== sanity test 398b: DIO and buffer IO race ============== 09:55:40 (1789134940) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.78401 s, 5.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145099: Fri Sep 11 09:58:44 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(5992KiB/159421msec) clat (usec): min=37, max=457749, avg=51884.78, stdev=41229.08 lat (usec): min=38, max=457751, avg=51887.89, stdev=41228.94 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 10945], 20.00th=[ 21890], | 30.00th=[ 28967], 40.00th=[ 36439], 50.00th=[ 43779], 60.00th=[ 52167], | 70.00th=[ 63701], 80.00th=[ 78119], 90.00th=[ 99091], 95.00th=[121111], | 99.00th=[187696], 99.50th=[238027], 99.90th=[400557], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 7, max= 118, per=25.35%, avg=37.76, stdev=19.56, samples=306 iops : min= 1, max= 29, avg= 8.77, stdev= 4.92, samples=306 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6296KiB/159421msec); 0 zone resets clat (usec): min=1100, max=950154, avg=51573.10, stdev=61031.92 lat (usec): min=1101, max=950156, avg=51580.55, stdev=61036.45 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1385], 10.00th=[ 1926], 20.00th=[ 5014], | 30.00th=[ 11600], 40.00th=[ 22676], 50.00th=[ 35914], 60.00th=[ 49021], | 70.00th=[ 65799], 80.00th=[ 83362], 90.00th=[122160], 95.00th=[152044], | 99.00th=[283116], 99.50th=[337642], 99.90th=[513803], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 151, per=25.04%, avg=39.06, stdev=20.21, samples=311 iops : min= 1, max= 37, avg= 9.10, stdev= 5.10, samples=311 lat (usec) : 50=0.20%, 100=3.55%, 250=0.72%, 500=0.03%, 750=0.07% lat (msec) : 2=5.31%, 4=3.39%, 10=6.15%, 20=8.27%, 50=31.41% lat (msec) : 100=28.52%, 250=11.65%, 500=0.68%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.72%, ctx=6713, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145102: Fri Sep 11 09:58:44 2026 read: IOPS=9, BW=37.4KiB/s (38.2kB/s)(5940KiB/159030msec) clat (usec): min=33, max=1050.2k, avg=51845.62, stdev=46072.59 lat (usec): min=33, max=1050.2k, avg=51852.49, stdev=46073.70 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 76], 10.00th=[ 13698], | 20.00th=[ 23725], 30.00th=[ 30540], 40.00th=[ 36439], | 50.00th=[ 43779], 60.00th=[ 51643], 70.00th=[ 62129], | 80.00th=[ 76022], 90.00th=[ 100140], 95.00th=[ 119014], | 99.00th=[ 168821], 99.50th=[ 204473], 99.90th=[ 549454], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 95, per=25.47%, avg=37.96, stdev=18.27, samples=304 iops : min= 1, max= 23, avg= 8.81, stdev= 4.60, samples=304 write: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6348KiB/159030msec); 0 zone resets clat (usec): min=997, max=980710, avg=51296.51, stdev=58962.69 lat (usec): min=997, max=980713, avg=51302.05, stdev=58963.47 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1385], 10.00th=[ 1942], 20.00th=[ 6063], | 30.00th=[ 11994], 40.00th=[ 23462], 50.00th=[ 35390], 60.00th=[ 50594], | 70.00th=[ 65274], 80.00th=[ 87557], 90.00th=[119014], 95.00th=[152044], | 99.00th=[248513], 99.50th=[320865], 99.90th=[557843], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 111, per=25.65%, avg=40.02, stdev=19.66, samples=308 iops : min= 1, max= 27, avg= 9.34, stdev= 4.95, samples=308 lat (usec) : 50=0.16%, 100=3.12%, 250=0.36%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.44%, 4=2.93%, 10=6.48%, 20=8.27%, 50=32.03% lat (msec) : 100=28.45%, 250=11.98%, 500=0.46%, 750=0.07%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.09%, sys=4.52%, ctx=6520, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145105: Fri Sep 11 09:58:44 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6028KiB/160566msec) clat (usec): min=37, max=270561, avg=51716.24, stdev=37754.90 lat (usec): min=37, max=270562, avg=51718.22, stdev=37754.99 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 74], 10.00th=[ 14746], 20.00th=[ 23987], | 30.00th=[ 29754], 40.00th=[ 36439], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 62653], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[119014], | 99.00th=[193987], 99.50th=[219153], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 135, per=25.48%, avg=37.96, stdev=19.18, samples=308 iops : min= 1, max= 33, avg= 8.82, stdev= 4.84, samples=308 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6260KiB/160566msec); 0 zone resets clat (usec): min=1084, max=1215.6k, avg=52382.82, stdev=68042.78 lat (usec): min=1085, max=1215.6k, avg=52394.83, stdev=68039.93 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1401], 10.00th=[ 1975], | 20.00th=[ 5800], 30.00th=[ 11338], 40.00th=[ 22414], | 50.00th=[ 35914], 60.00th=[ 49546], 70.00th=[ 66323], | 80.00th=[ 88605], 90.00th=[ 120062], 95.00th=[ 154141], | 99.00th=[ 240124], 99.50th=[ 312476], 99.90th=[1199571], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 127, per=25.20%, avg=39.30, stdev=19.34, samples=309 iops : min= 1, max= 31, avg= 9.16, stdev= 4.86, samples=309 lat (usec) : 50=0.26%, 100=3.22%, 250=0.23%, 500=0.03%, 750=0.03% lat (msec) : 2=5.24%, 4=3.09%, 10=6.25%, 20=8.17%, 50=32.19% lat (msec) : 100=28.78%, 250=11.98%, 500=0.46%, 2000=0.07% cpu : usr=0.08%, sys=4.63%, ctx=6725, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145106: Fri Sep 11 09:58:44 2026 read: IOPS=9, BW=38.1KiB/s (39.0kB/s)(6052KiB/158705msec) clat (usec): min=36, max=1008.9k, avg=53041.27, stdev=51064.14 lat (usec): min=36, max=1008.9k, avg=53043.39, stdev=51064.21 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 11600], | 20.00th=[ 22414], 30.00th=[ 28705], 40.00th=[ 35390], | 50.00th=[ 42730], 60.00th=[ 52167], 70.00th=[ 62129], | 80.00th=[ 77071], 90.00th=[ 103285], 95.00th=[ 129500], | 99.00th=[ 196084], 99.50th=[ 256902], 99.90th=[ 708838], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 111, per=25.70%, avg=38.29, stdev=18.90, samples=306 iops : min= 1, max= 27, avg= 8.91, stdev= 4.75, samples=306 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6236KiB/158705msec); 0 zone resets clat (usec): min=1031, max=402043, avg=49960.11, stdev=50677.63 lat (usec): min=1033, max=402054, avg=49966.91, stdev=50677.57 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1434], 10.00th=[ 2180], 20.00th=[ 6652], | 30.00th=[ 13566], 40.00th=[ 25560], 50.00th=[ 38011], 60.00th=[ 49021], | 70.00th=[ 63177], 80.00th=[ 83362], 90.00th=[112722], 95.00th=[149947], | 99.00th=[238027], 99.50th=[265290], 99.90th=[312476], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 126, per=25.13%, avg=39.20, stdev=19.52, samples=308 iops : min= 1, max= 31, avg= 9.13, stdev= 4.92, samples=308 lat (usec) : 50=0.29%, 100=3.55%, 250=0.42%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.75%, 4=2.57%, 10=6.15%, 20=7.71%, 50=33.50% lat (msec) : 100=28.65%, 250=11.62%, 500=0.52%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.72%, ctx=6652, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=150KiB/s (153kB/s), 37.4KiB/s-38.1KiB/s (38.2kB/s-39.0kB/s), io=23.4MiB (24.6MB), run=158705-160566msec WRITE: bw=157KiB/s (160kB/s), 38.0KiB/s-39.9KiB/s (39.9kB/s-40.9kB/s), io=24.6MiB (25.7MB), run=158705-160566msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145100: Fri Sep 11 10:01:14 2026 read: IOPS=4, BW=19.3KiB/s (19.8kB/s)(5992KiB/310135msec) clat (msec): min=5, max=940, avg=40.61, stdev=51.14 lat (msec): min=5, max=940, avg=40.62, stdev=51.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 53], 90.00th=[ 90], 95.00th=[ 134], | 99.00th=[ 226], 99.50th=[ 296], 99.90th=[ 493], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 87, per=29.31%, avg=22.57, stdev=15.83, samples=509 iops : min= 1, max= 21, avg= 4.99, stdev= 4.00, samples=509 write: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6296KiB/310135msec); 0 zone resets clat (msec): min=38, max=1285, avg=158.06, stdev=87.84 lat (msec): min=38, max=1285, avg=158.06, stdev=87.84 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 211], 90.00th=[ 264], 95.00th=[ 326], | 99.00th=[ 451], 99.50th=[ 506], 99.90th=[ 827], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 6, max= 48, per=25.05%, avg=20.29, stdev=10.06, samples=592 iops : min= 1, max= 12, avg= 4.40, stdev= 2.58, samples=592 lat (msec) : 10=2.90%, 20=16.63%, 50=19.27%, 100=18.39%, 250=36.39% lat (msec) : 500=6.12%, 750=0.20%, 1000=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.01%, ctx=4874, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145101: Fri Sep 11 10:01:14 2026 read: IOPS=4, BW=19.2KiB/s (19.7kB/s)(5940KiB/309188msec) clat (msec): min=6, max=1054, avg=41.33, stdev=54.35 lat (msec): min=6, max=1054, avg=41.33, stdev=54.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 55], 90.00th=[ 89], 95.00th=[ 129], | 99.00th=[ 247], 99.50th=[ 300], 99.90th=[ 527], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 87, per=29.48%, avg=22.70, stdev=15.72, samples=502 iops : min= 1, max= 21, avg= 5.02, stdev= 3.96, samples=502 write: IOPS=5, BW=20.5KiB/s (21.0kB/s)(6348KiB/309188msec); 0 zone resets clat (msec): min=34, max=975, avg=155.88, stdev=83.99 lat (msec): min=34, max=975, avg=155.88, stdev=83.99 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 209], 90.00th=[ 268], 95.00th=[ 313], | 99.00th=[ 464], 99.50th=[ 518], 99.90th=[ 592], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 48, per=25.41%, avg=20.59, stdev= 9.93, samples=589 iops : min= 1, max= 12, avg= 4.48, stdev= 2.56, samples=589 lat (msec) : 10=3.03%, 20=15.43%, 50=19.56%, 100=19.82%, 250=35.64% lat (msec) : 500=6.12%, 750=0.33%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.01%, ctx=5074, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145103: Fri Sep 11 10:01:14 2026 read: IOPS=4, BW=19.4KiB/s (19.9kB/s)(6028KiB/310301msec) clat (msec): min=5, max=519, avg=41.64, stdev=48.80 lat (msec): min=5, max=519, avg=41.65, stdev=48.80 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 57], 90.00th=[ 97], 95.00th=[ 133], | 99.00th=[ 247], 99.50th=[ 296], 99.90th=[ 460], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 103, per=29.55%, avg=22.76, stdev=16.12, samples=509 iops : min= 1, max= 25, avg= 5.03, stdev= 4.07, samples=509 write: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6260KiB/310301msec); 0 zone resets clat (msec): min=42, max=1308, avg=157.90, stdev=93.91 lat (msec): min=42, max=1308, avg=157.90, stdev=93.91 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 91], | 30.00th=[ 105], 40.00th=[ 117], 50.00th=[ 133], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 211], 90.00th=[ 271], 95.00th=[ 334], | 99.00th=[ 451], 99.50th=[ 527], 99.90th=[ 1267], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 6, max= 48, per=25.04%, avg=20.28, stdev=10.35, samples=590 iops : min= 1, max= 12, avg= 4.40, stdev= 2.65, samples=590 lat (msec) : 10=2.83%, 20=15.36%, 50=20.08%, 100=20.12%, 250=34.60% lat (msec) : 500=6.67%, 750=0.23%, 1000=0.03%, 2000=0.07% cpu : usr=0.05%, sys=1.08%, ctx=5080, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145104: Fri Sep 11 10:01:14 2026 read: IOPS=4, BW=19.6KiB/s (20.1kB/s)(6052KiB/307987msec) clat (msec): min=5, max=441, avg=40.67, stdev=44.47 lat (msec): min=5, max=441, avg=40.67, stdev=44.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 57], 90.00th=[ 97], 95.00th=[ 133], | 99.00th=[ 205], 99.50th=[ 275], 99.90th=[ 397], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 119, per=29.66%, avg=22.84, stdev=16.77, samples=509 iops : min= 1, max= 29, avg= 5.05, stdev= 4.24, samples=509 write: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6236KiB/307987msec); 0 zone resets clat (msec): min=32, max=974, avg=157.70, stdev=85.61 lat (msec): min=32, max=974, avg=157.70, stdev=85.61 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 211], 90.00th=[ 271], 95.00th=[ 313], | 99.00th=[ 430], 99.50th=[ 514], 99.90th=[ 869], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 55, per=24.85%, avg=20.12, stdev=10.16, samples=592 iops : min= 1, max= 13, avg= 4.36, stdev= 2.61, samples=592 lat (msec) : 10=3.09%, 20=16.24%, 50=19.14%, 100=18.98%, 250=36.00% lat (msec) : 500=6.28%, 750=0.20%, 1000=0.07% cpu : usr=0.05%, sys=1.02%, ctx=5042, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=77.4KiB/s (79.2kB/s), 19.2KiB/s-19.6KiB/s (19.7kB/s-20.1kB/s), io=23.4MiB (24.6MB), run=307987-310301msec WRITE: bw=81.0KiB/s (82.0kB/s), 20.2KiB/s-20.5KiB/s (20.7kB/s-21.0kB/s), io=24.6MiB (25.7MB), run=307987-310301msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145175: Fri Sep 11 10:01:57 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5920KiB/33433msec) clat (usec): min=39, max=203834, avg=43522.69, stdev=40534.26 lat (usec): min=40, max=203836, avg=43527.45, stdev=40534.95 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 64], 20.00th=[ 78], | 30.00th=[ 204], 40.00th=[ 27919], 50.00th=[ 41681], 60.00th=[ 50594], | 70.00th=[ 61080], 80.00th=[ 77071], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[154141], 99.50th=[177210], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 462, per=27.01%, avg=177.20, stdev=81.17, samples=65 iops : min= 1, max= 28, avg=10.29, stdev= 5.12, samples=65 write: IOPS=11, BW=190KiB/s (195kB/s)(6368KiB/33433msec); 0 zone resets clat (usec): min=1494, max=319325, avg=43122.76, stdev=47749.66 lat (usec): min=1495, max=319329, avg=43129.03, stdev=47749.80 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1958], 10.00th=[ 2999], 20.00th=[ 6521], | 30.00th=[ 11076], 40.00th=[ 17171], 50.00th=[ 26084], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 73925], 90.00th=[109577], 95.00th=[139461], | 99.00th=[219153], 99.50th=[254804], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 415, per=27.73%, avg=191.62, stdev=92.72, samples=65 iops : min= 1, max= 25, avg=11.22, stdev= 5.88, samples=65 lat (usec) : 50=2.21%, 100=11.07%, 250=1.30%, 500=0.26% lat (msec) : 2=3.39%, 4=4.43%, 10=7.55%, 20=8.98%, 50=25.65% lat (msec) : 100=24.35%, 250=10.55%, 500=0.26% cpu : usr=0.10%, sys=5.69%, ctx=1345, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145176: Fri Sep 11 10:01:57 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5744KiB/33927msec) clat (usec): min=36, max=201312, avg=46780.90, stdev=40277.49 lat (usec): min=37, max=201313, avg=46783.30, stdev=40277.73 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 20317], 40.00th=[ 33424], 50.00th=[ 43254], 60.00th=[ 54264], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[ 95945], 95.00th=[124257], | 99.00th=[160433], 99.50th=[198181], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 342, per=25.85%, avg=169.61, stdev=71.82, samples=66 iops : min= 1, max= 21, avg= 9.83, stdev= 4.57, samples=66 write: IOPS=12, BW=193KiB/s (198kB/s)(6544KiB/33927msec); 0 zone resets clat (usec): min=1535, max=418458, avg=41390.77, stdev=46761.95 lat (usec): min=1536, max=418459, avg=41393.98, stdev=46761.76 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1860], 10.00th=[ 2212], 20.00th=[ 5473], | 30.00th=[ 9896], 40.00th=[ 14877], 50.00th=[ 21365], 60.00th=[ 37487], | 70.00th=[ 55313], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[129500], | 99.00th=[191890], 99.50th=[204473], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 31, max= 413, per=27.95%, avg=193.15, stdev=78.04, samples=66 iops : min= 1, max= 25, avg=11.32, stdev= 4.97, samples=66 lat (usec) : 50=1.69%, 100=8.72%, 250=1.30%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.69%, 4=4.95%, 10=6.90%, 20=11.33%, 50=22.40% lat (msec) : 100=27.99%, 250=9.64%, 500=0.13% cpu : usr=0.06%, sys=5.07%, ctx=1381, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145177: Fri Sep 11 10:01:57 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36459msec) clat (usec): min=37, max=300699, avg=45854.26, stdev=43082.67 lat (usec): min=37, max=300701, avg=45857.99, stdev=43081.94 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 97], | 30.00th=[ 21103], 40.00th=[ 32375], 50.00th=[ 39060], 60.00th=[ 52167], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 98042], 95.00th=[124257], | 99.00th=[187696], 99.50th=[270533], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 347, per=26.19%, avg=171.77, stdev=80.89, samples=71 iops : min= 1, max= 21, avg= 9.97, stdev= 5.15, samples=71 write: IOPS=10, BW=165KiB/s (169kB/s)(6032KiB/36459msec); 0 zone resets clat (usec): min=1445, max=437444, avg=48485.62, stdev=61517.74 lat (usec): min=1446, max=437447, avg=48494.42, stdev=61513.92 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1909], 10.00th=[ 3326], 20.00th=[ 6915], | 30.00th=[ 9765], 40.00th=[ 15795], 50.00th=[ 24773], 60.00th=[ 39584], | 70.00th=[ 53740], 80.00th=[ 78119], 90.00th=[121111], 95.00th=[164627], | 99.00th=[287310], 99.50th=[362808], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 31, max= 504, per=23.66%, avg=163.52, stdev=84.74, samples=71 iops : min= 1, max= 31, avg= 9.45, stdev= 5.33, samples=71 lat (usec) : 50=1.17%, 100=9.51%, 250=1.43%, 500=0.26%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=2.86%, 4=4.30%, 10=8.72%, 20=8.33%, 50=26.17% lat (msec) : 100=24.48%, 250=10.94%, 500=1.30% cpu : usr=0.07%, sys=5.21%, ctx=1414, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145178: Fri Sep 11 10:01:57 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(6032KiB/34901msec) clat (usec): min=36, max=267088, avg=46772.52, stdev=44295.00 lat (usec): min=36, max=267090, avg=46774.23, stdev=44295.01 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 1549], 40.00th=[ 32113], 50.00th=[ 43779], 60.00th=[ 54789], | 70.00th=[ 68682], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[125305], | 99.00th=[200279], 99.50th=[242222], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 318, per=26.45%, avg=173.54, stdev=74.90, samples=67 iops : min= 1, max= 19, avg=10.10, stdev= 4.77, samples=67 write: IOPS=11, BW=179KiB/s (184kB/s)(6256KiB/34901msec); 0 zone resets clat (usec): min=1516, max=394420, avg=43537.79, stdev=49942.47 lat (usec): min=1517, max=394424, avg=43569.04, stdev=49950.93 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2114], 10.00th=[ 3884], 20.00th=[ 7308], | 30.00th=[ 10290], 40.00th=[ 14222], 50.00th=[ 24511], 60.00th=[ 38536], | 70.00th=[ 53216], 80.00th=[ 73925], 90.00th=[112722], 95.00th=[143655], | 99.00th=[210764], 99.50th=[235930], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 31, max= 377, per=26.17%, avg=180.82, stdev=75.88, samples=67 iops : min= 1, max= 23, avg=10.55, stdev= 4.84, samples=67 lat (usec) : 50=1.95%, 100=10.16%, 250=2.08%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.34%, 4=3.91%, 10=9.77%, 20=9.51%, 50=21.88% lat (msec) : 100=26.04%, 250=11.59%, 500=0.26% cpu : usr=0.06%, sys=4.95%, ctx=1288, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=657KiB/s (673kB/s), 169KiB/s-177KiB/s (173kB/s-181kB/s), io=23.4MiB (24.5MB), run=33433-36459msec WRITE: bw=691KiB/s (708kB/s), 165KiB/s-193KiB/s (169kB/s-198kB/s), io=24.6MiB (25.8MB), run=33433-36459msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145180: Fri Sep 11 10:02:42 2026 read: IOPS=4, BW=72.7KiB/s (74.4kB/s)(5920KiB/81461msec) clat (msec): min=7, max=461, avg=44.10, stdev=54.31 lat (msec): min=7, max=461, avg=44.11, stdev=54.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 53], 90.00th=[ 103], 95.00th=[ 163], | 99.00th=[ 296], 99.50th=[ 422], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 350, per=30.34%, avg=88.91, stdev=61.55, samples=130 iops : min= 1, max= 21, avg= 4.76, stdev= 3.89, samples=130 write: IOPS=4, BW=78.2KiB/s (80.0kB/s)(6368KiB/81461msec); 0 zone resets clat (msec): min=46, max=551, avg=163.54, stdev=92.49 lat (msec): min=46, max=551, avg=163.55, stdev=92.49 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 95], | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 174], 80.00th=[ 209], 90.00th=[ 313], 95.00th=[ 355], | 99.00th=[ 493], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 23, max= 160, per=26.06%, avg=80.27, stdev=38.77, samples=155 iops : min= 1, max= 10, avg= 4.19, stdev= 2.51, samples=155 lat (msec) : 10=1.43%, 20=13.80%, 50=23.18%, 100=17.45%, 250=35.29% lat (msec) : 500=8.46%, 750=0.39% cpu : usr=0.04%, sys=1.18%, ctx=1327, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145181: Fri Sep 11 10:02:42 2026 read: IOPS=4, BW=70.4KiB/s (72.1kB/s)(5744KiB/81616msec) clat (msec): min=6, max=411, avg=46.27, stdev=50.07 lat (msec): min=6, max=411, avg=46.27, stdev=50.07 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 44], 80.00th=[ 65], 90.00th=[ 122], 95.00th=[ 148], | 99.00th=[ 228], 99.50th=[ 313], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 23, max= 286, per=29.61%, avg=86.74, stdev=59.48, samples=129 iops : min= 1, max= 17, avg= 4.62, stdev= 3.78, samples=129 write: IOPS=5, BW=80.2KiB/s (82.1kB/s)(6544KiB/81616msec); 0 zone resets clat (msec): min=45, max=596, avg=158.77, stdev=86.94 lat (msec): min=45, max=596, avg=158.78, stdev=86.94 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 83], 20.00th=[ 95], | 30.00th=[ 108], 40.00th=[ 122], 50.00th=[ 134], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 201], 90.00th=[ 275], 95.00th=[ 326], | 99.00th=[ 485], 99.50th=[ 514], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 30, max= 160, per=26.47%, avg=81.51, stdev=40.02, samples=156 iops : min= 1, max= 10, avg= 4.28, stdev= 2.56, samples=156 lat (msec) : 10=1.95%, 20=13.28%, 50=20.05%, 100=18.23%, 250=39.58% lat (msec) : 500=6.38%, 750=0.52% cpu : usr=0.04%, sys=1.15%, ctx=1326, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145182: Fri Sep 11 10:02:42 2026 read: IOPS=4, BW=78.8KiB/s (80.6kB/s)(6256KiB/79441msec) clat (msec): min=6, max=302, avg=41.33, stdev=43.92 lat (msec): min=6, max=302, avg=41.33, stdev=43.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 105], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 275], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 23, max= 347, per=31.19%, avg=91.39, stdev=66.43, samples=135 iops : min= 1, max= 21, avg= 4.90, stdev= 4.19, samples=135 write: IOPS=4, BW=75.9KiB/s (77.8kB/s)(6032KiB/79441msec); 0 zone resets clat (msec): min=41, max=556, avg=167.65, stdev=89.67 lat (msec): min=41, max=556, avg=167.65, stdev=89.67 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 71], 10.00th=[ 84], 20.00th=[ 97], | 30.00th=[ 115], 40.00th=[ 129], 50.00th=[ 140], 60.00th=[ 159], | 70.00th=[ 184], 80.00th=[ 230], 90.00th=[ 296], 95.00th=[ 368], | 99.00th=[ 468], 99.50th=[ 527], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 160, per=25.34%, avg=78.05, stdev=35.37, samples=151 iops : min= 1, max= 10, avg= 4.06, stdev= 2.29, samples=151 lat (msec) : 10=1.43%, 20=14.84%, 50=24.48%, 100=15.63%, 250=35.55% lat (msec) : 500=7.68%, 750=0.39% cpu : usr=0.04%, sys=1.08%, ctx=1287, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145183: Fri Sep 11 10:02:42 2026 read: IOPS=4, BW=75.7KiB/s (77.5kB/s)(6032KiB/79693msec) clat (msec): min=7, max=381, avg=43.99, stdev=46.40 lat (msec): min=7, max=381, avg=44.00, stdev=46.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 99], 95.00th=[ 132], | 99.00th=[ 218], 99.50th=[ 338], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 288, per=30.96%, avg=90.72, stdev=60.93, samples=130 iops : min= 1, max= 18, avg= 4.85, stdev= 3.88, samples=130 write: IOPS=4, BW=78.5KiB/s (80.4kB/s)(6256KiB/79693msec); 0 zone resets clat (msec): min=48, max=553, avg=161.28, stdev=84.85 lat (msec): min=48, max=553, avg=161.28, stdev=84.85 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 95], | 30.00th=[ 107], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 215], 90.00th=[ 275], 95.00th=[ 338], | 99.00th=[ 443], 99.50th=[ 464], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 192, per=26.63%, avg=82.01, stdev=39.94, samples=150 iops : min= 1, max= 12, avg= 4.31, stdev= 2.55, samples=150 lat (msec) : 10=1.43%, 20=13.15%, 50=22.01%, 100=20.18%, 250=35.42% lat (msec) : 500=7.68%, 750=0.13% cpu : usr=0.04%, sys=1.18%, ctx=1342, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=293KiB/s (301kB/s), 70.4KiB/s-78.8KiB/s (72.1kB/s-80.6kB/s), io=23.4MiB (24.5MB), run=79441-81616msec WRITE: bw=309KiB/s (316kB/s), 75.9KiB/s-80.2KiB/s (77.8kB/s-82.1kB/s), io=24.6MiB (25.8MB), run=79441-81616msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145208: Fri Sep 11 10:03:00 2026 read: IOPS=0, BW=990KiB/s (1014kB/s)(7168KiB/7240msec) clat (usec): min=1353, max=283623, avg=189677.88, stdev=92748.18 lat (usec): min=1355, max=283625, avg=189679.60, stdev=92748.31 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1352], 10.00th=[ 1352], 20.00th=[170918], | 30.00th=[175113], 40.00th=[175113], 50.00th=[206570], 60.00th=[238027], | 70.00th=[238027], 80.00th=[252707], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 2007, max= 3518, per=85.48%, avg=2327.60, stdev=665.62, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=707KiB/s (724kB/s)(5120KiB/7240msec); 0 zone resets clat (msec): min=280, max=3334, avg=1181.50, stdev=1299.44 lat (msec): min=280, max=3334, avg=1181.62, stdev=1299.40 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1910, max= 2043, per=52.46%, avg=1999.75, stdev=60.66, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 2=8.33%, 250=33.33%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.05%, ctx=362, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145209: Fri Sep 11 10:03:00 2026 read: IOPS=0, BW=283KiB/s (290kB/s)(2048KiB/7232msec) clat (msec): min=354, max=385, avg=370.08, stdev=22.22 lat (msec): min=354, max=385, avg=370.08, stdev=22.22 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1715, max= 2019, per=68.56%, avg=1867.00, stdev=214.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1416KiB/s (1450kB/s)(10.0MiB/7232msec); 0 zone resets clat (msec): min=86, max=2783, avg=648.76, stdev=777.71 lat (msec): min=86, max=2783, avg=648.98, stdev=777.67 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 275], | 30.00th=[ 300], 40.00th=[ 334], 50.00th=[ 342], 60.00th=[ 422], | 70.00th=[ 464], 80.00th=[ 684], 90.00th=[ 802], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1910, max= 4087, per=72.14%, avg=2750.00, stdev=1047.17, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 500=66.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.67%, ctx=218, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145210: Fri Sep 11 10:03:00 2026 read: IOPS=1, BW=1577KiB/s (1615kB/s)(6144KiB/3896msec) clat (usec): min=645, max=396560, avg=122296.32, stdev=166934.75 lat (usec): min=647, max=396564, avg=122298.08, stdev=166935.11 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 725], | 30.00th=[ 725], 40.00th=[ 1106], 50.00th=[ 1106], 60.00th=[ 78119], | 70.00th=[256902], 80.00th=[256902], 90.00th=[396362], 95.00th=[396362], | 99.00th=[396362], 99.50th=[396362], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 1841, max= 4087, per=90.50%, avg=2464.25, stdev=1084.31, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1577KiB/s (1615kB/s)(6144KiB/3896msec); 0 zone resets clat (msec): min=217, max=895, avg=526.77, stdev=224.69 lat (msec): min=217, max=895, avg=526.90, stdev=224.69 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 542], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1741, max= 2043, per=50.63%, avg=1930.20, stdev=132.53, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 100=8.33%, 250=8.33%, 500=33.33%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=10.58%, ctx=119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145211: Fri Sep 11 10:03:00 2026 read: IOPS=0, BW=681KiB/s (697kB/s)(5120KiB/7521msec) clat (usec): min=415, max=3501.7k, avg=765648.88, stdev=1535855.45 lat (usec): min=416, max=3501.7k, avg=765650.65, stdev=1535855.76 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], | 20.00th=[ 416], 30.00th=[ 709], 40.00th=[ 709], | 50.00th=[ 2024], 60.00th=[ 2024], 70.00th=[ 325059], | 80.00th=[ 325059], 90.00th=[3506439], 95.00th=[3506439], | 99.00th=[3506439], 99.50th=[3506439], 99.90th=[3506439], | 99.95th=[3506439], 99.99th=[3506439] bw ( KiB/s): min= 2019, max= 6095, per=100.00%, avg=4057.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=953KiB/s (976kB/s)(7168KiB/7521msec); 0 zone resets clat (msec): min=129, max=1182, avg=526.51, stdev=358.72 lat (msec): min=129, max=1182, avg=526.62, stdev=358.74 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 213], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 439], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 684], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 2007, max= 4087, per=66.53%, avg=2536.00, stdev=1034.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=25.00%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=7.74%, ctx=543, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2723KiB/s (2788kB/s), 283KiB/s-1577KiB/s (290kB/s-1615kB/s), io=20.0MiB (20.0MB), run=3896-7521msec WRITE: bw=3812KiB/s (3904kB/s), 707KiB/s-1577KiB/s (724kB/s-1615kB/s), io=28.0MiB (29.4MB), run=3896-7521msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145203: Fri Sep 11 10:03:00 2026 read: IOPS=0, BW=992KiB/s (1016kB/s)(7168KiB/7223msec) clat (msec): min=102, max=211, avg=152.98, stdev=37.39 lat (msec): min=102, max=211, avg=152.98, stdev=37.39 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 125], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 167], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 211], 95.00th=[ 211], | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 1946, max= 4134, per=98.96%, avg=2524.50, stdev=1073.42, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=709KiB/s (726kB/s)(5120KiB/7223msec); 0 zone resets clat (msec): min=205, max=3843, avg=1207.48, stdev=1530.42 lat (msec): min=206, max=3844, avg=1207.83, stdev=1530.60 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 2015, max= 3893, per=74.09%, avg=2646.33, stdev=1079.67, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.77%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145204: Fri Sep 11 10:03:00 2026 read: IOPS=0, BW=259KiB/s (266kB/s)(2048KiB/7894msec) clat (msec): min=94, max=180, avg=137.19, stdev=60.57 lat (msec): min=94, max=180, avg=137.19, stdev=60.57 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 94], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1512, max= 1946, per=67.78%, avg=1729.00, stdev=306.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1297KiB/s (1328kB/s)(10.0MiB/7894msec); 0 zone resets clat (msec): min=188, max=2845, avg=755.21, stdev=810.23 lat (msec): min=188, max=2845, avg=755.53, stdev=810.19 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 222], | 30.00th=[ 253], 40.00th=[ 292], 50.00th=[ 321], 60.00th=[ 575], | 70.00th=[ 667], 80.00th=[ 1062], 90.00th=[ 1133], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1512, max= 4063, per=70.25%, avg=2509.29, stdev=1071.09, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=3.45%, ctx=132, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145205: Fri Sep 11 10:03:00 2026 read: IOPS=0, BW=766KiB/s (784kB/s)(6144KiB/8026msec) clat (msec): min=103, max=3536, avg=779.73, stdev=1356.45 lat (msec): min=103, max=3536, avg=779.74, stdev=1356.45 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 372], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1889, max= 2031, per=78.19%, avg=1994.60, stdev=60.01, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=766KiB/s (784kB/s)(6144KiB/8026msec); 0 zone resets clat (msec): min=234, max=978, avg=540.37, stdev=293.37 lat (msec): min=234, max=978, avg=540.53, stdev=293.35 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 609], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1381, max= 4047, per=63.78%, avg=2278.40, stdev=1023.35, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.71%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145206: Fri Sep 11 10:03:00 2026 read: IOPS=0, BW=698KiB/s (715kB/s)(5120KiB/7331msec) clat (msec): min=98, max=627, avg=305.01, stdev=217.52 lat (msec): min=98, max=627, avg=305.01, stdev=217.52 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1889, max= 2031, per=77.12%, avg=1967.25, stdev=63.03, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=978KiB/s (1001kB/s)(7168KiB/7331msec); 0 zone resets clat (msec): min=209, max=2745, avg=821.76, stdev=881.63 lat (msec): min=210, max=2745, avg=821.87, stdev=881.64 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 251], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 600], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 810], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 2003, max= 2775, per=61.81%, avg=2208.00, stdev=378.30, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=2.14%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2552KiB/s (2613kB/s), 259KiB/s-992KiB/s (266kB/s-1016kB/s), io=20.0MiB (20.0MB), run=7223-8026msec WRITE: bw=3572KiB/s (3658kB/s), 709KiB/s-1297KiB/s (726kB/s-1328kB/s), io=28.0MiB (29.4MB), run=7223-8026msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145223: Fri Sep 11 10:03:13 2026 read: IOPS=1, BW=4190KiB/s (4290kB/s)(12.0MiB/2933msec) clat (msec): min=759, max=1038, avg=864.94, stdev=151.33 lat (msec): min=759, max=1038, avg=864.95, stdev=151.33 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7922, max= 8143, per=100.00%, avg=8032.50, stdev=156.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=15.79%, ctx=416, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145224: Fri Sep 11 10:03:13 2026 read: IOPS=0, BW=988KiB/s (1011kB/s)(4096KiB/4147msec) clat (nsec): min=651308k, max=651308k, avg=651308288.00, stdev= 0.00 lat (nsec): min=651311k, max=651311k, avg=651310661.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1975KiB/s (2023kB/s)(8192KiB/4147msec); 0 zone resets clat (msec): min=1135, max=1910, avg=1522.93, stdev=547.46 lat (msec): min=1136, max=1910, avg=1523.38, stdev=547.46 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1905], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.71%, ctx=140, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145225: Fri Sep 11 10:03:13 2026 write: IOPS=0, BW=2940KiB/s (3011kB/s)(12.0MiB/4179msec); 0 zone resets clat (msec): min=345, max=1826, avg=1279.15, stdev=812.57 lat (msec): min=347, max=1827, avg=1280.13, stdev=812.10 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.03%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145226: Fri Sep 11 10:03:13 2026 write: IOPS=1, BW=4728KiB/s (4841kB/s)(12.0MiB/2599msec); 0 zone resets clat (msec): min=314, max=1621, avg=813.78, stdev=705.76 lat (msec): min=315, max=1621, avg=814.30, stdev=705.77 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 5475, max= 7922, per=85.43%, avg=6698.50, stdev=1730.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=5.85%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3951KiB/s (4046kB/s), 988KiB/s-4190KiB/s (1011kB/s-4290kB/s), io=16.0MiB (16.8MB), run=2933-4147msec WRITE: bw=7841KiB/s (8029kB/s), 1975KiB/s-4728KiB/s (2023kB/s-4841kB/s), io=32.0MiB (33.6MB), run=2599-4179msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145219: Fri Sep 11 10:03:14 2026 read: IOPS=0, BW=3683KiB/s (3772kB/s)(12.0MiB/3336msec) clat (msec): min=231, max=1820, avg=1034.94, stdev=794.29 lat (msec): min=231, max=1820, avg=1034.94, stdev=794.29 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.02%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145220: Fri Sep 11 10:03:14 2026 read: IOPS=0, BW=1152KiB/s (1180kB/s)(4096KiB/3555msec) clat (nsec): min=265047k, max=265047k, avg=265046664.00, stdev= 0.00 lat (nsec): min=265049k, max=265049k, avg=265049338.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 6977, max= 6977, per=100.00%, avg=6977.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2304KiB/s (2360kB/s)(8192KiB/3555msec); 0 zone resets clat (msec): min=1420, max=1630, avg=1525.42, stdev=148.63 lat (msec): min=1420, max=1631, avg=1525.93, stdev=148.60 clat percentiles (msec): | 1.00th=[ 1418], 5.00th=[ 1418], 10.00th=[ 1418], 20.00th=[ 1418], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.53%, ctx=55, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145221: Fri Sep 11 10:03:14 2026 write: IOPS=0, BW=2611KiB/s (2673kB/s)(12.0MiB/4707msec); 0 zone resets clat (msec): min=254, max=2107, avg=1454.86, stdev=1040.97 lat (msec): min=254, max=2109, avg=1455.84, stdev=1041.64 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 2005], 50.00th=[ 2005], 60.00th=[ 2005], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=2.12%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145222: Fri Sep 11 10:03:14 2026 write: IOPS=0, BW=4054KiB/s (4151kB/s)(12.0MiB/3031msec); 0 zone resets clat (msec): min=719, max=1110, avg=936.87, stdev=199.28 lat (msec): min=722, max=1112, avg=939.73, stdev=198.61 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.10%, sys=7.46%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4609KiB/s (4719kB/s), 1152KiB/s-3683KiB/s (1180kB/s-3772kB/s), io=16.0MiB (16.8MB), run=3336-3555msec WRITE: bw=6962KiB/s (7129kB/s), 2304KiB/s-4054KiB/s (2360kB/s-4151kB/s), io=32.0MiB (33.6MB), run=3031-4707msec