== sanity test 398b: DIO and buffer IO race ============== 20:33:10 (1788395590) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.44442 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180852: Wed Sep 2 20:35:19 2026 read: IOPS=13, BW=55.7KiB/s (56.0kB/s)(5992KiB/107656msec) clat (usec): min=42, max=691961, avg=39544.70, stdev=30539.79 lat (usec): min=42, max=691963, avg=39546.45, stdev=30539.16 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 10421], 10.00th=[ 14746], 20.00th=[ 19792], | 30.00th=[ 24511], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 45876], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[135267], 99.50th=[145753], 99.90th=[208667], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 143, per=25.56%, avg=55.46, stdev=21.86, samples=212 iops : min= 1, max= 35, avg=13.23, stdev= 5.49, samples=212 write: IOPS=14, BW=58.5KiB/s (59.9kB/s)(6296KiB/107656msec); 0 zone resets clat (usec): min=998, max=263269, avg=30664.48, stdev=32015.84 lat (usec): min=999, max=263270, avg=30667.25, stdev=32018.62 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1614], 20.00th=[ 3294], | 30.00th=[ 5932], 40.00th=[ 13960], 50.00th=[ 22414], 60.00th=[ 29754], | 70.00th=[ 39584], 80.00th=[ 52167], 90.00th=[ 73925], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[147850], 99.90th=[214959], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 151, per=25.54%, avg=58.22, stdev=23.38, samples=212 iops : min= 1, max= 37, avg=13.93, stdev= 5.88, samples=212 lat (usec) : 50=0.26%, 100=1.33%, 250=0.23%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.54%, 4=5.47%, 10=7.03%, 20=13.18%, 50=42.22% lat (msec) : 100=19.89%, 250=3.68%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.39%, ctx=6718, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180853: Wed Sep 2 20:35:19 2026 read: IOPS=14, BW=56.3KiB/s (57.6kB/s)(5940KiB/105548msec) clat (usec): min=43, max=636634, avg=38697.82, stdev=29510.95 lat (usec): min=43, max=636637, avg=38699.05, stdev=29511.03 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10421], 10.00th=[ 14484], 20.00th=[ 19006], | 30.00th=[ 23462], 40.00th=[ 27657], 50.00th=[ 32900], 60.00th=[ 39584], | 70.00th=[ 45351], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[125305], 99.50th=[145753], 99.90th=[208667], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 15, max= 120, per=25.76%, avg=55.89, stdev=21.60, samples=207 iops : min= 3, max= 30, avg=13.35, stdev= 5.43, samples=207 write: IOPS=15, BW=60.1KiB/s (61.6kB/s)(6348KiB/105548msec); 0 zone resets clat (usec): min=985, max=243666, avg=30172.70, stdev=31113.76 lat (usec): min=986, max=243667, avg=30175.97, stdev=31113.62 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1680], 20.00th=[ 3458], | 30.00th=[ 6390], 40.00th=[ 13698], 50.00th=[ 22676], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 51643], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[123208], 99.50th=[147850], 99.90th=[242222], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 15, max= 167, per=26.15%, avg=59.62, stdev=24.51, samples=207 iops : min= 3, max= 41, avg=14.29, stdev= 6.15, samples=207 lat (usec) : 50=0.20%, 100=1.50%, 250=0.16%, 750=0.10%, 1000=0.03% lat (msec) : 2=6.41%, 4=5.63%, 10=7.19%, 20=13.48%, 50=42.77% lat (msec) : 100=19.47%, 250=3.03%, 750=0.03% cpu : usr=0.09%, sys=5.52%, ctx=6664, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180854: Wed Sep 2 20:35:19 2026 read: IOPS=13, BW=54.7KiB/s (56.0kB/s)(6028KiB/110153msec) clat (usec): min=39, max=265255, avg=39504.51, stdev=26608.51 lat (usec): min=39, max=265256, avg=39506.70, stdev=26607.74 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9241], 10.00th=[ 14484], 20.00th=[ 19792], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 55837], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[162530], 99.90th=[179307], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 15, max= 119, per=25.11%, avg=54.49, stdev=19.19, samples=217 iops : min= 3, max= 29, avg=12.99, stdev= 4.82, samples=217 write: IOPS=14, BW=56.8KiB/s (58.2kB/s)(6260KiB/110153msec); 0 zone resets clat (usec): min=912, max=701261, avg=32253.81, stdev=36465.44 lat (usec): min=913, max=701262, avg=32255.40, stdev=36465.37 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1795], 20.00th=[ 3556], | 30.00th=[ 6915], 40.00th=[ 15664], 50.00th=[ 23725], 60.00th=[ 31327], | 70.00th=[ 42730], 80.00th=[ 55313], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[160433], 99.90th=[256902], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 142, per=24.82%, avg=56.60, stdev=25.15, samples=217 iops : min= 1, max= 35, avg=13.53, stdev= 6.30, samples=217 lat (usec) : 50=0.26%, 100=1.69%, 250=0.16%, 1000=0.07% lat (msec) : 2=5.73%, 4=5.24%, 10=7.23%, 20=12.92%, 50=41.57% lat (msec) : 100=21.45%, 250=3.58%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.16%, ctx=6621, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180855: Wed Sep 2 20:35:19 2026 read: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6052KiB/105995msec) clat (usec): min=30, max=199702, avg=38353.85, stdev=25903.41 lat (usec): min=30, max=199702, avg=38356.11, stdev=25905.28 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 4113], 10.00th=[ 14615], 20.00th=[ 19268], | 30.00th=[ 23462], 40.00th=[ 27132], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 45876], 80.00th=[ 55313], 90.00th=[ 68682], 95.00th=[ 85459], | 99.00th=[135267], 99.50th=[152044], 99.90th=[164627], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 7, max= 111, per=26.21%, avg=56.87, stdev=20.54, samples=208 iops : min= 1, max= 27, avg=13.59, stdev= 5.16, samples=208 write: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6236KiB/105995msec); 0 zone resets clat (usec): min=992, max=660158, avg=30639.47, stdev=33897.23 lat (usec): min=993, max=660160, avg=30645.27, stdev=33898.59 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1729], 20.00th=[ 3392], | 30.00th=[ 6915], 40.00th=[ 14746], 50.00th=[ 22414], 60.00th=[ 30016], | 70.00th=[ 40109], 80.00th=[ 52167], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[147850], 99.90th=[168821], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 143, per=25.69%, avg=58.56, stdev=24.61, samples=208 iops : min= 1, max= 35, avg=14.02, stdev= 6.19, samples=208 lat (usec) : 50=0.33%, 100=1.95%, 250=0.10%, 750=0.03%, 1000=0.03% lat (msec) : 2=6.02%, 4=5.27%, 10=6.54%, 20=14.42%, 50=41.86% lat (msec) : 100=20.41%, 250=2.99%, 750=0.03% cpu : usr=0.08%, sys=5.49%, ctx=6716, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=218KiB/s (223kB/s), 54.7KiB/s-57.1KiB/s (56.0kB/s-58.5kB/s), io=23.4MiB (24.6MB), run=105548-110153msec WRITE: bw=228KiB/s (234kB/s), 56.8KiB/s-60.1KiB/s (58.2kB/s-61.6kB/s), io=24.6MiB (25.7MB), run=105548-110153msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180847: Wed Sep 2 20:35:58 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(5992KiB/146870msec) clat (msec): min=5, max=761, avg=38.92, stdev=37.83 lat (msec): min=5, max=761, avg=38.92, stdev=37.82 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 105], | 99.00th=[ 178], 99.50th=[ 207], 99.90th=[ 249], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 135, per=25.41%, avg=40.91, stdev=24.52, samples=286 iops : min= 1, max= 33, avg= 9.56, stdev= 6.18, samples=286 write: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6296KiB/146870msec); 0 zone resets clat (msec): min=11, max=313, avg=56.03, stdev=36.57 lat (msec): min=11, max=313, avg=56.03, stdev=36.57 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 80], 90.00th=[ 104], 95.00th=[ 128], | 99.00th=[ 188], 99.50th=[ 205], 99.90th=[ 296], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 128, per=25.16%, avg=42.52, stdev=22.95, samples=289 iops : min= 1, max= 32, avg= 9.96, stdev= 5.76, samples=289 lat (msec) : 10=2.02%, 20=16.70%, 50=48.18%, 100=24.77%, 250=8.24% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=1.97%, ctx=4714, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180848: Wed Sep 2 20:35:58 2026 read: IOPS=10, BW=40.2KiB/s (41.2kB/s)(5940KiB/147745msec) clat (msec): min=5, max=737, avg=37.58, stdev=36.99 lat (msec): min=5, max=737, avg=37.59, stdev=36.98 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 174], 99.50th=[ 184], 99.90th=[ 249], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 159, per=25.14%, avg=40.48, stdev=26.19, samples=285 iops : min= 1, max= 39, avg= 9.45, stdev= 6.58, samples=285 write: IOPS=10, BW=42.0KiB/s (43.0kB/s)(6348KiB/147745msec); 0 zone resets clat (msec): min=10, max=312, avg=57.66, stdev=38.85 lat (msec): min=10, max=312, avg=57.67, stdev=38.85 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 115], 95.00th=[ 133], | 99.00th=[ 190], 99.50th=[ 203], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 118, per=25.13%, avg=42.47, stdev=22.65, samples=290 iops : min= 1, max= 29, avg= 9.95, stdev= 5.68, samples=290 lat (msec) : 10=2.05%, 20=17.02%, 50=48.57%, 100=22.49%, 250=9.67% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.06%, sys=1.84%, ctx=4630, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180849: Wed Sep 2 20:35:58 2026 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6028KiB/148443msec) clat (msec): min=6, max=277, avg=38.42, stdev=32.48 lat (msec): min=6, max=277, avg=38.43, stdev=32.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 106], | 99.00th=[ 161], 99.50th=[ 197], 99.90th=[ 271], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 134, per=25.18%, avg=40.54, stdev=24.11, samples=290 iops : min= 1, max= 33, avg= 9.46, stdev= 6.06, samples=290 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6260KiB/148443msec); 0 zone resets clat (msec): min=9, max=749, avg=57.59, stdev=42.08 lat (msec): min=9, max=749, avg=57.61, stdev=42.09 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 108], 95.00th=[ 133], | 99.00th=[ 201], 99.50th=[ 245], 99.90th=[ 305], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 119, per=24.84%, avg=41.98, stdev=23.56, samples=291 iops : min= 1, max= 29, avg= 9.83, stdev= 5.92, samples=291 lat (msec) : 10=1.89%, 20=16.28%, 50=48.01%, 100=24.35%, 250=9.21% lat (msec) : 500=0.23%, 750=0.03% cpu : usr=0.06%, sys=1.88%, ctx=4714, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180850: Wed Sep 2 20:35:58 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6052KiB/148666msec) clat (msec): min=5, max=281, avg=38.86, stdev=34.82 lat (msec): min=5, max=281, avg=38.86, stdev=34.82 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 112], | 99.00th=[ 176], 99.50th=[ 209], 99.90th=[ 271], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 143, per=25.32%, avg=40.77, stdev=25.15, samples=289 iops : min= 1, max= 35, avg= 9.52, stdev= 6.31, samples=289 write: IOPS=10, BW=41.9KiB/s (42.0kB/s)(6236KiB/148666msec); 0 zone resets clat (msec): min=10, max=752, avg=57.38, stdev=42.10 lat (msec): min=10, max=752, avg=57.38, stdev=42.10 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 82], 90.00th=[ 107], 95.00th=[ 133], | 99.00th=[ 201], 99.50th=[ 245], 99.90th=[ 309], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 119, per=24.84%, avg=41.97, stdev=23.16, samples=289 iops : min= 1, max= 29, avg= 9.82, stdev= 5.80, samples=289 lat (msec) : 10=2.28%, 20=16.83%, 50=47.56%, 100=24.02%, 250=9.08% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=1.86%, ctx=4747, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=162KiB/s (165kB/s), 40.2KiB/s-40.8KiB/s (41.2kB/s-41.8kB/s), io=23.4MiB (24.6MB), run=146870-148666msec WRITE: bw=169KiB/s (173kB/s), 41.9KiB/s-42.0KiB/s (42.0kB/s-43.0kB/s), io=24.6MiB (25.7MB), run=146870-148666msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180889: Wed Sep 2 20:36:37 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(5920KiB/28257msec) clat (usec): min=36, max=129050, avg=39081.50, stdev=26592.59 lat (usec): min=36, max=129051, avg=39082.88, stdev=26592.50 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 77], 20.00th=[ 18744], | 30.00th=[ 23987], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 56886], 90.00th=[ 70779], 95.00th=[ 93848], | 99.00th=[114820], 99.50th=[126354], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 63, max= 438, per=24.12%, avg=204.33, stdev=74.31, samples=55 iops : min= 3, max= 27, avg=12.00, stdev= 4.72, samples=55 write: IOPS=14, BW=225KiB/s (231kB/s)(6368KiB/28257msec); 0 zone resets clat (usec): min=1412, max=178531, avg=34483.68, stdev=33658.00 lat (usec): min=1414, max=178533, avg=34488.80, stdev=33655.69 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2376], 10.00th=[ 3097], 20.00th=[ 5342], | 30.00th=[ 8586], 40.00th=[ 16450], 50.00th=[ 23725], 60.00th=[ 32375], | 70.00th=[ 44303], 80.00th=[ 61604], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[141558], 99.50th=[175113], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 477, per=24.94%, avg=222.22, stdev=81.50, samples=55 iops : min= 1, max= 29, avg=13.13, stdev= 5.20, samples=55 lat (usec) : 50=0.39%, 100=4.69%, 250=0.78%, 500=0.13% lat (msec) : 2=2.08%, 4=5.47%, 10=9.90%, 20=10.29%, 50=37.89% lat (msec) : 100=23.96%, 250=4.43% cpu : usr=0.07%, sys=6.26%, ctx=1693, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180890: Wed Sep 2 20:36:37 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(5744KiB/27655msec) clat (usec): min=41, max=177092, avg=38943.70, stdev=26051.56 lat (usec): min=41, max=177093, avg=38944.96, stdev=26051.58 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 97], 20.00th=[ 20055], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 39584], | 70.00th=[ 48497], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 82314], | 99.00th=[109577], 99.50th=[135267], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 510, per=24.47%, avg=207.22, stdev=85.24, samples=54 iops : min= 1, max= 31, avg=12.17, stdev= 5.40, samples=54 write: IOPS=14, BW=237KiB/s (242kB/s)(6544KiB/27655msec); 0 zone resets clat (usec): min=1394, max=203070, avg=32604.31, stdev=32711.00 lat (usec): min=1396, max=203073, avg=32606.71, stdev=32710.87 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2089], 10.00th=[ 2802], 20.00th=[ 4817], | 30.00th=[ 8979], 40.00th=[ 16057], 50.00th=[ 24773], 60.00th=[ 32375], | 70.00th=[ 40633], 80.00th=[ 51643], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[152044], 99.50th=[164627], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 95, max= 447, per=26.48%, avg=235.93, stdev=91.80, samples=54 iops : min= 5, max= 27, avg=13.98, stdev= 5.76, samples=54 lat (usec) : 50=0.39%, 100=4.30%, 250=0.78%, 1000=0.13% lat (msec) : 2=2.34%, 4=5.60%, 10=9.77%, 20=9.77%, 50=42.32% lat (msec) : 100=21.48%, 250=3.12% cpu : usr=0.07%, sys=5.74%, ctx=1694, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180891: Wed Sep 2 20:36:37 2026 read: IOPS=14, BW=233KiB/s (239kB/s)(6256KiB/26855msec) clat (usec): min=42, max=271618, avg=37429.72, stdev=28145.88 lat (usec): min=42, max=271619, avg=37431.91, stdev=28146.21 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 78], 20.00th=[ 17433], | 30.00th=[ 24511], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 56886], 90.00th=[ 65799], 95.00th=[ 79168], | 99.00th=[110625], 99.50th=[198181], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 95, max= 416, per=27.88%, avg=236.12, stdev=82.14, samples=52 iops : min= 5, max= 26, avg=14.00, stdev= 5.23, samples=52 write: IOPS=14, BW=225KiB/s (230kB/s)(6032KiB/26855msec); 0 zone resets clat (usec): min=1356, max=156649, avg=31329.11, stdev=29806.13 lat (usec): min=1357, max=156652, avg=31343.32, stdev=29811.19 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2024], 10.00th=[ 2900], 20.00th=[ 4883], | 30.00th=[ 9110], 40.00th=[ 13829], 50.00th=[ 22152], 60.00th=[ 30016], | 70.00th=[ 42206], 80.00th=[ 53740], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[122160], 99.50th=[128451], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 95, max= 477, per=25.55%, avg=227.69, stdev=84.33, samples=51 iops : min= 5, max= 29, avg=13.47, stdev= 5.30, samples=51 lat (usec) : 50=0.39%, 100=5.73%, 250=0.78%, 500=0.39%, 750=0.13% lat (msec) : 2=2.60%, 4=5.34%, 10=8.98%, 20=9.90%, 50=39.45% lat (msec) : 100=24.35%, 250=1.82%, 500=0.13% cpu : usr=0.09%, sys=6.04%, ctx=1664, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180892: Wed Sep 2 20:36:37 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26933msec) clat (usec): min=37, max=190291, avg=38348.82, stdev=29124.49 lat (usec): min=37, max=190293, avg=38350.04, stdev=29124.53 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 69], 20.00th=[ 12649], | 30.00th=[ 24249], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[126354], 99.50th=[187696], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 498, per=27.35%, avg=231.63, stdev=87.67, samples=51 iops : min= 3, max= 31, avg=13.73, stdev= 5.58, samples=51 write: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26933msec); 0 zone resets clat (usec): min=1505, max=162458, avg=30624.44, stdev=30320.07 lat (usec): min=1507, max=162460, avg=30626.59, stdev=30320.18 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1860], 10.00th=[ 2474], 20.00th=[ 4686], | 30.00th=[ 8094], 40.00th=[ 13435], 50.00th=[ 21103], 60.00th=[ 28443], | 70.00th=[ 38011], 80.00th=[ 54264], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[128451], 99.50th=[147850], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 31, max= 505, per=26.50%, avg=236.12, stdev=100.51, samples=52 iops : min= 1, max= 31, avg=14.02, stdev= 6.32, samples=52 lat (usec) : 50=0.52%, 100=7.03%, 250=0.78%, 500=0.26% lat (msec) : 2=3.65%, 4=5.60%, 10=8.98%, 20=10.42%, 50=35.81% lat (msec) : 100=24.09%, 250=2.86% cpu : usr=0.07%, sys=6.25%, ctx=1716, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=848KiB/s (868kB/s), 208KiB/s-233KiB/s (213kB/s-239kB/s), io=23.4MiB (24.5MB), run=26855-28257msec WRITE: bw=892KiB/s (913kB/s), 225KiB/s-237KiB/s (230kB/s-242kB/s), io=24.6MiB (25.8MB), run=26855-28257msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180893: Wed Sep 2 20:36:51 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(5920KiB/42376msec) clat (msec): min=8, max=163, avg=43.19, stdev=26.66 lat (msec): min=8, max=163, avg=43.19, stdev=26.67 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 78], 95.00th=[ 105], | 99.00th=[ 136], 99.50th=[ 155], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 30, max= 350, per=25.06%, avg=141.59, stdev=71.13, samples=81 iops : min= 1, max= 21, avg= 8.09, stdev= 4.49, samples=81 write: IOPS=9, BW=150KiB/s (154kB/s)(6368KiB/42376msec); 0 zone resets clat (msec): min=14, max=347, avg=65.34, stdev=41.06 lat (msec): min=14, max=347, avg=65.34, stdev=41.06 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 117], 95.00th=[ 136], | 99.00th=[ 259], 99.50th=[ 284], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 352, per=25.22%, avg=149.82, stdev=67.58, samples=83 iops : min= 1, max= 22, avg= 8.61, stdev= 4.27, samples=83 lat (msec) : 10=0.39%, 20=6.77%, 50=51.17%, 100=30.99%, 250=10.16% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.91%, ctx=1210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180894: Wed Sep 2 20:36:51 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5744KiB/42264msec) clat (msec): min=7, max=222, avg=45.20, stdev=32.02 lat (msec): min=7, max=222, avg=45.20, stdev=32.02 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 87], 95.00th=[ 108], | 99.00th=[ 178], 99.50th=[ 218], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 383, per=23.88%, avg=134.94, stdev=69.61, samples=83 iops : min= 1, max= 23, avg= 7.65, stdev= 4.35, samples=83 write: IOPS=9, BW=155KiB/s (159kB/s)(6544KiB/42264msec); 0 zone resets clat (msec): min=17, max=264, avg=63.48, stdev=35.43 lat (msec): min=17, max=264, avg=63.48, stdev=35.43 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 63], | 70.00th=[ 74], 80.00th=[ 89], 90.00th=[ 111], 95.00th=[ 134], | 99.00th=[ 180], 99.50th=[ 201], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 352, per=25.87%, avg=153.66, stdev=66.44, samples=83 iops : min= 1, max= 22, avg= 8.83, stdev= 4.21, samples=83 lat (msec) : 10=0.26%, 20=6.38%, 50=50.39%, 100=33.20%, 250=9.64% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.97%, ctx=1170, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180895: Wed Sep 2 20:36:51 2026 read: IOPS=9, BW=149KiB/s (152kB/s)(6256KiB/42075msec) clat (msec): min=7, max=268, avg=43.63, stdev=29.27 lat (msec): min=7, max=268, avg=43.63, stdev=29.27 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 62], 90.00th=[ 78], 95.00th=[ 93], | 99.00th=[ 140], 99.50th=[ 178], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 380, per=27.42%, avg=154.90, stdev=83.20, samples=79 iops : min= 1, max= 23, avg= 8.92, stdev= 5.22, samples=79 write: IOPS=8, BW=143KiB/s (147kB/s)(6032KiB/42075msec); 0 zone resets clat (msec): min=17, max=344, avg=65.14, stdev=42.41 lat (msec): min=17, max=344, avg=65.15, stdev=42.41 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 122], 95.00th=[ 144], | 99.00th=[ 232], 99.50th=[ 284], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 352, per=23.82%, avg=141.49, stdev=63.35, samples=82 iops : min= 1, max= 22, avg= 8.07, stdev= 4.06, samples=82 lat (msec) : 10=0.52%, 20=8.07%, 50=49.48%, 100=31.25%, 250=10.29% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.81%, ctx=1143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180896: Wed Sep 2 20:36:51 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(6032KiB/41996msec) clat (msec): min=9, max=323, avg=46.01, stdev=35.32 lat (msec): min=9, max=323, avg=46.01, stdev=35.32 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 64], 90.00th=[ 86], 95.00th=[ 125], | 99.00th=[ 174], 99.50th=[ 180], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 416, per=25.44%, avg=143.73, stdev=72.75, samples=81 iops : min= 1, max= 26, avg= 8.23, stdev= 4.58, samples=81 write: IOPS=9, BW=149KiB/s (153kB/s)(6256KiB/41996msec); 0 zone resets clat (msec): min=17, max=260, avg=62.30, stdev=37.68 lat (msec): min=17, max=260, avg=62.31, stdev=37.69 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 59], | 70.00th=[ 70], 80.00th=[ 85], 90.00th=[ 115], 95.00th=[ 138], | 99.00th=[ 199], 99.50th=[ 230], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 352, per=25.63%, avg=152.25, stdev=67.28, samples=80 iops : min= 1, max= 22, avg= 8.76, stdev= 4.24, samples=80 lat (msec) : 10=0.13%, 20=8.72%, 50=50.13%, 100=29.95%, 250=10.81% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.75%, ctx=1194, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=565KiB/s (579kB/s), 136KiB/s-149KiB/s (139kB/s-152kB/s), io=23.4MiB (24.5MB), run=41996-42376msec WRITE: bw=595KiB/s (609kB/s), 143KiB/s-155KiB/s (147kB/s-159kB/s), io=24.6MiB (25.8MB), run=41996-42376msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180909: Wed Sep 2 20:37:06 2026 read: IOPS=1, BW=1914KiB/s (1960kB/s)(7168KiB/3745msec) clat (msec): min=2, max=574, avg=246.71, stdev=191.08 lat (msec): min=2, max=574, avg=246.71, stdev=191.08 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 136], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 184], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 414], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1762, max= 4179, per=61.58%, avg=2473.25, stdev=1142.52, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1367KiB/s (1400kB/s)(5120KiB/3745msec); 0 zone resets clat (msec): min=220, max=548, avg=385.92, stdev=145.94 lat (msec): min=221, max=548, avg=386.04, stdev=145.95 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2023, max= 4087, per=48.26%, avg=2713.67, stdev=1189.35, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=33.33%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=16.08%, ctx=127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180910: Wed Sep 2 20:37:06 2026 read: IOPS=0, BW=402KiB/s (411kB/s)(2048KiB/5099msec) clat (msec): min=8, max=149, avg=78.69, stdev=99.46 lat (msec): min=8, max=149, avg=78.69, stdev=99.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 9], | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 1434, max= 1921, per=41.77%, avg=1677.50, stdev=344.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2008KiB/s (2056kB/s)(10.0MiB/5099msec); 0 zone resets clat (msec): min=262, max=964, avg=491.76, stdev=240.48 lat (msec): min=262, max=965, avg=492.18, stdev=240.24 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 268], | 30.00th=[ 275], 40.00th=[ 338], 50.00th=[ 376], 60.00th=[ 498], | 70.00th=[ 535], 80.00th=[ 600], 90.00th=[ 802], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1762, max= 4096, per=44.74%, avg=2516.00, stdev=1065.97, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 10=8.33%, 250=8.33%, 500=50.00%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=13.81%, ctx=234, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180911: Wed Sep 2 20:37:06 2026 read: IOPS=1, BW=1688KiB/s (1729kB/s)(6144KiB/3639msec) clat (usec): min=769, max=449654, avg=217074.49, stdev=181226.64 lat (usec): min=770, max=449655, avg=217075.90, stdev=181226.35 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[ 6849], | 30.00th=[ 6849], 40.00th=[219153], 50.00th=[219153], 60.00th=[295699], | 70.00th=[333448], 80.00th=[333448], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 1762, max= 4047, per=60.84%, avg=2443.25, stdev=1075.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1688KiB/s (1729kB/s)(6144KiB/3639msec); 0 zone resets clat (msec): min=228, max=530, avg=373.89, stdev=104.55 lat (msec): min=228, max=530, avg=374.10, stdev=104.65 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 380], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1921, max= 2778, per=38.92%, avg=2188.25, stdev=396.34, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 10=8.33%, 250=16.67%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=12.78%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180912: Wed Sep 2 20:37:06 2026 read: IOPS=1, BW=1389KiB/s (1422kB/s)(5120KiB/3686msec) clat (usec): min=607, max=543449, avg=166397.01, stdev=243983.24 lat (usec): min=609, max=543450, avg=166398.21, stdev=243983.26 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 2245], 60.00th=[ 2245], | 70.00th=[283116], 80.00th=[283116], 90.00th=[541066], 95.00th=[541066], | 99.00th=[541066], 99.50th=[541066], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 2023, max= 6131, per=100.00%, avg=4077.00, stdev=2904.79, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1945KiB/s (1991kB/s)(7168KiB/3686msec); 0 zone resets clat (msec): min=254, max=659, avg=401.58, stdev=145.29 lat (msec): min=254, max=659, avg=402.00, stdev=145.02 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 266], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 397], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 481], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1484, max= 4063, per=41.04%, avg=2307.50, stdev=1184.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=16.42%, ctx=134, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4016KiB/s (4113kB/s), 402KiB/s-1914KiB/s (411kB/s-1960kB/s), io=20.0MiB (20.0MB), run=3639-5099msec WRITE: bw=5623KiB/s (5758kB/s), 1367KiB/s-2008KiB/s (1400kB/s-2056kB/s), io=28.0MiB (29.4MB), run=3639-5099msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180914: Wed Sep 2 20:37:06 2026 read: IOPS=1, BW=1745KiB/s (1787kB/s)(7168KiB/4108msec) clat (msec): min=96, max=580, avg=315.68, stdev=207.08 lat (msec): min=96, max=580, avg=315.68, stdev=207.08 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 142], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 239], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 535], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1494, max= 4063, per=54.45%, avg=2318.40, stdev=1001.25, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1246KiB/s (1276kB/s)(5120KiB/4108msec); 0 zone resets clat (msec): min=208, max=625, avg=375.21, stdev=197.38 lat (msec): min=209, max=625, avg=375.30, stdev=197.37 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2011, max= 4079, per=45.47%, avg=2711.00, stdev=1184.83, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=33.33% cpu : usr=0.00%, sys=5.28%, ctx=70, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180915: Wed Sep 2 20:37:06 2026 read: IOPS=0, BW=451KiB/s (461kB/s)(2048KiB/4546msec) clat (msec): min=102, max=661, avg=381.59, stdev=395.39 lat (msec): min=102, max=661, avg=381.59, stdev=395.39 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1438, max= 2043, per=40.88%, avg=1740.50, stdev=427.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2253KiB/s (2307kB/s)(10.0MiB/4546msec); 0 zone resets clat (msec): min=152, max=795, avg=373.94, stdev=226.87 lat (msec): min=152, max=797, avg=374.18, stdev=227.15 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 157], | 30.00th=[ 182], 40.00th=[ 243], 50.00th=[ 268], 60.00th=[ 296], | 70.00th=[ 456], 80.00th=[ 518], 90.00th=[ 676], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1957, max= 3961, per=38.53%, avg=2297.29, stdev=734.24, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=6.62%, ctx=160, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180916: Wed Sep 2 20:37:06 2026 read: IOPS=1, BW=1473KiB/s (1509kB/s)(6144KiB/4170msec) clat (msec): min=66, max=845, avg=265.33, stdev=290.50 lat (msec): min=66, max=845, avg=265.33, stdev=290.50 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 199], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2011, max= 4079, per=63.57%, avg=2707.00, stdev=1188.23, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1473KiB/s (1509kB/s)(6144KiB/4170msec); 0 zone resets clat (msec): min=173, max=724, avg=424.59, stdev=232.86 lat (msec): min=173, max=724, avg=424.69, stdev=232.85 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 514], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1957, max= 2039, per=33.71%, avg=2009.50, stdev=36.93, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=3.31%, ctx=73, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180917: Wed Sep 2 20:37:06 2026 read: IOPS=1, BW=1065KiB/s (1090kB/s)(5120KiB/4809msec) clat (msec): min=70, max=890, avg=343.01, stdev=328.80 lat (msec): min=70, max=890, avg=343.02, stdev=328.80 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2035, max= 3961, per=62.90%, avg=2678.33, stdev=1110.82, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1491KiB/s (1526kB/s)(7168KiB/4809msec); 0 zone resets clat (msec): min=136, max=816, avg=367.57, stdev=216.90 lat (msec): min=136, max=816, avg=367.71, stdev=216.90 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 236], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 317], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 422], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1957, max= 4015, per=42.16%, avg=2513.75, stdev=1001.64, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=6.30%, ctx=134, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4259KiB/s (4361kB/s), 451KiB/s-1745KiB/s (461kB/s-1787kB/s), io=20.0MiB (20.0MB), run=4108-4809msec WRITE: bw=5962KiB/s (6105kB/s), 1246KiB/s-2253KiB/s (1276kB/s-2307kB/s), io=28.0MiB (29.4MB), run=4108-4809msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180925: Wed Sep 2 20:37:22 2026 read: IOPS=0, BW=3798KiB/s (3890kB/s)(12.0MiB/3235msec) clat (msec): min=872, max=1175, avg=1043.13, stdev=154.71 lat (msec): min=872, max=1175, avg=1043.13, stdev=154.71 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.43%, ctx=320, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180926: Wed Sep 2 20:37:22 2026 read: IOPS=0, BW=1160KiB/s (1188kB/s)(4096KiB/3532msec) clat (nsec): min=664486k, max=664486k, avg=664486177.00, stdev= 0.00 lat (nsec): min=664489k, max=664489k, avg=664489161.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2319KiB/s (2375kB/s)(8192KiB/3532msec); 0 zone resets clat (msec): min=1179, max=1539, avg=1359.52, stdev=254.36 lat (msec): min=1179, max=1540, avg=1360.10, stdev=254.80 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=6.60%, ctx=181, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180928: Wed Sep 2 20:37:22 2026 write: IOPS=0, BW=3045KiB/s (3118kB/s)(12.0MiB/4036msec); 0 zone resets clat (msec): min=274, max=2644, avg=1322.63, stdev=1208.46 lat (msec): min=275, max=2645, avg=1323.08, stdev=1208.40 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.92%, ctx=81, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180931: Wed Sep 2 20:37:22 2026 write: IOPS=0, BW=3942KiB/s (4037kB/s)(12.0MiB/3117msec); 0 zone resets clat (msec): min=517, max=1489, avg=1013.57, stdev=486.15 lat (msec): min=518, max=1490, avg=1013.98, stdev=486.38 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.24%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4639KiB/s (4750kB/s), 1160KiB/s-3798KiB/s (1188kB/s-3890kB/s), io=16.0MiB (16.8MB), run=3235-3532msec WRITE: bw=8119KiB/s (8314kB/s), 2319KiB/s-3942KiB/s (2375kB/s-4037kB/s), io=32.0MiB (33.6MB), run=3117-4036msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180927: Wed Sep 2 20:37:22 2026 read: IOPS=1, BW=4213KiB/s (4314kB/s)(12.0MiB/2917msec) clat (msec): min=234, max=1312, avg=939.54, stdev=611.09 lat (msec): min=234, max=1312, avg=939.54, stdev=611.09 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 6714, max= 8126, per=100.00%, avg=7420.00, stdev=998.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.12%, ctx=70, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180929: Wed Sep 2 20:37:22 2026 read: IOPS=0, BW=1002KiB/s (1026kB/s)(4096KiB/4089msec) clat (nsec): min=1948.0M, max=1948.0M, avg=1948975683.00, stdev= 0.00 lat (nsec): min=1948.0M, max=1948.0M, avg=1948977977.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1955], 5.00th=[ 1955], 10.00th=[ 1955], 20.00th=[ 1955], | 30.00th=[ 1955], 40.00th=[ 1955], 50.00th=[ 1955], 60.00th=[ 1955], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2003KiB/s (2052kB/s)(8192KiB/4089msec); 0 zone resets clat (msec): min=601, max=1433, avg=1017.20, stdev=588.48 lat (msec): min=601, max=1433, avg=1017.61, stdev=588.42 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.52%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180930: Wed Sep 2 20:37:22 2026 write: IOPS=0, BW=2926KiB/s (2996kB/s)(12.0MiB/4200msec); 0 zone resets clat (msec): min=266, max=2838, avg=1371.96, stdev=1323.42 lat (msec): min=266, max=2838, avg=1375.17, stdev=1322.33 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 7772, max= 7772, per=99.63%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.60%, ctx=88, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180932: Wed Sep 2 20:37:22 2026 write: IOPS=0, BW=3627KiB/s (3714kB/s)(12.0MiB/3388msec); 0 zone resets clat (msec): min=425, max=1698, avg=1101.85, stdev=640.20 lat (msec): min=426, max=1699, avg=1102.72, stdev=640.34 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7772, max= 8126, per=100.00%, avg=7949.00, stdev=250.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.09%, sys=3.40%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4007KiB/s (4103kB/s), 1002KiB/s-4213KiB/s (1026kB/s-4314kB/s), io=16.0MiB (16.8MB), run=2917-4089msec WRITE: bw=7802KiB/s (7989kB/s), 2003KiB/s-3627KiB/s (2052kB/s-3714kB/s), io=32.0MiB (33.6MB), run=3388-4200msec