== sanity test 398b: DIO and buffer IO race ============== 04:50:00 (1789548600) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.09752 s, 16.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188857: Wed Sep 16 04:51:11 2026 read: IOPS=24, BW=98.2KiB/s (101kB/s)(5992KiB/61040msec) clat (usec): min=33, max=842366, avg=22007.65, stdev=24233.14 lat (usec): min=33, max=842367, avg=22008.70, stdev=24233.17 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 8160], 10.00th=[ 9896], 20.00th=[ 12256], | 30.00th=[ 14222], 40.00th=[ 16581], 50.00th=[ 19006], 60.00th=[ 22152], | 70.00th=[ 25297], 80.00th=[ 29754], 90.00th=[ 36963], 95.00th=[ 43779], | 99.00th=[ 60556], 99.50th=[ 73925], 99.90th=[ 81265], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 6, max= 174, per=25.02%, avg=97.60, stdev=26.99, samples=121 iops : min= 1, max= 43, avg=24.00, stdev= 6.80, samples=121 write: IOPS=25, BW=103KiB/s (106kB/s)(6296KiB/61040msec); 0 zone resets clat (usec): min=690, max=92651, avg=17682.56, stdev=15274.68 lat (usec): min=691, max=92652, avg=17684.01, stdev=15274.85 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1663], 10.00th=[ 2278], 20.00th=[ 3556], | 30.00th=[ 6128], 40.00th=[10945], 50.00th=[14222], 60.00th=[17957], | 70.00th=[22676], 80.00th=[29230], 90.00th=[38536], 95.00th=[48497], | 99.00th=[64226], 99.50th=[74974], 99.90th=[91751], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 7, max= 199, per=25.36%, avg=103.48, stdev=30.15, samples=120 iops : min= 1, max= 49, avg=25.47, stdev= 7.55, samples=120 lat (usec) : 50=0.13%, 100=0.59%, 250=0.55%, 750=0.07%, 1000=0.36% lat (msec) : 2=3.45%, 4=7.81%, 10=11.78%, 20=34.31%, 50=37.50% lat (msec) : 100=3.42%, 1000=0.03% cpu : usr=0.11%, sys=17.35%, ctx=7894, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188858: Wed Sep 16 04:51:11 2026 read: IOPS=24, BW=98.2KiB/s (101kB/s)(5940KiB/60516msec) clat (usec): min=44, max=104946, avg=21567.30, stdev=12108.88 lat (usec): min=45, max=104947, avg=21568.33, stdev=12108.93 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 7832], 10.00th=[ 9503], 20.00th=[ 11863], | 30.00th=[ 14222], 40.00th=[ 16319], 50.00th=[ 19268], 60.00th=[ 22414], | 70.00th=[ 25822], 80.00th=[ 30016], 90.00th=[ 36439], 95.00th=[ 44303], | 99.00th=[ 62129], 99.50th=[ 67634], 99.90th=[ 93848], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 6, max= 175, per=25.14%, avg=98.03, stdev=26.10, samples=120 iops : min= 1, max= 43, avg=24.11, stdev= 6.61, samples=120 write: IOPS=26, BW=105KiB/s (107kB/s)(6348KiB/60516msec); 0 zone resets clat (usec): min=758, max=819223, avg=17800.88, stdev=25397.07 lat (usec): min=758, max=819225, avg=17802.34, stdev=25397.02 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1680], 10.00th=[ 2311], 20.00th=[ 3589], | 30.00th=[ 5669], 40.00th=[ 10159], 50.00th=[ 13566], 60.00th=[ 17171], | 70.00th=[ 21890], 80.00th=[ 28443], 90.00th=[ 38536], 95.00th=[ 49021], | 99.00th=[ 68682], 99.50th=[ 74974], 99.90th=[126354], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 48, max= 192, per=25.83%, avg=105.37, stdev=30.80, samples=119 iops : min= 12, max= 48, avg=25.95, stdev= 7.67, samples=119 lat (usec) : 50=0.03%, 100=0.65%, 250=0.49%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=3.35%, 4=8.14%, 10=12.86%, 20=33.59%, 50=36.82% lat (msec) : 100=3.45%, 250=0.10%, 1000=0.03% cpu : usr=0.13%, sys=17.35%, ctx=7708, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188859: Wed Sep 16 04:51:11 2026 read: IOPS=24, BW=97.9KiB/s (100kB/s)(6028KiB/61561msec) clat (usec): min=39, max=176350, avg=21516.29, stdev=13134.35 lat (usec): min=40, max=176352, avg=21521.34, stdev=13140.21 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 7439], 10.00th=[ 9241], 20.00th=[ 12125], | 30.00th=[ 14091], 40.00th=[ 16712], 50.00th=[ 19268], 60.00th=[ 22152], | 70.00th=[ 25822], 80.00th=[ 29230], 90.00th=[ 35390], 95.00th=[ 42206], | 99.00th=[ 64750], 99.50th=[ 85459], 99.90th=[110625], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 32, max= 199, per=25.38%, avg=98.97, stdev=26.34, samples=120 iops : min= 8, max= 49, avg=24.34, stdev= 6.61, samples=120 write: IOPS=25, BW=102KiB/s (104kB/s)(6260KiB/61561msec); 0 zone resets clat (usec): min=766, max=880632, avg=18444.74, stdev=26923.64 lat (usec): min=767, max=880633, avg=18446.81, stdev=26923.62 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1663], 10.00th=[ 2245], 20.00th=[ 3523], | 30.00th=[ 5800], 40.00th=[ 10814], 50.00th=[ 13829], 60.00th=[ 17957], | 70.00th=[ 22676], 80.00th=[ 29754], 90.00th=[ 40633], 95.00th=[ 50070], | 99.00th=[ 66323], 99.50th=[ 79168], 99.90th=[120062], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 15, max= 191, per=24.91%, avg=101.64, stdev=29.51, samples=121 iops : min= 3, max= 47, avg=25.01, stdev= 7.39, samples=121 lat (usec) : 50=0.16%, 100=0.49%, 250=1.07%, 500=0.03%, 1000=0.39% lat (msec) : 2=3.58%, 4=7.75%, 10=11.30%, 20=33.89%, 50=37.47% lat (msec) : 100=3.65%, 250=0.20%, 1000=0.03% cpu : usr=0.11%, sys=17.15%, ctx=7916, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188860: Wed Sep 16 04:51:11 2026 read: IOPS=25, BW=101KiB/s (104kB/s)(6052KiB/59769msec) clat (usec): min=46, max=112789, avg=20792.27, stdev=11842.66 lat (usec): min=47, max=112790, avg=20793.59, stdev=11842.64 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 7177], 10.00th=[ 9372], 20.00th=[ 11469], | 30.00th=[ 13960], 40.00th=[ 16188], 50.00th=[ 19006], 60.00th=[ 21365], | 70.00th=[ 24773], 80.00th=[ 28705], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 63177], 99.50th=[ 70779], 99.90th=[ 84411], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 47, max= 168, per=26.33%, avg=102.69, stdev=25.42, samples=116 iops : min= 11, max= 42, avg=25.28, stdev= 6.45, samples=116 write: IOPS=26, BW=104KiB/s (107kB/s)(6236KiB/59769msec); 0 zone resets clat (usec): min=694, max=880740, avg=18000.40, stdev=26894.68 lat (usec): min=695, max=880742, avg=18002.08, stdev=26894.54 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1778], 10.00th=[ 2343], 20.00th=[ 3326], | 30.00th=[ 5145], 40.00th=[ 10028], 50.00th=[ 13435], 60.00th=[ 17433], | 70.00th=[ 22676], 80.00th=[ 29492], 90.00th=[ 40109], 95.00th=[ 49021], | 99.00th=[ 63177], 99.50th=[ 77071], 99.90th=[120062], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 200, per=25.75%, avg=105.08, stdev=29.79, samples=117 iops : min= 1, max= 50, avg=25.87, stdev= 7.50, samples=117 lat (usec) : 50=0.10%, 100=0.85%, 250=0.68%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.49% lat (msec) : 2=2.96%, 4=9.31%, 10=12.30%, 20=33.40%, 50=36.59% lat (msec) : 100=3.09%, 250=0.10%, 1000=0.03% cpu : usr=0.13%, sys=17.50%, ctx=7740, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=390KiB/s (399kB/s), 97.9KiB/s-101KiB/s (100kB/s-104kB/s), io=23.4MiB (24.6MB), run=59769-61561msec WRITE: bw=408KiB/s (418kB/s), 102KiB/s-105KiB/s (104kB/s-107kB/s), io=24.6MiB (25.7MB), run=59769-61561msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188861: Wed Sep 16 04:51:29 2026 read: IOPS=18, BW=75.7KiB/s (77.6kB/s)(5992KiB/79111msec) clat (msec): min=3, max=840, avg=21.53, stdev=27.07 lat (msec): min=3, max=840, avg=21.53, stdev=27.07 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 59], | 99.00th=[ 83], 99.50th=[ 99], 99.90th=[ 129], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 23, max= 224, per=25.14%, avg=75.92, stdev=42.96, samples=156 iops : min= 5, max= 56, avg=18.53, stdev=10.83, samples=156 write: IOPS=19, BW=79.6KiB/s (81.5kB/s)(6296KiB/79111msec); 0 zone resets clat (msec): min=8, max=134, avg=29.64, stdev=18.39 lat (msec): min=8, max=134, avg=29.64, stdev=18.39 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 55], 95.00th=[ 67], | 99.00th=[ 97], 99.50th=[ 110], 99.90th=[ 133], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 7, max= 208, per=25.23%, avg=79.71, stdev=41.00, samples=156 iops : min= 1, max= 52, avg=19.47, stdev=10.35, samples=156 lat (msec) : 4=0.03%, 10=14.16%, 20=38.25%, 50=37.27%, 100=9.67% lat (msec) : 250=0.59%, 1000=0.03% cpu : usr=0.12%, sys=6.73%, ctx=5145, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188862: Wed Sep 16 04:51:29 2026 read: IOPS=18, BW=74.9KiB/s (76.7kB/s)(5940KiB/79343msec) clat (msec): min=3, max=839, avg=21.42, stdev=27.36 lat (msec): min=3, max=839, avg=21.42, stdev=27.36 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 59], | 99.00th=[ 85], 99.50th=[ 99], 99.90th=[ 122], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 255, per=24.78%, avg=74.84, stdev=45.45, samples=156 iops : min= 1, max= 63, avg=18.26, stdev=11.45, samples=156 write: IOPS=20, BW=80.0KiB/s (81.9kB/s)(6348KiB/79343msec); 0 zone resets clat (msec): min=7, max=175, avg=29.82, stdev=18.65 lat (msec): min=7, max=175, avg=29.82, stdev=18.65 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 56], 95.00th=[ 66], | 99.00th=[ 97], 99.50th=[ 108], 99.90th=[ 133], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 23, max= 200, per=25.23%, avg=79.71, stdev=40.23, samples=156 iops : min= 5, max= 50, avg=19.47, stdev=10.15, samples=156 lat (msec) : 4=0.03%, 10=14.45%, 20=38.09%, 50=36.56%, 100=10.25% lat (msec) : 250=0.59%, 1000=0.03% cpu : usr=0.10%, sys=6.59%, ctx=5131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188863: Wed Sep 16 04:51:29 2026 read: IOPS=19, BW=76.5KiB/s (78.4kB/s)(6028KiB/78775msec) clat (msec): min=3, max=125, avg=20.84, stdev=16.59 lat (msec): min=3, max=125, avg=20.84, stdev=16.59 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 85], 99.50th=[ 90], 99.90th=[ 109], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 15, max= 239, per=25.56%, avg=77.18, stdev=42.49, samples=154 iops : min= 3, max= 59, avg=18.84, stdev=10.72, samples=154 write: IOPS=19, BW=79.5KiB/s (81.4kB/s)(6260KiB/78775msec); 0 zone resets clat (msec): min=7, max=852, avg=30.13, stdev=27.54 lat (msec): min=7, max=852, avg=30.13, stdev=27.54 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 55], 95.00th=[ 65], | 99.00th=[ 89], 99.50th=[ 104], 99.90th=[ 138], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 23, max= 208, per=25.14%, avg=79.44, stdev=41.56, samples=155 iops : min= 5, max= 52, avg=19.41, stdev=10.48, samples=155 lat (msec) : 4=0.03%, 10=13.44%, 20=39.26%, 50=36.72%, 100=10.12% lat (msec) : 250=0.39%, 1000=0.03% cpu : usr=0.12%, sys=6.70%, ctx=5185, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188864: Wed Sep 16 04:51:29 2026 read: IOPS=19, BW=76.3KiB/s (78.1kB/s)(6052KiB/79327msec) clat (msec): min=3, max=142, avg=21.17, stdev=17.20 lat (msec): min=3, max=142, avg=21.17, stdev=17.20 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 56], | 99.00th=[ 84], 99.50th=[ 96], 99.90th=[ 123], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 16, max= 240, per=25.52%, avg=77.07, stdev=43.56, samples=154 iops : min= 4, max= 60, avg=18.82, stdev=10.99, samples=154 write: IOPS=19, BW=78.6KiB/s (80.5kB/s)(6236KiB/79327msec); 0 zone resets clat (msec): min=6, max=856, avg=30.20, stdev=28.03 lat (msec): min=6, max=856, avg=30.20, stdev=28.03 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 55], 95.00th=[ 64], | 99.00th=[ 100], 99.50th=[ 116], 99.90th=[ 176], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 15, max= 207, per=24.87%, avg=78.58, stdev=41.27, samples=156 iops : min= 3, max= 51, avg=19.19, stdev=10.40, samples=156 lat (msec) : 4=0.07%, 10=13.83%, 20=37.76%, 50=37.86%, 100=9.83% lat (msec) : 250=0.62%, 1000=0.03% cpu : usr=0.13%, sys=6.62%, ctx=5152, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=303KiB/s (310kB/s), 74.9KiB/s-76.5KiB/s (76.7kB/s-78.4kB/s), io=23.4MiB (24.6MB), run=78775-79343msec WRITE: bw=317KiB/s (324kB/s), 78.6KiB/s-80.0KiB/s (80.5kB/s-81.9kB/s), io=24.6MiB (25.7MB), run=78775-79343msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188896: Wed Sep 16 04:51:59 2026 read: IOPS=16, BW=269KiB/s (275kB/s)(5920KiB/22033msec) clat (usec): min=50, max=223518, avg=32177.78, stdev=26061.01 lat (usec): min=50, max=223520, avg=32178.95, stdev=26061.12 clat percentiles (usec): | 1.00th=[ 66], 5.00th=[ 122], 10.00th=[ 11600], 20.00th=[ 15926], | 30.00th=[ 19268], 40.00th=[ 23200], 50.00th=[ 26608], 60.00th=[ 30278], | 70.00th=[ 33424], 80.00th=[ 44827], 90.00th=[ 60556], 95.00th=[ 73925], | 99.00th=[143655], 99.50th=[175113], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 95, max= 512, per=26.45%, avg=270.84, stdev=111.12, samples=43 iops : min= 5, max= 32, avg=16.23, stdev= 7.06, samples=43 write: IOPS=18, BW=289KiB/s (296kB/s)(6368KiB/22033msec); 0 zone resets clat (usec): min=1344, max=161636, avg=25304.58, stdev=25374.62 lat (usec): min=1347, max=161637, avg=25313.77, stdev=25369.82 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2180], 10.00th=[ 2966], 20.00th=[ 4752], | 30.00th=[ 8979], 40.00th=[ 14091], 50.00th=[ 19006], 60.00th=[ 23200], | 70.00th=[ 29492], 80.00th=[ 37487], 90.00th=[ 55837], 95.00th=[ 81265], | 99.00th=[123208], 99.50th=[137364], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 63, max= 508, per=27.15%, avg=292.40, stdev=113.62, samples=43 iops : min= 3, max= 31, avg=17.58, stdev= 7.16, samples=43 lat (usec) : 100=2.21%, 250=0.78% lat (msec) : 2=1.95%, 4=6.25%, 10=9.24%, 20=23.05%, 50=42.97% lat (msec) : 100=11.07%, 250=2.47% cpu : usr=0.12%, sys=11.81%, ctx=2026, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188897: Wed Sep 16 04:51:59 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(5744KiB/22393msec) clat (usec): min=52, max=154035, avg=33150.25, stdev=24888.22 lat (usec): min=53, max=154036, avg=33151.80, stdev=24888.36 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 137], 10.00th=[ 12256], 20.00th=[ 15795], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 26084], 60.00th=[ 30802], | 70.00th=[ 36439], 80.00th=[ 47973], 90.00th=[ 65799], 95.00th=[ 81265], | 99.00th=[130548], 99.50th=[149947], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 62, max= 544, per=25.17%, avg=257.75, stdev=120.23, samples=44 iops : min= 3, max= 34, avg=15.41, stdev= 7.61, samples=44 write: IOPS=18, BW=292KiB/s (299kB/s)(6544KiB/22393msec); 0 zone resets clat (usec): min=1681, max=141004, avg=25176.50, stdev=25291.66 lat (usec): min=1682, max=141006, avg=25178.75, stdev=25291.69 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2704], 10.00th=[ 3523], 20.00th=[ 5473], | 30.00th=[ 8455], 40.00th=[ 13173], 50.00th=[ 17695], 60.00th=[ 21627], | 70.00th=[ 28181], 80.00th=[ 38536], 90.00th=[ 58983], 95.00th=[ 79168], | 99.00th=[113771], 99.50th=[135267], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 94, max= 608, per=27.20%, avg=292.93, stdev=110.48, samples=44 iops : min= 5, max= 38, avg=17.64, stdev= 7.01, samples=44 lat (usec) : 100=1.82%, 250=0.78% lat (msec) : 2=1.04%, 4=5.99%, 10=11.72%, 20=23.57%, 50=39.45% lat (msec) : 100=13.02%, 250=2.60% cpu : usr=0.09%, sys=11.85%, ctx=1999, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188898: Wed Sep 16 04:51:59 2026 read: IOPS=16, BW=268KiB/s (274kB/s)(6256KiB/23378msec) clat (usec): min=38, max=132980, avg=32541.43, stdev=24566.39 lat (usec): min=38, max=132981, avg=32543.57, stdev=24565.90 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 89], 10.00th=[ 7767], 20.00th=[ 15401], | 30.00th=[ 19530], 40.00th=[ 23725], 50.00th=[ 27395], 60.00th=[ 31327], | 70.00th=[ 37487], 80.00th=[ 44827], 90.00th=[ 65274], 95.00th=[ 86508], | 99.00th=[123208], 99.50th=[123208], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 95, max= 599, per=26.22%, avg=268.54, stdev=98.95, samples=46 iops : min= 5, max= 37, avg=16.09, stdev= 6.29, samples=46 write: IOPS=16, BW=258KiB/s (264kB/s)(6032KiB/23378msec); 0 zone resets clat (usec): min=1068, max=207405, avg=27810.00, stdev=30788.42 lat (usec): min=1069, max=207408, avg=27813.44, stdev=30787.42 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2737], 10.00th=[ 3589], 20.00th=[ 5211], | 30.00th=[ 8979], 40.00th=[ 12649], 50.00th=[ 18482], 60.00th=[ 22938], | 70.00th=[ 31589], 80.00th=[ 42206], 90.00th=[ 62129], 95.00th=[ 87557], | 99.00th=[168821], 99.50th=[183501], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 62, max= 479, per=23.85%, avg=256.85, stdev=106.85, samples=46 iops : min= 3, max= 29, avg=15.35, stdev= 6.69, samples=46 lat (usec) : 50=0.39%, 100=2.60%, 250=1.30%, 500=0.26%, 750=0.13% lat (msec) : 2=1.04%, 4=5.47%, 10=10.55%, 20=20.70%, 50=41.28% lat (msec) : 100=12.89%, 250=3.39% cpu : usr=0.07%, sys=11.00%, ctx=1965, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188899: Wed Sep 16 04:51:59 2026 read: IOPS=16, BW=270KiB/s (276kB/s)(6032KiB/22352msec) clat (usec): min=56, max=172296, avg=32770.76, stdev=27755.64 lat (usec): min=57, max=172298, avg=32776.61, stdev=27756.10 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 93], 10.00th=[ 194], 20.00th=[ 14091], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 27395], 60.00th=[ 31589], | 70.00th=[ 36439], 80.00th=[ 47449], 90.00th=[ 64226], 95.00th=[ 86508], | 99.00th=[147850], 99.50th=[170918], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 94, max= 544, per=26.47%, avg=271.07, stdev=97.30, samples=44 iops : min= 5, max= 34, avg=16.25, stdev= 6.18, samples=44 write: IOPS=17, BW=280KiB/s (287kB/s)(6256KiB/22352msec); 0 zone resets clat (usec): min=1307, max=209228, avg=25238.95, stdev=25522.02 lat (usec): min=1309, max=209229, avg=25242.48, stdev=25524.69 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2180], 10.00th=[ 3130], 20.00th=[ 5604], | 30.00th=[ 8979], 40.00th=[ 13435], 50.00th=[ 16319], 60.00th=[ 22414], | 70.00th=[ 30802], 80.00th=[ 39584], 90.00th=[ 60031], 95.00th=[ 70779], | 99.00th=[122160], 99.50th=[131597], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 125, max= 506, per=26.13%, avg=281.39, stdev=115.57, samples=44 iops : min= 7, max= 31, avg=16.91, stdev= 7.35, samples=44 lat (usec) : 100=2.60%, 250=2.60% lat (msec) : 2=1.95%, 4=4.82%, 10=10.81%, 20=22.27%, 50=38.67% lat (msec) : 100=13.67%, 250=2.60% cpu : usr=0.11%, sys=12.23%, ctx=1969, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1025KiB/s (1049kB/s), 257KiB/s-270KiB/s (263kB/s-276kB/s), io=23.4MiB (24.5MB), run=22033-23378msec WRITE: bw=1078KiB/s (1104kB/s), 258KiB/s-292KiB/s (264kB/s-299kB/s), io=24.6MiB (25.8MB), run=22033-23378msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188892: Wed Sep 16 04:52:17 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(5920KiB/41829msec) clat (msec): min=6, max=282, avg=42.35, stdev=34.98 lat (msec): min=6, max=282, avg=42.35, stdev=34.98 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 85], 95.00th=[ 105], | 99.00th=[ 186], 99.50th=[ 213], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 447, per=27.24%, avg=155.80, stdev=83.79, samples=74 iops : min= 1, max= 27, avg= 9.07, stdev= 5.31, samples=74 write: IOPS=9, BW=152KiB/s (156kB/s)(6368KiB/41829msec); 0 zone resets clat (msec): min=12, max=2090, avg=65.43, stdev=112.81 lat (msec): min=12, max=2090, avg=65.43, stdev=112.81 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 112], 95.00th=[ 163], | 99.00th=[ 271], 99.50th=[ 363], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 32, max= 352, per=26.18%, avg=157.61, stdev=75.12, samples=79 iops : min= 2, max= 22, avg= 9.20, stdev= 4.70, samples=79 lat (msec) : 10=1.30%, 20=16.67%, 50=45.18%, 100=27.60%, 250=8.46% lat (msec) : 500=0.65%, >=2000=0.13% cpu : usr=0.08%, sys=3.37%, ctx=1348, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188893: Wed Sep 16 04:52:17 2026 read: IOPS=8, BW=139KiB/s (143kB/s)(5744KiB/41251msec) clat (msec): min=7, max=259, avg=42.60, stdev=35.68 lat (msec): min=7, max=259, avg=42.60, stdev=35.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 83], 95.00th=[ 127], | 99.00th=[ 174], 99.50th=[ 232], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 350, per=25.72%, avg=147.09, stdev=78.60, samples=77 iops : min= 1, max= 21, avg= 8.52, stdev= 4.88, samples=77 write: IOPS=9, BW=159KiB/s (162kB/s)(6544KiB/41251msec); 0 zone resets clat (msec): min=13, max=2080, avg=63.21, stdev=109.66 lat (msec): min=13, max=2080, avg=63.21, stdev=109.66 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 114], 95.00th=[ 136], | 99.00th=[ 271], 99.50th=[ 326], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 30, max= 381, per=27.34%, avg=164.56, stdev=83.22, samples=78 iops : min= 1, max= 23, avg= 9.62, stdev= 5.22, samples=78 lat (msec) : 10=1.04%, 20=14.84%, 50=48.31%, 100=26.17%, 250=8.72% lat (msec) : 500=0.78%, >=2000=0.13% cpu : usr=0.06%, sys=2.83%, ctx=1258, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188894: Wed Sep 16 04:52:17 2026 read: IOPS=9, BW=157KiB/s (160kB/s)(6256KiB/39953msec) clat (msec): min=6, max=345, avg=42.78, stdev=42.18 lat (msec): min=6, max=345, avg=42.78, stdev=42.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 108], | 99.00th=[ 268], 99.50th=[ 292], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 381, per=28.60%, avg=163.57, stdev=85.42, samples=75 iops : min= 1, max= 23, avg= 9.57, stdev= 5.35, samples=75 write: IOPS=9, BW=151KiB/s (155kB/s)(6032KiB/39953msec); 0 zone resets clat (msec): min=11, max=2079, avg=61.37, stdev=110.95 lat (msec): min=11, max=2079, avg=61.38, stdev=110.95 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 222], 99.50th=[ 236], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 28, max= 351, per=26.38%, avg=158.78, stdev=81.79, samples=74 iops : min= 1, max= 21, avg= 9.26, stdev= 5.15, samples=74 lat (msec) : 10=1.56%, 20=15.23%, 50=49.61%, 100=24.48%, 250=8.46% lat (msec) : 500=0.52%, >=2000=0.13% cpu : usr=0.09%, sys=3.31%, ctx=1354, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188895: Wed Sep 16 04:52:17 2026 read: IOPS=9, BW=146KiB/s (149kB/s)(6032KiB/41344msec) clat (msec): min=7, max=281, avg=41.65, stdev=35.18 lat (msec): min=7, max=281, avg=41.65, stdev=35.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 78], 95.00th=[ 113], | 99.00th=[ 194], 99.50th=[ 232], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 28, max= 381, per=26.65%, avg=152.45, stdev=79.75, samples=77 iops : min= 1, max= 23, avg= 8.88, stdev= 4.98, samples=77 write: IOPS=9, BW=151KiB/s (155kB/s)(6256KiB/41344msec); 0 zone resets clat (msec): min=13, max=2099, avg=65.48, stdev=112.61 lat (msec): min=13, max=2099, avg=65.49, stdev=112.61 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 81], 90.00th=[ 111], 95.00th=[ 167], | 99.00th=[ 253], 99.50th=[ 288], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 31, max= 479, per=26.16%, avg=157.46, stdev=76.02, samples=78 iops : min= 1, max= 29, avg= 9.17, stdev= 4.78, samples=78 lat (msec) : 10=1.43%, 20=13.28%, 50=49.87%, 100=25.91%, 250=8.72% lat (msec) : 500=0.65%, >=2000=0.13% cpu : usr=0.07%, sys=2.90%, ctx=1302, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=573KiB/s (586kB/s), 139KiB/s-157KiB/s (143kB/s-160kB/s), io=23.4MiB (24.5MB), run=39953-41829msec WRITE: bw=602KiB/s (617kB/s), 151KiB/s-159KiB/s (155kB/s-162kB/s), io=24.6MiB (25.8MB), run=39953-41829msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188911: Wed Sep 16 04:52:35 2026 read: IOPS=1, BW=1682KiB/s (1722kB/s)(7168KiB/4262msec) clat (msec): min=136, max=1069, avg=367.60, stdev=336.01 lat (msec): min=136, max=1069, avg=367.60, stdev=336.01 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 150], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 232], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 506], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1943, max= 4042, per=100.00%, avg=3225.00, stdev=1124.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1201KiB/s (1230kB/s)(5120KiB/4262msec); 0 zone resets clat (msec): min=125, max=756, avg=329.29, stdev=245.29 lat (msec): min=125, max=756, avg=329.39, stdev=245.27 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1347, max= 2035, per=44.66%, avg=1865.60, stdev=291.95, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.87%, ctx=92, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188912: Wed Sep 16 04:52:35 2026 read: IOPS=0, BW=298KiB/s (306kB/s)(2048KiB/6864msec) clat (msec): min=268, max=523, avg=395.97, stdev=180.49 lat (msec): min=268, max=523, avg=395.98, stdev=180.49 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1400, max= 2031, per=57.51%, avg=1715.50, stdev=446.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1492KiB/s (1528kB/s)(10.0MiB/6864msec); 0 zone resets clat (msec): min=113, max=2230, avg=588.60, stdev=633.32 lat (msec): min=114, max=2230, avg=588.68, stdev=633.32 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 180], | 30.00th=[ 184], 40.00th=[ 220], 50.00th=[ 342], 60.00th=[ 388], | 70.00th=[ 575], 80.00th=[ 776], 90.00th=[ 877], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1400, max= 4079, per=60.20%, avg=2514.67, stdev=1091.97, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=4.47%, ctx=90, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188913: Wed Sep 16 04:52:35 2026 read: IOPS=1, BW=1344KiB/s (1376kB/s)(6144KiB/4573msec) clat (msec): min=113, max=771, avg=390.17, stdev=262.06 lat (msec): min=113, max=771, avg=390.17, stdev=262.06 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 510], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1943, max= 4031, per=100.00%, avg=3221.33, stdev=1120.12, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1344KiB/s (1376kB/s)(6144KiB/4573msec); 0 zone resets clat (msec): min=129, max=887, avg=349.30, stdev=273.65 lat (msec): min=129, max=887, avg=349.39, stdev=273.66 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 292], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1845, max= 2748, per=51.02%, avg=2131.00, stdev=353.64, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=3.57%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188914: Wed Sep 16 04:52:35 2026 read: IOPS=1, BW=1166KiB/s (1194kB/s)(5120KiB/4391msec) clat (msec): min=160, max=823, avg=375.55, stdev=272.59 lat (msec): min=160, max=823, avg=375.55, stdev=272.59 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 3976, max= 4071, per=100.00%, avg=4023.50, stdev=67.18, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1632KiB/s (1672kB/s)(7168KiB/4391msec); 0 zone resets clat (msec): min=176, max=698, avg=352.18, stdev=169.95 lat (msec): min=176, max=698, avg=352.26, stdev=169.96 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 243], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 305], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 414], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1943, max= 3690, per=60.32%, avg=2519.60, stdev=773.07, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.03%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2984KiB/s (3055kB/s), 298KiB/s-1682KiB/s (306kB/s-1722kB/s), io=20.0MiB (20.0MB), run=4262-6864msec WRITE: bw=4177KiB/s (4277kB/s), 1201KiB/s-1632KiB/s (1230kB/s-1672kB/s), io=28.0MiB (29.4MB), run=4262-6864msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188916: Wed Sep 16 04:52:35 2026 read: IOPS=1, BW=1739KiB/s (1780kB/s)(7168KiB/4123msec) clat (usec): min=481, max=779386, avg=371648.27, stdev=260305.90 lat (usec): min=483, max=779388, avg=371649.80, stdev=260305.95 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[200279], | 30.00th=[267387], 40.00th=[267387], 50.00th=[346031], 60.00th=[383779], | 70.00th=[383779], 80.00th=[616563], 90.00th=[775947], 95.00th=[775947], | 99.00th=[775947], 99.50th=[775947], 99.90th=[775947], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 1595, max= 4071, per=67.86%, avg=2355.50, stdev=1155.72, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1242KiB/s (1272kB/s)(5120KiB/4123msec); 0 zone resets clat (msec): min=82, max=373, avg=297.56, stdev=121.28 lat (msec): min=82, max=373, avg=297.74, stdev=121.36 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1756, max= 4071, per=53.64%, avg=2606.33, stdev=1273.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.48%, ctx=214, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188917: Wed Sep 16 04:52:35 2026 read: IOPS=0, BW=347KiB/s (355kB/s)(2048KiB/5900msec) clat (msec): min=3, max=503, avg=253.69, stdev=353.85 lat (msec): min=3, max=503, avg=253.69, stdev=353.85 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 4], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1420, max= 2035, per=49.77%, avg=1727.50, stdev=434.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1736KiB/s (1777kB/s)(10.0MiB/5900msec); 0 zone resets clat (msec): min=128, max=1420, avg=538.48, stdev=396.34 lat (msec): min=128, max=1420, avg=538.58, stdev=396.34 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 236], | 30.00th=[ 266], 40.00th=[ 292], 50.00th=[ 372], 60.00th=[ 435], | 70.00th=[ 550], 80.00th=[ 760], 90.00th=[ 936], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1756, max= 4079, per=52.71%, avg=2561.29, stdev=1009.70, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 4=8.33%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=10.04%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188918: Wed Sep 16 04:52:35 2026 read: IOPS=1, BW=1174KiB/s (1202kB/s)(6144KiB/5232msec) clat (usec): min=583, max=232097, avg=68112.45, stdev=104883.86 lat (usec): min=584, max=232098, avg=68113.64, stdev=104883.63 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 742], | 30.00th=[ 742], 40.00th=[ 799], 50.00th=[ 799], 60.00th=[ 4293], | 70.00th=[170918], 80.00th=[170918], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 1818, max= 6095, per=95.12%, avg=3301.67, stdev=2420.66, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1174KiB/s (1202kB/s)(6144KiB/5232msec); 0 zone resets clat (msec): min=219, max=2514, avg=803.15, stdev=875.90 lat (msec): min=219, max=2514, avg=803.20, stdev=875.91 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 659], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1818, max= 4096, per=51.31%, avg=2493.00, stdev=1073.29, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=9.50%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188919: Wed Sep 16 04:52:35 2026 read: IOPS=1, BW=1095KiB/s (1122kB/s)(5120KiB/4674msec) clat (usec): min=1009, max=643489, avg=341676.72, stdev=249002.95 lat (usec): min=1010, max=643490, avg=341678.02, stdev=249002.94 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1012], 10.00th=[ 1012], 20.00th=[ 1012], | 30.00th=[225444], 40.00th=[225444], 50.00th=[329253], 60.00th=[329253], | 70.00th=[505414], 80.00th=[505414], 90.00th=[641729], 95.00th=[641729], | 99.00th=[641729], 99.50th=[641729], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 3512, max= 4071, per=100.00%, avg=3791.50, stdev=395.27, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1534KiB/s (1570kB/s)(7168KiB/4674msec); 0 zone resets clat (msec): min=160, max=1397, avg=422.95, stdev=444.86 lat (msec): min=160, max=1398, avg=423.08, stdev=444.93 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 174], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 245], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 506], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1376, max= 5919, per=68.32%, avg=3319.75, stdev=2058.90, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 2=8.33%, 250=50.00%, 500=8.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=11.75%, ctx=307, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3471KiB/s (3554kB/s), 347KiB/s-1739KiB/s (355kB/s-1780kB/s), io=20.0MiB (20.0MB), run=4123-5900msec WRITE: bw=4860KiB/s (4976kB/s), 1174KiB/s-1736KiB/s (1202kB/s-1777kB/s), io=28.0MiB (29.4MB), run=4123-5900msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188927: Wed Sep 16 04:52:47 2026 read: IOPS=1, BW=6387KiB/s (6540kB/s)(12.0MiB/1924msec) clat (msec): min=287, max=951, avg=589.31, stdev=336.16 lat (msec): min=287, max=951, avg=589.31, stdev=336.16 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 6638, max= 8175, per=95.84%, avg=7406.50, stdev=1086.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=14.82%, ctx=91, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188929: Wed Sep 16 04:52:47 2026 read: IOPS=0, BW=1932KiB/s (1978kB/s)(4096KiB/2120msec) clat (nsec): min=879681k, max=879681k, avg=879681126.00, stdev= 0.00 lat (nsec): min=879683k, max=879683k, avg=879682935.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3864KiB/s (3957kB/s)(8192KiB/2120msec); 0 zone resets clat (msec): min=284, max=848, avg=566.54, stdev=399.44 lat (msec): min=284, max=849, avg=566.98, stdev=399.41 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8175, max= 8175, per=61.57%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=9.86%, ctx=92, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188931: Wed Sep 16 04:52:47 2026 write: IOPS=1, BW=5899KiB/s (6041kB/s)(12.0MiB/2083msec); 0 zone resets clat (msec): min=241, max=1026, avg=651.74, stdev=393.61 lat (msec): min=241, max=1026, avg=652.05, stdev=393.62 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8175, max= 8175, per=61.57%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.96%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188933: Wed Sep 16 04:52:47 2026 write: IOPS=1, BW=4979KiB/s (5098kB/s)(12.0MiB/2468msec); 0 zone resets clat (msec): min=161, max=1572, avg=792.13, stdev=717.23 lat (msec): min=161, max=1572, avg=792.38, stdev=717.22 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8175, max= 8175, per=61.57%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=13.38%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7728KiB/s (7914kB/s), 1932KiB/s-6387KiB/s (1978kB/s-6540kB/s), io=16.0MiB (16.8MB), run=1924-2120msec WRITE: bw=12.0MiB/s (13.6MB/s), 3864KiB/s-5899KiB/s (3957kB/s-6041kB/s), io=32.0MiB (33.6MB), run=2083-2468msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188928: Wed Sep 16 04:52:47 2026 read: IOPS=1, BW=6838KiB/s (7002kB/s)(12.0MiB/1797msec) clat (msec): min=442, max=704, avg=562.42, stdev=132.41 lat (msec): min=442, max=704, avg=562.43, stdev=132.41 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7135, max= 8110, per=91.62%, avg=7622.50, stdev=689.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=33.74%, ctx=1182, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188930: Wed Sep 16 04:52:47 2026 read: IOPS=0, BW=2080KiB/s (2130kB/s)(4096KiB/1969msec) clat (nsec): min=465777k, max=465777k, avg=465776644.00, stdev= 0.00 lat (nsec): min=465780k, max=465780k, avg=465780371.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7001, max= 7001, per=84.15%, avg=7001.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4160KiB/s (4260kB/s)(8192KiB/1969msec); 0 zone resets clat (msec): min=452, max=934, avg=693.41, stdev=341.30 lat (msec): min=452, max=935, avg=694.10, stdev=341.89 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8110, max= 8110, per=60.29%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.24%, ctx=613, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188932: Wed Sep 16 04:52:47 2026 write: IOPS=1, BW=5044KiB/s (5165kB/s)(12.0MiB/2436msec); 0 zone resets clat (msec): min=203, max=1269, avg=784.32, stdev=539.11 lat (msec): min=204, max=1269, avg=784.63, stdev=539.16 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8110, max= 8110, per=60.29%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=9.90%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188934: Wed Sep 16 04:52:47 2026 write: IOPS=1, BW=7319KiB/s (7494kB/s)(12.0MiB/1679msec); 0 zone resets clat (msec): min=259, max=959, avg=533.62, stdev=374.01 lat (msec): min=259, max=959, avg=533.98, stdev=373.96 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7488, max= 8110, per=57.98%, avg=7799.00, stdev=439.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.96%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8321KiB/s (8521kB/s), 2080KiB/s-6838KiB/s (2130kB/s-7002kB/s), io=16.0MiB (16.8MB), run=1797-1969msec WRITE: bw=13.1MiB/s (13.8MB/s), 4160KiB/s-7319KiB/s (4260kB/s-7494kB/s), io=32.0MiB (33.6MB), run=1679-2436msec