== sanity test 398b: DIO and buffer IO race ============== 19:23:40 (1789687420) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.47627 s, 9.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145397: Thu Sep 17 19:26:11 2026 read: IOPS=11, BW=45.9KiB/s (46.0kB/s)(5992KiB/130612msec) clat (usec): min=32, max=397552, avg=42370.19, stdev=35916.85 lat (usec): min=32, max=397554, avg=42372.72, stdev=35917.48 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 75], 20.00th=[ 17957], | 30.00th=[ 23987], 40.00th=[ 29492], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[154141], 99.50th=[217056], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 102, per=25.52%, avg=45.93, stdev=20.13, samples=254 iops : min= 1, max= 25, avg=10.87, stdev= 5.05, samples=254 write: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6296KiB/130612msec); 0 zone resets clat (usec): min=859, max=369761, avg=42556.40, stdev=46244.82 lat (usec): min=859, max=369763, avg=42559.89, stdev=46244.23 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1139], 10.00th=[ 1352], 20.00th=[ 3195], | 30.00th=[ 7242], 40.00th=[ 16581], 50.00th=[ 30278], 60.00th=[ 41681], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[104334], 95.00th=[129500], | 99.00th=[185598], 99.50th=[252707], 99.90th=[346031], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 6, max= 133, per=25.46%, avg=47.86, stdev=20.83, samples=256 iops : min= 1, max= 33, avg=11.36, stdev= 5.25, samples=256 lat (usec) : 50=1.11%, 100=4.23%, 250=0.29%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.52% lat (msec) : 2=7.42%, 4=3.68%, 10=6.05%, 20=9.47%, 50=33.63% lat (msec) : 100=25.39%, 250=7.55%, 500=0.42% cpu : usr=0.07%, sys=4.84%, ctx=6161, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145398: Thu Sep 17 19:26:11 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(5940KiB/129991msec) clat (usec): min=35, max=270438, avg=40848.60, stdev=31860.06 lat (usec): min=35, max=270439, avg=40851.30, stdev=31860.43 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 81], 20.00th=[ 17695], | 30.00th=[ 24249], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[156238], 99.50th=[175113], 99.90th=[238027], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 6, max= 111, per=25.68%, avg=46.22, stdev=20.34, samples=251 iops : min= 1, max= 27, avg=10.93, stdev= 5.09, samples=251 write: IOPS=12, BW=48.8KiB/s (50.0kB/s)(6348KiB/129991msec); 0 zone resets clat (usec): min=722, max=448818, avg=43557.47, stdev=47028.08 lat (usec): min=724, max=449035, avg=43563.33, stdev=47026.45 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1156], 10.00th=[ 1352], 20.00th=[ 3982], | 30.00th=[ 9110], 40.00th=[ 20579], 50.00th=[ 32900], 60.00th=[ 43254], | 70.00th=[ 56361], 80.00th=[ 74974], 90.00th=[104334], 95.00th=[126354], | 99.00th=[196084], 99.50th=[270533], 99.90th=[392168], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 6, max= 136, per=25.73%, avg=48.38, stdev=20.21, samples=256 iops : min= 1, max= 34, avg=11.48, stdev= 5.10, samples=256 lat (usec) : 50=1.07%, 100=4.26%, 250=0.36%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.42% lat (msec) : 2=7.19%, 4=2.93%, 10=6.25%, 20=8.79%, 50=36.30% lat (msec) : 100=24.38%, 250=7.45%, 500=0.42% cpu : usr=0.07%, sys=4.87%, ctx=6166, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145399: Thu Sep 17 19:26:11 2026 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6028KiB/130805msec) clat (usec): min=32, max=261899, avg=41533.42, stdev=32373.74 lat (usec): min=33, max=261901, avg=41542.93, stdev=32375.51 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 72], 20.00th=[ 17433], | 30.00th=[ 23462], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[145753], 99.50th=[158335], 99.90th=[252707], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 109, per=25.65%, avg=46.16, stdev=20.95, samples=255 iops : min= 1, max= 27, avg=10.93, stdev= 5.28, samples=255 write: IOPS=11, BW=47.9KiB/s (49.0kB/s)(6260KiB/130805msec); 0 zone resets clat (usec): min=754, max=438367, avg=43479.90, stdev=47472.37 lat (usec): min=755, max=438369, avg=43484.21, stdev=47471.65 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1303], 20.00th=[ 3490], | 30.00th=[ 7963], 40.00th=[ 20055], 50.00th=[ 31327], 60.00th=[ 43779], | 70.00th=[ 57410], 80.00th=[ 76022], 90.00th=[100140], 95.00th=[125305], | 99.00th=[202376], 99.50th=[263193], 99.90th=[387974], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 7, max= 103, per=25.20%, avg=47.38, stdev=19.73, samples=258 iops : min= 1, max= 25, avg=11.24, stdev= 4.97, samples=258 lat (usec) : 50=1.11%, 100=4.33%, 250=0.33%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=7.52%, 4=3.09%, 10=6.32%, 20=8.79%, 50=34.51% lat (msec) : 100=25.72%, 250=7.36%, 500=0.33% cpu : usr=0.07%, sys=4.91%, ctx=6201, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145400: Thu Sep 17 19:26:11 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6052KiB/133017msec) clat (usec): min=30, max=390955, avg=41362.91, stdev=35213.69 lat (usec): min=30, max=390957, avg=41365.92, stdev=35214.58 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 70], 20.00th=[ 16581], | 30.00th=[ 22414], 40.00th=[ 28443], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[168821], 99.50th=[198181], 99.90th=[278922], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 127, per=25.30%, avg=45.54, stdev=21.53, samples=259 iops : min= 1, max= 31, avg=10.77, stdev= 5.41, samples=259 write: IOPS=11, BW=46.9KiB/s (48.0kB/s)(6236KiB/133017msec); 0 zone resets clat (usec): min=733, max=428563, avg=45062.66, stdev=46913.61 lat (usec): min=735, max=428564, avg=45065.94, stdev=46913.62 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1401], 20.00th=[ 4359], | 30.00th=[ 8848], 40.00th=[ 20579], 50.00th=[ 32637], 60.00th=[ 44827], | 70.00th=[ 60556], 80.00th=[ 80217], 90.00th=[107480], 95.00th=[132645], | 99.00th=[200279], 99.50th=[223347], 99.90th=[387974], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 110, per=24.74%, avg=46.52, stdev=19.25, samples=261 iops : min= 1, max= 27, avg=11.01, stdev= 4.83, samples=261 lat (usec) : 50=1.20%, 100=4.59%, 250=0.52%, 500=0.07%, 750=0.16% lat (usec) : 1000=0.36% lat (msec) : 2=6.15%, 4=3.42%, 10=6.61%, 20=9.51%, 50=33.37% lat (msec) : 100=25.29%, 250=8.40%, 500=0.36% cpu : usr=0.07%, sys=4.80%, ctx=6230, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (185kB/s), 45.5KiB/s-46.1KiB/s (46.6kB/s-47.2kB/s), io=23.4MiB (24.6MB), run=129991-133017msec WRITE: bw=189KiB/s (194kB/s), 46.9KiB/s-48.8KiB/s (48.0kB/s-50.0kB/s), io=24.6MiB (25.7MB), run=129991-133017msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145392: Thu Sep 17 19:28:41 2026 read: IOPS=5, BW=21.1KiB/s (21.6kB/s)(5992KiB/283940msec) clat (msec): min=5, max=1194, avg=39.83, stdev=48.48 lat (msec): min=5, max=1194, avg=39.83, stdev=48.48 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 111], | 99.00th=[ 207], 99.50th=[ 257], 99.90th=[ 414], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 104, per=28.91%, avg=24.29, stdev=16.25, samples=476 iops : min= 1, max= 26, avg= 5.46, stdev= 4.12, samples=476 write: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6296KiB/283940msec); 0 zone resets clat (msec): min=30, max=624, avg=142.23, stdev=75.22 lat (msec): min=30, max=624, avg=142.23, stdev=75.22 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 163], 80.00th=[ 197], 90.00th=[ 245], 95.00th=[ 296], | 99.00th=[ 397], 99.50th=[ 447], 99.90th=[ 550], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 63, per=24.98%, avg=21.98, stdev=10.86, samples=550 iops : min= 1, max= 15, avg= 4.87, stdev= 2.80, samples=550 lat (msec) : 10=3.09%, 20=13.28%, 50=22.49%, 100=24.45%, 250=31.67% lat (msec) : 500=4.82%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5517, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145393: Thu Sep 17 19:28:41 2026 read: IOPS=5, BW=20.0KiB/s (21.5kB/s)(5940KiB/283060msec) clat (msec): min=5, max=939, avg=37.33, stdev=40.93 lat (msec): min=5, max=939, avg=37.33, stdev=40.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 72], 95.00th=[ 102], | 99.00th=[ 188], 99.50th=[ 224], 99.90th=[ 342], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 87, per=29.29%, avg=24.60, stdev=15.91, samples=466 iops : min= 1, max= 21, avg= 5.53, stdev= 4.03, samples=466 write: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6348KiB/283060msec); 0 zone resets clat (msec): min=33, max=658, avg=143.19, stdev=77.25 lat (msec): min=33, max=658, avg=143.19, stdev=77.25 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 197], 90.00th=[ 249], 95.00th=[ 292], | 99.00th=[ 401], 99.50th=[ 460], 99.90th=[ 625], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 56, per=25.21%, avg=22.19, stdev=10.79, samples=550 iops : min= 1, max= 14, avg= 4.92, stdev= 2.78, samples=550 lat (msec) : 10=2.73%, 20=14.10%, 50=22.30%, 100=24.77%, 250=30.89% lat (msec) : 500=5.05%, 750=0.13%, 1000=0.03% cpu : usr=0.04%, sys=1.13%, ctx=5514, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145394: Thu Sep 17 19:28:41 2026 read: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6028KiB/283145msec) clat (msec): min=5, max=416, avg=39.34, stdev=37.17 lat (msec): min=5, max=416, avg=39.34, stdev=37.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 182], 99.50th=[ 220], 99.90th=[ 405], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 120, per=27.99%, avg=23.52, stdev=17.32, samples=495 iops : min= 1, max= 30, avg= 5.26, stdev= 4.38, samples=495 write: IOPS=5, BW=22.1KiB/s (22.6kB/s)(6260KiB/283145msec); 0 zone resets clat (msec): min=33, max=1026, avg=142.79, stdev=79.25 lat (msec): min=33, max=1026, avg=142.79, stdev=79.25 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 192], 90.00th=[ 255], 95.00th=[ 300], | 99.00th=[ 405], 99.50th=[ 451], 99.90th=[ 550], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 56, per=24.80%, avg=21.83, stdev=10.83, samples=552 iops : min= 1, max= 14, avg= 4.84, stdev= 2.78, samples=552 lat (msec) : 10=3.12%, 20=12.63%, 50=22.59%, 100=25.98%, 250=30.24% lat (msec) : 500=5.34%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=5425, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145395: Thu Sep 17 19:28:41 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6052KiB/283240msec) clat (msec): min=4, max=530, avg=38.92, stdev=40.44 lat (msec): min=4, max=530, avg=38.92, stdev=40.44 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 114], | 99.00th=[ 199], 99.50th=[ 245], 99.90th=[ 443], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 111, per=29.18%, avg=24.51, stdev=16.96, samples=477 iops : min= 1, max= 27, avg= 5.51, stdev= 4.29, samples=477 write: IOPS=5, BW=22.0KiB/s (22.5kB/s)(6236KiB/283240msec); 0 zone resets clat (msec): min=37, max=1039, avg=143.66, stdev=79.65 lat (msec): min=37, max=1039, avg=143.67, stdev=79.65 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 106], 50.00th=[ 120], 60.00th=[ 140], | 70.00th=[ 165], 80.00th=[ 194], 90.00th=[ 257], 95.00th=[ 305], | 99.00th=[ 376], 99.50th=[ 418], 99.90th=[ 531], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 55, per=24.73%, avg=21.76, stdev=10.99, samples=551 iops : min= 1, max= 13, avg= 4.82, stdev= 2.82, samples=551 lat (msec) : 10=3.09%, 20=13.35%, 50=23.05%, 100=24.35%, 250=30.57% lat (msec) : 500=5.44%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5532, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=84.6KiB/s (86.6kB/s), 20.0KiB/s-21.4KiB/s (21.5kB/s-21.9kB/s), io=23.4MiB (24.6MB), run=283060-283940msec WRITE: bw=88.5KiB/s (90.7kB/s), 22.0KiB/s-22.4KiB/s (22.5kB/s-22.0kB/s), io=24.6MiB (25.7MB), run=283060-283940msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145458: Thu Sep 17 19:29:13 2026 read: IOPS=17, BW=278KiB/s (285kB/s)(5920KiB/21261msec) clat (usec): min=28, max=164810, avg=27808.79, stdev=23197.19 lat (usec): min=28, max=164811, avg=27810.23, stdev=23197.90 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 75], | 30.00th=[ 15926], 40.00th=[ 22152], 50.00th=[ 27395], 60.00th=[ 31851], | 70.00th=[ 38011], 80.00th=[ 44303], 90.00th=[ 55313], 95.00th=[ 66323], | 99.00th=[104334], 99.50th=[108528], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 95, max= 535, per=27.31%, avg=278.24, stdev=107.64, samples=42 iops : min= 5, max= 33, avg=16.60, stdev= 6.78, samples=42 write: IOPS=18, BW=300KiB/s (307kB/s)(6368KiB/21261msec); 0 zone resets clat (usec): min=992, max=168852, avg=26969.67, stdev=29291.44 lat (usec): min=993, max=168855, avg=26973.64, stdev=29293.16 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1647], 10.00th=[ 2114], 20.00th=[ 3720], | 30.00th=[ 5407], 40.00th=[ 8979], 50.00th=[ 15139], 60.00th=[ 24773], | 70.00th=[ 34341], 80.00th=[ 49546], 90.00th=[ 66847], 95.00th=[ 86508], | 99.00th=[130548], 99.50th=[141558], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 127, max= 541, per=27.89%, avg=298.98, stdev=104.71, samples=42 iops : min= 7, max= 33, avg=17.90, stdev= 6.62, samples=42 lat (usec) : 50=2.21%, 100=8.59%, 250=0.91%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.43%, 4=7.16%, 10=10.16%, 20=12.24%, 50=36.98% lat (msec) : 100=14.97%, 250=1.95% cpu : usr=0.12%, sys=6.96%, ctx=1308, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145459: Thu Sep 17 19:29:13 2026 read: IOPS=16, BW=260KiB/s (266kB/s)(5744KiB/22130msec) clat (usec): min=33, max=132070, avg=27567.18, stdev=25411.60 lat (usec): min=34, max=132070, avg=27579.73, stdev=25400.03 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 44], 10.00th=[ 57], 20.00th=[ 67], | 30.00th=[ 318], 40.00th=[ 20055], 50.00th=[ 25560], 60.00th=[ 30802], | 70.00th=[ 36439], 80.00th=[ 46924], 90.00th=[ 62129], 95.00th=[ 73925], | 99.00th=[110625], 99.50th=[120062], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 31, max= 541, per=26.17%, avg=266.71, stdev=109.89, samples=42 iops : min= 1, max= 33, avg=15.90, stdev= 6.87, samples=42 write: IOPS=18, BW=296KiB/s (303kB/s)(6544KiB/22130msec); 0 zone resets clat (usec): min=1272, max=296633, avg=28880.33, stdev=33799.72 lat (usec): min=1275, max=296634, avg=28882.42, stdev=33799.93 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1663], 10.00th=[ 2180], 20.00th=[ 3949], | 30.00th=[ 6652], 40.00th=[ 10159], 50.00th=[ 15664], 60.00th=[ 27132], | 70.00th=[ 36439], 80.00th=[ 47973], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[162530], 99.50th=[175113], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 534, per=27.74%, avg=297.33, stdev=126.97, samples=43 iops : min= 1, max= 33, avg=17.84, stdev= 8.02, samples=43 lat (usec) : 50=2.73%, 100=10.29%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=4.56%, 4=6.12%, 10=10.42%, 20=12.24%, 50=34.38% lat (msec) : 100=15.49%, 250=2.47%, 500=0.13% cpu : usr=0.07%, sys=6.61%, ctx=1333, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145460: Thu Sep 17 19:29:13 2026 read: IOPS=16, BW=269KiB/s (276kB/s)(6256KiB/23248msec) clat (usec): min=33, max=207422, avg=31862.05, stdev=28852.36 lat (usec): min=33, max=207423, avg=31863.15, stdev=28852.34 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 60], 20.00th=[ 80], | 30.00th=[ 17171], 40.00th=[ 24249], 50.00th=[ 29230], 60.00th=[ 35390], | 70.00th=[ 41681], 80.00th=[ 51119], 90.00th=[ 65799], 95.00th=[ 79168], | 99.00th=[124257], 99.50th=[191890], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 95, max= 541, per=26.38%, avg=268.78, stdev=101.54, samples=46 iops : min= 5, max= 33, avg=16.04, stdev= 6.47, samples=46 write: IOPS=16, BW=259KiB/s (266kB/s)(6032KiB/23248msec); 0 zone resets clat (usec): min=1144, max=333460, avg=28373.56, stdev=32862.23 lat (usec): min=1146, max=333460, avg=28378.75, stdev=32859.79 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1696], 10.00th=[ 1975], 20.00th=[ 3589], | 30.00th=[ 6194], 40.00th=[ 9765], 50.00th=[ 16909], 60.00th=[ 26608], | 70.00th=[ 36963], 80.00th=[ 49546], 90.00th=[ 67634], 95.00th=[ 88605], | 99.00th=[135267], 99.50th=[173016], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 126, max= 542, per=24.13%, avg=258.65, stdev=96.44, samples=46 iops : min= 7, max= 33, avg=15.39, stdev= 6.11, samples=46 lat (usec) : 50=1.82%, 100=9.24%, 250=1.30%, 500=0.39%, 1000=0.26% lat (msec) : 2=5.08%, 4=5.47%, 10=9.77%, 20=9.64%, 50=36.85% lat (msec) : 100=17.71%, 250=2.34%, 500=0.13% cpu : usr=0.10%, sys=6.98%, ctx=1366, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145461: Thu Sep 17 19:29:13 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(6032KiB/23503msec) clat (usec): min=34, max=152819, avg=29815.60, stdev=25766.48 lat (usec): min=34, max=152820, avg=29816.66, stdev=25766.38 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 70], | 30.00th=[ 14091], 40.00th=[ 22414], 50.00th=[ 29230], 60.00th=[ 34341], | 70.00th=[ 41157], 80.00th=[ 51119], 90.00th=[ 60031], 95.00th=[ 74974], | 99.00th=[105382], 99.50th=[115868], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 31, max= 510, per=25.91%, avg=264.07, stdev=108.28, samples=45 iops : min= 1, max= 31, avg=15.71, stdev= 6.84, samples=45 write: IOPS=16, BW=266KiB/s (273kB/s)(6256KiB/23503msec); 0 zone resets clat (usec): min=1034, max=271008, avg=30452.87, stdev=38803.66 lat (usec): min=1035, max=271011, avg=30473.60, stdev=38843.01 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1631], 10.00th=[ 2147], 20.00th=[ 4080], | 30.00th=[ 6325], 40.00th=[ 9241], 50.00th=[ 14615], 60.00th=[ 22938], | 70.00th=[ 34341], 80.00th=[ 53216], 90.00th=[ 73925], 95.00th=[103285], | 99.00th=[212861], 99.50th=[235930], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 538, per=25.02%, avg=268.17, stdev=118.55, samples=46 iops : min= 3, max= 33, avg=15.96, stdev= 7.45, samples=46 lat (usec) : 50=1.95%, 100=10.42%, 250=0.52%, 500=0.39%, 1000=0.26% lat (msec) : 2=4.95%, 4=5.99%, 10=11.59%, 20=10.55%, 50=31.51% lat (msec) : 100=18.36%, 250=3.39%, 500=0.13% cpu : usr=0.11%, sys=6.44%, ctx=1340, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1019KiB/s (1044kB/s), 257KiB/s-278KiB/s (263kB/s-285kB/s), io=23.4MiB (24.5MB), run=21261-23503msec WRITE: bw=1072KiB/s (1098kB/s), 259KiB/s-300KiB/s (266kB/s-307kB/s), io=24.6MiB (25.8MB), run=21261-23503msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145454: Thu Sep 17 19:29:48 2026 read: IOPS=6, BW=102KiB/s (105kB/s)(5920KiB/57822msec) clat (msec): min=5, max=198, avg=31.86, stdev=29.24 lat (msec): min=5, max=198, avg=31.86, stdev=29.24 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 66], 95.00th=[ 92], | 99.00th=[ 161], 99.50th=[ 184], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 30, max= 372, per=25.94%, avg=105.82, stdev=64.35, samples=109 iops : min= 1, max= 23, avg= 5.83, stdev= 4.08, samples=109 write: IOPS=6, BW=110KiB/s (113kB/s)(6368KiB/57822msec); 0 zone resets clat (msec): min=35, max=340, avg=115.00, stdev=47.17 lat (msec): min=35, max=340, avg=115.01, stdev=47.17 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 75], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 106], 60.00th=[ 121], | 70.00th=[ 131], 80.00th=[ 153], 90.00th=[ 184], 95.00th=[ 197], | 99.00th=[ 275], 99.50th=[ 288], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 224, per=25.72%, avg=110.35, stdev=45.27, samples=113 iops : min= 1, max= 14, avg= 6.12, stdev= 2.94, samples=113 lat (msec) : 10=3.12%, 20=18.49%, 50=20.05%, 100=27.21%, 250=30.34% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.41%, ctx=1208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145455: Thu Sep 17 19:29:48 2026 read: IOPS=6, BW=97.0KiB/s (100kB/s)(5744KiB/58640msec) clat (msec): min=6, max=172, avg=30.20, stdev=27.66 lat (msec): min=6, max=172, avg=30.20, stdev=27.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 66], 95.00th=[ 96], | 99.00th=[ 148], 99.50th=[ 169], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 30, max= 352, per=26.75%, avg=109.15, stdev=75.19, samples=103 iops : min= 1, max= 22, avg= 6.07, stdev= 4.77, samples=103 write: IOPS=6, BW=112KiB/s (114kB/s)(6544KiB/58640msec); 0 zone resets clat (msec): min=39, max=326, avg=116.71, stdev=51.80 lat (msec): min=39, max=326, avg=116.71, stdev=51.80 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 52], 10.00th=[ 61], 20.00th=[ 72], | 30.00th=[ 84], 40.00th=[ 95], 50.00th=[ 108], 60.00th=[ 122], | 70.00th=[ 134], 80.00th=[ 157], 90.00th=[ 188], 95.00th=[ 209], | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 320, per=25.89%, avg=111.09, stdev=49.89, samples=116 iops : min= 1, max= 20, avg= 6.17, stdev= 3.23, samples=116 lat (msec) : 10=4.56%, 20=18.75%, 50=18.75%, 100=27.08%, 250=29.30% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.43%, ctx=1312, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145456: Thu Sep 17 19:29:48 2026 read: IOPS=6, BW=109KiB/s (111kB/s)(6256KiB/57641msec) clat (msec): min=5, max=217, avg=31.54, stdev=28.66 lat (msec): min=5, max=217, avg=31.54, stdev=28.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 67], 95.00th=[ 88], | 99.00th=[ 150], 99.50th=[ 169], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 30, max= 378, per=28.09%, avg=114.59, stdev=78.84, samples=108 iops : min= 1, max= 23, avg= 6.39, stdev= 5.04, samples=108 write: IOPS=6, BW=105KiB/s (107kB/s)(6032KiB/57641msec); 0 zone resets clat (msec): min=38, max=315, avg=119.21, stdev=48.81 lat (msec): min=38, max=315, avg=119.22, stdev=48.81 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 110], 60.00th=[ 121], | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 188], 95.00th=[ 215], | 99.00th=[ 268], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 192, per=24.19%, avg=103.78, stdev=41.53, samples=114 iops : min= 1, max= 12, avg= 5.70, stdev= 2.67, samples=114 lat (msec) : 10=3.78%, 20=19.53%, 50=20.05%, 100=26.04%, 250=29.95% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.43%, ctx=1344, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145457: Thu Sep 17 19:29:48 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(6032KiB/57714msec) clat (msec): min=7, max=171, avg=30.28, stdev=27.41 lat (msec): min=7, max=171, avg=30.28, stdev=27.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 61], 95.00th=[ 80], | 99.00th=[ 165], 99.50th=[ 169], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 31, max= 316, per=27.43%, avg=111.91, stdev=69.79, samples=105 iops : min= 1, max= 19, avg= 6.22, stdev= 4.39, samples=105 write: IOPS=6, BW=108KiB/s (111kB/s)(6256KiB/57714msec); 0 zone resets clat (msec): min=36, max=376, avg=117.98, stdev=51.38 lat (msec): min=36, max=376, avg=117.98, stdev=51.38 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 99], 50.00th=[ 108], 60.00th=[ 121], | 70.00th=[ 134], 80.00th=[ 153], 90.00th=[ 186], 95.00th=[ 209], | 99.00th=[ 309], 99.50th=[ 351], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 223, per=25.34%, avg=108.70, stdev=42.55, samples=113 iops : min= 1, max= 13, avg= 6.01, stdev= 2.77, samples=113 lat (msec) : 10=2.99%, 20=21.09%, 50=19.66%, 100=25.52%, 250=29.56% lat (msec) : 500=1.17% cpu : usr=0.05%, sys=1.38%, ctx=1286, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=408KiB/s (418kB/s), 97.0KiB/s-109KiB/s (100kB/s-111kB/s), io=23.4MiB (24.5MB), run=57641-58640msec WRITE: bw=430KiB/s (440kB/s), 105KiB/s-112KiB/s (107kB/s-114kB/s), io=24.6MiB (25.8MB), run=57641-58640msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145481: Thu Sep 17 19:30:05 2026 read: IOPS=1, BW=1539KiB/s (1575kB/s)(7168KiB/4659msec) clat (usec): min=484, max=281880, avg=167297.39, stdev=116809.31 lat (usec): min=486, max=281881, avg=167299.06, stdev=116809.52 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 553], | 30.00th=[196084], 40.00th=[196084], 50.00th=[217056], 60.00th=[235930], | 70.00th=[235930], 80.00th=[238027], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 2035, max= 4087, per=69.31%, avg=2758.50, stdev=966.83, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1099KiB/s (1125kB/s)(5120KiB/4659msec); 0 zone resets clat (msec): min=196, max=2022, avg=682.73, stdev=772.81 lat (msec): min=196, max=2022, avg=682.80, stdev=772.81 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 4079, max= 4087, per=73.28%, avg=4083.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.86%, ctx=182, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145482: Thu Sep 17 19:30:05 2026 read: IOPS=0, BW=408KiB/s (418kB/s)(2048KiB/5015msec) clat (msec): min=126, max=2198, avg=1162.64, stdev=1464.75 lat (msec): min=126, max=2198, avg=1162.64, stdev=1464.75 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 2048, max= 2048, per=51.46%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2042KiB/s (2091kB/s)(10.0MiB/5015msec); 0 zone resets clat (msec): min=74, max=660, avg=245.02, stdev=160.61 lat (msec): min=74, max=660, avg=245.10, stdev=160.62 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 150], | 30.00th=[ 161], 40.00th=[ 176], 50.00th=[ 182], 60.00th=[ 236], | 70.00th=[ 243], 80.00th=[ 255], 90.00th=[ 317], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2039, max= 5699, per=57.15%, avg=3184.20, stdev=1660.77, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.52, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.57%, ctx=404, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145483: Thu Sep 17 19:30:05 2026 read: IOPS=2, BW=2224KiB/s (2278kB/s)(6144KiB/2762msec) clat (usec): min=457, max=239099, avg=100886.55, stdev=93209.29 lat (usec): min=459, max=239100, avg=100887.82, stdev=93209.30 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 519], | 30.00th=[ 519], 40.00th=[ 86508], 50.00th=[ 86508], 60.00th=[115868], | 70.00th=[162530], 80.00th=[162530], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 4096, max= 6131, per=100.00%, avg=5113.50, stdev=1438.96, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2224KiB/s (2278kB/s)(6144KiB/2762msec); 0 zone resets clat (msec): min=97, max=692, avg=275.96, stdev=216.82 lat (msec): min=97, max=693, avg=276.04, stdev=216.83 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 209], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2048, max= 4087, per=61.06%, avg=3402.00, stdev=1172.63, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=8.33% cpu : usr=0.04%, sys=15.21%, ctx=282, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145484: Thu Sep 17 19:30:05 2026 read: IOPS=0, BW=995KiB/s (1019kB/s)(5120KiB/5145msec) clat (usec): min=565, max=243560, avg=142822.27, stdev=121772.27 lat (usec): min=567, max=243562, avg=142823.86, stdev=121772.39 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 19268], 40.00th=[ 19268], 50.00th=[219153], 60.00th=[219153], | 70.00th=[231736], 80.00th=[231736], 90.00th=[244319], 95.00th=[244319], | 99.00th=[244319], 99.50th=[244319], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 2048, max= 5699, per=97.32%, avg=3873.50, stdev=2581.65, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1393KiB/s (1427kB/s)(7168KiB/5145msec); 0 zone resets clat (msec): min=90, max=1896, avg=608.42, stdev=609.10 lat (msec): min=90, max=1896, avg=608.51, stdev=609.17 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 279], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 330], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 709], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 1537, max= 2048, per=34.32%, avg=1912.40, stdev=218.85, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=6.94%, ctx=140, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3981KiB/s (4076kB/s), 408KiB/s-2224KiB/s (418kB/s-2278kB/s), io=20.0MiB (20.0MB), run=2762-5145msec WRITE: bw=5573KiB/s (5707kB/s), 1099KiB/s-2224KiB/s (1125kB/s-2278kB/s), io=28.0MiB (29.4MB), run=2762-5145msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145477: Thu Sep 17 19:30:06 2026 read: IOPS=1, BW=1635KiB/s (1674kB/s)(7168KiB/4384msec) clat (msec): min=102, max=289, avg=192.51, stdev=75.96 lat (msec): min=102, max=289, avg=192.51, stdev=75.96 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 105], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 199], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1943, max= 4151, per=95.56%, avg=3364.67, stdev=1233.51, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1168KiB/s (1196kB/s)(5120KiB/4384msec); 0 zone resets clat (msec): min=146, max=1976, avg=585.22, stdev=780.64 lat (msec): min=147, max=1976, avg=586.15, stdev=780.15 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 1943, max= 4079, per=51.03%, avg=2515.25, stdev=1043.25, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=2.69%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145478: Thu Sep 17 19:30:06 2026 read: IOPS=0, BW=365KiB/s (374kB/s)(2048KiB/5606msec) clat (msec): min=85, max=537, avg=311.47, stdev=319.60 lat (msec): min=85, max=537, avg=311.47, stdev=319.60 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 86], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1358, max= 1943, per=46.88%, avg=1650.50, stdev=413.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1827KiB/s (1870kB/s)(10.0MiB/5606msec); 0 zone resets clat (msec): min=151, max=1997, avg=477.50, stdev=552.20 lat (msec): min=151, max=1997, avg=478.19, stdev=552.31 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 161], | 30.00th=[ 203], 40.00th=[ 236], 50.00th=[ 305], 60.00th=[ 309], | 70.00th=[ 321], 80.00th=[ 527], 90.00th=[ 567], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 2019, max= 6095, per=82.41%, avg=4062.00, stdev=1664.06, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=2.78%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145479: Thu Sep 17 19:30:06 2026 read: IOPS=1, BW=1358KiB/s (1391kB/s)(6144KiB/4523msec) clat (msec): min=77, max=1479, avg=360.17, stdev=549.91 lat (msec): min=77, max=1479, avg=360.17, stdev=549.91 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 159], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 3908, max= 4039, per=100.00%, avg=3973.50, stdev=92.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1358KiB/s (1391kB/s)(6144KiB/4523msec); 0 zone resets clat (msec): min=113, max=596, avg=349.55, stdev=226.66 lat (msec): min=113, max=596, avg=349.65, stdev=226.66 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 481], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2019, max= 2039, per=41.25%, avg=2033.00, stdev= 9.52, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=3.32%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145480: Thu Sep 17 19:30:06 2026 read: IOPS=0, BW=880KiB/s (901kB/s)(5120KiB/5816msec) clat (msec): min=42, max=564, avg=339.03, stdev=203.98 lat (msec): min=42, max=564, avg=339.03, stdev=203.98 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1943, max= 4063, per=75.86%, avg=2671.00, stdev=1205.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1232KiB/s (1262kB/s)(7168KiB/5816msec); 0 zone resets clat (msec): min=105, max=2084, avg=577.25, stdev=695.24 lat (msec): min=105, max=2084, avg=577.36, stdev=695.24 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 131], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 313], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 667], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 1368, max= 2039, per=37.71%, avg=1858.50, stdev=327.41, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=8.33%, 250=25.00%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.32%, ctx=75, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3521KiB/s (3606kB/s), 365KiB/s-1635KiB/s (374kB/s-1674kB/s), io=20.0MiB (20.0MB), run=4384-5816msec WRITE: bw=4930KiB/s (5048kB/s), 1168KiB/s-1827KiB/s (1196kB/s-1870kB/s), io=28.0MiB (29.4MB), run=4384-5816msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145491: Thu Sep 17 19:30:19 2026 read: IOPS=1, BW=5141KiB/s (5265kB/s)(12.0MiB/2390msec) clat (msec): min=358, max=1109, avg=765.32, stdev=379.77 lat (msec): min=358, max=1109, avg=765.32, stdev=379.77 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8110, max= 8159, per=100.00%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.13%, ctx=31, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145492: Thu Sep 17 19:30:19 2026 read: IOPS=0, BW=1282KiB/s (1313kB/s)(4096KiB/3194msec) clat (nsec): min=877777k, max=877777k, avg=877776786.00, stdev= 0.00 lat (nsec): min=877779k, max=877779k, avg=877779243.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2565KiB/s (2626kB/s)(8192KiB/3194msec); 0 zone resets clat (msec): min=397, max=1804, avg=1100.79, stdev=994.67 lat (msec): min=397, max=1804, avg=1101.25, stdev=994.65 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 1804], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.98%, ctx=45, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145493: Thu Sep 17 19:30:19 2026 write: IOPS=2, BW=8647KiB/s (8855kB/s)(12.0MiB/1421msec); 0 zone resets clat (msec): min=316, max=443, avg=382.45, stdev=64.12 lat (msec): min=318, max=444, avg=383.53, stdev=63.33 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 6574, max= 8047, per=71.26%, avg=7310.50, stdev=1041.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=9.58%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145494: Thu Sep 17 19:30:19 2026 write: IOPS=1, BW=4789KiB/s (4904kB/s)(12.0MiB/2566msec); 0 zone resets clat (msec): min=622, max=1006, avg=786.05, stdev=197.83 lat (msec): min=623, max=1006, avg=786.65, stdev=197.89 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8110, max= 8126, per=79.13%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.25%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5130KiB/s (5253kB/s), 1282KiB/s-5141KiB/s (1313kB/s-5265kB/s), io=16.0MiB (16.8MB), run=2390-3194msec WRITE: bw=10.0MiB/s (10.5MB/s), 2565KiB/s-8647KiB/s (2626kB/s-8855kB/s), io=32.0MiB (33.6MB), run=1421-3194msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145495: Thu Sep 17 19:30:19 2026 read: IOPS=1, BW=5533KiB/s (5665kB/s)(12.0MiB/2221msec) clat (msec): min=576, max=808, avg=659.03, stdev=129.89 lat (msec): min=576, max=808, avg=659.03, stdev=129.89 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7937, max= 8062, per=100.00%, avg=7999.50, stdev=88.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=12.03%, ctx=298, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145496: Thu Sep 17 19:30:19 2026 read: IOPS=0, BW=1485KiB/s (1521kB/s)(4096KiB/2758msec) clat (nsec): min=671411k, max=671411k, avg=671410985.00, stdev= 0.00 lat (nsec): min=671413k, max=671413k, avg=671413417.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2970KiB/s (3042kB/s)(8192KiB/2758msec); 0 zone resets clat (msec): min=905, max=1052, avg=978.69, stdev=104.05 lat (msec): min=905, max=1087, avg=996.86, stdev=128.80 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7968, max= 7968, per=74.14%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.06%, ctx=228, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145497: Thu Sep 17 19:30:19 2026 write: IOPS=0, BW=4030KiB/s (4127kB/s)(12.0MiB/3049msec); 0 zone resets clat (msec): min=619, max=1561, avg=950.97, stdev=529.00 lat (msec): min=620, max=1561, avg=951.51, stdev=529.02 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7968, max= 8062, per=74.58%, avg=8015.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.04%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145498: Thu Sep 17 19:30:19 2026 write: IOPS=1, BW=5644KiB/s (5780kB/s)(12.0MiB/2177msec); 0 zone resets clat (msec): min=364, max=922, avg=691.04, stdev=290.86 lat (msec): min=365, max=923, avg=691.58, stdev=290.85 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7474, max= 7937, per=71.70%, avg=7705.50, stdev=327.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.37%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5941KiB/s (6083kB/s), 1485KiB/s-5533KiB/s (1521kB/s-5665kB/s), io=16.0MiB (16.8MB), run=2221-2758msec WRITE: bw=10.5MiB/s (11.0MB/s), 2970KiB/s-5644KiB/s (3042kB/s-5780kB/s), io=32.0MiB (33.6MB), run=2177-3049msec