== sanity test 398b: DIO and buffer IO race ============== 14:34:44 (1789583684) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.06311 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144875: Wed Sep 16 14:37:12 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(5992KiB/128908msec) clat (usec): min=36, max=437015, avg=42172.54, stdev=33543.10 lat (usec): min=37, max=437016, avg=42176.74, stdev=33545.71 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 9634], 20.00th=[ 19792], | 30.00th=[ 25035], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[162530], 99.50th=[181404], 99.90th=[341836], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 7, max= 111, per=25.15%, avg=46.79, stdev=21.00, samples=249 iops : min= 1, max= 27, avg=11.04, stdev= 5.30, samples=249 write: IOPS=12, BW=48.8KiB/s (50.0kB/s)(6296KiB/128908msec); 0 zone resets clat (usec): min=651, max=949541, avg=41413.15, stdev=48370.28 lat (usec): min=652, max=949543, avg=41417.12, stdev=48369.86 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1500], 20.00th=[ 3949], | 30.00th=[ 8455], 40.00th=[ 18744], 50.00th=[ 30016], 60.00th=[ 40633], | 70.00th=[ 53216], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[116917], | 99.00th=[193987], 99.50th=[219153], 99.90th=[350225], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 111, per=24.82%, avg=48.40, stdev=20.92, samples=253 iops : min= 1, max= 27, avg=11.43, stdev= 5.28, samples=253 lat (usec) : 50=0.36%, 100=3.65%, 250=0.29%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=6.74%, 4=3.68%, 10=6.25%, 20=9.86%, 50=37.01% lat (msec) : 100=24.67%, 250=6.80%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=5.03%, ctx=6444, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144876: Wed Sep 16 14:37:12 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(5940KiB/128487msec) clat (usec): min=27, max=273641, avg=41587.11, stdev=31555.23 lat (usec): min=28, max=273642, avg=41588.49, stdev=31555.22 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 269], 20.00th=[ 20317], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[156238], 99.50th=[191890], 99.90th=[270533], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 103, per=24.70%, avg=45.94, stdev=18.70, samples=251 iops : min= 1, max= 25, avg=10.82, stdev= 4.69, samples=251 write: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6348KiB/128487msec); 0 zone resets clat (usec): min=887, max=747380, avg=41664.31, stdev=46571.58 lat (usec): min=888, max=747381, avg=41675.65, stdev=46584.36 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1647], 20.00th=[ 4293], | 30.00th=[ 8160], 40.00th=[ 19268], 50.00th=[ 31065], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[122160], | 99.00th=[191890], 99.50th=[235930], 99.90th=[467665], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 111, per=25.03%, avg=48.81, stdev=19.90, samples=252 iops : min= 1, max= 27, avg=11.54, stdev= 5.01, samples=252 lat (usec) : 50=0.33%, 100=4.00%, 250=0.49%, 500=0.10%, 1000=0.07% lat (msec) : 2=5.86%, 4=3.97%, 10=7.00%, 20=8.63%, 50=37.66% lat (msec) : 100=25.42%, 250=6.22%, 500=0.23%, 750=0.03% cpu : usr=0.08%, sys=4.90%, ctx=6452, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144877: Wed Sep 16 14:37:12 2026 read: IOPS=11, BW=47.1KiB/s (48.3kB/s)(6028KiB/127926msec) clat (usec): min=31, max=959877, avg=43202.13, stdev=39937.57 lat (usec): min=31, max=959878, avg=43205.65, stdev=39939.23 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 9765], 20.00th=[ 20055], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 63177], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[139461], 99.50th=[191890], 99.90th=[354419], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 118, per=25.37%, avg=47.19, stdev=18.97, samples=249 iops : min= 1, max= 29, avg=11.13, stdev= 4.77, samples=249 write: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6260KiB/127926msec); 0 zone resets clat (usec): min=804, max=356537, avg=39778.55, stdev=42076.66 lat (usec): min=806, max=356538, avg=39784.46, stdev=42075.89 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 1860], 20.00th=[ 4752], | 30.00th=[ 9241], 40.00th=[ 18220], 50.00th=[ 27919], 60.00th=[ 38011], | 70.00th=[ 52167], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[183501], 99.50th=[210764], 99.90th=[354419], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 95, per=25.13%, avg=49.00, stdev=19.19, samples=249 iops : min= 1, max= 23, avg=11.58, stdev= 4.83, samples=249 lat (usec) : 50=0.29%, 100=3.97%, 250=0.33%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.31%, 4=3.78%, 10=6.90%, 20=10.35%, 50=37.60% lat (msec) : 100=24.90%, 250=6.05%, 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=5.01%, ctx=6396, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144878: Wed Sep 16 14:37:12 2026 read: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6052KiB/128236msec) clat (usec): min=36, max=389754, avg=41216.84, stdev=30969.69 lat (usec): min=36, max=389755, avg=41220.32, stdev=30969.07 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 133], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[137364], 99.50th=[152044], 99.90th=[283116], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 111, per=25.31%, avg=47.08, stdev=20.30, samples=251 iops : min= 1, max= 27, avg=11.10, stdev= 5.12, samples=251 write: IOPS=12, BW=48.6KiB/s (49.8kB/s)(6236KiB/128236msec); 0 zone resets clat (usec): min=1007, max=968935, avg=41900.15, stdev=48978.68 lat (usec): min=1009, max=968937, avg=41905.76, stdev=48980.81 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1549], 20.00th=[ 4293], | 30.00th=[ 9372], 40.00th=[ 20317], 50.00th=[ 30540], 60.00th=[ 40633], | 70.00th=[ 54264], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[124257], | 99.00th=[189793], 99.50th=[219153], 99.90th=[367002], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 111, per=24.85%, avg=48.47, stdev=19.87, samples=251 iops : min= 1, max= 27, avg=11.46, stdev= 4.99, samples=251 lat (usec) : 50=0.59%, 100=4.10%, 250=0.49%, 500=0.13%, 1000=0.03% lat (msec) : 2=6.25%, 4=3.58%, 10=6.22%, 20=8.95%, 50=37.60% lat (msec) : 100=25.75%, 250=6.05%, 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=4.97%, ctx=6426, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (191kB/s), 46.2KiB/s-47.2KiB/s (47.3kB/s-48.3kB/s), io=23.4MiB (24.6MB), run=127926-128908msec WRITE: bw=195KiB/s (200kB/s), 48.6KiB/s-49.4KiB/s (49.8kB/s-50.6kB/s), io=24.6MiB (25.7MB), run=127926-128908msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Wed Sep 16 14:39:34 2026 read: IOPS=5, BW=22.2KiB/s (22.8kB/s)(5992KiB/269446msec) clat (msec): min=5, max=1022, avg=35.54, stdev=47.33 lat (msec): min=5, max=1022, avg=35.54, stdev=47.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 71], 95.00th=[ 99], | 99.00th=[ 178], 99.50th=[ 271], 99.90th=[ 625], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 103, per=28.16%, avg=24.78, stdev=17.47, samples=467 iops : min= 1, max= 25, avg= 5.55, stdev= 4.38, samples=467 write: IOPS=5, BW=23.4KiB/s (23.9kB/s)(6296KiB/269446msec); 0 zone resets clat (msec): min=36, max=469, avg=137.27, stdev=62.85 lat (msec): min=36, max=469, avg=137.27, stdev=62.86 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 222], 95.00th=[ 262], | 99.00th=[ 351], 99.50th=[ 384], 99.90th=[ 418], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 56, per=25.06%, avg=23.05, stdev=10.07, samples=525 iops : min= 1, max= 14, avg= 5.11, stdev= 2.57, samples=525 lat (msec) : 10=3.48%, 20=16.44%, 50=20.67%, 100=21.84%, 250=34.08% lat (msec) : 500=3.42%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.13%, ctx=4988, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144881: Wed Sep 16 14:39:34 2026 read: IOPS=5, BW=21.0KiB/s (22.5kB/s)(5940KiB/270490msec) clat (msec): min=5, max=801, avg=35.69, stdev=43.15 lat (msec): min=5, max=801, avg=35.69, stdev=43.15 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 72], 95.00th=[ 104], | 99.00th=[ 178], 99.50th=[ 259], 99.90th=[ 625], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 88, per=27.67%, avg=24.35, stdev=15.82, samples=470 iops : min= 1, max= 22, avg= 5.44, stdev= 4.00, samples=470 write: IOPS=5, BW=23.5KiB/s (24.0kB/s)(6348KiB/270490msec); 0 zone resets clat (msec): min=37, max=725, avg=136.95, stdev=63.12 lat (msec): min=37, max=725, avg=136.96, stdev=63.12 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 88], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 215], 95.00th=[ 253], | 99.00th=[ 355], 99.50th=[ 384], 99.90th=[ 502], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 55, per=25.12%, avg=23.11, stdev=10.03, samples=527 iops : min= 1, max= 13, avg= 5.13, stdev= 2.54, samples=527 lat (msec) : 10=2.90%, 20=15.63%, 50=22.14%, 100=20.12%, 250=36.23% lat (msec) : 500=2.86%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.12%, ctx=5012, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144882: Wed Sep 16 14:39:34 2026 read: IOPS=5, BW=22.4KiB/s (22.9kB/s)(6028KiB/269264msec) clat (msec): min=5, max=423, avg=35.29, stdev=36.27 lat (msec): min=5, max=423, avg=35.29, stdev=36.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 79], 95.00th=[ 101], | 99.00th=[ 169], 99.50th=[ 220], 99.90th=[ 393], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 95, per=27.66%, avg=24.35, stdev=16.55, samples=478 iops : min= 1, max= 23, avg= 5.44, stdev= 4.14, samples=478 write: IOPS=5, BW=23.2KiB/s (23.8kB/s)(6260KiB/269264msec); 0 zone resets clat (msec): min=39, max=951, avg=137.97, stdev=66.62 lat (msec): min=39, max=951, avg=137.98, stdev=66.62 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 176], 90.00th=[ 215], 95.00th=[ 255], | 99.00th=[ 351], 99.50th=[ 418], 99.90th=[ 735], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 54, per=24.83%, avg=22.85, stdev=10.14, samples=527 iops : min= 1, max= 13, avg= 5.06, stdev= 2.57, samples=527 lat (msec) : 10=3.03%, 20=16.86%, 50=20.54%, 100=21.74%, 250=34.90% lat (msec) : 500=2.83%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.15%, ctx=5036, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144883: Wed Sep 16 14:39:34 2026 read: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6052KiB/266552msec) clat (msec): min=5, max=394, avg=34.49, stdev=33.78 lat (msec): min=5, max=394, avg=34.49, stdev=33.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 105], | 99.00th=[ 148], 99.50th=[ 203], 99.90th=[ 347], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 104, per=28.70%, avg=25.25, stdev=16.98, samples=463 iops : min= 1, max= 26, avg= 5.67, stdev= 4.29, samples=463 write: IOPS=5, BW=23.4KiB/s (23.0kB/s)(6236KiB/266552msec); 0 zone resets clat (msec): min=43, max=902, avg=137.40, stdev=64.13 lat (msec): min=43, max=902, avg=137.40, stdev=64.13 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 215], 95.00th=[ 257], | 99.00th=[ 330], 99.50th=[ 405], 99.90th=[ 535], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 56, per=24.97%, avg=22.97, stdev= 9.98, samples=522 iops : min= 1, max= 14, avg= 5.09, stdev= 2.53, samples=522 lat (msec) : 10=3.22%, 20=17.55%, 50=19.73%, 100=21.55%, 250=34.96% lat (msec) : 500=2.93%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.16%, ctx=5014, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=88.8KiB/s (90.9kB/s), 21.0KiB/s-22.7KiB/s (22.5kB/s-23.2kB/s), io=23.4MiB (24.6MB), run=266552-270490msec WRITE: bw=92.9KiB/s (95.2kB/s), 23.2KiB/s-23.5KiB/s (23.8kB/s-24.0kB/s), io=24.6MiB (25.7MB), run=266552-270490msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144938: Wed Sep 16 14:40:22 2026 read: IOPS=11, BW=178KiB/s (182kB/s)(5920KiB/33252msec) clat (usec): min=37, max=352540, avg=46559.17, stdev=42954.46 lat (usec): min=37, max=352542, avg=46561.72, stdev=42955.21 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 60], 20.00th=[ 124], | 30.00th=[ 26084], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 49021], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[117965], | 99.00th=[177210], 99.50th=[308282], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 60, max= 341, per=25.12%, avg=180.87, stdev=70.17, samples=64 iops : min= 3, max= 21, avg=10.53, stdev= 4.48, samples=64 write: IOPS=11, BW=192KiB/s (196kB/s)(6368KiB/33252msec); 0 zone resets clat (usec): min=1282, max=212038, avg=39447.48, stdev=41595.47 lat (usec): min=1282, max=212040, avg=39449.80, stdev=41595.78 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1762], 10.00th=[ 2311], 20.00th=[ 5735], | 30.00th=[ 8848], 40.00th=[ 14353], 50.00th=[ 23462], 60.00th=[ 32900], | 70.00th=[ 52691], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[125305], | 99.00th=[162530], 99.50th=[189793], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 442, per=25.41%, avg=192.38, stdev=93.37, samples=65 iops : min= 1, max= 27, avg=11.26, stdev= 5.86, samples=65 lat (usec) : 50=1.30%, 100=7.94%, 250=0.52%, 750=0.39% lat (msec) : 2=3.91%, 4=3.39%, 10=9.90%, 20=7.42%, 50=31.25% lat (msec) : 100=24.48%, 250=9.11%, 500=0.39% cpu : usr=0.08%, sys=4.99%, ctx=1480, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144939: Wed Sep 16 14:40:22 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5744KiB/32430msec) clat (usec): min=41, max=345433, avg=47550.06, stdev=38584.20 lat (usec): min=42, max=345434, avg=47551.51, stdev=38584.16 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 65], 20.00th=[ 17695], | 30.00th=[ 28967], 40.00th=[ 36439], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[112722], | 99.00th=[145753], 99.50th=[198181], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 319, per=24.66%, avg=177.57, stdev=78.36, samples=63 iops : min= 1, max= 19, avg=10.33, stdev= 4.97, samples=63 write: IOPS=12, BW=202KiB/s (207kB/s)(6544KiB/32430msec); 0 zone resets clat (usec): min=1372, max=252851, avg=36742.24, stdev=40440.10 lat (usec): min=1374, max=252853, avg=36744.47, stdev=40440.13 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1762], 10.00th=[ 2343], 20.00th=[ 4424], | 30.00th=[ 7242], 40.00th=[ 11731], 50.00th=[ 23725], 60.00th=[ 35390], | 70.00th=[ 49546], 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[114820], | 99.00th=[170918], 99.50th=[223347], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 380, per=26.73%, avg=202.33, stdev=87.74, samples=63 iops : min= 1, max= 23, avg=11.90, stdev= 5.50, samples=63 lat (usec) : 50=0.52%, 100=7.42%, 250=0.39%, 750=0.13%, 1000=0.13% lat (msec) : 2=4.56%, 4=5.21%, 10=10.16%, 20=6.90%, 50=29.43% lat (msec) : 100=27.47%, 250=7.42%, 500=0.26% cpu : usr=0.07%, sys=5.02%, ctx=1444, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144940: Wed Sep 16 14:40:22 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32550msec) clat (usec): min=37, max=435023, avg=45372.46, stdev=38355.42 lat (usec): min=37, max=435023, avg=45373.86, stdev=38355.44 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 12649], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 59507], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[133694], 99.50th=[183501], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 62, max= 445, per=27.48%, avg=197.85, stdev=82.30, samples=62 iops : min= 3, max= 27, avg=11.63, stdev= 5.19, samples=62 write: IOPS=11, BW=185KiB/s (190kB/s)(6032KiB/32550msec); 0 zone resets clat (usec): min=1299, max=235615, avg=38979.92, stdev=42949.17 lat (usec): min=1301, max=235618, avg=38982.28, stdev=42949.23 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1762], 10.00th=[ 1942], 20.00th=[ 5473], | 30.00th=[ 9765], 40.00th=[ 16450], 50.00th=[ 22938], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[102237], 95.00th=[137364], | 99.00th=[193987], 99.50th=[208667], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 31, max= 377, per=24.52%, avg=185.65, stdev=79.03, samples=63 iops : min= 1, max= 23, avg=10.86, stdev= 4.97, samples=63 lat (usec) : 50=0.91%, 100=8.46%, 250=0.52% lat (msec) : 2=5.34%, 4=2.73%, 10=7.16%, 20=8.59%, 50=32.29% lat (msec) : 100=25.78%, 250=8.07%, 500=0.13% cpu : usr=0.06%, sys=4.88%, ctx=1525, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144944: Wed Sep 16 14:40:22 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(6032KiB/33173msec) clat (usec): min=33, max=283053, avg=46129.48, stdev=36267.85 lat (usec): min=33, max=283054, avg=46131.10, stdev=36267.89 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 478], | 30.00th=[ 27132], 40.00th=[ 34866], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[106431], | 99.00th=[135267], 99.50th=[208667], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 381, per=25.56%, avg=184.03, stdev=75.09, samples=64 iops : min= 1, max= 23, avg=10.73, stdev= 4.77, samples=64 write: IOPS=11, BW=189KiB/s (193kB/s)(6256KiB/33173msec); 0 zone resets clat (usec): min=1333, max=251854, avg=39318.81, stdev=43182.22 lat (usec): min=1336, max=251856, avg=39320.95, stdev=43182.23 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1663], 10.00th=[ 2040], 20.00th=[ 4555], | 30.00th=[ 7963], 40.00th=[ 13304], 50.00th=[ 22414], 60.00th=[ 36439], | 70.00th=[ 49546], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[125305], | 99.00th=[193987], 99.50th=[233833], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 352, per=25.00%, avg=189.26, stdev=81.89, samples=65 iops : min= 1, max= 22, avg=11.06, stdev= 5.19, samples=65 lat (usec) : 50=1.43%, 100=7.29%, 250=0.91%, 500=0.26% lat (msec) : 2=5.21%, 4=3.52%, 10=8.59%, 20=8.98%, 50=28.13% lat (msec) : 100=26.43%, 250=8.98%, 500=0.26% cpu : usr=0.06%, sys=4.49%, ctx=1364, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=720KiB/s (738kB/s), 177KiB/s-192KiB/s (181kB/s-197kB/s), io=23.4MiB (24.5MB), run=32430-33252msec WRITE: bw=758KiB/s (776kB/s), 185KiB/s-202KiB/s (190kB/s-207kB/s), io=24.6MiB (25.8MB), run=32430-33252msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Wed Sep 16 14:41:02 2026 read: IOPS=5, BW=80.9KiB/s (82.9kB/s)(5920KiB/73145msec) clat (msec): min=7, max=332, avg=43.17, stdev=48.65 lat (msec): min=7, max=332, avg=43.17, stdev=48.65 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 93], 95.00th=[ 146], | 99.00th=[ 251], 99.50th=[ 305], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 319, per=28.86%, avg=93.51, stdev=63.78, samples=124 iops : min= 1, max= 19, avg= 5.10, stdev= 4.03, samples=124 write: IOPS=5, BW=87.1KiB/s (89.1kB/s)(6368KiB/73145msec); 0 zone resets clat (msec): min=40, max=504, avg=142.75, stdev=73.55 lat (msec): min=40, max=504, avg=142.75, stdev=73.55 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 247], 95.00th=[ 288], | 99.00th=[ 435], 99.50th=[ 481], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 30, max= 192, per=26.57%, avg=90.59, stdev=41.94, samples=138 iops : min= 1, max= 12, avg= 4.90, stdev= 2.72, samples=138 lat (msec) : 10=2.60%, 20=13.41%, 50=22.14%, 100=21.22%, 250=35.42% lat (msec) : 500=5.08%, 750=0.13% cpu : usr=0.03%, sys=1.16%, ctx=1257, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144942: Wed Sep 16 14:41:02 2026 read: IOPS=4, BW=77.8KiB/s (79.7kB/s)(5744KiB/73788msec) clat (msec): min=7, max=304, avg=40.48, stdev=41.31 lat (msec): min=7, max=304, avg=40.49, stdev=41.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 93], 95.00th=[ 131], | 99.00th=[ 199], 99.50th=[ 264], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 22, max= 415, per=29.03%, avg=94.05, stdev=67.50, samples=119 iops : min= 1, max= 25, avg= 5.13, stdev= 4.30, samples=119 write: IOPS=5, BW=88.7KiB/s (90.8kB/s)(6544KiB/73788msec); 0 zone resets clat (msec): min=39, max=663, avg=143.76, stdev=76.78 lat (msec): min=39, max=663, avg=143.76, stdev=76.78 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 243], 95.00th=[ 288], | 99.00th=[ 414], 99.50th=[ 451], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 22, max= 253, per=26.30%, avg=89.69, stdev=44.94, samples=142 iops : min= 1, max= 15, avg= 4.85, stdev= 2.86, samples=142 lat (msec) : 10=3.12%, 20=14.19%, 50=20.18%, 100=22.66%, 250=34.77% lat (msec) : 500=4.95%, 750=0.13% cpu : usr=0.05%, sys=1.18%, ctx=1338, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144943: Wed Sep 16 14:41:02 2026 read: IOPS=5, BW=89.1KiB/s (91.2kB/s)(6256KiB/70230msec) clat (msec): min=6, max=421, avg=40.84, stdev=47.41 lat (msec): min=6, max=421, avg=40.84, stdev=47.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 85], 95.00th=[ 113], | 99.00th=[ 288], 99.50th=[ 388], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 319, per=30.65%, avg=99.31, stdev=68.20, samples=124 iops : min= 1, max= 19, avg= 5.44, stdev= 4.35, samples=124 write: IOPS=5, BW=85.9KiB/s (87.9kB/s)(6032KiB/70230msec); 0 zone resets clat (msec): min=43, max=613, avg=143.54, stdev=75.51 lat (msec): min=43, max=613, avg=143.55, stdev=75.51 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 69], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 97], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 199], 90.00th=[ 251], 95.00th=[ 296], | 99.00th=[ 384], 99.50th=[ 514], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 30, max= 189, per=25.76%, avg=87.84, stdev=40.97, samples=134 iops : min= 1, max= 11, avg= 4.72, stdev= 2.66, samples=134 lat (msec) : 10=1.30%, 20=16.67%, 50=22.53%, 100=23.70%, 250=30.47% lat (msec) : 500=5.08%, 750=0.26% cpu : usr=0.03%, sys=1.19%, ctx=1360, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144945: Wed Sep 16 14:41:02 2026 read: IOPS=5, BW=83.9KiB/s (85.9kB/s)(6032KiB/71925msec) clat (msec): min=5, max=427, avg=40.75, stdev=44.68 lat (msec): min=5, max=427, avg=40.75, stdev=44.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 90], 95.00th=[ 123], | 99.00th=[ 224], 99.50th=[ 264], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 318, per=29.55%, avg=95.75, stdev=60.75, samples=122 iops : min= 1, max= 19, avg= 5.23, stdev= 3.82, samples=122 write: IOPS=5, BW=86.0KiB/s (89.1kB/s)(6256KiB/71925msec); 0 zone resets clat (msec): min=44, max=624, avg=143.80, stdev=76.11 lat (msec): min=44, max=624, avg=143.81, stdev=76.11 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 234], 95.00th=[ 296], | 99.00th=[ 435], 99.50th=[ 523], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 30, max= 221, per=26.02%, avg=88.72, stdev=42.93, samples=137 iops : min= 1, max= 13, avg= 4.78, stdev= 2.79, samples=137 lat (msec) : 10=2.34%, 20=15.23%, 50=21.74%, 100=21.35%, 250=35.16% lat (msec) : 500=3.78%, 750=0.39% cpu : usr=0.03%, sys=1.09%, ctx=1228, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=325KiB/s (332kB/s), 77.8KiB/s-89.1KiB/s (79.7kB/s-91.2kB/s), io=23.4MiB (24.5MB), run=70230-73788msec WRITE: bw=342KiB/s (350kB/s), 85.9KiB/s-88.7KiB/s (87.9kB/s-90.8kB/s), io=24.6MiB (25.8MB), run=70230-73788msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144963: Wed Sep 16 14:41:21 2026 read: IOPS=2, BW=2083KiB/s (2132kB/s)(7168KiB/3442msec) clat (usec): min=476, max=439016, avg=277107.66, stdev=138708.15 lat (usec): min=477, max=439017, avg=277109.28, stdev=138708.27 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[227541], | 30.00th=[274727], 40.00th=[274727], 50.00th=[308282], 60.00th=[346031], | 70.00th=[346031], 80.00th=[346031], 90.00th=[438305], 95.00th=[438305], | 99.00th=[438305], 99.50th=[438305], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 1838, max= 3992, per=69.94%, avg=2922.00, stdev=1200.56, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1488KiB/s (1523kB/s)(5120KiB/3442msec); 0 zone resets clat (msec): min=144, max=419, avg=284.49, stdev=132.57 lat (msec): min=144, max=419, avg=284.58, stdev=132.56 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1917, max= 3644, per=42.67%, avg=2496.33, stdev=993.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=25.00%, 500=66.67% cpu : usr=0.00%, sys=12.58%, ctx=171, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144965: Wed Sep 16 14:41:21 2026 read: IOPS=0, BW=420KiB/s (430kB/s)(2048KiB/4881msec) clat (usec): min=494, max=269901, avg=135198.01, stdev=190499.57 lat (usec): min=495, max=269904, avg=135200.10, stdev=190500.43 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 494], | 30.00th=[ 494], 40.00th=[ 494], 50.00th=[ 494], 60.00th=[270533], | 70.00th=[270533], 80.00th=[270533], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1610, max= 1973, per=42.88%, avg=1791.50, stdev=256.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2098KiB/s (2148kB/s)(10.0MiB/4881msec); 0 zone resets clat (msec): min=144, max=1135, avg=452.71, stdev=316.91 lat (msec): min=145, max=1135, avg=453.54, stdev=316.80 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 148], | 30.00th=[ 232], 40.00th=[ 275], 50.00th=[ 372], 60.00th=[ 384], | 70.00th=[ 405], 80.00th=[ 625], 90.00th=[ 810], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1822, max= 3946, per=42.61%, avg=2492.43, stdev=946.15, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 500=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.87%, ctx=147, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144966: Wed Sep 16 14:41:21 2026 read: IOPS=1, BW=1254KiB/s (1284kB/s)(6144KiB/4901msec) clat (usec): min=514, max=753263, avg=265686.49, stdev=275027.69 lat (usec): min=516, max=753266, avg=265687.86, stdev=275027.87 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 1926], | 30.00th=[ 1926], 40.00th=[278922], 50.00th=[278922], 60.00th=[278922], | 70.00th=[283116], 80.00th=[283116], 90.00th=[750781], 95.00th=[750781], | 99.00th=[750781], 99.50th=[750781], 99.90th=[750781], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 1928, max= 4079, per=77.00%, avg=3217.00, stdev=1137.30, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1254KiB/s (1284kB/s)(6144KiB/4901msec); 0 zone resets clat (msec): min=171, max=1038, avg=504.43, stdev=288.02 lat (msec): min=171, max=1038, avg=504.53, stdev=288.02 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 498], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1822, max= 2039, per=32.96%, avg=1928.33, stdev=71.95, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=58.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=7.49%, ctx=136, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144967: Wed Sep 16 14:41:21 2026 read: IOPS=1, BW=1266KiB/s (1297kB/s)(5120KiB/4043msec) clat (usec): min=821, max=406117, avg=193082.42, stdev=198185.85 lat (usec): min=823, max=406118, avg=193084.08, stdev=198185.88 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], 20.00th=[ 824], | 30.00th=[ 1303], 40.00th=[ 1303], 50.00th=[170918], 60.00th=[170918], | 70.00th=[387974], 80.00th=[387974], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 1822, max= 5785, per=91.04%, avg=3803.50, stdev=2802.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1773KiB/s (1815kB/s)(7168KiB/4043msec); 0 zone resets clat (msec): min=168, max=882, avg=425.51, stdev=262.71 lat (msec): min=168, max=882, avg=425.59, stdev=262.71 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 188], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 355], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 684], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1996, max= 3946, per=50.50%, avg=2954.00, stdev=1082.47, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=9.70%, ctx=173, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4179KiB/s (4279kB/s), 420KiB/s-2083KiB/s (430kB/s-2132kB/s), io=20.0MiB (20.0MB), run=3442-4901msec WRITE: bw=5850KiB/s (5991kB/s), 1254KiB/s-2098KiB/s (1284kB/s-2148kB/s), io=28.0MiB (29.4MB), run=3442-4901msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144968: Wed Sep 16 14:41:22 2026 read: IOPS=1, BW=1443KiB/s (1477kB/s)(7168KiB/4968msec) clat (msec): min=144, max=1072, avg=368.46, stdev=317.09 lat (msec): min=144, max=1072, avg=368.46, stdev=317.09 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 197], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 271], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 334], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1398, max= 3849, per=60.98%, avg=2172.20, stdev=962.58, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1031KiB/s (1055kB/s)(5120KiB/4968msec); 0 zone resets clat (msec): min=363, max=485, avg=449.12, stdev=50.25 lat (msec): min=363, max=485, avg=449.23, stdev=50.28 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1796, max= 2039, per=38.69%, avg=1930.00, stdev=109.35, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=25.00%, 500=66.67%, 2000=8.33% cpu : usr=0.00%, sys=2.66%, ctx=58, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144969: Wed Sep 16 14:41:22 2026 read: IOPS=0, BW=363KiB/s (372kB/s)(2048KiB/5644msec) clat (msec): min=262, max=777, avg=520.24, stdev=364.42 lat (msec): min=262, max=777, avg=520.24, stdev=364.42 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1822, max= 2007, per=53.75%, avg=1914.50, stdev=130.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1814KiB/s (1858kB/s)(10.0MiB/5644msec); 0 zone resets clat (msec): min=165, max=1372, avg=444.43, stdev=380.30 lat (msec): min=165, max=1372, avg=444.60, stdev=380.35 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 209], | 30.00th=[ 215], 40.00th=[ 220], 50.00th=[ 253], 60.00th=[ 284], | 70.00th=[ 334], 80.00th=[ 667], 90.00th=[ 726], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1889, max= 4063, per=53.17%, avg=2652.33, stdev=1066.81, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.48%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144970: Wed Sep 16 14:41:22 2026 read: IOPS=1, BW=1137KiB/s (1165kB/s)(6144KiB/5402msec) clat (msec): min=115, max=419, avg=187.28, stdev=118.85 lat (msec): min=115, max=419, avg=187.28, stdev=118.85 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1889, max= 3992, per=69.67%, avg=2481.75, stdev=1008.90, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1137KiB/s (1165kB/s)(6144KiB/5402msec); 0 zone resets clat (msec): min=381, max=1175, avg=668.97, stdev=354.34 lat (msec): min=381, max=1175, avg=669.05, stdev=354.36 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 498], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1889, max= 3792, per=48.54%, avg=2421.00, stdev=915.55, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 2000=16.67% cpu : usr=0.00%, sys=2.37%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144971: Wed Sep 16 14:41:22 2026 read: IOPS=0, BW=891KiB/s (912kB/s)(5120KiB/5748msec) clat (msec): min=70, max=334, avg=205.62, stdev=97.26 lat (msec): min=70, max=334, avg=205.63, stdev=97.27 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 2031, max= 6023, per=100.00%, avg=4027.00, stdev=2822.77, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1247KiB/s (1277kB/s)(7168KiB/5748msec); 0 zone resets clat (msec): min=179, max=1406, avg=654.61, stdev=528.78 lat (msec): min=179, max=1406, avg=654.70, stdev=528.78 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 222], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 342], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1183], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1896, max= 2039, per=39.64%, avg=1977.20, stdev=64.21, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 2000=25.00% cpu : usr=0.00%, sys=2.94%, ctx=94, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3563KiB/s (3648kB/s), 363KiB/s-1443KiB/s (372kB/s-1477kB/s), io=20.0MiB (20.0MB), run=4968-5748msec WRITE: bw=4988KiB/s (5108kB/s), 1031KiB/s-1814KiB/s (1055kB/s-1858kB/s), io=28.0MiB (29.4MB), run=4968-5748msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144979: Wed Sep 16 14:41:40 2026 read: IOPS=0, BW=4045KiB/s (4142kB/s)(12.0MiB/3038msec) clat (msec): min=900, max=1065, avg=978.49, stdev=82.49 lat (msec): min=900, max=1065, avg=978.49, stdev=82.49 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7787, max= 8159, per=100.00%, avg=7973.00, stdev=263.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.20%, sys=9.98%, ctx=327, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144981: Wed Sep 16 14:41:40 2026 read: IOPS=0, BW=1020KiB/s (1045kB/s)(4096KiB/4015msec) clat (nsec): min=869813k, max=869813k, avg=869813435.00, stdev= 0.00 lat (nsec): min=869816k, max=869816k, avg=869816213.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7787, max= 7787, per=100.00%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2040KiB/s (2089kB/s)(8192KiB/4015msec); 0 zone resets clat (msec): min=1048, max=1957, avg=1503.19, stdev=642.46 lat (msec): min=1049, max=1957, avg=1503.71, stdev=642.44 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1955], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.05%, sys=2.47%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144984: Wed Sep 16 14:41:40 2026 write: IOPS=1, BW=6166KiB/s (6314kB/s)(12.0MiB/1993msec); 0 zone resets clat (msec): min=433, max=902, avg=619.61, stdev=249.10 lat (msec): min=433, max=902, avg=620.20, stdev=248.88 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=1.31%, ctx=31, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144986: Wed Sep 16 14:41:40 2026 write: IOPS=1, BW=5040KiB/s (5161kB/s)(12.0MiB/2438msec); 0 zone resets clat (msec): min=467, max=1120, avg=792.74, stdev=326.31 lat (msec): min=470, max=1127, avg=796.03, stdev=328.43 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 6068, max= 7787, per=84.89%, avg=6927.50, stdev=1215.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=3.08%, ctx=32, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4081KiB/s (4179kB/s), 1020KiB/s-4045KiB/s (1045kB/s-4142kB/s), io=16.0MiB (16.8MB), run=3038-4015msec WRITE: bw=8161KiB/s (8357kB/s), 2040KiB/s-6166KiB/s (2089kB/s-6314kB/s), io=32.0MiB (33.6MB), run=1993-4015msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144980: Wed Sep 16 14:41:41 2026 read: IOPS=0, BW=3258KiB/s (3336kB/s)(12.0MiB/3772msec) clat (msec): min=501, max=1658, avg=1238.41, stdev=639.85 lat (msec): min=501, max=1658, avg=1238.41, stdev=639.85 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.39%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144982: Wed Sep 16 14:41:41 2026 read: IOPS=0, BW=870KiB/s (891kB/s)(4096KiB/4708msec) clat (nsec): min=1378.3M, max=1378.3M, avg=1378301526.00, stdev= 0.00 lat (nsec): min=1378.3M, max=1378.3M, avg=1378305347.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1740KiB/s (1782kB/s)(8192KiB/4708msec); 0 zone resets clat (msec): min=1073, max=2110, avg=1592.28, stdev=733.06 lat (msec): min=1075, max=2111, avg=1593.38, stdev=732.20 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 2106], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.15%, sys=2.70%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144983: Wed Sep 16 14:41:41 2026 write: IOPS=0, BW=3032KiB/s (3105kB/s)(12.0MiB/4053msec); 0 zone resets clat (msec): min=424, max=1916, avg=1325.11, stdev=792.66 lat (msec): min=425, max=1917, avg=1325.70, stdev=792.76 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.10%, sys=2.34%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144985: Wed Sep 16 14:41:41 2026 write: IOPS=1, BW=4122KiB/s (4221kB/s)(12.0MiB/2981msec); 0 zone resets clat (msec): min=723, max=1356, avg=968.54, stdev=339.91 lat (msec): min=723, max=1357, avg=969.68, stdev=339.51 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.40%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3480KiB/s (3564kB/s), 870KiB/s-3258KiB/s (891kB/s-3336kB/s), io=16.0MiB (16.8MB), run=3772-4708msec WRITE: bw=6960KiB/s (7127kB/s), 1740KiB/s-4122KiB/s (1782kB/s-4221kB/s), io=32.0MiB (33.6MB), run=2981-4708msec