== sanity test 398b: DIO and buffer IO race ============== 12:07:18 (1790006838) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.07004 s, 7.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179359: Mon Sep 21 12:09:34 2026 read: IOPS=13, BW=52.4KiB/s (53.6kB/s)(5992KiB/114418msec) clat (usec): min=43, max=985520, avg=41847.04, stdev=38066.01 lat (usec): min=43, max=985521, avg=41848.91, stdev=38065.34 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 5866], 10.00th=[ 14222], 20.00th=[ 19530], | 30.00th=[ 24249], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[154141], 99.50th=[185598], 99.90th=[223347], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 6, max= 119, per=25.06%, avg=52.13, stdev=20.73, samples=225 iops : min= 1, max= 29, avg=12.38, stdev= 5.22, samples=225 write: IOPS=13, BW=55.0KiB/s (56.3kB/s)(6296KiB/114418msec); 0 zone resets clat (usec): min=771, max=233415, avg=32548.31, stdev=35062.68 lat (usec): min=772, max=233416, avg=32550.11, stdev=35063.51 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1205], 10.00th=[ 1352], 20.00th=[ 2999], | 30.00th=[ 5997], 40.00th=[ 13566], 50.00th=[ 22414], 60.00th=[ 29754], | 70.00th=[ 41157], 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[152044], 99.50th=[175113], 99.90th=[227541], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 15, max= 144, per=25.34%, avg=55.24, stdev=25.37, samples=223 iops : min= 3, max= 36, avg=13.16, stdev= 6.37, samples=223 lat (usec) : 50=0.16%, 100=2.08%, 250=0.07%, 500=0.03%, 1000=0.33% lat (msec) : 2=7.75%, 4=4.75%, 10=6.18%, 20=13.25%, 50=39.06% lat (msec) : 100=21.48%, 250=4.82%, 1000=0.03% cpu : usr=0.07%, sys=5.34%, ctx=6096, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179360: Mon Sep 21 12:09:34 2026 read: IOPS=13, BW=52.5KiB/s (53.8kB/s)(5940KiB/113045msec) clat (usec): min=37, max=999924, avg=42049.88, stdev=37887.92 lat (usec): min=38, max=999926, avg=42051.16, stdev=37887.79 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9634], 10.00th=[ 15664], | 20.00th=[ 20579], 30.00th=[ 25297], 40.00th=[ 30278], | 50.00th=[ 34866], 60.00th=[ 41157], 70.00th=[ 49021], | 80.00th=[ 58983], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[ 141558], 99.50th=[ 168821], 99.90th=[ 333448], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 6, max= 103, per=25.08%, avg=52.18, stdev=20.24, samples=222 iops : min= 1, max= 25, avg=12.39, stdev= 5.05, samples=222 write: IOPS=14, BW=56.2KiB/s (57.5kB/s)(6348KiB/113045msec); 0 zone resets clat (usec): min=742, max=248908, avg=31611.27, stdev=33711.48 lat (usec): min=743, max=248909, avg=31614.14, stdev=33711.79 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1221], 10.00th=[ 1369], 20.00th=[ 3294], | 30.00th=[ 6587], 40.00th=[ 13435], 50.00th=[ 22676], 60.00th=[ 29492], | 70.00th=[ 38536], 80.00th=[ 54264], 90.00th=[ 78119], 95.00th=[103285], | 99.00th=[143655], 99.50th=[158335], 99.90th=[223347], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 166, per=25.52%, avg=55.63, stdev=26.50, samples=222 iops : min= 1, max= 41, avg=13.27, stdev= 6.68, samples=222 lat (usec) : 50=0.26%, 100=1.46%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=7.36%, 4=4.43%, 10=7.19%, 20=12.04%, 50=41.73% lat (msec) : 100=20.67%, 250=4.43%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=5.36%, ctx=6156, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179361: Mon Sep 21 12:09:34 2026 read: IOPS=13, BW=52.4KiB/s (53.7kB/s)(6028KiB/114955msec) clat (usec): min=35, max=956708, avg=42292.10, stdev=37175.51 lat (usec): min=35, max=956709, avg=42295.66, stdev=37174.84 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 7570], 10.00th=[ 14353], 20.00th=[ 20317], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[141558], 99.50th=[158335], 99.90th=[210764], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 6, max= 119, per=25.10%, avg=52.21, stdev=21.87, samples=226 iops : min= 1, max= 29, avg=12.40, stdev= 5.48, samples=226 write: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6260KiB/114955msec); 0 zone resets clat (usec): min=749, max=263849, avg=32444.94, stdev=35077.46 lat (usec): min=749, max=263850, avg=32447.84, stdev=35076.51 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1401], 20.00th=[ 3228], | 30.00th=[ 5997], 40.00th=[ 14091], 50.00th=[ 23200], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 54789], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[160433], 99.50th=[179307], 99.90th=[235930], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 128, per=24.83%, avg=54.12, stdev=24.40, samples=226 iops : min= 1, max= 32, avg=12.89, stdev= 6.14, samples=226 lat (usec) : 50=0.33%, 100=1.86%, 250=0.10%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=6.97%, 4=4.13%, 10=7.06%, 20=12.01%, 50=40.69% lat (msec) : 100=21.65%, 250=4.65%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.34%, ctx=6274, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179363: Mon Sep 21 12:09:34 2026 read: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6052KiB/114993msec) clat (usec): min=35, max=851827, avg=41408.19, stdev=34961.15 lat (usec): min=35, max=851828, avg=41410.46, stdev=34960.82 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 147], 10.00th=[ 14353], 20.00th=[ 19530], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[149947], 99.50th=[177210], 99.90th=[204473], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 6, max= 127, per=25.28%, avg=52.59, stdev=21.85, samples=225 iops : min= 1, max= 31, avg=12.49, stdev= 5.49, samples=225 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6236KiB/114993msec); 0 zone resets clat (usec): min=788, max=209888, avg=33285.74, stdev=35773.37 lat (usec): min=789, max=209889, avg=33287.15, stdev=35773.41 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1369], 20.00th=[ 3261], | 30.00th=[ 6652], 40.00th=[ 14222], 50.00th=[ 22676], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[106431], | 99.00th=[162530], 99.50th=[177210], 99.90th=[208667], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 127, per=24.70%, avg=53.84, stdev=22.68, samples=226 iops : min= 1, max= 31, avg=12.82, stdev= 5.72, samples=226 lat (usec) : 50=0.23%, 100=2.15%, 250=0.10%, 500=0.03%, 1000=0.16% lat (msec) : 2=7.26%, 4=4.26%, 10=6.80%, 20=13.09%, 50=39.71% lat (msec) : 100=21.48%, 250=4.69%, 1000=0.03% cpu : usr=0.08%, sys=5.40%, ctx=6299, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=209KiB/s (214kB/s), 52.4KiB/s-52.6KiB/s (53.6kB/s-53.9kB/s), io=23.4MiB (24.6MB), run=113045-114993msec WRITE: bw=219KiB/s (224kB/s), 54.2KiB/s-56.2KiB/s (55.5kB/s-57.5kB/s), io=24.6MiB (25.7MB), run=113045-114993msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179362: Mon Sep 21 12:10:12 2026 read: IOPS=9, BW=39.5KiB/s (40.5kB/s)(5992KiB/151577msec) clat (msec): min=4, max=979, avg=40.21, stdev=43.29 lat (msec): min=4, max=979, avg=40.21, stdev=43.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 90], 95.00th=[ 115], | 99.00th=[ 182], 99.50th=[ 201], 99.90th=[ 271], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 159, per=25.81%, avg=40.26, stdev=27.90, samples=290 iops : min= 1, max= 39, avg= 9.40, stdev= 7.00, samples=290 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6296KiB/151577msec); 0 zone resets clat (msec): min=8, max=315, avg=57.79, stdev=42.85 lat (msec): min=8, max=315, avg=57.80, stdev=42.85 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 226], 99.50th=[ 253], 99.90th=[ 296], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 151, per=25.25%, avg=41.41, stdev=26.25, samples=296 iops : min= 1, max= 37, avg= 9.70, stdev= 6.58, samples=296 lat (msec) : 10=3.84%, 20=18.16%, 50=43.91%, 100=23.54%, 250=10.19% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.86%, ctx=4812, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179364: Mon Sep 21 12:10:12 2026 read: IOPS=9, BW=39.2KiB/s (40.2kB/s)(5940KiB/151451msec) clat (msec): min=5, max=873, avg=39.11, stdev=41.12 lat (msec): min=5, max=873, avg=39.11, stdev=41.12 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 113], | 99.00th=[ 171], 99.50th=[ 207], 99.90th=[ 279], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 167, per=25.49%, avg=39.76, stdev=28.93, samples=291 iops : min= 1, max= 41, avg= 9.28, stdev= 7.27, samples=291 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6348KiB/151451msec); 0 zone resets clat (msec): min=8, max=319, avg=58.60, stdev=41.77 lat (msec): min=8, max=319, avg=58.60, stdev=41.77 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 215], 99.50th=[ 236], 99.90th=[ 296], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 135, per=25.44%, avg=41.71, stdev=25.82, samples=297 iops : min= 1, max= 33, avg= 9.77, stdev= 6.48, samples=297 lat (msec) : 10=3.42%, 20=18.20%, 50=44.47%, 100=22.79%, 250=10.77% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.88%, ctx=4787, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179365: Mon Sep 21 12:10:12 2026 read: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6028KiB/152032msec) clat (msec): min=4, max=258, avg=40.48, stdev=37.01 lat (msec): min=4, max=258, avg=40.49, stdev=37.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 92], 95.00th=[ 120], | 99.00th=[ 182], 99.50th=[ 194], 99.90th=[ 215], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 7, max= 135, per=25.39%, avg=39.60, stdev=27.03, samples=296 iops : min= 1, max= 33, avg= 9.25, stdev= 6.79, samples=296 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6260KiB/152032msec); 0 zone resets clat (msec): min=9, max=907, avg=57.92, stdev=47.50 lat (msec): min=9, max=907, avg=57.92, stdev=47.50 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 84], 90.00th=[ 114], 95.00th=[ 144], | 99.00th=[ 215], 99.50th=[ 247], 99.90th=[ 334], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 143, per=25.18%, avg=41.30, stdev=26.83, samples=295 iops : min= 1, max= 35, avg= 9.67, stdev= 6.74, samples=295 lat (msec) : 10=3.61%, 20=17.87%, 50=44.86%, 100=22.59%, 250=10.84% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=1.84%, ctx=4744, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179366: Mon Sep 21 12:10:12 2026 read: IOPS=9, BW=39.6KiB/s (40.5kB/s)(6052KiB/152954msec) clat (msec): min=4, max=260, avg=39.50, stdev=37.61 lat (msec): min=4, max=260, avg=39.50, stdev=37.61 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 190], 99.50th=[ 211], 99.90th=[ 253], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 151, per=26.16%, avg=40.80, stdev=28.80, samples=289 iops : min= 1, max= 37, avg= 9.54, stdev= 7.24, samples=289 write: IOPS=10, BW=40.8KiB/s (41.7kB/s)(6236KiB/152954msec); 0 zone resets clat (msec): min=8, max=882, avg=59.54, stdev=48.14 lat (msec): min=8, max=882, avg=59.54, stdev=48.14 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 121], 95.00th=[ 150], | 99.00th=[ 218], 99.50th=[ 239], 99.90th=[ 330], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 159, per=24.82%, avg=40.71, stdev=25.70, samples=298 iops : min= 1, max= 39, avg= 9.52, stdev= 6.44, samples=298 lat (msec) : 10=3.84%, 20=17.97%, 50=44.69%, 100=21.91%, 250=11.33% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=1.90%, ctx=4916, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=157KiB/s (161kB/s), 39.2KiB/s-39.6KiB/s (40.2kB/s-40.6kB/s), io=23.4MiB (24.6MB), run=151451-152954msec WRITE: bw=164KiB/s (168kB/s), 40.8KiB/s-41.9KiB/s (41.7kB/s-42.9kB/s), io=24.6MiB (25.7MB), run=151451-152954msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179410: Mon Sep 21 12:10:53 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(5920KiB/29713msec) clat (usec): min=42, max=217522, avg=43941.12, stdev=28288.29 lat (usec): min=43, max=217523, avg=43942.35, stdev=28288.33 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 14353], 20.00th=[ 22414], | 30.00th=[ 29754], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 53216], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[127402], 99.50th=[137364], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 94, max= 383, per=26.48%, avg=198.86, stdev=71.86, samples=58 iops : min= 5, max= 23, avg=11.64, stdev= 4.50, samples=58 write: IOPS=13, BW=214KiB/s (219kB/s)(6368KiB/29713msec); 0 zone resets clat (usec): min=1508, max=174135, avg=33008.04, stdev=32281.54 lat (usec): min=1511, max=174138, avg=33024.64, stdev=32290.54 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1844], 10.00th=[ 2540], 20.00th=[ 5932], | 30.00th=[ 9765], 40.00th=[ 16581], 50.00th=[ 22938], 60.00th=[ 30802], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[166724], 99.50th=[170918], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 26, max= 412, per=27.21%, avg=214.97, stdev=82.36, samples=58 iops : min= 1, max= 25, avg=12.64, stdev= 5.16, samples=58 lat (usec) : 50=0.39%, 100=3.52%, 250=0.13% lat (msec) : 2=4.04%, 4=3.52%, 10=8.20%, 20=11.33%, 50=38.54% lat (msec) : 100=26.04%, 250=4.30% cpu : usr=0.08%, sys=6.25%, ctx=1674, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179411: Mon Sep 21 12:10:53 2026 read: IOPS=11, BW=182KiB/s (187kB/s)(5744KiB/31486msec) clat (usec): min=41, max=199192, avg=45064.37, stdev=30015.04 lat (usec): min=42, max=199194, avg=45066.41, stdev=30015.52 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 1156], 20.00th=[ 22676], | 30.00th=[ 30540], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 64750], 90.00th=[ 87557], 95.00th=[100140], | 99.00th=[139461], 99.50th=[179307], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 26, max= 375, per=24.33%, avg=182.74, stdev=78.39, samples=62 iops : min= 1, max= 23, avg=10.61, stdev= 4.95, samples=62 write: IOPS=12, BW=208KiB/s (213kB/s)(6544KiB/31486msec); 0 zone resets clat (usec): min=1539, max=212945, avg=36802.74, stdev=36918.90 lat (usec): min=1542, max=212948, avg=36807.06, stdev=36923.84 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2212], 10.00th=[ 3523], 20.00th=[ 6718], | 30.00th=[ 12780], 40.00th=[ 17171], 50.00th=[ 24511], 60.00th=[ 32113], | 70.00th=[ 41681], 80.00th=[ 63177], 90.00th=[ 90702], 95.00th=[117965], | 99.00th=[147850], 99.50th=[166724], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 444, per=26.20%, avg=207.02, stdev=92.24, samples=62 iops : min= 1, max= 27, avg=12.15, stdev= 5.82, samples=62 lat (usec) : 50=0.65%, 100=3.65%, 250=0.26% lat (msec) : 2=2.60%, 4=3.39%, 10=8.46%, 20=11.07%, 50=40.36% lat (msec) : 100=22.66%, 250=6.90% cpu : usr=0.10%, sys=5.76%, ctx=1716, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179412: Mon Sep 21 12:10:53 2026 read: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31863msec) clat (usec): min=34, max=199028, avg=47865.35, stdev=31124.35 lat (usec): min=35, max=199029, avg=47867.35, stdev=31124.57 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 6325], 10.00th=[ 17433], 20.00th=[ 24773], | 30.00th=[ 28967], 40.00th=[ 35914], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 55313], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[101188], | 99.00th=[160433], 99.50th=[177210], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 88, max= 352, per=26.02%, avg=195.42, stdev=67.36, samples=62 iops : min= 5, max= 22, avg=11.42, stdev= 4.26, samples=62 write: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31863msec); 0 zone resets clat (usec): min=1486, max=200114, avg=34625.58, stdev=33018.48 lat (usec): min=1488, max=200117, avg=34635.70, stdev=33023.08 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1958], 10.00th=[ 3064], 20.00th=[ 5997], | 30.00th=[ 11207], 40.00th=[ 17171], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 81265], 95.00th=[ 94897], | 99.00th=[160433], 99.50th=[179307], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 416, per=23.49%, avg=185.56, stdev=85.56, samples=62 iops : min= 1, max= 26, avg=10.81, stdev= 5.41, samples=62 lat (usec) : 50=0.39%, 100=2.08% lat (msec) : 2=2.60%, 4=4.17%, 10=7.16%, 20=11.20%, 50=40.49% lat (msec) : 100=26.95%, 250=4.95% cpu : usr=0.07%, sys=5.69%, ctx=1749, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179413: Mon Sep 21 12:10:53 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29829msec) clat (usec): min=37, max=164307, avg=40746.57, stdev=27355.84 lat (usec): min=38, max=164308, avg=40747.80, stdev=27355.84 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 97], 20.00th=[ 19792], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 36963], 60.00th=[ 45351], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 86508], | 99.00th=[137364], 99.50th=[147850], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 62, max= 380, per=27.21%, avg=204.33, stdev=73.90, samples=57 iops : min= 3, max= 23, avg=11.98, stdev= 4.64, samples=57 write: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29829msec); 0 zone resets clat (usec): min=1214, max=239425, avg=35966.20, stdev=37561.40 lat (usec): min=1216, max=239428, avg=35968.66, stdev=37561.17 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1827], 10.00th=[ 2147], 20.00th=[ 4752], | 30.00th=[ 8586], 40.00th=[ 14746], 50.00th=[ 23462], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 62129], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[175113], 99.50th=[187696], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 466, per=26.49%, avg=209.28, stdev=84.36, samples=58 iops : min= 1, max= 29, avg=12.29, stdev= 5.34, samples=58 lat (usec) : 50=0.65%, 100=4.30%, 250=0.52% lat (msec) : 2=4.95%, 4=4.56%, 10=8.07%, 20=9.77%, 50=37.76% lat (msec) : 100=24.35%, 250=5.08% cpu : usr=0.08%, sys=5.57%, ctx=1603, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=752KiB/s (770kB/s), 182KiB/s-202KiB/s (187kB/s-207kB/s), io=23.4MiB (24.5MB), run=29713-31863msec WRITE: bw=791KiB/s (810kB/s), 189KiB/s-214KiB/s (194kB/s-219kB/s), io=24.6MiB (25.8MB), run=29713-31863msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179405: Mon Sep 21 12:11:04 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(5920KiB/42432msec) clat (msec): min=5, max=200, avg=45.32, stdev=37.60 lat (msec): min=5, max=200, avg=45.32, stdev=37.60 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 69], 90.00th=[ 106], 95.00th=[ 129], | 99.00th=[ 186], 99.50th=[ 199], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 445, per=24.73%, avg=139.49, stdev=83.77, samples=82 iops : min= 1, max= 27, avg= 7.94, stdev= 5.25, samples=82 write: IOPS=9, BW=150KiB/s (154kB/s)(6368KiB/42432msec); 0 zone resets clat (msec): min=12, max=328, avg=63.91, stdev=43.32 lat (msec): min=12, max=328, avg=63.92, stdev=43.33 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 60], | 70.00th=[ 74], 80.00th=[ 90], 90.00th=[ 128], 95.00th=[ 146], | 99.00th=[ 222], 99.50th=[ 300], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 28, max= 414, per=25.48%, avg=151.07, stdev=84.10, samples=82 iops : min= 1, max= 25, avg= 8.66, stdev= 5.27, samples=82 lat (msec) : 10=0.65%, 20=12.50%, 50=47.53%, 100=25.65%, 250=13.41% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.75%, ctx=1126, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179407: Mon Sep 21 12:11:04 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5744KiB/42346msec) clat (msec): min=6, max=329, avg=43.75, stdev=40.19 lat (msec): min=6, max=329, avg=43.75, stdev=40.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 99], 95.00th=[ 126], | 99.00th=[ 178], 99.50th=[ 305], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 28, max= 414, per=24.86%, avg=140.20, stdev=86.38, samples=80 iops : min= 1, max= 25, avg= 7.97, stdev= 5.41, samples=80 write: IOPS=9, BW=155KiB/s (158kB/s)(6544KiB/42346msec); 0 zone resets clat (msec): min=10, max=226, avg=64.52, stdev=40.55 lat (msec): min=10, max=226, avg=64.52, stdev=40.55 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 63], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 121], 95.00th=[ 144], | 99.00th=[ 203], 99.50th=[ 211], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 416, per=26.21%, avg=155.40, stdev=88.84, samples=82 iops : min= 1, max= 26, avg= 8.95, stdev= 5.59, samples=82 lat (msec) : 10=1.56%, 20=11.98%, 50=47.53%, 100=25.13%, 250=13.54% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.79%, ctx=1192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179408: Mon Sep 21 12:11:04 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40385msec) clat (msec): min=6, max=198, avg=41.21, stdev=34.75 lat (msec): min=6, max=198, avg=41.21, stdev=34.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 86], 95.00th=[ 121], | 99.00th=[ 178], 99.50th=[ 190], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 30, max= 509, per=27.88%, avg=157.24, stdev=109.99, samples=78 iops : min= 1, max= 31, avg= 9.08, stdev= 6.94, samples=78 write: IOPS=9, BW=149KiB/s (153kB/s)(6032KiB/40385msec); 0 zone resets clat (msec): min=12, max=231, avg=64.26, stdev=42.39 lat (msec): min=12, max=231, avg=64.26, stdev=42.39 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 75], 80.00th=[ 93], 90.00th=[ 133], 95.00th=[ 153], | 99.00th=[ 203], 99.50th=[ 213], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 382, per=24.86%, avg=147.43, stdev=81.20, samples=79 iops : min= 1, max= 23, avg= 8.44, stdev= 5.13, samples=79 lat (msec) : 10=2.21%, 20=14.71%, 50=46.22%, 100=25.52%, 250=11.33% cpu : usr=0.05%, sys=1.86%, ctx=1166, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179409: Mon Sep 21 12:11:04 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6032KiB/42215msec) clat (msec): min=5, max=331, avg=45.47, stdev=40.11 lat (msec): min=5, max=331, avg=45.47, stdev=40.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 108], 95.00th=[ 130], | 99.00th=[ 182], 99.50th=[ 203], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 541, per=26.12%, avg=147.30, stdev=92.25, samples=80 iops : min= 1, max= 33, avg= 8.43, stdev= 5.80, samples=80 write: IOPS=9, BW=148KiB/s (152kB/s)(6256KiB/42215msec); 0 zone resets clat (msec): min=13, max=338, avg=63.61, stdev=43.00 lat (msec): min=13, max=338, avg=63.62, stdev=43.01 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 122], 95.00th=[ 146], | 99.00th=[ 203], 99.50th=[ 224], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 446, per=24.94%, avg=147.89, stdev=88.76, samples=83 iops : min= 1, max= 27, avg= 8.47, stdev= 5.57, samples=83 lat (msec) : 10=1.56%, 20=12.89%, 50=46.48%, 100=24.22%, 250=14.58% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.88%, ctx=1249, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=564KiB/s (578kB/s), 136KiB/s-155KiB/s (139kB/s-159kB/s), io=23.4MiB (24.5MB), run=40385-42432msec WRITE: bw=594KiB/s (608kB/s), 148KiB/s-155KiB/s (152kB/s-158kB/s), io=24.6MiB (25.8MB), run=40385-42432msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179426: Mon Sep 21 12:11:21 2026 read: IOPS=1, BW=1721KiB/s (1762kB/s)(7168KiB/4166msec) clat (msec): min=62, max=952, avg=249.19, stdev=317.85 lat (msec): min=62, max=952, avg=249.20, stdev=317.85 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 72], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 120], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 271], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1973, max= 4039, per=75.89%, avg=3079.00, stdev=1040.71, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1229KiB/s (1258kB/s)(5120KiB/4166msec); 0 zone resets clat (msec): min=99, max=1340, avg=466.28, stdev=518.88 lat (msec): min=99, max=1340, avg=466.37, stdev=518.88 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1946, max= 2019, per=34.91%, avg=1982.50, stdev=51.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=4.95%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179427: Mon Sep 21 12:11:21 2026 read: IOPS=0, BW=406KiB/s (415kB/s)(2048KiB/5048msec) clat (msec): min=143, max=393, avg=268.55, stdev=176.30 lat (msec): min=143, max=393, avg=268.55, stdev=176.30 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1436, max= 1946, per=41.68%, avg=1691.00, stdev=360.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2029KiB/s (2077kB/s)(10.0MiB/5048msec); 0 zone resets clat (msec): min=251, max=1200, avg=429.74, stdev=287.63 lat (msec): min=251, max=1200, avg=430.06, stdev=287.62 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 259], | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 292], 60.00th=[ 363], | 70.00th=[ 397], 80.00th=[ 422], 90.00th=[ 558], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1973, max= 4063, per=45.22%, avg=2568.00, stdev=964.77, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=8.33%, 500=75.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.39%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179428: Mon Sep 21 12:11:21 2026 read: IOPS=1, BW=1369KiB/s (1402kB/s)(6144KiB/4489msec) clat (msec): min=115, max=546, avg=309.17, stdev=194.92 lat (msec): min=115, max=546, avg=309.17, stdev=194.92 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 330], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1946, max= 4031, per=81.91%, avg=3323.00, stdev=1192.68, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1369KiB/s (1402kB/s)(6144KiB/4489msec); 0 zone resets clat (msec): min=111, max=638, avg=426.14, stdev=190.53 lat (msec): min=111, max=638, avg=426.30, stdev=190.54 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 468], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1973, max= 2880, per=38.99%, avg=2214.00, stdev=444.43, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=3.19%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179431: Mon Sep 21 12:11:21 2026 read: IOPS=1, BW=1139KiB/s (1166kB/s)(5120KiB/4496msec) clat (msec): min=101, max=727, avg=355.53, stdev=335.22 lat (msec): min=101, max=727, avg=355.53, stdev=335.22 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1946, max= 4031, per=65.41%, avg=2653.67, stdev=1192.96, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1594KiB/s (1633kB/s)(7168KiB/4496msec); 0 zone resets clat (msec): min=136, max=853, avg=379.79, stdev=246.12 lat (msec): min=136, max=853, avg=380.08, stdev=245.96 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 178], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 359], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 472], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1735, max= 3992, per=43.11%, avg=2448.50, stdev=1038.64, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.45%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4057KiB/s (4154kB/s), 406KiB/s-1721KiB/s (415kB/s-1762kB/s), io=20.0MiB (20.0MB), run=4166-5048msec WRITE: bw=5680KiB/s (5816kB/s), 1229KiB/s-2029KiB/s (1258kB/s-2077kB/s), io=28.0MiB (29.4MB), run=4166-5048msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179429: Mon Sep 21 12:11:21 2026 read: IOPS=2, BW=2242KiB/s (2296kB/s)(7168KiB/3197msec) clat (usec): min=584, max=788854, avg=222461.22, stdev=265865.32 lat (usec): min=586, max=788856, avg=222462.79, stdev=265865.26 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 758], | 30.00th=[175113], 40.00th=[175113], 50.00th=[181404], 60.00th=[191890], | 70.00th=[191890], 80.00th=[219153], 90.00th=[792724], 95.00th=[792724], | 99.00th=[792724], 99.50th=[792724], 99.90th=[792724], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 2011, max= 3407, per=73.56%, avg=2912.33, stdev=781.82, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1602KiB/s (1640kB/s)(5120KiB/3197msec); 0 zone resets clat (msec): min=187, max=544, avg=288.77, stdev=146.32 lat (msec): min=187, max=544, avg=289.22, stdev=146.06 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2011, max= 5818, per=70.62%, avg=3914.50, stdev=2691.96, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=16.20%, ctx=159, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179430: Mon Sep 21 12:11:21 2026 read: IOPS=0, BW=396KiB/s (405kB/s)(2048KiB/5172msec) clat (usec): min=1492, max=497825, avg=249659.02, stdev=350961.03 lat (usec): min=1493, max=497828, avg=249661.00, stdev=350961.68 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1500], 10.00th=[ 1500], 20.00th=[ 1500], | 30.00th=[ 1500], 40.00th=[ 1500], 50.00th=[ 1500], 60.00th=[497026], | 70.00th=[497026], 80.00th=[497026], 90.00th=[497026], 95.00th=[497026], | 99.00th=[497026], 99.50th=[497026], 99.90th=[497026], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 1950, max= 2011, per=50.03%, avg=1980.50, stdev=43.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1980KiB/s (2027kB/s)(10.0MiB/5172msec); 0 zone resets clat (msec): min=123, max=1167, avg=448.32, stdev=353.13 lat (msec): min=123, max=1167, avg=448.41, stdev=353.14 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 128], | 30.00th=[ 136], 40.00th=[ 226], 50.00th=[ 266], 60.00th=[ 447], | 70.00th=[ 477], 80.00th=[ 651], 90.00th=[ 860], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1659, max= 3900, per=40.65%, avg=2253.50, stdev=818.22, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=13.38%, ctx=139, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179432: Mon Sep 21 12:11:21 2026 read: IOPS=1, BW=1295KiB/s (1326kB/s)(6144KiB/4744msec) clat (msec): min=161, max=400, avg=272.31, stdev=87.46 lat (msec): min=161, max=400, avg=272.31, stdev=87.46 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 300], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1939, max= 3319, per=58.75%, avg=2326.00, stdev=663.26, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1295KiB/s (1326kB/s)(6144KiB/4744msec); 0 zone resets clat (msec): min=267, max=753, avg=508.24, stdev=172.05 lat (msec): min=272, max=753, avg=509.72, stdev=170.44 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 550], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1622, max= 2023, per=34.44%, avg=1909.00, stdev=164.58, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=14.02%, ctx=182, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179433: Mon Sep 21 12:11:21 2026 read: IOPS=1, BW=1024KiB/s (1049kB/s)(5120KiB/5000msec) clat (usec): min=430, max=329749, avg=157754.74, stdev=155653.10 lat (usec): min=431, max=329749, avg=157755.78, stdev=155653.16 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 433], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[166724], 60.00th=[166724], | 70.00th=[291505], 80.00th=[291505], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1434KiB/s (1468kB/s)(7168KiB/5000msec); 0 zone resets clat (msec): min=231, max=1035, avg=584.23, stdev=252.92 lat (msec): min=231, max=1035, avg=584.34, stdev=252.91 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 430], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 592], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 701], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1659, max= 3930, per=41.72%, avg=2312.40, stdev=916.19, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=10.10%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3960KiB/s (4055kB/s), 396KiB/s-2242KiB/s (405kB/s-2296kB/s), io=20.0MiB (20.0MB), run=3197-5172msec WRITE: bw=5544KiB/s (5677kB/s), 1295KiB/s-1980KiB/s (1326kB/s-2027kB/s), io=28.0MiB (29.4MB), run=3197-5172msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179440: Mon Sep 21 12:11:37 2026 read: IOPS=0, BW=2522KiB/s (2582kB/s)(12.0MiB/4873msec) clat (msec): min=837, max=2827, avg=1536.80, stdev=1119.20 lat (msec): min=837, max=2827, avg=1536.81, stdev=1119.20 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.80%, ctx=281, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179441: Mon Sep 21 12:11:37 2026 read: IOPS=0, BW=810KiB/s (829kB/s)(4096KiB/5058msec) clat (nsec): min=2815.3M, max=2815.3M, avg=2815295962.00, stdev= 0.00 lat (nsec): min=2815.3M, max=2815.3M, avg=2815298982.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2802], 5.00th=[ 2802], 10.00th=[ 2802], 20.00th=[ 2802], | 30.00th=[ 2802], 40.00th=[ 2802], 50.00th=[ 2802], 60.00th=[ 2802], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1620KiB/s (1658kB/s)(8192KiB/5058msec); 0 zone resets clat (msec): min=672, max=1422, avg=1047.27, stdev=530.13 lat (msec): min=672, max=1422, avg=1047.66, stdev=530.07 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.09%, ctx=483, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179442: Mon Sep 21 12:11:37 2026 write: IOPS=0, BW=2933KiB/s (3003kB/s)(12.0MiB/4190msec); 0 zone resets clat (msec): min=776, max=2105, avg=1378.40, stdev=673.25 lat (msec): min=776, max=2106, avg=1379.17, stdev=673.47 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 7937, max= 8110, per=100.00%, avg=8023.50, stdev=122.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.03%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179444: Mon Sep 21 12:11:37 2026 write: IOPS=0, BW=2549KiB/s (2610kB/s)(12.0MiB/4821msec); 0 zone resets clat (msec): min=511, max=2087, avg=1553.54, stdev=902.53 lat (msec): min=513, max=2088, avg=1554.42, stdev=901.71 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 2056], 50.00th=[ 2056], 60.00th=[ 2056], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 7937, max= 8110, per=100.00%, avg=8023.50, stdev=122.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.99%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3239KiB/s (3317kB/s), 810KiB/s-2522KiB/s (829kB/s-2582kB/s), io=16.0MiB (16.8MB), run=4873-5058msec WRITE: bw=6478KiB/s (6634kB/s), 1620KiB/s-2933KiB/s (1658kB/s-3003kB/s), io=32.0MiB (33.6MB), run=4190-5058msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179443: Mon Sep 21 12:11:37 2026 read: IOPS=0, BW=2589KiB/s (2651kB/s)(12.0MiB/4747msec) clat (msec): min=783, max=2986, avg=1568.27, stdev=1230.38 lat (msec): min=783, max=2986, avg=1568.27, stdev=1230.38 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 7684, max= 8094, per=100.00%, avg=7889.00, stdev=289.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.85%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179445: Mon Sep 21 12:11:37 2026 read: IOPS=0, BW=772KiB/s (791kB/s)(4096KiB/5304msec) clat (nsec): min=4291.2M, max=4291.2M, avg=4291228284.00, stdev= 0.00 lat (nsec): min=4291.2M, max=4291.2M, avg=4291230682.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4279], 5.00th=[ 4279], 10.00th=[ 4279], 20.00th=[ 4279], | 30.00th=[ 4279], 40.00th=[ 4279], 50.00th=[ 4279], 60.00th=[ 4279], | 70.00th=[ 4279], 80.00th=[ 4279], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1544KiB/s (1582kB/s)(8192KiB/5304msec); 0 zone resets clat (msec): min=362, max=476, avg=419.66, stdev=80.83 lat (msec): min=362, max=479, avg=421.22, stdev=82.33 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.17%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179446: Mon Sep 21 12:11:37 2026 write: IOPS=0, BW=2316KiB/s (2371kB/s)(12.0MiB/5306msec); 0 zone resets clat (msec): min=275, max=3993, avg=1750.75, stdev=1974.13 lat (msec): min=276, max=3993, avg=1751.26, stdev=1973.99 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 8047, max= 8094, per=100.00%, avg=8070.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.24%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179447: Mon Sep 21 12:11:37 2026 write: IOPS=0, BW=2512KiB/s (2572kB/s)(12.0MiB/4892msec); 0 zone resets clat (msec): min=214, max=2459, avg=1586.71, stdev=1203.07 lat (msec): min=214, max=2462, avg=1589.40, stdev=1204.97 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 2089], 50.00th=[ 2089], 60.00th=[ 2089], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.23%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3089KiB/s (3163kB/s), 772KiB/s-2589KiB/s (791kB/s-2651kB/s), io=16.0MiB (16.8MB), run=4747-5304msec WRITE: bw=6176KiB/s (6324kB/s), 1544KiB/s-2512KiB/s (1582kB/s-2572kB/s), io=32.0MiB (33.6MB), run=4892-5306msec