== sanity test 398b: DIO and buffer IO race ============== 05:49:59 (1789120199) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.48085 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144955: Fri Sep 11 05:52:33 2026 read: IOPS=11, BW=44.9KiB/s (46.0kB/s)(5992KiB/133366msec) clat (usec): min=34, max=737967, avg=44132.85, stdev=39089.97 lat (usec): min=35, max=737968, avg=44137.74, stdev=39088.54 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 6652], 20.00th=[ 20317], | 30.00th=[ 25560], 40.00th=[ 30802], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 52691], 80.00th=[ 66323], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[162530], 99.50th=[189793], 99.90th=[455082], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 95, per=25.34%, avg=45.10, stdev=19.25, samples=259 iops : min= 1, max= 23, avg=10.62, stdev= 4.84, samples=259 write: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6296KiB/133366msec); 0 zone resets clat (usec): min=843, max=353988, avg=42590.81, stdev=42590.32 lat (usec): min=844, max=353990, avg=42598.52, stdev=42587.25 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1352], 10.00th=[ 1631], 20.00th=[ 4555], | 30.00th=[ 9110], 40.00th=[ 20579], 50.00th=[ 33817], 60.00th=[ 43779], | 70.00th=[ 57410], 80.00th=[ 74974], 90.00th=[ 98042], 95.00th=[123208], | 99.00th=[183501], 99.50th=[210764], 99.90th=[308282], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 7, max= 111, per=25.29%, avg=47.03, stdev=20.58, samples=261 iops : min= 1, max= 27, avg=11.10, stdev= 5.19, samples=261 lat (usec) : 50=0.26%, 100=3.71%, 250=0.52%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=6.15%, 4=3.39%, 10=6.77%, 20=8.66%, 50=36.56% lat (msec) : 100=25.98%, 250=7.36%, 500=0.23%, 750=0.03% cpu : usr=0.08%, sys=4.95%, ctx=6668, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Fri Sep 11 05:52:33 2026 read: IOPS=11, BW=44.1KiB/s (45.2kB/s)(5940KiB/134566msec) clat (usec): min=29, max=787941, avg=43777.41, stdev=36503.44 lat (usec): min=29, max=787942, avg=43785.83, stdev=36506.25 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 73], 10.00th=[ 11207], 20.00th=[ 20579], | 30.00th=[ 25560], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[168821], 99.90th=[291505], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 111, per=24.67%, avg=43.92, stdev=19.04, samples=262 iops : min= 1, max= 27, avg=10.32, stdev= 4.81, samples=262 write: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6348KiB/134566msec); 0 zone resets clat (usec): min=864, max=569494, avg=43677.70, stdev=48235.10 lat (usec): min=864, max=569497, avg=43692.38, stdev=48243.86 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 1778], 20.00th=[ 4293], | 30.00th=[ 8356], 40.00th=[ 18482], 50.00th=[ 31589], 60.00th=[ 43779], | 70.00th=[ 57410], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[130548], | 99.00th=[187696], 99.50th=[248513], 99.90th=[549454], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 151, per=25.01%, avg=46.52, stdev=21.39, samples=264 iops : min= 1, max= 37, avg=10.97, stdev= 5.35, samples=264 lat (usec) : 50=0.29%, 100=3.12%, 250=0.75%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.89%, 4=4.04%, 10=7.23%, 20=8.85%, 50=35.61% lat (msec) : 100=25.94%, 250=7.75%, 500=0.20%, 750=0.07%, 1000=0.03% cpu : usr=0.09%, sys=4.85%, ctx=6564, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144957: Fri Sep 11 05:52:33 2026 read: IOPS=11, BW=44.9KiB/s (45.0kB/s)(6028KiB/134204msec) clat (usec): min=31, max=590999, avg=43263.31, stdev=34031.28 lat (usec): min=31, max=591001, avg=43266.26, stdev=34031.69 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 1287], 20.00th=[ 19268], | 30.00th=[ 25035], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 65799], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[160433], 99.90th=[242222], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 103, per=25.20%, avg=44.85, stdev=19.76, samples=261 iops : min= 1, max= 25, avg=10.56, stdev= 4.97, samples=261 write: IOPS=11, BW=46.6KiB/s (47.8kB/s)(6260KiB/134204msec); 0 zone resets clat (usec): min=909, max=871547, avg=43964.74, stdev=49494.09 lat (usec): min=910, max=871549, avg=43967.77, stdev=49493.99 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1385], 10.00th=[ 1778], 20.00th=[ 4883], | 30.00th=[ 10159], 40.00th=[ 21103], 50.00th=[ 32113], 60.00th=[ 43779], | 70.00th=[ 56886], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[126354], | 99.00th=[193987], 99.50th=[229639], 99.90th=[408945], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 140, per=24.91%, avg=46.34, stdev=20.97, samples=262 iops : min= 1, max= 35, avg=10.93, stdev= 5.31, samples=262 lat (usec) : 50=0.26%, 100=3.87%, 250=0.55%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.89%, 4=3.65%, 10=6.05%, 20=9.51%, 50=35.71% lat (msec) : 100=26.43%, 250=7.62%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.82%, ctx=6572, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144958: Fri Sep 11 05:52:33 2026 read: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6052KiB/134235msec) clat (usec): min=35, max=236392, avg=43038.14, stdev=31944.28 lat (usec): min=36, max=236394, avg=43039.55, stdev=31944.32 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 734], 20.00th=[ 20317], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[154141], 99.50th=[160433], 99.90th=[208667], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 95, per=25.53%, avg=45.45, stdev=19.52, samples=260 iops : min= 1, max= 23, avg=10.70, stdev= 4.89, samples=260 write: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6236KiB/134235msec); 0 zone resets clat (usec): min=1007, max=854418, avg=44180.04, stdev=50771.67 lat (usec): min=1007, max=854419, avg=44182.99, stdev=50770.95 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1369], 10.00th=[ 2008], 20.00th=[ 4752], | 30.00th=[ 9634], 40.00th=[ 20317], 50.00th=[ 32637], 60.00th=[ 43254], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[135267], | 99.00th=[193987], 99.50th=[240124], 99.90th=[574620], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 123, per=24.79%, avg=46.10, stdev=21.25, samples=264 iops : min= 1, max= 30, avg=10.87, stdev= 5.36, samples=264 lat (usec) : 50=0.39%, 100=3.58%, 250=0.68%, 500=0.16%, 750=0.16% lat (usec) : 1000=0.03% lat (msec) : 2=5.05%, 4=4.13%, 10=6.61%, 20=8.85%, 50=37.43% lat (msec) : 100=24.71%, 250=8.04%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=4.96%, ctx=6593, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=178KiB/s (183kB/s), 44.1KiB/s-45.1KiB/s (45.2kB/s-46.2kB/s), io=23.4MiB (24.6MB), run=133366-134566msec WRITE: bw=187KiB/s (191kB/s), 46.5KiB/s-47.2KiB/s (47.6kB/s-48.3kB/s), io=24.6MiB (25.7MB), run=133366-134566msec fio: pid=144953, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=144950: Fri Sep 11 05:54:55 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5992KiB/276532msec) clat (msec): min=5, max=778, avg=41.52, stdev=43.02 lat (msec): min=5, max=778, avg=41.52, stdev=43.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 78], 95.00th=[ 107], | 99.00th=[ 207], 99.50th=[ 271], 99.90th=[ 451], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 80, per=29.30%, avg=23.73, stdev=16.08, samples=485 iops : min= 1, max= 20, avg= 5.27, stdev= 4.05, samples=485 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6296KiB/276532msec); 0 zone resets clat (msec): min=34, max=577, avg=135.92, stdev=65.42 lat (msec): min=34, max=577, avg=135.92, stdev=65.42 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 133], | 70.00th=[ 153], 80.00th=[ 184], 90.00th=[ 226], 95.00th=[ 266], | 99.00th=[ 359], 99.50th=[ 393], 99.90th=[ 460], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 56, per=26.58%, avg=22.32, stdev= 9.95, samples=540 iops : min= 1, max= 14, avg= 4.92, stdev= 2.53, samples=540 lat (msec) : 10=1.69%, 20=12.11%, 50=23.27%, 100=26.11%, 250=33.17% lat (msec) : 500=3.58%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.27%, ctx=5519, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Fri Sep 11 05:54:55 2026 read: IOPS=5, BW=21.5KiB/s (22.0kB/s)(5940KiB/276376msec) clat (msec): min=6, max=816, avg=41.03, stdev=40.90 lat (msec): min=6, max=816, avg=41.04, stdev=40.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 82], 95.00th=[ 106], | 99.00th=[ 178], 99.50th=[ 215], 99.90th=[ 575], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 79, per=29.89%, avg=24.21, stdev=15.13, samples=472 iops : min= 1, max= 19, avg= 5.39, stdev= 3.80, samples=472 write: IOPS=5, BW=22.0KiB/s (23.5kB/s)(6348KiB/276376msec); 0 zone resets clat (msec): min=40, max=585, avg=135.49, stdev=63.93 lat (msec): min=40, max=585, avg=135.49, stdev=63.93 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 218], 95.00th=[ 257], | 99.00th=[ 355], 99.50th=[ 384], 99.90th=[ 468], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 56, per=27.13%, avg=22.79, stdev= 9.83, samples=535 iops : min= 1, max= 14, avg= 5.03, stdev= 2.49, samples=535 lat (msec) : 10=1.63%, 20=11.69%, 50=23.60%, 100=26.89%, 250=33.30% lat (msec) : 500=2.80%, 750=0.07%, 1000=0.03% cpu : usr=0.06%, sys=1.31%, ctx=5509, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Fri Sep 11 05:54:55 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6028KiB/276409msec) clat (msec): min=6, max=447, avg=41.28, stdev=37.02 lat (msec): min=6, max=447, avg=41.28, stdev=37.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 188], 99.50th=[ 228], 99.90th=[ 309], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 91, per=28.78%, avg=23.31, stdev=15.34, samples=497 iops : min= 1, max= 22, avg= 5.17, stdev= 3.85, samples=497 write: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6260KiB/276409msec); 0 zone resets clat (msec): min=38, max=906, avg=136.60, stdev=68.78 lat (msec): min=38, max=906, avg=136.61, stdev=68.79 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 224], 95.00th=[ 268], | 99.00th=[ 359], 99.50th=[ 401], 99.90th=[ 609], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 56, per=26.63%, avg=22.37, stdev=10.15, samples=537 iops : min= 1, max= 14, avg= 4.93, stdev= 2.57, samples=537 lat (msec) : 10=1.82%, 20=11.00%, 50=24.80%, 100=25.52%, 250=33.40% lat (msec) : 500=3.35%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.29%, ctx=5519, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144953: Fri Sep 11 05:54:55 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(4508KiB/216826msec) clat (msec): min=5, max=573, avg=44.05, stdev=42.37 lat (msec): min=5, max=573, avg=44.06, stdev=42.37 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 94], 95.00th=[ 121], | 99.00th=[ 209], 99.50th=[ 271], 99.90th=[ 338], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 119, per=29.29%, avg=23.72, stdev=16.62, samples=366 iops : min= 1, max= 29, avg= 5.26, stdev= 4.17, samples=366 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(4580KiB/216826msec); 0 zone resets clat (msec): min=37, max=904, avg=145.69, stdev=75.31 lat (msec): min=37, max=904, avg=145.70, stdev=75.31 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 102], 40.00th=[ 114], 50.00th=[ 128], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 243], 95.00th=[ 288], | 99.00th=[ 380], 99.50th=[ 468], 99.90th=[ 609], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 48, per=24.86%, avg=20.88, stdev= 9.84, samples=420 iops : min= 1, max= 12, avg= 4.55, stdev= 2.50, samples=420 lat (msec) : 10=1.54%, 20=12.01%, 50=22.44%, 100=24.07%, 250=35.11% lat (msec) : 500=4.62%, 750=0.13%, 1000=0.04% cpu : usr=0.05%, sys=1.14%, ctx=3846, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1128,1145,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=81.2KiB/s (83.2kB/s), 20.8KiB/s-21.8KiB/s (21.3kB/s-22.3kB/s), io=21.9MiB (23.0MB), run=216826-276532msec WRITE: bw=84.9KiB/s (86.0kB/s), 21.1KiB/s-22.0KiB/s (21.6kB/s-23.5kB/s), io=22.9MiB (24.0MB), run=216826-276532msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145010: Fri Sep 11 05:55:32 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(5920KiB/30805msec) clat (usec): min=33, max=355096, avg=43571.00, stdev=39260.19 lat (usec): min=34, max=355097, avg=43575.21, stdev=39261.35 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 97], | 30.00th=[ 24249], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[105382], | 99.00th=[187696], 99.50th=[233833], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 62, max= 473, per=24.64%, avg=190.73, stdev=82.45, samples=60 iops : min= 3, max= 29, avg=11.13, stdev= 5.19, samples=60 write: IOPS=12, BW=207KiB/s (212kB/s)(6368KiB/30805msec); 0 zone resets clat (usec): min=1250, max=163678, avg=36330.79, stdev=37586.63 lat (usec): min=1253, max=163680, avg=36333.85, stdev=37586.22 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2024], 10.00th=[ 2442], 20.00th=[ 4621], | 30.00th=[ 8094], 40.00th=[ 12911], 50.00th=[ 23200], 60.00th=[ 34866], | 70.00th=[ 47449], 80.00th=[ 64226], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[152044], 99.50th=[156238], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 31, max= 415, per=25.43%, avg=207.03, stdev=95.77, samples=60 iops : min= 1, max= 25, avg=12.15, stdev= 6.03, samples=60 lat (usec) : 50=1.69%, 100=8.20%, 250=0.78%, 750=0.13% lat (msec) : 2=2.60%, 4=6.77%, 10=9.51%, 20=7.16%, 50=30.73% lat (msec) : 100=24.87%, 250=7.42%, 500=0.13% cpu : usr=0.10%, sys=5.17%, ctx=1449, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145011: Fri Sep 11 05:55:32 2026 read: IOPS=11, BW=188KiB/s (192kB/s)(5744KiB/30633msec) clat (usec): min=39, max=371554, avg=44708.90, stdev=40966.39 lat (usec): min=39, max=371555, avg=44710.24, stdev=40966.44 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 2507], | 30.00th=[ 25560], 40.00th=[ 32375], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[121111], | 99.00th=[173016], 99.50th=[248513], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 54, max= 412, per=24.15%, avg=186.92, stdev=91.23, samples=60 iops : min= 3, max= 25, avg=10.88, stdev= 5.75, samples=60 write: IOPS=13, BW=214KiB/s (219kB/s)(6544KiB/30633msec); 0 zone resets clat (usec): min=1191, max=346506, avg=35107.40, stdev=39611.92 lat (usec): min=1193, max=346508, avg=35112.43, stdev=39612.90 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2089], 10.00th=[ 3064], 20.00th=[ 5932], | 30.00th=[ 8717], 40.00th=[ 12911], 50.00th=[ 21365], 60.00th=[ 31065], | 70.00th=[ 44827], 80.00th=[ 62653], 90.00th=[ 89654], 95.00th=[105382], | 99.00th=[147850], 99.50th=[173016], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 28, max= 509, per=26.28%, avg=213.92, stdev=109.13, samples=60 iops : min= 1, max= 31, avg=12.58, stdev= 6.88, samples=60 lat (usec) : 50=1.30%, 100=6.51%, 250=0.91%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.47%, 4=5.21%, 10=10.55%, 20=10.03%, 50=32.94% lat (msec) : 100=22.79%, 250=6.51%, 500=0.39% cpu : usr=0.10%, sys=5.49%, ctx=1459, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145012: Fri Sep 11 05:55:32 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30432msec) clat (usec): min=39, max=265105, avg=42041.24, stdev=35216.24 lat (usec): min=39, max=265107, avg=42049.56, stdev=35215.49 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 99], | 30.00th=[ 22938], 40.00th=[ 32113], 50.00th=[ 38011], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[145753], 99.50th=[164627], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 444, per=26.83%, avg=207.68, stdev=97.28, samples=59 iops : min= 1, max= 27, avg=12.19, stdev= 6.12, samples=59 write: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30432msec); 0 zone resets clat (usec): min=1399, max=259962, avg=36875.28, stdev=38507.19 lat (usec): min=1401, max=259965, avg=36891.86, stdev=38515.52 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2024], 10.00th=[ 3261], 20.00th=[ 5604], | 30.00th=[ 8979], 40.00th=[ 15139], 50.00th=[ 23725], 60.00th=[ 36439], | 70.00th=[ 48497], 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[116917], | 99.00th=[160433], 99.50th=[242222], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 539, per=24.08%, avg=196.02, stdev=102.22, samples=59 iops : min= 1, max= 33, avg=11.46, stdev= 6.46, samples=59 lat (usec) : 50=1.30%, 100=8.98%, 250=0.65%, 500=0.13%, 750=0.26% lat (msec) : 2=2.47%, 4=4.69%, 10=8.72%, 20=10.42%, 50=29.95% lat (msec) : 100=26.30%, 250=5.86%, 500=0.26% cpu : usr=0.09%, sys=5.48%, ctx=1444, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145013: Fri Sep 11 05:55:32 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30942msec) clat (usec): min=37, max=278212, avg=44186.40, stdev=40018.38 lat (usec): min=37, max=278212, avg=44189.28, stdev=40017.00 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 73], 20.00th=[ 91], | 30.00th=[ 23200], 40.00th=[ 31065], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 57934], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[121111], | 99.00th=[181404], 99.50th=[191890], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 63, max= 442, per=24.96%, avg=193.17, stdev=86.98, samples=60 iops : min= 3, max= 27, avg=11.27, stdev= 5.50, samples=60 write: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30942msec); 0 zone resets clat (usec): min=1441, max=313047, avg=36012.12, stdev=40340.57 lat (usec): min=1443, max=313049, avg=36017.99, stdev=40338.93 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1991], 10.00th=[ 2606], 20.00th=[ 4424], | 30.00th=[ 8717], 40.00th=[ 12911], 50.00th=[ 20055], 60.00th=[ 32375], | 70.00th=[ 49021], 80.00th=[ 62653], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[191890], 99.50th=[240124], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 474, per=24.67%, avg=200.82, stdev=104.41, samples=60 iops : min= 1, max= 29, avg=11.75, stdev= 6.58, samples=60 lat (usec) : 50=0.91%, 100=9.51%, 250=1.30%, 500=0.13% lat (msec) : 2=2.86%, 4=5.99%, 10=8.33%, 20=10.55%, 50=27.21% lat (msec) : 100=25.13%, 250=7.81%, 500=0.26% cpu : usr=0.13%, sys=5.23%, ctx=1455, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=774KiB/s (793kB/s), 188KiB/s-206KiB/s (192kB/s-211kB/s), io=23.4MiB (24.5MB), run=30432-30942msec WRITE: bw=814KiB/s (834kB/s), 198KiB/s-214KiB/s (203kB/s-219kB/s), io=24.6MiB (25.8MB), run=30432-30942msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145015: Fri Sep 11 05:56:20 2026 read: IOPS=4, BW=76.2KiB/s (78.0kB/s)(5920KiB/77678msec) clat (msec): min=7, max=281, avg=43.36, stdev=36.15 lat (msec): min=7, max=281, avg=43.36, stdev=36.15 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 57], 90.00th=[ 80], 95.00th=[ 116], | 99.00th=[ 190], 99.50th=[ 207], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 314, per=28.09%, avg=86.51, stdev=55.42, samples=133 iops : min= 1, max= 19, avg= 4.58, stdev= 3.56, samples=133 write: IOPS=5, BW=81.0KiB/s (83.9kB/s)(6368KiB/77678msec); 0 zone resets clat (msec): min=41, max=446, avg=154.44, stdev=70.59 lat (msec): min=41, max=446, avg=154.45, stdev=70.59 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 74], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 128], 50.00th=[ 142], 60.00th=[ 157], | 70.00th=[ 174], 80.00th=[ 199], 90.00th=[ 245], 95.00th=[ 313], | 99.00th=[ 384], 99.50th=[ 435], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 160, per=25.22%, avg=81.72, stdev=33.10, samples=152 iops : min= 1, max= 10, avg= 4.28, stdev= 2.13, samples=152 lat (msec) : 10=0.78%, 20=8.98%, 50=26.04%, 100=20.83%, 250=38.41% lat (msec) : 500=4.95% cpu : usr=0.05%, sys=1.29%, ctx=1329, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145016: Fri Sep 11 05:56:20 2026 read: IOPS=4, BW=75.5KiB/s (77.3kB/s)(5744KiB/76078msec) clat (msec): min=9, max=405, avg=44.62, stdev=43.52 lat (msec): min=9, max=405, avg=44.62, stdev=43.52 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 92], 95.00th=[ 136], | 99.00th=[ 213], 99.50th=[ 284], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 26, max= 317, per=28.71%, avg=88.41, stdev=54.70, samples=128 iops : min= 1, max= 19, avg= 4.71, stdev= 3.46, samples=128 write: IOPS=5, BW=86.0KiB/s (88.1kB/s)(6544KiB/76078msec); 0 zone resets clat (msec): min=45, max=463, avg=146.47, stdev=62.94 lat (msec): min=45, max=463, avg=146.47, stdev=62.94 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 121], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 190], 90.00th=[ 224], 95.00th=[ 268], | 99.00th=[ 368], 99.50th=[ 384], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 26, max= 159, per=26.76%, avg=86.72, stdev=35.58, samples=148 iops : min= 1, max= 9, avg= 4.59, stdev= 2.29, samples=148 lat (msec) : 10=0.39%, 20=10.29%, 50=24.48%, 100=19.53%, 250=41.80% lat (msec) : 500=3.52% cpu : usr=0.05%, sys=1.26%, ctx=1242, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145017: Fri Sep 11 05:56:20 2026 read: IOPS=5, BW=84.0KiB/s (86.0kB/s)(6256KiB/74475msec) clat (msec): min=8, max=403, avg=45.40, stdev=43.90 lat (msec): min=8, max=403, avg=45.40, stdev=43.90 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 87], 95.00th=[ 126], | 99.00th=[ 259], 99.50th=[ 305], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 348, per=30.10%, avg=92.71, stdev=61.66, samples=133 iops : min= 1, max= 21, avg= 4.93, stdev= 3.89, samples=133 write: IOPS=5, BW=80.0KiB/s (82.9kB/s)(6032KiB/74475msec); 0 zone resets clat (msec): min=48, max=430, avg=150.06, stdev=62.35 lat (msec): min=48, max=430, avg=150.07, stdev=62.35 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 75], 10.00th=[ 86], 20.00th=[ 99], | 30.00th=[ 113], 40.00th=[ 125], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 169], 80.00th=[ 197], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 347], 99.50th=[ 388], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 31, max= 191, per=25.20%, avg=81.63, stdev=34.15, samples=145 iops : min= 1, max= 11, avg= 4.26, stdev= 2.19, samples=145 lat (msec) : 10=0.65%, 20=10.68%, 50=25.52%, 100=20.31%, 250=38.28% lat (msec) : 500=4.56% cpu : usr=0.05%, sys=1.37%, ctx=1391, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145018: Fri Sep 11 05:56:20 2026 read: IOPS=4, BW=78.8KiB/s (80.7kB/s)(6032KiB/76559msec) clat (msec): min=9, max=267, avg=45.33, stdev=40.66 lat (msec): min=9, max=267, avg=45.33, stdev=40.66 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 54], 90.00th=[ 88], 95.00th=[ 140], | 99.00th=[ 230], 99.50th=[ 255], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 281, per=28.94%, avg=89.14, stdev=58.67, samples=132 iops : min= 1, max= 17, avg= 4.73, stdev= 3.70, samples=132 write: IOPS=5, BW=81.7KiB/s (83.7kB/s)(6256KiB/76559msec); 0 zone resets clat (msec): min=50, max=413, avg=151.78, stdev=64.45 lat (msec): min=50, max=413, avg=151.79, stdev=64.45 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 85], 20.00th=[ 100], | 30.00th=[ 112], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 197], 90.00th=[ 241], 95.00th=[ 271], | 99.00th=[ 376], 99.50th=[ 409], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 26, max= 160, per=25.40%, avg=82.29, stdev=32.75, samples=149 iops : min= 1, max= 10, avg= 4.31, stdev= 2.11, samples=149 lat (msec) : 10=0.39%, 20=7.16%, 50=29.56%, 100=18.88%, 250=39.45% lat (msec) : 500=4.56% cpu : usr=0.04%, sys=1.24%, ctx=1397, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=308KiB/s (316kB/s), 75.5KiB/s-84.0KiB/s (77.3kB/s-86.0kB/s), io=23.4MiB (24.5MB), run=74475-77678msec WRITE: bw=324KiB/s (332kB/s), 80.0KiB/s-86.0KiB/s (82.9kB/s-88.1kB/s), io=24.6MiB (25.8MB), run=74475-77678msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145039: Fri Sep 11 05:56:34 2026 read: IOPS=1, BW=1598KiB/s (1636kB/s)(7168KiB/4486msec) clat (usec): min=551, max=703730, avg=323680.10, stdev=212814.49 lat (usec): min=552, max=703732, avg=323681.82, stdev=212814.55 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[206570], | 30.00th=[274727], 40.00th=[274727], 50.00th=[320865], 60.00th=[354419], | 70.00th=[354419], 80.00th=[400557], 90.00th=[700449], 95.00th=[700449], | 99.00th=[700449], 99.50th=[700449], 99.90th=[700449], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 1878, max= 4031, per=63.58%, avg=2400.60, stdev=913.91, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1141KiB/s (1169kB/s)(5120KiB/4486msec); 0 zone resets clat (msec): min=235, max=630, avg=408.17, stdev=144.12 lat (msec): min=250, max=630, avg=411.21, stdev=139.87 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2023, max= 2048, per=38.50%, avg=2035.25, stdev=10.21, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=58.33%, 750=16.67% cpu : usr=0.02%, sys=11.44%, ctx=171, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145040: Fri Sep 11 05:56:34 2026 read: IOPS=0, BW=378KiB/s (387kB/s)(2048KiB/5423msec) clat (msec): min=57, max=378, avg=217.52, stdev=226.96 lat (msec): min=57, max=378, avg=217.52, stdev=226.96 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 57], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2015, max= 2023, per=53.47%, avg=2019.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1888KiB/s (1934kB/s)(10.0MiB/5423msec); 0 zone resets clat (msec): min=278, max=840, avg=483.12, stdev=179.52 lat (msec): min=278, max=840, avg=483.63, stdev=179.63 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 305], | 30.00th=[ 313], 40.00th=[ 355], 50.00th=[ 464], 60.00th=[ 502], | 70.00th=[ 535], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2023, max= 4031, per=43.16%, avg=2281.62, stdev=706.90, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 100=8.33%, 500=58.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=9.59%, ctx=206, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145041: Fri Sep 11 05:56:34 2026 read: IOPS=1, BW=1286KiB/s (1317kB/s)(6144KiB/4777msec) clat (usec): min=673, max=1484.3k, avg=375490.08, stdev=591478.21 lat (usec): min=675, max=1484.3k, avg=375491.58, stdev=591478.21 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], | 20.00th=[ 676], 30.00th=[ 676], 40.00th=[ 758], | 50.00th=[ 758], 60.00th=[ 162530], 70.00th=[ 608175], | 80.00th=[ 608175], 90.00th=[1484784], 95.00th=[1484784], | 99.00th=[1484784], 99.50th=[1484784], 99.90th=[1484784], | 99.95th=[1484784], 99.99th=[1484784] bw ( KiB/s): min= 4047, max= 4063, per=100.00%, avg=4055.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1286KiB/s (1317kB/s)(6144KiB/4777msec); 0 zone resets clat (msec): min=151, max=1132, avg=394.32, stdev=367.37 lat (msec): min=151, max=1132, avg=394.63, stdev=367.31 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 288], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1935, max= 2023, per=37.77%, avg=1997.00, stdev=41.51, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=25.00%, 500=25.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=7.18%, ctx=128, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145042: Fri Sep 11 05:56:34 2026 read: IOPS=1, BW=1219KiB/s (1248kB/s)(5120KiB/4200msec) clat (usec): min=382, max=736231, avg=190684.14, stdev=317157.61 lat (usec): min=384, max=736232, avg=190685.63, stdev=317157.47 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 383], | 30.00th=[ 725], 40.00th=[ 725], 50.00th=[ 11207], 60.00th=[ 11207], | 70.00th=[204473], 80.00th=[204473], 90.00th=[734004], 95.00th=[734004], | 99.00th=[734004], 99.50th=[734004], 99.90th=[734004], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 2023, max= 6107, per=100.00%, avg=4065.00, stdev=2887.82, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1707KiB/s (1748kB/s)(7168KiB/4200msec); 0 zone resets clat (msec): min=137, max=870, avg=454.34, stdev=217.02 lat (msec): min=137, max=871, avg=454.49, stdev=217.10 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 372], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 443], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 472], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1932, max= 4096, per=45.81%, avg=2421.80, stdev=936.84, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 20=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=8.86%, ctx=114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3777KiB/s (3867kB/s), 378KiB/s-1598KiB/s (387kB/s-1636kB/s), io=20.0MiB (20.0MB), run=4200-5423msec WRITE: bw=5287KiB/s (5414kB/s), 1141KiB/s-1888KiB/s (1169kB/s-1934kB/s), io=28.0MiB (29.4MB), run=4200-5423msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145044: Fri Sep 11 05:56:35 2026 read: IOPS=1, BW=1339KiB/s (1371kB/s)(7168KiB/5354msec) clat (msec): min=53, max=1400, avg=427.61, stdev=488.47 lat (msec): min=54, max=1400, avg=427.62, stdev=488.47 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 148], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 169], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 760], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1528, max= 4071, per=63.61%, avg=2366.75, stdev=1153.29, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=956KiB/s (979kB/s)(5120KiB/5354msec); 0 zone resets clat (msec): min=90, max=1151, avg=447.04, stdev=418.11 lat (msec): min=90, max=1151, avg=447.31, stdev=418.09 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1954, max= 4087, per=57.98%, avg=3020.50, stdev=1508.26, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 1000=8.33%, 2000=16.67% cpu : usr=0.02%, sys=3.04%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145045: Fri Sep 11 05:56:35 2026 read: IOPS=0, BW=372KiB/s (381kB/s)(2048KiB/5503msec) clat (msec): min=128, max=217, avg=173.29, stdev=62.79 lat (msec): min=128, max=217, avg=173.29, stdev=62.79 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 1592, max= 2043, per=48.84%, avg=1817.50, stdev=318.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1861KiB/s (1905kB/s)(10.0MiB/5503msec); 0 zone resets clat (msec): min=97, max=1319, avg=496.47, stdev=436.97 lat (msec): min=97, max=1319, avg=496.90, stdev=437.14 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 133], | 30.00th=[ 159], 40.00th=[ 247], 50.00th=[ 249], 60.00th=[ 296], | 70.00th=[ 542], 80.00th=[ 844], 90.00th=[ 1083], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2023, max= 6131, per=66.50%, avg=3464.80, stdev=1713.44, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=3.65%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145046: Fri Sep 11 05:56:35 2026 read: IOPS=1, BW=1180KiB/s (1209kB/s)(6144KiB/5205msec) clat (msec): min=85, max=547, avg=261.55, stdev=181.41 lat (msec): min=85, max=547, avg=261.55, stdev=181.41 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 232], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2035, max= 3500, per=67.88%, avg=2526.00, stdev=843.52, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1180KiB/s (1209kB/s)(6144KiB/5205msec); 0 zone resets clat (msec): min=129, max=1230, avg=578.71, stdev=461.33 lat (msec): min=129, max=1231, avg=578.83, stdev=461.33 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 397], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1659, max= 2043, per=36.09%, avg=1880.40, stdev=166.76, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 2000=16.67% cpu : usr=0.04%, sys=3.36%, ctx=71, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145047: Fri Sep 11 05:56:35 2026 read: IOPS=0, BW=938KiB/s (960kB/s)(5120KiB/5459msec) clat (msec): min=174, max=332, avg=236.92, stdev=59.03 lat (msec): min=174, max=332, avg=236.92, stdev=59.03 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1954, max= 3500, per=67.09%, avg=2496.33, stdev=870.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1313KiB/s (1345kB/s)(7168KiB/5459msec); 0 zone resets clat (msec): min=160, max=1339, avg=579.06, stdev=406.09 lat (msec): min=161, max=1339, avg=579.18, stdev=406.07 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 259], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 542], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 802], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1514, max= 2043, per=33.90%, avg=1766.20, stdev=250.02, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.84%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3722KiB/s (3811kB/s), 372KiB/s-1339KiB/s (381kB/s-1371kB/s), io=20.0MiB (20.0MB), run=5205-5503msec WRITE: bw=5210KiB/s (5335kB/s), 956KiB/s-1861KiB/s (979kB/s-1905kB/s), io=28.0MiB (29.4MB), run=5205-5503msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145055: Fri Sep 11 05:56:55 2026 read: IOPS=0, BW=1867KiB/s (1912kB/s)(12.0MiB/6581msec) clat (msec): min=1573, max=3036, avg=2122.03, stdev=797.53 lat (msec): min=1573, max=3036, avg=2122.03, stdev=797.53 clat percentiles (msec): | 1.00th=[ 1569], 5.00th=[ 1569], 10.00th=[ 1569], 20.00th=[ 1569], | 30.00th=[ 1569], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 7757, max= 7907, per=100.00%, avg=7832.00, stdev=106.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.43%, ctx=661, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145056: Fri Sep 11 05:56:55 2026 read: IOPS=0, BW=536KiB/s (548kB/s)(4096KiB/7648msec) clat (nsec): min=1063.8M, max=1063.8M, avg=1063754151.00, stdev= 0.00 lat (nsec): min=1063.8M, max=1063.8M, avg=1063756311.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1062], 5.00th=[ 1062], 10.00th=[ 1062], 20.00th=[ 1062], | 30.00th=[ 1062], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1071KiB/s (1097kB/s)(8192KiB/7648msec); 0 zone resets clat (msec): min=3067, max=3410, avg=3239.18, stdev=242.40 lat (msec): min=3068, max=3411, avg=3239.60, stdev=242.41 clat percentiles (msec): | 1.00th=[ 3071], 5.00th=[ 3071], 10.00th=[ 3071], 20.00th=[ 3071], | 30.00th=[ 3071], 40.00th=[ 3071], 50.00th=[ 3071], 60.00th=[ 3406], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.45%, ctx=116, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145057: Fri Sep 11 05:56:55 2026 write: IOPS=0, BW=1666KiB/s (1706kB/s)(12.0MiB/7376msec); 0 zone resets clat (msec): min=859, max=3695, avg=2328.67, stdev=1420.57 lat (msec): min=860, max=3696, avg=2329.33, stdev=1420.49 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 2433], 50.00th=[ 2433], 60.00th=[ 2433], | 70.00th=[ 3708], 80.00th=[ 3708], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 7937, max= 8192, per=100.00%, avg=8064.50, stdev=180.31, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.06%, ctx=83, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145058: Fri Sep 11 05:56:55 2026 write: IOPS=0, BW=2189KiB/s (2241kB/s)(12.0MiB/5614msec); 0 zone resets clat (msec): min=756, max=3094, avg=1802.60, stdev=1188.30 lat (msec): min=758, max=3095, avg=1803.71, stdev=1187.72 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 7713, max= 7937, per=100.00%, avg=7825.00, stdev=158.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.48%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2142KiB/s (2194kB/s), 536KiB/s-1867KiB/s (548kB/s-1912kB/s), io=16.0MiB (16.8MB), run=6581-7648msec WRITE: bw=4285KiB/s (4387kB/s), 1071KiB/s-2189KiB/s (1097kB/s-2241kB/s), io=32.0MiB (33.6MB), run=5614-7648msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145060: Fri Sep 11 05:56:56 2026 read: IOPS=0, BW=1591KiB/s (1629kB/s)(12.0MiB/7722msec) clat (msec): min=853, max=3957, avg=2457.99, stdev=1554.58 lat (msec): min=853, max=3957, avg=2458.00, stdev=1554.58 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 2567], 50.00th=[ 2567], 60.00th=[ 2567], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.14%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145061: Fri Sep 11 05:56:56 2026 read: IOPS=0, BW=483KiB/s (494kB/s)(4096KiB/8482msec) clat (nsec): min=4039.7M, max=4039.7M, avg=4039685520.00, stdev= 0.00 lat (nsec): min=4039.7M, max=4039.7M, avg=4039688294.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4044], 5.00th=[ 4044], 10.00th=[ 4044], 20.00th=[ 4044], | 30.00th=[ 4044], 40.00th=[ 4044], 50.00th=[ 4044], 60.00th=[ 4044], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=966KiB/s (989kB/s)(8192KiB/8482msec); 0 zone resets clat (msec): min=1732, max=2200, avg=1966.60, stdev=330.85 lat (msec): min=1733, max=2201, avg=1967.20, stdev=331.13 clat percentiles (msec): | 1.00th=[ 1737], 5.00th=[ 1737], 10.00th=[ 1737], 20.00th=[ 1737], | 30.00th=[ 1737], 40.00th=[ 1737], 50.00th=[ 1737], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.11%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145062: Fri Sep 11 05:56:56 2026 write: IOPS=0, BW=1444KiB/s (1479kB/s)(12.0MiB/8508msec); 0 zone resets clat (msec): min=473, max=4894, avg=2785.00, stdev=2217.48 lat (msec): min=473, max=4894, avg=2785.52, stdev=2217.44 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 3004], 50.00th=[ 3004], 60.00th=[ 3004], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.40%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145063: Fri Sep 11 05:56:56 2026 write: IOPS=0, BW=1968KiB/s (2016kB/s)(12.0MiB/6243msec); 0 zone resets clat (msec): min=689, max=3440, avg=1945.99, stdev=1391.14 lat (msec): min=692, max=3441, avg=1947.59, stdev=1389.73 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 7613, max= 8110, per=100.00%, avg=7861.50, stdev=351.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=2.52%, ctx=92, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1932KiB/s (1978kB/s), 483KiB/s-1591KiB/s (494kB/s-1629kB/s), io=16.0MiB (16.8MB), run=7722-8482msec WRITE: bw=3851KiB/s (3944kB/s), 966KiB/s-1968KiB/s (989kB/s-2016kB/s), io=32.0MiB (33.6MB), run=6243-8508msec