== sanity test 398b: DIO and buffer IO race ============== 05:29:46 (1789291786) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.34987 s, 9.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145611: Sun Sep 13 05:31:54 2026 read: IOPS=14, BW=56.3KiB/s (57.7kB/s)(5992KiB/106428msec) clat (usec): min=29, max=708936, avg=33634.23, stdev=31644.96 lat (usec): min=29, max=708937, avg=33635.52, stdev=31644.93 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 67], 20.00th=[ 15401], | 30.00th=[ 20055], 40.00th=[ 24249], 50.00th=[ 28705], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 49546], 90.00th=[ 63177], 95.00th=[ 78119], | 99.00th=[126354], 99.50th=[149947], 99.90th=[346031], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 123, per=26.09%, avg=56.10, stdev=21.84, samples=209 iops : min= 1, max= 30, avg=13.41, stdev= 5.49, samples=209 write: IOPS=14, BW=59.2KiB/s (60.6kB/s)(6296KiB/106428msec); 0 zone resets clat (usec): min=759, max=328986, avg=35519.18, stdev=36503.52 lat (usec): min=760, max=328987, avg=35524.12, stdev=36504.05 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3228], | 30.00th=[ 7373], 40.00th=[ 17171], 50.00th=[ 27395], 60.00th=[ 36439], | 70.00th=[ 46924], 80.00th=[ 61080], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[149947], 99.50th=[181404], 99.90th=[316670], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 111, per=26.19%, avg=58.92, stdev=20.00, samples=209 iops : min= 1, max= 27, avg=14.12, stdev= 5.04, samples=209 lat (usec) : 50=0.88%, 100=4.88%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=7.55%, 4=3.65%, 10=6.15%, 20=12.63%, 50=40.07% lat (msec) : 100=19.56%, 250=3.84%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=5.21%, ctx=6197, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145612: Sun Sep 13 05:31:54 2026 read: IOPS=13, BW=53.7KiB/s (54.0kB/s)(5940KiB/110661msec) clat (usec): min=34, max=697657, avg=34914.04, stdev=31121.96 lat (usec): min=34, max=697659, avg=34915.65, stdev=31121.63 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 16057], | 30.00th=[ 20579], 40.00th=[ 25035], 50.00th=[ 29492], 60.00th=[ 35390], | 70.00th=[ 43254], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 79168], | 99.00th=[107480], 99.50th=[130548], 99.90th=[274727], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 8, max= 118, per=25.08%, avg=53.92, stdev=21.17, samples=215 iops : min= 2, max= 29, avg=12.87, stdev= 5.33, samples=215 write: IOPS=14, BW=57.4KiB/s (58.7kB/s)(6348KiB/110661msec); 0 zone resets clat (usec): min=555, max=364221, avg=36990.81, stdev=40088.60 lat (usec): min=555, max=364222, avg=36992.27, stdev=40088.62 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1139], 10.00th=[ 1221], 20.00th=[ 3032], | 30.00th=[ 6194], 40.00th=[ 15008], 50.00th=[ 25822], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 64750], 90.00th=[ 91751], 95.00th=[111674], | 99.00th=[173016], 99.50th=[200279], 99.90th=[325059], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 8, max= 115, per=25.32%, avg=56.96, stdev=21.95, samples=217 iops : min= 2, max= 28, avg=13.63, stdev= 5.52, samples=217 lat (usec) : 50=1.24%, 100=4.43%, 250=0.16%, 500=0.10%, 750=0.16% lat (usec) : 1000=0.55% lat (msec) : 2=7.85%, 4=3.97%, 10=6.48%, 20=11.91%, 50=36.52% lat (msec) : 100=22.10%, 250=4.30%, 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=5.02%, ctx=6141, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145613: Sun Sep 13 05:31:54 2026 read: IOPS=13, BW=54.6KiB/s (55.0kB/s)(6028KiB/110315msec) clat (usec): min=26, max=161795, avg=33229.39, stdev=25023.01 lat (usec): min=27, max=161796, avg=33239.43, stdev=25024.15 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 14222], | 30.00th=[ 20055], 40.00th=[ 23987], 50.00th=[ 29230], 60.00th=[ 34866], | 70.00th=[ 41681], 80.00th=[ 51119], 90.00th=[ 65274], 95.00th=[ 79168], | 99.00th=[114820], 99.50th=[121111], 99.90th=[152044], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 7, max= 112, per=25.56%, avg=54.94, stdev=21.80, samples=215 iops : min= 1, max= 28, avg=13.12, stdev= 5.51, samples=215 write: IOPS=14, BW=56.7KiB/s (58.1kB/s)(6260KiB/110315msec); 0 zone resets clat (usec): min=623, max=830306, avg=38396.84, stdev=45720.92 lat (usec): min=623, max=830307, avg=38398.62, stdev=45721.24 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 3195], | 30.00th=[ 8094], 40.00th=[ 19268], 50.00th=[ 28443], 60.00th=[ 38536], | 70.00th=[ 49546], 80.00th=[ 64750], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[177210], 99.50th=[219153], 99.90th=[616563], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 116, per=25.13%, avg=56.53, stdev=20.28, samples=217 iops : min= 1, max= 29, avg=13.53, stdev= 5.10, samples=217 lat (usec) : 50=1.37%, 100=5.27%, 250=0.20%, 500=0.10%, 750=0.20% lat (usec) : 1000=0.39% lat (msec) : 2=7.42%, 4=2.99%, 10=6.58%, 20=11.10%, 50=38.87% lat (msec) : 100=21.32%, 250=4.07%, 500=0.07%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.24%, ctx=6195, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145614: Sun Sep 13 05:31:54 2026 read: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6052KiB/111447msec) clat (usec): min=30, max=351895, avg=35200.31, stdev=30007.90 lat (usec): min=31, max=351896, avg=35203.30, stdev=30007.76 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 14746], | 30.00th=[ 20055], 40.00th=[ 24773], 50.00th=[ 29754], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 54264], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[130548], 99.50th=[183501], 99.90th=[312476], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 118, per=25.28%, avg=54.35, stdev=20.17, samples=218 iops : min= 1, max= 29, avg=12.96, stdev= 5.07, samples=218 write: IOPS=13, BW=55.0KiB/s (57.3kB/s)(6236KiB/111447msec); 0 zone resets clat (usec): min=729, max=896944, avg=37249.68, stdev=43019.76 lat (usec): min=730, max=896948, avg=37252.23, stdev=43019.07 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 3425], | 30.00th=[ 8225], 40.00th=[ 19268], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 48497], 80.00th=[ 62653], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[170918], 99.50th=[193987], 99.90th=[337642], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 104, per=24.73%, avg=55.63, stdev=20.10, samples=219 iops : min= 1, max= 26, avg=13.29, stdev= 5.04, samples=219 lat (usec) : 50=1.40%, 100=5.27%, 250=0.16%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=7.13%, 4=3.65%, 10=6.18%, 20=11.30%, 50=38.18% lat (msec) : 100=22.49%, 250=3.65%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=5.14%, ctx=6312, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=215KiB/s (221kB/s), 53.7KiB/s-56.3KiB/s (54.0kB/s-57.7kB/s), io=23.4MiB (24.6MB), run=106428-111447msec WRITE: bw=226KiB/s (231kB/s), 55.0KiB/s-59.2KiB/s (57.3kB/s-60.6kB/s), io=24.6MiB (25.7MB), run=106428-111447msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145606: Sun Sep 13 05:34:06 2026 read: IOPS=6, BW=24.7KiB/s (25.3kB/s)(5992KiB/242659msec) clat (msec): min=4, max=789, avg=30.01, stdev=33.35 lat (msec): min=4, max=789, avg=30.01, stdev=33.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 41], 90.00th=[ 64], 95.00th=[ 84], | 99.00th=[ 142], 99.50th=[ 171], 99.90th=[ 226], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 104, per=27.27%, avg=26.73, stdev=18.46, samples=434 iops : min= 1, max= 26, avg= 6.05, stdev= 4.65, samples=434 write: IOPS=6, BW=25.9KiB/s (26.6kB/s)(6296KiB/242659msec); 0 zone resets clat (msec): min=30, max=619, avg=125.37, stdev=58.63 lat (msec): min=30, max=619, avg=125.37, stdev=58.63 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 232], | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 468], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 72, per=24.81%, avg=25.55, stdev=11.32, samples=476 iops : min= 1, max= 18, avg= 5.75, stdev= 2.89, samples=476 lat (msec) : 10=5.34%, 20=18.52%, 50=18.98%, 100=24.74%, 250=30.66% lat (msec) : 500=1.69%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.12%, ctx=4971, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145607: Sun Sep 13 05:34:06 2026 read: IOPS=6, BW=24.4KiB/s (25.0kB/s)(5940KiB/243099msec) clat (msec): min=4, max=798, avg=31.58, stdev=39.82 lat (msec): min=4, max=798, avg=31.59, stdev=39.82 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 66], 95.00th=[ 87], | 99.00th=[ 150], 99.50th=[ 192], 99.90th=[ 684], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 95, per=27.75%, avg=27.19, stdev=17.95, samples=421 iops : min= 1, max= 23, avg= 6.17, stdev= 4.53, samples=421 write: IOPS=6, BW=26.1KiB/s (26.7kB/s)(6348KiB/243099msec); 0 zone resets clat (msec): min=19, max=479, avg=123.37, stdev=56.38 lat (msec): min=19, max=479, avg=123.38, stdev=56.38 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 110], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 201], 95.00th=[ 228], | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 405], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 56, per=24.92%, avg=25.67, stdev=11.54, samples=475 iops : min= 1, max= 14, avg= 5.78, stdev= 2.94, samples=475 lat (msec) : 10=5.89%, 20=18.03%, 50=18.07%, 100=26.60%, 250=29.59% lat (msec) : 500=1.76%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=4975, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145608: Sun Sep 13 05:34:06 2026 read: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6028KiB/242738msec) clat (msec): min=5, max=684, avg=31.40, stdev=32.46 lat (msec): min=5, max=684, avg=31.40, stdev=32.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 69], 95.00th=[ 87], | 99.00th=[ 130], 99.50th=[ 161], 99.90th=[ 284], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 112, per=27.09%, avg=26.55, stdev=18.42, samples=439 iops : min= 1, max= 28, avg= 6.00, stdev= 4.64, samples=439 write: IOPS=6, BW=25.8KiB/s (26.4kB/s)(6260KiB/242738msec); 0 zone resets clat (msec): min=34, max=890, avg=124.63, stdev=59.24 lat (msec): min=34, max=890, avg=124.63, stdev=59.24 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 99], 50.00th=[ 113], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 228], | 99.00th=[ 309], 99.50th=[ 330], 99.90th=[ 472], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 56, per=24.67%, avg=25.41, stdev=11.25, samples=476 iops : min= 1, max= 14, avg= 5.71, stdev= 2.86, samples=476 lat (msec) : 10=5.70%, 20=18.07%, 50=18.10%, 100=26.82%, 250=29.72% lat (msec) : 500=1.53%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5097, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145609: Sun Sep 13 05:34:06 2026 read: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6052KiB/241794msec) clat (msec): min=5, max=459, avg=30.90, stdev=33.01 lat (msec): min=5, max=459, avg=30.90, stdev=33.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 67], 95.00th=[ 86], | 99.00th=[ 153], 99.50th=[ 215], 99.90th=[ 368], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 96, per=27.42%, avg=26.88, stdev=18.98, samples=436 iops : min= 1, max= 24, avg= 6.08, stdev= 4.79, samples=436 write: IOPS=6, BW=25.8KiB/s (26.4kB/s)(6236KiB/241794msec); 0 zone resets clat (msec): min=35, max=988, avg=124.85, stdev=58.85 lat (msec): min=35, max=988, avg=124.85, stdev=58.85 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 199], 95.00th=[ 226], | 99.00th=[ 292], 99.50th=[ 347], 99.90th=[ 468], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 63, per=24.54%, avg=25.28, stdev=11.07, samples=476 iops : min= 1, max= 15, avg= 5.68, stdev= 2.82, samples=476 lat (msec) : 10=5.96%, 20=18.91%, 50=17.42%, 100=25.20%, 250=31.05% lat (msec) : 500=1.43%, 1000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5001, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=98.8KiB/s (101kB/s), 24.4KiB/s-25.0KiB/s (25.0kB/s-25.6kB/s), io=23.4MiB (24.6MB), run=241794-243099msec WRITE: bw=103KiB/s (106kB/s), 25.8KiB/s-26.1KiB/s (26.4kB/s-26.7kB/s), io=24.6MiB (25.7MB), run=241794-243099msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145661: Sun Sep 13 05:34:44 2026 read: IOPS=14, BW=230KiB/s (236kB/s)(5920KiB/25715msec) clat (usec): min=34, max=208841, avg=35563.06, stdev=31366.48 lat (usec): min=34, max=208842, avg=35564.17, stdev=31366.50 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 72], | 30.00th=[ 17433], 40.00th=[ 25297], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 46924], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 92799], | 99.00th=[130548], 99.50th=[156238], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 63, max= 544, per=25.57%, avg=227.58, stdev=107.30, samples=50 iops : min= 3, max= 34, avg=13.50, stdev= 6.82, samples=50 write: IOPS=15, BW=248KiB/s (254kB/s)(6368KiB/25715msec); 0 zone resets clat (usec): min=898, max=294089, avg=31331.23, stdev=35960.54 lat (usec): min=900, max=294091, avg=31333.33, stdev=35960.59 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1696], 10.00th=[ 2147], 20.00th=[ 4080], | 30.00th=[ 7046], 40.00th=[ 11076], 50.00th=[ 17695], 60.00th=[ 25297], | 70.00th=[ 39584], 80.00th=[ 55313], 90.00th=[ 77071], 95.00th=[104334], | 99.00th=[149947], 99.50th=[185598], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 63, max= 528, per=26.35%, avg=246.62, stdev=101.00, samples=50 iops : min= 3, max= 33, avg=14.72, stdev= 6.39, samples=50 lat (usec) : 50=1.56%, 100=9.11%, 250=0.39%, 750=0.26%, 1000=0.39% lat (msec) : 2=4.17%, 4=6.38%, 10=9.77%, 20=11.85%, 50=31.51% lat (msec) : 100=19.53%, 250=4.95%, 500=0.13% cpu : usr=0.06%, sys=5.32%, ctx=1317, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145662: Sun Sep 13 05:34:44 2026 read: IOPS=13, BW=213KiB/s (219kB/s)(5744KiB/26909msec) clat (usec): min=25, max=265973, avg=34620.83, stdev=32593.69 lat (usec): min=25, max=265974, avg=34622.06, stdev=32593.71 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 70], | 30.00th=[ 17171], 40.00th=[ 25560], 50.00th=[ 31065], 60.00th=[ 38011], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[170918], 99.50th=[183501], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 24, max= 478, per=25.22%, avg=224.48, stdev=100.15, samples=50 iops : min= 1, max= 29, avg=13.28, stdev= 6.27, samples=50 write: IOPS=15, BW=243KiB/s (249kB/s)(6544KiB/26909msec); 0 zone resets clat (usec): min=985, max=370846, avg=34764.96, stdev=46827.20 lat (usec): min=986, max=370848, avg=34767.19, stdev=46827.12 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1582], 10.00th=[ 1762], 20.00th=[ 3326], | 30.00th=[ 5997], 40.00th=[ 9896], 50.00th=[ 19268], 60.00th=[ 28443], | 70.00th=[ 40109], 80.00th=[ 57934], 90.00th=[ 90702], 95.00th=[110625], | 99.00th=[233833], 99.50th=[299893], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 24, max= 474, per=26.26%, avg=245.77, stdev=101.43, samples=52 iops : min= 1, max= 29, avg=14.65, stdev= 6.43, samples=52 lat (usec) : 50=2.08%, 100=9.51%, 250=0.52%, 500=0.26%, 1000=0.26% lat (msec) : 2=6.90%, 4=4.82%, 10=9.64%, 20=8.33%, 50=32.29% lat (msec) : 100=20.05%, 250=4.69%, 500=0.65% cpu : usr=0.08%, sys=5.01%, ctx=1304, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145664: Sun Sep 13 05:34:44 2026 read: IOPS=14, BW=239KiB/s (245kB/s)(6256KiB/26186msec) clat (usec): min=25, max=160651, avg=35388.18, stdev=29931.09 lat (usec): min=25, max=160652, avg=35389.64, stdev=29931.16 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 59], 20.00th=[ 67], | 30.00th=[ 19006], 40.00th=[ 25560], 50.00th=[ 32637], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[121111], 99.50th=[125305], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 96, max= 606, per=27.76%, avg=247.02, stdev=88.85, samples=50 iops : min= 6, max= 37, avg=14.72, stdev= 5.53, samples=50 write: IOPS=14, BW=230KiB/s (236kB/s)(6032KiB/26186msec); 0 zone resets clat (usec): min=1036, max=204127, avg=31398.72, stdev=32422.92 lat (usec): min=1039, max=204128, avg=31400.74, stdev=32423.03 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1680], 10.00th=[ 1827], 20.00th=[ 3949], | 30.00th=[ 6980], 40.00th=[ 11863], 50.00th=[ 21365], 60.00th=[ 30016], | 70.00th=[ 42730], 80.00th=[ 57410], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[147850], 99.50th=[168821], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 23, max= 528, per=24.51%, avg=229.41, stdev=108.76, samples=51 iops : min= 1, max= 33, avg=13.63, stdev= 6.94, samples=51 lat (usec) : 50=2.47%, 100=10.42%, 250=0.26% lat (msec) : 2=5.99%, 4=4.30%, 10=7.29%, 20=9.24%, 50=33.72% lat (msec) : 100=22.79%, 250=3.52% cpu : usr=0.07%, sys=5.68%, ctx=1322, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145665: Sun Sep 13 05:34:44 2026 read: IOPS=14, BW=237KiB/s (243kB/s)(6032KiB/25438msec) clat (usec): min=37, max=169031, avg=34441.19, stdev=30164.24 lat (usec): min=38, max=169032, avg=34442.38, stdev=30164.25 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 70], | 30.00th=[ 19530], 40.00th=[ 25035], 50.00th=[ 31851], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[127402], 99.50th=[149947], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 63, max= 413, per=26.51%, avg=235.90, stdev=86.35, samples=50 iops : min= 3, max= 25, avg=14.02, stdev= 5.46, samples=50 write: IOPS=15, BW=246KiB/s (252kB/s)(6256KiB/25438msec); 0 zone resets clat (usec): min=1004, max=266666, avg=31021.48, stdev=37568.52 lat (usec): min=1005, max=266667, avg=31057.56, stdev=37549.15 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1565], 10.00th=[ 1713], 20.00th=[ 3097], | 30.00th=[ 5342], 40.00th=[ 8848], 50.00th=[ 16450], 60.00th=[ 24511], | 70.00th=[ 40633], 80.00th=[ 55313], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[179307], 99.50th=[208667], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 542, per=26.41%, avg=247.20, stdev=112.63, samples=50 iops : min= 1, max= 33, avg=14.74, stdev= 7.10, samples=50 lat (usec) : 50=1.82%, 100=10.16%, 250=0.13%, 500=0.13% lat (msec) : 2=8.20%, 4=4.69%, 10=8.72%, 20=9.51%, 50=33.07% lat (msec) : 100=19.53%, 250=3.91%, 500=0.13% cpu : usr=0.04%, sys=5.61%, ctx=1304, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=890KiB/s (911kB/s), 213KiB/s-239KiB/s (219kB/s-245kB/s), io=23.4MiB (24.5MB), run=25438-26909msec WRITE: bw=936KiB/s (959kB/s), 230KiB/s-248KiB/s (236kB/s-254kB/s), io=24.6MiB (25.8MB), run=25438-26909msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145666: Sun Sep 13 05:35:23 2026 read: IOPS=5, BW=90.3KiB/s (92.4kB/s)(5920KiB/65591msec) clat (msec): min=6, max=329, avg=35.30, stdev=33.23 lat (msec): min=6, max=329, avg=35.30, stdev=33.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 62], 95.00th=[ 95], | 99.00th=[ 169], 99.50th=[ 249], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 320, per=27.17%, avg=98.91, stdev=65.74, samples=117 iops : min= 1, max= 20, avg= 5.40, stdev= 4.21, samples=117 write: IOPS=6, BW=97.1KiB/s (99.4kB/s)(6368KiB/65591msec); 0 zone resets clat (msec): min=34, max=471, avg=130.97, stdev=63.54 lat (msec): min=34, max=471, avg=130.97, stdev=63.54 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 63], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 220], 95.00th=[ 259], | 99.00th=[ 342], 99.50th=[ 439], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 29, max= 192, per=25.45%, avg=97.49, stdev=39.82, samples=128 iops : min= 1, max= 12, avg= 5.30, stdev= 2.57, samples=128 lat (msec) : 10=1.95%, 20=15.76%, 50=23.05%, 100=23.18%, 250=33.20% lat (msec) : 500=2.86% cpu : usr=0.04%, sys=1.26%, ctx=1302, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145667: Sun Sep 13 05:35:23 2026 read: IOPS=5, BW=87.4KiB/s (89.5kB/s)(5744KiB/65695msec) clat (msec): min=6, max=303, avg=36.38, stdev=36.07 lat (msec): min=6, max=303, avg=36.38, stdev=36.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 67], 95.00th=[ 107], | 99.00th=[ 180], 99.50th=[ 275], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 28, max= 382, per=27.66%, avg=100.68, stdev=66.84, samples=111 iops : min= 1, max= 23, avg= 5.51, stdev= 4.24, samples=111 write: IOPS=6, BW=99.6KiB/s (102kB/s)(6544KiB/65695msec); 0 zone resets clat (msec): min=46, max=515, avg=128.40, stdev=61.69 lat (msec): min=46, max=515, avg=128.40, stdev=61.70 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 82], | 30.00th=[ 90], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 142], 80.00th=[ 169], 90.00th=[ 207], 95.00th=[ 262], | 99.00th=[ 321], 99.50th=[ 372], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 28, max= 192, per=25.94%, avg=99.37, stdev=40.75, samples=128 iops : min= 1, max= 12, avg= 5.43, stdev= 2.60, samples=128 lat (msec) : 10=1.56%, 20=14.97%, 50=22.53%, 100=26.82%, 250=30.60% lat (msec) : 500=3.39%, 750=0.13% cpu : usr=0.05%, sys=1.18%, ctx=1221, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145668: Sun Sep 13 05:35:23 2026 read: IOPS=6, BW=99.4KiB/s (102kB/s)(6256KiB/62915msec) clat (msec): min=7, max=272, avg=34.06, stdev=32.61 lat (msec): min=7, max=272, avg=34.06, stdev=32.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 64], 95.00th=[ 94], | 99.00th=[ 178], 99.50th=[ 249], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 445, per=30.32%, avg=110.38, stdev=78.62, samples=112 iops : min= 1, max= 27, avg= 6.12, stdev= 4.96, samples=112 write: IOPS=5, BW=95.9KiB/s (98.2kB/s)(6032KiB/62915msec); 0 zone resets clat (msec): min=37, max=424, avg=130.50, stdev=63.11 lat (msec): min=37, max=424, avg=130.50, stdev=63.11 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 94], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 215], 95.00th=[ 284], | 99.00th=[ 321], 99.50th=[ 338], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 28, max= 220, per=25.05%, avg=95.96, stdev=40.40, samples=123 iops : min= 1, max= 13, avg= 5.20, stdev= 2.60, samples=123 lat (msec) : 10=2.73%, 20=17.97%, 50=22.92%, 100=24.35%, 250=28.52% lat (msec) : 500=3.52% cpu : usr=0.04%, sys=1.25%, ctx=1371, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145669: Sun Sep 13 05:35:23 2026 read: IOPS=5, BW=91.0KiB/s (94.2kB/s)(6032KiB/65592msec) clat (msec): min=6, max=316, avg=35.37, stdev=34.93 lat (msec): min=6, max=316, avg=35.37, stdev=34.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 70], 95.00th=[ 100], | 99.00th=[ 190], 99.50th=[ 243], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 319, per=28.76%, avg=104.68, stdev=66.51, samples=112 iops : min= 1, max= 19, avg= 5.76, stdev= 4.19, samples=112 write: IOPS=5, BW=95.4KiB/s (97.7kB/s)(6256KiB/65592msec); 0 zone resets clat (msec): min=43, max=520, avg=132.51, stdev=62.10 lat (msec): min=43, max=520, avg=132.51, stdev=62.10 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 213], 95.00th=[ 257], | 99.00th=[ 334], 99.50th=[ 481], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 29, max= 160, per=25.40%, avg=97.28, stdev=36.43, samples=126 iops : min= 1, max= 10, avg= 5.29, stdev= 2.37, samples=126 lat (msec) : 10=1.82%, 20=17.71%, 50=21.22%, 100=23.44%, 250=32.94% lat (msec) : 500=2.73%, 750=0.13% cpu : usr=0.04%, sys=1.17%, ctx=1299, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=365KiB/s (373kB/s), 87.4KiB/s-99.4KiB/s (89.5kB/s-102kB/s), io=23.4MiB (24.5MB), run=62915-65695msec WRITE: bw=384KiB/s (393kB/s), 95.4KiB/s-99.6KiB/s (97.7kB/s-102kB/s), io=24.6MiB (25.8MB), run=62915-65695msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145690: Sun Sep 13 05:35:39 2026 read: IOPS=2, BW=2543KiB/s (2604kB/s)(7168KiB/2819msec) clat (msec): min=67, max=316, avg=134.34, stdev=85.00 lat (msec): min=67, max=316, avg=134.34, stdev=85.00 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 71], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 113], 60.00th=[ 116], | 70.00th=[ 116], 80.00th=[ 150], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2015, max= 7252, per=100.00%, avg=4633.50, stdev=3703.12, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1816KiB/s (1860kB/s)(5120KiB/2819msec); 0 zone resets clat (msec): min=157, max=621, avg=367.08, stdev=172.75 lat (msec): min=157, max=621, avg=367.15, stdev=172.75 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1450, max= 2031, per=45.06%, avg=1887.40, stdev=246.17, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=4.15%, ctx=46, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145691: Sun Sep 13 05:35:39 2026 read: IOPS=0, BW=307KiB/s (314kB/s)(2048KiB/6672msec) clat (msec): min=64, max=409, avg=237.15, stdev=243.86 lat (msec): min=64, max=409, avg=237.15, stdev=243.86 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 65], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1432, max= 1957, per=56.63%, avg=1694.50, stdev=371.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1535KiB/s (1572kB/s)(10.0MiB/6672msec); 0 zone resets clat (msec): min=147, max=2240, avg=601.81, stdev=636.56 lat (msec): min=147, max=2240, avg=601.89, stdev=636.56 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 197], | 30.00th=[ 201], 40.00th=[ 271], 50.00th=[ 338], 60.00th=[ 376], | 70.00th=[ 485], 80.00th=[ 776], 90.00th=[ 995], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 2015, max= 4071, per=71.79%, avg=3007.20, stdev=1027.13, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.11%, ctx=80, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145692: Sun Sep 13 05:35:39 2026 read: IOPS=1, BW=1053KiB/s (1078kB/s)(6144KiB/5837msec) clat (msec): min=116, max=558, avg=278.93, stdev=189.03 lat (msec): min=116, max=558, avg=278.94, stdev=189.03 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 192], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1957, max= 3968, per=83.51%, avg=2498.75, stdev=980.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1053KiB/s (1078kB/s)(6144KiB/5837msec); 0 zone resets clat (msec): min=150, max=1980, avg=670.58, stdev=681.08 lat (msec): min=150, max=1980, avg=670.75, stdev=681.08 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 535], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 2003, max= 3047, per=53.14%, avg=2226.20, stdev=459.02, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.09%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145693: Sun Sep 13 05:35:39 2026 read: IOPS=0, BW=748KiB/s (766kB/s)(5120KiB/6843msec) clat (msec): min=92, max=2821, avg=828.52, stdev=1137.44 lat (msec): min=92, max=2821, avg=828.53, stdev=1137.44 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1957, max= 4007, per=89.12%, avg=2666.33, stdev=1161.71, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1047KiB/s (1073kB/s)(7168KiB/6843msec); 0 zone resets clat (msec): min=213, max=734, avg=367.44, stdev=182.71 lat (msec): min=213, max=734, avg=367.70, stdev=182.55 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 236], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 347], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 451], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1984, max= 4087, per=62.41%, avg=2614.20, stdev=917.34, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=1.94%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2993KiB/s (3065kB/s), 307KiB/s-2543KiB/s (314kB/s-2604kB/s), io=20.0MiB (20.0MB), run=2819-6843msec WRITE: bw=4190KiB/s (4291kB/s), 1047KiB/s-1816KiB/s (1073kB/s-1860kB/s), io=28.0MiB (29.4MB), run=2819-6843msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145695: Sun Sep 13 05:35:39 2026 read: IOPS=1, BW=1350KiB/s (1382kB/s)(7168KiB/5310msec) clat (usec): min=497, max=2668.9k, avg=571441.79, stdev=984001.12 lat (usec): min=498, max=2668.9k, avg=571443.17, stdev=984001.10 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], | 20.00th=[ 529], 30.00th=[ 1057], 40.00th=[ 1057], | 50.00th=[ 179307], 60.00th=[ 200279], 70.00th=[ 200279], | 80.00th=[ 952108], 90.00th=[2667578], 95.00th=[2667578], | 99.00th=[2667578], 99.50th=[2667578], 99.90th=[2667578], | 99.95th=[2667578], 99.99th=[2667578] bw ( KiB/s): min= 2015, max= 4015, per=81.36%, avg=2738.50, stdev=939.61, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=0, BW=964KiB/s (987kB/s)(5120KiB/5310msec); 0 zone resets clat (msec): min=85, max=604, avg=261.62, stdev=211.21 lat (msec): min=85, max=604, avg=261.69, stdev=211.21 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2015, max= 4047, per=57.36%, avg=2703.33, stdev=1163.77, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=8.33%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.63%, ctx=328, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145696: Sun Sep 13 05:35:39 2026 read: IOPS=0, BW=337KiB/s (345kB/s)(2048KiB/6083msec) clat (usec): min=490, max=262981, avg=131736.18, stdev=185608.79 lat (usec): min=492, max=262984, avg=131738.20, stdev=185609.79 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 490], 40.00th=[ 490], 50.00th=[ 490], 60.00th=[263193], | 70.00th=[263193], 80.00th=[263193], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 1412, max= 2043, per=51.32%, avg=1727.50, stdev=446.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1683KiB/s (1724kB/s)(10.0MiB/6083msec); 0 zone resets clat (msec): min=79, max=2873, avg=581.39, stdev=829.35 lat (msec): min=79, max=2873, avg=581.49, stdev=829.32 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 104], | 30.00th=[ 176], 40.00th=[ 239], 50.00th=[ 292], 60.00th=[ 326], | 70.00th=[ 464], 80.00th=[ 592], 90.00th=[ 676], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1992, max= 6131, per=67.98%, avg=3203.80, stdev=1817.57, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.97%, ctx=132, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145697: Sun Sep 13 05:35:39 2026 read: IOPS=1, BW=1154KiB/s (1182kB/s)(6144KiB/5324msec) clat (usec): min=509, max=369585, avg=143787.12, stdev=162945.18 lat (usec): min=510, max=369586, avg=143788.45, stdev=162945.08 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 775], | 30.00th=[ 775], 40.00th=[ 1565], 50.00th=[ 1565], 60.00th=[242222], | 70.00th=[248513], 80.00th=[248513], 90.00th=[371196], 95.00th=[371196], | 99.00th=[371196], 99.50th=[371196], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 2015, max= 4087, per=100.00%, avg=3383.00, stdev=1184.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1154KiB/s (1182kB/s)(6144KiB/5324msec); 0 zone resets clat (msec): min=127, max=2473, avg=741.77, stdev=950.00 lat (msec): min=127, max=2473, avg=741.86, stdev=949.98 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 249], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 2023, max= 4031, per=58.44%, avg=2754.50, stdev=949.66, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=6.59%, ctx=196, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145698: Sun Sep 13 05:35:39 2026 read: IOPS=1, BW=1114KiB/s (1141kB/s)(5120KiB/4595msec) clat (usec): min=451, max=1983.3k, avg=524111.12, stdev=821163.58 lat (usec): min=452, max=1983.3k, avg=524112.78, stdev=821163.54 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], | 20.00th=[ 453], 30.00th=[ 175113], 40.00th=[ 175113], | 50.00th=[ 227541], 60.00th=[ 227541], 70.00th=[ 231736], | 80.00th=[ 231736], 90.00th=[1988101], 95.00th=[1988101], | 99.00th=[1988101], 99.50th=[1988101], 99.90th=[1988101], | 99.95th=[1988101], 99.99th=[1988101] bw ( KiB/s): min= 2039, max= 4015, per=80.18%, avg=2699.00, stdev=1139.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1560KiB/s (1597kB/s)(7168KiB/4595msec); 0 zone resets clat (msec): min=153, max=567, avg=280.54, stdev=137.96 lat (msec): min=153, max=567, avg=280.63, stdev=137.95 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 259], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 313], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1428, max= 3984, per=50.17%, avg=2364.50, stdev=1115.58, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.04%, sys=9.80%, ctx=457, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3367KiB/s (3448kB/s), 337KiB/s-1350KiB/s (345kB/s-1382kB/s), io=20.0MiB (20.0MB), run=4595-6083msec WRITE: bw=4713KiB/s (4827kB/s), 964KiB/s-1683KiB/s (987kB/s-1724kB/s), io=28.0MiB (29.4MB), run=4595-6083msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145709: Sun Sep 13 05:35:55 2026 read: IOPS=0, BW=2783KiB/s (2849kB/s)(12.0MiB/4416msec) clat (msec): min=434, max=3116, avg=1471.29, stdev=1440.53 lat (msec): min=434, max=3116, avg=1471.29, stdev=1440.53 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.81%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145710: Sun Sep 13 05:35:55 2026 read: IOPS=0, BW=821KiB/s (840kB/s)(4096KiB/4991msec) clat (nsec): min=3299.3M, max=3299.3M, avg=3299346969.00, stdev= 0.00 lat (nsec): min=3299.3M, max=3299.3M, avg=3299349889.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3306], 5.00th=[ 3306], 10.00th=[ 3306], 20.00th=[ 3306], | 30.00th=[ 3306], 40.00th=[ 3306], 50.00th=[ 3306], 60.00th=[ 3306], | 70.00th=[ 3306], 80.00th=[ 3306], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1641KiB/s (1681kB/s)(8192KiB/4991msec); 0 zone resets clat (msec): min=464, max=1179, avg=821.80, stdev=505.59 lat (msec): min=464, max=1180, avg=822.35, stdev=505.86 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.42%, ctx=41, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145711: Sun Sep 13 05:35:55 2026 write: IOPS=0, BW=2458KiB/s (2517kB/s)(12.0MiB/5000msec); 0 zone resets clat (msec): min=300, max=3662, avg=1646.09, stdev=1778.27 lat (msec): min=300, max=3662, avg=1647.44, stdev=1777.67 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.60%, ctx=39, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145712: Sun Sep 13 05:35:55 2026 write: IOPS=0, BW=2585KiB/s (2647kB/s)(12.0MiB/4754msec); 0 zone resets clat (msec): min=329, max=3385, avg=1583.53, stdev=1600.20 lat (msec): min=330, max=3386, avg=1583.90, stdev=1600.10 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 6918, max= 8175, per=100.00%, avg=7546.50, stdev=888.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.86%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3283KiB/s (3361kB/s), 821KiB/s-2783KiB/s (840kB/s-2849kB/s), io=16.0MiB (16.8MB), run=4416-4991msec WRITE: bw=6554KiB/s (6711kB/s), 1641KiB/s-2585KiB/s (1681kB/s-2647kB/s), io=32.0MiB (33.6MB), run=4754-5000msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145705: Sun Sep 13 05:35:55 2026 read: IOPS=0, BW=2502KiB/s (2562kB/s)(12.0MiB/4912msec) clat (msec): min=887, max=3034, avg=1603.88, stdev=1238.99 lat (msec): min=887, max=3034, avg=1603.88, stdev=1238.99 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.15%, ctx=244, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145706: Sun Sep 13 05:35:55 2026 read: IOPS=0, BW=824KiB/s (844kB/s)(4096KiB/4972msec) clat (nsec): min=3198.6M, max=3198.6M, avg=3198611899.00, stdev= 0.00 lat (nsec): min=3198.6M, max=3198.6M, avg=3198614269.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3205], 5.00th=[ 3205], 10.00th=[ 3205], 20.00th=[ 3205], | 30.00th=[ 3205], 40.00th=[ 3205], 50.00th=[ 3205], 60.00th=[ 3205], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1648KiB/s (1687kB/s)(8192KiB/4972msec); 0 zone resets clat (msec): min=633, max=925, avg=779.41, stdev=206.30 lat (msec): min=634, max=925, avg=779.96, stdev=205.87 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.95%, ctx=602, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145707: Sun Sep 13 05:35:55 2026 write: IOPS=0, BW=2054KiB/s (2103kB/s)(12.0MiB/5982msec); 0 zone resets clat (msec): min=245, max=4855, avg=1946.03, stdev=2531.58 lat (msec): min=246, max=4855, avg=1946.38, stdev=2531.54 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.41%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145708: Sun Sep 13 05:35:55 2026 write: IOPS=0, BW=2648KiB/s (2711kB/s)(12.0MiB/4641msec); 0 zone resets clat (msec): min=467, max=2701, avg=1492.36, stdev=1128.10 lat (msec): min=468, max=2702, avg=1492.98, stdev=1128.77 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.37%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3295KiB/s (3374kB/s), 824KiB/s-2502KiB/s (844kB/s-2562kB/s), io=16.0MiB (16.8MB), run=4912-4972msec WRITE: bw=5478KiB/s (5609kB/s), 1648KiB/s-2648KiB/s (1687kB/s-2711kB/s), io=32.0MiB (33.6MB), run=4641-5982msec