== sanity test 398b: DIO and buffer IO race ============== 07:18:13 (1775128693) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.72681 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147305: Thu Apr 2 07:20:38 2026 read: IOPS=11, BW=47.8KiB/s (48.9kB/s)(5992KiB/125436msec) clat (usec): min=32, max=465249, avg=41153.61, stdev=33124.36 lat (usec): min=32, max=465249, avg=41157.25, stdev=33121.60 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 8291], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[198181], 99.90th=[434111], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 119, per=24.91%, avg=47.33, stdev=19.52, samples=246 iops : min= 1, max= 29, avg=11.19, stdev= 4.89, samples=246 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6296KiB/125436msec); 0 zone resets clat (usec): min=1131, max=945723, avg=40209.83, stdev=46497.73 lat (usec): min=1132, max=945725, avg=40212.15, stdev=46497.75 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 1663], 20.00th=[ 4752], | 30.00th=[ 9503], 40.00th=[ 18744], 50.00th=[ 29230], 60.00th=[ 40633], | 70.00th=[ 53216], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[175113], 99.50th=[200279], 99.90th=[463471], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 104, per=25.43%, avg=50.61, stdev=19.02, samples=242 iops : min= 1, max= 26, avg=12.01, stdev= 4.81, samples=242 lat (usec) : 50=0.55%, 100=3.71%, 250=0.26%, 500=0.10%, 750=0.03% lat (msec) : 2=5.89%, 4=3.35%, 10=6.84%, 20=9.57%, 50=38.64% lat (msec) : 100=25.03%, 250=5.76%, 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=5.46%, ctx=6614, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147306: Thu Apr 2 07:20:38 2026 read: IOPS=12, BW=48.4KiB/s (49.5kB/s)(5940KiB/122804msec) clat (usec): min=27, max=849051, avg=40170.31, stdev=34868.02 lat (usec): min=27, max=849052, avg=40173.29, stdev=34867.55 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 1156], 20.00th=[ 20055], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 76022], 95.00th=[ 88605], | 99.00th=[122160], 99.50th=[149947], 99.90th=[270533], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 5, max= 118, per=25.44%, avg=48.33, stdev=20.32, samples=240 iops : min= 1, max= 29, avg=11.44, stdev= 5.10, samples=240 write: IOPS=12, BW=51.7KiB/s (52.9kB/s)(6348KiB/122804msec); 0 zone resets clat (usec): min=1063, max=978278, avg=39436.48, stdev=48517.24 lat (usec): min=1064, max=978279, avg=39440.08, stdev=48515.99 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1614], 20.00th=[ 4817], | 30.00th=[ 9110], 40.00th=[ 20055], 50.00th=[ 30278], 60.00th=[ 39060], | 70.00th=[ 50070], 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[166724], 99.50th=[214959], 99.90th=[708838], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 5, max= 135, per=26.08%, avg=51.91, stdev=22.90, samples=239 iops : min= 1, max= 33, avg=12.35, stdev= 5.80, samples=239 lat (usec) : 50=0.52%, 100=4.04%, 250=0.20%, 750=0.03%, 1000=0.03% lat (msec) : 2=6.05%, 4=3.22%, 10=7.16%, 20=8.89%, 50=40.14% lat (msec) : 100=24.64%, 250=4.82%, 500=0.16%, 750=0.03%, 1000=0.07% cpu : usr=0.08%, sys=5.62%, ctx=6610, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147307: Thu Apr 2 07:20:38 2026 read: IOPS=11, BW=47.8KiB/s (48.9kB/s)(6028KiB/126167msec) clat (usec): min=32, max=1027.4k, avg=41178.23, stdev=41740.49 lat (usec): min=33, max=1027.4k, avg=41194.96, stdev=41741.11 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 135], | 20.00th=[ 18482], 30.00th=[ 23987], 40.00th=[ 28967], | 50.00th=[ 34341], 60.00th=[ 41157], 70.00th=[ 49021], | 80.00th=[ 60556], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[ 143655], 99.50th=[ 210764], 99.90th=[ 459277], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 110, per=24.97%, avg=47.45, stdev=21.66, samples=246 iops : min= 1, max= 27, avg=11.22, stdev= 5.47, samples=246 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6260KiB/126167msec); 0 zone resets clat (usec): min=1120, max=410401, avg=40629.49, stdev=40745.58 lat (usec): min=1121, max=410403, avg=40633.18, stdev=40745.09 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1369], 10.00th=[ 1729], 20.00th=[ 5276], | 30.00th=[ 10290], 40.00th=[ 20841], 50.00th=[ 30278], 60.00th=[ 40633], | 70.00th=[ 53740], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[168821], 99.50th=[189793], 99.90th=[304088], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 108, per=24.69%, avg=49.14, stdev=19.22, samples=246 iops : min= 1, max= 27, avg=11.65, stdev= 4.85, samples=246 lat (usec) : 50=0.68%, 100=4.04%, 250=0.42%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.60%, 4=2.99%, 10=7.00%, 20=9.77%, 50=38.54% lat (msec) : 100=24.67%, 250=5.76%, 500=0.26%, 2000=0.03% cpu : usr=0.08%, sys=5.44%, ctx=6605, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147308: Thu Apr 2 07:20:38 2026 read: IOPS=12, BW=48.1KiB/s (49.2kB/s)(6052KiB/125879msec) clat (usec): min=33, max=465584, avg=39209.56, stdev=30625.89 lat (usec): min=33, max=465585, avg=39211.79, stdev=30625.34 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 824], 20.00th=[ 19268], | 30.00th=[ 23725], 40.00th=[ 28181], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 49021], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[143655], 99.50th=[170918], 99.90th=[258999], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 127, per=25.45%, avg=48.35, stdev=20.07, samples=244 iops : min= 1, max= 31, avg=11.44, stdev= 5.06, samples=244 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6236KiB/125879msec); 0 zone resets clat (usec): min=1098, max=1169.1k, avg=42337.65, stdev=52926.55 lat (usec): min=1099, max=1169.1k, avg=42341.83, stdev=52926.03 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1385], 10.00th=[ 2073], | 20.00th=[ 5211], 30.00th=[ 10028], 40.00th=[ 20841], | 50.00th=[ 32113], 60.00th=[ 42730], 70.00th=[ 55313], | 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[ 117965], | 99.00th=[ 187696], 99.50th=[ 235930], 99.90th=[ 658506], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 132, per=24.94%, avg=49.63, stdev=21.45, samples=244 iops : min= 1, max= 33, avg=11.77, stdev= 5.42, samples=244 lat (usec) : 50=0.52%, 100=4.07%, 250=0.20%, 500=0.13%, 1000=0.07% lat (msec) : 2=4.82%, 4=3.52%, 10=7.23%, 20=10.32%, 50=37.73% lat (msec) : 100=25.65%, 250=5.47%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.41%, ctx=6557, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (195kB/s), 47.8KiB/s-48.4KiB/s (48.9kB/s-49.5kB/s), io=23.4MiB (24.6MB), run=122804-126167msec WRITE: bw=199KiB/s (204kB/s), 49.5KiB/s-51.7KiB/s (50.7kB/s-52.9kB/s), io=24.6MiB (25.7MB), run=122804-126167msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147309: Thu Apr 2 07:23:04 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(5992KiB/270372msec) clat (msec): min=6, max=984, avg=34.42, stdev=41.71 lat (msec): min=6, max=984, avg=34.42, stdev=41.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 74], 95.00th=[ 105], | 99.00th=[ 167], 99.50th=[ 197], 99.90th=[ 388], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 94, per=28.41%, avg=25.00, stdev=16.02, samples=463 iops : min= 1, max= 23, avg= 5.61, stdev= 4.05, samples=463 write: IOPS=5, BW=23.3KiB/s (23.8kB/s)(6296KiB/270372msec); 0 zone resets clat (msec): min=37, max=732, avg=138.75, stdev=62.70 lat (msec): min=37, max=732, avg=138.75, stdev=62.70 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 103], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 213], 95.00th=[ 247], | 99.00th=[ 363], 99.50th=[ 401], 99.90th=[ 642], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 55, per=25.07%, avg=23.07, stdev= 9.56, samples=526 iops : min= 1, max= 13, avg= 5.13, stdev= 2.44, samples=526 lat (msec) : 10=3.45%, 20=18.20%, 50=18.75%, 100=20.08%, 250=36.95% lat (msec) : 500=2.44%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.34%, ctx=5322, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147310: Thu Apr 2 07:23:04 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(5940KiB/272520msec) clat (msec): min=5, max=1034, avg=33.69, stdev=43.66 lat (msec): min=5, max=1034, avg=33.69, stdev=43.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 70], 95.00th=[ 93], | 99.00th=[ 176], 99.50th=[ 220], 99.90th=[ 493], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 87, per=27.61%, avg=24.29, stdev=16.70, samples=472 iops : min= 1, max= 21, avg= 5.44, stdev= 4.22, samples=472 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6348KiB/272520msec); 0 zone resets clat (msec): min=41, max=939, avg=139.92, stdev=62.92 lat (msec): min=41, max=939, avg=139.92, stdev=62.92 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 104], 40.00th=[ 115], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 220], 95.00th=[ 257], | 99.00th=[ 338], 99.50th=[ 380], 99.90th=[ 510], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 47, per=24.93%, avg=22.93, stdev= 9.38, samples=533 iops : min= 1, max= 11, avg= 5.10, stdev= 2.39, samples=533 lat (msec) : 10=3.03%, 20=18.33%, 50=19.14%, 100=19.86%, 250=36.65% lat (msec) : 500=2.90%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5187, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147311: Thu Apr 2 07:23:04 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6028KiB/270615msec) clat (msec): min=5, max=517, avg=34.61, stdev=36.52 lat (msec): min=5, max=517, avg=34.61, stdev=36.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 78], 95.00th=[ 101], | 99.00th=[ 157], 99.50th=[ 201], 99.90th=[ 414], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 95, per=27.64%, avg=24.32, stdev=16.63, samples=478 iops : min= 1, max= 23, avg= 5.44, stdev= 4.18, samples=478 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6260KiB/270615msec); 0 zone resets clat (msec): min=43, max=1190, avg=139.29, stdev=69.34 lat (msec): min=43, max=1190, avg=139.29, stdev=69.34 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 222], 95.00th=[ 251], | 99.00th=[ 330], 99.50th=[ 401], 99.90th=[ 953], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 55, per=24.84%, avg=22.85, stdev= 9.77, samples=527 iops : min= 1, max= 13, avg= 5.08, stdev= 2.50, samples=527 lat (msec) : 10=3.19%, 20=18.10%, 50=19.21%, 100=21.48%, 250=35.19% lat (msec) : 500=2.70%, 750=0.07%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.32%, ctx=5202, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147312: Thu Apr 2 07:23:04 2026 read: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6052KiB/269674msec) clat (msec): min=6, max=467, avg=34.14, stdev=33.78 lat (msec): min=6, max=467, avg=34.14, stdev=33.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 75], 95.00th=[ 99], | 99.00th=[ 155], 99.50th=[ 182], 99.90th=[ 338], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 95, per=28.68%, avg=25.24, stdev=17.40, samples=463 iops : min= 1, max= 23, avg= 5.68, stdev= 4.36, samples=463 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6236KiB/269674msec); 0 zone resets clat (msec): min=44, max=1173, avg=139.58, stdev=67.34 lat (msec): min=44, max=1173, avg=139.58, stdev=67.34 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 113], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 257], | 99.00th=[ 334], 99.50th=[ 409], 99.90th=[ 709], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 55, per=24.62%, avg=22.65, stdev= 9.74, samples=529 iops : min= 1, max= 13, avg= 5.02, stdev= 2.49, samples=529 lat (msec) : 10=2.99%, 20=18.16%, 50=19.43%, 100=20.77%, 250=35.71% lat (msec) : 500=2.86%, 750=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.30%, ctx=5255, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=88.1KiB/s (90.2kB/s), 21.8KiB/s-22.4KiB/s (22.3kB/s-22.0kB/s), io=23.4MiB (24.6MB), run=269674-272520msec WRITE: bw=92.2KiB/s (94.5kB/s), 23.1KiB/s-23.3KiB/s (23.7kB/s-23.9kB/s), io=24.6MiB (25.7MB), run=269674-272520msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147371: Thu Apr 2 07:23:44 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5920KiB/27855msec) clat (usec): min=41, max=222042, avg=38634.86, stdev=34039.29 lat (usec): min=42, max=222043, avg=38636.31, stdev=34038.97 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 120], | 30.00th=[ 23725], 40.00th=[ 29754], 50.00th=[ 35914], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 94897], | 99.00th=[177210], 99.50th=[206570], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 62, max= 447, per=24.74%, avg=210.76, stdev=91.91, samples=54 iops : min= 3, max= 27, avg=12.46, stdev= 5.80, samples=54 write: IOPS=14, BW=229KiB/s (234kB/s)(6368KiB/27855msec); 0 zone resets clat (usec): min=1577, max=229417, avg=33346.55, stdev=35764.64 lat (usec): min=1578, max=229420, avg=33363.24, stdev=35766.60 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1827], 10.00th=[ 2409], 20.00th=[ 5145], | 30.00th=[ 8979], 40.00th=[ 13829], 50.00th=[ 20579], 60.00th=[ 31065], | 70.00th=[ 42206], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[110625], | 99.00th=[152044], 99.50th=[219153], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 61, max= 416, per=25.57%, avg=229.35, stdev=91.90, samples=54 iops : min= 3, max= 26, avg=13.65, stdev= 5.76, samples=54 lat (usec) : 50=0.78%, 100=8.59%, 250=0.52%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.91%, 4=4.17%, 10=8.85%, 20=11.07%, 50=37.11% lat (msec) : 100=19.79%, 250=4.95% cpu : usr=0.10%, sys=6.36%, ctx=1477, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147372: Thu Apr 2 07:23:44 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(5744KiB/28092msec) clat (usec): min=33, max=293964, avg=39933.56, stdev=34380.74 lat (usec): min=33, max=293964, avg=39935.75, stdev=34380.99 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 8979], | 30.00th=[ 25035], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[181404], 99.50th=[233833], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 28, max= 381, per=24.39%, avg=207.83, stdev=80.42, samples=54 iops : min= 1, max= 23, avg=12.28, stdev= 5.12, samples=54 write: IOPS=14, BW=233KiB/s (239kB/s)(6544KiB/28092msec); 0 zone resets clat (usec): min=1523, max=305009, avg=33120.39, stdev=41100.53 lat (usec): min=1525, max=305012, avg=33123.15, stdev=41100.29 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1893], 10.00th=[ 2343], 20.00th=[ 5473], | 30.00th=[ 8717], 40.00th=[ 12387], 50.00th=[ 18744], 60.00th=[ 26346], | 70.00th=[ 38011], 80.00th=[ 54264], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[221250], 99.50th=[278922], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 28, max= 592, per=25.92%, avg=232.47, stdev=109.13, samples=55 iops : min= 1, max= 37, avg=13.85, stdev= 6.85, samples=55 lat (usec) : 50=0.78%, 100=7.29%, 250=0.39%, 500=0.52%, 1000=0.13% lat (msec) : 2=4.69%, 4=3.39%, 10=10.16%, 20=11.72%, 50=33.72% lat (msec) : 100=22.92%, 250=3.78%, 500=0.52% cpu : usr=0.10%, sys=6.36%, ctx=1511, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147373: Thu Apr 2 07:23:44 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26955msec) clat (usec): min=36, max=197057, avg=36651.41, stdev=27718.73 lat (usec): min=36, max=197058, avg=36652.70, stdev=27718.86 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 13304], | 30.00th=[ 22938], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 55837], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[114820], 99.50th=[156238], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 63, max= 561, per=27.35%, avg=233.00, stdev=105.21, samples=53 iops : min= 3, max= 35, avg=13.89, stdev= 6.68, samples=53 write: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26955msec); 0 zone resets clat (usec): min=1570, max=292748, avg=33154.04, stdev=38593.42 lat (usec): min=1573, max=292749, avg=33156.43, stdev=38593.20 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2024], 10.00th=[ 3130], 20.00th=[ 5932], | 30.00th=[ 8717], 40.00th=[ 13304], 50.00th=[ 19268], 60.00th=[ 26084], | 70.00th=[ 38536], 80.00th=[ 55313], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[187696], 99.50th=[263193], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 62, max= 383, per=24.84%, avg=222.85, stdev=81.17, samples=53 iops : min= 3, max= 23, avg=13.25, stdev= 4.98, samples=53 lat (usec) : 50=1.17%, 100=7.03%, 250=0.91%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.34%, 4=4.04%, 10=9.64%, 20=12.76%, 50=35.68% lat (msec) : 100=21.61%, 250=3.78%, 500=0.26% cpu : usr=0.10%, sys=6.64%, ctx=1541, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147374: Thu Apr 2 07:23:44 2026 read: IOPS=15, BW=243KiB/s (248kB/s)(6032KiB/24871msec) clat (usec): min=33, max=293656, avg=36861.60, stdev=30992.67 lat (usec): min=33, max=293657, avg=36862.73, stdev=30992.69 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 104], | 30.00th=[ 22938], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[131597], 99.50th=[162530], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 28, max= 506, per=28.46%, avg=242.45, stdev=100.01, samples=49 iops : min= 1, max= 31, avg=14.47, stdev= 6.27, samples=49 write: IOPS=15, BW=252KiB/s (258kB/s)(6256KiB/24871msec); 0 zone resets clat (usec): min=1483, max=340394, avg=27290.51, stdev=34618.81 lat (usec): min=1484, max=342269, avg=27297.47, stdev=34662.34 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1827], 10.00th=[ 2343], 20.00th=[ 4490], | 30.00th=[ 5932], 40.00th=[ 8586], 50.00th=[ 12649], 60.00th=[ 21365], | 70.00th=[ 31851], 80.00th=[ 47973], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[139461], 99.50th=[219153], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 93, max= 448, per=28.12%, avg=252.24, stdev=79.66, samples=49 iops : min= 5, max= 28, avg=15.08, stdev= 5.01, samples=49 lat (usec) : 50=0.91%, 100=8.59%, 250=0.91%, 500=0.26% lat (msec) : 2=4.30%, 4=4.69%, 10=13.93%, 20=8.85%, 50=33.98% lat (msec) : 100=20.70%, 250=2.60%, 500=0.26% cpu : usr=0.08%, sys=6.63%, ctx=1444, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=853KiB/s (873kB/s), 204KiB/s-243KiB/s (209kB/s-248kB/s), io=23.4MiB (24.5MB), run=24871-28092msec WRITE: bw=897KiB/s (919kB/s), 224KiB/s-252KiB/s (229kB/s-258kB/s), io=24.6MiB (25.8MB), run=24871-28092msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147366: Thu Apr 2 07:24:33 2026 read: IOPS=4, BW=79.7KiB/s (81.6kB/s)(5920KiB/74247msec) clat (msec): min=9, max=356, avg=41.01, stdev=34.53 lat (msec): min=9, max=356, avg=41.02, stdev=34.53 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 55], 90.00th=[ 75], 95.00th=[ 106], | 99.00th=[ 178], 99.50th=[ 211], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 255, per=28.21%, avg=87.73, stdev=50.61, samples=133 iops : min= 1, max= 15, avg= 4.63, stdev= 3.19, samples=133 write: IOPS=5, BW=85.8KiB/s (87.8kB/s)(6368KiB/74247msec); 0 zone resets clat (msec): min=54, max=462, avg=148.31, stdev=58.81 lat (msec): min=54, max=462, avg=148.31, stdev=58.81 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 75], 10.00th=[ 84], 20.00th=[ 101], | 30.00th=[ 112], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 190], 90.00th=[ 222], 95.00th=[ 264], | 99.00th=[ 321], 99.50th=[ 422], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 31, max= 159, per=26.22%, avg=85.73, stdev=32.32, samples=146 iops : min= 1, max= 9, avg= 4.51, stdev= 2.07, samples=146 lat (msec) : 10=0.52%, 20=11.20%, 50=25.26%, 100=18.75%, 250=41.15% lat (msec) : 500=3.12% cpu : usr=0.03%, sys=1.38%, ctx=1462, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147367: Thu Apr 2 07:24:33 2026 read: IOPS=4, BW=74.6KiB/s (76.4kB/s)(5744KiB/76965msec) clat (msec): min=7, max=344, avg=43.94, stdev=40.21 lat (msec): min=7, max=344, avg=43.94, stdev=40.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 81], 95.00th=[ 121], | 99.00th=[ 192], 99.50th=[ 326], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 255, per=27.90%, avg=86.78, stdev=52.96, samples=129 iops : min= 1, max= 15, avg= 4.60, stdev= 3.30, samples=129 write: IOPS=5, BW=85.0KiB/s (87.1kB/s)(6544KiB/76965msec); 0 zone resets clat (msec): min=48, max=377, avg=148.94, stdev=61.40 lat (msec): min=48, max=377, avg=148.95, stdev=61.41 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 84], 20.00th=[ 99], | 30.00th=[ 109], 40.00th=[ 118], 50.00th=[ 134], 60.00th=[ 157], | 70.00th=[ 171], 80.00th=[ 199], 90.00th=[ 232], 95.00th=[ 266], | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 160, per=25.95%, avg=84.85, stdev=35.48, samples=151 iops : min= 1, max= 10, avg= 4.47, stdev= 2.32, samples=151 lat (msec) : 10=0.78%, 20=10.55%, 50=22.27%, 100=21.88%, 250=40.36% lat (msec) : 500=4.17% cpu : usr=0.04%, sys=1.31%, ctx=1409, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147368: Thu Apr 2 07:24:33 2026 read: IOPS=5, BW=86.7KiB/s (88.7kB/s)(6256KiB/72195msec) clat (msec): min=8, max=315, avg=41.47, stdev=36.81 lat (msec): min=8, max=315, avg=41.47, stdev=36.81 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 80], 95.00th=[ 114], | 99.00th=[ 184], 99.50th=[ 236], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 318, per=30.75%, avg=95.64, stdev=63.73, samples=129 iops : min= 1, max= 19, avg= 5.13, stdev= 4.00, samples=129 write: IOPS=5, BW=83.6KiB/s (85.6kB/s)(6032KiB/72195msec); 0 zone resets clat (msec): min=41, max=444, avg=148.07, stdev=61.23 lat (msec): min=41, max=444, avg=148.07, stdev=61.23 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 84], 20.00th=[ 100], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 224], 95.00th=[ 279], | 99.00th=[ 351], 99.50th=[ 414], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 189, per=25.54%, avg=83.52, stdev=33.36, samples=142 iops : min= 1, max= 11, avg= 4.36, stdev= 2.13, samples=142 lat (msec) : 10=1.04%, 20=12.11%, 50=25.78%, 100=19.27%, 250=38.15% lat (msec) : 500=3.65% cpu : usr=0.04%, sys=1.53%, ctx=1465, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147369: Thu Apr 2 07:24:33 2026 read: IOPS=5, BW=81.7KiB/s (83.6kB/s)(6032KiB/73874msec) clat (msec): min=8, max=248, avg=42.11, stdev=36.55 lat (msec): min=8, max=248, avg=42.11, stdev=36.55 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 80], 95.00th=[ 114], | 99.00th=[ 203], 99.50th=[ 230], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 30, max= 253, per=29.31%, avg=91.15, stdev=55.38, samples=129 iops : min= 1, max= 15, avg= 4.85, stdev= 3.50, samples=129 write: IOPS=5, BW=84.7KiB/s (86.7kB/s)(6256KiB/73874msec); 0 zone resets clat (msec): min=51, max=352, avg=147.90, stdev=58.72 lat (msec): min=51, max=352, avg=147.91, stdev=58.71 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 77], 10.00th=[ 86], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 192], 90.00th=[ 232], 95.00th=[ 266], | 99.00th=[ 338], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 192, per=26.13%, avg=85.44, stdev=32.53, samples=144 iops : min= 1, max= 12, avg= 4.49, stdev= 2.09, samples=144 lat (msec) : 10=0.91%, 20=11.85%, 50=24.35%, 100=20.31%, 250=38.67% lat (msec) : 500=3.91% cpu : usr=0.04%, sys=1.37%, ctx=1383, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=311KiB/s (319kB/s), 74.6KiB/s-86.7KiB/s (76.4kB/s-88.7kB/s), io=23.4MiB (24.5MB), run=72195-76965msec WRITE: bw=327KiB/s (335kB/s), 83.6KiB/s-85.8KiB/s (85.6kB/s-87.8kB/s), io=24.6MiB (25.8MB), run=72195-76965msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147393: Thu Apr 2 07:24:50 2026 read: IOPS=1, BW=1528KiB/s (1564kB/s)(7168KiB/4692msec) clat (usec): min=563, max=435915, avg=159407.80, stdev=144757.39 lat (usec): min=565, max=435917, avg=159409.43, stdev=144757.45 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 7701], | 30.00th=[145753], 40.00th=[145753], 50.00th=[173016], 60.00th=[173016], | 70.00th=[173016], 80.00th=[181404], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 2031, max= 4023, per=76.92%, avg=2968.25, stdev=1077.37, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1091KiB/s (1117kB/s)(5120KiB/4692msec); 0 zone resets clat (msec): min=239, max=1283, avg=696.81, stdev=408.29 lat (msec): min=239, max=1283, avg=696.88, stdev=408.30 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1957, max= 2039, per=37.28%, avg=2014.50, stdev=38.52, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=9.06%, ctx=186, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147394: Thu Apr 2 07:24:50 2026 read: IOPS=0, BW=386KiB/s (395kB/s)(2048KiB/5306msec) clat (usec): min=1210, max=1418.4k, avg=709807.65, stdev=1002107.65 lat (usec): min=1211, max=1418.4k, avg=709809.44, stdev=1002108.53 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1205], 10.00th=[ 1205], | 20.00th=[ 1205], 30.00th=[ 1205], 40.00th=[ 1205], | 50.00th=[ 1205], 60.00th=[1417675], 70.00th=[1417675], | 80.00th=[1417675], 90.00th=[1417675], 95.00th=[1417675], | 99.00th=[1417675], 99.50th=[1417675], 99.90th=[1417675], | 99.95th=[1417675], 99.99th=[1417675] bw ( KiB/s): min= 2031, max= 2035, per=52.68%, avg=2033.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1930KiB/s (1976kB/s)(10.0MiB/5306msec); 0 zone resets clat (msec): min=107, max=1003, avg=383.07, stdev=268.47 lat (msec): min=107, max=1004, avg=383.15, stdev=268.47 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 126], | 30.00th=[ 169], 40.00th=[ 262], 50.00th=[ 275], 60.00th=[ 380], | 70.00th=[ 472], 80.00th=[ 485], 90.00th=[ 558], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1957, max= 4079, per=65.96%, avg=3563.80, stdev=915.74, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=10.44%, ctx=292, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147395: Thu Apr 2 07:24:50 2026 read: IOPS=1, BW=1484KiB/s (1519kB/s)(6144KiB/4141msec) clat (usec): min=528, max=360122, avg=174668.32, stdev=146487.01 lat (usec): min=529, max=360123, avg=174669.58, stdev=146487.09 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[193987], 50.00th=[193987], 60.00th=[219153], | 70.00th=[274727], 80.00th=[274727], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 1828, max= 4079, per=68.39%, avg=2639.33, stdev=1250.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1484KiB/s (1519kB/s)(6144KiB/4141msec); 0 zone resets clat (msec): min=214, max=1463, avg=470.42, stdev=489.26 lat (msec): min=214, max=1463, avg=470.52, stdev=489.25 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 288], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1828, max= 3915, per=45.31%, avg=2448.25, stdev=982.30, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=33.33%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=10.05%, ctx=183, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147396: Thu Apr 2 07:24:50 2026 read: IOPS=1, BW=1307KiB/s (1338kB/s)(5120KiB/3918msec) clat (usec): min=498, max=248655, avg=91520.19, stdev=123656.52 lat (usec): min=499, max=248656, avg=91521.43, stdev=123656.51 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[ 4883], 60.00th=[ 4883], | 70.00th=[202376], 80.00th=[202376], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7314, max= 7314, per=100.00%, avg=7314.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1830KiB/s (1873kB/s)(7168KiB/3918msec); 0 zone resets clat (msec): min=197, max=1443, avg=457.11, stdev=446.25 lat (msec): min=197, max=1444, avg=457.22, stdev=446.27 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 209], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 259], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 485], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 3915, max= 4079, per=74.14%, avg=4005.67, stdev=83.36, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=10.77%, ctx=124, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3860KiB/s (3952kB/s), 386KiB/s-1528KiB/s (395kB/s-1564kB/s), io=20.0MiB (20.0MB), run=3918-5306msec WRITE: bw=5404KiB/s (5533kB/s), 1091KiB/s-1930KiB/s (1117kB/s-1976kB/s), io=28.0MiB (29.4MB), run=3918-5306msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147397: Thu Apr 2 07:24:50 2026 read: IOPS=1, BW=1555KiB/s (1592kB/s)(7168KiB/4611msec) clat (msec): min=115, max=501, avg=205.77, stdev=134.87 lat (msec): min=115, max=501, avg=205.77, stdev=134.87 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 125], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 159], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 220], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1928, max= 4718, per=75.83%, avg=2658.50, stdev=1373.35, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1110KiB/s (1137kB/s)(5120KiB/4611msec); 0 zone resets clat (msec): min=373, max=1077, avg=624.38, stdev=274.64 lat (msec): min=373, max=1077, avg=624.52, stdev=274.60 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1928, max= 2048, per=40.46%, avg=1986.00, stdev=49.15, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=50.00%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=3.45%, ctx=111, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147398: Thu Apr 2 07:24:50 2026 read: IOPS=0, BW=351KiB/s (359kB/s)(2048KiB/5840msec) clat (msec): min=237, max=1191, avg=714.44, stdev=674.91 lat (msec): min=237, max=1191, avg=714.45, stdev=674.92 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1980, max= 2048, per=57.44%, avg=2014.00, stdev=48.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1753KiB/s (1796kB/s)(10.0MiB/5840msec); 0 zone resets clat (msec): min=187, max=803, avg=412.15, stdev=251.83 lat (msec): min=187, max=804, avg=412.26, stdev=251.84 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 211], | 30.00th=[ 230], 40.00th=[ 236], 50.00th=[ 239], 60.00th=[ 262], | 70.00th=[ 493], 80.00th=[ 726], 90.00th=[ 735], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1928, max= 4000, per=52.25%, avg=2564.86, stdev=962.93, samples=7 iops : min= 1, max= 3, avg= 1.86, stdev= 0.90, samples=7 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=4.06%, ctx=101, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147399: Thu Apr 2 07:24:50 2026 read: IOPS=1, BW=1072KiB/s (1097kB/s)(6144KiB/5733msec) clat (msec): min=111, max=485, avg=293.79, stdev=149.83 lat (msec): min=111, max=485, avg=293.79, stdev=149.83 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 317], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1973, max= 3976, per=76.03%, avg=2665.67, stdev=1135.40, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1072KiB/s (1097kB/s)(6144KiB/5733msec); 0 zone resets clat (msec): min=224, max=1986, avg=636.34, stdev=669.87 lat (msec): min=224, max=1986, avg=636.46, stdev=669.86 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 430], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1928, max= 2048, per=40.48%, avg=1987.40, stdev=43.31, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.42%, ctx=119, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147400: Thu Apr 2 07:24:50 2026 read: IOPS=0, BW=930KiB/s (952kB/s)(5120KiB/5506msec) clat (msec): min=97, max=529, avg=212.18, stdev=183.50 lat (msec): min=97, max=529, avg=212.18, stdev=183.50 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 112], 60.00th=[ 112], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1928, max= 3976, per=75.60%, avg=2650.67, stdev=1149.34, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1302KiB/s (1333kB/s)(7168KiB/5506msec); 0 zone resets clat (msec): min=248, max=2192, avg=612.82, stdev=700.58 lat (msec): min=248, max=2192, avg=612.92, stdev=700.59 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 279], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 372], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 481], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1973, max= 4096, per=49.30%, avg=2420.20, stdev=937.23, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.11%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3507KiB/s (3591kB/s), 351KiB/s-1555KiB/s (359kB/s-1592kB/s), io=20.0MiB (20.0MB), run=4611-5840msec WRITE: bw=4910KiB/s (5027kB/s), 1072KiB/s-1753KiB/s (1097kB/s-1796kB/s), io=28.0MiB (29.4MB), run=4611-5840msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147411: Thu Apr 2 07:25:04 2026 read: IOPS=1, BW=4351KiB/s (4456kB/s)(12.0MiB/2824msec) clat (msec): min=828, max=1007, avg=926.33, stdev=90.67 lat (msec): min=828, max=1007, avg=926.33, stdev=90.67 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8015, max= 8143, per=100.00%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.68%, ctx=305, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147412: Thu Apr 2 07:25:04 2026 read: IOPS=0, BW=1276KiB/s (1307kB/s)(4096KiB/3210msec) clat (nsec): min=1112.1M, max=1112.1M, avg=1112117895.00, stdev= 0.00 lat (nsec): min=1112.1M, max=1112.1M, avg=1112120176.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2552KiB/s (2613kB/s)(8192KiB/3210msec); 0 zone resets clat (msec): min=691, max=1404, avg=1047.88, stdev=504.32 lat (msec): min=691, max=1405, avg=1048.42, stdev=504.35 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7876, max= 7876, per=77.16%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.05%, ctx=124, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147413: Thu Apr 2 07:25:04 2026 write: IOPS=0, BW=3933KiB/s (4028kB/s)(12.0MiB/3124msec); 0 zone resets clat (msec): min=374, max=1416, avg=1037.13, stdev=575.48 lat (msec): min=375, max=1417, avg=1040.01, stdev=576.88 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8047, max= 8192, per=79.54%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.78%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147414: Thu Apr 2 07:25:04 2026 write: IOPS=1, BW=4483KiB/s (4591kB/s)(12.0MiB/2741msec); 0 zone resets clat (msec): min=376, max=1409, avg=910.74, stdev=517.83 lat (msec): min=376, max=1414, avg=912.63, stdev=520.10 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8047, max= 8175, per=79.46%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.26%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5104KiB/s (5227kB/s), 1276KiB/s-4351KiB/s (1307kB/s-4456kB/s), io=16.0MiB (16.8MB), run=2824-3210msec WRITE: bw=9.97MiB/s (10.5MB/s), 2552KiB/s-4483KiB/s (2613kB/s-4591kB/s), io=32.0MiB (33.6MB), run=2741-3210msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147406: Thu Apr 2 07:25:05 2026 read: IOPS=1, BW=7576KiB/s (7758kB/s)(12.0MiB/1622msec) clat (msec): min=173, max=1019, avg=513.15, stdev=446.74 lat (msec): min=174, max=1019, avg=513.15, stdev=446.74 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min=12840, max=12840, per=100.00%, avg=12840.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.48%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147407: Thu Apr 2 07:25:05 2026 read: IOPS=0, BW=1008KiB/s (1032kB/s)(4096KiB/4063msec) clat (nsec): min=1709.3M, max=1709.3M, avg=1709266923.00, stdev= 0.00 lat (nsec): min=1709.3M, max=1709.3M, avg=1709269848.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1703], 5.00th=[ 1703], 10.00th=[ 1703], 20.00th=[ 1703], | 30.00th=[ 1703], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2016KiB/s (2065kB/s)(8192KiB/4063msec); 0 zone resets clat (msec): min=872, max=1349, avg=1111.12, stdev=337.45 lat (msec): min=877, max=1350, avg=1113.85, stdev=334.07 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.76%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147408: Thu Apr 2 07:25:05 2026 write: IOPS=0, BW=3712KiB/s (3801kB/s)(12.0MiB/3310msec); 0 zone resets clat (msec): min=576, max=1390, avg=1085.70, stdev=444.24 lat (msec): min=576, max=1391, avg=1086.16, stdev=444.26 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.45%, ctx=44, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147409: Thu Apr 2 07:25:05 2026 write: IOPS=1, BW=5269KiB/s (5396kB/s)(12.0MiB/2332msec); 0 zone resets clat (msec): min=483, max=903, avg=742.90, stdev=226.90 lat (msec): min=484, max=904, avg=743.50, stdev=226.82 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.04%, sys=4.63%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4032KiB/s (4129kB/s), 1008KiB/s-7576KiB/s (1032kB/s-7758kB/s), io=16.0MiB (16.8MB), run=1622-4063msec WRITE: bw=8065KiB/s (8259kB/s), 2016KiB/s-5269KiB/s (2065kB/s-5396kB/s), io=32.0MiB (33.6MB), run=2332-4063msec