== sanity test 398b: DIO and buffer IO race ============== 08:15:28 (1787141728) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.54512 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144461: Wed Aug 19 08:17:48 2026 read: IOPS=12, BW=48.8KiB/s (49.0kB/s)(5992KiB/122734msec) clat (usec): min=33, max=983748, avg=42207.13, stdev=39385.64 lat (usec): min=34, max=983749, avg=42209.71, stdev=39385.64 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 13173], 20.00th=[ 20055], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[164627], 99.50th=[185598], 99.90th=[291505], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 111, per=25.04%, avg=48.83, stdev=21.85, samples=240 iops : min= 1, max= 27, avg=11.58, stdev= 5.46, samples=240 write: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6296KiB/122734msec); 0 zone resets clat (usec): min=845, max=484634, avg=37575.77, stdev=39271.00 lat (usec): min=846, max=484636, avg=37580.79, stdev=39268.71 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1647], 20.00th=[ 4686], | 30.00th=[ 9372], 40.00th=[ 17695], 50.00th=[ 27657], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[160433], 99.50th=[189793], 99.90th=[299893], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 7, max= 135, per=25.15%, avg=51.31, stdev=22.63, samples=240 iops : min= 1, max= 33, avg=12.20, stdev= 5.68, samples=240 lat (usec) : 50=0.55%, 100=2.80%, 250=0.16%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=5.83%, 4=3.42%, 10=7.00%, 20=11.33%, 50=38.93% lat (msec) : 100=24.15%, 250=5.31%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=5.23%, ctx=6361, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144462: Wed Aug 19 08:17:48 2026 read: IOPS=12, BW=50.3KiB/s (51.5kB/s)(5940KiB/118165msec) clat (usec): min=33, max=545076, avg=38275.41, stdev=31047.96 lat (usec): min=34, max=545077, avg=38280.66, stdev=31044.44 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 8848], 20.00th=[ 17957], | 30.00th=[ 22414], 40.00th=[ 27132], 50.00th=[ 32637], 60.00th=[ 39060], | 70.00th=[ 45876], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[147850], 99.90th=[337642], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 5, max= 118, per=25.65%, avg=50.02, stdev=23.33, samples=232 iops : min= 1, max= 29, avg=11.88, stdev= 5.84, samples=232 write: IOPS=13, BW=53.7KiB/s (55.0kB/s)(6348KiB/118165msec); 0 zone resets clat (usec): min=915, max=853653, avg=38418.22, stdev=45527.33 lat (usec): min=916, max=853654, avg=38422.14, stdev=45526.91 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1532], 20.00th=[ 4228], | 30.00th=[ 8455], 40.00th=[ 17171], 50.00th=[ 28181], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 64226], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[196084], 99.50th=[238027], 99.90th=[392168], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 5, max= 148, per=26.11%, avg=53.26, stdev=23.33, samples=233 iops : min= 1, max= 37, avg=12.69, stdev= 5.85, samples=233 lat (usec) : 50=0.39%, 100=3.68%, 250=0.16%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=6.41%, 4=3.55%, 10=7.49%, 20=11.88%, 50=38.74% lat (msec) : 100=22.10%, 250=5.08%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.38%, ctx=6334, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144463: Wed Aug 19 08:17:48 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6028KiB/121580msec) clat (usec): min=22, max=407528, avg=39079.80, stdev=33287.33 lat (usec): min=22, max=407529, avg=39081.87, stdev=33287.84 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 1188], 20.00th=[ 17957], | 30.00th=[ 22938], 40.00th=[ 27919], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 92799], | 99.00th=[156238], 99.50th=[210764], 99.90th=[362808], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 111, per=25.57%, avg=49.87, stdev=22.53, samples=235 iops : min= 1, max= 27, avg=11.85, stdev= 5.64, samples=235 write: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6260KiB/121580msec); 0 zone resets clat (usec): min=921, max=960898, avg=39810.75, stdev=52305.45 lat (usec): min=922, max=960901, avg=39814.21, stdev=52304.24 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1516], 20.00th=[ 3949], | 30.00th=[ 8717], 40.00th=[ 17695], 50.00th=[ 27132], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 64226], 90.00th=[ 92799], 95.00th=[124257], | 99.00th=[204473], 99.50th=[235930], 99.90th=[809501], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 115, per=25.36%, avg=51.74, stdev=22.54, samples=235 iops : min= 1, max= 28, avg=12.31, stdev= 5.66, samples=235 lat (usec) : 50=0.94%, 100=3.45%, 250=0.26%, 500=0.10%, 1000=0.16% lat (msec) : 2=6.28%, 4=4.13%, 10=6.67%, 20=11.59%, 50=39.16% lat (msec) : 100=21.26%, 250=5.70%, 500=0.23%, 1000=0.07% cpu : usr=0.07%, sys=5.20%, ctx=6291, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144464: Wed Aug 19 08:17:48 2026 read: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6052KiB/122204msec) clat (usec): min=31, max=509610, avg=39191.22, stdev=32014.98 lat (usec): min=31, max=509610, avg=39193.31, stdev=32014.96 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 8586], 20.00th=[ 18220], | 30.00th=[ 22938], 40.00th=[ 27657], 50.00th=[ 33162], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[164627], 99.90th=[408945], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 127, per=25.61%, avg=49.94, stdev=22.01, samples=237 iops : min= 1, max= 31, avg=11.86, stdev= 5.55, samples=237 write: IOPS=12, BW=51.0KiB/s (52.3kB/s)(6236KiB/122204msec); 0 zone resets clat (usec): min=886, max=1047.6k, avg=40065.81, stdev=49099.07 lat (usec): min=887, max=1047.6k, avg=40071.39, stdev=49096.08 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1631], | 20.00th=[ 4686], 30.00th=[ 9241], 40.00th=[ 19530], | 50.00th=[ 29492], 60.00th=[ 39584], 70.00th=[ 50594], | 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[ 114820], | 99.00th=[ 164627], 99.50th=[ 200279], 99.90th=[ 517997], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 7, max= 150, per=24.99%, avg=50.98, stdev=23.93, samples=239 iops : min= 1, max= 37, avg=12.13, stdev= 6.04, samples=239 lat (usec) : 50=0.62%, 100=3.61%, 250=0.16%, 500=0.10%, 750=0.20% lat (usec) : 1000=0.07% lat (msec) : 2=6.05%, 4=3.16%, 10=7.03%, 20=11.10%, 50=39.32% lat (msec) : 100=22.92%, 250=5.37%, 500=0.20%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.17%, ctx=6434, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=196KiB/s (200kB/s), 48.8KiB/s-50.3KiB/s (49.0kB/s-51.5kB/s), io=23.4MiB (24.6MB), run=118165-122734msec WRITE: bw=205KiB/s (210kB/s), 51.0KiB/s-53.7KiB/s (52.3kB/s-55.0kB/s), io=24.6MiB (25.7MB), run=118165-122734msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144456: Wed Aug 19 08:20:02 2026 read: IOPS=5, BW=23.4KiB/s (23.0kB/s)(5992KiB/256044msec) clat (msec): min=5, max=1078, avg=35.57, stdev=41.87 lat (msec): min=5, max=1078, avg=35.57, stdev=41.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 71], 95.00th=[ 108], | 99.00th=[ 167], 99.50th=[ 188], 99.90th=[ 288], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 103, per=28.27%, avg=26.29, stdev=17.83, samples=440 iops : min= 1, max= 25, avg= 5.94, stdev= 4.48, samples=440 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6296KiB/256044msec); 0 zone resets clat (msec): min=28, max=824, avg=128.46, stdev=71.32 lat (msec): min=28, max=824, avg=128.46, stdev=71.32 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 99], 50.00th=[ 111], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 257], | 99.00th=[ 368], 99.50th=[ 418], 99.90th=[ 818], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 63, per=25.23%, avg=24.48, stdev=11.58, samples=495 iops : min= 1, max= 15, avg= 5.48, stdev= 2.95, samples=495 lat (msec) : 10=3.94%, 20=15.49%, 50=21.74%, 100=25.78%, 250=30.11% lat (msec) : 500=2.77%, 750=0.03%, 1000=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.39%, ctx=5360, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144457: Wed Aug 19 08:20:02 2026 read: IOPS=5, BW=23.1KiB/s (23.7kB/s)(5940KiB/256938msec) clat (msec): min=4, max=924, avg=36.06, stdev=43.04 lat (msec): min=4, max=924, avg=36.06, stdev=43.04 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 74], 95.00th=[ 99], | 99.00th=[ 174], 99.50th=[ 215], 99.90th=[ 642], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 111, per=27.96%, avg=26.00, stdev=17.13, samples=441 iops : min= 1, max= 27, avg= 5.87, stdev= 4.31, samples=441 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6348KiB/256938msec); 0 zone resets clat (msec): min=33, max=660, avg=127.83, stdev=66.10 lat (msec): min=33, max=660, avg=127.83, stdev=66.10 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 78], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 110], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 174], 90.00th=[ 211], 95.00th=[ 249], | 99.00th=[ 351], 99.50th=[ 405], 99.90th=[ 617], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 63, per=25.25%, avg=24.50, stdev=11.56, samples=499 iops : min= 1, max= 15, avg= 5.48, stdev= 2.95, samples=499 lat (msec) : 10=3.74%, 20=15.46%, 50=21.81%, 100=25.62%, 250=30.73% lat (msec) : 500=2.44%, 750=0.16%, 1000=0.03% cpu : usr=0.04%, sys=1.39%, ctx=5382, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144458: Wed Aug 19 08:20:02 2026 read: IOPS=5, BW=23.6KiB/s (24.1kB/s)(6028KiB/255782msec) clat (msec): min=5, max=335, avg=35.32, stdev=34.51 lat (msec): min=5, max=335, avg=35.32, stdev=34.51 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 73], 95.00th=[ 103], | 99.00th=[ 167], 99.50th=[ 215], 99.90th=[ 317], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 127, per=27.62%, avg=25.68, stdev=17.67, samples=453 iops : min= 1, max= 31, avg= 5.78, stdev= 4.45, samples=453 write: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6260KiB/255782msec); 0 zone resets clat (msec): min=29, max=1000, avg=129.08, stdev=73.15 lat (msec): min=29, max=1000, avg=129.08, stdev=73.15 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 255], | 99.00th=[ 376], 99.50th=[ 451], 99.90th=[ 818], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 64, per=25.17%, avg=24.42, stdev=11.64, samples=494 iops : min= 1, max= 16, avg= 5.46, stdev= 2.96, samples=494 lat (msec) : 10=4.62%, 20=15.01%, 50=21.26%, 100=26.30%, 250=29.92% lat (msec) : 500=2.77%, 750=0.07%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.39%, ctx=5371, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144459: Wed Aug 19 08:20:02 2026 read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(6052KiB/253357msec) clat (msec): min=5, max=331, avg=33.88, stdev=33.19 lat (msec): min=5, max=331, avg=33.89, stdev=33.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 69], 95.00th=[ 101], | 99.00th=[ 169], 99.50th=[ 197], 99.90th=[ 313], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 101, per=28.93%, avg=26.90, stdev=18.60, samples=435 iops : min= 1, max= 25, avg= 6.09, stdev= 4.69, samples=435 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6236KiB/253357msec); 0 zone resets clat (msec): min=33, max=1152, avg=129.31, stdev=74.51 lat (msec): min=33, max=1152, avg=129.31, stdev=74.51 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 253], | 99.00th=[ 376], 99.50th=[ 468], 99.90th=[ 751], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 64, per=25.12%, avg=24.37, stdev=11.74, samples=493 iops : min= 1, max= 16, avg= 5.45, stdev= 2.99, samples=493 lat (msec) : 10=3.84%, 20=16.54%, 50=22.14%, 100=24.74%, 250=30.05% lat (msec) : 500=2.51%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.41%, ctx=5374, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=93.5KiB/s (95.7kB/s), 23.1KiB/s-23.9KiB/s (23.7kB/s-24.5kB/s), io=23.4MiB (24.6MB), run=253357-256938msec WRITE: bw=97.8KiB/s (100kB/s), 24.5KiB/s-24.7KiB/s (25.1kB/s-25.3kB/s), io=24.6MiB (25.7MB), run=253357-256938msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144514: Wed Aug 19 08:20:37 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(5920KiB/24451msec) clat (usec): min=23, max=240234, avg=33492.66, stdev=29371.32 lat (usec): min=23, max=240234, avg=33493.79, stdev=29371.34 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 83], | 30.00th=[ 19006], 40.00th=[ 25297], 50.00th=[ 30016], 60.00th=[ 36439], | 70.00th=[ 44303], 80.00th=[ 54264], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[127402], 99.50th=[156238], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 63, max= 447, per=24.84%, avg=243.15, stdev=94.31, samples=48 iops : min= 3, max= 27, avg=14.42, stdev= 5.90, samples=48 write: IOPS=16, BW=260KiB/s (267kB/s)(6368KiB/24451msec); 0 zone resets clat (usec): min=1564, max=181882, avg=29648.44, stdev=29542.03 lat (usec): min=1565, max=181884, avg=29651.83, stdev=29541.18 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1876], 10.00th=[ 2606], 20.00th=[ 5145], | 30.00th=[ 8094], 40.00th=[ 12649], 50.00th=[ 18744], 60.00th=[ 28967], | 70.00th=[ 36963], 80.00th=[ 51643], 90.00th=[ 69731], 95.00th=[ 92799], | 99.00th=[120062], 99.50th=[137364], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 510, per=25.33%, avg=260.85, stdev=112.11, samples=48 iops : min= 3, max= 31, avg=15.50, stdev= 7.04, samples=48 lat (usec) : 50=1.17%, 100=9.11%, 250=1.30%, 500=0.39% lat (msec) : 2=3.26%, 4=5.21%, 10=9.77%, 20=11.07%, 50=36.33% lat (msec) : 100=19.79%, 250=2.60% cpu : usr=0.07%, sys=7.21%, ctx=1448, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144515: Wed Aug 19 08:20:37 2026 read: IOPS=15, BW=240KiB/s (246kB/s)(5744KiB/23921msec) clat (usec): min=25, max=206696, avg=33062.69, stdev=28407.63 lat (usec): min=25, max=206711, avg=33070.06, stdev=28400.97 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 115], | 30.00th=[ 18744], 40.00th=[ 25035], 50.00th=[ 30802], 60.00th=[ 38011], | 70.00th=[ 43254], 80.00th=[ 53216], 90.00th=[ 64226], 95.00th=[ 77071], | 99.00th=[141558], 99.50th=[160433], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 63, max= 471, per=24.59%, avg=240.72, stdev=101.15, samples=47 iops : min= 3, max= 29, avg=14.28, stdev= 6.38, samples=47 write: IOPS=17, BW=274KiB/s (280kB/s)(6544KiB/23921msec); 0 zone resets clat (usec): min=1325, max=316857, avg=29164.01, stdev=33649.43 lat (usec): min=1326, max=316861, avg=29174.48, stdev=33646.74 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1844], 10.00th=[ 2245], 20.00th=[ 4359], | 30.00th=[ 6718], 40.00th=[ 11469], 50.00th=[ 17171], 60.00th=[ 27132], | 70.00th=[ 36439], 80.00th=[ 52167], 90.00th=[ 67634], 95.00th=[ 79168], | 99.00th=[137364], 99.50th=[183501], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 93, max= 572, per=26.54%, avg=273.40, stdev=94.91, samples=47 iops : min= 5, max= 35, avg=16.32, stdev= 5.93, samples=47 lat (usec) : 50=1.69%, 100=7.29%, 250=1.04%, 500=0.26%, 750=0.39% lat (usec) : 1000=0.26% lat (msec) : 2=4.43%, 4=5.21%, 10=10.68%, 20=11.07%, 50=35.81% lat (msec) : 100=19.40%, 250=2.21%, 500=0.26% cpu : usr=0.08%, sys=7.27%, ctx=1453, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144517: Wed Aug 19 08:20:37 2026 read: IOPS=16, BW=259KiB/s (265kB/s)(6256KiB/24154msec) clat (usec): min=36, max=143253, avg=31224.85, stdev=27733.73 lat (usec): min=36, max=143255, avg=31226.84, stdev=27734.06 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 76], | 30.00th=[ 15139], 40.00th=[ 22938], 50.00th=[ 28705], 60.00th=[ 34341], | 70.00th=[ 42730], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[120062], 99.50th=[125305], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 63, max= 590, per=27.29%, avg=267.15, stdev=106.58, samples=46 iops : min= 3, max= 36, avg=15.91, stdev= 6.67, samples=46 write: IOPS=15, BW=250KiB/s (256kB/s)(6032KiB/24154msec); 0 zone resets clat (usec): min=1510, max=267775, avg=31057.21, stdev=36472.16 lat (usec): min=1512, max=267778, avg=31059.07, stdev=36472.25 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1926], 10.00th=[ 2573], 20.00th=[ 4752], | 30.00th=[ 7504], 40.00th=[ 10552], 50.00th=[ 16909], 60.00th=[ 24511], | 70.00th=[ 36963], 80.00th=[ 53216], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[191890], 99.50th=[202376], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 56, max= 606, per=24.12%, avg=248.43, stdev=119.83, samples=47 iops : min= 3, max= 37, avg=14.74, stdev= 7.53, samples=47 lat (usec) : 50=1.95%, 100=10.29%, 250=1.56%, 500=0.13% lat (msec) : 2=3.65%, 4=5.47%, 10=10.16%, 20=10.68%, 50=34.11% lat (msec) : 100=18.49%, 250=3.39%, 500=0.13% cpu : usr=0.07%, sys=6.89%, ctx=1421, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144519: Wed Aug 19 08:20:37 2026 read: IOPS=17, BW=274KiB/s (280kB/s)(6032KiB/22042msec) clat (usec): min=37, max=207334, avg=29190.59, stdev=27825.68 lat (usec): min=37, max=207335, avg=29192.56, stdev=27824.77 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 48], 10.00th=[ 58], 20.00th=[ 71], | 30.00th=[ 2606], 40.00th=[ 21365], 50.00th=[ 28443], 60.00th=[ 33424], | 70.00th=[ 39584], 80.00th=[ 49021], 90.00th=[ 60031], 95.00th=[ 76022], | 99.00th=[108528], 99.50th=[158335], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 63, max= 574, per=27.85%, avg=272.65, stdev=123.58, samples=43 iops : min= 3, max= 35, avg=16.28, stdev= 7.73, samples=43 write: IOPS=17, BW=284KiB/s (291kB/s)(6256KiB/22042msec); 0 zone resets clat (usec): min=1511, max=243142, avg=27470.24, stdev=32711.89 lat (usec): min=1511, max=243144, avg=27473.88, stdev=32711.26 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1876], 10.00th=[ 2606], 20.00th=[ 4883], | 30.00th=[ 6718], 40.00th=[ 9896], 50.00th=[ 15139], 60.00th=[ 22938], | 70.00th=[ 30278], 80.00th=[ 45876], 90.00th=[ 71828], 95.00th=[ 83362], | 99.00th=[152044], 99.50th=[229639], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 590, per=27.64%, avg=284.70, stdev=119.20, samples=43 iops : min= 1, max= 36, avg=17.02, stdev= 7.44, samples=43 lat (usec) : 50=2.47%, 100=10.55%, 250=1.17%, 500=0.26%, 750=0.13% lat (msec) : 2=3.65%, 4=5.21%, 10=12.24%, 20=11.46%, 50=34.51% lat (msec) : 100=15.89%, 250=2.47% cpu : usr=0.10%, sys=7.34%, ctx=1340, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=980KiB/s (1003kB/s), 240KiB/s-274KiB/s (246kB/s-280kB/s), io=23.4MiB (24.5MB), run=22042-24451msec WRITE: bw=1031KiB/s (1055kB/s), 250KiB/s-284KiB/s (256kB/s-291kB/s), io=24.6MiB (25.8MB), run=22042-24451msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144516: Wed Aug 19 08:21:17 2026 read: IOPS=5, BW=91.9KiB/s (94.1kB/s)(5920KiB/64396msec) clat (msec): min=7, max=287, avg=36.72, stdev=34.72 lat (msec): min=7, max=287, avg=36.73, stdev=34.72 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 215], 99.50th=[ 255], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 350, per=27.96%, avg=103.73, stdev=64.87, samples=112 iops : min= 1, max= 21, avg= 5.75, stdev= 4.08, samples=112 write: IOPS=6, BW=98.9KiB/s (101kB/s)(6368KiB/64396msec); 0 zone resets clat (msec): min=34, max=429, avg=127.05, stdev=55.05 lat (msec): min=34, max=429, avg=127.05, stdev=55.05 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 115], 60.00th=[ 128], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 205], 95.00th=[ 226], | 99.00th=[ 330], 99.50th=[ 380], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 192, per=25.45%, avg=99.25, stdev=39.80, samples=126 iops : min= 1, max= 12, avg= 5.46, stdev= 2.55, samples=126 lat (msec) : 10=0.78%, 20=16.02%, 50=22.14%, 100=24.61%, 250=34.90% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.53%, ctx=1340, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144518: Wed Aug 19 08:21:17 2026 read: IOPS=5, BW=89.0KiB/s (91.1kB/s)(5744KiB/64536msec) clat (msec): min=6, max=369, avg=38.39, stdev=40.13 lat (msec): min=6, max=369, avg=38.39, stdev=40.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 73], 95.00th=[ 113], | 99.00th=[ 220], 99.50th=[ 257], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 27, max= 351, per=26.26%, avg=97.42, stdev=62.80, samples=115 iops : min= 1, max= 21, avg= 5.37, stdev= 3.95, samples=115 write: IOPS=6, BW=101KiB/s (104kB/s)(6544KiB/64536msec); 0 zone resets clat (msec): min=38, max=353, avg=123.47, stdev=51.67 lat (msec): min=38, max=353, avg=123.48, stdev=51.67 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 90], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 157], 90.00th=[ 190], 95.00th=[ 215], | 99.00th=[ 288], 99.50th=[ 321], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 27, max= 191, per=26.25%, avg=102.37, stdev=41.04, samples=125 iops : min= 1, max= 11, avg= 5.66, stdev= 2.60, samples=125 lat (msec) : 10=2.47%, 20=14.97%, 50=20.44%, 100=26.69%, 250=33.59% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.56%, ctx=1389, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144520: Wed Aug 19 08:21:17 2026 read: IOPS=6, BW=100KiB/s (103kB/s)(6256KiB/62436msec) clat (msec): min=6, max=239, avg=35.31, stdev=31.21 lat (msec): min=6, max=239, avg=35.31, stdev=31.21 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 49], 90.00th=[ 64], 95.00th=[ 88], | 99.00th=[ 188], 99.50th=[ 239], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 318, per=28.97%, avg=107.46, stdev=72.11, samples=115 iops : min= 1, max= 19, avg= 5.97, stdev= 4.54, samples=115 write: IOPS=6, BW=96.6KiB/s (98.9kB/s)(6032KiB/62436msec); 0 zone resets clat (msec): min=36, max=435, avg=128.78, stdev=54.55 lat (msec): min=36, max=435, avg=128.79, stdev=54.54 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 194], 95.00th=[ 239], | 99.00th=[ 305], 99.50th=[ 321], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 31, max= 222, per=24.68%, avg=96.24, stdev=39.01, samples=123 iops : min= 1, max= 13, avg= 5.26, stdev= 2.46, samples=123 lat (msec) : 10=2.60%, 20=14.32%, 50=25.39%, 100=22.01%, 250=33.85% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.57%, ctx=1425, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144521: Wed Aug 19 08:21:17 2026 read: IOPS=5, BW=95.4KiB/s (97.6kB/s)(6032KiB/63260msec) clat (msec): min=7, max=264, avg=33.58, stdev=30.64 lat (msec): min=7, max=264, avg=33.58, stdev=30.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 63], 95.00th=[ 85], | 99.00th=[ 188], 99.50th=[ 249], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 341, per=28.09%, avg=104.22, stdev=70.33, samples=113 iops : min= 1, max= 21, avg= 5.77, stdev= 4.45, samples=113 write: IOPS=6, BW=98.9KiB/s (101kB/s)(6256KiB/63260msec); 0 zone resets clat (msec): min=42, max=395, avg=128.66, stdev=61.23 lat (msec): min=42, max=395, avg=128.66, stdev=61.23 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 209], 95.00th=[ 249], | 99.00th=[ 338], 99.50th=[ 355], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 28, max= 191, per=25.33%, avg=98.80, stdev=42.11, samples=125 iops : min= 1, max= 11, avg= 5.42, stdev= 2.67, samples=125 lat (msec) : 10=1.43%, 20=16.15%, 50=25.26%, 100=24.35%, 250=30.21% lat (msec) : 500=2.60% cpu : usr=0.06%, sys=1.54%, ctx=1346, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=371KiB/s (380kB/s), 89.0KiB/s-100KiB/s (91.1kB/s-103kB/s), io=23.4MiB (24.5MB), run=62436-64536msec WRITE: bw=390KiB/s (400kB/s), 96.6KiB/s-101KiB/s (98.9kB/s-104kB/s), io=24.6MiB (25.8MB), run=62436-64536msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144538: Wed Aug 19 08:21:34 2026 read: IOPS=1, BW=1248KiB/s (1278kB/s)(7168KiB/5745msec) clat (msec): min=118, max=1659, avg=421.83, stdev=563.11 lat (msec): min=118, max=1659, avg=421.83, stdev=563.11 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 120], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 174], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 518], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1560, max= 2048, per=57.28%, avg=1956.67, stdev=194.58, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=891KiB/s (913kB/s)(5120KiB/5745msec); 0 zone resets clat (msec): min=240, max=644, avg=500.08, stdev=154.38 lat (msec): min=240, max=644, avg=500.21, stdev=154.38 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2035, max= 4087, per=53.41%, avg=2554.50, stdev=1021.69, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 250=50.00%, 500=8.33%, 750=33.33%, 2000=8.33% cpu : usr=0.02%, sys=2.16%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144540: Wed Aug 19 08:21:34 2026 read: IOPS=0, BW=350KiB/s (359kB/s)(2048KiB/5848msec) clat (msec): min=74, max=162, avg=118.61, stdev=61.83 lat (msec): min=74, max=162, avg=118.61, stdev=61.82 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 1497, max= 2048, per=51.89%, avg=1772.50, stdev=389.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1751KiB/s (1793kB/s)(10.0MiB/5848msec); 0 zone resets clat (msec): min=160, max=2031, avg=547.03, stdev=535.04 lat (msec): min=160, max=2031, avg=547.13, stdev=535.08 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 275], | 30.00th=[ 313], 40.00th=[ 359], 50.00th=[ 372], 60.00th=[ 401], | 70.00th=[ 485], 80.00th=[ 502], 90.00th=[ 575], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 2035, max= 4063, per=53.99%, avg=2582.57, stdev=926.53, samples=7 iops : min= 1, max= 3, avg= 1.86, stdev= 0.90, samples=7 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.75%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144542: Wed Aug 19 08:21:34 2026 read: IOPS=1, BW=1039KiB/s (1064kB/s)(6144KiB/5914msec) clat (msec): min=117, max=346, avg=191.52, stdev=84.26 lat (msec): min=117, max=346, avg=191.52, stdev=84.26 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 199], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 2019, max= 4071, per=74.51%, avg=2545.25, stdev=1017.25, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1039KiB/s (1064kB/s)(6144KiB/5914msec); 0 zone resets clat (msec): min=111, max=2331, avg=744.25, stdev=810.70 lat (msec): min=112, max=2339, avg=745.80, stdev=813.40 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 558], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1903, max= 2048, per=42.00%, avg=2008.80, stdev=60.20, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.50%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144544: Wed Aug 19 08:21:34 2026 read: IOPS=0, BW=854KiB/s (875kB/s)(5120KiB/5994msec) clat (msec): min=75, max=295, avg=189.15, stdev=87.77 lat (msec): min=75, max=295, avg=189.15, stdev=87.77 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 77], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1903, max= 4071, per=78.23%, avg=2672.33, stdev=1213.30, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1196KiB/s (1225kB/s)(7168KiB/5994msec); 0 zone resets clat (msec): min=134, max=2178, avg=687.80, stdev=706.14 lat (msec): min=134, max=2178, avg=687.90, stdev=706.13 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 194], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 397], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 818], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1903, max= 2048, per=42.07%, avg=2012.20, stdev=62.21, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.20%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3417KiB/s (3499kB/s), 350KiB/s-1248KiB/s (359kB/s-1278kB/s), io=20.0MiB (20.0MB), run=5745-5994msec WRITE: bw=4783KiB/s (4898kB/s), 891KiB/s-1751KiB/s (913kB/s-1793kB/s), io=28.0MiB (29.4MB), run=5745-5994msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144537: Wed Aug 19 08:21:34 2026 read: IOPS=1, BW=1703KiB/s (1744kB/s)(7168KiB/4208msec) clat (msec): min=2, max=1706, avg=395.31, stdev=590.35 lat (msec): min=2, max=1706, avg=395.31, stdev=590.35 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 153], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 409], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 2035, max= 4071, per=83.97%, avg=2866.75, stdev=1001.92, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1217KiB/s (1246kB/s)(5120KiB/4208msec); 0 zone resets clat (msec): min=135, max=471, avg=276.54, stdev=132.62 lat (msec): min=135, max=471, avg=276.63, stdev=132.61 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2035, max= 4096, per=56.95%, avg=2722.00, stdev=1189.92, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 4=8.33%, 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.07%, sys=11.98%, ctx=310, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144539: Wed Aug 19 08:21:34 2026 read: IOPS=0, BW=341KiB/s (350kB/s)(2048KiB/5998msec) clat (msec): min=165, max=191, avg=178.43, stdev=18.72 lat (msec): min=165, max=191, avg=178.44, stdev=18.72 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 1756, max= 1759, per=51.48%, avg=1757.50, stdev= 2.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1707KiB/s (1748kB/s)(10.0MiB/5998msec); 0 zone resets clat (msec): min=178, max=2182, avg=542.62, stdev=590.73 lat (msec): min=178, max=2182, avg=542.72, stdev=590.73 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 222], | 30.00th=[ 239], 40.00th=[ 241], 50.00th=[ 405], 60.00th=[ 464], | 70.00th=[ 493], 80.00th=[ 502], 90.00th=[ 510], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1759, max= 4047, per=47.79%, avg=2284.43, stdev=784.18, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.79, samples=7 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.95%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144541: Wed Aug 19 08:21:34 2026 read: IOPS=1, BW=1219KiB/s (1249kB/s)(6144KiB/5039msec) clat (usec): min=406, max=600007, avg=222414.00, stdev=269849.37 lat (usec): min=407, max=600008, avg=222415.26, stdev=269849.44 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 408], 10.00th=[ 408], 20.00th=[ 652], | 30.00th=[ 652], 40.00th=[ 1844], 50.00th=[ 1844], 60.00th=[235930], | 70.00th=[492831], 80.00th=[492831], 90.00th=[599786], 95.00th=[599786], | 99.00th=[599786], 99.50th=[599786], 99.90th=[599786], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 4071, max= 6144, per=100.00%, avg=5107.50, stdev=1465.83, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1219KiB/s (1249kB/s)(6144KiB/5039msec); 0 zone resets clat (msec): min=143, max=1948, avg=594.44, stdev=679.90 lat (msec): min=143, max=1948, avg=594.75, stdev=679.87 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 401], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 2035, max= 4087, per=53.44%, avg=2554.50, stdev=1021.69, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=7.84%, ctx=154, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144543: Wed Aug 19 08:21:34 2026 read: IOPS=1, BW=1153KiB/s (1181kB/s)(5120KiB/4440msec) clat (usec): min=407, max=242917, avg=91964.47, stdev=125556.71 lat (usec): min=407, max=242919, avg=91965.59, stdev=125556.97 clat percentiles (usec): | 1.00th=[ 408], 5.00th=[ 408], 10.00th=[ 408], 20.00th=[ 408], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 734], 60.00th=[ 734], | 70.00th=[214959], 80.00th=[214959], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 2035, max= 5278, per=100.00%, avg=3656.50, stdev=2293.15, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1614KiB/s (1653kB/s)(7168KiB/4440msec); 0 zone resets clat (msec): min=168, max=1834, avg=534.39, stdev=595.24 lat (msec): min=168, max=1835, avg=534.48, stdev=595.24 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 226], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 266], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 659], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1656, max= 3518, per=47.25%, avg=2258.40, stdev=723.46, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=9.69%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3414KiB/s (3496kB/s), 341KiB/s-1703KiB/s (350kB/s-1744kB/s), io=20.0MiB (20.0MB), run=4208-5998msec WRITE: bw=4780KiB/s (4895kB/s), 1217KiB/s-1707KiB/s (1246kB/s-1748kB/s), io=28.0MiB (29.4MB), run=4208-5998msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144551: Wed Aug 19 08:21:50 2026 read: IOPS=1, BW=4521KiB/s (4629kB/s)(12.0MiB/2718msec) clat (msec): min=755, max=1065, avg=872.68, stdev=168.39 lat (msec): min=755, max=1065, avg=872.69, stdev=168.39 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7984, max= 8159, per=100.00%, avg=8071.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.05%, ctx=282, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144552: Wed Aug 19 08:21:50 2026 read: IOPS=0, BW=1293KiB/s (1324kB/s)(4096KiB/3167msec) clat (nsec): min=834781k, max=834781k, avg=834780725.00, stdev= 0.00 lat (nsec): min=834783k, max=834783k, avg=834783480.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2587KiB/s (2649kB/s)(8192KiB/3167msec); 0 zone resets clat (msec): min=915, max=1388, avg=1152.07, stdev=334.41 lat (msec): min=916, max=1388, avg=1152.53, stdev=334.26 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8159, max= 8159, per=79.61%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.19%, sys=4.14%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144553: Wed Aug 19 08:21:50 2026 write: IOPS=0, BW=3844KiB/s (3936kB/s)(12.0MiB/3197msec); 0 zone resets clat (msec): min=547, max=1428, avg=1055.14, stdev=455.53 lat (msec): min=547, max=1429, avg=1055.54, stdev=455.69 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7953, max= 8000, per=77.83%, avg=7976.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.35%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144554: Wed Aug 19 08:21:50 2026 write: IOPS=1, BW=4514KiB/s (4623kB/s)(12.0MiB/2722msec); 0 zone resets clat (msec): min=415, max=1496, avg=880.20, stdev=556.58 lat (msec): min=415, max=1497, avg=880.75, stdev=556.47 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7984, max= 8000, per=77.98%, avg=7992.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.12%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5173KiB/s (5298kB/s), 1293KiB/s-4521KiB/s (1324kB/s-4629kB/s), io=16.0MiB (16.8MB), run=2718-3167msec WRITE: bw=10.0MiB/s (10.5MB/s), 2587KiB/s-4514KiB/s (2649kB/s-4623kB/s), io=32.0MiB (33.6MB), run=2722-3197msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144556: Wed Aug 19 08:21:50 2026 read: IOPS=0, BW=4004KiB/s (4100kB/s)(12.0MiB/3069msec) clat (msec): min=298, max=1527, avg=1022.67, stdev=643.48 lat (msec): min=298, max=1527, avg=1022.67, stdev=643.48 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.61%, ctx=39, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144557: Wed Aug 19 08:21:50 2026 read: IOPS=0, BW=1157KiB/s (1185kB/s)(4096KiB/3539msec) clat (nsec): min=1103.3M, max=1103.3M, avg=1103330687.00, stdev= 0.00 lat (nsec): min=1103.3M, max=1103.3M, avg=1103333184.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2315KiB/s (2370kB/s)(8192KiB/3539msec); 0 zone resets clat (msec): min=637, max=1785, avg=1211.41, stdev=811.24 lat (msec): min=640, max=1790, avg=1215.49, stdev=812.80 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8126, max= 8126, per=87.76%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.60%, ctx=29, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144558: Wed Aug 19 08:21:50 2026 write: IOPS=0, BW=3579KiB/s (3665kB/s)(12.0MiB/3433msec); 0 zone resets clat (msec): min=332, max=1607, avg=1143.02, stdev=704.08 lat (msec): min=333, max=1608, avg=1143.58, stdev=703.81 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8126, max= 8126, per=87.76%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.53%, ctx=27, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144559: Wed Aug 19 08:21:50 2026 write: IOPS=1, BW=4730KiB/s (4843kB/s)(12.0MiB/2598msec); 0 zone resets clat (msec): min=663, max=989, avg=865.32, stdev=176.48 lat (msec): min=663, max=989, avg=865.73, stdev=176.58 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8078, max= 8126, per=87.50%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.12%, sys=5.28%, ctx=36, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4630KiB/s (4741kB/s), 1157KiB/s-4004KiB/s (1185kB/s-4100kB/s), io=16.0MiB (16.8MB), run=3069-3539msec WRITE: bw=9259KiB/s (9481kB/s), 2315KiB/s-4730KiB/s (2370kB/s-4843kB/s), io=32.0MiB (33.6MB), run=2598-3539msec