== sanity test 398b: DIO and buffer IO race ============== 22:27:29 (1788834449) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.46497 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145607: Mon Sep 7 22:29:57 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(5992KiB/124870msec) clat (usec): min=36, max=404668, avg=39707.56, stdev=31546.91 lat (usec): min=36, max=404669, avg=39709.06, stdev=31548.15 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 113], 20.00th=[ 18220], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[129500], 99.50th=[160433], 99.90th=[362808], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 109, per=25.59%, avg=47.60, stdev=21.02, samples=245 iops : min= 1, max= 27, avg=11.24, stdev= 5.32, samples=245 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6296KiB/124870msec); 0 zone resets clat (usec): min=917, max=1024.4k, avg=41316.42, stdev=48559.20 lat (usec): min=918, max=1024.4k, avg=41319.96, stdev=48557.57 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1385], | 20.00th=[ 3425], 30.00th=[ 8291], 40.00th=[ 18482], | 50.00th=[ 31327], 60.00th=[ 41157], 70.00th=[ 54789], | 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[ 116917], | 99.00th=[ 175113], 99.50th=[ 210764], 99.90th=[ 337642], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 127, per=25.78%, avg=50.27, stdev=19.02, samples=244 iops : min= 1, max= 31, avg=11.91, stdev= 4.79, samples=244 lat (usec) : 50=0.62%, 100=4.10%, 250=0.42%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=7.16%, 4=3.87%, 10=5.34%, 20=11.00%, 50=36.43% lat (msec) : 100=24.32%, 250=6.05%, 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=4.70%, ctx=6425, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145608: Mon Sep 7 22:29:57 2026 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(5940KiB/128827msec) clat (usec): min=25, max=1059.3k, avg=41170.18, stdev=41046.01 lat (usec): min=26, max=1059.3k, avg=41178.92, stdev=41048.48 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 2008], | 20.00th=[ 18744], 30.00th=[ 23987], 40.00th=[ 28181], | 50.00th=[ 33817], 60.00th=[ 40633], 70.00th=[ 50070], | 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[ 137364], 99.50th=[ 183501], 99.90th=[ 404751], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 7, max= 103, per=25.03%, avg=46.56, stdev=19.87, samples=248 iops : min= 1, max= 25, avg=10.97, stdev= 5.01, samples=248 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6348KiB/128827msec); 0 zone resets clat (usec): min=987, max=371157, avg=42365.89, stdev=46077.45 lat (usec): min=988, max=371159, avg=42369.88, stdev=46077.01 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1434], 20.00th=[ 3523], | 30.00th=[ 8455], 40.00th=[ 19792], 50.00th=[ 30016], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 72877], 90.00th=[ 98042], 95.00th=[121111], | 99.00th=[227541], 99.50th=[263193], 99.90th=[304088], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 116, per=25.07%, avg=48.89, stdev=21.81, samples=252 iops : min= 1, max= 29, avg=11.56, stdev= 5.50, samples=252 lat (usec) : 50=0.75%, 100=3.55%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.90%, 4=4.46%, 10=5.83%, 20=9.70%, 50=36.49% lat (msec) : 100=25.23%, 250=6.12%, 500=0.42%, 2000=0.03% cpu : usr=0.07%, sys=4.57%, ctx=6355, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145609: Mon Sep 7 22:29:57 2026 read: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6028KiB/126499msec) clat (usec): min=32, max=456568, avg=40386.75, stdev=32312.94 lat (usec): min=32, max=456568, avg=40388.49, stdev=32313.01 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 83], 20.00th=[ 17433], | 30.00th=[ 23200], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[164627], 99.90th=[291505], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 119, per=25.64%, avg=47.68, stdev=19.38, samples=247 iops : min= 1, max= 29, avg=11.26, stdev= 4.86, samples=247 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6260KiB/126499msec); 0 zone resets clat (usec): min=928, max=1011.7k, avg=41696.63, stdev=49627.65 lat (usec): min=930, max=1011.7k, avg=41698.65, stdev=49627.94 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1319], | 20.00th=[ 3785], 30.00th=[ 8029], 40.00th=[ 19792], | 50.00th=[ 31327], 60.00th=[ 40109], 70.00th=[ 53740], | 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[ 119014], | 99.00th=[ 200279], 99.50th=[ 227541], 99.90th=[ 425722], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 127, per=25.20%, avg=49.15, stdev=20.11, samples=249 iops : min= 1, max= 31, avg=11.62, stdev= 5.07, samples=249 lat (usec) : 50=0.78%, 100=4.46%, 250=0.20%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=7.10%, 4=3.42%, 10=6.09%, 20=10.35%, 50=36.26% lat (msec) : 100=24.77%, 250=6.09%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=4.61%, ctx=6335, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145610: Mon Sep 7 22:29:57 2026 read: IOPS=12, BW=49.0KiB/s (50.2kB/s)(6052KiB/123398msec) clat (usec): min=33, max=454928, avg=40723.27, stdev=32095.94 lat (usec): min=33, max=454930, avg=40725.34, stdev=32095.69 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 5997], 20.00th=[ 18744], | 30.00th=[ 23725], 40.00th=[ 28705], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[177210], 99.90th=[254804], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 15, max= 127, per=26.56%, avg=49.39, stdev=20.24, samples=239 iops : min= 3, max= 31, avg=11.68, stdev= 5.10, samples=239 write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6236KiB/123398msec); 0 zone resets clat (usec): min=969, max=1241.4k, avg=39388.22, stdev=50394.68 lat (usec): min=971, max=1241.4k, avg=39397.93, stdev=50407.62 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1385], | 20.00th=[ 3490], 30.00th=[ 7701], 40.00th=[ 16450], | 50.00th=[ 29230], 60.00th=[ 39584], 70.00th=[ 50594], | 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[ 115868], | 99.00th=[ 170918], 99.50th=[ 212861], 99.90th=[ 287310], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 127, per=25.80%, avg=50.32, stdev=19.96, samples=241 iops : min= 1, max= 31, avg=11.92, stdev= 5.02, samples=241 lat (usec) : 50=0.49%, 100=3.58%, 250=0.52%, 500=0.23%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.97%, 4=3.87%, 10=6.74%, 20=10.32%, 50=37.27% lat (msec) : 100=24.25%, 250=5.40%, 500=0.23%, 2000=0.03% cpu : usr=0.08%, sys=4.82%, ctx=6253, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (191kB/s), 46.1KiB/s-49.0KiB/s (47.2kB/s-50.2kB/s), io=23.4MiB (24.6MB), run=123398-128827msec WRITE: bw=195KiB/s (200kB/s), 49.3KiB/s-50.5KiB/s (50.5kB/s-51.7kB/s), io=24.6MiB (25.7MB), run=123398-128827msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145602: Mon Sep 7 22:32:21 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(5992KiB/270073msec) clat (msec): min=5, max=1068, avg=35.28, stdev=44.21 lat (msec): min=5, max=1068, avg=35.28, stdev=44.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 107], | 99.00th=[ 176], 99.50th=[ 222], 99.90th=[ 338], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 80, per=27.71%, avg=24.39, stdev=16.16, samples=475 iops : min= 1, max= 20, avg= 5.49, stdev= 4.08, samples=475 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6296KiB/270073msec); 0 zone resets clat (msec): min=33, max=508, avg=137.75, stdev=59.70 lat (msec): min=33, max=508, avg=137.76, stdev=59.70 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 182], 90.00th=[ 215], 95.00th=[ 247], | 99.00th=[ 317], 99.50th=[ 355], 99.90th=[ 506], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 48, per=25.06%, avg=23.05, stdev=10.00, samples=527 iops : min= 1, max= 12, avg= 5.15, stdev= 2.56, samples=527 lat (msec) : 10=3.52%, 20=18.36%, 50=18.10%, 100=20.64%, 250=36.72% lat (msec) : 500=2.57%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5142, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145603: Mon Sep 7 22:32:21 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(5940KiB/272694msec) clat (msec): min=4, max=1076, avg=34.29, stdev=43.32 lat (msec): min=4, max=1076, avg=34.29, stdev=43.32 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 103], | 99.00th=[ 169], 99.50th=[ 192], 99.90th=[ 418], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 95, per=28.26%, avg=24.87, stdev=16.30, samples=462 iops : min= 1, max= 23, avg= 5.61, stdev= 4.11, samples=462 write: IOPS=5, BW=23.3KiB/s (23.8kB/s)(6348KiB/272694msec); 0 zone resets clat (msec): min=36, max=516, avg=139.48, stdev=63.89 lat (msec): min=36, max=516, avg=139.48, stdev=63.90 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 127], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 226], 95.00th=[ 259], | 99.00th=[ 334], 99.50th=[ 384], 99.90th=[ 493], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 48, per=24.96%, avg=22.97, stdev=10.22, samples=533 iops : min= 1, max= 12, avg= 5.13, stdev= 2.61, samples=533 lat (msec) : 10=3.97%, 20=17.81%, 50=18.33%, 100=21.42%, 250=35.38% lat (msec) : 500=3.03%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.03%, ctx=5148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145604: Mon Sep 7 22:32:21 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6028KiB/270213msec) clat (msec): min=5, max=399, avg=36.02, stdev=36.42 lat (msec): min=5, max=399, avg=36.02, stdev=36.42 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 84], 95.00th=[ 109], | 99.00th=[ 178], 99.50th=[ 201], 99.90th=[ 342], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 103, per=26.95%, avg=23.71, stdev=16.75, samples=491 iops : min= 1, max= 25, avg= 5.32, stdev= 4.21, samples=491 write: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6260KiB/270213msec); 0 zone resets clat (msec): min=41, max=1200, avg=137.72, stdev=66.08 lat (msec): min=41, max=1200, avg=137.73, stdev=66.08 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 220], 95.00th=[ 253], | 99.00th=[ 317], 99.50th=[ 397], 99.90th=[ 542], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 55, per=24.94%, avg=22.94, stdev=10.33, samples=526 iops : min= 1, max= 13, avg= 5.12, stdev= 2.65, samples=526 lat (msec) : 10=4.52%, 20=16.31%, 50=18.55%, 100=22.30%, 250=35.42% lat (msec) : 500=2.80%, 750=0.07%, 2000=0.03% cpu : usr=0.03%, sys=1.04%, ctx=4917, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145606: Mon Sep 7 22:32:21 2026 read: IOPS=5, BW=22.5KiB/s (22.0kB/s)(6052KiB/269486msec) clat (msec): min=5, max=316, avg=34.17, stdev=34.63 lat (msec): min=5, max=316, avg=34.18, stdev=34.63 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 109], | 99.00th=[ 169], 99.50th=[ 197], 99.90th=[ 309], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 104, per=28.98%, avg=25.50, stdev=17.60, samples=459 iops : min= 1, max= 26, avg= 5.76, stdev= 4.46, samples=459 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6236KiB/269486msec); 0 zone resets clat (msec): min=32, max=1211, avg=139.42, stdev=67.25 lat (msec): min=32, max=1211, avg=139.43, stdev=67.25 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 91], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 218], 95.00th=[ 253], | 99.00th=[ 342], 99.50th=[ 401], 99.90th=[ 575], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 55, per=24.86%, avg=22.87, stdev= 9.82, samples=525 iops : min= 1, max= 13, avg= 5.10, stdev= 2.53, samples=525 lat (msec) : 10=4.85%, 20=17.25%, 50=18.42%, 100=20.77%, 250=35.81% lat (msec) : 500=2.80%, 750=0.07%, 2000=0.03% cpu : usr=0.03%, sys=1.02%, ctx=5120, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=88.1KiB/s (90.2kB/s), 21.8KiB/s-22.5KiB/s (22.3kB/s-22.0kB/s), io=23.4MiB (24.6MB), run=269486-272694msec WRITE: bw=92.2KiB/s (94.4kB/s), 23.1KiB/s-23.3KiB/s (23.7kB/s-23.9kB/s), io=24.6MiB (25.7MB), run=269486-272694msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145668: Mon Sep 7 22:33:06 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5920KiB/34671msec) clat (usec): min=33, max=291970, avg=43548.85, stdev=41983.64 lat (usec): min=33, max=291971, avg=43549.99, stdev=41983.68 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 13698], 40.00th=[ 30016], 50.00th=[ 40109], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[181404], 99.50th=[196084], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 510, per=24.70%, avg=170.44, stdev=82.03, samples=68 iops : min= 1, max= 31, avg= 9.90, stdev= 5.18, samples=68 write: IOPS=11, BW=184KiB/s (188kB/s)(6368KiB/34671msec); 0 zone resets clat (usec): min=1371, max=389995, avg=45908.80, stdev=55843.06 lat (usec): min=1372, max=389998, avg=45911.45, stdev=55842.54 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1680], 10.00th=[ 2245], 20.00th=[ 5997], | 30.00th=[ 9110], 40.00th=[ 14877], 50.00th=[ 26608], 60.00th=[ 39584], | 70.00th=[ 53216], 80.00th=[ 77071], 90.00th=[117965], 95.00th=[147850], | 99.00th=[267387], 99.50th=[383779], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 410, per=25.73%, avg=186.79, stdev=77.26, samples=67 iops : min= 1, max= 25, avg=10.93, stdev= 4.87, samples=67 lat (usec) : 50=2.21%, 100=10.03%, 250=0.91%, 500=0.65%, 1000=0.13% lat (msec) : 2=4.69%, 4=3.78%, 10=8.46%, 20=8.33%, 50=25.52% lat (msec) : 100=24.48%, 250=10.03%, 500=0.78% cpu : usr=0.05%, sys=4.88%, ctx=1308, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145669: Mon Sep 7 22:33:06 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(5744KiB/32963msec) clat (usec): min=35, max=329511, avg=46548.13, stdev=44645.92 lat (usec): min=35, max=329512, avg=46549.14, stdev=44645.92 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 75], | 30.00th=[ 22676], 40.00th=[ 30540], 50.00th=[ 39584], 60.00th=[ 50070], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[116917], | 99.00th=[179307], 99.50th=[299893], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 56, max= 413, per=25.22%, avg=174.02, stdev=76.50, samples=64 iops : min= 3, max= 25, avg=10.14, stdev= 4.81, samples=64 write: IOPS=12, BW=199KiB/s (203kB/s)(6544KiB/32963msec); 0 zone resets clat (usec): min=1213, max=356195, avg=39022.34, stdev=46706.74 lat (usec): min=1215, max=356196, avg=39024.16, stdev=46706.70 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1647], 10.00th=[ 2147], 20.00th=[ 5735], | 30.00th=[ 8979], 40.00th=[ 13960], 50.00th=[ 20055], 60.00th=[ 33162], | 70.00th=[ 46924], 80.00th=[ 68682], 90.00th=[ 98042], 95.00th=[125305], | 99.00th=[204473], 99.50th=[283116], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 63, max= 539, per=27.72%, avg=201.27, stdev=87.16, samples=63 iops : min= 3, max= 33, avg=11.86, stdev= 5.49, samples=63 lat (usec) : 50=1.56%, 100=9.51%, 250=0.78%, 750=0.26%, 1000=0.26% lat (msec) : 2=4.82%, 4=3.78%, 10=9.11%, 20=9.77%, 50=26.56% lat (msec) : 100=23.96%, 250=8.98%, 500=0.65% cpu : usr=0.06%, sys=4.60%, ctx=1396, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145670: Mon Sep 7 22:33:06 2026 read: IOPS=11, BW=191KiB/s (196kB/s)(6256KiB/32669msec) clat (usec): min=37, max=229096, avg=44948.36, stdev=39513.42 lat (usec): min=38, max=229097, avg=44950.52, stdev=39514.53 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 80], | 30.00th=[ 20841], 40.00th=[ 31851], 50.00th=[ 41681], 60.00th=[ 50070], | 70.00th=[ 60031], 80.00th=[ 76022], 90.00th=[100140], 95.00th=[116917], | 99.00th=[156238], 99.50th=[206570], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 62, max= 413, per=27.81%, avg=191.89, stdev=76.31, samples=64 iops : min= 3, max= 25, avg=11.28, stdev= 4.82, samples=64 write: IOPS=11, BW=185KiB/s (189kB/s)(6032KiB/32669msec); 0 zone resets clat (usec): min=1206, max=288485, avg=39672.31, stdev=43839.01 lat (usec): min=1207, max=288487, avg=39692.75, stdev=43838.81 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1647], 10.00th=[ 2442], 20.00th=[ 5669], | 30.00th=[ 9241], 40.00th=[ 15270], 50.00th=[ 22938], 60.00th=[ 34341], | 70.00th=[ 49021], 80.00th=[ 69731], 90.00th=[102237], 95.00th=[124257], | 99.00th=[200279], 99.50th=[256902], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 349, per=25.65%, avg=186.25, stdev=72.38, samples=63 iops : min= 1, max= 21, avg=10.90, stdev= 4.59, samples=63 lat (usec) : 50=1.69%, 100=9.64%, 250=0.65%, 500=0.91% lat (msec) : 2=4.56%, 4=3.12%, 10=8.85%, 20=7.81%, 50=27.47% lat (msec) : 100=25.00%, 250=10.03%, 500=0.26% cpu : usr=0.05%, sys=5.23%, ctx=1432, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145671: Mon Sep 7 22:33:06 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6032KiB/32664msec) clat (usec): min=38, max=309729, avg=43673.02, stdev=42128.93 lat (usec): min=38, max=309730, avg=43675.27, stdev=42128.03 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 57], 20.00th=[ 84], | 30.00th=[ 20055], 40.00th=[ 31589], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[120062], | 99.00th=[219153], 99.50th=[227541], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 378, per=27.11%, avg=187.08, stdev=85.35, samples=63 iops : min= 1, max= 23, avg=10.95, stdev= 5.40, samples=63 write: IOPS=11, BW=192KiB/s (196kB/s)(6256KiB/32664msec); 0 zone resets clat (usec): min=1342, max=256384, avg=40617.06, stdev=47710.54 lat (usec): min=1347, max=256389, avg=40639.94, stdev=47741.96 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1582], 10.00th=[ 2114], 20.00th=[ 4621], | 30.00th=[ 7767], 40.00th=[ 11863], 50.00th=[ 21627], 60.00th=[ 34341], | 70.00th=[ 47449], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[139461], | 99.00th=[223347], 99.50th=[254804], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 57, max= 477, per=26.50%, avg=192.39, stdev=81.87, samples=64 iops : min= 3, max= 29, avg=11.30, stdev= 5.20, samples=64 lat (usec) : 50=1.30%, 100=9.64%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=5.08%, 4=4.56%, 10=9.24%, 20=8.46%, 50=28.26% lat (msec) : 100=22.66%, 250=9.24%, 500=0.39% cpu : usr=0.05%, sys=4.54%, ctx=1366, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=691KiB/s (707kB/s), 171KiB/s-191KiB/s (175kB/s-196kB/s), io=23.4MiB (24.5MB), run=32664-34671msec WRITE: bw=727KiB/s (744kB/s), 184KiB/s-199KiB/s (188kB/s-203kB/s), io=24.6MiB (25.8MB), run=32664-34671msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145664: Mon Sep 7 22:33:46 2026 read: IOPS=5, BW=80.0KiB/s (81.0kB/s)(5920KiB/73955msec) clat (msec): min=7, max=337, avg=38.75, stdev=42.06 lat (msec): min=7, max=337, avg=38.75, stdev=42.06 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 70], 95.00th=[ 131], | 99.00th=[ 222], 99.50th=[ 239], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 287, per=28.24%, avg=90.09, stdev=57.86, samples=129 iops : min= 1, max= 17, avg= 4.91, stdev= 3.68, samples=129 write: IOPS=5, BW=86.1KiB/s (88.2kB/s)(6368KiB/73955msec); 0 zone resets clat (msec): min=38, max=636, avg=149.16, stdev=81.46 lat (msec): min=38, max=636, avg=149.17, stdev=81.46 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 146], | 70.00th=[ 169], 80.00th=[ 199], 90.00th=[ 268], 95.00th=[ 326], | 99.00th=[ 397], 99.50th=[ 439], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 30, max= 221, per=26.23%, avg=88.12, stdev=44.55, samples=142 iops : min= 1, max= 13, avg= 4.78, stdev= 2.82, samples=142 lat (msec) : 10=1.69%, 20=15.36%, 50=22.27%, 100=21.88%, 250=32.81% lat (msec) : 500=5.86%, 750=0.13% cpu : usr=0.03%, sys=1.11%, ctx=1310, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145665: Mon Sep 7 22:33:46 2026 read: IOPS=4, BW=76.6KiB/s (78.4kB/s)(5744KiB/74997msec) clat (msec): min=6, max=298, avg=41.08, stdev=43.93 lat (msec): min=6, max=298, avg=41.08, stdev=43.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 99], 95.00th=[ 146], | 99.00th=[ 224], 99.50th=[ 255], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 29, max= 349, per=30.06%, avg=95.88, stdev=62.26, samples=118 iops : min= 1, max= 21, avg= 5.25, stdev= 3.95, samples=118 write: IOPS=5, BW=87.3KiB/s (89.3kB/s)(6544KiB/74997msec); 0 zone resets clat (msec): min=37, max=537, avg=146.67, stdev=79.28 lat (msec): min=37, max=537, avg=146.68, stdev=79.28 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 109], 50.00th=[ 126], 60.00th=[ 144], | 70.00th=[ 174], 80.00th=[ 203], 90.00th=[ 253], 95.00th=[ 305], | 99.00th=[ 380], 99.50th=[ 456], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 255, per=26.95%, avg=90.55, stdev=47.00, samples=142 iops : min= 1, max= 15, avg= 4.92, stdev= 2.99, samples=142 lat (msec) : 10=2.60%, 20=16.80%, 50=17.45%, 100=24.35%, 250=32.94% lat (msec) : 500=5.73%, 750=0.13% cpu : usr=0.04%, sys=1.08%, ctx=1246, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145666: Mon Sep 7 22:33:46 2026 read: IOPS=5, BW=86.5KiB/s (88.6kB/s)(6256KiB/72290msec) clat (msec): min=7, max=218, avg=38.04, stdev=38.80 lat (msec): min=7, max=218, avg=38.04, stdev=38.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 86], 95.00th=[ 132], | 99.00th=[ 201], 99.50th=[ 213], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 30, max= 383, per=30.26%, avg=96.52, stdev=74.62, samples=128 iops : min= 1, max= 23, avg= 5.30, stdev= 4.69, samples=128 write: IOPS=5, BW=83.4KiB/s (85.4kB/s)(6032KiB/72290msec); 0 zone resets clat (msec): min=47, max=553, avg=151.38, stdev=83.27 lat (msec): min=47, max=553, avg=151.38, stdev=83.27 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 88], | 30.00th=[ 104], 40.00th=[ 113], 50.00th=[ 129], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 203], 90.00th=[ 262], 95.00th=[ 326], | 99.00th=[ 481], 99.50th=[ 493], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 29, max= 191, per=24.88%, avg=83.60, stdev=43.06, samples=142 iops : min= 1, max= 11, avg= 4.49, stdev= 2.73, samples=142 lat (msec) : 10=2.21%, 20=20.31%, 50=18.49%, 100=19.66%, 250=33.98% lat (msec) : 500=5.21%, 750=0.13% cpu : usr=0.02%, sys=1.02%, ctx=1292, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145667: Mon Sep 7 22:33:46 2026 read: IOPS=5, BW=81.5KiB/s (83.4kB/s)(6032KiB/74022msec) clat (msec): min=7, max=298, avg=39.05, stdev=38.24 lat (msec): min=7, max=298, avg=39.05, stdev=38.24 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 88], 95.00th=[ 117], | 99.00th=[ 201], 99.50th=[ 253], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 350, per=29.73%, avg=94.84, stdev=64.92, samples=124 iops : min= 1, max= 21, avg= 5.23, stdev= 4.05, samples=124 write: IOPS=5, BW=84.5KiB/s (86.5kB/s)(6256KiB/74022msec); 0 zone resets clat (msec): min=43, max=704, avg=151.47, stdev=91.54 lat (msec): min=43, max=704, avg=151.47, stdev=91.54 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 110], 50.00th=[ 125], 60.00th=[ 142], | 70.00th=[ 169], 80.00th=[ 205], 90.00th=[ 268], 95.00th=[ 326], | 99.00th=[ 502], 99.50th=[ 558], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 30, max= 192, per=25.57%, avg=85.90, stdev=44.58, samples=143 iops : min= 1, max= 12, avg= 4.63, stdev= 2.82, samples=143 lat (msec) : 10=1.56%, 20=16.28%, 50=20.83%, 100=23.44%, 250=31.77% lat (msec) : 500=5.60%, 750=0.52% cpu : usr=0.03%, sys=1.03%, ctx=1294, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=319KiB/s (327kB/s), 76.6KiB/s-86.5KiB/s (78.4kB/s-88.6kB/s), io=23.4MiB (24.5MB), run=72290-74997msec WRITE: bw=336KiB/s (344kB/s), 83.4KiB/s-87.3KiB/s (85.4kB/s-89.3kB/s), io=24.6MiB (25.8MB), run=72290-74997msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145688: Mon Sep 7 22:34:05 2026 read: IOPS=1, BW=1250KiB/s (1280kB/s)(7168KiB/5735msec) clat (msec): min=74, max=266, avg=164.03, stdev=64.37 lat (msec): min=74, max=266, avg=164.03, stdev=64.37 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 126], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 142], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 215], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 1988, max= 3676, per=100.00%, avg=2353.80, stdev=739.48, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=893KiB/s (914kB/s)(5120KiB/5735msec); 0 zone resets clat (msec): min=81, max=2558, avg=868.09, stdev=1052.70 lat (msec): min=81, max=2558, avg=868.19, stdev=1052.70 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1988, max= 4039, per=95.76%, avg=2690.00, stdev=1168.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.95%, ctx=305, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145689: Mon Sep 7 22:34:05 2026 read: IOPS=0, BW=201KiB/s (206kB/s)(2048KiB/10205msec) clat (usec): min=1398, max=2845.0k, avg=1423199.75, stdev=2010730.14 lat (usec): min=1400, max=2845.0k, avg=1423201.69, stdev=2010730.92 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], | 20.00th=[ 1401], 30.00th=[ 1401], 40.00th=[ 1401], | 50.00th=[ 1401], 60.00th=[2835350], 70.00th=[2835350], | 80.00th=[2835350], 90.00th=[2835350], 95.00th=[2835350], | 99.00th=[2835350], 99.50th=[2835350], 99.90th=[2835350], | 99.95th=[2835350], 99.99th=[2835350] bw ( KiB/s): min= 2043, max= 2048, per=100.00%, avg=2045.50, stdev= 3.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=0, BW=1003KiB/s (1028kB/s)(10.0MiB/10205msec); 0 zone resets clat (msec): min=173, max=3860, avg=731.51, stdev=1122.58 lat (msec): min=177, max=3860, avg=731.99, stdev=1122.34 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 182], | 30.00th=[ 220], 40.00th=[ 226], 50.00th=[ 384], 60.00th=[ 388], | 70.00th=[ 464], 80.00th=[ 468], 90.00th=[ 944], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 1988, max= 4087, per=100.00%, avg=3033.33, stdev=1120.06, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=5.75%, ctx=595, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145690: Mon Sep 7 22:34:05 2026 read: IOPS=0, BW=630KiB/s (645kB/s)(6144KiB/9752msec) clat (usec): min=848, max=269335, avg=140884.37, stdev=116409.70 lat (usec): min=850, max=269337, avg=140885.60, stdev=116409.71 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[ 1287], | 30.00th=[ 1287], 40.00th=[141558], 50.00th=[141558], 60.00th=[193987], | 70.00th=[238027], 80.00th=[238027], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 2000, max= 4087, per=100.00%, avg=3370.00, stdev=1186.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=630KiB/s (645kB/s)(6144KiB/9752msec); 0 zone resets clat (msec): min=189, max=3825, avg=1437.18, stdev=1687.07 lat (msec): min=189, max=3825, avg=1437.26, stdev=1687.07 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 810], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 2000, max= 4087, per=100.00%, avg=3038.25, stdev=1174.46, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=16.67%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=5.25%, ctx=168, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145692: Mon Sep 7 22:34:05 2026 read: IOPS=0, BW=565KiB/s (579kB/s)(5120KiB/9059msec) clat (msec): min=2, max=3259, avg=768.85, stdev=1400.37 lat (msec): min=2, max=3259, avg=768.85, stdev=1400.37 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 2039, max= 4023, per=100.00%, avg=2701.67, stdev=1144.31, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=791KiB/s (810kB/s)(7168KiB/9059msec); 0 zone resets clat (msec): min=140, max=3063, avg=712.47, stdev=1044.03 lat (msec): min=140, max=3063, avg=712.57, stdev=1044.11 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 222], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 388], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 489], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1988, max= 4087, per=100.00%, avg=3007.25, stdev=1149.82, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 4=16.67%, 250=33.33%, 500=33.33%, >=2000=16.67% cpu : usr=0.01%, sys=7.84%, ctx=575, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2007KiB/s (2055kB/s), 201KiB/s-1250KiB/s (206kB/s-1280kB/s), io=20.0MiB (20.0MB), run=5735-10205msec WRITE: bw=2810KiB/s (2877kB/s), 630KiB/s-1003KiB/s (645kB/s-1028kB/s), io=28.0MiB (29.4MB), run=5735-10205msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145693: Mon Sep 7 22:34:06 2026 read: IOPS=0, BW=859KiB/s (879kB/s)(7168KiB/8347msec) clat (msec): min=74, max=2358, avg=443.99, stdev=845.30 lat (msec): min=74, max=2358, avg=443.99, stdev=845.30 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 91], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 109], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 186], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 2015, max= 3953, per=100.00%, avg=2983.50, stdev=1102.29, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=613KiB/s (628kB/s)(5120KiB/8347msec); 0 zone resets clat (msec): min=174, max=2894, avg=987.82, stdev=1152.11 lat (msec): min=174, max=2894, avg=987.94, stdev=1152.08 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1885, max= 2043, per=74.65%, avg=2000.50, stdev=77.07, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 2000=8.33%, >=2000=16.67% cpu : usr=0.05%, sys=2.11%, ctx=77, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145694: Mon Sep 7 22:34:06 2026 read: IOPS=0, BW=196KiB/s (201kB/s)(2048KiB/10458msec) clat (msec): min=219, max=2664, avg=1442.11, stdev=1728.51 lat (msec): min=219, max=2664, avg=1442.11, stdev=1728.51 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 2668], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1825, max= 2023, per=100.00%, avg=1924.00, stdev=140.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=979KiB/s (1003kB/s)(10.0MiB/10458msec); 0 zone resets clat (msec): min=161, max=3884, avg=736.96, stdev=1132.44 lat (msec): min=161, max=3884, avg=737.05, stdev=1132.43 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 182], | 30.00th=[ 211], 40.00th=[ 279], 50.00th=[ 292], 60.00th=[ 300], | 70.00th=[ 426], 80.00th=[ 751], 90.00th=[ 885], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 1950, max= 6131, per=100.00%, avg=3040.83, stdev=1723.94, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 1000=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=2.00%, ctx=102, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145695: Mon Sep 7 22:34:06 2026 read: IOPS=0, BW=642KiB/s (658kB/s)(6144KiB/9563msec) clat (msec): min=94, max=461, avg=193.44, stdev=143.73 lat (msec): min=94, max=461, avg=193.44, stdev=143.73 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 134], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2023, max= 4087, per=100.00%, avg=3393.67, stdev=1187.06, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=642KiB/s (658kB/s)(6144KiB/9563msec); 0 zone resets clat (msec): min=221, max=3695, avg=1387.42, stdev=1595.31 lat (msec): min=221, max=3695, avg=1387.50, stdev=1595.32 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 651], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1961, max= 3771, per=91.40%, avg=2449.50, stdev=881.69, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.85%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145696: Mon Sep 7 22:34:06 2026 read: IOPS=0, BW=479KiB/s (490kB/s)(5120KiB/10697msec) clat (msec): min=95, max=4082, avg=921.03, stdev=1767.45 lat (msec): min=95, max=4082, avg=921.03, stdev=1767.45 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 131], 60.00th=[ 131], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 4063, max= 4079, per=100.00%, avg=4071.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=670KiB/s (686kB/s)(7168KiB/10697msec); 0 zone resets clat (msec): min=256, max=3337, avg=828.46, stdev=1114.45 lat (msec): min=256, max=3337, avg=828.54, stdev=1114.45 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 266], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 634], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1961, max= 4096, per=100.00%, avg=2836.40, stdev=1138.79, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=1.73%, ctx=96, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1915KiB/s (1961kB/s), 196KiB/s-859KiB/s (201kB/s-879kB/s), io=20.0MiB (20.0MB), run=8347-10697msec WRITE: bw=2680KiB/s (2745kB/s), 613KiB/s-979KiB/s (628kB/s-1003kB/s), io=28.0MiB (29.4MB), run=8347-10697msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145705: Mon Sep 7 22:34:21 2026 read: IOPS=1, BW=7297KiB/s (7472kB/s)(12.0MiB/1684msec) clat (msec): min=366, max=782, avg=527.40, stdev=223.08 lat (msec): min=366, max=782, avg=527.40, stdev=223.08 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 6872, max= 7816, per=100.00%, avg=7344.00, stdev=667.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.42%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145706: Mon Sep 7 22:34:21 2026 read: IOPS=0, BW=1127KiB/s (1154kB/s)(4096KiB/3635msec) clat (nsec): min=1245.4M, max=1245.4M, avg=1245381721.00, stdev= 0.00 lat (nsec): min=1245.4M, max=1245.4M, avg=1245383752.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2254KiB/s (2308kB/s)(8192KiB/3635msec); 0 zone resets clat (msec): min=851, max=1427, avg=1139.46, stdev=407.15 lat (msec): min=851, max=1427, avg=1139.72, stdev=407.27 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8094, max= 8094, per=89.79%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.70%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145707: Mon Sep 7 22:34:21 2026 write: IOPS=1, BW=4939KiB/s (5057kB/s)(12.0MiB/2488msec); 0 zone resets clat (msec): min=684, max=905, avg=812.91, stdev=114.63 lat (msec): min=685, max=906, avg=813.24, stdev=114.62 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7984, max= 8047, per=88.92%, avg=8015.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.14%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145708: Mon Sep 7 22:34:21 2026 write: IOPS=1, BW=5299KiB/s (5426kB/s)(12.0MiB/2319msec); 0 zone resets clat (msec): min=441, max=1137, avg=757.91, stdev=352.24 lat (msec): min=442, max=1138, avg=759.24, stdev=352.01 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7816, max= 8000, per=87.73%, avg=7908.00, stdev=130.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.27%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4507KiB/s (4615kB/s), 1127KiB/s-7297KiB/s (1154kB/s-7472kB/s), io=16.0MiB (16.8MB), run=1684-3635msec WRITE: bw=9015KiB/s (9231kB/s), 2254KiB/s-5299KiB/s (2308kB/s-5426kB/s), io=32.0MiB (33.6MB), run=2319-3635msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145709: Mon Sep 7 22:34:21 2026 read: IOPS=1, BW=4580KiB/s (4690kB/s)(12.0MiB/2683msec) clat (msec): min=679, max=1128, avg=853.05, stdev=241.31 lat (msec): min=679, max=1128, avg=853.05, stdev=241.31 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8031, max= 8094, per=100.00%, avg=8062.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.93%, ctx=282, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145710: Mon Sep 7 22:34:21 2026 read: IOPS=0, BW=1462KiB/s (1497kB/s)(4096KiB/2802msec) clat (nsec): min=627199k, max=627199k, avg=627199292.00, stdev= 0.00 lat (nsec): min=627201k, max=627201k, avg=627201416.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2924KiB/s (2994kB/s)(8192KiB/2802msec); 0 zone resets clat (msec): min=735, max=1136, avg=935.94, stdev=283.71 lat (msec): min=735, max=1136, avg=936.24, stdev=283.81 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8175, max= 8175, per=86.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.32%, ctx=90, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145711: Mon Sep 7 22:34:21 2026 write: IOPS=0, BW=3565KiB/s (3650kB/s)(12.0MiB/3447msec); 0 zone resets clat (msec): min=384, max=1573, avg=1098.30, stdev=629.54 lat (msec): min=385, max=1573, avg=1098.75, stdev=629.30 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8078, max= 8175, per=85.49%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.31%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145712: Mon Sep 7 22:34:21 2026 write: IOPS=1, BW=4481KiB/s (4589kB/s)(12.0MiB/2742msec); 0 zone resets clat (msec): min=366, max=1557, avg=814.11, stdev=648.23 lat (msec): min=367, max=1557, avg=814.82, stdev=647.83 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8047, max= 8126, per=85.07%, avg=8086.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.18%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5847KiB/s (5988kB/s), 1462KiB/s-4580KiB/s (1497kB/s-4690kB/s), io=16.0MiB (16.8MB), run=2683-2802msec WRITE: bw=9506KiB/s (9734kB/s), 2924KiB/s-4481KiB/s (2994kB/s-4589kB/s), io=32.0MiB (33.6MB), run=2742-3447msec