== sanity test 398b: DIO and buffer IO race ============== 23:16:58 (1784085418) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.12489 s, 16.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194282: Tue Jul 14 23:18:06 2026 read: IOPS=25, BW=102KiB/s (105kB/s)(5992KiB/58654msec) clat (usec): min=79, max=675950, avg=21438.25, stdev=20388.79 lat (usec): min=80, max=675951, avg=21439.11, stdev=20388.83 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 7832], 10.00th=[ 9503], 20.00th=[ 11863], | 30.00th=[ 14484], 40.00th=[ 16450], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 24773], 80.00th=[ 28967], 90.00th=[ 35914], 95.00th=[ 41157], | 99.00th=[ 58983], 99.50th=[ 66847], 99.90th=[ 99091], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 168, per=24.83%, avg=101.32, stdev=25.54, samples=116 iops : min= 1, max= 42, avg=24.88, stdev= 6.46, samples=116 write: IOPS=26, BW=107KiB/s (110kB/s)(6296KiB/58654msec); 0 zone resets clat (usec): min=859, max=88465, avg=16715.53, stdev=12817.93 lat (usec): min=860, max=88467, avg=16721.58, stdev=12819.54 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2835], 10.00th=[ 3294], 20.00th=[ 4752], | 30.00th=[ 7701], 40.00th=[10683], 50.00th=[13960], 60.00th=[17433], | 70.00th=[21103], 80.00th=[26608], 90.00th=[34866], 95.00th=[40633], | 99.00th=[55313], 99.50th=[58459], 99.90th=[86508], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 31, max= 216, per=25.04%, avg=106.92, stdev=33.60, samples=115 iops : min= 7, max= 54, avg=26.29, stdev= 8.42, samples=115 lat (usec) : 100=0.33%, 250=0.91%, 500=0.03%, 1000=0.07% lat (msec) : 2=0.94%, 4=6.87%, 10=16.15%, 20=36.07%, 50=36.72% lat (msec) : 100=1.89%, 750=0.03% cpu : usr=0.13%, sys=25.62%, ctx=9849, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194284: Tue Jul 14 23:18:06 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(5940KiB/58278msec) clat (usec): min=37, max=94717, avg=20489.48, stdev=10658.24 lat (usec): min=38, max=94718, avg=20490.42, stdev=10658.38 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 8586], 10.00th=[ 9765], 20.00th=[12125], | 30.00th=[14091], 40.00th=[16188], 50.00th=[18744], 60.00th=[21103], | 70.00th=[23987], 80.00th=[28181], 90.00th=[34341], 95.00th=[39060], | 99.00th=[53740], 99.50th=[68682], 99.90th=[83362], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 7, max= 176, per=24.92%, avg=101.66, stdev=29.05, samples=116 iops : min= 1, max= 44, avg=24.97, stdev= 7.28, samples=116 write: IOPS=27, BW=109KiB/s (112kB/s)(6348KiB/58278msec); 0 zone resets clat (usec): min=879, max=680776, avg=17405.75, stdev=20851.74 lat (usec): min=880, max=680777, avg=17406.83, stdev=20851.81 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 2671], 10.00th=[ 3228], 20.00th=[ 5080], | 30.00th=[ 8029], 40.00th=[ 11338], 50.00th=[ 14484], 60.00th=[ 17957], | 70.00th=[ 22414], 80.00th=[ 27132], 90.00th=[ 34341], 95.00th=[ 40109], | 99.00th=[ 54264], 99.50th=[ 61604], 99.90th=[ 77071], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 14, max= 248, per=25.45%, avg=108.68, stdev=32.42, samples=116 iops : min= 3, max= 62, avg=26.72, stdev= 8.18, samples=116 lat (usec) : 50=0.10%, 100=0.33%, 250=0.49%, 500=0.07%, 1000=0.10% lat (msec) : 2=1.07%, 4=6.90%, 10=14.36%, 20=37.08%, 50=37.96% lat (msec) : 100=1.53%, 750=0.03% cpu : usr=0.12%, sys=25.72%, ctx=9965, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194286: Tue Jul 14 23:18:06 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6028KiB/58072msec) clat (usec): min=76, max=684730, avg=20995.52, stdev=19966.99 lat (usec): min=77, max=684731, avg=20996.45, stdev=19967.08 clat percentiles (usec): | 1.00th=[ 116], 5.00th=[ 8160], 10.00th=[ 9634], 20.00th=[ 12125], | 30.00th=[ 14615], 40.00th=[ 16909], 50.00th=[ 19006], 60.00th=[ 21365], | 70.00th=[ 24249], 80.00th=[ 27919], 90.00th=[ 33424], 95.00th=[ 38536], | 99.00th=[ 52167], 99.50th=[ 61604], 99.90th=[ 89654], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 160, per=25.34%, avg=103.37, stdev=28.99, samples=115 iops : min= 1, max= 40, avg=25.39, stdev= 7.28, samples=115 write: IOPS=26, BW=108KiB/s (110kB/s)(6260KiB/58072msec); 0 zone resets clat (usec): min=989, max=98103, avg=16752.86, stdev=12719.83 lat (usec): min=990, max=98105, avg=16754.02, stdev=12719.85 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2638], 10.00th=[ 3294], 20.00th=[ 5080], | 30.00th=[ 7832], 40.00th=[11076], 50.00th=[13698], 60.00th=[17171], | 70.00th=[21365], 80.00th=[26870], 90.00th=[34866], 95.00th=[40109], | 99.00th=[55837], 99.50th=[58983], 99.90th=[80217], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 21, max= 208, per=25.14%, avg=107.33, stdev=32.95, samples=115 iops : min= 5, max= 52, avg=26.38, stdev= 8.28, samples=115 lat (usec) : 100=0.26%, 250=0.98%, 1000=0.03% lat (msec) : 2=1.11%, 4=6.41%, 10=15.40%, 20=36.13%, 50=37.79% lat (msec) : 100=1.86%, 750=0.03% cpu : usr=0.09%, sys=25.75%, ctx=9874, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194288: Tue Jul 14 23:18:06 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(6052KiB/58783msec) clat (usec): min=52, max=667896, avg=21234.69, stdev=19854.28 lat (usec): min=53, max=667897, avg=21235.90, stdev=19854.22 clat percentiles (usec): | 1.00th=[ 115], 5.00th=[ 7767], 10.00th=[ 9634], 20.00th=[ 11863], | 30.00th=[ 14222], 40.00th=[ 16450], 50.00th=[ 19006], 60.00th=[ 21103], | 70.00th=[ 25035], 80.00th=[ 28705], 90.00th=[ 35390], 95.00th=[ 40109], | 99.00th=[ 55313], 99.50th=[ 61604], 99.90th=[ 79168], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 208, per=25.17%, avg=102.69, stdev=28.99, samples=117 iops : min= 1, max= 52, avg=25.23, stdev= 7.28, samples=117 write: IOPS=26, BW=106KiB/s (109kB/s)(6236KiB/58783msec); 0 zone resets clat (usec): min=789, max=69996, avg=16942.95, stdev=12242.14 lat (usec): min=790, max=69998, avg=16944.28, stdev=12242.45 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2802], 10.00th=[ 3392], 20.00th=[ 5342], | 30.00th=[ 8455], 40.00th=[11338], 50.00th=[14353], 60.00th=[17957], | 70.00th=[21890], 80.00th=[26608], 90.00th=[33817], 95.00th=[41681], | 99.00th=[54789], 99.50th=[58983], 99.90th=[66323], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 28, max= 184, per=24.75%, avg=105.69, stdev=30.51, samples=117 iops : min= 7, max= 46, avg=25.98, stdev= 7.70, samples=117 lat (usec) : 100=0.39%, 250=0.81%, 500=0.03%, 1000=0.07% lat (msec) : 2=0.49%, 4=5.99%, 10=15.76%, 20=36.56%, 50=38.22% lat (msec) : 100=1.66%, 750=0.03% cpu : usr=0.11%, sys=25.48%, ctx=10077, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=408KiB/s (418kB/s), 102KiB/s-104KiB/s (104kB/s-106kB/s), io=23.4MiB (24.6MB), run=58072-58783msec WRITE: bw=428KiB/s (438kB/s), 106KiB/s-109KiB/s (109kB/s-112kB/s), io=24.6MiB (25.7MB), run=58072-58783msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194281: Tue Jul 14 23:18:14 2026 read: IOPS=22, BW=90.1KiB/s (92.3kB/s)(5992KiB/66495msec) clat (msec): min=2, max=691, avg=19.51, stdev=23.05 lat (msec): min=2, max=691, avg=19.52, stdev=23.05 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 42], 95.00th=[ 51], | 99.00th=[ 69], 99.50th=[ 75], 99.90th=[ 126], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 31, max= 392, per=25.11%, avg=90.15, stdev=69.14, samples=131 iops : min= 7, max= 98, avg=22.13, stdev=17.42, samples=131 write: IOPS=23, BW=94.7KiB/s (96.0kB/s)(6296KiB/66495msec); 0 zone resets clat (msec): min=4, max=108, avg=23.54, stdev=16.27 lat (msec): min=4, max=108, avg=23.54, stdev=16.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 46], 95.00th=[ 55], | 99.00th=[ 78], 99.50th=[ 88], 99.90th=[ 107], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 23, max= 328, per=25.21%, avg=94.77, stdev=67.84, samples=131 iops : min= 5, max= 82, avg=23.29, stdev=17.08, samples=131 lat (msec) : 4=0.65%, 10=30.11%, 20=27.12%, 50=36.04%, 100=5.89% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.10%, sys=13.91%, ctx=6611, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194283: Tue Jul 14 23:18:14 2026 read: IOPS=22, BW=89.6KiB/s (91.7kB/s)(5940KiB/66299msec) clat (msec): min=2, max=679, avg=18.94, stdev=22.75 lat (msec): min=2, max=679, avg=18.95, stdev=22.75 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 66], 99.50th=[ 78], 99.90th=[ 103], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 16, max= 384, per=25.06%, avg=89.95, stdev=69.12, samples=131 iops : min= 4, max= 96, avg=22.08, stdev=17.37, samples=131 write: IOPS=23, BW=95.7KiB/s (98.0kB/s)(6348KiB/66299msec); 0 zone resets clat (msec): min=4, max=149, avg=23.92, stdev=16.94 lat (msec): min=4, max=149, avg=23.92, stdev=16.94 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 36], 90.00th=[ 47], 95.00th=[ 56], | 99.00th=[ 77], 99.50th=[ 88], 99.90th=[ 108], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 31, max= 376, per=25.58%, avg=96.18, stdev=68.58, samples=131 iops : min= 7, max= 94, avg=23.64, stdev=17.29, samples=131 lat (msec) : 4=0.85%, 10=30.01%, 20=27.77%, 50=34.80%, 100=6.38% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.10%, sys=13.73%, ctx=6526, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194285: Tue Jul 14 23:18:14 2026 read: IOPS=22, BW=90.3KiB/s (92.4kB/s)(6028KiB/66777msec) clat (usec): min=2760, max=96109, avg=18881.35, stdev=15311.32 lat (usec): min=2761, max=96110, avg=18882.47, stdev=15311.63 clat percentiles (usec): | 1.00th=[ 3195], 5.00th=[ 4490], 10.00th=[ 5014], 20.00th=[ 6063], | 30.00th=[ 8029], 40.00th=[11076], 50.00th=[14091], 60.00th=[17433], | 70.00th=[22414], 80.00th=[29754], 90.00th=[41157], 95.00th=[51119], | 99.00th=[70779], 99.50th=[74974], 99.90th=[89654], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 24, max= 376, per=25.26%, avg=90.67, stdev=70.05, samples=132 iops : min= 6, max= 94, avg=22.27, stdev=17.65, samples=132 write: IOPS=23, BW=93.7KiB/s (95.0kB/s)(6260KiB/66777msec); 0 zone resets clat (msec): min=4, max=686, avg=24.36, stdev=23.99 lat (msec): min=4, max=686, avg=24.36, stdev=23.99 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 47], 95.00th=[ 56], | 99.00th=[ 80], 99.50th=[ 91], 99.90th=[ 122], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 23, max= 336, per=25.02%, avg=94.07, stdev=70.94, samples=132 iops : min= 5, max= 84, avg=23.11, stdev=17.87, samples=132 lat (msec) : 4=1.46%, 10=31.18%, 20=25.49%, 50=35.29%, 100=6.41% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.07%, sys=13.57%, ctx=6491, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194287: Tue Jul 14 23:18:14 2026 read: IOPS=22, BW=91.1KiB/s (93.3kB/s)(6052KiB/66454msec) clat (usec): min=2824, max=86183, avg=18781.66, stdev=14776.12 lat (usec): min=2825, max=86184, avg=18782.60, stdev=14776.18 clat percentiles (usec): | 1.00th=[ 3752], 5.00th=[ 4621], 10.00th=[ 5145], 20.00th=[ 6456], | 30.00th=[ 8586], 40.00th=[11469], 50.00th=[14353], 60.00th=[17695], | 70.00th=[21627], 80.00th=[29230], 90.00th=[39584], 95.00th=[49546], | 99.00th=[67634], 99.50th=[76022], 99.90th=[85459], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 7, max= 344, per=25.39%, avg=91.17, stdev=67.23, samples=131 iops : min= 1, max= 86, avg=22.39, stdev=16.94, samples=131 write: IOPS=23, BW=93.8KiB/s (96.1kB/s)(6236KiB/66454msec); 0 zone resets clat (msec): min=4, max=691, avg=24.27, stdev=24.00 lat (msec): min=4, max=691, avg=24.27, stdev=24.00 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 16], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 83], 99.50th=[ 95], 99.90th=[ 150], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 32, max= 352, per=24.98%, avg=93.92, stdev=67.83, samples=131 iops : min= 8, max= 88, avg=23.08, stdev=17.08, samples=131 lat (msec) : 4=0.72%, 10=30.83%, 20=26.27%, 50=36.17%, 100=5.86% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.10%, sys=13.86%, ctx=6601, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=360KiB/s (368kB/s), 89.6KiB/s-91.1KiB/s (91.7kB/s-93.3kB/s), io=23.4MiB (24.6MB), run=66299-66777msec WRITE: bw=376KiB/s (386kB/s), 93.7KiB/s-95.7KiB/s (95.0kB/s-98.0kB/s), io=24.6MiB (25.7MB), run=66299-66777msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194324: Tue Jul 14 23:18:34 2026 read: IOPS=25, BW=415KiB/s (425kB/s)(5920KiB/14264msec) clat (usec): min=90, max=65697, avg=19734.83, stdev=11137.30 lat (usec): min=91, max=65698, avg=19736.00, stdev=11138.79 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 139], 10.00th=[ 9241], 20.00th=[11731], | 30.00th=[13698], 40.00th=[16188], 50.00th=[18220], 60.00th=[20317], | 70.00th=[23462], 80.00th=[27395], 90.00th=[32375], 95.00th=[40109], | 99.00th=[58459], 99.50th=[63701], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 223, max= 672, per=24.61%, avg=409.71, stdev=97.56, samples=28 iops : min= 13, max= 42, avg=25.14, stdev= 6.22, samples=28 write: IOPS=27, BW=446KiB/s (457kB/s)(6368KiB/14264msec); 0 zone resets clat (usec): min=1199, max=60591, avg=17424.52, stdev=12131.01 lat (usec): min=1200, max=60592, avg=17426.02, stdev=12131.09 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 4080], 10.00th=[ 4686], 20.00th=[ 6128], | 30.00th=[ 9241], 40.00th=[11863], 50.00th=[13960], 60.00th=[17957], | 70.00th=[21890], 80.00th=[27132], 90.00th=[35390], 95.00th=[41157], | 99.00th=[55837], 99.50th=[60031], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 159, max= 751, per=25.28%, avg=442.89, stdev=137.40, samples=28 iops : min= 9, max= 46, avg=27.21, stdev= 8.66, samples=28 lat (usec) : 100=0.65%, 250=2.47%, 500=0.13% lat (msec) : 2=0.78%, 4=1.69%, 10=17.19%, 20=39.71%, 50=35.42% lat (msec) : 100=1.95% cpu : usr=0.09%, sys=28.27%, ctx=2704, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194325: Tue Jul 14 23:18:34 2026 read: IOPS=25, BW=403KiB/s (412kB/s)(5744KiB/14269msec) clat (usec): min=54, max=67968, avg=20192.76, stdev=10065.61 lat (usec): min=54, max=67969, avg=20193.57, stdev=10065.65 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 206], 10.00th=[ 9503], 20.00th=[11994], | 30.00th=[15008], 40.00th=[17171], 50.00th=[19268], 60.00th=[21890], | 70.00th=[24249], 80.00th=[27919], 90.00th=[32637], 95.00th=[37487], | 99.00th=[51119], 99.50th=[56886], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 191, max= 544, per=24.02%, avg=399.86, stdev=102.83, samples=28 iops : min= 11, max= 34, avg=24.54, stdev= 6.59, samples=28 write: IOPS=28, BW=459KiB/s (470kB/s)(6544KiB/14269msec); 0 zone resets clat (usec): min=1131, max=64328, avg=17058.57, stdev=12061.17 lat (usec): min=1132, max=64330, avg=17060.10, stdev=12061.18 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 4146], 10.00th=[ 4752], 20.00th=[ 5866], | 30.00th=[ 8848], 40.00th=[11731], 50.00th=[14353], 60.00th=[17171], | 70.00th=[20317], 80.00th=[26084], 90.00th=[33817], 95.00th=[41681], | 99.00th=[56361], 99.50th=[58459], 99.90th=[64226], 99.95th=[64226], | 99.99th=[64226] bw ( KiB/s): min= 223, max= 751, per=25.93%, avg=454.29, stdev=121.11, samples=28 iops : min= 13, max= 46, avg=27.93, stdev= 7.58, samples=28 lat (usec) : 100=0.39%, 250=2.08%, 500=0.13% lat (msec) : 2=0.39%, 4=2.21%, 10=18.23%, 20=37.89%, 50=37.24% lat (msec) : 100=1.43% cpu : usr=0.11%, sys=28.99%, ctx=2814, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194326: Tue Jul 14 23:18:34 2026 read: IOPS=27, BW=435KiB/s (445kB/s)(6256KiB/14381msec) clat (usec): min=65, max=72565, avg=20381.43, stdev=11807.84 lat (usec): min=66, max=72566, avg=20382.27, stdev=11807.85 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 127], 10.00th=[ 8455], 20.00th=[11600], | 30.00th=[14222], 40.00th=[16450], 50.00th=[19006], 60.00th=[21627], | 70.00th=[24511], 80.00th=[28181], 90.00th=[35390], 95.00th=[42206], | 99.00th=[58459], 99.50th=[58983], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 223, max= 768, per=26.05%, avg=433.79, stdev=116.36, samples=28 iops : min= 13, max= 48, avg=26.64, stdev= 7.33, samples=28 write: IOPS=26, BW=419KiB/s (430kB/s)(6032KiB/14381msec); 0 zone resets clat (usec): min=1056, max=78953, avg=16888.42, stdev=11631.12 lat (usec): min=1057, max=78955, avg=16890.03, stdev=11631.22 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 3916], 10.00th=[ 4817], 20.00th=[ 6325], | 30.00th=[ 8717], 40.00th=[11994], 50.00th=[14746], 60.00th=[17171], | 70.00th=[21103], 80.00th=[25297], 90.00th=[33424], 95.00th=[39060], | 99.00th=[47449], 99.50th=[63701], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 190, max= 805, per=23.44%, avg=410.71, stdev=127.44, samples=28 iops : min= 11, max= 50, avg=25.21, stdev= 8.08, samples=28 lat (usec) : 100=1.30%, 250=2.60%, 750=0.13% lat (msec) : 2=0.65%, 4=1.95%, 10=18.36%, 20=35.55%, 50=37.76% lat (msec) : 100=1.69% cpu : usr=0.08%, sys=28.27%, ctx=2820, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194327: Tue Jul 14 23:18:34 2026 read: IOPS=28, BW=450KiB/s (460kB/s)(6032KiB/13415msec) clat (usec): min=46, max=68289, avg=18204.10, stdev=11241.81 lat (usec): min=47, max=68290, avg=18204.96, stdev=11241.80 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 115], 10.00th=[ 143], 20.00th=[11076], | 30.00th=[12911], 40.00th=[14746], 50.00th=[16909], 60.00th=[19530], | 70.00th=[22152], 80.00th=[25560], 90.00th=[30802], 95.00th=[38536], | 99.00th=[54264], 99.50th=[63177], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 192, max= 640, per=26.51%, avg=441.38, stdev=114.14, samples=26 iops : min= 12, max= 40, avg=27.15, stdev= 7.19, samples=26 write: IOPS=29, BW=466KiB/s (478kB/s)(6256KiB/13415msec); 0 zone resets clat (usec): min=1607, max=59629, avg=16609.93, stdev=11855.09 lat (usec): min=1609, max=59630, avg=16611.55, stdev=11855.13 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 3818], 10.00th=[ 4621], 20.00th=[ 5800], | 30.00th=[ 8094], 40.00th=[10683], 50.00th=[13960], 60.00th=[16712], | 70.00th=[20317], 80.00th=[26084], 90.00th=[32637], 95.00th=[41681], | 99.00th=[54264], 99.50th=[58459], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 254, max= 704, per=26.43%, avg=463.08, stdev=118.11, samples=26 iops : min= 15, max= 44, avg=28.50, stdev= 7.50, samples=26 lat (usec) : 50=0.13%, 100=1.30%, 250=4.04%, 500=0.26% lat (msec) : 2=0.39%, 4=2.73%, 10=19.14%, 20=36.59%, 50=34.11% lat (msec) : 100=1.30% cpu : usr=0.10%, sys=29.25%, ctx=2682, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1666KiB/s (1706kB/s), 403KiB/s-450KiB/s (412kB/s-460kB/s), io=23.4MiB (24.5MB), run=13415-14381msec WRITE: bw=1752KiB/s (1794kB/s), 419KiB/s-466KiB/s (430kB/s-478kB/s), io=24.6MiB (25.8MB), run=13415-14381msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194329: Tue Jul 14 23:18:37 2026 read: IOPS=21, BW=351KiB/s (359kB/s)(5920KiB/16874msec) clat (usec): min=3901, max=88006, avg=19263.82, stdev=14715.24 lat (usec): min=3902, max=88006, avg=19264.57, stdev=14715.24 clat percentiles (usec): | 1.00th=[ 4817], 5.00th=[ 6128], 10.00th=[ 6718], 20.00th=[ 7832], | 30.00th=[ 9896], 40.00th=[11863], 50.00th=[13829], 60.00th=[17171], | 70.00th=[20317], 80.00th=[26608], 90.00th=[43779], 95.00th=[50070], | 99.00th=[70779], 99.50th=[86508], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 95, max= 1053, per=24.71%, avg=349.42, stdev=206.88, samples=33 iops : min= 5, max= 65, avg=21.39, stdev=12.91, samples=33 write: IOPS=23, BW=377KiB/s (386kB/s)(6368KiB/16874msec); 0 zone resets clat (usec): min=6043, max=99139, avg=24147.58, stdev=15865.26 lat (usec): min=6044, max=99140, avg=24149.30, stdev=15865.29 clat percentiles (usec): | 1.00th=[ 7570], 5.00th=[ 8717], 10.00th=[ 9634], 20.00th=[11600], | 30.00th=[13304], 40.00th=[15795], 50.00th=[18744], 60.00th=[23200], | 70.00th=[27919], 80.00th=[34866], 90.00th=[47449], 95.00th=[57934], | 99.00th=[80217], 99.50th=[94897], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 95, max= 992, per=25.45%, avg=378.48, stdev=193.18, samples=33 iops : min= 5, max= 62, avg=23.21, stdev=12.08, samples=33 lat (msec) : 4=0.13%, 10=20.57%, 20=40.49%, 50=32.03%, 100=6.77% cpu : usr=0.08%, sys=13.60%, ctx=1756, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194330: Tue Jul 14 23:18:37 2026 read: IOPS=21, BW=340KiB/s (348kB/s)(5744KiB/16878msec) clat (usec): min=4093, max=93897, avg=19173.10, stdev=14816.63 lat (usec): min=4094, max=93898, avg=19173.83, stdev=14816.70 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 5800], 10.00th=[ 6718], 20.00th=[ 8160], | 30.00th=[10028], 40.00th=[11863], 50.00th=[13829], 60.00th=[16450], | 70.00th=[19792], 80.00th=[28443], 90.00th=[40109], 95.00th=[50070], | 99.00th=[73925], 99.50th=[78119], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 159, max= 830, per=24.11%, avg=340.97, stdev=181.75, samples=33 iops : min= 9, max= 51, avg=20.85, stdev=11.36, samples=33 write: IOPS=24, BW=388KiB/s (397kB/s)(6544KiB/16878msec); 0 zone resets clat (usec): min=6062, max=95841, avg=24276.65, stdev=15434.05 lat (usec): min=6064, max=95844, avg=24278.25, stdev=15434.16 clat percentiles (usec): | 1.00th=[ 7373], 5.00th=[ 8848], 10.00th=[ 9634], 20.00th=[11600], | 30.00th=[13566], 40.00th=[15270], 50.00th=[18482], 60.00th=[23725], | 70.00th=[30016], 80.00th=[36439], 90.00th=[46924], 95.00th=[53740], | 99.00th=[70779], 99.50th=[77071], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 160, max= 928, per=26.00%, avg=386.64, stdev=197.04, samples=33 iops : min= 10, max= 58, avg=23.70, stdev=12.34, samples=33 lat (msec) : 10=19.92%, 20=40.89%, 50=32.81%, 100=6.38% cpu : usr=0.09%, sys=13.40%, ctx=1659, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194331: Tue Jul 14 23:18:37 2026 read: IOPS=23, BW=371KiB/s (380kB/s)(6256KiB/16859msec) clat (usec): min=3692, max=86342, avg=19654.47, stdev=14851.21 lat (usec): min=3693, max=86343, avg=19655.33, stdev=14851.21 clat percentiles (usec): | 1.00th=[ 4359], 5.00th=[ 5735], 10.00th=[ 6456], 20.00th=[ 8094], | 30.00th=[10159], 40.00th=[11994], 50.00th=[13960], 60.00th=[17171], | 70.00th=[21890], 80.00th=[30278], 90.00th=[42206], 95.00th=[52167], | 99.00th=[66323], 99.50th=[73925], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 127, max= 1024, per=26.43%, avg=373.67, stdev=216.65, samples=33 iops : min= 7, max= 64, avg=22.91, stdev=13.63, samples=33 write: IOPS=22, BW=358KiB/s (366kB/s)(6032KiB/16859msec); 0 zone resets clat (msec): min=5, max=111, avg=24.21, stdev=16.43 lat (msec): min=5, max=111, avg=24.22, stdev=16.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 74], 99.50th=[ 87], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 159, max= 928, per=23.91%, avg=355.55, stdev=192.10, samples=33 iops : min= 9, max= 58, avg=21.76, stdev=12.05, samples=33 lat (msec) : 4=0.13%, 10=21.22%, 20=38.67%, 50=31.77%, 100=8.07% lat (msec) : 250=0.13% cpu : usr=0.11%, sys=13.27%, ctx=1723, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194332: Tue Jul 14 23:18:37 2026 read: IOPS=22, BW=356KiB/s (365kB/s)(6032KiB/16939msec) clat (usec): min=3421, max=86190, avg=19283.17, stdev=14259.55 lat (usec): min=3422, max=86191, avg=19284.05, stdev=14259.53 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5866], 10.00th=[ 6456], 20.00th=[ 7832], | 30.00th=[10421], 40.00th=[12256], 50.00th=[14877], 60.00th=[17695], | 70.00th=[21627], 80.00th=[27919], 90.00th=[39584], 95.00th=[47449], | 99.00th=[70779], 99.50th=[84411], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 95, max= 928, per=24.85%, avg=351.33, stdev=198.52, samples=33 iops : min= 5, max= 58, avg=21.52, stdev=12.43, samples=33 write: IOPS=23, BW=369KiB/s (378kB/s)(6256KiB/16939msec); 0 zone resets clat (usec): min=5696, max=80605, avg=24624.39, stdev=15687.53 lat (usec): min=5697, max=80607, avg=24626.33, stdev=15687.50 clat percentiles (usec): | 1.00th=[ 6915], 5.00th=[ 8225], 10.00th=[ 9634], 20.00th=[11207], | 30.00th=[13304], 40.00th=[15664], 50.00th=[19530], 60.00th=[24511], | 70.00th=[30540], 80.00th=[37487], 90.00th=[47973], 95.00th=[57934], | 99.00th=[70779], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 160, max= 990, per=24.59%, avg=365.64, stdev=202.77, samples=33 iops : min= 10, max= 61, avg=22.39, stdev=12.71, samples=33 lat (msec) : 4=0.39%, 10=20.18%, 20=37.89%, 50=35.42%, 100=6.12% cpu : usr=0.06%, sys=13.23%, ctx=1664, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1414KiB/s (1448kB/s), 340KiB/s-371KiB/s (348kB/s-380kB/s), io=23.4MiB (24.5MB), run=16859-16939msec WRITE: bw=1488KiB/s (1523kB/s), 358KiB/s-388KiB/s (366kB/s-397kB/s), io=24.6MiB (25.8MB), run=16859-16939msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194344: Tue Jul 14 23:18:46 2026 read: IOPS=2, BW=2230KiB/s (2284kB/s)(7168KiB/3214msec) clat (msec): min=21, max=977, avg=229.19, stdev=332.66 lat (msec): min=21, max=977, avg=229.20, stdev=332.66 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 22], 10.00th=[ 22], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 122], 60.00th=[ 123], | 70.00th=[ 123], 80.00th=[ 153], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1686, max= 5907, per=45.73%, avg=2913.75, stdev=2002.12, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1593KiB/s (1631kB/s)(5120KiB/3214msec); 0 zone resets clat (msec): min=162, max=655, avg=313.39, stdev=198.19 lat (msec): min=162, max=655, avg=313.43, stdev=198.21 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1969, max= 4055, per=28.25%, avg=2519.50, stdev=1024.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=37.75%, ctx=1515, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194345: Tue Jul 14 23:18:46 2026 read: IOPS=0, BW=660KiB/s (676kB/s)(2048KiB/3104msec) clat (msec): min=30, max=140, avg=85.16, stdev=77.89 lat (msec): min=30, max=140, avg=85.16, stdev=77.89 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], | 30.00th=[ 31], 40.00th=[ 31], 50.00th=[ 31], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 140], 95.00th=[ 140], | 99.00th=[ 140], 99.50th=[ 140], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 1695, max= 2035, per=29.27%, avg=1865.00, stdev=240.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3299KiB/s (3378kB/s)(10.0MiB/3104msec); 0 zone resets clat (msec): min=82, max=1123, avg=283.63, stdev=305.59 lat (msec): min=82, max=1123, avg=283.69, stdev=305.59 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 126], | 30.00th=[ 153], 40.00th=[ 167], 50.00th=[ 171], 60.00th=[ 180], | 70.00th=[ 218], 80.00th=[ 239], 90.00th=[ 380], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1695, max= 6144, per=44.66%, avg=3983.25, stdev=2450.13, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.63, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=66.67%, 500=8.33%, 2000=8.33% cpu : usr=0.03%, sys=39.16%, ctx=210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194346: Tue Jul 14 23:18:46 2026 read: IOPS=2, BW=2287KiB/s (2341kB/s)(6144KiB/2687msec) clat (usec): min=520, max=168941, avg=99419.13, stdev=73046.62 lat (usec): min=521, max=168943, avg=99420.25, stdev=73046.55 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 13042], | 30.00th=[ 13042], 40.00th=[128451], 50.00th=[128451], 60.00th=[139461], | 70.00th=[145753], 80.00th=[145753], 90.00th=[168821], 95.00th=[168821], | 99.00th=[168821], 99.50th=[168821], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 4071, max= 6059, per=79.49%, avg=5065.00, stdev=1405.73, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2287KiB/s (2341kB/s)(6144KiB/2687msec); 0 zone resets clat (msec): min=108, max=1225, avg=335.36, stdev=438.15 lat (msec): min=108, max=1225, avg=335.41, stdev=438.15 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 150], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1969, max= 3419, per=26.46%, avg=2360.50, stdev=706.23, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=75.00%, 2000=8.33% cpu : usr=0.04%, sys=38.09%, ctx=573, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194347: Tue Jul 14 23:18:46 2026 read: IOPS=1, BW=1753KiB/s (1795kB/s)(5120KiB/2921msec) clat (usec): min=329, max=221769, avg=68585.84, stdev=100064.69 lat (usec): min=330, max=221771, avg=68586.56, stdev=100064.99 clat percentiles (usec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 396], 40.00th=[ 396], 50.00th=[ 478], 60.00th=[ 478], | 70.00th=[120062], 80.00th=[120062], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 2035, max= 6059, per=63.51%, avg=4047.00, stdev=2845.40, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2454KiB/s (2513kB/s)(7168KiB/2921msec); 0 zone resets clat (msec): min=174, max=1101, avg=353.20, stdev=331.91 lat (msec): min=174, max=1101, avg=353.26, stdev=331.91 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 199], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 228], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 288], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1698, max= 3938, per=27.16%, avg=2422.50, stdev=1022.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=25.00% lat (msec) : 250=50.00%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=35.92%, ctx=336, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6372KiB/s (6525kB/s), 660KiB/s-2287KiB/s (676kB/s-2341kB/s), io=20.0MiB (20.0MB), run=2687-3214msec WRITE: bw=8921KiB/s (9135kB/s), 1593KiB/s-3299KiB/s (1631kB/s-3378kB/s), io=28.0MiB (29.4MB), run=2687-3214msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194339: Tue Jul 14 23:18:46 2026 read: IOPS=2, BW=2395KiB/s (2452kB/s)(7168KiB/2993msec) clat (msec): min=66, max=582, avg=222.47, stdev=192.80 lat (msec): min=66, max=582, avg=222.47, stdev=192.80 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 132], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 397], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2011, max= 5086, per=62.40%, avg=3731.00, stdev=1569.66, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1711KiB/s (1752kB/s)(5120KiB/2993msec); 0 zone resets clat (msec): min=65, max=477, avg=282.18, stdev=167.33 lat (msec): min=65, max=477, avg=282.24, stdev=167.33 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2011, max= 4055, per=30.33%, avg=2539.25, stdev=1010.63, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=10.09%, ctx=101, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194340: Tue Jul 14 23:18:46 2026 read: IOPS=0, BW=600KiB/s (614kB/s)(2048KiB/3415msec) clat (msec): min=53, max=266, avg=159.89, stdev=150.91 lat (msec): min=53, max=266, avg=159.89, stdev=150.91 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 54], 40.00th=[ 54], 50.00th=[ 54], 60.00th=[ 268], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 268], 95.00th=[ 268], | 99.00th=[ 268], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 1692, max= 2011, per=30.97%, avg=1851.50, stdev=225.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2999KiB/s (3071kB/s)(10.0MiB/3415msec); 0 zone resets clat (msec): min=57, max=1024, avg=305.55, stdev=283.56 lat (msec): min=57, max=1024, avg=305.62, stdev=283.55 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 107], | 30.00th=[ 112], 40.00th=[ 178], 50.00th=[ 182], 60.00th=[ 209], | 70.00th=[ 368], 80.00th=[ 388], 90.00th=[ 435], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1692, max= 6131, per=32.97%, avg=2760.00, stdev=1889.22, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.06%, sys=15.00%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194341: Tue Jul 14 23:18:46 2026 read: IOPS=1, BW=1808KiB/s (1851kB/s)(6144KiB/3399msec) clat (msec): min=92, max=337, avg=206.35, stdev=113.10 lat (msec): min=92, max=337, avg=206.35, stdev=113.10 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 249], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1939, max= 4023, per=41.97%, avg=2509.25, stdev=1010.27, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1808KiB/s (1851kB/s)(6144KiB/3399msec); 0 zone resets clat (msec): min=57, max=1224, avg=358.80, stdev=458.29 lat (msec): min=57, max=1224, avg=358.85, stdev=458.30 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 59], | 30.00th=[ 59], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 161], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 2027, max= 3878, per=33.91%, avg=2838.50, stdev=945.23, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.98%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194342: Tue Jul 14 23:18:46 2026 read: IOPS=1, BW=1495KiB/s (1531kB/s)(5120KiB/3425msec) clat (msec): min=27, max=302, avg=121.26, stdev=107.30 lat (msec): min=27, max=302, avg=121.26, stdev=107.30 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 28], 10.00th=[ 28], 20.00th=[ 28], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 89], 60.00th=[ 89], | 70.00th=[ 124], 80.00th=[ 124], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2011, max= 5818, per=65.47%, avg=3914.50, stdev=2691.96, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2093KiB/s (2143kB/s)(7168KiB/3425msec); 0 zone resets clat (msec): min=63, max=1715, avg=398.25, stdev=597.59 lat (msec): min=63, max=1715, avg=398.31, stdev=597.60 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 101], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 384], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1700, max= 4055, per=30.92%, avg=2588.67, stdev=1279.37, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=41.67%, 250=16.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=15.95%, ctx=337, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5980KiB/s (6123kB/s), 600KiB/s-2395KiB/s (614kB/s-2452kB/s), io=20.0MiB (20.0MB), run=2993-3425msec WRITE: bw=8371KiB/s (8572kB/s), 1711KiB/s-2999KiB/s (1752kB/s-3071kB/s), io=28.0MiB (29.4MB), run=2993-3425msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194353: Tue Jul 14 23:18:54 2026 read: IOPS=2, BW=8486KiB/s (8690kB/s)(12.0MiB/1448msec) clat (msec): min=403, max=593, avg=476.43, stdev=102.51 lat (msec): min=403, max=593, avg=476.44, stdev=102.51 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7433, max= 8015, per=89.81%, avg=7724.00, stdev=411.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=47.68%, ctx=2251, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194354: Tue Jul 14 23:18:54 2026 read: IOPS=0, BW=2150KiB/s (2202kB/s)(4096KiB/1905msec) clat (nsec): min=401060k, max=401060k, avg=401059891.00, stdev= 0.00 lat (nsec): min=401062k, max=401062k, avg=401061941.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7249, max= 7249, per=84.29%, avg=7249.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4300KiB/s (4403kB/s)(8192KiB/1905msec); 0 zone resets clat (msec): min=511, max=959, avg=735.76, stdev=317.04 lat (msec): min=511, max=960, avg=736.06, stdev=317.07 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8015, max= 8015, per=46.60%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=18.43%, ctx=663, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194355: Tue Jul 14 23:18:54 2026 write: IOPS=1, BW=7380KiB/s (7557kB/s)(12.0MiB/1665msec); 0 zone resets clat (msec): min=314, max=683, avg=541.81, stdev=199.15 lat (msec): min=314, max=683, avg=542.09, stdev=199.13 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8015, max= 8192, per=47.11%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=23.86%, ctx=150, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194356: Tue Jul 14 23:18:54 2026 write: IOPS=1, BW=7782KiB/s (7969kB/s)(12.0MiB/1579msec); 0 zone resets clat (msec): min=354, max=635, avg=521.35, stdev=147.61 lat (msec): min=354, max=635, avg=521.62, stdev=147.61 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7515, max= 8015, per=45.14%, avg=7765.00, stdev=353.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=18.95%, ctx=125, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8601KiB/s (8807kB/s), 2150KiB/s-8486KiB/s (2202kB/s-8690kB/s), io=16.0MiB (16.8MB), run=1448-1905msec WRITE: bw=16.8MiB/s (17.6MB/s), 4300KiB/s-7782KiB/s (4403kB/s-7969kB/s), io=32.0MiB (33.6MB), run=1579-1905msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194358: Tue Jul 14 23:18:54 2026 read: IOPS=1, BW=6621KiB/s (6780kB/s)(12.0MiB/1856msec) clat (msec): min=125, max=1053, avg=617.48, stdev=466.34 lat (msec): min=125, max=1053, avg=617.48, stdev=466.34 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8192, max= 8192, per=93.81%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.11%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194359: Tue Jul 14 23:18:54 2026 read: IOPS=0, BW=2183KiB/s (2236kB/s)(4096KiB/1876msec) clat (nsec): min=729848k, max=729848k, avg=729847701.00, stdev= 0.00 lat (nsec): min=729850k, max=729850k, avg=729849801.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8094, max= 8094, per=92.68%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4367KiB/s (4472kB/s)(8192KiB/1876msec); 0 zone resets clat (msec): min=375, max=759, avg=567.51, stdev=271.88 lat (msec): min=375, max=760, avg=567.81, stdev=271.87 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8192, max= 8192, per=46.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=13.55%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194360: Tue Jul 14 23:18:54 2026 write: IOPS=1, BW=7267KiB/s (7441kB/s)(12.0MiB/1691msec); 0 zone resets clat (msec): min=128, max=954, avg=558.71, stdev=414.11 lat (msec): min=128, max=954, avg=558.94, stdev=414.06 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8094, max= 8094, per=46.34%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.68%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194361: Tue Jul 14 23:18:54 2026 write: IOPS=1, BW=8154KiB/s (8350kB/s)(12.0MiB/1507msec); 0 zone resets clat (msec): min=156, max=882, avg=501.36, stdev=364.40 lat (msec): min=157, max=883, avg=501.63, stdev=364.43 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 5490, max= 5490, per=31.43%, avg=5490.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=21.45%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8733KiB/s (8943kB/s), 2183KiB/s-6621KiB/s (2236kB/s-6780kB/s), io=16.0MiB (16.8MB), run=1856-1876msec WRITE: bw=17.1MiB/s (17.9MB/s), 4367KiB/s-8154KiB/s (4472kB/s-8350kB/s), io=32.0MiB (33.6MB), run=1507-1876msec