== sanity test 398b: DIO and buffer IO race ============== 12:00:14 (1780329614) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.70076 s, 18.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153863: Mon Jun 1 12:01:13 2026 read: IOPS=29, BW=118KiB/s (121kB/s)(5992KiB/50877msec) clat (usec): min=27, max=616247, avg=16683.01, stdev=19300.53 lat (usec): min=28, max=616248, avg=16683.79, stdev=19300.54 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 120], 10.00th=[ 6128], 20.00th=[ 8586], | 30.00th=[ 10028], 40.00th=[ 11863], 50.00th=[ 14222], 60.00th=[ 16581], | 70.00th=[ 19006], 80.00th=[ 23200], 90.00th=[ 29492], 95.00th=[ 35390], | 99.00th=[ 53216], 99.50th=[ 61080], 99.90th=[160433], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 6, max= 200, per=25.20%, avg=117.70, stdev=33.56, samples=101 iops : min= 1, max= 50, avg=29.11, stdev= 8.42, samples=101 write: IOPS=30, BW=124KiB/s (127kB/s)(6296KiB/50877msec); 0 zone resets clat (usec): min=659, max=97475, avg=16347.00, stdev=14299.84 lat (usec): min=659, max=97476, avg=16347.99, stdev=14300.08 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 1647], 10.00th=[ 2343], 20.00th=[ 3458], | 30.00th=[ 6063], 40.00th=[10028], 50.00th=[13042], 60.00th=[16581], | 70.00th=[21103], 80.00th=[26084], 90.00th=[34866], 95.00th=[42730], | 99.00th=[66847], 99.50th=[76022], 99.90th=[93848], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 48, max= 214, per=25.53%, avg=124.82, stdev=33.74, samples=100 iops : min= 12, max= 53, avg=30.89, stdev= 8.50, samples=100 lat (usec) : 50=0.42%, 100=1.17%, 250=1.73%, 500=0.07%, 750=0.33% lat (usec) : 1000=0.23% lat (msec) : 2=3.03%, 4=8.30%, 10=19.50%, 20=35.38%, 50=27.70% lat (msec) : 100=2.02%, 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=23.80%, ctx=8018, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153864: Mon Jun 1 12:01:13 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(5940KiB/50002msec) clat (usec): min=26, max=115214, avg=16455.67, stdev=11474.47 lat (usec): min=27, max=115214, avg=16456.46, stdev=11474.54 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 133], 10.00th=[ 6521], 20.00th=[ 8356], | 30.00th=[ 10028], 40.00th=[ 11994], 50.00th=[ 14091], 60.00th=[ 16581], | 70.00th=[ 19792], 80.00th=[ 23987], 90.00th=[ 29492], 95.00th=[ 35914], | 99.00th=[ 56361], 99.50th=[ 67634], 99.90th=[107480], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 6, max= 215, per=25.44%, avg=118.79, stdev=34.09, samples=99 iops : min= 1, max= 53, avg=29.39, stdev= 8.58, samples=99 write: IOPS=31, BW=127KiB/s (130kB/s)(6348KiB/50002msec); 0 zone resets clat (usec): min=663, max=605759, avg=16017.23, stdev=20595.09 lat (usec): min=663, max=605760, avg=16018.18, stdev=20595.12 clat percentiles (usec): | 1.00th=[ 840], 5.00th=[ 1631], 10.00th=[ 2311], 20.00th=[ 3163], | 30.00th=[ 5014], 40.00th=[ 8586], 50.00th=[ 12125], 60.00th=[ 15795], | 70.00th=[ 20055], 80.00th=[ 25822], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 63177], 99.50th=[ 73925], 99.90th=[131597], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 63, max= 216, per=26.20%, avg=128.13, stdev=33.42, samples=98 iops : min= 15, max= 54, avg=31.72, stdev= 8.43, samples=98 lat (usec) : 50=0.39%, 100=1.33%, 250=1.50%, 500=0.07%, 750=0.29% lat (usec) : 1000=0.68% lat (msec) : 2=2.90%, 4=9.05%, 10=20.96%, 20=32.75%, 50=28.03% lat (msec) : 100=1.89%, 250=0.13%, 750=0.03% cpu : usr=0.11%, sys=23.92%, ctx=7875, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153865: Mon Jun 1 12:01:13 2026 read: IOPS=29, BW=117KiB/s (120kB/s)(6028KiB/51355msec) clat (usec): min=29, max=95703, avg=16094.94, stdev=10497.69 lat (usec): min=29, max=95705, avg=16095.82, stdev=10497.76 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 117], 10.00th=[ 6718], 20.00th=[ 8356], | 30.00th=[ 9896], 40.00th=[11600], 50.00th=[14091], 60.00th=[16581], | 70.00th=[19530], 80.00th=[23200], 90.00th=[28705], 95.00th=[34866], | 99.00th=[49021], 99.50th=[61604], 99.90th=[80217], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 39, max= 239, per=25.36%, avg=118.42, stdev=35.09, samples=101 iops : min= 9, max= 59, avg=29.29, stdev= 8.85, samples=101 write: IOPS=30, BW=122KiB/s (125kB/s)(6260KiB/51355msec); 0 zone resets clat (usec): min=643, max=612484, avg=17227.06, stdev=21263.66 lat (usec): min=644, max=612485, avg=17228.12, stdev=21263.63 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 1795], 10.00th=[ 2474], 20.00th=[ 3490], | 30.00th=[ 5800], 40.00th=[ 10028], 50.00th=[ 13435], 60.00th=[ 16909], | 70.00th=[ 21627], 80.00th=[ 27395], 90.00th=[ 36963], 95.00th=[ 44303], | 99.00th=[ 63177], 99.50th=[ 81265], 99.90th=[121111], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 56, max= 200, per=25.12%, avg=122.83, stdev=33.50, samples=101 iops : min= 14, max= 50, avg=30.40, stdev= 8.38, samples=101 lat (usec) : 50=0.16%, 100=1.53%, 250=1.33%, 500=0.07%, 750=0.33% lat (usec) : 1000=0.68% lat (msec) : 2=2.34%, 4=8.40%, 10=20.54%, 20=33.40%, 50=29.17% lat (msec) : 100=1.86%, 250=0.16%, 750=0.03% cpu : usr=0.10%, sys=23.49%, ctx=7948, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153866: Mon Jun 1 12:01:13 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(6052KiB/50759msec) clat (usec): min=27, max=168262, avg=16291.88, stdev=11554.80 lat (usec): min=27, max=168263, avg=16292.69, stdev=11554.86 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 123], 10.00th=[ 6390], 20.00th=[ 8291], | 30.00th=[ 10028], 40.00th=[ 11994], 50.00th=[ 14222], 60.00th=[ 16188], | 70.00th=[ 19530], 80.00th=[ 23200], 90.00th=[ 29754], 95.00th=[ 35914], | 99.00th=[ 54789], 99.50th=[ 64226], 99.90th=[ 92799], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 55, max= 198, per=25.80%, avg=120.49, stdev=32.67, samples=100 iops : min= 13, max= 49, avg=29.81, stdev= 8.24, samples=100 write: IOPS=30, BW=123KiB/s (126kB/s)(6236KiB/50759msec); 0 zone resets clat (usec): min=662, max=579728, avg=16657.18, stdev=20553.58 lat (usec): min=662, max=579729, avg=16658.11, stdev=20553.59 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1778], 10.00th=[ 2540], 20.00th=[ 3654], | 30.00th=[ 5735], 40.00th=[ 9372], 50.00th=[ 13173], 60.00th=[ 16188], | 70.00th=[ 20841], 80.00th=[ 26346], 90.00th=[ 35914], 95.00th=[ 43254], | 99.00th=[ 66847], 99.50th=[ 83362], 99.90th=[147850], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 13, max= 215, per=25.13%, avg=122.90, stdev=34.39, samples=101 iops : min= 3, max= 53, avg=30.42, stdev= 8.61, samples=101 lat (usec) : 50=0.52%, 100=1.27%, 250=1.60%, 500=0.07%, 750=0.16% lat (usec) : 1000=0.42% lat (msec) : 2=2.77%, 4=8.04%, 10=21.00%, 20=34.28%, 50=27.70% lat (msec) : 100=2.05%, 250=0.10%, 750=0.03% cpu : usr=0.09%, sys=23.78%, ctx=7965, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=468KiB/s (479kB/s), 117KiB/s-119KiB/s (120kB/s-122kB/s), io=23.4MiB (24.6MB), run=50002-51355msec WRITE: bw=490KiB/s (501kB/s), 122KiB/s-127KiB/s (125kB/s-130kB/s), io=24.6MiB (25.7MB), run=50002-51355msec fio: pid=153862, err=5/file:backend.c:481, func=full resid, error=Input/output error fio: pid=153861, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=153859: Mon Jun 1 12:03:51 2026 read: IOPS=7, BW=28.7KiB/s (29.4kB/s)(5992KiB/208707msec) clat (msec): min=4, max=1101, avg=27.98, stdev=48.79 lat (msec): min=4, max=1101, avg=27.98, stdev=48.79 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 36], 90.00th=[ 50], 95.00th=[ 68], | 99.00th=[ 123], 99.50th=[ 144], 99.90th=[ 818], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 4, max= 104, per=31.70%, avg=33.60, stdev=23.03, samples=348 iops : min= 1, max= 26, avg= 7.92, stdev= 5.85, samples=348 write: IOPS=7, BW=30.2KiB/s (30.9kB/s)(6296KiB/208707msec); 0 zone resets clat (msec): min=19, max=1845, avg=105.83, stdev=117.51 lat (msec): min=19, max=1845, avg=105.84, stdev=117.52 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 46], | 30.00th=[ 53], 40.00th=[ 60], 50.00th=[ 68], 60.00th=[ 81], | 70.00th=[ 97], 80.00th=[ 140], 90.00th=[ 218], 95.00th=[ 300], | 99.00th=[ 567], 99.50th=[ 718], 99.90th=[ 1670], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 5, max= 80, per=28.38%, avg=31.50, stdev=19.05, samples=389 iops : min= 1, max= 20, avg= 7.37, stdev= 4.91, samples=389 lat (msec) : 10=6.71%, 20=18.75%, 50=32.26%, 100=26.40%, 250=11.85% lat (msec) : 500=3.22%, 750=0.49%, 1000=0.23%, 2000=0.10% cpu : usr=0.04%, sys=2.92%, ctx=5579, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153860: Mon Jun 1 12:03:51 2026 read: IOPS=7, BW=28.5KiB/s (29.2kB/s)(5940KiB/208385msec) clat (msec): min=4, max=587, avg=26.17, stdev=30.47 lat (msec): min=4, max=587, avg=26.17, stdev=30.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 36], 90.00th=[ 47], 95.00th=[ 64], | 99.00th=[ 122], 99.50th=[ 155], 99.90th=[ 481], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 4, max= 120, per=32.08%, avg=34.01, stdev=22.53, samples=342 iops : min= 1, max= 30, avg= 8.01, stdev= 5.73, samples=342 write: IOPS=7, BW=30.5KiB/s (31.2kB/s)(6348KiB/208385msec); 0 zone resets clat (msec): min=18, max=1502, avg=106.68, stdev=117.01 lat (msec): min=18, max=1502, avg=106.68, stdev=117.01 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 34], 10.00th=[ 40], 20.00th=[ 47], | 30.00th=[ 54], 40.00th=[ 61], 50.00th=[ 69], 60.00th=[ 80], | 70.00th=[ 99], 80.00th=[ 142], 90.00th=[ 220], 95.00th=[ 288], | 99.00th=[ 617], 99.50th=[ 735], 99.90th=[ 1301], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 5, max= 79, per=28.37%, avg=31.49, stdev=19.21, samples=393 iops : min= 1, max= 19, avg= 7.36, stdev= 4.94, samples=393 lat (msec) : 10=7.52%, 20=18.20%, 50=31.87%, 100=26.46%, 250=12.04% lat (msec) : 500=3.03%, 750=0.65%, 1000=0.07%, 2000=0.16% cpu : usr=0.05%, sys=2.74%, ctx=5437, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=153861: Mon Jun 1 12:03:51 2026 read: IOPS=7, BW=29.0KiB/s (29.7kB/s)(5984KiB/206254msec) clat (msec): min=5, max=1509, avg=25.99, stdev=44.93 lat (msec): min=5, max=1509, avg=25.99, stdev=44.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 47], 95.00th=[ 62], | 99.00th=[ 116], 99.50th=[ 165], 99.90th=[ 342], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 4, max= 128, per=32.99%, avg=34.97, stdev=23.29, samples=335 iops : min= 1, max= 32, avg= 8.25, stdev= 5.95, samples=335 write: IOPS=7, BW=30.1KiB/s (30.8kB/s)(6208KiB/206254msec); 0 zone resets clat (msec): min=19, max=1327, avg=107.70, stdev=114.25 lat (msec): min=19, max=1327, avg=107.70, stdev=114.26 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 46], | 30.00th=[ 53], 40.00th=[ 61], 50.00th=[ 69], 60.00th=[ 81], | 70.00th=[ 102], 80.00th=[ 146], 90.00th=[ 222], 95.00th=[ 305], | 99.00th=[ 558], 99.50th=[ 667], 99.90th=[ 1318], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 4, max= 86, per=27.91%, avg=30.98, stdev=19.33, samples=391 iops : min= 1, max= 21, avg= 7.23, stdev= 4.97, samples=391 lat (msec) : 10=7.54%, 20=19.12%, 50=31.88%, 100=25.16%, 250=12.46% lat (msec) : 500=3.05%, 750=0.49%, 1000=0.07%, 2000=0.20% cpu : usr=0.05%, sys=2.85%, ctx=5392, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1497,1552,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=153862: Mon Jun 1 12:03:51 2026 read: IOPS=9, BW=36.2KiB/s (37.1kB/s)(4316KiB/119192msec) clat (msec): min=5, max=530, avg=24.65, stdev=29.33 lat (msec): min=5, max=530, avg=24.65, stdev=29.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 58], | 99.00th=[ 122], 99.50th=[ 157], 99.90th=[ 477], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 96, per=40.47%, avg=42.90, stdev=23.04, samples=198 iops : min= 1, max= 24, avg=10.31, stdev= 5.85, samples=198 write: IOPS=9, BW=37.5KiB/s (38.4kB/s)(4468KiB/119192msec); 0 zone resets clat (msec): min=19, max=2048, avg=82.64, stdev=113.01 lat (msec): min=19, max=2048, avg=82.64, stdev=113.01 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 48], 40.00th=[ 53], 50.00th=[ 58], 60.00th=[ 64], | 70.00th=[ 70], 80.00th=[ 83], 90.00th=[ 117], 95.00th=[ 255], | 99.00th=[ 550], 99.50th=[ 693], 99.90th=[ 1301], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 5, max= 80, per=35.79%, avg=39.72, stdev=19.76, samples=221 iops : min= 1, max= 20, avg= 9.51, stdev= 5.07, samples=221 lat (msec) : 10=9.79%, 20=18.89%, 50=34.41%, 100=29.49%, 250=4.69% lat (msec) : 500=2.00%, 750=0.46%, 1000=0.09%, 2000=0.09%, >=2000=0.05% cpu : usr=0.05%, sys=3.91%, ctx=3756, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1080,1117,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=107KiB/s (109kB/s), 28.5KiB/s-36.2KiB/s (29.2kB/s-37.1kB/s), io=21.7MiB (22.8MB), run=119192-208707msec WRITE: bw=112KiB/s (114kB/s), 30.1KiB/s-37.5KiB/s (30.8kB/s-38.4kB/s), io=22.8MiB (23.9MB), run=119192-208707msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153933: Mon Jun 1 12:04:28 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(5920KiB/28039msec) clat (usec): min=40, max=200281, avg=38894.44, stdev=29905.83 lat (usec): min=40, max=200283, avg=38899.72, stdev=29904.04 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 2376], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 38011], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[139461], 99.50th=[145753], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 62, max= 414, per=24.64%, avg=210.42, stdev=76.71, samples=55 iops : min= 3, max= 25, avg=12.38, stdev= 4.86, samples=55 write: IOPS=14, BW=227KiB/s (233kB/s)(6368KiB/28039msec); 0 zone resets clat (usec): min=1548, max=296442, avg=33672.41, stdev=38847.68 lat (usec): min=1551, max=296444, avg=33688.29, stdev=38842.61 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2769], 10.00th=[ 3818], 20.00th=[ 6783], | 30.00th=[ 8717], 40.00th=[ 12780], 50.00th=[ 21103], 60.00th=[ 30802], | 70.00th=[ 41157], 80.00th=[ 53740], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[204473], 99.50th=[287310], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 32, max= 540, per=25.29%, avg=227.11, stdev=100.15, samples=55 iops : min= 2, max= 33, avg=13.44, stdev= 6.27, samples=55 lat (usec) : 50=0.65%, 100=6.64%, 250=1.82%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.04%, 4=4.69%, 10=12.24%, 20=8.72%, 50=37.50% lat (msec) : 100=22.40%, 250=3.52%, 500=0.39% cpu : usr=0.09%, sys=6.93%, ctx=1439, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153934: Mon Jun 1 12:04:28 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5744KiB/27935msec) clat (usec): min=38, max=138987, avg=40005.01, stdev=27833.12 lat (usec): min=38, max=138988, avg=40010.86, stdev=27831.63 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 16581], | 30.00th=[ 26870], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[121111], 99.50th=[135267], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 63, max= 381, per=24.09%, avg=205.76, stdev=78.44, samples=55 iops : min= 3, max= 23, avg=12.09, stdev= 4.98, samples=55 write: IOPS=14, BW=234KiB/s (240kB/s)(6544KiB/27935msec); 0 zone resets clat (usec): min=1573, max=204969, avg=32869.69, stdev=34742.24 lat (usec): min=1574, max=204970, avg=32873.03, stdev=34742.86 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2507], 10.00th=[ 3949], 20.00th=[ 6194], | 30.00th=[ 9241], 40.00th=[ 12780], 50.00th=[ 20055], 60.00th=[ 29492], | 70.00th=[ 39584], 80.00th=[ 55837], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[154141], 99.50th=[196084], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 94, max= 478, per=26.03%, avg=233.75, stdev=98.54, samples=55 iops : min= 5, max= 29, avg=13.85, stdev= 6.24, samples=55 lat (usec) : 50=0.52%, 100=6.25%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=1.17%, 4=4.30%, 10=12.50%, 20=11.72%, 50=34.90% lat (msec) : 100=23.83%, 250=3.78% cpu : usr=0.09%, sys=7.05%, ctx=1493, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153935: Mon Jun 1 12:04:28 2026 read: IOPS=14, BW=228KiB/s (233kB/s)(6256KiB/27465msec) clat (usec): min=37, max=173014, avg=36679.67, stdev=27410.25 lat (usec): min=37, max=173016, avg=36698.15, stdev=27424.49 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 169], | 30.00th=[ 25035], 40.00th=[ 29492], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 83362], | 99.00th=[115868], 99.50th=[133694], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 29, max= 477, per=26.84%, avg=229.19, stdev=85.72, samples=54 iops : min= 1, max= 29, avg=13.54, stdev= 5.40, samples=54 write: IOPS=13, BW=220KiB/s (225kB/s)(6032KiB/27465msec); 0 zone resets clat (usec): min=1695, max=316580, avg=34146.84, stdev=35943.53 lat (usec): min=1698, max=316580, avg=34150.69, stdev=35943.32 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2180], 10.00th=[ 3130], 20.00th=[ 6194], | 30.00th=[ 8291], 40.00th=[ 13435], 50.00th=[ 24773], 60.00th=[ 33817], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 77071], 95.00th=[103285], | 99.00th=[143655], 99.50th=[221250], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 88, max= 445, per=24.33%, avg=218.46, stdev=83.69, samples=54 iops : min= 5, max= 27, avg=12.87, stdev= 5.27, samples=54 lat (usec) : 50=1.04%, 100=6.77%, 250=2.60%, 500=0.52% lat (msec) : 2=1.56%, 4=5.08%, 10=9.77%, 20=7.16%, 50=38.67% lat (msec) : 100=23.05%, 250=3.65%, 500=0.13% cpu : usr=0.09%, sys=6.82%, ctx=1487, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153936: Mon Jun 1 12:04:28 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(6032KiB/27304msec) clat (usec): min=41, max=293948, avg=39426.13, stdev=35064.04 lat (usec): min=41, max=293949, avg=39429.29, stdev=35064.86 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 117], | 30.00th=[ 23462], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[168821], 99.50th=[200279], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 510, per=25.85%, avg=220.72, stdev=98.78, samples=53 iops : min= 1, max= 31, avg=13.02, stdev= 6.24, samples=53 write: IOPS=14, BW=229KiB/s (235kB/s)(6256KiB/27304msec); 0 zone resets clat (usec): min=1734, max=330380, avg=31134.69, stdev=36446.48 lat (usec): min=1735, max=330383, avg=31147.44, stdev=36440.79 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2245], 10.00th=[ 3294], 20.00th=[ 5604], | 30.00th=[ 8455], 40.00th=[ 12518], 50.00th=[ 19792], 60.00th=[ 27395], | 70.00th=[ 36963], 80.00th=[ 49021], 90.00th=[ 71828], 95.00th=[ 98042], | 99.00th=[191890], 99.50th=[219153], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 479, per=25.64%, avg=230.23, stdev=86.84, samples=53 iops : min= 1, max= 29, avg=13.62, stdev= 5.51, samples=53 lat (usec) : 50=1.17%, 100=8.07%, 250=1.30%, 500=0.52%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=1.56%, 4=5.34%, 10=11.85%, 20=9.11%, 50=34.51% lat (msec) : 100=21.88%, 250=3.91%, 500=0.26% cpu : usr=0.09%, sys=6.83%, ctx=1456, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=854KiB/s (875kB/s), 206KiB/s-228KiB/s (211kB/s-233kB/s), io=23.4MiB (24.5MB), run=27304-28039msec WRITE: bw=899KiB/s (920kB/s), 220KiB/s-234KiB/s (225kB/s-240kB/s), io=24.6MiB (25.8MB), run=27304-28039msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153929: Mon Jun 1 12:05:08 2026 read: IOPS=5, BW=87.9KiB/s (89.0kB/s)(5920KiB/67375msec) clat (msec): min=7, max=280, avg=40.60, stdev=40.89 lat (msec): min=7, max=280, avg=40.60, stdev=40.89 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 95], 95.00th=[ 132], | 99.00th=[ 207], 99.50th=[ 257], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 403, per=26.94%, avg=94.28, stdev=60.17, samples=123 iops : min= 1, max= 25, avg= 5.22, stdev= 3.85, samples=123 write: IOPS=5, BW=94.5KiB/s (96.8kB/s)(6368KiB/67375msec); 0 zone resets clat (msec): min=51, max=499, avg=131.35, stdev=53.23 lat (msec): min=51, max=499, avg=131.36, stdev=53.23 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 203], 95.00th=[ 236], | 99.00th=[ 288], 99.50th=[ 376], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 30, max= 192, per=25.94%, avg=95.47, stdev=37.35, samples=131 iops : min= 1, max= 12, avg= 5.30, stdev= 2.47, samples=131 lat (msec) : 10=0.39%, 20=15.23%, 50=22.92%, 100=21.48%, 250=38.28% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.55%, ctx=1328, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153930: Mon Jun 1 12:05:08 2026 read: IOPS=5, BW=84.1KiB/s (86.1kB/s)(5744KiB/68311msec) clat (msec): min=7, max=241, avg=39.56, stdev=37.40 lat (msec): min=7, max=241, avg=39.56, stdev=37.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 92], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 203], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 28, max= 287, per=26.76%, avg=93.67, stdev=59.39, samples=120 iops : min= 1, max= 17, avg= 5.19, stdev= 3.80, samples=120 write: IOPS=5, BW=95.8KiB/s (98.1kB/s)(6544KiB/68311msec); 0 zone resets clat (msec): min=48, max=412, avg=131.75, stdev=53.74 lat (msec): min=48, max=412, avg=131.76, stdev=53.74 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 78], 20.00th=[ 89], | 30.00th=[ 100], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 132], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 211], 95.00th=[ 234], | 99.00th=[ 300], 99.50th=[ 338], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 31, max= 221, per=26.07%, avg=95.95, stdev=40.56, samples=134 iops : min= 1, max= 13, avg= 5.33, stdev= 2.64, samples=134 lat (msec) : 10=1.17%, 20=13.15%, 50=23.18%, 100=21.61%, 250=39.19% lat (msec) : 500=1.69% cpu : usr=0.04%, sys=1.54%, ctx=1359, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153931: Mon Jun 1 12:05:08 2026 read: IOPS=5, BW=95.2KiB/s (97.4kB/s)(6256KiB/65746msec) clat (msec): min=6, max=256, avg=37.02, stdev=34.64 lat (msec): min=6, max=256, avg=37.02, stdev=34.64 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 66], 95.00th=[ 105], | 99.00th=[ 209], 99.50th=[ 249], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 30, max= 319, per=29.25%, avg=102.39, stdev=69.74, samples=121 iops : min= 1, max= 19, avg= 5.71, stdev= 4.47, samples=121 write: IOPS=5, BW=91.7KiB/s (93.9kB/s)(6032KiB/65746msec); 0 zone resets clat (msec): min=46, max=400, avg=135.48, stdev=58.28 lat (msec): min=46, max=400, avg=135.49, stdev=58.28 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 79], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 138], | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 205], 95.00th=[ 262], | 99.00th=[ 347], 99.50th=[ 376], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 192, per=24.99%, avg=91.96, stdev=37.42, samples=129 iops : min= 1, max= 12, avg= 5.06, stdev= 2.47, samples=129 lat (msec) : 10=0.39%, 20=15.63%, 50=26.04%, 100=20.57%, 250=34.51% lat (msec) : 500=2.86% cpu : usr=0.06%, sys=1.54%, ctx=1313, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153932: Mon Jun 1 12:05:08 2026 read: IOPS=5, BW=90.7KiB/s (92.8kB/s)(6032KiB/66529msec) clat (msec): min=7, max=261, avg=38.87, stdev=36.36 lat (msec): min=7, max=261, avg=38.88, stdev=36.36 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 83], 95.00th=[ 117], | 99.00th=[ 201], 99.50th=[ 228], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 286, per=28.20%, avg=98.71, stdev=58.24, samples=119 iops : min= 1, max= 17, avg= 5.51, stdev= 3.73, samples=119 write: IOPS=5, BW=94.0KiB/s (96.3kB/s)(6256KiB/66529msec); 0 zone resets clat (msec): min=46, max=349, avg=131.85, stdev=49.91 lat (msec): min=46, max=349, avg=131.85, stdev=49.91 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 91], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 124], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 165], 90.00th=[ 199], 95.00th=[ 224], | 99.00th=[ 321], 99.50th=[ 342], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 28, max= 191, per=25.90%, avg=95.29, stdev=34.56, samples=129 iops : min= 1, max= 11, avg= 5.28, stdev= 2.28, samples=129 lat (msec) : 10=0.65%, 20=13.67%, 50=25.39%, 100=21.22%, 250=37.63% lat (msec) : 500=1.43% cpu : usr=0.04%, sys=1.56%, ctx=1274, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=351KiB/s (359kB/s), 84.1KiB/s-95.2KiB/s (86.1kB/s-97.4kB/s), io=23.4MiB (24.5MB), run=65746-68311msec WRITE: bw=369KiB/s (378kB/s), 91.7KiB/s-95.8KiB/s (93.9kB/s-98.1kB/s), io=24.6MiB (25.8MB), run=65746-68311msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153962: Mon Jun 1 12:05:25 2026 read: IOPS=2, BW=2088KiB/s (2138kB/s)(7168KiB/3433msec) clat (msec): min=3, max=328, avg=219.19, stdev=126.45 lat (msec): min=3, max=328, avg=219.19, stdev=126.45 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 82], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 268], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 317], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1950, max= 2976, per=57.27%, avg=2196.80, stdev=437.43, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1491KiB/s (1527kB/s)(5120KiB/3433msec); 0 zone resets clat (msec): min=93, max=503, avg=310.84, stdev=159.59 lat (msec): min=93, max=503, avg=310.92, stdev=159.62 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1976, max= 4015, per=49.86%, avg=2678.00, stdev=1158.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 100=16.67%, 250=16.67%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=10.84%, ctx=220, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153963: Mon Jun 1 12:05:25 2026 read: IOPS=0, BW=384KiB/s (393kB/s)(2048KiB/5338msec) clat (msec): min=275, max=766, avg=520.79, stdev=347.00 lat (msec): min=275, max=766, avg=520.79, stdev=347.00 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2039, max= 2048, per=53.27%, avg=2043.50, stdev= 6.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1918KiB/s (1964kB/s)(10.0MiB/5338msec); 0 zone resets clat (msec): min=164, max=771, avg=393.50, stdev=194.81 lat (msec): min=164, max=772, avg=393.63, stdev=194.83 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 249], | 30.00th=[ 264], 40.00th=[ 309], 50.00th=[ 326], 60.00th=[ 351], | 70.00th=[ 372], 80.00th=[ 435], 90.00th=[ 701], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1950, max= 4087, per=48.18%, avg=2587.71, stdev=1021.74, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=11.99%, ctx=183, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153964: Mon Jun 1 12:05:25 2026 read: IOPS=1, BW=1334KiB/s (1366kB/s)(6144KiB/4605msec) clat (usec): min=669, max=289390, avg=123877.62, stdev=116092.09 lat (usec): min=670, max=289391, avg=123878.86, stdev=116091.95 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 2638], | 30.00th=[ 2638], 40.00th=[ 84411], 50.00th=[ 84411], 60.00th=[156238], | 70.00th=[210764], 80.00th=[210764], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 2048, max= 4087, per=87.20%, avg=3345.00, stdev=1127.12, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1334KiB/s (1366kB/s)(6144KiB/4605msec); 0 zone resets clat (msec): min=181, max=1087, avg=576.62, stdev=327.55 lat (msec): min=181, max=1087, avg=576.73, stdev=327.55 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 642], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1408, max= 2048, per=35.33%, avg=1897.60, stdev=276.68, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=25.00%, 500=16.67%, 750=25.00% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=8.64%, ctx=152, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153965: Mon Jun 1 12:05:25 2026 read: IOPS=1, BW=1741KiB/s (1783kB/s)(5120KiB/2940msec) clat (usec): min=1068, max=322355, avg=187542.16, stdev=169640.98 lat (usec): min=1069, max=322355, avg=187543.15, stdev=169640.84 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1074], 10.00th=[ 1074], 20.00th=[ 1074], | 30.00th=[ 2966], 40.00th=[ 2966], 50.00th=[295699], 60.00th=[295699], | 70.00th=[316670], 80.00th=[316670], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 2043, max= 5930, per=100.00%, avg=3986.50, stdev=2748.52, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2438KiB/s (2497kB/s)(7168KiB/2940msec); 0 zone resets clat (msec): min=175, max=508, avg=275.11, stdev=122.52 lat (msec): min=176, max=509, avg=275.25, stdev=122.44 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 230], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 368], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1976, max= 6023, per=60.32%, avg=3239.75, stdev=1904.99, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 lat (msec) : 2=8.33%, 4=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=13.88%, ctx=125, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3837KiB/s (3929kB/s), 384KiB/s-2088KiB/s (393kB/s-2138kB/s), io=20.0MiB (20.0MB), run=2940-5338msec WRITE: bw=5371KiB/s (5500kB/s), 1334KiB/s-2438KiB/s (1366kB/s-2497kB/s), io=28.0MiB (29.4MB), run=2940-5338msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153958: Mon Jun 1 12:05:25 2026 read: IOPS=1, BW=1709KiB/s (1750kB/s)(7168KiB/4195msec) clat (msec): min=133, max=875, avg=278.65, stdev=267.60 lat (msec): min=133, max=875, avg=278.65, stdev=267.60 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 140], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 284], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1508, max= 4031, per=63.86%, avg=2333.50, stdev=1146.47, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1221KiB/s (1250kB/s)(5120KiB/4195msec); 0 zone resets clat (msec): min=227, max=626, avg=402.40, stdev=165.40 lat (msec): min=228, max=627, avg=402.68, stdev=165.37 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1899, max= 4087, per=51.86%, avg=2653.00, stdev=1242.43, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.34%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153959: Mon Jun 1 12:05:25 2026 read: IOPS=0, BW=391KiB/s (401kB/s)(2048KiB/5232msec) clat (msec): min=186, max=276, avg=231.06, stdev=63.59 lat (msec): min=186, max=276, avg=231.07, stdev=63.59 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1553, max= 2043, per=49.21%, avg=1798.00, stdev=346.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1957KiB/s (2004kB/s)(10.0MiB/5232msec); 0 zone resets clat (msec): min=201, max=930, avg=451.11, stdev=267.53 lat (msec): min=201, max=930, avg=451.20, stdev=267.52 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 253], 40.00th=[ 321], 50.00th=[ 359], 60.00th=[ 372], | 70.00th=[ 393], 80.00th=[ 584], 90.00th=[ 894], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1973, max= 4071, per=62.22%, avg=3183.40, stdev=1078.29, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=3.78%, ctx=87, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153960: Mon Jun 1 12:05:25 2026 read: IOPS=1, BW=1446KiB/s (1481kB/s)(6144KiB/4249msec) clat (msec): min=72, max=475, avg=207.64, stdev=154.97 lat (msec): min=72, max=475, avg=207.64, stdev=154.97 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 180], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2043, max= 3946, per=89.29%, avg=3262.67, stdev=1058.82, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1446KiB/s (1481kB/s)(6144KiB/4249msec); 0 zone resets clat (msec): min=199, max=871, avg=485.47, stdev=224.48 lat (msec): min=199, max=871, avg=485.54, stdev=224.48 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 468], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1896, max= 2968, per=43.60%, avg=2230.50, stdev=495.78, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.18%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153961: Mon Jun 1 12:05:25 2026 read: IOPS=0, BW=914KiB/s (936kB/s)(5120KiB/5604msec) clat (msec): min=106, max=312, avg=162.73, stdev=84.71 lat (msec): min=106, max=312, avg=162.74, stdev=84.71 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 127], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2035, max= 6095, per=100.00%, avg=4065.00, stdev=2870.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1279KiB/s (1310kB/s)(7168KiB/5604msec); 0 zone resets clat (msec): min=223, max=1656, avg=630.10, stdev=501.22 lat (msec): min=223, max=1656, avg=630.31, stdev=501.21 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 243], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 575], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 776], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1973, max= 4087, per=47.57%, avg=2433.80, stdev=924.58, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=4.43%, ctx=121, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3655KiB/s (3742kB/s), 391KiB/s-1709KiB/s (401kB/s-1750kB/s), io=20.0MiB (20.0MB), run=4195-5604msec WRITE: bw=5116KiB/s (5239kB/s), 1221KiB/s-1957KiB/s (1250kB/s-2004kB/s), io=28.0MiB (29.4MB), run=4195-5604msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153977: Mon Jun 1 12:05:40 2026 read: IOPS=1, BW=5202KiB/s (5327kB/s)(12.0MiB/2362msec) clat (msec): min=625, max=987, avg=786.96, stdev=184.23 lat (msec): min=625, max=987, avg=786.96, stdev=184.23 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.09%, ctx=332, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153978: Mon Jun 1 12:05:40 2026 read: IOPS=0, BW=1055KiB/s (1081kB/s)(4096KiB/3881msec) clat (nsec): min=706233k, max=706233k, avg=706233224.00, stdev= 0.00 lat (nsec): min=706235k, max=706235k, avg=706234659.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2111KiB/s (2161kB/s)(8192KiB/3881msec); 0 zone resets clat (msec): min=667, max=2504, avg=1586.25, stdev=1298.96 lat (msec): min=668, max=2505, avg=1586.70, stdev=1298.77 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 2500], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8175, max= 8175, per=97.60%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.47%, ctx=107, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153979: Mon Jun 1 12:05:40 2026 write: IOPS=0, BW=3141KiB/s (3216kB/s)(12.0MiB/3912msec); 0 zone resets clat (msec): min=1175, max=1480, avg=1298.04, stdev=161.22 lat (msec): min=1175, max=1481, avg=1298.95, stdev=161.11 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8110, max= 8192, per=97.31%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.91%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153980: Mon Jun 1 12:05:40 2026 write: IOPS=1, BW=4565KiB/s (4674kB/s)(12.0MiB/2692msec); 0 zone resets clat (msec): min=502, max=1500, avg=895.79, stdev=531.74 lat (msec): min=502, max=1500, avg=896.10, stdev=531.74 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 5475, max= 8094, per=81.00%, avg=6784.50, stdev=1851.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.83%, ctx=39, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4222KiB/s (4323kB/s), 1055KiB/s-5202KiB/s (1081kB/s-5327kB/s), io=16.0MiB (16.8MB), run=2362-3881msec WRITE: bw=8376KiB/s (8577kB/s), 2111KiB/s-4565KiB/s (2161kB/s-4674kB/s), io=32.0MiB (33.6MB), run=2692-3912msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153971: Mon Jun 1 12:05:40 2026 read: IOPS=0, BW=3631KiB/s (3718kB/s)(12.0MiB/3384msec) clat (msec): min=732, max=1314, avg=1113.67, stdev=330.56 lat (msec): min=732, max=1314, avg=1113.67, stdev=330.56 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.84%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153972: Mon Jun 1 12:05:40 2026 read: IOPS=0, BW=846KiB/s (867kB/s)(4096KiB/4840msec) clat (nsec): min=1428.1M, max=1428.1M, avg=1428083792.00, stdev= 0.00 lat (nsec): min=1428.1M, max=1428.1M, avg=1428084764.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1693KiB/s (1733kB/s)(8192KiB/4840msec); 0 zone resets clat (msec): min=610, max=2725, avg=1667.72, stdev=1495.74 lat (msec): min=610, max=2725, avg=1667.99, stdev=1495.82 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 2735], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.92%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153973: Mon Jun 1 12:05:40 2026 write: IOPS=1, BW=5838KiB/s (5978kB/s)(12.0MiB/2105msec); 0 zone resets clat (msec): min=357, max=1262, avg=687.32, stdev=499.87 lat (msec): min=358, max=1264, avg=689.98, stdev=499.67 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 5859, max= 8094, per=100.00%, avg=6976.50, stdev=1580.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.10%, sys=5.56%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153974: Mon Jun 1 12:05:40 2026 write: IOPS=1, BW=4163KiB/s (4263kB/s)(12.0MiB/2952msec); 0 zone resets clat (msec): min=374, max=1512, avg=959.20, stdev=569.63 lat (msec): min=375, max=1513, avg=959.54, stdev=569.54 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 5580, max= 8175, per=100.00%, avg=6877.50, stdev=1834.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.93%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3385KiB/s (3466kB/s), 846KiB/s-3631KiB/s (867kB/s-3718kB/s), io=16.0MiB (16.8MB), run=3384-4840msec WRITE: bw=6770KiB/s (6933kB/s), 1693KiB/s-5838KiB/s (1733kB/s-5978kB/s), io=32.0MiB (33.6MB), run=2105-4840msec