== sanity test 398b: DIO and buffer IO race ============== 18:22:11 (1785882131) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 10.0682 s, 5.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143726: Tue Aug 4 18:25:53 2026 read: IOPS=7, BW=31.7KiB/s (32.5kB/s)(5992KiB/189038msec) clat (usec): min=32, max=580568, avg=64723.52, stdev=47121.40 lat (usec): min=32, max=580571, avg=64727.23, stdev=47119.90 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 71], 10.00th=[ 18744], 20.00th=[ 31065], | 30.00th=[ 39060], 40.00th=[ 47449], 50.00th=[ 55313], 60.00th=[ 66847], | 70.00th=[ 79168], 80.00th=[ 96994], 90.00th=[120062], 95.00th=[145753], | 99.00th=[200279], 99.50th=[244319], 99.90th=[574620], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 6, max= 88, per=24.94%, avg=31.42, stdev=14.97, samples=366 iops : min= 1, max= 22, avg= 7.18, stdev= 3.77, samples=366 write: IOPS=8, BW=33.3KiB/s (34.1kB/s)(6296KiB/189038msec); 0 zone resets clat (usec): min=1142, max=430641, avg=58082.90, stdev=59200.02 lat (usec): min=1143, max=430643, avg=58089.34, stdev=59200.09 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 2868], 20.00th=[ 7242], | 30.00th=[ 13435], 40.00th=[ 28181], 50.00th=[ 43779], 60.00th=[ 58459], | 70.00th=[ 77071], 80.00th=[ 99091], 90.00th=[132645], 95.00th=[168821], | 99.00th=[274727], 99.50th=[312476], 99.90th=[425722], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 94, per=25.07%, avg=33.10, stdev=16.96, samples=366 iops : min= 1, max= 23, avg= 7.60, stdev= 4.28, samples=366 lat (usec) : 50=0.49%, 100=2.70%, 250=0.23%, 500=0.10%, 750=0.03% lat (msec) : 2=4.30%, 4=2.15%, 10=7.03%, 20=6.09%, 50=26.17% lat (msec) : 100=31.90%, 250=17.90%, 500=0.85%, 750=0.07% cpu : usr=0.05%, sys=3.57%, ctx=6458, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143727: Tue Aug 4 18:25:53 2026 read: IOPS=7, BW=31.4KiB/s (32.1kB/s)(5940KiB/189371msec) clat (usec): min=28, max=757634, avg=63404.70, stdev=47208.85 lat (usec): min=29, max=757635, avg=63407.68, stdev=47208.94 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 69], 10.00th=[ 18744], 20.00th=[ 29754], | 30.00th=[ 38011], 40.00th=[ 45351], 50.00th=[ 53216], 60.00th=[ 64226], | 70.00th=[ 77071], 80.00th=[ 93848], 90.00th=[121111], 95.00th=[143655], | 99.00th=[202376], 99.50th=[217056], 99.90th=[375391], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 87, per=24.89%, avg=31.37, stdev=15.19, samples=365 iops : min= 1, max= 21, avg= 7.17, stdev= 3.83, samples=365 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6348KiB/189371msec); 0 zone resets clat (usec): min=1134, max=985874, avg=59532.48, stdev=63497.69 lat (usec): min=1135, max=985876, avg=59539.93, stdev=63498.03 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1467], 10.00th=[ 2343], 20.00th=[ 6980], | 30.00th=[ 13173], 40.00th=[ 28705], 50.00th=[ 44827], 60.00th=[ 61604], | 70.00th=[ 80217], 80.00th=[101188], 90.00th=[135267], 95.00th=[170918], | 99.00th=[263193], 99.50th=[308282], 99.90th=[591397], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 101, per=25.25%, avg=33.33, stdev=16.42, samples=367 iops : min= 1, max= 25, avg= 7.66, stdev= 4.16, samples=367 lat (usec) : 50=0.49%, 100=2.80%, 250=0.20% lat (msec) : 2=4.85%, 4=1.66%, 10=6.71%, 20=6.93%, 50=26.30% lat (msec) : 100=31.25%, 250=18.03%, 500=0.68%, 750=0.03%, 1000=0.07% cpu : usr=0.05%, sys=3.50%, ctx=6426, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143728: Tue Aug 4 18:25:53 2026 read: IOPS=7, BW=31.0KiB/s (32.7kB/s)(6028KiB/188544msec) clat (usec): min=29, max=563093, avg=62814.14, stdev=46278.79 lat (usec): min=29, max=563093, avg=62815.58, stdev=46278.76 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 18220], 20.00th=[ 31327], | 30.00th=[ 38536], 40.00th=[ 45876], 50.00th=[ 53740], 60.00th=[ 62129], | 70.00th=[ 76022], 80.00th=[ 93848], 90.00th=[117965], 95.00th=[137364], | 99.00th=[193987], 99.50th=[248513], 99.90th=[480248], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 93, per=25.33%, avg=31.92, stdev=15.16, samples=364 iops : min= 1, max= 23, avg= 7.30, stdev= 3.82, samples=364 write: IOPS=8, BW=33.2KiB/s (33.0kB/s)(6260KiB/188544msec); 0 zone resets clat (usec): min=1077, max=519299, avg=59487.78, stdev=59435.02 lat (usec): min=1077, max=519301, avg=59494.10, stdev=59436.76 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1450], 10.00th=[ 3294], 20.00th=[ 8029], | 30.00th=[ 13698], 40.00th=[ 28967], 50.00th=[ 45876], 60.00th=[ 61604], | 70.00th=[ 79168], 80.00th=[103285], 90.00th=[133694], 95.00th=[168821], | 99.00th=[248513], 99.50th=[283116], 99.90th=[513803], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 96, per=24.96%, avg=32.95, stdev=15.32, samples=366 iops : min= 1, max= 24, avg= 7.57, stdev= 3.88, samples=366 lat (usec) : 50=0.52%, 100=3.06%, 250=0.26%, 500=0.03% lat (msec) : 2=4.33%, 4=2.05%, 10=6.41%, 20=6.12%, 50=26.07% lat (msec) : 100=31.58%, 250=18.85%, 500=0.62%, 750=0.10% cpu : usr=0.05%, sys=3.57%, ctx=6412, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143729: Tue Aug 4 18:25:53 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(6052KiB/187423msec) clat (usec): min=31, max=1049.2k, avg=63370.05, stdev=53104.92 lat (usec): min=31, max=1049.2k, avg=63376.04, stdev=53110.59 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 11076], | 20.00th=[ 28967], 30.00th=[ 37487], 40.00th=[ 46400], | 50.00th=[ 54789], 60.00th=[ 64750], 70.00th=[ 77071], | 80.00th=[ 93848], 90.00th=[ 121111], 95.00th=[ 143655], | 99.00th=[ 193987], 99.50th=[ 240124], 99.90th=[ 608175], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 79, per=25.93%, avg=32.68, stdev=14.10, samples=357 iops : min= 1, max= 19, avg= 7.49, stdev= 3.54, samples=357 write: IOPS=8, BW=33.3KiB/s (34.1kB/s)(6236KiB/187423msec); 0 zone resets clat (usec): min=1044, max=467444, avg=58250.63, stdev=58764.23 lat (usec): min=1044, max=467445, avg=58259.89, stdev=58766.81 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1434], 10.00th=[ 2114], 20.00th=[ 7046], | 30.00th=[ 12125], 40.00th=[ 25822], 50.00th=[ 42206], 60.00th=[ 60031], | 70.00th=[ 79168], 80.00th=[102237], 90.00th=[137364], 95.00th=[168821], | 99.00th=[240124], 99.50th=[304088], 99.90th=[362808], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 86, per=25.29%, avg=33.39, stdev=15.82, samples=360 iops : min= 1, max= 21, avg= 7.67, stdev= 3.98, samples=360 lat (usec) : 50=0.72%, 100=3.39%, 250=0.29%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.14%, 4=1.63%, 10=6.58%, 20=6.74%, 50=25.13% lat (msec) : 100=31.15%, 250=18.36%, 500=0.62%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=3.55%, ctx=6361, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=127KiB/s (130kB/s), 31.4KiB/s-32.3KiB/s (32.1kB/s-33.1kB/s), io=23.4MiB (24.6MB), run=187423-189371msec WRITE: bw=133KiB/s (136kB/s), 33.2KiB/s-33.5KiB/s (33.0kB/s-34.3kB/s), io=24.6MiB (25.7MB), run=187423-189371msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143731: Tue Aug 4 18:29:32 2026 read: IOPS=3, BW=14.9KiB/s (15.2kB/s)(5992KiB/402875msec) clat (msec): min=6, max=1076, avg=60.02, stdev=59.69 lat (msec): min=6, max=1076, avg=60.02, stdev=59.69 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 292], 99.50th=[ 317], 99.90th=[ 510], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 72, per=31.51%, avg=18.28, stdev=12.17, samples=624 iops : min= 1, max= 18, avg= 3.90, stdev= 3.08, samples=624 write: IOPS=3, BW=15.6KiB/s (16.0kB/s)(6296KiB/402875msec); 0 zone resets clat (msec): min=53, max=1037, avg=198.70, stdev=88.42 lat (msec): min=53, max=1037, avg=198.71, stdev=88.42 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 90], 10.00th=[ 105], 20.00th=[ 127], | 30.00th=[ 148], 40.00th=[ 167], 50.00th=[ 184], 60.00th=[ 207], | 70.00th=[ 228], 80.00th=[ 259], 90.00th=[ 305], 95.00th=[ 351], | 99.00th=[ 489], 99.50th=[ 558], 99.90th=[ 785], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 47, per=25.48%, avg=15.54, stdev= 7.20, samples=764 iops : min= 1, max= 11, avg= 3.21, stdev= 1.85, samples=764 lat (msec) : 10=0.36%, 20=6.05%, 50=21.58%, 100=18.33%, 250=41.18% lat (msec) : 500=11.98%, 750=0.42%, 1000=0.03%, 2000=0.07% cpu : usr=0.03%, sys=1.00%, ctx=5362, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143732: Tue Aug 4 18:29:32 2026 read: IOPS=3, BW=14.6KiB/s (14.9kB/s)(5940KiB/407814msec) clat (msec): min=7, max=868, avg=58.86, stdev=57.29 lat (msec): min=7, max=868, avg=58.87, stdev=57.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 64], 80.00th=[ 81], 90.00th=[ 125], 95.00th=[ 159], | 99.00th=[ 268], 99.50th=[ 305], 99.90th=[ 600], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 95, per=32.23%, avg=18.69, stdev=12.47, samples=605 iops : min= 1, max= 23, avg= 4.00, stdev= 3.14, samples=605 write: IOPS=3, BW=15.6KiB/s (15.9kB/s)(6348KiB/407814msec); 0 zone resets clat (msec): min=33, max=835, avg=201.75, stdev=90.09 lat (msec): min=33, max=835, avg=201.76, stdev=90.09 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 85], 10.00th=[ 103], 20.00th=[ 130], | 30.00th=[ 153], 40.00th=[ 171], 50.00th=[ 190], 60.00th=[ 207], | 70.00th=[ 230], 80.00th=[ 268], 90.00th=[ 313], 95.00th=[ 363], | 99.00th=[ 506], 99.50th=[ 575], 99.90th=[ 684], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 79, per=25.27%, avg=15.41, stdev= 7.66, samples=777 iops : min= 1, max= 19, avg= 3.19, stdev= 1.95, samples=777 lat (msec) : 10=1.14%, 20=6.45%, 50=20.80%, 100=17.77%, 250=40.72% lat (msec) : 500=12.50%, 750=0.55%, 1000=0.07% cpu : usr=0.04%, sys=1.01%, ctx=5427, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143733: Tue Aug 4 18:29:32 2026 read: IOPS=3, BW=14.9KiB/s (15.3kB/s)(6028KiB/404615msec) clat (msec): min=7, max=609, avg=60.29, stdev=55.98 lat (msec): min=7, max=609, avg=60.30, stdev=55.98 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 82], 90.00th=[ 118], 95.00th=[ 167], | 99.00th=[ 296], 99.50th=[ 359], 99.90th=[ 518], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 64, per=30.37%, avg=17.62, stdev=11.74, samples=650 iops : min= 1, max= 16, avg= 3.74, stdev= 2.96, samples=650 write: IOPS=3, BW=15.5KiB/s (15.8kB/s)(6260KiB/404615msec); 0 zone resets clat (msec): min=38, max=828, avg=200.36, stdev=86.49 lat (msec): min=38, max=828, avg=200.36, stdev=86.49 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 91], 10.00th=[ 106], 20.00th=[ 131], | 30.00th=[ 150], 40.00th=[ 169], 50.00th=[ 186], 60.00th=[ 207], | 70.00th=[ 232], 80.00th=[ 262], 90.00th=[ 309], 95.00th=[ 355], | 99.00th=[ 468], 99.50th=[ 542], 99.90th=[ 684], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 56, per=25.25%, avg=15.40, stdev= 7.37, samples=767 iops : min= 1, max= 14, avg= 3.18, stdev= 1.89, samples=767 lat (msec) : 10=0.59%, 20=5.86%, 50=21.71%, 100=18.23%, 250=41.18% lat (msec) : 500=11.95%, 750=0.46%, 1000=0.03% cpu : usr=0.03%, sys=1.02%, ctx=5196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143734: Tue Aug 4 18:29:32 2026 read: IOPS=3, BW=14.0KiB/s (15.3kB/s)(6052KiB/403873msec) clat (msec): min=5, max=602, avg=58.57, stdev=53.46 lat (msec): min=5, max=602, avg=58.58, stdev=53.46 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 64], 80.00th=[ 81], 90.00th=[ 118], 95.00th=[ 155], | 99.00th=[ 271], 99.50th=[ 342], 99.90th=[ 464], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 79, per=32.08%, avg=18.61, stdev=12.40, samples=618 iops : min= 1, max= 19, avg= 3.99, stdev= 3.12, samples=618 write: IOPS=3, BW=15.4KiB/s (15.8kB/s)(6236KiB/403873msec); 0 zone resets clat (msec): min=33, max=1062, avg=202.10, stdev=90.85 lat (msec): min=33, max=1062, avg=202.10, stdev=90.85 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 86], 10.00th=[ 104], 20.00th=[ 132], | 30.00th=[ 150], 40.00th=[ 167], 50.00th=[ 188], 60.00th=[ 211], | 70.00th=[ 232], 80.00th=[ 264], 90.00th=[ 309], 95.00th=[ 363], | 99.00th=[ 518], 99.50th=[ 575], 99.90th=[ 718], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 40, per=24.91%, avg=15.20, stdev= 7.03, samples=771 iops : min= 1, max= 10, avg= 3.13, stdev= 1.80, samples=771 lat (msec) : 10=0.78%, 20=5.76%, 50=22.33%, 100=17.71%, 250=40.30% lat (msec) : 500=12.57%, 750=0.52%, 2000=0.03% cpu : usr=0.03%, sys=1.04%, ctx=5329, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=58.9KiB/s (60.3kB/s), 14.6KiB/s-14.0KiB/s (14.9kB/s-15.3kB/s), io=23.4MiB (24.6MB), run=402875-407814msec WRITE: bw=61.6KiB/s (63.1kB/s), 15.4KiB/s-15.6KiB/s (15.8kB/s-16.0kB/s), io=24.6MiB (25.7MB), run=402875-407814msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143812: Tue Aug 4 18:30:28 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5920KiB/43626msec) clat (usec): min=31, max=576290, avg=60618.04, stdev=53625.93 lat (usec): min=32, max=576291, avg=60667.28, stdev=53610.37 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 70], 20.00th=[ 21627], | 30.00th=[ 36963], 40.00th=[ 46400], 50.00th=[ 54264], 60.00th=[ 64226], | 70.00th=[ 76022], 80.00th=[ 91751], 90.00th=[110625], 95.00th=[139461], | 99.00th=[274727], 99.50th=[329253], 99.90th=[574620], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 31, max= 287, per=25.04%, avg=136.19, stdev=54.95, samples=84 iops : min= 1, max= 17, avg= 7.73, stdev= 3.49, samples=84 write: IOPS=9, BW=146KiB/s (149kB/s)(6368KiB/43626msec); 0 zone resets clat (usec): min=1493, max=264739, avg=52951.75, stdev=51828.91 lat (usec): min=1495, max=264743, avg=52962.16, stdev=51833.19 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2671], 10.00th=[ 5604], 20.00th=[ 9634], | 30.00th=[ 14091], 40.00th=[ 23725], 50.00th=[ 38536], 60.00th=[ 49021], | 70.00th=[ 71828], 80.00th=[ 91751], 90.00th=[122160], 95.00th=[160433], | 99.00th=[240124], 99.50th=[265290], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 384, per=26.38%, avg=151.16, stdev=66.48, samples=82 iops : min= 1, max= 24, avg= 8.67, stdev= 4.20, samples=82 lat (usec) : 50=1.30%, 100=5.86%, 250=0.26%, 1000=0.26% lat (msec) : 2=2.34%, 4=1.69%, 10=7.55%, 20=8.98%, 50=24.87% lat (msec) : 100=30.86%, 250=15.23%, 500=0.65%, 750=0.13% cpu : usr=0.04%, sys=3.93%, ctx=1580, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143813: Tue Aug 4 18:30:28 2026 read: IOPS=8, BW=131KiB/s (135kB/s)(5744KiB/43700msec) clat (usec): min=44, max=332376, avg=64032.89, stdev=47443.37 lat (usec): min=45, max=332377, avg=64034.20, stdev=47443.35 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 77], 20.00th=[ 28967], | 30.00th=[ 42206], 40.00th=[ 50594], 50.00th=[ 58459], 60.00th=[ 68682], | 70.00th=[ 77071], 80.00th=[ 91751], 90.00th=[123208], 95.00th=[145753], | 99.00th=[212861], 99.50th=[278922], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 22, max= 287, per=25.36%, avg=137.98, stdev=65.01, samples=81 iops : min= 1, max= 17, avg= 7.84, stdev= 4.08, samples=81 write: IOPS=9, BW=150KiB/s (153kB/s)(6544KiB/43700msec); 0 zone resets clat (usec): min=1381, max=444768, avg=49673.96, stdev=56183.67 lat (usec): min=1382, max=444771, avg=49677.34, stdev=56184.26 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2311], 10.00th=[ 4883], 20.00th=[ 8356], | 30.00th=[ 11863], 40.00th=[ 19792], 50.00th=[ 30016], 60.00th=[ 43254], | 70.00th=[ 61080], 80.00th=[ 82314], 90.00th=[122160], 95.00th=[156238], | 99.00th=[250610], 99.50th=[312476], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 31, max= 351, per=26.08%, avg=149.44, stdev=78.94, samples=85 iops : min= 1, max= 21, avg= 8.58, stdev= 5.01, samples=85 lat (usec) : 50=0.39%, 100=5.34%, 250=0.26%, 500=0.26% lat (msec) : 2=2.34%, 4=2.60%, 10=8.59%, 20=9.51%, 50=22.66% lat (msec) : 100=32.55%, 250=14.58%, 500=0.91% cpu : usr=0.05%, sys=4.05%, ctx=1569, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143815: Tue Aug 4 18:30:28 2026 read: IOPS=8, BW=142KiB/s (146kB/s)(6256KiB/43952msec) clat (usec): min=31, max=342156, avg=63543.07, stdev=51327.87 lat (usec): min=31, max=342157, avg=63544.39, stdev=51327.86 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 54], 10.00th=[ 67], 20.00th=[ 23462], | 30.00th=[ 40109], 40.00th=[ 50594], 50.00th=[ 56886], 60.00th=[ 66847], | 70.00th=[ 80217], 80.00th=[ 99091], 90.00th=[116917], 95.00th=[149947], | 99.00th=[274727], 99.50th=[304088], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 319, per=26.61%, avg=144.75, stdev=64.06, samples=85 iops : min= 1, max= 19, avg= 8.27, stdev= 4.07, samples=85 write: IOPS=8, BW=137KiB/s (141kB/s)(6032KiB/43952msec); 0 zone resets clat (usec): min=1436, max=351206, avg=49212.16, stdev=49652.87 lat (usec): min=1437, max=351208, avg=49214.45, stdev=49652.77 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2024], 10.00th=[ 3884], 20.00th=[ 7963], | 30.00th=[ 11863], 40.00th=[ 18744], 50.00th=[ 33817], 60.00th=[ 49546], | 70.00th=[ 67634], 80.00th=[ 84411], 90.00th=[112722], 95.00th=[147850], | 99.00th=[223347], 99.50th=[250610], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 288, per=24.41%, avg=139.85, stdev=63.13, samples=84 iops : min= 1, max= 18, avg= 7.95, stdev= 4.01, samples=84 lat (usec) : 50=1.69%, 100=6.38%, 250=0.65%, 500=0.13% lat (msec) : 2=2.86%, 4=2.99%, 10=7.42%, 20=7.81%, 50=19.66% lat (msec) : 100=33.59%, 250=16.02%, 500=0.78% cpu : usr=0.04%, sys=3.59%, ctx=1546, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143817: Tue Aug 4 18:30:28 2026 read: IOPS=8, BW=139KiB/s (143kB/s)(6032KiB/43334msec) clat (usec): min=40, max=532180, avg=65019.59, stdev=57754.75 lat (usec): min=41, max=532181, avg=65020.99, stdev=57754.99 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 20841], | 30.00th=[ 38536], 40.00th=[ 50594], 50.00th=[ 58459], 60.00th=[ 69731], | 70.00th=[ 80217], 80.00th=[ 92799], 90.00th=[123208], 95.00th=[154141], | 99.00th=[283116], 99.50th=[358613], 99.90th=[530580], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 29, max= 286, per=26.26%, avg=142.86, stdev=61.90, samples=83 iops : min= 1, max= 17, avg= 8.13, stdev= 3.90, samples=83 write: IOPS=9, BW=144KiB/s (148kB/s)(6256KiB/43334msec); 0 zone resets clat (usec): min=1436, max=279443, avg=47036.04, stdev=49244.78 lat (usec): min=1437, max=279445, avg=47038.26, stdev=49244.67 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2114], 10.00th=[ 5014], 20.00th=[ 8979], | 30.00th=[ 13042], 40.00th=[ 18482], 50.00th=[ 27919], 60.00th=[ 45351], | 70.00th=[ 59507], 80.00th=[ 82314], 90.00th=[110625], 95.00th=[143655], | 99.00th=[246416], 99.50th=[258999], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 30, max= 351, per=25.25%, avg=144.67, stdev=77.18, samples=85 iops : min= 1, max= 21, avg= 8.26, stdev= 4.87, samples=85 lat (usec) : 50=1.04%, 100=7.16%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=2.34%, 4=2.34%, 10=7.16%, 20=10.16%, 50=21.09% lat (msec) : 100=32.55%, 250=14.32%, 500=1.04%, 750=0.13% cpu : usr=0.06%, sys=3.77%, ctx=1587, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=545KiB/s (558kB/s), 131KiB/s-142KiB/s (135kB/s-146kB/s), io=23.4MiB (24.5MB), run=43334-43952msec WRITE: bw=573KiB/s (587kB/s), 137KiB/s-150KiB/s (141kB/s-153kB/s), io=24.6MiB (25.8MB), run=43334-43952msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143814: Tue Aug 4 18:31:21 2026 read: IOPS=3, BW=61.4KiB/s (62.9kB/s)(5920KiB/96347msec) clat (msec): min=8, max=363, avg=56.29, stdev=56.21 lat (msec): min=8, max=363, avg=56.29, stdev=56.21 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 77], 90.00th=[ 120], 95.00th=[ 184], | 99.00th=[ 275], 99.50th=[ 347], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 286, per=29.95%, avg=73.99, stdev=49.14, samples=157 iops : min= 1, max= 17, avg= 3.80, stdev= 3.07, samples=157 write: IOPS=4, BW=66.1KiB/s (67.7kB/s)(6368KiB/96347msec); 0 zone resets clat (msec): min=45, max=587, avg=189.14, stdev=86.77 lat (msec): min=45, max=587, avg=189.14, stdev=86.77 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 84], 10.00th=[ 95], 20.00th=[ 120], | 30.00th=[ 138], 40.00th=[ 157], 50.00th=[ 171], 60.00th=[ 192], | 70.00th=[ 215], 80.00th=[ 249], 90.00th=[ 300], 95.00th=[ 355], | 99.00th=[ 485], 99.50th=[ 567], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 22, max= 160, per=26.21%, avg=67.89, stdev=31.29, samples=184 iops : min= 1, max= 10, avg= 3.42, stdev= 2.00, samples=184 lat (msec) : 10=0.91%, 20=8.59%, 50=22.27%, 100=16.28%, 250=40.89% lat (msec) : 500=10.68%, 750=0.39% cpu : usr=0.04%, sys=0.96%, ctx=1288, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143816: Tue Aug 4 18:31:21 2026 read: IOPS=3, BW=59.3KiB/s (60.7kB/s)(5744KiB/96933msec) clat (msec): min=8, max=407, avg=54.67, stdev=52.91 lat (msec): min=8, max=407, avg=54.68, stdev=52.91 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 75], 90.00th=[ 117], 95.00th=[ 163], | 99.00th=[ 255], 99.50th=[ 305], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 22, max= 352, per=32.21%, avg=79.55, stdev=54.09, samples=142 iops : min= 1, max= 22, avg= 4.15, stdev= 3.43, samples=142 write: IOPS=4, BW=67.5KiB/s (69.1kB/s)(6544KiB/96933msec); 0 zone resets clat (msec): min=52, max=843, avg=187.54, stdev=96.35 lat (msec): min=52, max=843, avg=187.54, stdev=96.35 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 92], 20.00th=[ 116], | 30.00th=[ 133], 40.00th=[ 148], 50.00th=[ 171], 60.00th=[ 188], | 70.00th=[ 209], 80.00th=[ 243], 90.00th=[ 313], 95.00th=[ 363], | 99.00th=[ 527], 99.50th=[ 558], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 30, max= 189, per=27.62%, avg=71.55, stdev=31.09, samples=179 iops : min= 1, max= 11, avg= 3.66, stdev= 1.95, samples=179 lat (msec) : 10=0.52%, 20=7.03%, 50=23.70%, 100=16.02%, 250=42.06% lat (msec) : 500=9.90%, 750=0.65%, 1000=0.13% cpu : usr=0.03%, sys=1.03%, ctx=1271, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143818: Tue Aug 4 18:31:21 2026 read: IOPS=4, BW=66.4KiB/s (68.0kB/s)(6256KiB/94163msec) clat (msec): min=6, max=442, avg=54.86, stdev=59.71 lat (msec): min=6, max=442, avg=54.87, stdev=59.71 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 65], 90.00th=[ 132], 95.00th=[ 174], | 99.00th=[ 338], 99.50th=[ 372], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 30, max= 287, per=33.04%, avg=81.61, stdev=58.91, samples=151 iops : min= 1, max= 17, avg= 4.30, stdev= 3.70, samples=151 write: IOPS=4, BW=64.1KiB/s (65.6kB/s)(6032KiB/94163msec); 0 zone resets clat (msec): min=59, max=551, avg=191.54, stdev=87.99 lat (msec): min=59, max=551, avg=191.55, stdev=87.99 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 87], 10.00th=[ 103], 20.00th=[ 118], | 30.00th=[ 136], 40.00th=[ 157], 50.00th=[ 174], 60.00th=[ 194], | 70.00th=[ 215], 80.00th=[ 257], 90.00th=[ 300], 95.00th=[ 372], | 99.00th=[ 498], 99.50th=[ 542], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 22, max= 158, per=25.88%, avg=67.03, stdev=28.12, samples=175 iops : min= 1, max= 9, avg= 3.37, stdev= 1.79, samples=175 lat (msec) : 10=1.17%, 20=8.20%, 50=25.65%, 100=12.89%, 250=41.02% lat (msec) : 500=10.68%, 750=0.39% cpu : usr=0.02%, sys=1.07%, ctx=1354, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143819: Tue Aug 4 18:31:21 2026 read: IOPS=3, BW=62.5KiB/s (63.0kB/s)(6032KiB/96516msec) clat (msec): min=7, max=554, avg=55.86, stdev=62.21 lat (msec): min=7, max=554, avg=55.86, stdev=62.21 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 72], 90.00th=[ 111], 95.00th=[ 180], | 99.00th=[ 338], 99.50th=[ 418], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 285, per=30.68%, avg=75.78, stdev=53.09, samples=155 iops : min= 1, max= 17, avg= 3.92, stdev= 3.35, samples=155 write: IOPS=4, BW=64.8KiB/s (66.4kB/s)(6256KiB/96516msec); 0 zone resets clat (msec): min=47, max=637, avg=191.45, stdev=93.96 lat (msec): min=47, max=637, avg=191.46, stdev=93.96 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 86], 10.00th=[ 99], 20.00th=[ 117], | 30.00th=[ 133], 40.00th=[ 155], 50.00th=[ 174], 60.00th=[ 194], | 70.00th=[ 218], 80.00th=[ 249], 90.00th=[ 305], 95.00th=[ 393], | 99.00th=[ 567], 99.50th=[ 634], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 30, max= 191, per=26.26%, avg=68.01, stdev=31.13, samples=180 iops : min= 1, max= 11, avg= 3.43, stdev= 1.97, samples=180 lat (msec) : 10=0.26%, 20=7.55%, 50=25.26%, 100=15.89%, 250=39.97% lat (msec) : 500=10.29%, 750=0.78% cpu : usr=0.02%, sys=0.96%, ctx=1247, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=247KiB/s (253kB/s), 59.3KiB/s-66.4KiB/s (60.7kB/s-68.0kB/s), io=23.4MiB (24.5MB), run=94163-96933msec WRITE: bw=260KiB/s (266kB/s), 64.1KiB/s-67.5KiB/s (65.6kB/s-69.1kB/s), io=24.6MiB (25.8MB), run=94163-96933msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143842: Tue Aug 4 18:31:40 2026 read: IOPS=1, BW=2018KiB/s (2066kB/s)(7168KiB/3552msec) clat (msec): min=4, max=1254, avg=338.48, stdev=416.66 lat (msec): min=4, max=1254, avg=338.48, stdev=416.66 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 123], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 218], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 309], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1568, max= 4087, per=73.13%, avg=2431.50, stdev=1125.50, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1441KiB/s (1476kB/s)(5120KiB/3552msec); 0 zone resets clat (msec): min=134, max=354, avg=199.65, stdev=88.27 lat (msec): min=134, max=354, avg=199.77, stdev=88.26 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2023, max= 4087, per=65.63%, avg=3055.00, stdev=1459.47, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 10=8.33%, 250=58.33%, 500=25.00%, 2000=8.33% cpu : usr=0.03%, sys=12.05%, ctx=293, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143844: Tue Aug 4 18:31:40 2026 read: IOPS=0, BW=356KiB/s (364kB/s)(2048KiB/5757msec) clat (usec): min=466, max=205606, avg=103036.47, stdev=145055.60 lat (usec): min=467, max=205608, avg=103038.12, stdev=145056.49 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 465], | 30.00th=[ 465], 40.00th=[ 465], 50.00th=[ 465], 60.00th=[206570], | 70.00th=[206570], 80.00th=[206570], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 1587, max= 1954, per=53.25%, avg=1770.50, stdev=259.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1779KiB/s (1821kB/s)(10.0MiB/5757msec); 0 zone resets clat (msec): min=155, max=1968, avg=545.74, stdev=565.17 lat (msec): min=155, max=1968, avg=545.85, stdev=565.13 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 176], | 30.00th=[ 178], 40.00th=[ 180], 50.00th=[ 296], 60.00th=[ 376], | 70.00th=[ 527], 80.00th=[ 617], 90.00th=[ 986], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 1954, max= 6131, per=78.34%, avg=3646.80, stdev=1733.53, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.25%, ctx=122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143846: Tue Aug 4 18:31:40 2026 read: IOPS=0, BW=998KiB/s (1022kB/s)(6144KiB/6159msec) clat (usec): min=859, max=323259, avg=224959.56, stdev=117544.37 lat (usec): min=860, max=323261, avg=224960.92, stdev=117544.94 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[223347], | 30.00th=[223347], 40.00th=[235930], 50.00th=[235930], 60.00th=[250610], | 70.00th=[316670], 80.00th=[316670], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 1954, max= 4079, per=75.78%, avg=2519.75, stdev=1040.03, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=998KiB/s (1022kB/s)(6144KiB/6159msec); 0 zone resets clat (msec): min=188, max=2219, avg=771.75, stdev=733.65 lat (msec): min=188, max=2219, avg=771.83, stdev=733.65 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 550], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 2015, max= 2048, per=43.71%, avg=2034.67, stdev=13.87, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.99%, ctx=253, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143848: Tue Aug 4 18:31:40 2026 read: IOPS=0, BW=993KiB/s (1016kB/s)(5120KiB/5158msec) clat (usec): min=579, max=512653, avg=180203.24, stdev=225441.25 lat (usec): min=581, max=512655, avg=180204.66, stdev=225441.21 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 791], 40.00th=[ 791], 50.00th=[ 74974], 60.00th=[ 74974], | 70.00th=[312476], 80.00th=[312476], 90.00th=[513803], 95.00th=[513803], | 99.00th=[513803], 99.50th=[513803], 99.90th=[513803], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 3908, max= 4031, per=100.00%, avg=3969.50, stdev=86.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1390KiB/s (1423kB/s)(7168KiB/5158msec); 0 zone resets clat (msec): min=163, max=1588, avg=582.84, stdev=493.50 lat (msec): min=163, max=1588, avg=583.08, stdev=493.43 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 262], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 401], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 852], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1809, max= 2043, per=42.74%, avg=1989.43, stdev=85.43, samples=7 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=7 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=6.96%, ctx=141, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3325KiB/s (3405kB/s), 356KiB/s-2018KiB/s (364kB/s-2066kB/s), io=20.0MiB (20.0MB), run=3552-6159msec WRITE: bw=4655KiB/s (4767kB/s), 998KiB/s-1779KiB/s (1022kB/s-1821kB/s), io=28.0MiB (29.4MB), run=3552-6159msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143841: Tue Aug 4 18:31:41 2026 read: IOPS=1, BW=1229KiB/s (1259kB/s)(7168KiB/5832msec) clat (msec): min=133, max=1235, avg=414.88, stdev=394.90 lat (msec): min=133, max=1235, avg=414.88, stdev=394.90 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 180], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 251], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 617], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1651, max= 4071, per=81.13%, avg=2335.80, stdev=981.80, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=878KiB/s (899kB/s)(5120KiB/5832msec); 0 zone resets clat (msec): min=332, max=844, avg=542.05, stdev=209.51 lat (msec): min=332, max=844, avg=542.14, stdev=209.51 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1812, max= 4063, per=61.34%, avg=2472.50, stdev=1064.45, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.52%, ctx=238, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143843: Tue Aug 4 18:31:41 2026 read: IOPS=0, BW=288KiB/s (295kB/s)(2048KiB/7112msec) clat (msec): min=245, max=565, avg=405.70, stdev=226.44 lat (msec): min=245, max=565, avg=405.70, stdev=226.44 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1617, max= 2043, per=63.56%, avg=1830.00, stdev=301.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1440KiB/s (1474kB/s)(10.0MiB/7112msec); 0 zone resets clat (msec): min=202, max=1570, avg=617.17, stdev=491.62 lat (msec): min=202, max=1570, avg=617.26, stdev=491.61 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 228], | 30.00th=[ 236], 40.00th=[ 247], 50.00th=[ 253], 60.00th=[ 651], | 70.00th=[ 693], 80.00th=[ 776], 90.00th=[ 1318], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1812, max= 5763, per=77.66%, avg=3130.60, stdev=1734.12, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=41.67%, 500=8.33%, 750=25.00%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.11%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143845: Tue Aug 4 18:31:41 2026 read: IOPS=1, BW=1039KiB/s (1064kB/s)(6144KiB/5915msec) clat (msec): min=110, max=732, avg=330.79, stdev=256.68 lat (msec): min=110, max=732, avg=330.79, stdev=256.68 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 384], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1973, max= 4063, per=87.83%, avg=2528.50, stdev=1023.48, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1039KiB/s (1064kB/s)(6144KiB/5915msec); 0 zone resets clat (msec): min=275, max=1591, avg=647.29, stdev=479.10 lat (msec): min=276, max=1591, avg=647.38, stdev=479.08 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 550], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1572, max= 2048, per=47.22%, avg=1903.33, stdev=182.41, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=33.33%, 2000=8.33% cpu : usr=0.00%, sys=1.84%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143847: Tue Aug 4 18:31:41 2026 read: IOPS=0, BW=768KiB/s (787kB/s)(5120KiB/6666msec) clat (msec): min=150, max=298, avg=238.14, stdev=66.70 lat (msec): min=150, max=298, avg=238.14, stdev=66.70 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1812, max= 6131, per=100.00%, avg=3971.50, stdev=3053.99, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1075KiB/s (1101kB/s)(7168KiB/6666msec); 0 zone resets clat (msec): min=234, max=2075, avg=746.94, stdev=629.07 lat (msec): min=235, max=2075, avg=747.03, stdev=629.06 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 355], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 609], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 885], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 1812, max= 4023, per=73.06%, avg=2945.25, stdev=1202.89, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.37%, ctx=90, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2880KiB/s (2949kB/s), 288KiB/s-1229KiB/s (295kB/s-1259kB/s), io=20.0MiB (20.0MB), run=5832-7112msec WRITE: bw=4031KiB/s (4128kB/s), 878KiB/s-1440KiB/s (899kB/s-1474kB/s), io=28.0MiB (29.4MB), run=5832-7112msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143855: Tue Aug 4 18:32:00 2026 read: IOPS=1, BW=4415KiB/s (4521kB/s)(12.0MiB/2783msec) clat (msec): min=828, max=971, avg=887.51, stdev=74.90 lat (msec): min=828, max=971, avg=887.51, stdev=74.90 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=13.95%, ctx=281, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143856: Tue Aug 4 18:32:00 2026 read: IOPS=0, BW=1212KiB/s (1241kB/s)(4096KiB/3380msec) clat (nsec): min=859164k, max=859164k, avg=859163590.00, stdev= 0.00 lat (nsec): min=859166k, max=859166k, avg=859165550.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2424KiB/s (2482kB/s)(8192KiB/3380msec); 0 zone resets clat (msec): min=859, max=1602, avg=1231.02, stdev=525.73 lat (msec): min=859, max=1603, avg=1231.33, stdev=525.77 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.37%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143857: Tue Aug 4 18:32:00 2026 write: IOPS=0, BW=2485KiB/s (2545kB/s)(12.0MiB/4944msec); 0 zone resets clat (msec): min=907, max=2245, avg=1633.58, stdev=676.17 lat (msec): min=909, max=2245, avg=1634.63, stdev=674.96 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=1.92%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143858: Tue Aug 4 18:32:00 2026 write: IOPS=0, BW=3571KiB/s (3657kB/s)(12.0MiB/3441msec); 0 zone resets clat (msec): min=354, max=2258, avg=1114.10, stdev=1008.28 lat (msec): min=354, max=2258, avg=1114.42, stdev=1008.32 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 7613, max= 8175, per=100.00%, avg=7894.00, stdev=397.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.99%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4847KiB/s (4964kB/s), 1212KiB/s-4415KiB/s (1241kB/s-4521kB/s), io=16.0MiB (16.8MB), run=2783-3380msec WRITE: bw=6628KiB/s (6787kB/s), 2424KiB/s-3571KiB/s (2482kB/s-3657kB/s), io=32.0MiB (33.6MB), run=3380-4944msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143860: Tue Aug 4 18:32:01 2026 read: IOPS=0, BW=2396KiB/s (2454kB/s)(12.0MiB/5128msec) clat (msec): min=870, max=2258, avg=1708.79, stdev=738.05 lat (msec): min=870, max=2258, avg=1708.79, stdev=738.05 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 2005], 50.00th=[ 2005], 60.00th=[ 2005], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=1.64%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143861: Tue Aug 4 18:32:01 2026 read: IOPS=0, BW=880KiB/s (901kB/s)(4096KiB/4656msec) clat (nsec): min=2211.5M, max=2211.5M, avg=2211548500.00, stdev= 0.00 lat (nsec): min=2211.6M, max=2211.6M, avg=2211551346.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2198], 5.00th=[ 2198], 10.00th=[ 2198], 20.00th=[ 2198], | 30.00th=[ 2198], 40.00th=[ 2198], 50.00th=[ 2198], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1759KiB/s (1802kB/s)(8192KiB/4656msec); 0 zone resets clat (msec): min=818, max=1582, avg=1200.78, stdev=540.36 lat (msec): min=819, max=1583, avg=1201.37, stdev=540.13 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.09%, sys=2.51%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143862: Tue Aug 4 18:32:01 2026 write: IOPS=0, BW=2538KiB/s (2599kB/s)(12.0MiB/4842msec); 0 zone resets clat (msec): min=949, max=2185, avg=1612.11, stdev=623.18 lat (msec): min=953, max=2186, avg=1613.67, stdev=621.18 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.76%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143863: Tue Aug 4 18:32:01 2026 write: IOPS=0, BW=3503KiB/s (3587kB/s)(12.0MiB/3508msec); 0 zone resets clat (msec): min=739, max=1536, avg=1168.23, stdev=402.02 lat (msec): min=739, max=1536, avg=1169.04, stdev=402.20 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7953, max= 8031, per=100.00%, avg=7992.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.31%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3195KiB/s (3272kB/s), 880KiB/s-2396KiB/s (901kB/s-2454kB/s), io=16.0MiB (16.8MB), run=4656-5128msec WRITE: bw=6767KiB/s (6930kB/s), 1759KiB/s-3503KiB/s (1802kB/s-3587kB/s), io=32.0MiB (33.6MB), run=3508-4842msec