== sanity test 398b: DIO and buffer IO race ============== 10:13:49 (1773238429) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.90093 s, 17.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183918: Wed Mar 11 10:14:47 2026 read: IOPS=30, BW=123KiB/s (125kB/s)(5992KiB/48913msec) clat (usec): min=165, max=635407, avg=17788.33, stdev=18218.88 lat (usec): min=165, max=635409, avg=17788.98, stdev=18218.91 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 7111], 10.00th=[ 8586], 20.00th=[ 10552], | 30.00th=[ 11863], 40.00th=[ 13829], 50.00th=[ 16188], 60.00th=[ 18220], | 70.00th=[ 20317], 80.00th=[ 23200], 90.00th=[ 28181], 95.00th=[ 33817], | 99.00th=[ 47973], 99.50th=[ 54264], 99.90th=[ 68682], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 48, max= 200, per=25.12%, avg=123.08, stdev=27.42, samples=96 iops : min= 12, max= 50, avg=30.47, stdev= 6.85, samples=96 write: IOPS=32, BW=129KiB/s (132kB/s)(6296KiB/48913msec); 0 zone resets clat (usec): min=653, max=60191, avg=14110.04, stdev=10413.37 lat (usec): min=653, max=60192, avg=14110.98, stdev=10413.17 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2540], 10.00th=[ 2999], 20.00th=[ 3949], | 30.00th=[ 7242], 40.00th=[ 9765], 50.00th=[11863], 60.00th=[14091], | 70.00th=[17957], 80.00th=[22938], 90.00th=[29230], 95.00th=[34341], | 99.00th=[44303], 99.50th=[51119], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 48, max= 199, per=25.19%, avg=129.24, stdev=31.83, samples=96 iops : min= 12, max= 49, avg=32.01, stdev= 7.97, samples=96 lat (usec) : 250=0.20%, 500=0.78%, 750=0.42%, 1000=0.23% lat (msec) : 2=1.24%, 4=8.89%, 10=17.71%, 20=41.96%, 50=27.90% lat (msec) : 100=0.65%, 750=0.03% cpu : usr=0.10%, sys=26.19%, ctx=9235, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183919: Wed Mar 11 10:14:47 2026 read: IOPS=30, BW=122KiB/s (125kB/s)(5940KiB/48640msec) clat (usec): min=216, max=581196, avg=17802.93, stdev=17147.04 lat (usec): min=217, max=581197, avg=17803.63, stdev=17147.03 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 7504], 10.00th=[ 8848], 20.00th=[ 10552], | 30.00th=[ 12125], 40.00th=[ 13829], 50.00th=[ 15926], 60.00th=[ 17957], | 70.00th=[ 20317], 80.00th=[ 22938], 90.00th=[ 28443], 95.00th=[ 32900], | 99.00th=[ 49546], 99.50th=[ 54264], 99.90th=[ 78119], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 48, max= 176, per=25.15%, avg=123.25, stdev=27.02, samples=96 iops : min= 12, max= 44, avg=30.51, stdev= 6.81, samples=96 write: IOPS=32, BW=131KiB/s (134kB/s)(6348KiB/48640msec); 0 zone resets clat (usec): min=684, max=76318, avg=13965.25, stdev=10730.78 lat (usec): min=684, max=76319, avg=13966.11, stdev=10730.73 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 2573], 10.00th=[ 3032], 20.00th=[ 3982], | 30.00th=[ 6652], 40.00th=[ 9634], 50.00th=[11469], 60.00th=[13566], | 70.00th=[16909], 80.00th=[22152], 90.00th=[29230], 95.00th=[35390], | 99.00th=[46924], 99.50th=[54264], 99.90th=[59507], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 63, max= 255, per=25.68%, avg=131.75, stdev=37.08, samples=96 iops : min= 15, max= 63, avg=32.64, stdev= 9.25, samples=96 lat (usec) : 250=0.07%, 500=0.72%, 750=0.39%, 1000=0.42% lat (msec) : 2=0.81%, 4=9.21%, 10=18.42%, 20=42.64%, 50=26.50% lat (msec) : 100=0.78%, 750=0.03% cpu : usr=0.10%, sys=26.01%, ctx=9302, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183920: Wed Mar 11 10:14:47 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(6028KiB/48695msec) clat (usec): min=150, max=86454, avg=17462.85, stdev=9050.76 lat (usec): min=151, max=86455, avg=17463.48, stdev=9050.78 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 7439], 10.00th=[ 8717], 20.00th=[10421], | 30.00th=[12125], 40.00th=[13829], 50.00th=[15664], 60.00th=[17957], | 70.00th=[20579], 80.00th=[23462], 90.00th=[28181], 95.00th=[32900], | 99.00th=[49546], 99.50th=[54789], 99.90th=[73925], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 63, max= 215, per=25.51%, avg=125.00, stdev=31.25, samples=96 iops : min= 15, max= 53, avg=30.95, stdev= 7.86, samples=96 write: IOPS=32, BW=129KiB/s (132kB/s)(6260KiB/48695msec); 0 zone resets clat (usec): min=690, max=590872, avg=14272.98, stdev=18097.32 lat (usec): min=691, max=590872, avg=14273.76, stdev=18097.33 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 2540], 10.00th=[ 2999], 20.00th=[ 3752], | 30.00th=[ 5932], 40.00th=[ 9503], 50.00th=[ 11863], 60.00th=[ 13698], | 70.00th=[ 17433], 80.00th=[ 22152], 90.00th=[ 29230], 95.00th=[ 34866], | 99.00th=[ 49546], 99.50th=[ 55837], 99.90th=[ 64750], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 47, max= 224, per=25.26%, avg=129.58, stdev=37.78, samples=96 iops : min= 11, max= 56, avg=32.09, stdev= 9.45, samples=96 lat (usec) : 250=0.10%, 500=0.72%, 750=0.36%, 1000=0.29% lat (msec) : 2=1.01%, 4=9.93%, 10=17.48%, 20=41.96%, 50=27.28% lat (msec) : 100=0.85%, 750=0.03% cpu : usr=0.10%, sys=25.90%, ctx=9375, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183921: Wed Mar 11 10:14:47 2026 read: IOPS=31, BW=124KiB/s (127kB/s)(6052KiB/48754msec) clat (usec): min=102, max=80405, avg=17166.16, stdev=8985.38 lat (usec): min=102, max=80406, avg=17166.86, stdev=8985.45 clat percentiles (usec): | 1.00th=[ 396], 5.00th=[ 7177], 10.00th=[ 8586], 20.00th=[10421], | 30.00th=[11863], 40.00th=[13698], 50.00th=[15795], 60.00th=[17695], | 70.00th=[20055], 80.00th=[22938], 90.00th=[27395], 95.00th=[32900], | 99.00th=[48497], 99.50th=[53216], 99.90th=[79168], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 55, max= 200, per=25.56%, avg=125.26, stdev=31.90, samples=96 iops : min= 13, max= 50, avg=31.01, stdev= 8.00, samples=96 write: IOPS=31, BW=128KiB/s (131kB/s)(6236KiB/48754msec); 0 zone resets clat (usec): min=735, max=593370, avg=14584.29, stdev=18122.78 lat (usec): min=736, max=593371, avg=14585.13, stdev=18122.80 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2638], 10.00th=[ 3032], 20.00th=[ 3884], | 30.00th=[ 6521], 40.00th=[ 9634], 50.00th=[ 11731], 60.00th=[ 14484], | 70.00th=[ 18220], 80.00th=[ 23200], 90.00th=[ 29230], 95.00th=[ 35390], | 99.00th=[ 45351], 99.50th=[ 52691], 99.90th=[ 62653], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 47, max= 200, per=25.08%, avg=128.67, stdev=29.12, samples=96 iops : min= 11, max= 50, avg=31.86, stdev= 7.30, samples=96 lat (usec) : 250=0.10%, 500=0.94%, 750=0.26%, 1000=0.39% lat (msec) : 2=0.75%, 4=9.51%, 10=18.20%, 20=41.80%, 50=27.41% lat (msec) : 100=0.62%, 750=0.03% cpu : usr=0.10%, sys=25.87%, ctx=9270, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=491KiB/s (503kB/s), 122KiB/s-124KiB/s (125kB/s-127kB/s), io=23.4MiB (24.6MB), run=48640-48913msec WRITE: bw=514KiB/s (526kB/s), 128KiB/s-131KiB/s (131kB/s-134kB/s), io=24.6MiB (25.7MB), run=48640-48913msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183913: Wed Mar 11 10:14:53 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(5992KiB/55584msec) clat (msec): min=2, max=698, avg=16.45, stdev=21.66 lat (msec): min=2, max=698, avg=16.45, stdev=21.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 43], | 99.00th=[ 57], 99.50th=[ 63], 99.90th=[ 78], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 31, max= 352, per=25.08%, avg=108.08, stdev=72.80, samples=109 iops : min= 7, max= 88, avg=26.67, stdev=18.33, samples=109 write: IOPS=28, BW=113KiB/s (116kB/s)(6296KiB/55584msec); 0 zone resets clat (usec): min=4130, max=81265, avg=19533.12, stdev=12929.58 lat (usec): min=4130, max=81266, avg=19533.98, stdev=12929.62 clat percentiles (usec): | 1.00th=[ 5145], 5.00th=[ 6063], 10.00th=[ 6652], 20.00th=[ 7767], | 30.00th=[ 9765], 40.00th=[12387], 50.00th=[15795], 60.00th=[20055], | 70.00th=[24511], 80.00th=[30278], 90.00th=[38011], 95.00th=[44303], | 99.00th=[56886], 99.50th=[67634], 99.90th=[74974], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 31, max= 400, per=25.00%, avg=113.00, stdev=72.90, samples=109 iops : min= 7, max= 100, avg=27.90, stdev=18.35, samples=109 lat (msec) : 4=1.46%, 10=35.61%, 20=29.13%, 50=31.61%, 100=2.15% lat (msec) : 750=0.03% cpu : usr=0.08%, sys=12.71%, ctx=5656, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183914: Wed Mar 11 10:14:53 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(5940KiB/55604msec) clat (msec): min=2, max=651, avg=16.38, stdev=20.70 lat (msec): min=2, max=651, avg=16.38, stdev=20.70 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 35], 95.00th=[ 44], | 99.00th=[ 57], 99.50th=[ 63], 99.90th=[ 86], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 15, max= 384, per=24.84%, avg=107.06, stdev=73.71, samples=109 iops : min= 3, max= 96, avg=26.41, stdev=18.55, samples=109 write: IOPS=28, BW=114KiB/s (117kB/s)(6348KiB/55604msec); 0 zone resets clat (usec): min=3702, max=94828, avg=19589.28, stdev=13366.57 lat (usec): min=3702, max=94829, avg=19590.22, stdev=13366.56 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 5866], 10.00th=[ 6521], 20.00th=[ 7701], | 30.00th=[ 9634], 40.00th=[12780], 50.00th=[15664], 60.00th=[20055], | 70.00th=[24511], 80.00th=[29754], 90.00th=[38011], 95.00th=[44303], | 99.00th=[64226], 99.50th=[72877], 99.90th=[84411], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 39, max= 368, per=25.21%, avg=113.94, stdev=72.69, samples=109 iops : min= 9, max= 92, avg=28.14, stdev=18.28, samples=109 lat (msec) : 4=1.17%, 10=35.12%, 20=30.05%, 50=31.05%, 100=2.57% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=12.61%, ctx=5648, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183915: Wed Mar 11 10:14:53 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(6028KiB/55420msec) clat (usec): min=2495, max=74535, avg=15853.60, stdev=12402.81 lat (usec): min=2496, max=74535, avg=15854.33, stdev=12402.94 clat percentiles (usec): | 1.00th=[ 3589], 5.00th=[ 4424], 10.00th=[ 4883], 20.00th=[ 5669], | 30.00th=[ 7373], 40.00th=[ 9896], 50.00th=[11863], 60.00th=[13829], | 70.00th=[17957], 80.00th=[24511], 90.00th=[34866], 95.00th=[41681], | 99.00th=[56361], 99.50th=[66323], 99.90th=[72877], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 32, max= 432, per=25.42%, avg=109.55, stdev=76.40, samples=109 iops : min= 8, max= 108, avg=27.04, stdev=19.23, samples=109 write: IOPS=28, BW=113KiB/s (116kB/s)(6260KiB/55420msec); 0 zone resets clat (msec): min=4, max=654, avg=20.02, stdev=21.03 lat (msec): min=4, max=654, avg=20.02, stdev=21.03 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 66], 99.50th=[ 80], 99.90th=[ 89], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 39, max= 336, per=25.11%, avg=113.51, stdev=71.68, samples=109 iops : min= 9, max= 84, avg=28.03, stdev=18.04, samples=109 lat (msec) : 4=1.17%, 10=34.38%, 20=31.90%, 50=29.85%, 100=2.67% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=12.69%, ctx=5660, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183916: Wed Mar 11 10:14:53 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6052KiB/55431msec) clat (usec): min=2703, max=71669, avg=15642.51, stdev=11836.13 lat (usec): min=2703, max=71670, avg=15643.28, stdev=11836.11 clat percentiles (usec): | 1.00th=[ 3523], 5.00th=[ 4424], 10.00th=[ 4883], 20.00th=[ 5800], | 30.00th=[ 7701], 40.00th=[10028], 50.00th=[11731], 60.00th=[14091], | 70.00th=[18220], 80.00th=[23462], 90.00th=[33424], 95.00th=[40633], | 99.00th=[55313], 99.50th=[64750], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 23, max= 368, per=25.49%, avg=109.84, stdev=72.41, samples=109 iops : min= 5, max= 92, avg=27.11, stdev=18.23, samples=109 write: IOPS=28, BW=113KiB/s (115kB/s)(6236KiB/55431msec); 0 zone resets clat (msec): min=4, max=654, avg=20.25, stdev=21.18 lat (msec): min=4, max=654, avg=20.25, stdev=21.18 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 67], 99.50th=[ 74], 99.90th=[ 95], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 31, max= 384, per=25.03%, avg=113.15, stdev=73.43, samples=109 iops : min= 7, max= 96, avg=27.94, stdev=18.47, samples=109 lat (msec) : 4=1.30%, 10=33.66%, 20=31.97%, 50=30.31%, 100=2.73% lat (msec) : 750=0.03% cpu : usr=0.11%, sys=12.72%, ctx=5678, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=432KiB/s (442kB/s), 107KiB/s-109KiB/s (109kB/s-112kB/s), io=23.4MiB (24.6MB), run=55420-55604msec WRITE: bw=452KiB/s (463kB/s), 113KiB/s-114KiB/s (115kB/s-117kB/s), io=24.6MiB (25.7MB), run=55420-55604msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183943: Wed Mar 11 10:15:13 2026 read: IOPS=27, BW=445KiB/s (456kB/s)(5920KiB/13296msec) clat (usec): min=110, max=83753, avg=17996.53, stdev=9562.22 lat (usec): min=110, max=83753, avg=17997.04, stdev=9562.23 clat percentiles (usec): | 1.00th=[ 265], 5.00th=[ 469], 10.00th=[ 9110], 20.00th=[11469], | 30.00th=[13435], 40.00th=[14746], 50.00th=[16450], 60.00th=[18744], | 70.00th=[21627], 80.00th=[24511], 90.00th=[28705], 95.00th=[34341], | 99.00th=[52691], 99.50th=[55313], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 224, max= 638, per=24.87%, avg=447.23, stdev=103.91, samples=26 iops : min= 14, max= 39, avg=27.27, stdev= 6.45, samples=26 write: IOPS=29, BW=479KiB/s (490kB/s)(6368KiB/13296msec); 0 zone resets clat (usec): min=1074, max=58042, avg=16537.67, stdev=10269.82 lat (usec): min=1075, max=58043, avg=16538.74, stdev=10269.69 clat percentiles (usec): | 1.00th=[ 2245], 5.00th=[ 4080], 10.00th=[ 4883], 20.00th=[ 7177], | 30.00th=[10552], 40.00th=[12518], 50.00th=[14484], 60.00th=[16581], | 70.00th=[20055], 80.00th=[24511], 90.00th=[31327], 95.00th=[36963], | 99.00th=[47449], 99.50th=[49021], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 287, max= 637, per=25.38%, avg=479.96, stdev=88.68, samples=26 iops : min= 17, max= 39, avg=29.31, stdev= 5.58, samples=26 lat (usec) : 250=0.39%, 500=2.21%, 750=0.26% lat (msec) : 2=0.52%, 4=1.95%, 10=14.71%, 20=47.53%, 50=31.77% lat (msec) : 100=0.65% cpu : usr=0.10%, sys=28.94%, ctx=2890, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183944: Wed Mar 11 10:15:13 2026 read: IOPS=26, BW=431KiB/s (442kB/s)(5744KiB/13320msec) clat (usec): min=116, max=70700, avg=19309.22, stdev=8780.93 lat (usec): min=116, max=70700, avg=19311.16, stdev=8780.22 clat percentiles (usec): | 1.00th=[ 306], 5.00th=[ 8979], 10.00th=[10028], 20.00th=[12780], | 30.00th=[14746], 40.00th=[16319], 50.00th=[18220], 60.00th=[20317], | 70.00th=[22152], 80.00th=[25822], 90.00th=[29492], 95.00th=[33817], | 99.00th=[45351], 99.50th=[65274], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 254, max= 574, per=23.89%, avg=429.58, stdev=89.61, samples=26 iops : min= 15, max= 35, avg=26.15, stdev= 5.65, samples=26 write: IOPS=30, BW=491KiB/s (503kB/s)(6544KiB/13320msec); 0 zone resets clat (usec): min=1251, max=79552, avg=15427.97, stdev=10211.99 lat (usec): min=1252, max=79553, avg=15428.94, stdev=10212.02 clat percentiles (usec): | 1.00th=[ 3130], 5.00th=[ 4359], 10.00th=[ 4948], 20.00th=[ 6194], | 30.00th=[ 8848], 40.00th=[11207], 50.00th=[13304], 60.00th=[15533], | 70.00th=[18482], 80.00th=[22676], 90.00th=[29754], 95.00th=[34341], | 99.00th=[46924], 99.50th=[51119], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 318, max= 701, per=25.86%, avg=489.00, stdev=97.40, samples=26 iops : min= 19, max= 43, avg=29.88, stdev= 5.98, samples=26 lat (usec) : 250=0.26%, 500=1.04% lat (msec) : 2=0.13%, 4=2.08%, 10=19.14%, 20=44.92%, 50=31.51% lat (msec) : 100=0.91% cpu : usr=0.08%, sys=29.79%, ctx=2864, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183945: Wed Mar 11 10:15:13 2026 read: IOPS=29, BW=471KiB/s (483kB/s)(6256KiB/13272msec) clat (usec): min=294, max=47540, avg=18159.16, stdev=8113.54 lat (usec): min=295, max=47541, avg=18159.73, stdev=8113.56 clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 7504], 10.00th=[ 9765], 20.00th=[11731], | 30.00th=[13960], 40.00th=[15401], 50.00th=[17433], 60.00th=[19268], | 70.00th=[21627], 80.00th=[23462], 90.00th=[28181], 95.00th=[32375], | 99.00th=[45876], 99.50th=[47449], 99.90th=[47449], 99.95th=[47449], | 99.99th=[47449] bw ( KiB/s): min= 223, max= 701, per=26.32%, avg=473.23, stdev=118.14, samples=26 iops : min= 13, max= 43, avg=28.92, stdev= 7.28, samples=26 write: IOPS=28, BW=454KiB/s (465kB/s)(6032KiB/13272msec); 0 zone resets clat (usec): min=1450, max=54573, avg=16205.62, stdev=10028.85 lat (usec): min=1451, max=54574, avg=16206.87, stdev=10028.83 clat percentiles (usec): | 1.00th=[ 2089], 5.00th=[ 4555], 10.00th=[ 4948], 20.00th=[ 6194], | 30.00th=[ 9110], 40.00th=[11994], 50.00th=[14484], 60.00th=[17433], | 70.00th=[20579], 80.00th=[24249], 90.00th=[30016], 95.00th=[34866], | 99.00th=[44303], 99.50th=[52691], 99.90th=[54789], 99.95th=[54789], | 99.99th=[54789] bw ( KiB/s): min= 254, max= 670, per=23.73%, avg=448.73, stdev=104.12, samples=26 iops : min= 15, max= 41, avg=27.35, stdev= 6.57, samples=26 lat (usec) : 500=1.43%, 750=0.13% lat (msec) : 2=0.39%, 4=0.78%, 10=19.66%, 20=43.23%, 50=34.11% lat (msec) : 100=0.26% cpu : usr=0.07%, sys=29.13%, ctx=2871, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183946: Wed Mar 11 10:15:13 2026 read: IOPS=29, BW=470KiB/s (481kB/s)(6032KiB/12837msec) clat (usec): min=221, max=54153, avg=17553.94, stdev=9665.28 lat (usec): min=221, max=54154, avg=17554.46, stdev=9665.29 clat percentiles (usec): | 1.00th=[ 322], 5.00th=[ 424], 10.00th=[ 7963], 20.00th=[10814], | 30.00th=[12780], 40.00th=[14353], 50.00th=[16581], 60.00th=[19006], | 70.00th=[20841], 80.00th=[24511], 90.00th=[28967], 95.00th=[35914], | 99.00th=[51643], 99.50th=[53216], 99.90th=[54264], 99.95th=[54264], | 99.99th=[54264] bw ( KiB/s): min= 286, max= 637, per=25.94%, avg=466.48, stdev=79.53, samples=25 iops : min= 17, max= 39, avg=28.48, stdev= 5.01, samples=25 write: IOPS=30, BW=487KiB/s (499kB/s)(6256KiB/12837msec); 0 zone resets clat (usec): min=1106, max=75025, avg=15839.58, stdev=10949.64 lat (usec): min=1106, max=75026, avg=15840.60, stdev=10949.63 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 4228], 10.00th=[ 4948], 20.00th=[ 5800], | 30.00th=[ 8717], 40.00th=[10945], 50.00th=[13304], 60.00th=[15401], | 70.00th=[19530], 80.00th=[23987], 90.00th=[31065], 95.00th=[36963], | 99.00th=[47973], 99.50th=[53740], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 318, max= 796, per=25.56%, avg=483.32, stdev=109.56, samples=25 iops : min= 19, max= 49, avg=29.56, stdev= 6.87, samples=25 lat (usec) : 250=0.13%, 500=3.78%, 750=0.13% lat (msec) : 2=0.26%, 4=2.08%, 10=19.79%, 20=41.80%, 50=31.12% lat (msec) : 100=0.91% cpu : usr=0.09%, sys=29.18%, ctx=2849, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1798KiB/s (1841kB/s), 431KiB/s-471KiB/s (442kB/s-483kB/s), io=23.4MiB (24.5MB), run=12837-13320msec WRITE: bw=1892KiB/s (1937kB/s), 454KiB/s-491KiB/s (465kB/s-503kB/s), io=24.6MiB (25.8MB), run=12837-13320msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183948: Wed Mar 11 10:15:14 2026 read: IOPS=25, BW=407KiB/s (417kB/s)(5920KiB/14554msec) clat (usec): min=3433, max=67910, avg=17213.04, stdev=12410.94 lat (usec): min=3433, max=67910, avg=17213.87, stdev=12411.18 clat percentiles (usec): | 1.00th=[ 4146], 5.00th=[ 5145], 10.00th=[ 5669], 20.00th=[ 7046], | 30.00th=[ 9372], 40.00th=[10814], 50.00th=[12780], 60.00th=[15270], | 70.00th=[19006], 80.00th=[26346], 90.00th=[38011], 95.00th=[42730], | 99.00th=[54789], 99.50th=[63177], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 190, max= 1216, per=23.93%, avg=386.07, stdev=200.69, samples=28 iops : min= 11, max= 76, avg=23.71, stdev=12.60, samples=28 write: IOPS=27, BW=438KiB/s (448kB/s)(6368KiB/14554msec); 0 zone resets clat (usec): min=4812, max=82026, avg=20469.81, stdev=13207.67 lat (usec): min=4813, max=82027, avg=20471.00, stdev=13207.71 clat percentiles (usec): | 1.00th=[ 5473], 5.00th=[ 6259], 10.00th=[ 7046], 20.00th=[ 8717], | 30.00th=[10552], 40.00th=[13304], 50.00th=[16712], 60.00th=[20055], | 70.00th=[25560], 80.00th=[32113], 90.00th=[40109], 95.00th=[45876], | 99.00th=[56361], 99.50th=[62129], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 159, max= 1184, per=24.79%, avg=420.61, stdev=229.74, samples=28 iops : min= 9, max= 74, avg=25.89, stdev=14.46, samples=28 lat (msec) : 4=0.39%, 10=30.60%, 20=34.11%, 50=32.03%, 100=2.86% cpu : usr=0.10%, sys=13.13%, ctx=1531, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183949: Wed Mar 11 10:15:14 2026 read: IOPS=24, BW=387KiB/s (396kB/s)(5744KiB/14848msec) clat (usec): min=2572, max=67841, avg=17319.32, stdev=13301.60 lat (usec): min=2572, max=67841, avg=17320.02, stdev=13301.52 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 3294], 10.00th=[ 4883], 20.00th=[ 5932], | 30.00th=[ 8225], 40.00th=[10814], 50.00th=[12780], 60.00th=[15139], | 70.00th=[20579], 80.00th=[28705], 90.00th=[39584], 95.00th=[44827], | 99.00th=[54789], 99.50th=[60556], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 154, max= 1120, per=23.00%, avg=371.00, stdev=225.31, samples=29 iops : min= 9, max= 70, avg=22.79, stdev=14.23, samples=29 write: IOPS=27, BW=441KiB/s (451kB/s)(6544KiB/14848msec); 0 zone resets clat (usec): min=3405, max=78409, avg=20813.56, stdev=14669.98 lat (usec): min=3406, max=78410, avg=20814.71, stdev=14670.01 clat percentiles (usec): | 1.00th=[ 3752], 5.00th=[ 4359], 10.00th=[ 6128], 20.00th=[ 7373], | 30.00th=[ 9896], 40.00th=[12518], 50.00th=[16909], 60.00th=[21365], | 70.00th=[27657], 80.00th=[32637], 90.00th=[42730], 95.00th=[49021], | 99.00th=[68682], 99.50th=[70779], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 192, max= 1408, per=24.65%, avg=418.24, stdev=276.47, samples=29 iops : min= 12, max= 88, avg=25.76, stdev=17.39, samples=29 lat (msec) : 4=4.43%, 10=29.04%, 20=29.04%, 50=34.11%, 100=3.39% cpu : usr=0.08%, sys=12.11%, ctx=1484, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183950: Wed Mar 11 10:15:14 2026 read: IOPS=26, BW=428KiB/s (438kB/s)(6256KiB/14627msec) clat (usec): min=2863, max=69011, avg=15394.15, stdev=11390.16 lat (usec): min=2864, max=69012, avg=15394.86, stdev=11390.22 clat percentiles (usec): | 1.00th=[ 3884], 5.00th=[ 5080], 10.00th=[ 5604], 20.00th=[ 6849], | 30.00th=[ 8455], 40.00th=[10028], 50.00th=[11731], 60.00th=[13435], | 70.00th=[16450], 80.00th=[21890], 90.00th=[33817], 95.00th=[40109], | 99.00th=[60031], 99.50th=[62129], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 223, max= 1408, per=25.18%, avg=406.18, stdev=244.56, samples=28 iops : min= 13, max= 88, avg=25.00, stdev=15.42, samples=28 write: IOPS=25, BW=412KiB/s (422kB/s)(6032KiB/14627msec); 0 zone resets clat (usec): min=4572, max=88704, avg=22523.88, stdev=14900.49 lat (usec): min=4572, max=88706, avg=22525.22, stdev=14900.60 clat percentiles (usec): | 1.00th=[ 5145], 5.00th=[ 6194], 10.00th=[ 7177], 20.00th=[ 8717], | 30.00th=[11338], 40.00th=[14484], 50.00th=[18482], 60.00th=[23725], | 70.00th=[28967], 80.00th=[35914], 90.00th=[43254], 95.00th=[51119], | 99.00th=[63177], 99.50th=[83362], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 222, max= 1056, per=22.71%, avg=385.39, stdev=190.43, samples=28 iops : min= 13, max= 66, avg=23.68, stdev=12.03, samples=28 lat (msec) : 4=0.65%, 10=31.90%, 20=32.55%, 50=31.51%, 100=3.39% cpu : usr=0.12%, sys=12.82%, ctx=1486, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183951: Wed Mar 11 10:15:14 2026 read: IOPS=25, BW=411KiB/s (421kB/s)(6032KiB/14668msec) clat (usec): min=3514, max=68783, avg=16480.28, stdev=11915.08 lat (usec): min=3514, max=68784, avg=16480.81, stdev=11915.08 clat percentiles (usec): | 1.00th=[ 3916], 5.00th=[ 4817], 10.00th=[ 5407], 20.00th=[ 6325], | 30.00th=[ 8848], 40.00th=[10814], 50.00th=[12256], 60.00th=[14746], | 70.00th=[18482], 80.00th=[26084], 90.00th=[34866], 95.00th=[41681], | 99.00th=[55313], 99.50th=[61604], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 159, max= 1216, per=25.41%, avg=409.90, stdev=264.29, samples=29 iops : min= 9, max= 76, avg=25.24, stdev=16.70, samples=29 write: IOPS=26, BW=427KiB/s (437kB/s)(6256KiB/14668msec); 0 zone resets clat (usec): min=4309, max=86856, avg=21355.22, stdev=14436.74 lat (usec): min=4310, max=86856, avg=21356.69, stdev=14436.76 clat percentiles (usec): | 1.00th=[ 5014], 5.00th=[ 6259], 10.00th=[ 7242], 20.00th=[ 8717], | 30.00th=[11600], 40.00th=[13829], 50.00th=[17171], 60.00th=[21627], | 70.00th=[26346], 80.00th=[31327], 90.00th=[41681], 95.00th=[48497], | 99.00th=[72877], 99.50th=[82314], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 256, max= 1152, per=25.23%, avg=428.17, stdev=226.28, samples=29 iops : min= 16, max= 72, avg=26.38, stdev=14.28, samples=29 lat (msec) : 4=0.52%, 10=29.17%, 20=33.98%, 50=33.20%, 100=3.12% cpu : usr=0.07%, sys=12.85%, ctx=1481, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1613KiB/s (1652kB/s), 387KiB/s-428KiB/s (396kB/s-438kB/s), io=23.4MiB (24.5MB), run=14554-14848msec WRITE: bw=1697KiB/s (1738kB/s), 412KiB/s-441KiB/s (422kB/s-451kB/s), io=24.6MiB (25.8MB), run=14554-14848msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183958: Wed Mar 11 10:15:24 2026 read: IOPS=2, BW=2262KiB/s (2316kB/s)(7168KiB/3169msec) clat (usec): min=780, max=287006, avg=163616.42, stdev=95347.78 lat (usec): min=781, max=287008, avg=163617.75, stdev=95347.67 clat percentiles (usec): | 1.00th=[ 783], 5.00th=[ 783], 10.00th=[ 783], 20.00th=[100140], | 30.00th=[141558], 40.00th=[141558], 50.00th=[177210], 60.00th=[189793], | 70.00th=[189793], 80.00th=[250610], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 2039, max= 4096, per=54.88%, avg=2919.50, stdev=1043.18, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1616KiB/s (1654kB/s)(5120KiB/3169msec); 0 zone resets clat (msec): min=278, max=628, avg=402.47, stdev=155.18 lat (msec): min=278, max=628, avg=402.52, stdev=155.16 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1812, max= 4079, per=33.50%, avg=2495.50, stdev=1061.39, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=48.36%, ctx=791, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183959: Wed Mar 11 10:15:24 2026 read: IOPS=0, BW=532KiB/s (545kB/s)(2048KiB/3849msec) clat (msec): min=102, max=161, avg=132.32, stdev=41.57 lat (msec): min=102, max=161, avg=132.32, stdev=41.57 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 1715, max= 2048, per=35.37%, avg=1881.50, stdev=235.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2660KiB/s (2724kB/s)(10.0MiB/3849msec); 0 zone resets clat (msec): min=119, max=946, avg=357.00, stdev=259.27 lat (msec): min=119, max=946, avg=357.07, stdev=259.27 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 218], 60.00th=[ 271], | 70.00th=[ 384], 80.00th=[ 443], 90.00th=[ 634], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1812, max= 6144, per=40.68%, avg=3030.33, stdev=1745.71, samples=6 iops : min= 1, max= 6, avg= 2.50, stdev= 2.07, samples=6 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=46.57%, ctx=500, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183960: Wed Mar 11 10:15:24 2026 read: IOPS=1, BW=1849KiB/s (1893kB/s)(6144KiB/3323msec) clat (usec): min=540, max=473024, avg=165318.17, stdev=177169.50 lat (usec): min=541, max=473024, avg=165318.86, stdev=177169.50 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[100140], 50.00th=[100140], 60.00th=[204473], | 70.00th=[212861], 80.00th=[212861], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 1812, max= 4096, per=62.68%, avg=3334.67, stdev=1318.67, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1849KiB/s (1893kB/s)(6144KiB/3323msec); 0 zone resets clat (msec): min=173, max=767, avg=384.56, stdev=226.14 lat (msec): min=173, max=767, avg=384.61, stdev=226.14 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 338], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1715, max= 2048, per=26.19%, avg=1950.83, stdev=148.35, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=42.29%, ctx=296, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183961: Wed Mar 11 10:15:24 2026 read: IOPS=1, BW=1733KiB/s (1775kB/s)(5120KiB/2954msec) clat (usec): min=1006, max=217703, avg=160040.65, stdev=90711.13 lat (usec): min=1006, max=217704, avg=160041.59, stdev=90711.27 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1004], 10.00th=[ 1004], 20.00th=[ 1004], | 30.00th=[175113], 40.00th=[175113], 50.00th=[191890], 60.00th=[191890], | 70.00th=[214959], 80.00th=[214959], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 2048, max= 5437, per=70.35%, avg=3742.50, stdev=2396.38, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2427KiB/s (2485kB/s)(7168KiB/2954msec); 0 zone resets clat (msec): min=144, max=664, avg=305.05, stdev=182.03 lat (msec): min=144, max=664, avg=305.10, stdev=182.03 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 167], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 275], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 388], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1732, max= 4096, per=40.16%, avg=2991.75, stdev=1281.38, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 lat (msec) : 2=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=49.81%, ctx=837, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5321KiB/s (5449kB/s), 532KiB/s-2262KiB/s (545kB/s-2316kB/s), io=20.0MiB (20.0MB), run=2954-3849msec WRITE: bw=7449KiB/s (7628kB/s), 1616KiB/s-2660KiB/s (1654kB/s-2724kB/s), io=28.0MiB (29.4MB), run=2954-3849msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183963: Wed Mar 11 10:15:24 2026 read: IOPS=1, BW=1988KiB/s (2036kB/s)(7168KiB/3605msec) clat (msec): min=59, max=794, avg=374.34, stdev=303.18 lat (msec): min=59, max=794, avg=374.35, stdev=303.18 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 82], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 414], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 659], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1659, max= 2048, per=35.57%, avg=1950.20, stdev=167.23, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=1, BW=1420KiB/s (1454kB/s)(5120KiB/3605msec); 0 zone resets clat (msec): min=63, max=312, avg=187.97, stdev=99.29 lat (msec): min=63, max=312, avg=188.04, stdev=99.29 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 211], 60.00th=[ 211], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1957, max= 2048, per=26.09%, avg=2002.50, stdev=64.35, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 100=33.33%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=19.84%, ctx=135, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183964: Wed Mar 11 10:15:24 2026 read: IOPS=0, BW=548KiB/s (561kB/s)(2048KiB/3735msec) clat (msec): min=108, max=512, avg=310.26, stdev=285.40 lat (msec): min=108, max=512, avg=310.26, stdev=285.40 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1681, max= 2048, per=34.01%, avg=1864.50, stdev=259.51, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2742KiB/s (2807kB/s)(10.0MiB/3735msec); 0 zone resets clat (msec): min=72, max=1092, avg=308.16, stdev=292.20 lat (msec): min=72, max=1092, avg=308.23, stdev=292.23 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 83], | 30.00th=[ 180], 40.00th=[ 190], 50.00th=[ 220], 60.00th=[ 266], | 70.00th=[ 279], 80.00th=[ 326], 90.00th=[ 380], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1957, max= 4096, per=42.26%, avg=3244.00, stdev=1134.18, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.30, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=21.32%, ctx=183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183965: Wed Mar 11 10:15:24 2026 read: IOPS=1, BW=1757KiB/s (1800kB/s)(6144KiB/3496msec) clat (msec): min=65, max=399, avg=217.80, stdev=157.53 lat (msec): min=65, max=399, avg=217.80, stdev=157.53 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 288], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2048, max= 2048, per=37.35%, avg=2048.00, stdev= 0.00, samples=3 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=3 write: IOPS=1, BW=1757KiB/s (1800kB/s)(6144KiB/3496msec); 0 zone resets clat (msec): min=65, max=903, avg=361.13, stdev=318.55 lat (msec): min=65, max=903, avg=361.21, stdev=318.55 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 257], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2048, max= 4079, per=35.50%, avg=2725.00, stdev=1172.60, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=33.33%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=15.02%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183966: Wed Mar 11 10:15:24 2026 read: IOPS=1, BW=1392KiB/s (1425kB/s)(5120KiB/3679msec) clat (msec): min=44, max=398, avg=188.45, stdev=160.13 lat (msec): min=44, max=398, avg=188.45, stdev=160.13 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 104], 60.00th=[ 104], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 4023, max= 4096, per=74.04%, avg=4059.50, stdev=51.62, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1948KiB/s (1995kB/s)(7168KiB/3679msec); 0 zone resets clat (msec): min=97, max=847, avg=386.45, stdev=317.17 lat (msec): min=97, max=847, avg=386.53, stdev=317.18 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 127], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 184], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 718], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1957, max= 6035, per=46.01%, avg=3531.75, stdev=1940.17, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 2.06, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=17.65%, ctx=251, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5483KiB/s (5615kB/s), 548KiB/s-1988KiB/s (561kB/s-2036kB/s), io=20.0MiB (20.0MB), run=3496-3735msec WRITE: bw=7677KiB/s (7861kB/s), 1420KiB/s-2742KiB/s (1454kB/s-2807kB/s), io=28.0MiB (29.4MB), run=3496-3735msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183971: Wed Mar 11 10:15:33 2026 read: IOPS=1, BW=6903KiB/s (7069kB/s)(12.0MiB/1780msec) clat (msec): min=165, max=838, avg=587.61, stdev=367.90 lat (msec): min=165, max=838, avg=587.61, stdev=367.90 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7627, max= 8192, per=100.00%, avg=7909.50, stdev=399.52, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=16.92%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183972: Wed Mar 11 10:15:33 2026 read: IOPS=0, BW=1504KiB/s (1540kB/s)(4096KiB/2723msec) clat (nsec): min=1533.1M, max=1533.1M, avg=1533082397.00, stdev= 0.00 lat (nsec): min=1533.1M, max=1533.1M, avg=1533083573.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1536], 5.00th=[ 1536], 10.00th=[ 1536], 20.00th=[ 1536], | 30.00th=[ 1536], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3008KiB/s (3081kB/s)(8192KiB/2723msec); 0 zone resets clat (msec): min=137, max=1022, avg=580.15, stdev=626.20 lat (msec): min=137, max=1023, avg=580.43, stdev=626.19 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.06%, ctx=160, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183973: Wed Mar 11 10:15:33 2026 write: IOPS=1, BW=4508KiB/s (4616kB/s)(12.0MiB/2726msec); 0 zone resets clat (msec): min=676, max=1097, avg=898.78, stdev=211.48 lat (msec): min=676, max=1097, avg=899.00, stdev=211.42 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8192, max= 8192, per=68.15%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.44%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183974: Wed Mar 11 10:15:33 2026 write: IOPS=1, BW=5099KiB/s (5221kB/s)(12.0MiB/2410msec); 0 zone resets clat (msec): min=669, max=896, avg=797.19, stdev=116.39 lat (msec): min=669, max=897, avg=797.46, stdev=116.28 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=68.15%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=16.69%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6017KiB/s (6161kB/s), 1504KiB/s-6903KiB/s (1540kB/s-7069kB/s), io=16.0MiB (16.8MB), run=1780-2723msec WRITE: bw=11.7MiB/s (12.3MB/s), 3008KiB/s-5099KiB/s (3081kB/s-5221kB/s), io=32.0MiB (33.6MB), run=2410-2726msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183976: Wed Mar 11 10:15:33 2026 read: IOPS=1, BW=6175KiB/s (6323kB/s)(12.0MiB/1990msec) clat (msec): min=438, max=1023, avg=639.28, stdev=332.88 lat (msec): min=438, max=1023, avg=639.28, stdev=332.88 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=44.29%, ctx=2173, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183977: Wed Mar 11 10:15:33 2026 read: IOPS=0, BW=1710KiB/s (1751kB/s)(4096KiB/2396msec) clat (nsec): min=1068.5M, max=1068.5M, avg=1068458038.00, stdev= 0.00 lat (nsec): min=1068.5M, max=1068.5M, avg=1068459397.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3419KiB/s (3501kB/s)(8192KiB/2396msec); 0 zone resets clat (msec): min=274, max=1028, avg=651.78, stdev=533.37 lat (msec): min=274, max=1029, avg=652.06, stdev=533.38 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8192, max= 8192, per=64.40%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=25.97%, ctx=1316, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183978: Wed Mar 11 10:15:33 2026 write: IOPS=1, BW=4770KiB/s (4885kB/s)(12.0MiB/2576msec); 0 zone resets clat (msec): min=181, max=1972, avg=845.18, stdev=981.09 lat (msec): min=181, max=1973, avg=845.76, stdev=981.47 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.56%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183979: Wed Mar 11 10:15:33 2026 write: IOPS=1, BW=5114KiB/s (5236kB/s)(12.0MiB/2403msec); 0 zone resets clat (msec): min=321, max=1082, avg=769.81, stdev=398.33 lat (msec): min=321, max=1083, avg=770.06, stdev=398.43 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=64.40%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.95%, ctx=127, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6838KiB/s (7002kB/s), 1710KiB/s-6175KiB/s (1751kB/s-6323kB/s), io=16.0MiB (16.8MB), run=1990-2396msec WRITE: bw=12.4MiB/s (13.0MB/s), 3419KiB/s-5114KiB/s (3501kB/s-5236kB/s), io=32.0MiB (33.6MB), run=2396-2576msec