== sanity test 398b: DIO and buffer IO race ============== 14:31:56 (1781029916) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.7034 s, 18.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150942: Tue Jun 9 14:33:00 2026 read: IOPS=27, BW=111KiB/s (113kB/s)(5992KiB/54134msec) clat (usec): min=50, max=643719, avg=18961.21, stdev=19727.94 lat (usec): min=52, max=643720, avg=18962.06, stdev=19727.99 clat percentiles (usec): | 1.00th=[ 95], 5.00th=[ 4228], 10.00th=[ 8029], 20.00th=[ 10028], | 30.00th=[ 12256], 40.00th=[ 14222], 50.00th=[ 16581], 60.00th=[ 19006], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32113], 95.00th=[ 38011], | 99.00th=[ 56361], 99.50th=[ 70779], 99.90th=[123208], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 6, max= 199, per=25.72%, avg=110.58, stdev=33.30, samples=107 iops : min= 1, max= 49, avg=27.23, stdev= 8.35, samples=107 write: IOPS=29, BW=116KiB/s (119kB/s)(6296KiB/54134msec); 0 zone resets clat (usec): min=780, max=109580, avg=16229.10, stdev=13382.42 lat (usec): min=781, max=109581, avg=16230.72, stdev=13382.21 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2474], 10.00th=[ 3130], 20.00th=[ 4621], | 30.00th=[ 6849], 40.00th=[ 10159], 50.00th=[ 13304], 60.00th=[ 16450], | 70.00th=[ 20317], 80.00th=[ 25560], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 60556], 99.50th=[ 78119], 99.90th=[100140], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 39, max= 214, per=26.00%, avg=117.25, stdev=30.52, samples=106 iops : min= 9, max= 53, avg=28.92, stdev= 7.68, samples=106 lat (usec) : 100=0.55%, 250=1.63%, 500=0.07%, 1000=0.26% lat (msec) : 2=1.66%, 4=6.51%, 10=19.08%, 20=36.65%, 50=31.84% lat (msec) : 100=1.63%, 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=27.93%, ctx=9237, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150943: Tue Jun 9 14:33:00 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(5940KiB/54845msec) clat (usec): min=30, max=156000, avg=19082.90, stdev=12412.27 lat (usec): min=30, max=156001, avg=19083.73, stdev=12412.33 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 6390], 10.00th=[ 8160], 20.00th=[ 10421], | 30.00th=[ 12387], 40.00th=[ 14484], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32637], 95.00th=[ 38536], | 99.00th=[ 66847], 99.50th=[ 78119], 99.90th=[139461], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 6, max= 183, per=25.15%, avg=108.15, stdev=30.03, samples=109 iops : min= 1, max= 45, avg=26.62, stdev= 7.53, samples=109 write: IOPS=28, BW=116KiB/s (119kB/s)(6348KiB/54845msec); 0 zone resets clat (usec): min=723, max=635660, avg=16581.57, stdev=20269.37 lat (usec): min=724, max=635661, avg=16582.56, stdev=20269.41 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 2311], 10.00th=[ 3130], 20.00th=[ 4686], | 30.00th=[ 6915], 40.00th=[ 9896], 50.00th=[ 13304], 60.00th=[ 16581], | 70.00th=[ 20579], 80.00th=[ 25560], 90.00th=[ 34341], 95.00th=[ 41681], | 99.00th=[ 58459], 99.50th=[ 66323], 99.90th=[ 99091], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 47, max= 207, per=25.88%, avg=116.72, stdev=35.53, samples=108 iops : min= 11, max= 51, avg=28.77, stdev= 8.88, samples=108 lat (usec) : 50=0.13%, 100=0.46%, 250=1.07%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.33% lat (msec) : 2=1.53%, 4=6.25%, 10=19.47%, 20=36.52%, 50=32.06% lat (msec) : 100=1.95%, 250=0.07%, 750=0.03% cpu : usr=0.11%, sys=28.03%, ctx=9349, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150944: Tue Jun 9 14:33:00 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(6028KiB/55728msec) clat (usec): min=35, max=642177, avg=19173.26, stdev=19824.07 lat (usec): min=36, max=642178, avg=19174.33, stdev=19824.04 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 429], 10.00th=[ 7963], 20.00th=[ 10159], | 30.00th=[ 12518], 40.00th=[ 14484], 50.00th=[ 16581], 60.00th=[ 19006], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32113], 95.00th=[ 39060], | 99.00th=[ 64226], 99.50th=[ 71828], 99.90th=[ 92799], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 39, max= 191, per=25.28%, avg=108.72, stdev=31.14, samples=109 iops : min= 9, max= 47, avg=26.77, stdev= 7.78, samples=109 write: IOPS=28, BW=112KiB/s (115kB/s)(6260KiB/55728msec); 0 zone resets clat (usec): min=688, max=96555, avg=17030.79, stdev=13497.03 lat (usec): min=689, max=96556, avg=17033.38, stdev=13498.00 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2573], 10.00th=[ 3326], 20.00th=[ 5080], | 30.00th=[ 7570], 40.00th=[10814], 50.00th=[14091], 60.00th=[17695], | 70.00th=[21365], 80.00th=[26608], 90.00th=[34866], 95.00th=[43254], | 99.00th=[61604], 99.50th=[69731], 99.90th=[85459], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 19, max= 207, per=24.75%, avg=111.62, stdev=32.64, samples=110 iops : min= 4, max= 51, avg=27.49, stdev= 8.23, samples=110 lat (usec) : 50=0.10%, 100=0.65%, 250=1.53%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=1.27%, 4=5.96%, 10=17.81%, 20=37.14%, 50=32.45% lat (msec) : 100=2.51%, 750=0.03% cpu : usr=0.12%, sys=27.64%, ctx=9597, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150945: Tue Jun 9 14:33:00 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(6052KiB/55598msec) clat (usec): min=33, max=111780, avg=18461.84, stdev=11285.14 lat (usec): min=34, max=111781, avg=18462.68, stdev=11285.24 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 5932], 10.00th=[ 8225], 20.00th=[ 10421], | 30.00th=[ 12256], 40.00th=[ 14222], 50.00th=[ 16581], 60.00th=[ 18482], | 70.00th=[ 21627], 80.00th=[ 25297], 90.00th=[ 32113], 95.00th=[ 38011], | 99.00th=[ 58459], 99.50th=[ 66847], 99.90th=[100140], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 39, max= 183, per=25.48%, avg=109.56, stdev=32.36, samples=109 iops : min= 9, max= 45, avg=26.97, stdev= 8.09, samples=109 write: IOPS=28, BW=112KiB/s (115kB/s)(6236KiB/55598msec); 0 zone resets clat (usec): min=641, max=673378, avg=17629.90, stdev=22043.24 lat (usec): min=641, max=673379, avg=17632.09, stdev=22043.50 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2376], 10.00th=[ 3294], 20.00th=[ 5080], | 30.00th=[ 7701], 40.00th=[ 10945], 50.00th=[ 14484], 60.00th=[ 17695], | 70.00th=[ 21627], 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 65799], 99.50th=[ 90702], 99.90th=[154141], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 56, max= 206, per=25.04%, avg=112.91, stdev=30.45, samples=109 iops : min= 14, max= 51, avg=27.82, stdev= 7.65, samples=109 lat (usec) : 50=0.13%, 100=0.65%, 250=1.33%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=1.53%, 4=5.63%, 10=17.97%, 20=38.35%, 50=31.77% lat (msec) : 100=1.92%, 250=0.20%, 750=0.03% cpu : usr=0.10%, sys=27.66%, ctx=9423, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=431KiB/s (441kB/s), 108KiB/s-111KiB/s (111kB/s-113kB/s), io=23.4MiB (24.6MB), run=54134-55728msec WRITE: bw=451KiB/s (462kB/s), 112KiB/s-116KiB/s (115kB/s-119kB/s), io=24.6MiB (25.7MB), run=54134-55728msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150947: Tue Jun 9 14:33:25 2026 read: IOPS=18, BW=75.0KiB/s (76.8kB/s)(5992KiB/79859msec) clat (msec): min=2, max=647, avg=16.83, stdev=22.71 lat (msec): min=2, max=647, avg=16.84, stdev=22.71 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 50], | 99.00th=[ 80], 99.50th=[ 107], 99.90th=[ 136], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 15, max= 216, per=25.15%, avg=75.46, stdev=46.72, samples=158 iops : min= 3, max= 54, avg=18.57, stdev=11.83, samples=158 write: IOPS=19, BW=78.8KiB/s (80.7kB/s)(6296KiB/79859msec); 0 zone resets clat (msec): min=12, max=157, avg=34.63, stdev=18.91 lat (msec): min=12, max=157, avg=34.63, stdev=18.91 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 50], 90.00th=[ 60], 95.00th=[ 71], | 99.00th=[ 95], 99.50th=[ 111], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 24, max= 200, per=25.21%, avg=79.15, stdev=42.84, samples=158 iops : min= 6, max= 50, avg=19.49, stdev=10.90, samples=158 lat (msec) : 4=3.48%, 10=18.62%, 20=25.59%, 50=40.56%, 100=11.00% lat (msec) : 250=0.72%, 750=0.03% cpu : usr=0.10%, sys=10.78%, ctx=6461, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150948: Tue Jun 9 14:33:25 2026 read: IOPS=18, BW=74.3KiB/s (76.0kB/s)(5940KiB/79983msec) clat (msec): min=2, max=648, avg=16.71, stdev=22.64 lat (msec): min=2, max=648, avg=16.71, stdev=22.64 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 48], | 99.00th=[ 78], 99.50th=[ 100], 99.90th=[ 136], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 208, per=24.85%, avg=74.54, stdev=45.86, samples=158 iops : min= 1, max= 52, avg=18.34, stdev=11.65, samples=158 write: IOPS=19, BW=79.4KiB/s (81.3kB/s)(6348KiB/79983msec); 0 zone resets clat (msec): min=11, max=198, avg=34.68, stdev=19.89 lat (msec): min=11, max=198, avg=34.68, stdev=19.89 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 103], 99.50th=[ 124], 99.90th=[ 163], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 23, max= 192, per=25.29%, avg=79.41, stdev=43.09, samples=158 iops : min= 5, max= 48, avg=19.56, stdev=10.95, samples=158 lat (msec) : 4=3.26%, 10=18.88%, 20=24.87%, 50=41.47%, 100=10.71% lat (msec) : 250=0.78%, 750=0.03% cpu : usr=0.10%, sys=10.75%, ctx=6455, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150949: Tue Jun 9 14:33:25 2026 read: IOPS=18, BW=75.7KiB/s (77.5kB/s)(6028KiB/79608msec) clat (msec): min=2, max=133, avg=16.75, stdev=15.86 lat (msec): min=2, max=133, avg=16.75, stdev=15.86 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 49], | 99.00th=[ 78], 99.50th=[ 95], 99.90th=[ 124], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 7, max= 208, per=25.33%, avg=75.99, stdev=44.80, samples=157 iops : min= 1, max= 52, avg=18.70, stdev=11.38, samples=157 write: IOPS=19, BW=78.6KiB/s (80.5kB/s)(6260KiB/79608msec); 0 zone resets clat (msec): min=12, max=657, avg=34.65, stdev=24.96 lat (msec): min=12, max=657, avg=34.65, stdev=24.96 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 61], 95.00th=[ 71], | 99.00th=[ 105], 99.50th=[ 126], 99.90th=[ 174], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 23, max= 184, per=25.09%, avg=78.79, stdev=43.42, samples=157 iops : min= 5, max= 46, avg=19.40, stdev=11.03, samples=157 lat (msec) : 4=3.06%, 10=18.29%, 20=25.62%, 50=41.63%, 100=10.64% lat (msec) : 250=0.72%, 750=0.03% cpu : usr=0.10%, sys=10.79%, ctx=6572, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150950: Tue Jun 9 14:33:25 2026 read: IOPS=19, BW=76.2KiB/s (77.0kB/s)(6052KiB/79457msec) clat (msec): min=2, max=137, avg=16.41, stdev=15.78 lat (msec): min=2, max=137, avg=16.41, stdev=15.78 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 49], | 99.00th=[ 74], 99.50th=[ 93], 99.90th=[ 123], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 15, max= 256, per=25.66%, avg=76.99, stdev=47.21, samples=156 iops : min= 3, max= 64, avg=18.95, stdev=11.97, samples=156 write: IOPS=19, BW=78.5KiB/s (80.4kB/s)(6236KiB/79457msec); 0 zone resets clat (msec): min=12, max=669, avg=34.95, stdev=24.96 lat (msec): min=12, max=669, avg=34.96, stdev=24.96 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 49], 90.00th=[ 61], 95.00th=[ 71], | 99.00th=[ 95], 99.50th=[ 117], 99.90th=[ 199], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 16, max= 184, per=25.09%, avg=78.79, stdev=42.36, samples=157 iops : min= 4, max= 46, avg=19.40, stdev=10.78, samples=157 lat (msec) : 4=3.58%, 10=19.24%, 20=24.38%, 50=41.34%, 100=10.87% lat (msec) : 250=0.55%, 750=0.03% cpu : usr=0.09%, sys=10.81%, ctx=6461, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=300KiB/s (307kB/s), 74.3KiB/s-76.2KiB/s (76.0kB/s-77.0kB/s), io=23.4MiB (24.6MB), run=79457-79983msec WRITE: bw=314KiB/s (322kB/s), 78.5KiB/s-79.4KiB/s (80.4kB/s-81.3kB/s), io=24.6MiB (25.7MB), run=79457-79983msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150984: Tue Jun 9 14:33:45 2026 read: IOPS=24, BW=385KiB/s (394kB/s)(5920KiB/15383msec) clat (usec): min=48, max=84405, avg=20241.13, stdev=12777.00 lat (usec): min=49, max=84406, avg=20241.84, stdev=12777.07 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 184], 10.00th=[ 7046], 20.00th=[10421], | 30.00th=[13435], 40.00th=[16057], 50.00th=[18220], 60.00th=[20841], | 70.00th=[23725], 80.00th=[28443], 90.00th=[36439], 95.00th=[42730], | 99.00th=[66323], 99.50th=[78119], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 159, max= 640, per=23.83%, avg=371.03, stdev=128.19, samples=30 iops : min= 9, max= 40, avg=22.67, stdev= 8.10, samples=30 write: IOPS=25, BW=414KiB/s (424kB/s)(6368KiB/15383msec); 0 zone resets clat (usec): min=1014, max=88471, avg=19737.43, stdev=14253.54 lat (usec): min=1016, max=88473, avg=19738.81, stdev=14253.73 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 3687], 10.00th=[ 5014], 20.00th=[ 7832], | 30.00th=[10945], 40.00th=[13566], 50.00th=[16450], 60.00th=[19006], | 70.00th=[23725], 80.00th=[28967], 90.00th=[38536], 95.00th=[46924], | 99.00th=[72877], 99.50th=[79168], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 224, max= 576, per=24.74%, avg=405.27, stdev=109.13, samples=30 iops : min= 14, max= 36, avg=24.80, stdev= 6.80, samples=30 lat (usec) : 50=0.13%, 100=0.39%, 250=2.47%, 500=0.13%, 750=0.13% lat (msec) : 2=0.65%, 4=2.60%, 10=15.89%, 20=35.94%, 50=38.67% lat (msec) : 100=2.99% cpu : usr=0.08%, sys=29.81%, ctx=2953, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150985: Tue Jun 9 14:33:45 2026 read: IOPS=23, BW=377KiB/s (386kB/s)(5744KiB/15224msec) clat (usec): min=73, max=156063, avg=20907.74, stdev=14668.73 lat (usec): min=73, max=156063, avg=20908.66, stdev=14669.06 clat percentiles (usec): | 1.00th=[ 86], 5.00th=[ 149], 10.00th=[ 7832], 20.00th=[ 11207], | 30.00th=[ 13435], 40.00th=[ 15533], 50.00th=[ 18220], 60.00th=[ 21627], | 70.00th=[ 25560], 80.00th=[ 29492], 90.00th=[ 37487], 95.00th=[ 46924], | 99.00th=[ 67634], 99.50th=[ 69731], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 223, max= 608, per=24.28%, avg=378.07, stdev=118.91, samples=30 iops : min= 13, max= 38, avg=23.10, stdev= 7.48, samples=30 write: IOPS=26, BW=430KiB/s (440kB/s)(6544KiB/15224msec); 0 zone resets clat (usec): min=1228, max=84912, avg=18631.19, stdev=13090.77 lat (usec): min=1232, max=84913, avg=18632.52, stdev=13090.91 clat percentiles (usec): | 1.00th=[ 2474], 5.00th=[ 3982], 10.00th=[ 4817], 20.00th=[ 7308], | 30.00th=[ 9503], 40.00th=[12256], 50.00th=[15664], 60.00th=[19530], | 70.00th=[23462], 80.00th=[27657], 90.00th=[36439], 95.00th=[43254], | 99.00th=[62129], 99.50th=[64750], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 223, max= 733, per=26.24%, avg=429.83, stdev=145.41, samples=30 iops : min= 13, max= 45, avg=26.33, stdev= 9.09, samples=30 lat (usec) : 100=1.04%, 250=2.86%, 500=0.13% lat (msec) : 2=0.39%, 4=2.60%, 10=16.54%, 20=35.03%, 50=38.54% lat (msec) : 100=2.73%, 250=0.13% cpu : usr=0.15%, sys=30.18%, ctx=2858, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150986: Tue Jun 9 14:33:45 2026 read: IOPS=25, BW=414KiB/s (424kB/s)(6256KiB/15097msec) clat (usec): min=49, max=98644, avg=19905.20, stdev=12680.90 lat (usec): min=49, max=98646, avg=19906.02, stdev=12680.96 clat percentiles (usec): | 1.00th=[ 83], 5.00th=[ 125], 10.00th=[ 4424], 20.00th=[10814], | 30.00th=[14353], 40.00th=[16319], 50.00th=[18482], 60.00th=[20841], | 70.00th=[23725], 80.00th=[27657], 90.00th=[33424], 95.00th=[42206], | 99.00th=[58983], 99.50th=[78119], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 286, max= 860, per=26.55%, avg=413.31, stdev=131.79, samples=29 iops : min= 17, max= 53, avg=25.31, stdev= 8.19, samples=29 write: IOPS=24, BW=400KiB/s (409kB/s)(6032KiB/15097msec); 0 zone resets clat (usec): min=1015, max=80865, avg=19188.90, stdev=13820.96 lat (usec): min=1015, max=80867, avg=19190.39, stdev=13821.16 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 3884], 10.00th=[ 4621], 20.00th=[ 7242], | 30.00th=[ 9765], 40.00th=[12649], 50.00th=[15533], 60.00th=[19530], | 70.00th=[23462], 80.00th=[30016], 90.00th=[38011], 95.00th=[45876], | 99.00th=[65799], 99.50th=[72877], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 191, max= 672, per=23.51%, avg=385.17, stdev=115.35, samples=29 iops : min= 11, max= 42, avg=23.52, stdev= 7.31, samples=29 lat (usec) : 50=0.13%, 100=1.69%, 250=3.26% lat (msec) : 2=0.78%, 4=1.69%, 10=16.15%, 20=35.03%, 50=38.28% lat (msec) : 100=2.99% cpu : usr=0.07%, sys=30.05%, ctx=2783, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150987: Tue Jun 9 14:33:45 2026 read: IOPS=25, BW=407KiB/s (417kB/s)(6032KiB/14829msec) clat (usec): min=31, max=102562, avg=19693.43, stdev=13347.49 lat (usec): min=31, max=102563, avg=19694.80, stdev=13347.97 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 115], 10.00th=[ 215], 20.00th=[ 9765], | 30.00th=[ 12649], 40.00th=[ 16057], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 24773], 80.00th=[ 28967], 90.00th=[ 35390], 95.00th=[ 44303], | 99.00th=[ 57410], 99.50th=[ 76022], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 192, max= 734, per=25.90%, avg=403.28, stdev=128.61, samples=29 iops : min= 12, max= 45, avg=24.66, stdev= 8.08, samples=29 write: IOPS=26, BW=422KiB/s (432kB/s)(6256KiB/14829msec); 0 zone resets clat (usec): min=889, max=73230, avg=18699.51, stdev=12988.82 lat (usec): min=890, max=73231, avg=18700.87, stdev=12988.99 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 4228], 10.00th=[ 5211], 20.00th=[ 7111], | 30.00th=[ 9765], 40.00th=[12518], 50.00th=[16319], 60.00th=[19530], | 70.00th=[22414], 80.00th=[27395], 90.00th=[36439], 95.00th=[47449], | 99.00th=[57410], 99.50th=[61080], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 192, max= 736, per=25.67%, avg=420.45, stdev=136.29, samples=29 iops : min= 12, max= 46, avg=25.72, stdev= 8.59, samples=29 lat (usec) : 50=0.26%, 100=1.17%, 250=3.91%, 500=0.26%, 1000=0.26% lat (msec) : 2=0.26%, 4=1.69%, 10=18.75%, 20=32.94%, 50=37.24% lat (msec) : 100=3.12%, 250=0.13% cpu : usr=0.09%, sys=30.40%, ctx=2854, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1557KiB/s (1594kB/s), 377KiB/s-414KiB/s (386kB/s-424kB/s), io=23.4MiB (24.5MB), run=14829-15383msec WRITE: bw=1638KiB/s (1677kB/s), 400KiB/s-430KiB/s (409kB/s-440kB/s), io=24.6MiB (25.8MB), run=14829-15383msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150979: Tue Jun 9 14:33:51 2026 read: IOPS=18, BW=288KiB/s (295kB/s)(5920KiB/20553msec) clat (usec): min=3104, max=92126, avg=19285.83, stdev=14697.23 lat (usec): min=3105, max=92127, avg=19286.50, stdev=14697.28 clat percentiles (usec): | 1.00th=[ 3851], 5.00th=[ 4817], 10.00th=[ 6063], 20.00th=[ 8717], | 30.00th=[10159], 40.00th=[11469], 50.00th=[13829], 60.00th=[17957], | 70.00th=[21627], 80.00th=[27919], 90.00th=[41681], 95.00th=[50070], | 99.00th=[70779], 99.50th=[74974], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 126, max= 640, per=24.46%, avg=283.70, stdev=143.77, samples=40 iops : min= 7, max= 40, avg=17.20, stdev= 9.20, samples=40 write: IOPS=19, BW=310KiB/s (317kB/s)(6368KiB/20553msec); 0 zone resets clat (msec): min=12, max=148, avg=33.59, stdev=17.60 lat (msec): min=12, max=148, avg=33.59, stdev=17.60 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 44], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 92], 99.50th=[ 115], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 95, max= 608, per=25.26%, avg=308.15, stdev=141.38, samples=40 iops : min= 5, max= 38, avg=18.73, stdev= 9.07, samples=40 lat (msec) : 4=0.65%, 10=13.15%, 20=27.60%, 50=48.18%, 100=10.03% lat (msec) : 250=0.39% cpu : usr=0.12%, sys=12.48%, ctx=1929, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150980: Tue Jun 9 14:33:51 2026 read: IOPS=17, BW=278KiB/s (285kB/s)(5744KiB/20642msec) clat (msec): min=3, max=118, avg=18.73, stdev=16.79 lat (msec): min=3, max=118, avg=18.73, stdev=16.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 41], 95.00th=[ 58], | 99.00th=[ 88], 99.50th=[ 89], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 63, max= 640, per=23.99%, avg=278.27, stdev=153.83, samples=40 iops : min= 3, max= 40, avg=16.85, stdev= 9.85, samples=40 write: IOPS=19, BW=317KiB/s (325kB/s)(6544KiB/20642msec); 0 zone resets clat (msec): min=12, max=155, avg=33.97, stdev=18.86 lat (msec): min=12, max=155, avg=33.98, stdev=18.86 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 63], 95.00th=[ 69], | 99.00th=[ 104], 99.50th=[ 130], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 158, max= 640, per=25.45%, avg=310.55, stdev=144.00, samples=40 iops : min= 9, max= 40, avg=18.88, stdev= 9.23, samples=40 lat (msec) : 4=1.17%, 10=13.67%, 20=29.82%, 50=44.01%, 100=10.55% lat (msec) : 250=0.78% cpu : usr=0.05%, sys=12.49%, ctx=1794, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150981: Tue Jun 9 14:33:51 2026 read: IOPS=19, BW=304KiB/s (312kB/s)(6256KiB/20560msec) clat (msec): min=3, max=110, avg=18.39, stdev=16.42 lat (msec): min=3, max=110, avg=18.39, stdev=16.42 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 52], | 99.00th=[ 80], 99.50th=[ 102], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 126, max= 798, per=26.25%, avg=304.47, stdev=186.61, samples=40 iops : min= 7, max= 49, avg=18.50, stdev=11.88, samples=40 write: IOPS=18, BW=293KiB/s (300kB/s)(6032KiB/20560msec); 0 zone resets clat (msec): min=13, max=154, avg=35.35, stdev=20.77 lat (msec): min=13, max=154, avg=35.36, stdev=20.77 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 62], 95.00th=[ 77], | 99.00th=[ 121], 99.50th=[ 140], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 96, max= 608, per=23.69%, avg=289.00, stdev=139.01, samples=40 iops : min= 6, max= 38, avg=17.52, stdev= 8.95, samples=40 lat (msec) : 4=1.43%, 10=19.01%, 20=24.74%, 50=43.62%, 100=10.03% lat (msec) : 250=1.17% cpu : usr=0.06%, sys=12.61%, ctx=1964, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150982: Tue Jun 9 14:33:51 2026 read: IOPS=18, BW=293KiB/s (300kB/s)(6032KiB/20563msec) clat (msec): min=3, max=110, avg=18.43, stdev=15.80 lat (msec): min=3, max=110, avg=18.43, stdev=15.80 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 53], | 99.00th=[ 82], 99.50th=[ 109], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 95, max= 800, per=24.93%, avg=289.20, stdev=157.83, samples=40 iops : min= 5, max= 50, avg=17.55, stdev=10.09, samples=40 write: IOPS=19, BW=304KiB/s (312kB/s)(6256KiB/20563msec); 0 zone resets clat (msec): min=13, max=125, avg=34.73, stdev=19.64 lat (msec): min=13, max=125, avg=34.73, stdev=19.64 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 81], | 99.00th=[ 104], 99.50th=[ 123], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 126, max= 672, per=24.79%, avg=302.48, stdev=147.27, samples=40 iops : min= 7, max= 42, avg=18.37, stdev= 9.49, samples=40 lat (msec) : 4=0.26%, 10=15.63%, 20=30.73%, 50=42.84%, 100=9.51% lat (msec) : 250=1.04% cpu : usr=0.06%, sys=12.48%, ctx=1969, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1160KiB/s (1188kB/s), 278KiB/s-304KiB/s (285kB/s-312kB/s), io=23.4MiB (24.5MB), run=20553-20642msec WRITE: bw=1221KiB/s (1250kB/s), 293KiB/s-317KiB/s (300kB/s-325kB/s), io=24.6MiB (25.8MB), run=20553-20642msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150995: Tue Jun 9 14:33:58 2026 read: IOPS=3, BW=3182KiB/s (3258kB/s)(7168KiB/2253msec) clat (usec): min=697, max=153816, avg=112616.97, stdev=56148.37 lat (usec): min=698, max=153818, avg=112617.99, stdev=56148.41 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 73925], | 30.00th=[132645], 40.00th=[132645], 50.00th=[132645], 60.00th=[143655], | 70.00th=[143655], 80.00th=[149947], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 2048, max= 5069, per=51.41%, avg=3734.67, stdev=1541.01, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2273KiB/s (2327kB/s)(5120KiB/2253msec); 0 zone resets clat (msec): min=169, max=561, avg=283.79, stdev=171.15 lat (msec): min=169, max=561, avg=283.86, stdev=171.16 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2035, max= 4096, per=26.79%, avg=2724.67, stdev=1187.62, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33% cpu : usr=0.04%, sys=42.01%, ctx=1431, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150996: Tue Jun 9 14:33:58 2026 read: IOPS=0, BW=726KiB/s (744kB/s)(2048KiB/2819msec) clat (msec): min=135, max=146, avg=140.86, stdev= 7.52 lat (msec): min=135, max=146, avg=140.86, stdev= 7.52 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 1695, max= 2048, per=25.76%, avg=1871.50, stdev=249.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3632KiB/s (3720kB/s)(10.0MiB/2819msec); 0 zone resets clat (msec): min=91, max=482, avg=249.64, stdev=150.11 lat (msec): min=91, max=482, avg=249.71, stdev=150.11 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 116], | 30.00th=[ 134], 40.00th=[ 150], 50.00th=[ 155], 60.00th=[ 197], | 70.00th=[ 321], 80.00th=[ 380], 90.00th=[ 472], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2048, max= 6131, per=40.16%, avg=4084.25, stdev=1666.90, samples=4 iops : min= 2, max= 5, avg= 3.25, stdev= 1.26, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.04%, sys=42.12%, ctx=392, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150997: Tue Jun 9 14:33:58 2026 read: IOPS=2, BW=2495KiB/s (2554kB/s)(6144KiB/2463msec) clat (usec): min=326, max=240470, avg=98249.57, stdev=110654.57 lat (usec): min=327, max=240470, avg=98250.57, stdev=110654.49 clat percentiles (usec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 420], | 30.00th=[ 420], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[154141], | 70.00th=[193987], 80.00th=[193987], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 2048, max= 8143, per=70.15%, avg=5095.50, stdev=4309.82, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2495KiB/s (2554kB/s)(6144KiB/2463msec); 0 zone resets clat (msec): min=105, max=846, avg=310.46, stdev=296.79 lat (msec): min=105, max=846, avg=310.51, stdev=296.80 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 159], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2048, max= 4071, per=31.13%, avg=3166.00, stdev=1028.18, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=58.33%, 500=8.33%, 1000=8.33% cpu : usr=0.04%, sys=35.78%, ctx=522, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150998: Tue Jun 9 14:33:58 2026 read: IOPS=2, BW=2464KiB/s (2523kB/s)(5120KiB/2078msec) clat (usec): min=503, max=211373, avg=108412.04, stdev=74948.81 lat (usec): min=505, max=211373, avg=108412.87, stdev=74948.63 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 99091], 40.00th=[ 99091], 50.00th=[112722], 60.00th=[112722], | 70.00th=[119014], 80.00th=[119014], 90.00th=[210764], 95.00th=[210764], | 99.00th=[210764], 99.50th=[210764], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 2043, max= 6107, per=56.10%, avg=4075.00, stdev=2873.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=3, BW=3449KiB/s (3532kB/s)(7168KiB/2078msec); 0 zone resets clat (msec): min=93, max=505, avg=214.25, stdev=141.31 lat (msec): min=93, max=505, avg=214.31, stdev=141.32 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 118], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 163], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 259], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1695, max= 6131, per=38.99%, avg=3965.67, stdev=2219.88, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=58.33%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=49.06%, ctx=453, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7265KiB/s (7439kB/s), 726KiB/s-3182KiB/s (744kB/s-3258kB/s), io=20.0MiB (20.0MB), run=2078-2819msec WRITE: bw=9.93MiB/s (10.4MB/s), 2273KiB/s-3632KiB/s (2327kB/s-3720kB/s), io=28.0MiB (29.4MB), run=2078-2819msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151000: Tue Jun 9 14:33:58 2026 read: IOPS=2, BW=2757KiB/s (2823kB/s)(7168KiB/2600msec) clat (msec): min=44, max=700, avg=194.81, stdev=231.34 lat (msec): min=44, max=700, avg=194.81, stdev=231.34 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 51], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 103], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 218], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1689, max= 4096, per=47.69%, avg=3293.67, stdev=1389.68, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1969KiB/s (2016kB/s)(5120KiB/2600msec); 0 zone resets clat (msec): min=88, max=399, avg=237.15, stdev=146.52 lat (msec): min=88, max=399, avg=237.22, stdev=146.53 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2039, max= 4096, per=31.72%, avg=3067.50, stdev=1454.52, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (msec) : 50=8.33%, 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.08%, sys=15.89%, ctx=122, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151001: Tue Jun 9 14:33:58 2026 read: IOPS=0, BW=704KiB/s (721kB/s)(2048KiB/2910msec) clat (msec): min=52, max=448, avg=250.12, stdev=280.06 lat (msec): min=52, max=448, avg=250.12, stdev=280.06 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 53], | 30.00th=[ 53], 40.00th=[ 53], 50.00th=[ 53], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1706, max= 2003, per=26.85%, avg=1854.50, stdev=210.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3519KiB/s (3603kB/s)(10.0MiB/2910msec); 0 zone resets clat (msec): min=51, max=697, avg=239.15, stdev=178.81 lat (msec): min=51, max=697, avg=239.21, stdev=178.81 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 103], | 30.00th=[ 159], 40.00th=[ 163], 50.00th=[ 182], 60.00th=[ 215], | 70.00th=[ 222], 80.00th=[ 296], 90.00th=[ 309], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 4079, max= 6011, per=48.90%, avg=4728.67, stdev=1110.57, samples=3 iops : min= 3, max= 5, avg= 4.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=14.92%, ctx=99, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151002: Tue Jun 9 14:33:58 2026 read: IOPS=2, BW=2086KiB/s (2136kB/s)(6144KiB/2946msec) clat (msec): min=43, max=477, avg=205.53, stdev=165.43 lat (msec): min=43, max=477, avg=205.53, stdev=165.43 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 51], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 232], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2048, max= 6011, per=58.34%, avg=4029.50, stdev=2802.26, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2086KiB/s (2136kB/s)(6144KiB/2946msec); 0 zone resets clat (msec): min=52, max=797, avg=273.89, stdev=286.20 lat (msec): min=52, max=797, avg=273.95, stdev=286.20 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 194], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2003, max= 3379, per=25.58%, avg=2473.67, stdev=784.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=11.27%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151003: Tue Jun 9 14:33:58 2026 read: IOPS=1, BW=1727KiB/s (1768kB/s)(5120KiB/2965msec) clat (msec): min=18, max=113, avg=65.80, stdev=35.04 lat (msec): min=18, max=113, avg=65.80, stdev=35.04 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 19], 10.00th=[ 19], 20.00th=[ 19], | 30.00th=[ 50], 40.00th=[ 50], 50.00th=[ 74], 60.00th=[ 74], | 70.00th=[ 75], 80.00th=[ 75], 90.00th=[ 113], 95.00th=[ 113], | 99.00th=[ 113], 99.50th=[ 113], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2418KiB/s (2476kB/s)(7168KiB/2965msec); 0 zone resets clat (msec): min=54, max=789, avg=367.55, stdev=247.79 lat (msec): min=54, max=789, avg=367.62, stdev=247.78 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 91], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 426], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 451], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1698, max= 4007, per=25.32%, avg=2448.00, stdev=1052.02, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 20=8.33%, 50=8.33%, 100=33.33%, 250=8.33%, 500=33.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=11.77%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6907KiB/s (7073kB/s), 704KiB/s-2757KiB/s (721kB/s-2823kB/s), io=20.0MiB (20.0MB), run=2600-2965msec WRITE: bw=9670KiB/s (9902kB/s), 1969KiB/s-3519KiB/s (2016kB/s-3603kB/s), io=28.0MiB (29.4MB), run=2600-2965msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151008: Tue Jun 9 14:34:06 2026 read: IOPS=1, BW=6946KiB/s (7113kB/s)(12.0MiB/1769msec) clat (msec): min=408, max=720, avg=574.49, stdev=156.63 lat (msec): min=408, max=720, avg=574.49, stdev=156.63 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8192, max= 8192, per=95.16%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=14.59%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151009: Tue Jun 9 14:34:06 2026 read: IOPS=0, BW=2152KiB/s (2204kB/s)(4096KiB/1903msec) clat (nsec): min=1052.2M, max=1052.2M, avg=1052193019.00, stdev= 0.00 lat (nsec): min=1052.2M, max=1052.2M, avg=1052195349.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8192, max= 8192, per=95.16%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4305KiB/s (4408kB/s)(8192KiB/1903msec); 0 zone resets clat (msec): min=381, max=383, avg=382.43, stdev= 1.73 lat (msec): min=381, max=383, avg=382.79, stdev= 1.70 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 8110, max= 8110, per=47.10%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=12.67%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151010: Tue Jun 9 14:34:06 2026 write: IOPS=1, BW=6631KiB/s (6791kB/s)(12.0MiB/1853msec); 0 zone resets clat (msec): min=304, max=1042, avg=609.37, stdev=385.23 lat (msec): min=304, max=1042, avg=609.67, stdev=385.22 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7757, max= 8192, per=46.31%, avg=7974.50, stdev=307.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.11%, sys=16.74%, ctx=115, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151012: Tue Jun 9 14:34:06 2026 write: IOPS=1, BW=6502KiB/s (6658kB/s)(12.0MiB/1890msec); 0 zone resets clat (msec): min=175, max=1288, avg=616.85, stdev=590.86 lat (msec): min=175, max=1288, avg=617.08, stdev=590.87 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7447, max= 7447, per=43.25%, avg=7447.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.87%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8610KiB/s (8816kB/s), 2152KiB/s-6946KiB/s (2204kB/s-7113kB/s), io=16.0MiB (16.8MB), run=1769-1903msec WRITE: bw=16.8MiB/s (17.6MB/s), 4305KiB/s-6631KiB/s (4408kB/s-6791kB/s), io=32.0MiB (33.6MB), run=1853-1903msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151013: Tue Jun 9 14:34:06 2026 read: IOPS=2, BW=9799KiB/s (10.0MB/s)(12.0MiB/1254msec) clat (msec): min=373, max=424, avg=405.51, stdev=28.21 lat (msec): min=373, max=424, avg=405.51, stdev=28.21 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7968, max= 8192, per=86.85%, avg=8080.00, stdev=158.39, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.16%, sys=55.47%, ctx=2805, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151014: Tue Jun 9 14:34:06 2026 read: IOPS=0, BW=2326KiB/s (2382kB/s)(4096KiB/1761msec) clat (nsec): min=381818k, max=381818k, avg=381818183.00, stdev= 0.00 lat (nsec): min=381821k, max=381821k, avg=381820602.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 5512, max= 5512, per=59.25%, avg=5512.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4652KiB/s (4764kB/s)(8192KiB/1761msec); 0 zone resets clat (msec): min=603, max=722, avg=662.75, stdev=84.00 lat (msec): min=603, max=722, avg=663.01, stdev=83.99 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8192, max= 8192, per=48.50%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=16.70%, ctx=1021, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151015: Tue Jun 9 14:34:06 2026 write: IOPS=1, BW=6334KiB/s (6486kB/s)(12.0MiB/1940msec); 0 zone resets clat (msec): min=321, max=994, avg=642.03, stdev=337.64 lat (msec): min=321, max=994, avg=642.36, stdev=337.57 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8192, max= 8192, per=48.50%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.31%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151016: Tue Jun 9 14:34:06 2026 write: IOPS=1, BW=7666KiB/s (7850kB/s)(12.0MiB/1603msec); 0 zone resets clat (msec): min=209, max=663, avg=510.37, stdev=260.64 lat (msec): min=209, max=663, avg=510.59, stdev=260.60 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 5512, max= 5512, per=32.63%, avg=5512.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=15.54%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9304KiB/s (9527kB/s), 2326KiB/s-9799KiB/s (2382kB/s-10.0MB/s), io=16.0MiB (16.8MB), run=1254-1761msec WRITE: bw=16.5MiB/s (17.3MB/s), 4652KiB/s-7666KiB/s (4764kB/s-7850kB/s), io=32.0MiB (33.6MB), run=1603-1940msec