== sanity test 398b: DIO and buffer IO race ============== 12:54:04 (1777913644) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.51149 s, 20.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183141: Mon May 4 12:54:54 2026 read: IOPS=35, BW=142KiB/s (146kB/s)(5992KiB/42155msec) clat (usec): min=56, max=625444, avg=14963.41, stdev=17359.11 lat (usec): min=56, max=625445, avg=14963.96, stdev=17359.12 clat percentiles (usec): | 1.00th=[ 86], 5.00th=[ 5866], 10.00th=[ 7439], 20.00th=[ 8848], | 30.00th=[ 10159], 40.00th=[ 11731], 50.00th=[ 13435], 60.00th=[ 15270], | 70.00th=[ 17433], 80.00th=[ 19792], 90.00th=[ 22938], 95.00th=[ 26608], | 99.00th=[ 39584], 99.50th=[ 42206], 99.90th=[ 74974], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 13, max= 216, per=24.65%, avg=140.27, stdev=34.20, samples=83 iops : min= 3, max= 54, avg=34.84, stdev= 8.62, samples=83 write: IOPS=37, BW=149KiB/s (153kB/s)(6296KiB/42155msec); 0 zone resets clat (usec): min=646, max=68824, avg=12441.37, stdev=9351.84 lat (usec): min=646, max=68825, avg=12442.29, stdev=9351.89 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2245], 10.00th=[ 2704], 20.00th=[ 3556], | 30.00th=[ 5866], 40.00th=[ 8455], 50.00th=[10552], 60.00th=[12518], | 70.00th=[15664], 80.00th=[20055], 90.00th=[25560], 95.00th=[29754], | 99.00th=[43779], 99.50th=[46400], 99.90th=[56361], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 80, max= 239, per=25.02%, avg=149.13, stdev=34.67, samples=82 iops : min= 20, max= 59, avg=37.06, stdev= 8.61, samples=82 lat (usec) : 100=0.78%, 250=0.36%, 500=0.03%, 750=0.10%, 1000=0.49% lat (msec) : 2=1.33%, 4=10.09%, 10=25.65%, 20=41.21%, 50=19.69% lat (msec) : 100=0.23%, 750=0.03% cpu : usr=0.10%, sys=25.10%, ctx=9118, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183142: Mon May 4 12:54:54 2026 read: IOPS=35, BW=144KiB/s (147kB/s)(5940KiB/41320msec) clat (usec): min=37, max=78934, avg=14439.82, stdev=7264.91 lat (usec): min=39, max=78934, avg=14440.40, stdev=7265.04 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 6325], 10.00th=[ 7439], 20.00th=[ 8848], | 30.00th=[10028], 40.00th=[11600], 50.00th=[13304], 60.00th=[15008], | 70.00th=[16909], 80.00th=[19268], 90.00th=[22938], 95.00th=[27132], | 99.00th=[39584], 99.50th=[42730], 99.90th=[65799], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 6, max= 216, per=25.23%, avg=143.54, stdev=33.98, samples=82 iops : min= 1, max= 54, avg=35.66, stdev= 8.56, samples=82 write: IOPS=38, BW=154KiB/s (157kB/s)(6348KiB/41320msec); 0 zone resets clat (usec): min=720, max=564826, avg=12424.48, stdev=16648.14 lat (usec): min=721, max=564827, avg=12425.07, stdev=16648.15 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 2376], 10.00th=[ 2704], 20.00th=[ 3326], | 30.00th=[ 4817], 40.00th=[ 8225], 50.00th=[ 10290], 60.00th=[ 12387], | 70.00th=[ 15270], 80.00th=[ 19268], 90.00th=[ 25297], 95.00th=[ 29492], | 99.00th=[ 39584], 99.50th=[ 49546], 99.90th=[ 63701], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 6, max= 271, per=25.69%, avg=153.10, stdev=40.32, samples=82 iops : min= 1, max= 67, avg=38.05, stdev=10.03, samples=82 lat (usec) : 50=0.03%, 100=0.52%, 250=0.42%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=1.20%, 4=11.98%, 10=25.23%, 20=42.06%, 50=17.94% lat (msec) : 100=0.26%, 750=0.03% cpu : usr=0.09%, sys=25.41%, ctx=8962, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183143: Mon May 4 12:54:54 2026 read: IOPS=36, BW=145KiB/s (148kB/s)(6028KiB/41616msec) clat (usec): min=32, max=572262, avg=15005.36, stdev=16294.93 lat (usec): min=33, max=572262, avg=15006.00, stdev=16294.95 clat percentiles (usec): | 1.00th=[ 95], 5.00th=[ 6390], 10.00th=[ 7439], 20.00th=[ 8848], | 30.00th=[ 9896], 40.00th=[ 11207], 50.00th=[ 13304], 60.00th=[ 15270], | 70.00th=[ 17171], 80.00th=[ 19530], 90.00th=[ 23462], 95.00th=[ 27395], | 99.00th=[ 40109], 99.50th=[ 53740], 99.90th=[ 85459], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 71, max= 207, per=25.73%, avg=146.43, stdev=30.76, samples=81 iops : min= 17, max= 51, avg=36.38, stdev= 7.71, samples=81 write: IOPS=37, BW=150KiB/s (154kB/s)(6260KiB/41616msec); 0 zone resets clat (usec): min=699, max=63800, avg=12039.43, stdev=9419.67 lat (usec): min=700, max=63801, avg=12040.24, stdev=9419.66 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 2311], 10.00th=[ 2638], 20.00th=[ 3195], | 30.00th=[ 4555], 40.00th=[ 7963], 50.00th=[ 9896], 60.00th=[11994], | 70.00th=[15139], 80.00th=[19268], 90.00th=[25822], 95.00th=[30278], | 99.00th=[39584], 99.50th=[43779], 99.90th=[57934], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 20, max= 248, per=25.11%, avg=149.68, stdev=38.30, samples=82 iops : min= 5, max= 62, avg=37.20, stdev= 9.59, samples=82 lat (usec) : 50=0.03%, 100=0.52%, 250=0.42%, 750=0.10%, 1000=0.26% lat (msec) : 2=0.98%, 4=12.11%, 10=26.27%, 20=40.46%, 50=18.39% lat (msec) : 100=0.42%, 750=0.03% cpu : usr=0.09%, sys=25.18%, ctx=8792, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183144: Mon May 4 12:54:54 2026 read: IOPS=36, BW=145KiB/s (149kB/s)(6052KiB/41610msec) clat (usec): min=27, max=71723, avg=14807.23, stdev=7520.28 lat (usec): min=28, max=71724, avg=14807.78, stdev=7520.20 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 6456], 10.00th=[ 7570], 20.00th=[ 8979], | 30.00th=[10290], 40.00th=[11731], 50.00th=[13435], 60.00th=[15270], | 70.00th=[17171], 80.00th=[19792], 90.00th=[23987], 95.00th=[28181], | 99.00th=[40109], 99.50th=[45351], 99.90th=[58459], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 87, max= 215, per=25.77%, avg=146.63, stdev=28.17, samples=81 iops : min= 21, max= 53, avg=36.43, stdev= 7.10, samples=81 write: IOPS=37, BW=150KiB/s (153kB/s)(6236KiB/41610msec); 0 zone resets clat (usec): min=707, max=558087, avg=12218.43, stdev=16513.71 lat (usec): min=708, max=558088, avg=12219.04, stdev=16513.72 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 2212], 10.00th=[ 2606], 20.00th=[ 3163], | 30.00th=[ 4883], 40.00th=[ 8291], 50.00th=[ 10290], 60.00th=[ 12256], | 70.00th=[ 14877], 80.00th=[ 19006], 90.00th=[ 24511], 95.00th=[ 29754], | 99.00th=[ 40633], 99.50th=[ 45351], 99.90th=[ 58983], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 20, max= 223, per=25.11%, avg=149.67, stdev=33.91, samples=82 iops : min= 5, max= 55, avg=37.20, stdev= 8.50, samples=82 lat (usec) : 50=0.10%, 100=0.65%, 250=0.39%, 750=0.07%, 1000=0.49% lat (msec) : 2=1.37%, 4=11.36%, 10=23.76%, 20=43.03%, 50=18.49% lat (msec) : 100=0.26%, 750=0.03% cpu : usr=0.09%, sys=25.22%, ctx=8977, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=570KiB/s (583kB/s), 142KiB/s-145KiB/s (146kB/s-149kB/s), io=23.4MiB (24.6MB), run=41320-42155msec WRITE: bw=596KiB/s (611kB/s), 149KiB/s-154KiB/s (153kB/s-157kB/s), io=24.6MiB (25.7MB), run=41320-42155msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183137: Mon May 4 12:55:01 2026 read: IOPS=31, BW=124KiB/s (127kB/s)(5992KiB/48137msec) clat (msec): min=2, max=629, avg=13.92, stdev=19.01 lat (msec): min=2, max=629, avg=13.92, stdev=19.01 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 29], 95.00th=[ 35], | 99.00th=[ 49], 99.50th=[ 57], 99.90th=[ 69], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 48, max= 376, per=24.93%, avg=123.93, stdev=80.86, samples=94 iops : min= 12, max= 94, avg=30.67, stdev=20.33, samples=94 write: IOPS=32, BW=131KiB/s (134kB/s)(6296KiB/48137msec); 0 zone resets clat (usec): min=4141, max=99290, avg=17230.93, stdev=11966.92 lat (usec): min=4142, max=99291, avg=17231.67, stdev=11966.96 clat percentiles (usec): | 1.00th=[ 5080], 5.00th=[ 5735], 10.00th=[ 6259], 20.00th=[ 6980], | 30.00th=[ 8160], 40.00th=[10683], 50.00th=[13698], 60.00th=[17433], | 70.00th=[21627], 80.00th=[26084], 90.00th=[33424], 95.00th=[39060], | 99.00th=[58459], 99.50th=[63177], 99.90th=[82314], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 48, max= 400, per=24.98%, avg=130.14, stdev=81.22, samples=94 iops : min= 12, max= 100, avg=32.22, stdev=20.41, samples=94 lat (msec) : 4=1.50%, 10=41.96%, 20=28.97%, 50=26.27%, 100=1.27% lat (msec) : 750=0.03% cpu : usr=0.08%, sys=13.51%, ctx=5723, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183138: Mon May 4 12:55:01 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(5940KiB/47968msec) clat (msec): min=2, max=577, avg=13.80, stdev=17.79 lat (msec): min=2, max=577, avg=13.80, stdev=17.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 29], 95.00th=[ 35], | 99.00th=[ 47], 99.50th=[ 53], 99.90th=[ 75], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 39, max= 392, per=25.05%, avg=124.52, stdev=80.94, samples=94 iops : min= 9, max= 98, avg=30.82, stdev=20.35, samples=94 write: IOPS=33, BW=132KiB/s (136kB/s)(6348KiB/47968msec); 0 zone resets clat (usec): min=3870, max=91724, avg=17212.00, stdev=11656.45 lat (usec): min=3870, max=91726, avg=17212.71, stdev=11656.49 clat percentiles (usec): | 1.00th=[ 5080], 5.00th=[ 5800], 10.00th=[ 6259], 20.00th=[ 6980], | 30.00th=[ 8356], 40.00th=[10683], 50.00th=[13698], 60.00th=[16909], | 70.00th=[21365], 80.00th=[26608], 90.00th=[33817], 95.00th=[39584], | 99.00th=[53740], 99.50th=[57410], 99.90th=[78119], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 55, max= 400, per=25.44%, avg=132.52, stdev=81.13, samples=94 iops : min= 13, max= 100, avg=32.82, stdev=20.40, samples=94 lat (msec) : 4=1.43%, 10=42.15%, 20=29.20%, 50=26.17%, 100=1.01% lat (msec) : 750=0.03% cpu : usr=0.11%, sys=13.81%, ctx=5774, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183139: Mon May 4 12:55:01 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(6028KiB/48235msec) clat (usec): min=2455, max=84652, avg=13761.57, stdev=10687.06 lat (usec): min=2455, max=84653, avg=13762.15, stdev=10687.10 clat percentiles (usec): | 1.00th=[ 3195], 5.00th=[ 4178], 10.00th=[ 4555], 20.00th=[ 5145], | 30.00th=[ 6063], 40.00th=[ 8094], 50.00th=[10028], 60.00th=[12387], | 70.00th=[16057], 80.00th=[21627], 90.00th=[29230], 95.00th=[34866], | 99.00th=[49021], 99.50th=[53740], 99.90th=[70779], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 47, max= 424, per=25.35%, avg=125.99, stdev=84.95, samples=95 iops : min= 11, max= 106, avg=31.19, stdev=21.36, samples=95 write: IOPS=32, BW=130KiB/s (133kB/s)(6260KiB/48235msec); 0 zone resets clat (msec): min=4, max=579, avg=17.46, stdev=18.49 lat (msec): min=4, max=579, avg=17.47, stdev=18.49 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 27], 90.00th=[ 34], 95.00th=[ 40], | 99.00th=[ 55], 99.50th=[ 66], 99.90th=[ 91], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 48, max= 392, per=25.12%, avg=130.86, stdev=85.66, samples=95 iops : min= 12, max= 98, avg=32.41, stdev=21.52, samples=95 lat (msec) : 4=1.76%, 10=42.51%, 20=27.31%, 50=27.08%, 100=1.30% lat (msec) : 750=0.03% cpu : usr=0.06%, sys=13.48%, ctx=5637, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183140: Mon May 4 12:55:01 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(6052KiB/48134msec) clat (usec): min=2845, max=80636, avg=13949.99, stdev=11186.19 lat (usec): min=2846, max=80637, avg=13950.58, stdev=11186.17 clat percentiles (usec): | 1.00th=[ 3458], 5.00th=[ 4178], 10.00th=[ 4555], 20.00th=[ 5145], | 30.00th=[ 6063], 40.00th=[ 8094], 50.00th=[ 9896], 60.00th=[11994], | 70.00th=[16057], 80.00th=[21890], 90.00th=[30278], 95.00th=[36963], | 99.00th=[51119], 99.50th=[56886], 99.90th=[70779], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 40, max= 392, per=25.17%, avg=125.12, stdev=81.22, samples=94 iops : min= 10, max= 98, avg=30.97, stdev=20.41, samples=94 write: IOPS=32, BW=130KiB/s (133kB/s)(6236KiB/48134msec); 0 zone resets clat (msec): min=4, max=573, avg=17.23, stdev=17.98 lat (msec): min=4, max=573, avg=17.23, stdev=17.98 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 27], 90.00th=[ 33], 95.00th=[ 39], | 99.00th=[ 54], 99.50th=[ 57], 99.90th=[ 74], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 47, max= 392, per=24.73%, avg=128.86, stdev=81.62, samples=94 iops : min= 11, max= 98, avg=31.90, stdev=20.53, samples=94 lat (msec) : 4=1.60%, 10=43.07%, 20=27.08%, 50=26.95%, 100=1.27% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=13.47%, ctx=5676, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=498KiB/s (510kB/s), 124KiB/s-126KiB/s (127kB/s-129kB/s), io=23.4MiB (24.6MB), run=47968-48235msec WRITE: bw=521KiB/s (534kB/s), 130KiB/s-132KiB/s (133kB/s-136kB/s), io=24.6MiB (25.7MB), run=47968-48235msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183169: Mon May 4 12:55:20 2026 read: IOPS=28, BW=453KiB/s (464kB/s)(5920KiB/13075msec) clat (usec): min=39, max=66144, avg=17474.61, stdev=9457.86 lat (usec): min=39, max=66145, avg=17475.20, stdev=9457.86 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 125], 10.00th=[ 8717], 20.00th=[10814], | 30.00th=[12649], 40.00th=[14746], 50.00th=[16581], 60.00th=[18744], | 70.00th=[21627], 80.00th=[23725], 90.00th=[28443], 95.00th=[33162], | 99.00th=[45876], 99.50th=[62653], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 319, max= 608, per=24.86%, avg=444.96, stdev=78.20, samples=25 iops : min= 19, max= 38, avg=27.32, stdev= 4.97, samples=25 write: IOPS=30, BW=487KiB/s (499kB/s)(6368KiB/13075msec); 0 zone resets clat (usec): min=1208, max=77834, avg=16470.54, stdev=11198.94 lat (usec): min=1208, max=77835, avg=16471.61, stdev=11198.95 clat percentiles (usec): | 1.00th=[ 2769], 5.00th=[ 3949], 10.00th=[ 4621], 20.00th=[ 5932], | 30.00th=[ 8717], 40.00th=[11469], 50.00th=[14353], 60.00th=[16909], | 70.00th=[21103], 80.00th=[25560], 90.00th=[31851], 95.00th=[37487], | 99.00th=[52691], 99.50th=[68682], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 287, max= 669, per=25.83%, avg=486.64, stdev=108.49, samples=25 iops : min= 17, max= 41, avg=29.92, stdev= 6.85, samples=25 lat (usec) : 50=0.13%, 100=1.30%, 250=2.34% lat (msec) : 2=0.26%, 4=2.34%, 10=19.01%, 20=41.80%, 50=32.03% lat (msec) : 100=0.78% cpu : usr=0.08%, sys=28.30%, ctx=2816, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183170: Mon May 4 12:55:20 2026 read: IOPS=27, BW=441KiB/s (451kB/s)(5744KiB/13038msec) clat (usec): min=58, max=53840, avg=18114.20, stdev=9077.30 lat (usec): min=59, max=53841, avg=18114.85, stdev=9077.33 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 131], 10.00th=[ 9372], 20.00th=[11731], | 30.00th=[13435], 40.00th=[15926], 50.00th=[17433], 60.00th=[19268], | 70.00th=[21365], 80.00th=[24249], 90.00th=[30016], 95.00th=[33817], | 99.00th=[42730], 99.50th=[49021], 99.90th=[53740], 99.95th=[53740], | 99.99th=[53740] bw ( KiB/s): min= 255, max= 640, per=24.74%, avg=442.80, stdev=91.84, samples=25 iops : min= 15, max= 40, avg=27.20, stdev= 5.81, samples=25 write: IOPS=31, BW=502KiB/s (514kB/s)(6544KiB/13038msec); 0 zone resets clat (usec): min=1589, max=75012, avg=15885.91, stdev=10814.17 lat (usec): min=1591, max=75013, avg=15886.99, stdev=10814.18 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 4293], 10.00th=[ 4686], 20.00th=[ 6063], | 30.00th=[ 8717], 40.00th=[11338], 50.00th=[14091], 60.00th=[15926], | 70.00th=[19530], 80.00th=[23987], 90.00th=[30802], 95.00th=[35914], | 99.00th=[46924], 99.50th=[57410], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 319, max= 736, per=26.26%, avg=494.68, stdev=84.41, samples=25 iops : min= 19, max= 46, avg=30.44, stdev= 5.34, samples=25 lat (usec) : 100=0.52%, 250=2.60% lat (msec) : 2=0.78%, 4=1.30%, 10=19.14%, 20=43.49%, 50=31.51% lat (msec) : 100=0.65% cpu : usr=0.07%, sys=28.62%, ctx=2776, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183171: Mon May 4 12:55:20 2026 read: IOPS=29, BW=468KiB/s (479kB/s)(6256KiB/13374msec) clat (usec): min=80, max=70459, avg=18362.05, stdev=9028.28 lat (usec): min=81, max=70459, avg=18362.69, stdev=9028.29 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 157], 10.00th=[ 9110], 20.00th=[11600], | 30.00th=[13698], 40.00th=[15533], 50.00th=[17433], 60.00th=[20317], | 70.00th=[22414], 80.00th=[24511], 90.00th=[28705], 95.00th=[32375], | 99.00th=[50594], 99.50th=[55313], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 319, max= 638, per=26.02%, avg=465.77, stdev=86.36, samples=26 iops : min= 19, max= 39, avg=28.65, stdev= 5.51, samples=26 write: IOPS=28, BW=451KiB/s (462kB/s)(6032KiB/13374msec); 0 zone resets clat (usec): min=1186, max=82024, avg=16298.70, stdev=11045.45 lat (usec): min=1187, max=82026, avg=16299.85, stdev=11045.47 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 4424], 10.00th=[ 4883], 20.00th=[ 6128], | 30.00th=[ 9634], 40.00th=[11863], 50.00th=[13829], 60.00th=[15926], | 70.00th=[20055], 80.00th=[25035], 90.00th=[32113], 95.00th=[35914], | 99.00th=[50594], 99.50th=[56361], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 223, max= 638, per=23.42%, avg=441.27, stdev=113.81, samples=26 iops : min= 13, max= 39, avg=27.12, stdev= 7.13, samples=26 lat (usec) : 100=0.91%, 250=1.69% lat (msec) : 2=0.52%, 4=0.91%, 10=18.23%, 20=42.19%, 50=34.51% lat (msec) : 100=1.04% cpu : usr=0.07%, sys=28.12%, ctx=2873, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183172: Mon May 4 12:55:20 2026 read: IOPS=29, BW=470KiB/s (481kB/s)(6032KiB/12841msec) clat (usec): min=65, max=67165, avg=17879.62, stdev=9420.28 lat (usec): min=65, max=67166, avg=17880.22, stdev=9420.29 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 124], 10.00th=[ 8717], 20.00th=[11469], | 30.00th=[13566], 40.00th=[15533], 50.00th=[17171], 60.00th=[19268], | 70.00th=[21365], 80.00th=[23987], 90.00th=[28443], 95.00th=[32900], | 99.00th=[49546], 99.50th=[63177], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 319, max= 638, per=26.12%, avg=467.52, stdev=80.18, samples=25 iops : min= 19, max= 39, avg=28.72, stdev= 4.99, samples=25 write: IOPS=30, BW=487KiB/s (499kB/s)(6256KiB/12841msec); 0 zone resets clat (usec): min=1199, max=86345, avg=15553.96, stdev=10782.78 lat (usec): min=1200, max=86346, avg=15555.21, stdev=10782.83 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 4424], 10.00th=[ 5014], 20.00th=[ 5800], | 30.00th=[ 8160], 40.00th=[10159], 50.00th=[12780], 60.00th=[15926], | 70.00th=[19792], 80.00th=[23987], 90.00th=[29492], 95.00th=[35390], | 99.00th=[46400], 99.50th=[51643], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 351, max= 736, per=25.80%, avg=486.16, stdev=96.42, samples=25 iops : min= 21, max= 46, avg=29.92, stdev= 6.05, samples=25 lat (usec) : 100=0.65%, 250=2.99%, 500=0.13% lat (msec) : 2=0.65%, 4=0.39%, 10=21.22%, 20=40.62%, 50=32.55% lat (msec) : 100=0.78% cpu : usr=0.05%, sys=28.25%, ctx=2723, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1791KiB/s (1834kB/s), 441KiB/s-470KiB/s (451kB/s-481kB/s), io=23.4MiB (24.5MB), run=12841-13374msec WRITE: bw=1884KiB/s (1929kB/s), 451KiB/s-502KiB/s (462kB/s-514kB/s), io=24.6MiB (25.8MB), run=12841-13374msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183174: Mon May 4 12:55:22 2026 read: IOPS=24, BW=386KiB/s (395kB/s)(5920KiB/15345msec) clat (usec): min=3195, max=68467, avg=18017.17, stdev=12609.62 lat (usec): min=3196, max=68468, avg=18017.96, stdev=12609.59 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 5211], 10.00th=[ 5800], 20.00th=[ 7701], | 30.00th=[ 9765], 40.00th=[11863], 50.00th=[13173], 60.00th=[16712], | 70.00th=[21890], 80.00th=[28181], 90.00th=[37487], 95.00th=[43254], | 99.00th=[59507], 99.50th=[67634], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 191, max= 960, per=23.87%, avg=372.37, stdev=192.86, samples=30 iops : min= 11, max= 60, avg=22.93, stdev=12.17, samples=30 write: IOPS=25, BW=415KiB/s (425kB/s)(6368KiB/15345msec); 0 zone resets clat (usec): min=5399, max=94711, avg=21575.27, stdev=14420.02 lat (usec): min=5401, max=94712, avg=21576.75, stdev=14420.05 clat percentiles (usec): | 1.00th=[ 5669], 5.00th=[ 7439], 10.00th=[ 8291], 20.00th=[ 9896], | 30.00th=[12518], 40.00th=[13960], 50.00th=[16188], 60.00th=[21103], | 70.00th=[25822], 80.00th=[32113], 90.00th=[40109], 95.00th=[50594], | 99.00th=[78119], 99.50th=[88605], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 192, max= 1088, per=24.88%, avg=408.57, stdev=197.34, samples=30 iops : min= 12, max= 68, avg=25.20, stdev=12.45, samples=30 lat (msec) : 4=1.04%, 10=24.61%, 20=37.50%, 50=33.33%, 100=3.52% cpu : usr=0.03%, sys=13.63%, ctx=1634, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183175: Mon May 4 12:55:22 2026 read: IOPS=23, BW=377KiB/s (386kB/s)(5744KiB/15254msec) clat (usec): min=4444, max=57761, avg=17182.20, stdev=11103.47 lat (usec): min=4445, max=57761, avg=17182.83, stdev=11103.47 clat percentiles (usec): | 1.00th=[ 5080], 5.00th=[ 5735], 10.00th=[ 6587], 20.00th=[ 8717], | 30.00th=[10421], 40.00th=[12125], 50.00th=[13042], 60.00th=[14746], | 70.00th=[19006], 80.00th=[25297], 90.00th=[34341], 95.00th=[40109], | 99.00th=[53216], 99.50th=[57410], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 127, max= 832, per=24.01%, avg=374.63, stdev=162.94, samples=30 iops : min= 7, max= 52, avg=23.07, stdev=10.30, samples=30 write: IOPS=26, BW=429KiB/s (439kB/s)(6544KiB/15254msec); 0 zone resets clat (msec): min=5, max=101, avg=21.99, stdev=14.56 lat (msec): min=5, max=101, avg=21.99, stdev=14.56 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 43], 95.00th=[ 48], | 99.00th=[ 79], 99.50th=[ 89], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 224, max= 1120, per=25.97%, avg=426.37, stdev=220.62, samples=30 iops : min= 14, max= 70, avg=26.30, stdev=13.93, samples=30 lat (msec) : 10=22.66%, 20=41.15%, 50=33.46%, 100=2.60%, 250=0.13% cpu : usr=0.08%, sys=13.97%, ctx=1652, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183176: Mon May 4 12:55:22 2026 read: IOPS=25, BW=409KiB/s (419kB/s)(6256KiB/15285msec) clat (usec): min=4089, max=67663, avg=17462.77, stdev=12001.28 lat (usec): min=4089, max=67664, avg=17463.46, stdev=12001.28 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 5735], 10.00th=[ 6587], 20.00th=[ 8586], | 30.00th=[10421], 40.00th=[11731], 50.00th=[13173], 60.00th=[15270], | 70.00th=[20055], 80.00th=[24511], 90.00th=[34866], 95.00th=[43254], | 99.00th=[60031], 99.50th=[63177], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 224, max= 1120, per=26.13%, avg=407.57, stdev=209.84, samples=30 iops : min= 14, max= 70, avg=25.13, stdev=13.22, samples=30 write: IOPS=24, BW=395KiB/s (404kB/s)(6032KiB/15285msec); 0 zone resets clat (msec): min=5, max=100, avg=22.16, stdev=14.86 lat (msec): min=5, max=100, avg=22.16, stdev=14.86 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 51], | 99.00th=[ 70], 99.50th=[ 100], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 223, max= 1056, per=23.65%, avg=388.40, stdev=199.18, samples=30 iops : min= 13, max= 66, avg=23.93, stdev=12.58, samples=30 lat (msec) : 10=22.79%, 20=41.28%, 50=31.77%, 100=4.04%, 250=0.13% cpu : usr=0.08%, sys=13.64%, ctx=1676, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183177: Mon May 4 12:55:22 2026 read: IOPS=24, BW=397KiB/s (407kB/s)(6032KiB/15180msec) clat (usec): min=4070, max=66276, avg=17012.50, stdev=11744.93 lat (usec): min=4070, max=66277, avg=17013.15, stdev=11744.91 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 5669], 10.00th=[ 6194], 20.00th=[ 7898], | 30.00th=[10028], 40.00th=[11207], 50.00th=[12780], 60.00th=[15795], | 70.00th=[19268], 80.00th=[24511], 90.00th=[32900], 95.00th=[43254], | 99.00th=[59507], 99.50th=[64226], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 159, max= 1120, per=25.43%, avg=396.67, stdev=209.42, samples=30 iops : min= 9, max= 70, avg=24.43, stdev=13.24, samples=30 write: IOPS=25, BW=412KiB/s (422kB/s)(6256KiB/15180msec); 0 zone resets clat (usec): min=6462, max=98084, avg=22160.72, stdev=13445.67 lat (usec): min=6465, max=98085, avg=22162.41, stdev=13445.55 clat percentiles (usec): | 1.00th=[ 6915], 5.00th=[ 7701], 10.00th=[ 8848], 20.00th=[11076], | 30.00th=[13173], 40.00th=[15139], 50.00th=[18220], 60.00th=[21890], | 70.00th=[26346], 80.00th=[32637], 90.00th=[42730], 95.00th=[50594], | 99.00th=[58459], 99.50th=[65799], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 192, max= 992, per=25.22%, avg=414.10, stdev=188.34, samples=30 iops : min= 12, max= 62, avg=25.53, stdev=11.86, samples=30 lat (msec) : 10=22.79%, 20=40.89%, 50=32.29%, 100=4.04% cpu : usr=0.08%, sys=13.83%, ctx=1608, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1561KiB/s (1598kB/s), 377KiB/s-409KiB/s (386kB/s-419kB/s), io=23.4MiB (24.5MB), run=15180-15345msec WRITE: bw=1642KiB/s (1682kB/s), 395KiB/s-429KiB/s (404kB/s-439kB/s), io=24.6MiB (25.8MB), run=15180-15345msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183187: Mon May 4 12:55:31 2026 read: IOPS=3, BW=3315KiB/s (3395kB/s)(7168KiB/2162msec) clat (usec): min=517, max=200797, avg=103648.96, stdev=77955.92 lat (usec): min=518, max=200798, avg=103650.39, stdev=77955.67 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 611], | 30.00th=[105382], 40.00th=[105382], 50.00th=[115868], 60.00th=[127402], | 70.00th=[127402], 80.00th=[175113], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 2048, max= 6119, per=60.54%, avg=4087.67, stdev=2035.51, samples=3 iops : min= 2, max= 5, avg= 3.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2368KiB/s (2425kB/s)(5120KiB/2162msec); 0 zone resets clat (msec): min=156, max=616, avg=280.12, stdev=195.77 lat (msec): min=156, max=616, avg=280.18, stdev=195.78 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 4096, max= 4096, per=43.33%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 lat (usec) : 750=16.67% lat (msec) : 250=66.67%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=48.91%, ctx=656, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183189: Mon May 4 12:55:31 2026 read: IOPS=0, BW=675KiB/s (691kB/s)(2048KiB/3033msec) clat (msec): min=104, max=168, avg=136.84, stdev=45.06 lat (msec): min=104, max=168, avg=136.84, stdev=45.06 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 169], 95.00th=[ 169], | 99.00th=[ 169], 99.50th=[ 169], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 2023, max= 2048, per=30.15%, avg=2035.50, stdev=17.68, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3376KiB/s (3457kB/s)(10.0MiB/3033msec); 0 zone resets clat (msec): min=116, max=652, avg=274.43, stdev=184.22 lat (msec): min=116, max=652, avg=274.51, stdev=184.23 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 148], | 30.00th=[ 153], 40.00th=[ 163], 50.00th=[ 186], 60.00th=[ 188], | 70.00th=[ 215], 80.00th=[ 418], 90.00th=[ 510], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 3806, max= 6131, per=49.48%, avg=4677.67, stdev=1266.95, samples=3 iops : min= 3, max= 5, avg= 4.00, stdev= 1.00, samples=3 lat (msec) : 250=75.00%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=41.56%, ctx=460, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183190: Mon May 4 12:55:31 2026 read: IOPS=2, BW=2421KiB/s (2479kB/s)(6144KiB/2538msec) clat (usec): min=534, max=435019, avg=151015.74, stdev=160952.61 lat (usec): min=535, max=435020, avg=151016.88, stdev=160952.21 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[130548], 50.00th=[130548], 60.00th=[133694], | 70.00th=[204473], 80.00th=[204473], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 2048, max= 4096, per=49.12%, avg=3316.67, stdev=1108.22, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2421KiB/s (2479kB/s)(6144KiB/2538msec); 0 zone resets clat (msec): min=152, max=376, avg=261.15, stdev=102.52 lat (msec): min=152, max=376, avg=261.22, stdev=102.50 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 334], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1374, max= 4096, per=24.92%, avg=2355.25, stdev=1196.10, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=45.68%, ctx=520, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183192: Mon May 4 12:55:31 2026 read: IOPS=1, BW=1950KiB/s (1997kB/s)(5120KiB/2625msec) clat (usec): min=625, max=321067, avg=91112.95, stdev=137831.77 lat (usec): min=627, max=321068, avg=91114.24, stdev=137831.53 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 627], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 13960], 60.00th=[ 13960], | 70.00th=[119014], 80.00th=[119014], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7613, max= 7613, per=100.00%, avg=7613.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2731KiB/s (2796kB/s)(7168KiB/2625msec); 0 zone resets clat (msec): min=133, max=739, avg=299.55, stdev=209.64 lat (msec): min=133, max=739, avg=299.61, stdev=209.63 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 161], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 234], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 342], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 2748, max= 4096, per=36.20%, avg=3422.00, stdev=953.18, samples=2 iops : min= 2, max= 4, avg= 3.00, stdev= 1.41, samples=2 lat (usec) : 750=16.67% lat (msec) : 20=8.33%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=41.96%, ctx=438, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6752KiB/s (6914kB/s), 675KiB/s-3315KiB/s (691kB/s-3395kB/s), io=20.0MiB (20.0MB), run=2162-3033msec WRITE: bw=9453KiB/s (9680kB/s), 2368KiB/s-3376KiB/s (2425kB/s-3457kB/s), io=28.0MiB (29.4MB), run=2162-3033msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183186: Mon May 4 12:55:31 2026 read: IOPS=3, BW=3663KiB/s (3751kB/s)(7168KiB/1957msec) clat (msec): min=47, max=456, avg=180.52, stdev=149.21 lat (msec): min=47, max=456, avg=180.53, stdev=149.21 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 58], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 130], 60.00th=[ 138], | 70.00th=[ 138], 80.00th=[ 313], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2043, max= 6131, per=61.51%, avg=4090.00, stdev=2044.01, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=2, BW=2616KiB/s (2679kB/s)(5120KiB/1957msec); 0 zone resets clat (msec): min=45, max=278, avg=136.87, stdev=101.07 lat (msec): min=45, max=278, avg=136.95, stdev=101.07 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 85], 60.00th=[ 85], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 2048, max= 8175, per=54.91%, avg=5111.50, stdev=4332.44, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 lat (msec) : 50=16.67%, 100=25.00%, 250=33.33%, 500=25.00% cpu : usr=0.00%, sys=13.96%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183188: Mon May 4 12:55:31 2026 read: IOPS=0, BW=665KiB/s (681kB/s)(2048KiB/3080msec) clat (msec): min=147, max=188, avg=168.00, stdev=29.29 lat (msec): min=147, max=188, avg=168.00, stdev=29.29 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 1383, max= 1984, per=25.32%, avg=1683.50, stdev=424.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3325KiB/s (3404kB/s)(10.0MiB/3080msec); 0 zone resets clat (msec): min=66, max=533, avg=268.19, stdev=158.09 lat (msec): min=66, max=533, avg=268.29, stdev=158.09 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 113], | 30.00th=[ 136], 40.00th=[ 157], 50.00th=[ 215], 60.00th=[ 268], | 70.00th=[ 368], 80.00th=[ 372], 90.00th=[ 456], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 2027, max= 5953, per=42.30%, avg=3937.50, stdev=1612.39, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.06%, sys=21.08%, ctx=168, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183191: Mon May 4 12:55:31 2026 read: IOPS=2, BW=2202KiB/s (2255kB/s)(6144KiB/2790msec) clat (msec): min=35, max=489, avg=239.97, stdev=180.10 lat (msec): min=35, max=489, avg=239.97, stdev=180.10 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 50], | 30.00th=[ 50], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 334], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1841, max= 2043, per=29.63%, avg=1970.33, stdev=112.29, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 write: IOPS=2, BW=2202KiB/s (2255kB/s)(6144KiB/2790msec); 0 zone resets clat (msec): min=49, max=358, avg=221.92, stdev=99.51 lat (msec): min=49, max=358, avg=222.00, stdev=99.51 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 243], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2027, max= 2782, per=24.54%, avg=2284.00, stdev=431.35, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 50=25.00%, 250=41.67%, 500=33.33% cpu : usr=0.04%, sys=20.26%, ctx=127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183193: Mon May 4 12:55:31 2026 read: IOPS=1, BW=1699KiB/s (1740kB/s)(5120KiB/3013msec) clat (msec): min=43, max=540, avg=278.81, stdev=238.21 lat (msec): min=43, max=540, avg=278.81, stdev=238.21 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 44], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 3683, max= 3968, per=57.53%, avg=3825.50, stdev=201.53, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2379KiB/s (2436kB/s)(7168KiB/3013msec); 0 zone resets clat (msec): min=44, max=695, avg=224.71, stdev=218.84 lat (msec): min=44, max=695, avg=224.78, stdev=218.84 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 110], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 153], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 259], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1984, max= 2801, per=23.78%, avg=2213.75, stdev=392.29, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 50=16.67%, 100=8.33%, 250=41.67%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=13.88%, ctx=347, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6649KiB/s (6809kB/s), 665KiB/s-3663KiB/s (681kB/s-3751kB/s), io=20.0MiB (20.0MB), run=1957-3080msec WRITE: bw=9309KiB/s (9533kB/s), 2202KiB/s-3325KiB/s (2255kB/s-3404kB/s), io=28.0MiB (29.4MB), run=1957-3080msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183204: Mon May 4 12:55:40 2026 read: IOPS=2, BW=9548KiB/s (9777kB/s)(12.0MiB/1287msec) clat (msec): min=388, max=441, avg=417.07, stdev=26.79 lat (msec): min=388, max=441, avg=417.08, stdev=26.79 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 5483, max= 8192, per=67.48%, avg=6837.50, stdev=1915.55, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=54.74%, ctx=2848, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183205: Mon May 4 12:55:40 2026 read: IOPS=0, BW=2533KiB/s (2594kB/s)(4096KiB/1617msec) clat (nsec): min=393932k, max=393932k, avg=393931591.00, stdev= 0.00 lat (nsec): min=393934k, max=393934k, avg=393934128.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 5673, max= 5673, per=55.99%, avg=5673.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5066KiB/s (5188kB/s)(8192KiB/1617msec); 0 zone resets clat (usec): min=595107, max=595688, avg=595397.81, stdev=411.04 lat (usec): min=595467, max=595992, avg=595730.07, stdev=371.41 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8192, max= 8192, per=41.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.12%, sys=17.20%, ctx=935, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183206: Mon May 4 12:55:40 2026 write: IOPS=1, BW=7628KiB/s (7811kB/s)(12.0MiB/1611msec); 0 zone resets clat (msec): min=185, max=918, avg=531.79, stdev=368.39 lat (msec): min=185, max=919, avg=532.11, stdev=368.38 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8192, max= 8192, per=41.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.06%, sys=14.47%, ctx=39, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183207: Mon May 4 12:55:40 2026 write: IOPS=1, BW=7461KiB/s (7640kB/s)(12.0MiB/1647msec); 0 zone resets clat (msec): min=161, max=1120, avg=544.91, stdev=507.32 lat (msec): min=161, max=1120, avg=545.20, stdev=507.35 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8110, max= 8126, per=40.80%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=17.62%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9.89MiB/s (10.4MB/s), 2533KiB/s-9548KiB/s (2594kB/s-9777kB/s), io=16.0MiB (16.8MB), run=1287-1617msec WRITE: bw=19.4MiB/s (20.4MB/s), 5066KiB/s-7628KiB/s (5188kB/s-7811kB/s), io=32.0MiB (33.6MB), run=1611-1647msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183199: Mon May 4 12:55:40 2026 read: IOPS=2, BW=8264KiB/s (8462kB/s)(12.0MiB/1487msec) clat (msec): min=157, max=684, avg=485.72, stdev=286.34 lat (msec): min=157, max=684, avg=485.72, stdev=286.33 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7406, max= 8192, per=71.50%, avg=7799.00, stdev=555.79, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.07%, sys=16.22%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183200: Mon May 4 12:55:40 2026 read: IOPS=0, BW=2727KiB/s (2792kB/s)(4096KiB/1502msec) clat (nsec): min=427075k, max=427075k, avg=427074908.00, stdev= 0.00 lat (nsec): min=427076k, max=427076k, avg=427075968.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7393, max= 7393, per=67.78%, avg=7393.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5454KiB/s (5585kB/s)(8192KiB/1502msec); 0 zone resets clat (msec): min=458, max=585, avg=521.95, stdev=90.08 lat (msec): min=458, max=585, avg=522.26, stdev=90.13 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8192, max= 8192, per=48.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=19.17%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183201: Mon May 4 12:55:40 2026 write: IOPS=1, BW=6308KiB/s (6459kB/s)(12.0MiB/1948msec); 0 zone resets clat (msec): min=64, max=1512, avg=638.34, stdev=769.14 lat (msec): min=64, max=1512, avg=638.61, stdev=769.21 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 65], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8192, max= 8192, per=48.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.86%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183202: Mon May 4 12:55:40 2026 write: IOPS=1, BW=8132KiB/s (8328kB/s)(12.0MiB/1511msec); 0 zone resets clat (msec): min=115, max=1010, avg=491.90, stdev=464.13 lat (msec): min=115, max=1010, avg=492.21, stdev=464.11 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min=14867, max=14867, per=88.38%, avg=14867.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.07%, sys=15.76%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.7MiB/s (11.2MB/s), 2727KiB/s-8264KiB/s (2792kB/s-8462kB/s), io=16.0MiB (16.8MB), run=1487-1502msec WRITE: bw=16.4MiB/s (17.2MB/s), 5454KiB/s-8132KiB/s (5585kB/s-8328kB/s), io=32.0MiB (33.6MB), run=1502-1948msec