== sanity test 398b: DIO and buffer IO race ============== 06:58:25 (1778929105) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.87923 s, 17.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147536: Sat May 16 06:59:29 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(5992KiB/54998msec) clat (usec): min=30, max=526413, avg=18091.67, stdev=18007.81 lat (usec): min=31, max=526414, avg=18099.17, stdev=18009.57 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 108], 10.00th=[ 7308], 20.00th=[ 9634], | 30.00th=[ 11338], 40.00th=[ 13173], 50.00th=[ 15008], 60.00th=[ 17433], | 70.00th=[ 21103], 80.00th=[ 25560], 90.00th=[ 32113], 95.00th=[ 38536], | 99.00th=[ 61604], 99.50th=[ 81265], 99.90th=[122160], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 14, max= 192, per=25.35%, avg=108.50, stdev=30.26, samples=109 iops : min= 3, max= 48, avg=26.73, stdev= 7.53, samples=109 write: IOPS=28, BW=114KiB/s (117kB/s)(6296KiB/54998msec); 0 zone resets clat (usec): min=882, max=157689, avg=17580.19, stdev=15815.39 lat (usec): min=883, max=157690, avg=17581.57, stdev=15815.42 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1778], 10.00th=[ 2376], 20.00th=[ 3392], | 30.00th=[ 5538], 40.00th=[ 10290], 50.00th=[ 14091], 60.00th=[ 18220], | 70.00th=[ 23200], 80.00th=[ 28967], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 64750], 99.50th=[ 82314], 99.90th=[156238], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 47, max= 207, per=25.69%, avg=115.07, stdev=30.85, samples=108 iops : min= 11, max= 51, avg=28.38, stdev= 7.74, samples=108 lat (usec) : 50=0.26%, 100=1.82%, 250=1.53%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=3.29%, 4=8.72%, 10=14.45%, 20=34.93%, 50=32.13% lat (msec) : 100=2.21%, 250=0.23%, 750=0.03% cpu : usr=0.15%, sys=19.12%, ctx=7977, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147537: Sat May 16 06:59:29 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(5940KiB/55595msec) clat (usec): min=35, max=240818, avg=18218.74, stdev=13947.84 lat (usec): min=36, max=240818, avg=18220.00, stdev=13947.79 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 106], 10.00th=[ 7439], 20.00th=[ 9765], | 30.00th=[ 11469], 40.00th=[ 13042], 50.00th=[ 15270], 60.00th=[ 18220], | 70.00th=[ 20841], 80.00th=[ 25822], 90.00th=[ 32637], 95.00th=[ 39584], | 99.00th=[ 68682], 99.50th=[ 80217], 99.90th=[131597], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 174, per=24.83%, avg=106.28, stdev=28.79, samples=110 iops : min= 1, max= 43, avg=26.17, stdev= 7.21, samples=110 write: IOPS=28, BW=114KiB/s (117kB/s)(6348KiB/55595msec); 0 zone resets clat (usec): min=897, max=557811, avg=17829.59, stdev=20519.57 lat (usec): min=898, max=557812, avg=17833.35, stdev=20521.41 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1795], 10.00th=[ 2343], 20.00th=[ 3490], | 30.00th=[ 5735], 40.00th=[ 10290], 50.00th=[ 14091], 60.00th=[ 17695], | 70.00th=[ 22676], 80.00th=[ 28967], 90.00th=[ 39060], 95.00th=[ 49546], | 99.00th=[ 65799], 99.50th=[ 71828], 99.90th=[143655], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 182, per=25.25%, avg=113.12, stdev=29.68, samples=110 iops : min= 1, max= 45, avg=27.88, stdev= 7.45, samples=110 lat (usec) : 50=0.39%, 100=1.86%, 250=1.04%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=3.26%, 4=8.79%, 10=15.36%, 20=34.44%, 50=31.12% lat (msec) : 100=3.32%, 250=0.16%, 750=0.03% cpu : usr=0.13%, sys=18.93%, ctx=7811, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147539: Sat May 16 06:59:29 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(6028KiB/55730msec) clat (usec): min=37, max=581811, avg=17859.81, stdev=18361.57 lat (usec): min=37, max=581812, avg=17861.04, stdev=18361.59 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 98], 10.00th=[ 6980], 20.00th=[ 9634], | 30.00th=[ 11338], 40.00th=[ 13173], 50.00th=[ 15533], 60.00th=[ 18220], | 70.00th=[ 21627], 80.00th=[ 25560], 90.00th=[ 31327], 95.00th=[ 36439], | 99.00th=[ 51643], 99.50th=[ 62653], 99.90th=[125305], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 47, max= 200, per=25.27%, avg=108.17, stdev=30.07, samples=109 iops : min= 11, max= 50, avg=26.64, stdev= 7.55, samples=109 write: IOPS=28, BW=112KiB/s (115kB/s)(6260KiB/55730msec); 0 zone resets clat (usec): min=788, max=162030, avg=18268.56, stdev=17236.50 lat (usec): min=789, max=162031, avg=18270.12, stdev=17236.52 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1713], 10.00th=[ 2311], 20.00th=[ 3425], | 30.00th=[ 5342], 40.00th=[ 10290], 50.00th=[ 14353], 60.00th=[ 18744], | 70.00th=[ 23987], 80.00th=[ 29492], 90.00th=[ 40109], 95.00th=[ 49021], | 99.00th=[ 74974], 99.50th=[105382], 99.90th=[141558], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 22, max= 192, per=24.81%, avg=111.15, stdev=29.35, samples=110 iops : min= 5, max= 48, avg=27.39, stdev= 7.35, samples=110 lat (usec) : 50=0.10%, 100=2.51%, 250=1.24%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=3.48%, 4=8.50%, 10=14.55%, 20=33.95%, 50=32.32% lat (msec) : 100=2.70%, 250=0.33%, 750=0.03% cpu : usr=0.11%, sys=19.19%, ctx=7947, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147541: Sat May 16 06:59:29 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(6052KiB/56019msec) clat (usec): min=21, max=561284, avg=18756.99, stdev=19423.04 lat (usec): min=21, max=561286, avg=18758.20, stdev=19423.11 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 101], 10.00th=[ 6652], 20.00th=[ 9765], | 30.00th=[ 11863], 40.00th=[ 13566], 50.00th=[ 15401], 60.00th=[ 18482], | 70.00th=[ 22152], 80.00th=[ 26346], 90.00th=[ 32900], 95.00th=[ 39584], | 99.00th=[ 70779], 99.50th=[ 83362], 99.90th=[145753], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 47, max= 183, per=25.22%, avg=107.95, stdev=27.69, samples=110 iops : min= 11, max= 45, avg=26.60, stdev= 6.99, samples=110 write: IOPS=27, BW=111KiB/s (114kB/s)(6236KiB/56019msec); 0 zone resets clat (usec): min=798, max=125292, avg=17589.68, stdev=15415.76 lat (usec): min=799, max=125294, avg=17591.26, stdev=15415.86 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1778], 10.00th=[ 2343], 20.00th=[ 3621], | 30.00th=[ 6128], 40.00th=[ 10290], 50.00th=[ 14222], 60.00th=[ 18220], | 70.00th=[ 23200], 80.00th=[ 29230], 90.00th=[ 39584], 95.00th=[ 45351], | 99.00th=[ 63177], 99.50th=[ 80217], 99.90th=[116917], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 29, max= 192, per=24.68%, avg=110.59, stdev=31.67, samples=111 iops : min= 7, max= 48, avg=27.25, stdev= 7.93, samples=111 lat (usec) : 50=0.55%, 100=1.89%, 250=1.79%, 500=0.29%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=3.45%, 4=7.81%, 10=14.23%, 20=34.18%, 50=32.62% lat (msec) : 100=2.77%, 250=0.23%, 750=0.03% cpu : usr=0.14%, sys=18.94%, ctx=7991, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=429KiB/s (439kB/s), 107KiB/s-109KiB/s (109kB/s-112kB/s), io=23.4MiB (24.6MB), run=54998-56019msec WRITE: bw=449KiB/s (460kB/s), 111KiB/s-114KiB/s (114kB/s-117kB/s), io=24.6MiB (25.7MB), run=54998-56019msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147538: Sat May 16 07:00:22 2026 read: IOPS=13, BW=55.5KiB/s (56.8kB/s)(5992KiB/107944msec) clat (msec): min=4, max=538, avg=16.66, stdev=20.03 lat (msec): min=4, max=538, avg=16.66, stdev=20.03 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 82], 99.50th=[ 97], 99.90th=[ 176], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 151, per=25.45%, avg=55.98, stdev=30.49, samples=212 iops : min= 1, max= 37, avg=13.59, stdev= 7.65, samples=212 write: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6296KiB/107944msec); 0 zone resets clat (msec): min=16, max=246, avg=52.58, stdev=24.25 lat (msec): min=16, max=246, avg=52.58, stdev=24.25 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 46], 60.00th=[ 52], | 70.00th=[ 59], 80.00th=[ 68], 90.00th=[ 85], 95.00th=[ 100], | 99.00th=[ 134], 99.50th=[ 150], 99.90th=[ 228], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 16, max= 111, per=25.21%, avg=58.22, stdev=23.00, samples=214 iops : min= 4, max= 27, avg=14.15, stdev= 5.80, samples=214 lat (msec) : 10=21.13%, 20=16.41%, 50=39.06%, 100=20.77%, 250=2.60% lat (msec) : 750=0.03% cpu : usr=0.08%, sys=4.70%, ctx=5864, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147540: Sat May 16 07:00:22 2026 read: IOPS=13, BW=54.6KiB/s (55.9kB/s)(5940KiB/108749msec) clat (msec): min=3, max=582, avg=17.26, stdev=21.27 lat (msec): min=3, max=582, avg=17.26, stdev=21.27 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 45], | 99.00th=[ 79], 99.50th=[ 97], 99.90th=[ 174], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 151, per=24.92%, avg=54.82, stdev=30.86, samples=214 iops : min= 1, max= 37, avg=13.30, stdev= 7.76, samples=214 write: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6348KiB/108749msec); 0 zone resets clat (msec): min=16, max=209, avg=52.23, stdev=22.83 lat (msec): min=16, max=209, avg=52.23, stdev=22.83 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 58], 80.00th=[ 68], 90.00th=[ 82], 95.00th=[ 95], | 99.00th=[ 129], 99.50th=[ 146], 99.90th=[ 203], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 15, max= 112, per=25.18%, avg=58.18, stdev=23.00, samples=215 iops : min= 3, max= 28, avg=14.14, stdev= 5.80, samples=215 lat (msec) : 4=0.03%, 10=19.86%, 20=16.60%, 50=39.00%, 100=22.27% lat (msec) : 250=2.21%, 750=0.03% cpu : usr=0.07%, sys=4.66%, ctx=5874, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147542: Sat May 16 07:00:22 2026 read: IOPS=13, BW=55.9KiB/s (57.2kB/s)(6028KiB/107865msec) clat (msec): min=3, max=174, avg=16.81, stdev=14.20 lat (msec): min=3, max=174, avg=16.81, stdev=14.20 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 46], | 99.00th=[ 70], 99.50th=[ 81], 99.90th=[ 108], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 7, max= 152, per=25.47%, avg=56.03, stdev=29.90, samples=212 iops : min= 1, max= 38, avg=13.60, stdev= 7.54, samples=212 write: IOPS=14, BW=58.0KiB/s (59.4kB/s)(6260KiB/107865msec); 0 zone resets clat (msec): min=17, max=611, avg=52.59, stdev=26.97 lat (msec): min=17, max=611, avg=52.59, stdev=26.97 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 38], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 59], 80.00th=[ 69], 90.00th=[ 83], 95.00th=[ 97], | 99.00th=[ 126], 99.50th=[ 150], 99.90th=[ 249], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 15, max= 111, per=25.03%, avg=57.83, stdev=23.07, samples=213 iops : min= 3, max= 27, avg=14.05, stdev= 5.81, samples=213 lat (msec) : 4=0.07%, 10=20.35%, 20=16.05%, 50=39.29%, 100=22.01% lat (msec) : 250=2.21%, 750=0.03% cpu : usr=0.07%, sys=4.82%, ctx=5874, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147543: Sat May 16 07:00:22 2026 read: IOPS=14, BW=56.4KiB/s (57.8kB/s)(6052KiB/107226msec) clat (msec): min=3, max=213, avg=16.31, stdev=14.12 lat (msec): min=3, max=213, avg=16.31, stdev=14.12 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 43], | 99.00th=[ 67], 99.50th=[ 81], 99.90th=[ 105], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 7, max= 152, per=25.87%, avg=56.91, stdev=30.73, samples=210 iops : min= 1, max= 38, avg=13.83, stdev= 7.68, samples=210 write: IOPS=14, BW=58.2KiB/s (59.6kB/s)(6236KiB/107226msec); 0 zone resets clat (msec): min=19, max=612, avg=52.80, stdev=27.50 lat (msec): min=19, max=612, avg=52.80, stdev=27.50 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 30], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 53], | 70.00th=[ 59], 80.00th=[ 69], 90.00th=[ 83], 95.00th=[ 94], | 99.00th=[ 131], 99.50th=[ 165], 99.90th=[ 253], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 15, max= 111, per=25.14%, avg=58.07, stdev=22.73, samples=212 iops : min= 3, max= 27, avg=14.11, stdev= 5.73, samples=212 lat (msec) : 4=0.07%, 10=21.32%, 20=15.30%, 50=39.71%, 100=21.65% lat (msec) : 250=1.89%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=4.70%, ctx=5770, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=221KiB/s (226kB/s), 54.6KiB/s-56.4KiB/s (55.9kB/s-57.8kB/s), io=23.4MiB (24.6MB), run=107226-108749msec WRITE: bw=231KiB/s (237kB/s), 58.0KiB/s-58.4KiB/s (59.4kB/s-59.8kB/s), io=24.6MiB (25.7MB), run=107226-108749msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147574: Sat May 16 07:00:40 2026 read: IOPS=29, BW=467KiB/s (478kB/s)(5920KiB/12682msec) clat (usec): min=32, max=78485, avg=17327.57, stdev=13174.12 lat (usec): min=32, max=78487, avg=17328.67, stdev=13174.12 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 84], 10.00th=[ 108], 20.00th=[ 1434], | 30.00th=[11600], 40.00th=[14222], 50.00th=[16581], 60.00th=[19268], | 70.00th=[22152], 80.00th=[25560], 90.00th=[31589], 95.00th=[39060], | 99.00th=[62653], 99.50th=[71828], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 318, max= 768, per=24.75%, avg=467.12, stdev=117.58, samples=25 iops : min= 19, max= 48, avg=28.72, stdev= 7.57, samples=25 write: IOPS=31, BW=502KiB/s (514kB/s)(6368KiB/12682msec); 0 zone resets clat (usec): min=1231, max=111817, avg=15540.19, stdev=14313.97 lat (usec): min=1233, max=111818, avg=15542.33, stdev=14313.76 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2442], 10.00th=[ 3261], 20.00th=[ 4113], | 30.00th=[ 5145], 40.00th=[ 7373], 50.00th=[ 10945], 60.00th=[ 14746], | 70.00th=[ 20841], 80.00th=[ 25560], 90.00th=[ 33817], 95.00th=[ 42206], | 99.00th=[ 66847], 99.50th=[ 82314], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 223, max= 800, per=25.38%, avg=504.08, stdev=150.25, samples=25 iops : min= 13, max= 50, avg=31.04, stdev= 9.55, samples=25 lat (usec) : 50=0.39%, 100=3.26%, 250=5.34%, 500=0.52% lat (msec) : 2=1.56%, 4=8.46%, 10=17.32%, 20=28.78%, 50=31.77% lat (msec) : 100=2.47%, 250=0.13% cpu : usr=0.14%, sys=22.81%, ctx=2047, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147575: Sat May 16 07:00:40 2026 read: IOPS=28, BW=455KiB/s (466kB/s)(5744KiB/12623msec) clat (usec): min=40, max=116101, avg=18061.32, stdev=13594.36 lat (usec): min=40, max=116103, avg=18068.18, stdev=13595.82 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 84], 10.00th=[ 103], 20.00th=[ 9241], | 30.00th=[ 12256], 40.00th=[ 14353], 50.00th=[ 16450], 60.00th=[ 19530], | 70.00th=[ 22938], 80.00th=[ 27919], 90.00th=[ 34341], 95.00th=[ 40109], | 99.00th=[ 54264], 99.50th=[ 69731], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 285, max= 672, per=24.38%, avg=460.08, stdev=113.96, samples=24 iops : min= 17, max= 42, avg=28.25, stdev= 7.30, samples=24 write: IOPS=32, BW=518KiB/s (531kB/s)(6544KiB/12623msec); 0 zone resets clat (usec): min=1034, max=87823, avg=14843.45, stdev=14024.70 lat (usec): min=1035, max=87825, avg=14845.68, stdev=14024.62 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2409], 10.00th=[ 3228], 20.00th=[ 4178], | 30.00th=[ 5342], 40.00th=[ 7177], 50.00th=[ 9634], 60.00th=[13173], | 70.00th=[17171], 80.00th=[25560], 90.00th=[34866], 95.00th=[39584], | 99.00th=[66323], 99.50th=[70779], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 191, max= 832, per=25.96%, avg=515.58, stdev=155.92, samples=24 iops : min= 11, max= 52, avg=31.75, stdev= 9.94, samples=24 lat (usec) : 50=0.13%, 100=4.04%, 250=4.04%, 500=0.52% lat (msec) : 2=1.43%, 4=8.07%, 10=18.88%, 20=30.34%, 50=29.69% lat (msec) : 100=2.73%, 250=0.13% cpu : usr=0.17%, sys=22.69%, ctx=2025, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147576: Sat May 16 07:00:40 2026 read: IOPS=30, BW=493KiB/s (505kB/s)(6256KiB/12688msec) clat (usec): min=41, max=74099, avg=16438.13, stdev=12560.91 lat (usec): min=41, max=74100, avg=16439.69, stdev=12560.61 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 81], 10.00th=[ 102], 20.00th=[ 204], | 30.00th=[11207], 40.00th=[13960], 50.00th=[15926], 60.00th=[18744], | 70.00th=[21103], 80.00th=[26346], 90.00th=[33817], 95.00th=[38536], | 99.00th=[51119], 99.50th=[51119], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 287, max= 928, per=26.29%, avg=496.08, stdev=153.45, samples=25 iops : min= 17, max= 58, avg=30.56, stdev= 9.79, samples=25 write: IOPS=29, BW=475KiB/s (487kB/s)(6032KiB/12688msec); 0 zone resets clat (usec): min=1496, max=98184, avg=16499.50, stdev=14064.58 lat (usec): min=1497, max=98186, avg=16501.56, stdev=14064.77 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2802], 10.00th=[ 3326], 20.00th=[ 4113], | 30.00th=[ 6128], 40.00th=[ 9372], 50.00th=[13042], 60.00th=[16188], | 70.00th=[21365], 80.00th=[26870], 90.00th=[34866], 95.00th=[43779], | 99.00th=[65274], 99.50th=[84411], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 254, max= 896, per=23.91%, avg=474.76, stdev=155.76, samples=25 iops : min= 15, max= 56, avg=29.20, stdev= 9.84, samples=25 lat (usec) : 50=0.65%, 100=4.17%, 250=5.86%, 500=1.30%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.30%, 4=7.42%, 10=13.28%, 20=31.77%, 50=31.77% lat (msec) : 100=2.08% cpu : usr=0.16%, sys=22.43%, ctx=1995, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147577: Sat May 16 07:00:40 2026 read: IOPS=30, BW=488KiB/s (500kB/s)(6032KiB/12353msec) clat (usec): min=34, max=96237, avg=16540.98, stdev=14125.94 lat (usec): min=34, max=96239, avg=16541.94, stdev=14125.93 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 64], 10.00th=[ 88], 20.00th=[ 167], | 30.00th=[10552], 40.00th=[12911], 50.00th=[15926], 60.00th=[19006], | 70.00th=[21890], 80.00th=[25822], 90.00th=[31589], 95.00th=[38011], | 99.00th=[73925], 99.50th=[92799], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 320, max= 823, per=25.98%, avg=490.33, stdev=122.05, samples=24 iops : min= 20, max= 51, avg=30.17, stdev= 7.68, samples=24 write: IOPS=31, BW=506KiB/s (519kB/s)(6256KiB/12353msec); 0 zone resets clat (usec): min=1016, max=73505, avg=15383.92, stdev=14526.78 lat (usec): min=1016, max=73508, avg=15385.86, stdev=14526.89 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1909], 10.00th=[ 2737], 20.00th=[ 3785], | 30.00th=[ 5080], 40.00th=[ 6849], 50.00th=[10290], 60.00th=[14222], | 70.00th=[19006], 80.00th=[25560], 90.00th=[36963], 95.00th=[44827], | 99.00th=[71828], 99.50th=[72877], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 255, max= 768, per=25.81%, avg=512.58, stdev=133.59, samples=24 iops : min= 15, max= 48, avg=31.54, stdev= 8.60, samples=24 lat (usec) : 50=0.65%, 100=5.47%, 250=5.21%, 500=0.65%, 1000=0.13% lat (msec) : 2=3.26%, 4=8.07%, 10=15.76%, 20=28.13%, 50=29.82% lat (msec) : 100=2.86% cpu : usr=0.10%, sys=22.51%, ctx=1986, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1888KiB/s (1933kB/s), 455KiB/s-493KiB/s (466kB/s-505kB/s), io=23.4MiB (24.5MB), run=12353-12688msec WRITE: bw=1986KiB/s (2034kB/s), 475KiB/s-518KiB/s (487kB/s-531kB/s), io=24.6MiB (25.8MB), run=12353-12688msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147579: Sat May 16 07:00:58 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5920KiB/30384msec) clat (usec): min=5302, max=99699, avg=20483.63, stdev=15636.17 lat (usec): min=5304, max=99700, avg=20484.89, stdev=15636.18 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 25], 90.00th=[ 40], 95.00th=[ 62], | 99.00th=[ 83], 99.50th=[ 84], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 63, max= 448, per=24.71%, avg=192.77, stdev=86.32, samples=60 iops : min= 3, max= 28, avg=11.50, stdev= 5.49, samples=60 write: IOPS=13, BW=210KiB/s (215kB/s)(6368KiB/30384msec); 0 zone resets clat (msec): min=22, max=158, avg=57.11, stdev=20.73 lat (msec): min=22, max=158, avg=57.12, stdev=20.73 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 42], | 30.00th=[ 46], 40.00th=[ 50], 50.00th=[ 53], 60.00th=[ 58], | 70.00th=[ 63], 80.00th=[ 69], 90.00th=[ 86], 95.00th=[ 94], | 99.00th=[ 146], 99.50th=[ 155], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 95, max= 350, per=25.39%, avg=208.42, stdev=67.26, samples=60 iops : min= 5, max= 21, avg=12.48, stdev= 4.30, samples=60 lat (msec) : 10=9.24%, 20=23.57%, 50=34.51%, 100=30.73%, 250=1.95% cpu : usr=0.09%, sys=4.89%, ctx=1613, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147580: Sat May 16 07:00:58 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(5744KiB/30691msec) clat (msec): min=4, max=103, avg=19.32, stdev=14.57 lat (msec): min=4, max=103, avg=19.33, stdev=14.57 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 35], 95.00th=[ 51], | 99.00th=[ 77], 99.50th=[ 91], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 31, max= 447, per=25.07%, avg=195.53, stdev=92.04, samples=57 iops : min= 1, max= 27, avg=11.68, stdev= 5.78, samples=57 write: IOPS=13, BW=213KiB/s (218kB/s)(6544KiB/30691msec); 0 zone resets clat (msec): min=24, max=187, avg=57.65, stdev=23.66 lat (msec): min=24, max=187, avg=57.65, stdev=23.66 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 35], 20.00th=[ 41], | 30.00th=[ 45], 40.00th=[ 50], 50.00th=[ 54], 60.00th=[ 58], | 70.00th=[ 63], 80.00th=[ 68], 90.00th=[ 85], 95.00th=[ 108], | 99.00th=[ 157], 99.50th=[ 165], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 95, max= 416, per=25.64%, avg=210.53, stdev=71.91, samples=60 iops : min= 5, max= 26, avg=12.62, stdev= 4.58, samples=60 lat (msec) : 10=12.63%, 20=19.27%, 50=35.42%, 100=29.30%, 250=3.39% cpu : usr=0.09%, sys=4.86%, ctx=1657, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147581: Sat May 16 07:00:58 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29544msec) clat (usec): min=4556, max=88719, avg=18039.20, stdev=13235.06 lat (usec): min=4558, max=88720, avg=18040.57, stdev=13234.97 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 7046], 10.00th=[ 7767], 20.00th=[ 9110], | 30.00th=[10421], 40.00th=[12125], 50.00th=[13960], 60.00th=[16909], | 70.00th=[19530], 80.00th=[22676], 90.00th=[32113], 95.00th=[45351], | 99.00th=[80217], 99.50th=[83362], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 31, max= 512, per=27.37%, avg=213.52, stdev=112.99, samples=58 iops : min= 1, max= 32, avg=12.79, stdev= 7.19, samples=58 write: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29544msec); 0 zone resets clat (msec): min=26, max=201, avg=59.22, stdev=24.11 lat (msec): min=26, max=201, avg=59.23, stdev=24.11 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 37], 20.00th=[ 42], | 30.00th=[ 45], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 59], | 70.00th=[ 66], 80.00th=[ 75], 90.00th=[ 94], 95.00th=[ 108], | 99.00th=[ 153], 99.50th=[ 167], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 63, max= 352, per=24.73%, avg=203.05, stdev=64.51, samples=58 iops : min= 3, max= 22, avg=12.14, stdev= 4.11, samples=58 lat (msec) : 10=14.45%, 20=21.88%, 50=33.59%, 100=27.08%, 250=2.99% cpu : usr=0.11%, sys=4.95%, ctx=1627, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147582: Sat May 16 07:00:58 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30098msec) clat (msec): min=5, max=124, avg=20.37, stdev=17.10 lat (msec): min=5, max=124, avg=20.37, stdev=17.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 59], | 99.00th=[ 83], 99.50th=[ 125], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 52, max= 479, per=25.77%, avg=201.03, stdev=89.87, samples=58 iops : min= 3, max= 29, avg=12.02, stdev= 5.64, samples=58 write: IOPS=12, BW=208KiB/s (213kB/s)(6256KiB/30098msec); 0 zone resets clat (msec): min=21, max=172, avg=57.03, stdev=21.40 lat (msec): min=21, max=172, avg=57.03, stdev=21.40 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 41], | 30.00th=[ 45], 40.00th=[ 50], 50.00th=[ 53], 60.00th=[ 58], | 70.00th=[ 64], 80.00th=[ 70], 90.00th=[ 82], 95.00th=[ 103], | 99.00th=[ 142], 99.50th=[ 146], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 63, max= 319, per=25.03%, avg=205.51, stdev=64.94, samples=59 iops : min= 3, max= 19, avg=12.29, stdev= 4.16, samples=59 lat (msec) : 10=11.98%, 20=22.14%, 50=33.85%, 100=29.17%, 250=2.86% cpu : usr=0.09%, sys=4.91%, ctx=1623, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=780KiB/s (799kB/s), 187KiB/s-212KiB/s (192kB/s-217kB/s), io=23.4MiB (24.5MB), run=29544-30691msec WRITE: bw=821KiB/s (841kB/s), 204KiB/s-213KiB/s (209kB/s-218kB/s), io=24.6MiB (25.8MB), run=29544-30691msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147606: Sat May 16 07:01:07 2026 read: IOPS=2, BW=2843KiB/s (2912kB/s)(7168KiB/2521msec) clat (usec): min=827, max=461541, avg=172060.66, stdev=142309.63 lat (usec): min=828, max=461542, avg=172063.48, stdev=142309.40 clat percentiles (usec): | 1.00th=[ 832], 5.00th=[ 832], 10.00th=[ 832], 20.00th=[108528], | 30.00th=[111674], 40.00th=[111674], 50.00th=[156238], 60.00th=[170918], | 70.00th=[170918], 80.00th=[193987], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 1777, max= 4079, per=40.17%, avg=2849.50, stdev=1113.51, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=2031KiB/s (2080kB/s)(5120KiB/2521msec); 0 zone resets clat (msec): min=125, max=524, avg=237.94, stdev=170.51 lat (msec): min=125, max=524, avg=237.99, stdev=170.49 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1777, max= 4079, per=26.53%, avg=2634.67, stdev=1258.15, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=33.25%, ctx=210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147607: Sat May 16 07:01:07 2026 read: IOPS=0, BW=709KiB/s (726kB/s)(2048KiB/2887msec) clat (msec): min=97, max=169, avg=133.65, stdev=51.07 lat (msec): min=97, max=169, avg=133.65, stdev=51.07 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 169], 95.00th=[ 169], | 99.00th=[ 169], 99.50th=[ 169], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 1729, max= 2048, per=26.62%, avg=1888.50, stdev=225.57, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3547KiB/s (3632kB/s)(10.0MiB/2887msec); 0 zone resets clat (msec): min=139, max=613, avg=259.90, stdev=152.59 lat (msec): min=139, max=613, avg=260.00, stdev=152.59 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 148], | 30.00th=[ 157], 40.00th=[ 165], 50.00th=[ 180], 60.00th=[ 213], | 70.00th=[ 230], 80.00th=[ 372], 90.00th=[ 384], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1729, max= 8094, per=35.17%, avg=3493.00, stdev=2668.66, samples=5 iops : min= 1, max= 7, avg= 2.80, stdev= 2.49, samples=5 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=36.59%, ctx=280, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147608: Sat May 16 07:01:07 2026 read: IOPS=2, BW=2547KiB/s (2608kB/s)(6144KiB/2412msec) clat (usec): min=535, max=289851, avg=133437.47, stdev=136349.21 lat (usec): min=537, max=289854, avg=133439.17, stdev=136349.21 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 594], | 30.00th=[ 594], 40.00th=[ 32637], 50.00th=[ 32637], 60.00th=[217056], | 70.00th=[258999], 80.00th=[258999], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 2048, max= 8159, per=71.95%, avg=5103.50, stdev=4321.13, samples=2 iops : min= 2, max= 7, avg= 4.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2547KiB/s (2608kB/s)(6144KiB/2412msec); 0 zone resets clat (msec): min=120, max=440, avg=255.87, stdev=112.98 lat (msec): min=120, max=440, avg=256.23, stdev=112.88 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 279], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1777, max= 4079, per=28.74%, avg=2854.00, stdev=1117.01, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 250=33.33%, 500=41.67% cpu : usr=0.00%, sys=40.27%, ctx=386, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147609: Sat May 16 07:01:07 2026 read: IOPS=1, BW=2044KiB/s (2093kB/s)(5120KiB/2505msec) clat (usec): min=449, max=219758, avg=165256.34, stdev=93567.03 lat (usec): min=450, max=219759, avg=165257.29, stdev=93567.33 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 449], | 30.00th=[179307], 40.00th=[179307], 50.00th=[210764], 60.00th=[210764], | 70.00th=[217056], 80.00th=[217056], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 1777, max= 6119, per=55.66%, avg=3948.00, stdev=3070.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2861KiB/s (2930kB/s)(7168KiB/2505msec); 0 zone resets clat (msec): min=139, max=355, avg=230.10, stdev=77.45 lat (msec): min=139, max=355, avg=230.18, stdev=77.47 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 161], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 211], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 292], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 3465, max= 4096, per=37.31%, avg=3705.33, stdev=341.31, samples=3 iops : min= 3, max= 4, avg= 3.33, stdev= 0.58, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=44.65%, ctx=517, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7094KiB/s (7264kB/s), 709KiB/s-2843KiB/s (726kB/s-2912kB/s), io=20.0MiB (20.0MB), run=2412-2887msec WRITE: bw=9931KiB/s (10.2MB/s), 2031KiB/s-3547KiB/s (2080kB/s-3632kB/s), io=28.0MiB (29.4MB), run=2412-2887msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147610: Sat May 16 07:01:08 2026 read: IOPS=2, BW=2056KiB/s (2105kB/s)(7168KiB/3487msec) clat (msec): min=32, max=785, avg=342.30, stdev=314.67 lat (msec): min=32, max=785, avg=342.31, stdev=314.67 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 37], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 300], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 600], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1992, max= 4096, per=43.13%, avg=2532.75, stdev=1042.41, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1468KiB/s (1504kB/s)(5120KiB/3487msec); 0 zone resets clat (msec): min=61, max=549, avg=197.62, stdev=206.57 lat (msec): min=62, max=550, avg=197.73, stdev=206.58 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 92], 60.00th=[ 92], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2048, max= 2048, per=24.91%, avg=2048.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 50=16.67%, 100=33.33%, 250=8.33%, 500=8.33%, 750=25.00% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=5.42%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147611: Sat May 16 07:01:08 2026 read: IOPS=0, BW=633KiB/s (648kB/s)(2048KiB/3236msec) clat (msec): min=117, max=396, avg=256.72, stdev=197.51 lat (msec): min=117, max=396, avg=256.72, stdev=197.51 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1774, max= 2043, per=32.50%, avg=1908.50, stdev=190.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3164KiB/s (3240kB/s)(10.0MiB/3236msec); 0 zone resets clat (msec): min=97, max=637, avg=269.72, stdev=155.79 lat (msec): min=97, max=637, avg=269.82, stdev=155.78 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 150], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 241], 60.00th=[ 271], | 70.00th=[ 313], 80.00th=[ 334], 90.00th=[ 351], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2000, max= 6144, per=44.41%, avg=3651.60, stdev=1719.56, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=14.34%, ctx=109, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147612: Sat May 16 07:01:08 2026 read: IOPS=1, BW=1932KiB/s (1978kB/s)(6144KiB/3180msec) clat (msec): min=82, max=519, avg=197.69, stdev=161.47 lat (msec): min=82, max=519, avg=197.69, stdev=161.47 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 159], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1992, max= 4096, per=43.31%, avg=2543.50, stdev=1035.28, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1932KiB/s (1978kB/s)(6144KiB/3180msec); 0 zone resets clat (msec): min=115, max=716, avg=323.36, stdev=240.74 lat (msec): min=115, max=716, avg=323.48, stdev=240.75 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 268], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1787, max= 4096, per=28.99%, avg=2383.60, stdev=962.39, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=9.28%, ctx=95, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147613: Sat May 16 07:01:08 2026 read: IOPS=1, BW=1585KiB/s (1623kB/s)(5120KiB/3230msec) clat (msec): min=56, max=417, avg=200.79, stdev=168.57 lat (msec): min=56, max=417, avg=200.79, stdev=168.57 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 102], 60.00th=[ 102], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 4087, max= 4096, per=69.67%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2219KiB/s (2272kB/s)(7168KiB/3230msec); 0 zone resets clat (msec): min=92, max=582, avg=302.18, stdev=191.39 lat (msec): min=92, max=582, avg=302.27, stdev=191.38 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 100], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 271], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 531], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1992, max= 4096, per=37.02%, avg=3043.75, stdev=1209.85, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=33.33%, 250=8.33%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=12.42%, ctx=136, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5873KiB/s (6014kB/s), 633KiB/s-2056KiB/s (648kB/s-2105kB/s), io=20.0MiB (20.0MB), run=3180-3487msec WRITE: bw=8223KiB/s (8420kB/s), 1468KiB/s-3164KiB/s (1504kB/s-3240kB/s), io=28.0MiB (29.4MB), run=3180-3487msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147618: Sat May 16 07:01:15 2026 read: IOPS=1, BW=7319KiB/s (7494kB/s)(12.0MiB/1679msec) clat (msec): min=510, max=610, avg=559.30, stdev=50.13 lat (msec): min=510, max=610, avg=559.30, stdev=50.13 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 5680, max= 8192, per=75.23%, avg=6936.00, stdev=1776.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=16.15%, ctx=33, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147619: Sat May 16 07:01:15 2026 read: IOPS=0, BW=2305KiB/s (2360kB/s)(4096KiB/1777msec) clat (nsec): min=133274k, max=133274k, avg=133273657.00, stdev= 0.00 lat (nsec): min=133276k, max=133276k, avg=133275612.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 134], 80.00th=[ 134], 90.00th=[ 134], 95.00th=[ 134], | 99.00th=[ 134], 99.50th=[ 134], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 7585, max= 7585, per=82.27%, avg=7585.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4610KiB/s (4721kB/s)(8192KiB/1777msec); 0 zone resets clat (msec): min=810, max=830, avg=820.54, stdev=14.73 lat (msec): min=811, max=831, avg=821.21, stdev=14.38 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8175, max= 8175, per=55.29%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.47%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147620: Sat May 16 07:01:15 2026 write: IOPS=1, BW=5545KiB/s (5678kB/s)(12.0MiB/2216msec); 0 zone resets clat (msec): min=186, max=1269, avg=737.45, stdev=541.75 lat (msec): min=187, max=1270, avg=738.15, stdev=541.86 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8159, max= 8175, per=55.23%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=12.82%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147622: Sat May 16 07:01:15 2026 write: IOPS=2, BW=8510KiB/s (8714kB/s)(12.0MiB/1444msec); 0 zone resets clat (msec): min=201, max=880, avg=480.06, stdev=355.66 lat (msec): min=201, max=881, avg=480.72, stdev=355.54 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7922, max= 8175, per=54.43%, avg=8048.50, stdev=178.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.86%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9220KiB/s (9441kB/s), 2305KiB/s-7319KiB/s (2360kB/s-7494kB/s), io=16.0MiB (16.8MB), run=1679-1777msec WRITE: bw=14.4MiB/s (15.1MB/s), 4610KiB/s-8510KiB/s (4721kB/s-8714kB/s), io=32.0MiB (33.6MB), run=1444-2216msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147623: Sat May 16 07:01:15 2026 read: IOPS=2, BW=8605KiB/s (8812kB/s)(12.0MiB/1428msec) clat (msec): min=427, max=504, avg=475.43, stdev=41.47 lat (msec): min=427, max=504, avg=475.43, stdev=41.47 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 5769, max= 8192, per=89.22%, avg=6980.50, stdev=1713.32, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=38.96%, ctx=1730, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147624: Sat May 16 07:01:15 2026 read: IOPS=0, BW=1956KiB/s (2003kB/s)(4096KiB/2094msec) clat (nsec): min=498141k, max=498141k, avg=498141399.00, stdev= 0.00 lat (nsec): min=498143k, max=498143k, avg=498143267.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 5736, max= 5736, per=73.31%, avg=5736.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3912KiB/s (4006kB/s)(8192KiB/2094msec); 0 zone resets clat (msec): min=731, max=861, avg=796.31, stdev=91.75 lat (msec): min=732, max=861, avg=796.93, stdev=91.79 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8192, max= 8192, per=52.35%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=18.68%, ctx=436, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147625: Sat May 16 07:01:15 2026 write: IOPS=1, BW=6454KiB/s (6609kB/s)(12.0MiB/1904msec); 0 zone resets clat (msec): min=127, max=896, avg=633.62, stdev=438.13 lat (msec): min=128, max=897, avg=634.29, stdev=438.41 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=52.35%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.11%, sys=11.29%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147626: Sat May 16 07:01:15 2026 write: IOPS=1, BW=7111KiB/s (7282kB/s)(12.0MiB/1728msec); 0 zone resets clat (msec): min=398, max=829, avg=574.71, stdev=226.08 lat (msec): min=398, max=830, avg=575.53, stdev=226.22 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 5550, max= 8192, per=43.91%, avg=6871.00, stdev=1868.18, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.17%, sys=18.41%, ctx=101, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7824KiB/s (8012kB/s), 1956KiB/s-8605KiB/s (2003kB/s-8812kB/s), io=16.0MiB (16.8MB), run=1428-2094msec WRITE: bw=15.3MiB/s (16.0MB/s), 3912KiB/s-7111KiB/s (4006kB/s-7282kB/s), io=32.0MiB (33.6MB), run=1728-2094msec