== sanity test 398b: DIO and buffer IO race ============== 12:33:47 (1788626027) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.80453 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179626: Sat Sep 5 12:36:18 2026 read: IOPS=11, BW=47.8KiB/s (48.9kB/s)(5992KiB/125477msec) clat (usec): min=31, max=564193, avg=46963.94, stdev=33704.94 lat (usec): min=31, max=564194, avg=46965.98, stdev=33704.94 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11469], 10.00th=[ 17433], 20.00th=[ 23200], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[152044], 99.50th=[187696], 99.90th=[283116], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 104, per=25.78%, avg=47.70, stdev=19.23, samples=245 iops : min= 1, max= 26, avg=11.29, stdev= 4.86, samples=245 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6296KiB/125477msec); 0 zone resets clat (usec): min=852, max=232212, avg=34905.92, stdev=37124.50 lat (usec): min=852, max=232213, avg=34910.24, stdev=37124.18 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1336], 20.00th=[ 3392], | 30.00th=[ 6915], 40.00th=[ 14222], 50.00th=[ 23200], 60.00th=[ 33162], | 70.00th=[ 44303], 80.00th=[ 62129], 90.00th=[ 86508], 95.00th=[113771], | 99.00th=[162530], 99.50th=[175113], 99.90th=[229639], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 135, per=25.86%, avg=49.92, stdev=22.26, samples=246 iops : min= 1, max= 33, avg=11.85, stdev= 5.62, samples=246 lat (usec) : 50=0.36%, 100=1.43%, 250=0.13%, 500=0.03%, 1000=0.07% lat (msec) : 2=7.26%, 4=4.04%, 10=6.64%, 20=10.22%, 50=38.64% lat (msec) : 100=25.10%, 250=5.99%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.08%, ctx=6513, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179627: Sat Sep 5 12:36:18 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(5940KiB/127719msec) clat (usec): min=40, max=609207, avg=47092.17, stdev=34575.29 lat (usec): min=41, max=609209, avg=47102.95, stdev=34581.30 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 12125], 10.00th=[ 17433], 20.00th=[ 22676], | 30.00th=[ 28181], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[170918], 99.50th=[189793], 99.90th=[229639], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 5, max= 103, per=24.98%, avg=46.21, stdev=18.96, samples=251 iops : min= 1, max= 25, avg=10.92, stdev= 4.77, samples=251 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6348KiB/127719msec); 0 zone resets clat (usec): min=844, max=211480, avg=36304.04, stdev=37433.51 lat (usec): min=845, max=211482, avg=36306.37, stdev=37434.28 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1467], 20.00th=[ 3392], | 30.00th=[ 7046], 40.00th=[ 16188], 50.00th=[ 25822], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 65799], 90.00th=[ 89654], 95.00th=[111674], | 99.00th=[156238], 99.50th=[183501], 99.90th=[204473], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 125, per=25.54%, avg=49.29, stdev=21.69, samples=251 iops : min= 1, max= 31, avg=11.69, stdev= 5.47, samples=251 lat (usec) : 50=0.13%, 100=1.33%, 250=0.13%, 750=0.07%, 1000=0.23% lat (msec) : 2=6.71%, 4=4.62%, 10=6.25%, 20=10.55%, 50=38.09% lat (msec) : 100=25.33%, 250=6.54%, 750=0.03% cpu : usr=0.08%, sys=5.09%, ctx=6496, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179628: Sat Sep 5 12:36:18 2026 read: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6028KiB/125504msec) clat (usec): min=33, max=283994, avg=45273.57, stdev=30315.85 lat (usec): min=34, max=283995, avg=45282.29, stdev=30314.27 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9765], 10.00th=[ 16581], 20.00th=[ 22938], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 95945], | 99.00th=[154141], 99.50th=[177210], 99.90th=[258999], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 111, per=25.93%, avg=47.98, stdev=18.73, samples=245 iops : min= 1, max= 27, avg=11.36, stdev= 4.74, samples=245 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6260KiB/125504msec); 0 zone resets clat (usec): min=961, max=635044, avg=36477.24, stdev=41050.52 lat (usec): min=963, max=635047, avg=36479.94, stdev=41049.85 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1385], 20.00th=[ 3195], | 30.00th=[ 6652], 40.00th=[ 15926], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 90702], 95.00th=[113771], | 99.00th=[168821], 99.50th=[196084], 99.90th=[252707], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 5, max= 119, per=25.66%, avg=49.52, stdev=21.91, samples=246 iops : min= 1, max= 29, avg=11.75, stdev= 5.52, samples=246 lat (usec) : 50=0.23%, 100=1.76%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=6.97%, 4=4.30%, 10=6.71%, 20=9.44%, 50=39.84% lat (msec) : 100=24.22%, 250=6.05%, 500=0.10%, 750=0.03% cpu : usr=0.07%, sys=5.14%, ctx=6410, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179629: Sat Sep 5 12:36:18 2026 read: IOPS=11, BW=46.7KiB/s (47.8kB/s)(6052KiB/129715msec) clat (usec): min=35, max=228278, avg=46577.78, stdev=31364.71 lat (usec): min=36, max=228279, avg=46580.46, stdev=31363.95 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11469], 10.00th=[ 16712], 20.00th=[ 22676], | 30.00th=[ 27919], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[160433], 99.50th=[185598], 99.90th=[214959], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 7, max= 111, per=25.10%, avg=46.44, stdev=19.49, samples=255 iops : min= 1, max= 27, avg=10.96, stdev= 4.92, samples=255 write: IOPS=12, BW=48.1KiB/s (49.2kB/s)(6236KiB/129715msec); 0 zone resets clat (usec): min=923, max=646924, avg=37867.28, stdev=42028.40 lat (usec): min=923, max=646926, avg=37869.13, stdev=42028.81 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1172], 10.00th=[ 1418], 20.00th=[ 3261], | 30.00th=[ 7439], 40.00th=[ 16909], 50.00th=[ 26870], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[164627], 99.50th=[196084], 99.90th=[316670], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 5, max= 110, per=24.86%, avg=47.97, stdev=21.24, samples=254 iops : min= 1, max= 27, avg=11.36, stdev= 5.36, samples=254 lat (usec) : 50=0.36%, 100=1.40%, 250=0.07%, 1000=0.29% lat (msec) : 2=6.87%, 4=4.52%, 10=5.50%, 20=9.83%, 50=38.57% lat (msec) : 100=25.91%, 250=6.61%, 500=0.03%, 750=0.03% cpu : usr=0.06%, sys=4.94%, ctx=6473, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=185KiB/s (190kB/s), 46.5KiB/s-48.0KiB/s (47.6kB/s-49.2kB/s), io=23.4MiB (24.6MB), run=125477-129715msec WRITE: bw=194KiB/s (198kB/s), 48.1KiB/s-50.2KiB/s (49.2kB/s-51.4kB/s), io=24.6MiB (25.7MB), run=125477-129715msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179621: Sat Sep 5 12:36:57 2026 read: IOPS=8, BW=35.6KiB/s (36.4kB/s)(5992KiB/168535msec) clat (msec): min=5, max=1152, avg=45.07, stdev=50.60 lat (msec): min=5, max=1152, avg=45.07, stdev=50.60 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 104], 95.00th=[ 133], | 99.00th=[ 209], 99.50th=[ 243], 99.90th=[ 330], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 151, per=25.92%, avg=36.54, stdev=25.88, samples=318 iops : min= 1, max= 37, avg= 8.48, stdev= 6.51, samples=318 write: IOPS=9, BW=37.4KiB/s (38.3kB/s)(6296KiB/168535msec); 0 zone resets clat (msec): min=10, max=343, avg=63.97, stdev=46.77 lat (msec): min=10, max=343, avg=63.97, stdev=46.77 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 49], 60.00th=[ 60], | 70.00th=[ 74], 80.00th=[ 97], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 232], 99.50th=[ 257], 99.90th=[ 288], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 119, per=25.14%, avg=37.20, stdev=24.46, samples=328 iops : min= 1, max= 29, avg= 8.64, stdev= 6.14, samples=328 lat (msec) : 10=2.90%, 20=15.23%, 50=43.49%, 100=23.57%, 250=14.29% lat (msec) : 500=0.49%, 2000=0.03% cpu : usr=0.04%, sys=1.72%, ctx=4888, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179622: Sat Sep 5 12:36:57 2026 read: IOPS=8, BW=35.0KiB/s (35.9kB/s)(5940KiB/169486msec) clat (msec): min=5, max=1251, avg=44.31, stdev=53.63 lat (msec): min=5, max=1251, avg=44.31, stdev=53.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 104], 95.00th=[ 134], | 99.00th=[ 222], 99.50th=[ 257], 99.90th=[ 355], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 119, per=25.45%, avg=35.88, stdev=25.80, samples=321 iops : min= 1, max= 29, avg= 8.31, stdev= 6.48, samples=321 write: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6348KiB/169486msec); 0 zone resets clat (msec): min=12, max=430, avg=65.12, stdev=48.65 lat (msec): min=12, max=430, avg=65.12, stdev=48.65 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 61], | 70.00th=[ 75], 80.00th=[ 96], 90.00th=[ 131], 95.00th=[ 161], | 99.00th=[ 234], 99.50th=[ 271], 99.90th=[ 376], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 127, per=25.40%, avg=37.59, stdev=24.90, samples=327 iops : min= 1, max= 31, avg= 8.74, stdev= 6.25, samples=327 lat (msec) : 10=2.86%, 20=15.89%, 50=44.14%, 100=22.69%, 250=13.74% lat (msec) : 500=0.65%, 2000=0.03% cpu : usr=0.05%, sys=1.60%, ctx=4915, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179623: Sat Sep 5 12:36:57 2026 read: IOPS=9, BW=36.3KiB/s (37.1kB/s)(6028KiB/166252msec) clat (msec): min=5, max=321, avg=44.15, stdev=42.10 lat (msec): min=5, max=321, avg=44.15, stdev=42.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 96], 95.00th=[ 133], | 99.00th=[ 209], 99.50th=[ 249], 99.90th=[ 313], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 127, per=25.81%, avg=36.40, stdev=24.93, samples=322 iops : min= 1, max= 31, avg= 8.44, stdev= 6.26, samples=322 write: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6260KiB/166252msec); 0 zone resets clat (msec): min=11, max=1248, avg=63.50, stdev=53.97 lat (msec): min=11, max=1248, avg=63.51, stdev=53.97 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 125], 95.00th=[ 153], | 99.00th=[ 228], 99.50th=[ 251], 99.90th=[ 414], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 119, per=25.49%, avg=37.72, stdev=24.45, samples=323 iops : min= 1, max= 29, avg= 8.78, stdev= 6.14, samples=323 lat (msec) : 10=2.05%, 20=16.08%, 50=44.34%, 100=24.32%, 250=12.73% lat (msec) : 500=0.46%, 2000=0.03% cpu : usr=0.05%, sys=1.70%, ctx=4705, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179624: Sat Sep 5 12:36:57 2026 read: IOPS=9, BW=36.2KiB/s (37.1kB/s)(6052KiB/167021msec) clat (msec): min=5, max=332, avg=42.43, stdev=40.64 lat (msec): min=5, max=332, avg=42.44, stdev=40.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 94], 95.00th=[ 129], | 99.00th=[ 194], 99.50th=[ 243], 99.90th=[ 321], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 135, per=26.38%, avg=37.19, stdev=25.15, samples=316 iops : min= 1, max= 33, avg= 8.64, stdev= 6.31, samples=316 write: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6236KiB/167021msec); 0 zone resets clat (msec): min=10, max=1247, avg=65.72, stdev=56.91 lat (msec): min=10, max=1247, avg=65.73, stdev=56.90 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 74], 80.00th=[ 96], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 226], 99.50th=[ 284], 99.90th=[ 430], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 111, per=25.29%, avg=37.44, stdev=23.87, samples=323 iops : min= 1, max= 27, avg= 8.70, stdev= 6.00, samples=323 lat (msec) : 10=2.67%, 20=15.76%, 50=44.47%, 100=23.34%, 250=13.22% lat (msec) : 500=0.52%, 2000=0.03% cpu : usr=0.06%, sys=1.63%, ctx=4672, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=142KiB/s (145kB/s), 35.0KiB/s-36.3KiB/s (35.9kB/s-37.1kB/s), io=23.4MiB (24.6MB), run=166252-169486msec WRITE: bw=148KiB/s (152kB/s), 37.3KiB/s-37.7KiB/s (38.2kB/s-38.6kB/s), io=24.6MiB (25.7MB), run=166252-169486msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179670: Sat Sep 5 12:37:36 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5920KiB/27329msec) clat (usec): min=46, max=162491, avg=38171.82, stdev=24961.44 lat (usec): min=48, max=162492, avg=38173.31, stdev=24961.44 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 60], 10.00th=[ 611], 20.00th=[ 20317], | 30.00th=[ 25822], 40.00th=[ 28967], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 47449], 80.00th=[ 54789], 90.00th=[ 63701], 95.00th=[ 81265], | 99.00th=[123208], 99.50th=[145753], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 63, max= 467, per=25.55%, avg=215.65, stdev=78.83, samples=54 iops : min= 3, max= 29, avg=12.74, stdev= 5.02, samples=54 write: IOPS=14, BW=233KiB/s (239kB/s)(6368KiB/27329msec); 0 zone resets clat (usec): min=1382, max=165792, avg=32671.24, stdev=32920.39 lat (usec): min=1383, max=165793, avg=32673.75, stdev=32920.35 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1811], 10.00th=[ 2507], 20.00th=[ 4883], | 30.00th=[ 7701], 40.00th=[ 14484], 50.00th=[ 21365], 60.00th=[ 31589], | 70.00th=[ 43254], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[143655], 99.50th=[162530], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 63, max= 496, per=26.20%, avg=232.65, stdev=88.16, samples=54 iops : min= 3, max= 31, avg=13.81, stdev= 5.59, samples=54 lat (usec) : 50=0.26%, 100=3.78%, 250=0.65%, 750=0.13% lat (msec) : 2=3.12%, 4=5.86%, 10=9.38%, 20=11.20%, 50=40.10% lat (msec) : 100=21.88%, 250=3.65% cpu : usr=0.09%, sys=6.47%, ctx=1693, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179671: Sat Sep 5 12:37:36 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(5744KiB/28317msec) clat (usec): min=38, max=243277, avg=41323.23, stdev=31890.01 lat (usec): min=38, max=243279, avg=41324.99, stdev=31889.98 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 65], 10.00th=[ 229], 20.00th=[ 21103], | 30.00th=[ 25035], 40.00th=[ 29754], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[170918], 99.50th=[187696], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 94, max= 378, per=24.01%, avg=202.64, stdev=70.81, samples=56 iops : min= 5, max= 23, avg=11.93, stdev= 4.50, samples=56 write: IOPS=14, BW=231KiB/s (237kB/s)(6544KiB/28317msec); 0 zone resets clat (usec): min=1421, max=174981, avg=32800.87, stdev=31067.74 lat (usec): min=1423, max=174986, avg=32804.63, stdev=31066.87 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2212], 10.00th=[ 3490], 20.00th=[ 6194], | 30.00th=[ 10290], 40.00th=[ 16581], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 40633], 80.00th=[ 56361], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[131597], 99.50th=[166724], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 63, max= 571, per=25.93%, avg=230.27, stdev=101.01, samples=56 iops : min= 3, max= 35, avg=13.66, stdev= 6.31, samples=56 lat (usec) : 50=0.78%, 100=2.99%, 250=0.91%, 750=0.13%, 1000=0.26% lat (msec) : 2=1.95%, 4=4.43%, 10=9.77%, 20=10.81%, 50=42.06% lat (msec) : 100=22.01%, 250=3.91% cpu : usr=0.08%, sys=6.55%, ctx=1708, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179672: Sat Sep 5 12:37:36 2026 read: IOPS=14, BW=226KiB/s (231kB/s)(6256KiB/27677msec) clat (usec): min=43, max=212694, avg=40281.95, stdev=27953.81 lat (usec): min=43, max=212694, avg=40284.23, stdev=27954.47 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 143], 20.00th=[ 20579], | 30.00th=[ 27132], 40.00th=[ 30540], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 48497], 80.00th=[ 60556], 90.00th=[ 73925], 95.00th=[ 85459], | 99.00th=[147850], 99.50th=[154141], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 95, max= 382, per=27.00%, avg=227.87, stdev=71.24, samples=54 iops : min= 5, max= 23, avg=13.50, stdev= 4.50, samples=54 write: IOPS=13, BW=218KiB/s (223kB/s)(6032KiB/27677msec); 0 zone resets clat (usec): min=1498, max=160062, avg=31187.32, stdev=30535.56 lat (usec): min=1500, max=160065, avg=31190.26, stdev=30535.47 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1909], 10.00th=[ 3163], 20.00th=[ 5211], | 30.00th=[ 8848], 40.00th=[ 13042], 50.00th=[ 21890], 60.00th=[ 29492], | 70.00th=[ 41681], 80.00th=[ 53740], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[139461], 99.50th=[143655], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 31, max= 415, per=24.27%, avg=215.52, stdev=89.97, samples=54 iops : min= 1, max= 25, avg=12.72, stdev= 5.72, samples=54 lat (usec) : 50=0.39%, 100=4.56%, 250=0.39%, 500=0.39%, 1000=0.13% lat (msec) : 2=2.60%, 4=3.91%, 10=9.90%, 20=11.33%, 50=40.89% lat (msec) : 100=22.27%, 250=3.26% cpu : usr=0.09%, sys=6.21%, ctx=1721, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179673: Sat Sep 5 12:37:36 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(6032KiB/28368msec) clat (usec): min=36, max=194231, avg=42129.16, stdev=29479.79 lat (usec): min=36, max=194233, avg=42134.91, stdev=29480.42 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 122], 20.00th=[ 20841], | 30.00th=[ 27657], 40.00th=[ 32637], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 51643], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[149947], 99.50th=[170918], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 95, max= 383, per=24.93%, avg=210.38, stdev=64.99, samples=56 iops : min= 5, max= 23, avg=12.41, stdev= 4.06, samples=56 write: IOPS=13, BW=221KiB/s (226kB/s)(6256KiB/28368msec); 0 zone resets clat (usec): min=1374, max=190800, avg=31522.49, stdev=30999.28 lat (usec): min=1375, max=190802, avg=31526.57, stdev=30999.13 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2008], 10.00th=[ 2769], 20.00th=[ 5014], | 30.00th=[ 7242], 40.00th=[ 14877], 50.00th=[ 22152], 60.00th=[ 28705], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[135267], 99.50th=[145753], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 63, max= 572, per=24.77%, avg=219.95, stdev=94.70, samples=56 iops : min= 3, max= 35, avg=13.02, stdev= 5.89, samples=56 lat (usec) : 50=0.65%, 100=4.04%, 250=0.65%, 500=0.13% lat (msec) : 2=2.47%, 4=6.38%, 10=8.59%, 20=10.03%, 50=39.32% lat (msec) : 100=23.70%, 250=4.04% cpu : usr=0.06%, sys=6.33%, ctx=1717, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=844KiB/s (865kB/s), 203KiB/s-226KiB/s (208kB/s-231kB/s), io=23.4MiB (24.5MB), run=27329-28368msec WRITE: bw=888KiB/s (910kB/s), 218KiB/s-233KiB/s (223kB/s-239kB/s), io=24.6MiB (25.8MB), run=27329-28368msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179675: Sat Sep 5 12:37:49 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(5920KiB/40162msec) clat (msec): min=6, max=247, avg=42.30, stdev=37.18 lat (msec): min=6, max=247, avg=42.30, stdev=37.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 91], 95.00th=[ 122], | 99.00th=[ 199], 99.50th=[ 213], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 415, per=24.77%, avg=146.91, stdev=83.67, samples=79 iops : min= 1, max= 25, avg= 8.37, stdev= 5.31, samples=79 write: IOPS=9, BW=159KiB/s (162kB/s)(6368KiB/40162msec); 0 zone resets clat (msec): min=13, max=269, avg=61.37, stdev=37.18 lat (msec): min=13, max=269, avg=61.37, stdev=37.18 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 51], 60.00th=[ 59], | 70.00th=[ 69], 80.00th=[ 85], 90.00th=[ 111], 95.00th=[ 132], | 99.00th=[ 211], 99.50th=[ 245], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 23, max= 383, per=25.34%, avg=158.10, stdev=82.97, samples=79 iops : min= 1, max= 23, avg= 9.08, stdev= 5.20, samples=79 lat (msec) : 10=1.69%, 20=12.11%, 50=47.27%, 100=28.26%, 250=10.55% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.94%, ctx=1172, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179676: Sat Sep 5 12:37:49 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5744KiB/39949msec) clat (msec): min=7, max=234, avg=42.20, stdev=36.05 lat (msec): min=7, max=234, avg=42.20, stdev=36.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 82], 95.00th=[ 117], | 99.00th=[ 180], 99.50th=[ 232], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 447, per=24.43%, avg=144.86, stdev=85.34, samples=77 iops : min= 1, max= 27, avg= 8.22, stdev= 5.38, samples=77 write: IOPS=10, BW=164KiB/s (168kB/s)(6544KiB/39949msec); 0 zone resets clat (msec): min=16, max=227, avg=60.42, stdev=35.09 lat (msec): min=16, max=227, avg=60.42, stdev=35.09 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 60], | 70.00th=[ 69], 80.00th=[ 85], 90.00th=[ 107], 95.00th=[ 128], | 99.00th=[ 188], 99.50th=[ 199], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 30, max= 443, per=26.08%, avg=162.74, stdev=82.68, samples=78 iops : min= 1, max= 27, avg= 9.36, stdev= 5.18, samples=78 lat (msec) : 10=0.91%, 20=11.59%, 50=46.88%, 100=31.12%, 250=9.51% cpu : usr=0.05%, sys=1.86%, ctx=1203, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179677: Sat Sep 5 12:37:49 2026 read: IOPS=9, BW=156KiB/s (159kB/s)(6256KiB/40186msec) clat (msec): min=6, max=244, avg=40.18, stdev=33.24 lat (msec): min=6, max=244, avg=40.18, stdev=33.24 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 90], 95.00th=[ 116], | 99.00th=[ 155], 99.50th=[ 171], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 478, per=26.60%, avg=157.74, stdev=100.09, samples=78 iops : min= 1, max= 29, avg= 9.04, stdev= 6.31, samples=78 write: IOPS=9, BW=150KiB/s (154kB/s)(6032KiB/40186msec); 0 zone resets clat (msec): min=9, max=296, avg=64.78, stdev=42.76 lat (msec): min=9, max=296, avg=64.78, stdev=42.75 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 60], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 228], 99.50th=[ 271], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 383, per=23.75%, avg=148.20, stdev=75.67, samples=79 iops : min= 1, max= 23, avg= 8.44, stdev= 4.76, samples=79 lat (msec) : 10=2.08%, 20=14.06%, 50=45.44%, 100=26.17%, 250=11.98% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=1.98%, ctx=1233, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179678: Sat Sep 5 12:37:49 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(6032KiB/40331msec) clat (msec): min=7, max=244, avg=42.25, stdev=35.06 lat (msec): min=7, max=244, avg=42.26, stdev=35.06 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 124], | 99.00th=[ 163], 99.50th=[ 201], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 413, per=25.15%, avg=149.17, stdev=82.29, samples=78 iops : min= 1, max= 25, avg= 8.50, stdev= 5.21, samples=78 write: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40331msec); 0 zone resets clat (msec): min=14, max=296, avg=62.22, stdev=42.04 lat (msec): min=14, max=296, avg=62.23, stdev=42.04 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 31], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 87], 90.00th=[ 111], 95.00th=[ 146], | 99.00th=[ 264], 99.50th=[ 288], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 443, per=24.57%, avg=153.34, stdev=87.64, samples=79 iops : min= 1, max= 27, avg= 8.77, stdev= 5.52, samples=79 lat (msec) : 10=0.78%, 20=14.32%, 50=47.27%, 100=26.69%, 250=10.42% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=2.00%, ctx=1255, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=594KiB/s (608kB/s), 144KiB/s-156KiB/s (147kB/s-159kB/s), io=23.4MiB (24.5MB), run=39949-40331msec WRITE: bw=625KiB/s (640kB/s), 150KiB/s-164KiB/s (154kB/s-168kB/s), io=24.6MiB (25.8MB), run=39949-40331msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Sat Sep 5 12:38:04 2026 read: IOPS=2, BW=2164KiB/s (2216kB/s)(7168KiB/3312msec) clat (usec): min=486, max=556890, avg=196573.81, stdev=200268.58 lat (usec): min=487, max=556891, avg=196575.22, stdev=200268.50 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 1221], | 30.00th=[113771], 40.00th=[113771], 50.00th=[141558], 60.00th=[210764], | 70.00th=[210764], 80.00th=[350225], 90.00th=[557843], 95.00th=[557843], | 99.00th=[557843], 99.50th=[557843], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 1499, max= 4055, per=55.91%, avg=2332.00, stdev=990.82, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1546KiB/s (1583kB/s)(5120KiB/3312msec); 0 zone resets clat (msec): min=246, max=587, avg=345.98, stdev=137.48 lat (msec): min=246, max=587, avg=346.08, stdev=137.54 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2027, max= 4063, per=46.46%, avg=2712.67, stdev=1169.47, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=18.70%, ctx=159, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179694: Sat Sep 5 12:38:04 2026 read: IOPS=0, BW=417KiB/s (427kB/s)(2048KiB/4910msec) clat (msec): min=104, max=383, avg=243.91, stdev=197.58 lat (msec): min=104, max=383, avg=243.91, stdev=197.58 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1501, max= 1992, per=41.87%, avg=1746.50, stdev=347.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2086KiB/s (2136kB/s)(10.0MiB/4910msec); 0 zone resets clat (msec): min=176, max=843, avg=423.30, stdev=251.13 lat (msec): min=176, max=843, avg=423.98, stdev=252.04 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 182], | 30.00th=[ 226], 40.00th=[ 264], 50.00th=[ 266], 60.00th=[ 368], | 70.00th=[ 477], 80.00th=[ 676], 90.00th=[ 760], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2027, max= 4096, per=62.65%, avg=3658.00, stdev=912.98, samples=5 iops : min= 1, max= 4, avg= 3.00, stdev= 1.22, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=12.79%, ctx=210, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Sat Sep 5 12:38:04 2026 read: IOPS=1, BW=1718KiB/s (1759kB/s)(6144KiB/3577msec) clat (usec): min=1314, max=546312, avg=226317.43, stdev=207640.21 lat (usec): min=1315, max=546314, avg=226318.77, stdev=207640.50 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1319], 10.00th=[ 1319], 20.00th=[ 1467], | 30.00th=[ 1467], 40.00th=[221250], 50.00th=[221250], 60.00th=[256902], | 70.00th=[329253], 80.00th=[329253], 90.00th=[549454], 95.00th=[549454], | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 1992, max= 6083, per=80.76%, avg=3368.67, stdev=2350.76, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1718KiB/s (1759kB/s)(6144KiB/3577msec); 0 zone resets clat (msec): min=171, max=752, avg=360.14, stdev=200.95 lat (msec): min=171, max=752, avg=360.22, stdev=200.95 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 330], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2027, max= 2959, per=38.81%, avg=2266.25, stdev=461.92, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 2=16.67%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=15.94%, ctx=171, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Sat Sep 5 12:38:04 2026 read: IOPS=1, BW=1144KiB/s (1172kB/s)(5120KiB/4475msec) clat (usec): min=426, max=377839, avg=167597.31, stdev=164076.76 lat (usec): min=427, max=377839, avg=167598.44, stdev=164076.42 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 429], 10.00th=[ 429], 20.00th=[ 429], | 30.00th=[ 783], 40.00th=[ 783], 50.00th=[223347], 60.00th=[223347], | 70.00th=[233833], 80.00th=[233833], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 3984, max= 4063, per=96.46%, avg=4023.50, stdev=55.86, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1602KiB/s (1640kB/s)(7168KiB/4475msec); 0 zone resets clat (msec): min=210, max=1064, avg=473.65, stdev=290.42 lat (msec): min=210, max=1064, avg=473.73, stdev=290.41 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 264], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 384], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 567], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1535, max= 2048, per=33.35%, avg=1947.33, stdev=203.00, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=13.77%, ctx=194, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4171KiB/s (4271kB/s), 417KiB/s-2164KiB/s (427kB/s-2216kB/s), io=20.0MiB (20.0MB), run=3312-4910msec WRITE: bw=5840KiB/s (5980kB/s), 1546KiB/s-2086KiB/s (1583kB/s-2136kB/s), io=28.0MiB (29.4MB), run=3312-4910msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179693: Sat Sep 5 12:38:04 2026 read: IOPS=1, BW=1615KiB/s (1654kB/s)(7168KiB/4439msec) clat (msec): min=109, max=552, avg=197.55, stdev=160.35 lat (msec): min=109, max=552, avg=197.55, stdev=160.35 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 114], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 128], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 213], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1633, max= 4087, per=73.36%, avg=2872.75, stdev=1213.06, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1153KiB/s (1181kB/s)(5120KiB/4439msec); 0 zone resets clat (msec): min=479, max=693, avg=582.36, stdev=100.70 lat (msec): min=479, max=693, avg=582.45, stdev=100.70 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2019, max= 2043, per=37.10%, avg=2034.00, stdev=11.49, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=50.00%, 500=8.33%, 750=41.67% cpu : usr=0.00%, sys=6.40%, ctx=90, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179695: Sat Sep 5 12:38:04 2026 read: IOPS=0, BW=399KiB/s (408kB/s)(2048KiB/5137msec) clat (msec): min=457, max=609, avg=533.10, stdev=107.38 lat (msec): min=457, max=609, avg=533.10, stdev=107.38 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1861, max= 2043, per=49.85%, avg=1952.00, stdev=128.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1993KiB/s (2041kB/s)(10.0MiB/5137msec); 0 zone resets clat (msec): min=88, max=1037, avg=392.13, stdev=292.84 lat (msec): min=88, max=1037, avg=392.24, stdev=292.85 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 126], | 30.00th=[ 184], 40.00th=[ 228], 50.00th=[ 268], 60.00th=[ 409], | 70.00th=[ 430], 80.00th=[ 443], 90.00th=[ 709], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 2019, max= 4063, per=43.33%, avg=2375.83, stdev=826.60, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.71%, ctx=124, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Sat Sep 5 12:38:04 2026 read: IOPS=1, BW=1175KiB/s (1203kB/s)(6144KiB/5229msec) clat (msec): min=91, max=593, avg=329.38, stdev=207.90 lat (msec): min=91, max=593, avg=329.38, stdev=207.90 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 443], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2019, max= 4087, per=64.84%, avg=2539.00, stdev=1032.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1175KiB/s (1203kB/s)(6144KiB/5229msec); 0 zone resets clat (msec): min=105, max=827, avg=499.12, stdev=271.89 lat (msec): min=105, max=827, avg=499.33, stdev=271.90 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 558], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2003, max= 2048, per=37.01%, avg=2029.17, stdev=17.14, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 100=16.67%, 250=8.33%, 500=41.67%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=5.57%, ctx=111, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Sat Sep 5 12:38:04 2026 read: IOPS=1, BW=1233KiB/s (1263kB/s)(5120KiB/4152msec) clat (msec): min=99, max=780, avg=375.02, stdev=333.66 lat (msec): min=99, max=780, avg=375.02, stdev=333.66 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2019, max= 4087, per=69.26%, avg=2712.33, stdev=1190.51, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1726KiB/s (1768kB/s)(7168KiB/4152msec); 0 zone resets clat (msec): min=141, max=527, avg=318.04, stdev=161.99 lat (msec): min=141, max=527, avg=318.15, stdev=161.98 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 165], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 284], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 468], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2043, max= 3723, per=52.34%, avg=2870.00, stdev=840.30, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=4.84%, ctx=92, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3917KiB/s (4011kB/s), 399KiB/s-1615KiB/s (408kB/s-1654kB/s), io=20.0MiB (20.0MB), run=4152-5229msec WRITE: bw=5483KiB/s (5615kB/s), 1153KiB/s-1993KiB/s (1181kB/s-2041kB/s), io=28.0MiB (29.4MB), run=4152-5229msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179705: Sat Sep 5 12:38:18 2026 read: IOPS=4, BW=18.5MiB/s (19.4MB/s)(12.0MiB/647msec) clat (msec): min=152, max=255, avg=207.91, stdev=51.92 lat (msec): min=152, max=255, avg=207.92, stdev=51.91 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=18.89%, ctx=64, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179706: Sat Sep 5 12:38:18 2026 read: IOPS=0, BW=848KiB/s (869kB/s)(4096KiB/4828msec) clat (nsec): min=541418k, max=541418k, avg=541418484.00, stdev= 0.00 lat (nsec): min=541421k, max=541421k, avg=541421224.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 5542, max= 5542, per=100.00%, avg=5542.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1697KiB/s (1737kB/s)(8192KiB/4828msec); 0 zone resets clat (msec): min=961, max=3205, avg=2083.67, stdev=1586.56 lat (msec): min=962, max=3205, avg=2083.99, stdev=1586.55 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 3205], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 7599, max= 7599, per=100.00%, avg=7599.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.02%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179707: Sat Sep 5 12:38:18 2026 write: IOPS=0, BW=2533KiB/s (2594kB/s)(12.0MiB/4851msec); 0 zone resets clat (msec): min=328, max=3763, avg=1596.63, stdev=1885.98 lat (msec): min=328, max=3764, avg=1596.99, stdev=1885.95 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 5752, max= 7599, per=98.84%, avg=6675.50, stdev=1306.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.62%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179708: Sat Sep 5 12:38:18 2026 write: IOPS=0, BW=2867KiB/s (2936kB/s)(12.0MiB/4286msec); 0 zone resets clat (msec): min=178, max=3609, avg=1408.51, stdev=1910.22 lat (msec): min=180, max=3609, avg=1409.70, stdev=1909.54 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min=11040, max=11040, per=100.00%, avg=11040.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.39%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3394KiB/s (3475kB/s), 848KiB/s-18.5MiB/s (869kB/s-19.4MB/s), io=16.0MiB (16.8MB), run=647-4828msec WRITE: bw=6755KiB/s (6917kB/s), 1697KiB/s-2867KiB/s (1737kB/s-2936kB/s), io=32.0MiB (33.6MB), run=4286-4851msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179711: Sat Sep 5 12:38:20 2026 read: IOPS=0, BW=2277KiB/s (2331kB/s)(12.0MiB/5397msec) clat (msec): min=897, max=3577, avg=1798.55, stdev=1540.38 lat (msec): min=897, max=3577, avg=1798.55, stdev=1540.38 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8031, max= 8143, per=100.00%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.43%, ctx=257, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179712: Sat Sep 5 12:38:20 2026 read: IOPS=0, BW=691KiB/s (708kB/s)(4096KiB/5927msec) clat (nsec): min=3630.4M, max=3630.4M, avg=3630360480.00, stdev= 0.00 lat (nsec): min=3630.4M, max=3630.4M, avg=3630362851.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3641], 5.00th=[ 3641], 10.00th=[ 3641], 20.00th=[ 3641], | 30.00th=[ 3641], 40.00th=[ 3641], 50.00th=[ 3641], 60.00th=[ 3641], | 70.00th=[ 3641], 80.00th=[ 3641], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1382KiB/s (1415kB/s)(8192KiB/5927msec); 0 zone resets clat (msec): min=728, max=1563, avg=1146.14, stdev=590.26 lat (msec): min=729, max=1563, avg=1146.65, stdev=590.02 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.91%, ctx=636, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179713: Sat Sep 5 12:38:20 2026 write: IOPS=0, BW=2093KiB/s (2144kB/s)(12.0MiB/5870msec); 0 zone resets clat (msec): min=277, max=4736, avg=1956.02, stdev=2424.98 lat (msec): min=278, max=4736, avg=1956.24, stdev=2424.96 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 4732], 80.00th=[ 4732], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 7861, max= 8126, per=100.00%, avg=7993.50, stdev=187.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.04%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179714: Sat Sep 5 12:38:20 2026 write: IOPS=0, BW=2257KiB/s (2311kB/s)(12.0MiB/5445msec); 0 zone resets clat (msec): min=347, max=3541, avg=1813.94, stdev=1612.53 lat (msec): min=348, max=3541, avg=1814.50, stdev=1612.38 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 3540], 80.00th=[ 3540], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 7861, max= 8143, per=100.00%, avg=8002.00, stdev=199.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.71%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2764KiB/s (2831kB/s), 691KiB/s-2277KiB/s (708kB/s-2331kB/s), io=16.0MiB (16.8MB), run=5397-5927msec WRITE: bw=5529KiB/s (5661kB/s), 1382KiB/s-2257KiB/s (1415kB/s-2311kB/s), io=32.0MiB (33.6MB), run=5445-5927msec