== sanity test 398b: DIO and buffer IO race ============== 06:24:53 (1787826293) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.64514 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180632: Thu Aug 27 06:26:59 2026 read: IOPS=13, BW=55.0KiB/s (57.3kB/s)(5992KiB/107055msec) clat (usec): min=41, max=879026, avg=39425.35, stdev=33236.22 lat (usec): min=41, max=879027, avg=39426.35, stdev=33236.23 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10159], 10.00th=[ 14615], 20.00th=[ 19006], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 84411], | 99.00th=[123208], 99.50th=[156238], 99.90th=[193987], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 116, per=25.07%, avg=55.66, stdev=19.91, samples=211 iops : min= 1, max= 29, avg=13.29, stdev= 5.00, samples=211 write: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6296KiB/107055msec); 0 zone resets clat (usec): min=849, max=248219, avg=30323.95, stdev=31750.87 lat (usec): min=850, max=248220, avg=30325.58, stdev=31751.52 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1385], 20.00th=[ 2966], | 30.00th=[ 5800], 40.00th=[ 13435], 50.00th=[ 22152], 60.00th=[ 28967], | 70.00th=[ 38536], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[132645], 99.50th=[160433], 99.90th=[240124], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 125, per=25.21%, avg=58.75, stdev=23.11, samples=210 iops : min= 1, max= 31, avg=14.06, stdev= 5.78, samples=210 lat (usec) : 50=0.33%, 100=1.30%, 250=0.13%, 1000=0.13% lat (msec) : 2=7.62%, 4=4.56%, 10=7.23%, 20=13.90%, 50=40.30% lat (msec) : 100=21.35%, 250=3.12%, 1000=0.03% cpu : usr=0.07%, sys=5.59%, ctx=6498, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180633: Thu Aug 27 06:26:59 2026 read: IOPS=13, BW=55.5KiB/s (56.9kB/s)(5940KiB/106970msec) clat (usec): min=41, max=716097, avg=39523.25, stdev=31182.71 lat (usec): min=41, max=716100, avg=39524.78, stdev=31182.30 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10945], 10.00th=[ 15270], 20.00th=[ 20579], | 30.00th=[ 24249], 40.00th=[ 28181], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 47449], 80.00th=[ 55837], 90.00th=[ 69731], 95.00th=[ 81265], | 99.00th=[143655], 99.50th=[168821], 99.90th=[225444], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 119, per=24.81%, avg=55.08, stdev=21.15, samples=210 iops : min= 1, max= 29, avg=13.14, stdev= 5.31, samples=210 write: IOPS=14, BW=59.3KiB/s (60.8kB/s)(6348KiB/106970msec); 0 zone resets clat (usec): min=987, max=246483, avg=30181.75, stdev=32427.05 lat (usec): min=987, max=246484, avg=30184.74, stdev=32428.24 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1631], 20.00th=[ 3195], | 30.00th=[ 6259], 40.00th=[ 13173], 50.00th=[ 21365], 60.00th=[ 28443], | 70.00th=[ 37487], 80.00th=[ 52167], 90.00th=[ 72877], 95.00th=[ 96994], | 99.00th=[141558], 99.50th=[179307], 99.90th=[193987], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 15, max= 174, per=25.34%, avg=59.03, stdev=22.43, samples=209 iops : min= 3, max= 43, avg=14.13, stdev= 5.65, samples=209 lat (usec) : 50=0.33%, 100=1.30%, 250=0.10%, 500=0.03%, 1000=0.03% lat (msec) : 2=6.74%, 4=5.14%, 10=7.75%, 20=12.76%, 50=41.70% lat (msec) : 100=20.41%, 250=3.68%, 750=0.03% cpu : usr=0.09%, sys=5.53%, ctx=6351, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180634: Thu Aug 27 06:26:59 2026 read: IOPS=14, BW=56.4KiB/s (57.8kB/s)(6028KiB/106795msec) clat (usec): min=39, max=249354, avg=39071.62, stdev=24993.96 lat (usec): min=39, max=249355, avg=39074.48, stdev=24993.10 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10421], 10.00th=[ 15008], 20.00th=[ 19530], | 30.00th=[ 23987], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 55837], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[122160], 99.50th=[154141], 99.90th=[202376], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 16, max= 126, per=25.42%, avg=56.43, stdev=19.16, samples=209 iops : min= 4, max= 31, avg=13.47, stdev= 4.81, samples=209 write: IOPS=14, BW=58.6KiB/s (60.0kB/s)(6260KiB/106795msec); 0 zone resets clat (usec): min=925, max=783540, avg=30393.72, stdev=35312.18 lat (usec): min=926, max=783543, avg=30397.25, stdev=35311.54 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1745], 20.00th=[ 3556], | 30.00th=[ 7242], 40.00th=[ 15008], 50.00th=[ 21627], 60.00th=[ 28967], | 70.00th=[ 38536], 80.00th=[ 51119], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[126354], 99.50th=[143655], 99.90th=[204473], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 134, per=25.04%, avg=58.33, stdev=24.51, samples=210 iops : min= 1, max= 33, avg=13.96, stdev= 6.15, samples=210 lat (usec) : 50=0.46%, 100=1.24%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.99%, 4=4.75%, 10=6.74%, 20=14.42%, 50=42.68% lat (msec) : 100=20.90%, 250=2.38%, 1000=0.03% cpu : usr=0.09%, sys=5.48%, ctx=6408, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180635: Thu Aug 27 06:26:59 2026 read: IOPS=14, BW=56.2KiB/s (57.5kB/s)(6052KiB/107721msec) clat (usec): min=37, max=206650, avg=38732.70, stdev=25006.93 lat (usec): min=37, max=206651, avg=38745.82, stdev=25012.99 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 100], 10.00th=[ 13960], 20.00th=[ 19530], | 30.00th=[ 23462], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 56361], 90.00th=[ 68682], 95.00th=[ 81265], | 99.00th=[121111], 99.50th=[139461], 99.90th=[202376], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 23, max= 116, per=25.28%, avg=56.11, stdev=18.05, samples=211 iops : min= 5, max= 29, avg=13.39, stdev= 4.53, samples=211 write: IOPS=14, BW=57.9KiB/s (59.3kB/s)(6236KiB/107721msec); 0 zone resets clat (usec): min=998, max=749593, avg=31264.12, stdev=37187.05 lat (usec): min=1000, max=749596, avg=31265.94, stdev=37187.22 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1418], 20.00th=[ 3228], | 30.00th=[ 6390], 40.00th=[ 12518], 50.00th=[ 21627], 60.00th=[ 30016], | 70.00th=[ 39584], 80.00th=[ 54264], 90.00th=[ 74974], 95.00th=[ 98042], | 99.00th=[139461], 99.50th=[152044], 99.90th=[238027], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 134, per=24.63%, avg=57.38, stdev=22.19, samples=212 iops : min= 1, max= 33, avg=13.72, stdev= 5.59, samples=212 lat (usec) : 50=0.62%, 100=1.86%, 250=0.23%, 500=0.07%, 1000=0.03% lat (msec) : 2=7.29%, 4=4.59%, 10=7.32%, 20=12.99%, 50=39.97% lat (msec) : 100=21.65%, 250=3.35%, 750=0.03% cpu : usr=0.08%, sys=5.55%, ctx=6493, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=223KiB/s (228kB/s), 55.5KiB/s-56.4KiB/s (56.9kB/s-57.8kB/s), io=23.4MiB (24.6MB), run=106795-107721msec WRITE: bw=233KiB/s (239kB/s), 57.9KiB/s-59.3KiB/s (59.3kB/s-60.8kB/s), io=24.6MiB (25.7MB), run=106795-107721msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180627: Thu Aug 27 06:27:35 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(5992KiB/143941msec) clat (msec): min=5, max=908, avg=37.41, stdev=42.37 lat (msec): min=5, max=908, avg=37.41, stdev=42.37 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 111], | 99.00th=[ 192], 99.50th=[ 209], 99.90th=[ 279], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 151, per=25.62%, avg=42.53, stdev=28.55, samples=274 iops : min= 1, max= 37, avg=10.01, stdev= 7.19, samples=274 write: IOPS=10, BW=43.7KiB/s (44.8kB/s)(6296KiB/143941msec); 0 zone resets clat (msec): min=8, max=312, avg=55.62, stdev=39.55 lat (msec): min=8, max=312, avg=55.62, stdev=39.55 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 82], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 201], 99.50th=[ 241], 99.90th=[ 271], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 134, per=25.07%, avg=43.62, stdev=27.66, samples=281 iops : min= 1, max= 33, avg=10.28, stdev= 6.96, samples=281 lat (msec) : 10=4.00%, 20=19.69%, 50=44.86%, 100=21.58%, 250=9.57% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=1.92%, ctx=4758, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180628: Thu Aug 27 06:27:35 2026 read: IOPS=10, BW=41.3KiB/s (42.3kB/s)(5940KiB/143871msec) clat (msec): min=5, max=819, avg=37.28, stdev=39.61 lat (msec): min=5, max=819, avg=37.29, stdev=39.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 163], 99.50th=[ 197], 99.90th=[ 245], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 150, per=25.11%, avg=41.68, stdev=28.68, samples=278 iops : min= 1, max= 37, avg= 9.79, stdev= 7.22, samples=278 write: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6348KiB/143871msec); 0 zone resets clat (msec): min=10, max=312, avg=55.54, stdev=39.46 lat (msec): min=10, max=312, avg=55.55, stdev=39.45 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 82], 90.00th=[ 106], 95.00th=[ 133], | 99.00th=[ 201], 99.50th=[ 230], 99.90th=[ 296], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 126, per=25.36%, avg=44.12, stdev=26.80, samples=280 iops : min= 1, max= 31, avg=10.41, stdev= 6.75, samples=280 lat (msec) : 10=3.97%, 20=18.65%, 50=45.35%, 100=22.40%, 250=9.38% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=1.86%, ctx=4754, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180629: Thu Aug 27 06:27:35 2026 read: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6028KiB/142815msec) clat (msec): min=5, max=286, avg=36.97, stdev=34.22 lat (msec): min=5, max=286, avg=36.97, stdev=34.22 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 108], | 99.00th=[ 176], 99.50th=[ 197], 99.90th=[ 241], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 126, per=25.43%, avg=42.22, stdev=27.40, samples=278 iops : min= 1, max= 31, avg= 9.92, stdev= 6.89, samples=278 write: IOPS=10, BW=43.8KiB/s (44.9kB/s)(6260KiB/142815msec); 0 zone resets clat (msec): min=8, max=820, avg=55.41, stdev=42.22 lat (msec): min=8, max=820, avg=55.42, stdev=42.22 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 110], 95.00th=[ 128], | 99.00th=[ 186], 99.50th=[ 230], 99.90th=[ 262], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 134, per=24.98%, avg=43.46, stdev=27.12, samples=280 iops : min= 1, max= 33, avg=10.24, stdev= 6.84, samples=280 lat (msec) : 10=3.22%, 20=19.92%, 50=45.87%, 100=21.58%, 250=9.28% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.06%, sys=1.90%, ctx=4791, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180630: Thu Aug 27 06:27:35 2026 read: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6052KiB/143846msec) clat (msec): min=5, max=275, avg=35.82, stdev=32.57 lat (msec): min=5, max=275, avg=35.82, stdev=32.57 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 108], | 99.00th=[ 150], 99.50th=[ 184], 99.90th=[ 209], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 144, per=25.65%, avg=42.58, stdev=28.70, samples=277 iops : min= 1, max= 36, avg=10.01, stdev= 7.24, samples=277 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6236KiB/143846msec); 0 zone resets clat (msec): min=9, max=804, avg=57.27, stdev=44.28 lat (msec): min=9, max=804, avg=57.28, stdev=44.28 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 114], 95.00th=[ 136], | 99.00th=[ 209], 99.50th=[ 232], 99.90th=[ 292], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 126, per=24.65%, avg=42.88, stdev=25.86, samples=283 iops : min= 1, max= 31, avg=10.10, stdev= 6.52, samples=283 lat (msec) : 10=3.68%, 20=19.95%, 50=45.25%, 100=21.16%, 250=9.73% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=1.88%, ctx=4750, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=167KiB/s (171kB/s), 41.3KiB/s-42.2KiB/s (42.3kB/s-43.2kB/s), io=23.4MiB (24.6MB), run=142815-143941msec WRITE: bw=175KiB/s (179kB/s), 43.4KiB/s-44.1KiB/s (44.4kB/s-45.2kB/s), io=24.6MiB (25.7MB), run=142815-143941msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180688: Thu Aug 27 06:28:15 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(5920KiB/28100msec) clat (usec): min=42, max=193729, avg=41011.41, stdev=28292.72 lat (usec): min=42, max=193730, avg=41012.49, stdev=28292.77 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 74], 20.00th=[ 20055], | 30.00th=[ 26346], 40.00th=[ 32900], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 62129], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[126354], 99.50th=[139461], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 62, max= 479, per=25.57%, avg=210.20, stdev=94.04, samples=55 iops : min= 3, max= 29, avg=12.35, stdev= 5.89, samples=55 write: IOPS=14, BW=227KiB/s (232kB/s)(6368KiB/28100msec); 0 zone resets clat (usec): min=1403, max=216973, avg=32420.10, stdev=31281.28 lat (usec): min=1405, max=216975, avg=32436.03, stdev=31274.67 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2008], 10.00th=[ 2802], 20.00th=[ 5669], | 30.00th=[ 9503], 40.00th=[ 16909], 50.00th=[ 23725], 60.00th=[ 32113], | 70.00th=[ 41157], 80.00th=[ 55313], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[127402], 99.50th=[183501], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 95, max= 447, per=26.19%, avg=226.55, stdev=83.18, samples=55 iops : min= 5, max= 27, avg=13.38, stdev= 5.18, samples=55 lat (usec) : 50=1.04%, 100=4.43%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.34%, 4=5.73%, 10=8.33%, 20=10.03%, 50=40.89% lat (msec) : 100=22.53%, 250=4.04% cpu : usr=0.09%, sys=6.27%, ctx=1713, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180689: Thu Aug 27 06:28:15 2026 read: IOPS=12, BW=199KiB/s (203kB/s)(5744KiB/28905msec) clat (usec): min=50, max=181915, avg=42669.57, stdev=28435.48 lat (usec): min=50, max=181916, avg=42676.25, stdev=28427.65 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 12780], 20.00th=[ 20579], | 30.00th=[ 26346], 40.00th=[ 32375], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 52167], 80.00th=[ 65274], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[133694], 99.50th=[154141], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 61, max= 446, per=24.06%, avg=197.73, stdev=83.88, samples=56 iops : min= 3, max= 27, avg=11.55, stdev= 5.25, samples=56 write: IOPS=14, BW=226KiB/s (232kB/s)(6544KiB/28905msec); 0 zone resets clat (usec): min=1427, max=212214, avg=33140.83, stdev=33787.23 lat (usec): min=1429, max=212216, avg=33146.77, stdev=33785.46 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1942], 10.00th=[ 3032], 20.00th=[ 6390], | 30.00th=[ 9765], 40.00th=[ 15401], 50.00th=[ 22938], 60.00th=[ 32375], | 70.00th=[ 42730], 80.00th=[ 54264], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[168821], 99.50th=[185598], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 63, max= 446, per=25.79%, avg=223.12, stdev=90.23, samples=56 iops : min= 3, max= 27, avg=13.16, stdev= 5.63, samples=56 lat (usec) : 100=3.12%, 250=0.52%, 500=0.26% lat (msec) : 2=2.99%, 4=4.17%, 10=9.11%, 20=12.89%, 50=40.23% lat (msec) : 100=22.27%, 250=4.43% cpu : usr=0.09%, sys=6.07%, ctx=1631, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180690: Thu Aug 27 06:28:15 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29130msec) clat (usec): min=38, max=183805, avg=41277.04, stdev=27699.65 lat (usec): min=38, max=183806, avg=41278.43, stdev=27699.92 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 10683], 20.00th=[ 21890], | 30.00th=[ 27395], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[145753], 99.50th=[152044], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 446, per=26.16%, avg=215.04, stdev=92.40, samples=57 iops : min= 1, max= 27, avg=12.65, stdev= 5.77, samples=57 write: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29130msec); 0 zone resets clat (usec): min=1431, max=222618, avg=34354.91, stdev=33247.70 lat (usec): min=1432, max=222621, avg=34363.14, stdev=33249.69 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1795], 10.00th=[ 3261], 20.00th=[ 5932], | 30.00th=[ 9241], 40.00th=[ 17433], 50.00th=[ 26608], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[141558], 99.50th=[181404], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 383, per=23.49%, avg=203.21, stdev=84.82, samples=57 iops : min= 1, max= 23, avg=11.91, stdev= 5.34, samples=57 lat (usec) : 50=0.39%, 100=3.91%, 250=0.52% lat (msec) : 2=2.86%, 4=3.12%, 10=9.64%, 20=8.59%, 50=44.40% lat (msec) : 100=22.53%, 250=4.04% cpu : usr=0.07%, sys=5.90%, ctx=1672, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180691: Thu Aug 27 06:28:15 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(6032KiB/27324msec) clat (usec): min=32, max=143657, avg=39005.10, stdev=27784.60 lat (usec): min=32, max=143658, avg=39006.28, stdev=27784.64 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 18744], | 30.00th=[ 24249], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 56886], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[139461], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 63, max= 381, per=26.11%, avg=214.64, stdev=82.49, samples=53 iops : min= 3, max= 23, avg=12.62, stdev= 5.16, samples=53 write: IOPS=14, BW=229KiB/s (234kB/s)(6256KiB/27324msec); 0 zone resets clat (usec): min=1486, max=218257, avg=32179.74, stdev=35463.91 lat (usec): min=1488, max=218258, avg=32187.68, stdev=35459.74 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1827], 10.00th=[ 2442], 20.00th=[ 4686], | 30.00th=[ 6980], 40.00th=[ 10552], 50.00th=[ 18482], 60.00th=[ 27919], | 70.00th=[ 41681], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[108528], | 99.00th=[145753], 99.50th=[164627], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 63, max= 478, per=26.21%, avg=226.70, stdev=99.66, samples=53 iops : min= 3, max= 29, avg=13.38, stdev= 6.28, samples=53 lat (usec) : 50=0.52%, 100=5.21%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=3.78%, 4=4.82%, 10=10.94%, 20=11.72%, 50=36.20% lat (msec) : 100=21.22%, 250=5.08% cpu : usr=0.08%, sys=6.24%, ctx=1518, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=822KiB/s (842kB/s), 199KiB/s-221KiB/s (203kB/s-226kB/s), io=23.4MiB (24.5MB), run=27324-29130msec WRITE: bw=865KiB/s (886kB/s), 207KiB/s-229KiB/s (212kB/s-234kB/s), io=24.6MiB (25.8MB), run=27324-29130msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180682: Thu Aug 27 06:28:29 2026 read: IOPS=8, BW=135KiB/s (138kB/s)(5920KiB/43955msec) clat (msec): min=7, max=187, avg=47.06, stdev=33.99 lat (msec): min=7, max=187, avg=47.06, stdev=33.99 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 52], 80.00th=[ 64], 90.00th=[ 100], 95.00th=[ 122], | 99.00th=[ 174], 99.50th=[ 180], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 352, per=25.01%, avg=136.03, stdev=71.73, samples=86 iops : min= 1, max= 22, avg= 7.72, stdev= 4.56, samples=86 write: IOPS=9, BW=145KiB/s (148kB/s)(6368KiB/43955msec); 0 zone resets clat (msec): min=16, max=298, avg=66.54, stdev=39.17 lat (msec): min=16, max=298, avg=66.55, stdev=39.17 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 122], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 236], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 318, per=25.19%, avg=144.33, stdev=63.46, samples=87 iops : min= 1, max= 19, avg= 8.24, stdev= 3.98, samples=87 lat (msec) : 10=0.78%, 20=7.81%, 50=46.22%, 100=31.51%, 250=13.54% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.79%, ctx=1204, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180683: Thu Aug 27 06:28:29 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5744KiB/43454msec) clat (msec): min=7, max=210, avg=44.16, stdev=34.32 lat (msec): min=7, max=210, avg=44.16, stdev=34.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 87], 95.00th=[ 124], | 99.00th=[ 174], 99.50th=[ 201], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 348, per=24.55%, avg=133.55, stdev=82.46, samples=85 iops : min= 1, max= 21, avg= 7.56, stdev= 5.26, samples=85 write: IOPS=9, BW=151KiB/s (154kB/s)(6544KiB/43454msec); 0 zone resets clat (msec): min=15, max=283, avg=67.05, stdev=38.54 lat (msec): min=15, max=283, avg=67.06, stdev=38.53 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 66], | 70.00th=[ 80], 80.00th=[ 92], 90.00th=[ 118], 95.00th=[ 142], | 99.00th=[ 192], 99.50th=[ 232], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 346, per=26.18%, avg=149.99, stdev=67.78, samples=86 iops : min= 1, max= 21, avg= 8.60, stdev= 4.28, samples=86 lat (msec) : 10=0.65%, 20=9.90%, 50=45.57%, 100=31.77%, 250=11.98% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.68%, ctx=1076, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180684: Thu Aug 27 06:28:29 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6256KiB/43887msec) clat (msec): min=7, max=219, avg=45.95, stdev=34.22 lat (msec): min=7, max=219, avg=45.95, stdev=34.22 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 51], 80.00th=[ 61], 90.00th=[ 88], 95.00th=[ 130], | 99.00th=[ 178], 99.50th=[ 197], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 320, per=26.29%, avg=143.02, stdev=74.33, samples=86 iops : min= 1, max= 20, avg= 8.16, stdev= 4.70, samples=86 write: IOPS=8, BW=137KiB/s (141kB/s)(6032KiB/43887msec); 0 zone resets clat (msec): min=14, max=233, avg=68.48, stdev=40.08 lat (msec): min=14, max=233, avg=68.49, stdev=40.08 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 68], | 70.00th=[ 81], 80.00th=[ 99], 90.00th=[ 128], 95.00th=[ 150], | 99.00th=[ 201], 99.50th=[ 209], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 318, per=23.67%, avg=135.60, stdev=65.14, samples=86 iops : min= 1, max= 19, avg= 7.70, stdev= 4.11, samples=86 lat (msec) : 10=0.65%, 20=8.59%, 50=46.88%, 100=30.60%, 250=13.28% cpu : usr=0.06%, sys=1.86%, ctx=1286, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180685: Thu Aug 27 06:28:29 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(6032KiB/43355msec) clat (msec): min=8, max=240, avg=48.19, stdev=37.19 lat (msec): min=8, max=240, avg=48.19, stdev=37.19 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 66], 90.00th=[ 101], 95.00th=[ 130], | 99.00th=[ 180], 99.50th=[ 215], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 349, per=25.37%, avg=138.02, stdev=68.91, samples=85 iops : min= 1, max= 21, avg= 7.86, stdev= 4.36, samples=85 write: IOPS=9, BW=144KiB/s (148kB/s)(6256KiB/43355msec); 0 zone resets clat (msec): min=17, max=239, avg=64.05, stdev=36.77 lat (msec): min=17, max=239, avg=64.06, stdev=36.77 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 74], 80.00th=[ 91], 90.00th=[ 120], 95.00th=[ 140], | 99.00th=[ 180], 99.50th=[ 197], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 349, per=25.43%, avg=145.69, stdev=64.59, samples=84 iops : min= 1, max= 21, avg= 8.35, stdev= 4.09, samples=84 lat (msec) : 10=0.52%, 20=8.72%, 50=47.40%, 100=30.86%, 250=12.50% cpu : usr=0.07%, sys=1.86%, ctx=1259, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=545KiB/s (558kB/s), 132KiB/s-143KiB/s (135kB/s-146kB/s), io=23.4MiB (24.5MB), run=43355-43955msec WRITE: bw=573KiB/s (587kB/s), 137KiB/s-151KiB/s (141kB/s-154kB/s), io=24.6MiB (25.8MB), run=43355-43955msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180704: Thu Aug 27 06:28:44 2026 read: IOPS=3, BW=3207KiB/s (3284kB/s)(7168KiB/2235msec) clat (usec): min=399, max=234986, avg=126912.15, stdev=75494.23 lat (usec): min=401, max=234987, avg=126913.84, stdev=75494.21 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 74974], | 30.00th=[119014], 40.00th=[119014], 50.00th=[125305], 60.00th=[149947], | 70.00th=[149947], 80.00th=[183501], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 2031, max= 4458, per=59.74%, avg=3501.33, stdev=1292.47, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2291KiB/s (2346kB/s)(5120KiB/2235msec); 0 zone resets clat (msec): min=99, max=752, avg=264.49, stdev=276.44 lat (msec): min=99, max=752, avg=264.56, stdev=276.42 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1984, max= 6023, per=40.78%, avg=3346.00, stdev=2318.47, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=16.67%, 250=66.67%, 1000=8.33% cpu : usr=0.00%, sys=17.77%, ctx=152, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180705: Thu Aug 27 06:28:44 2026 read: IOPS=0, BW=586KiB/s (600kB/s)(2048KiB/3494msec) clat (usec): min=487, max=429642, avg=215065.11, stdev=303458.02 lat (usec): min=488, max=429644, avg=215066.47, stdev=303458.73 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 490], 40.00th=[ 490], 50.00th=[ 490], 60.00th=[429917], | 70.00th=[429917], 80.00th=[429917], 90.00th=[429917], 95.00th=[429917], | 99.00th=[429917], 99.50th=[429917], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 1467, max= 2048, per=29.99%, avg=1757.50, stdev=410.83, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2931KiB/s (3001kB/s)(10.0MiB/3494msec); 0 zone resets clat (msec): min=91, max=663, avg=279.17, stdev=179.08 lat (msec): min=91, max=663, avg=279.46, stdev=179.20 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 100], | 30.00th=[ 130], 40.00th=[ 140], 50.00th=[ 226], 60.00th=[ 330], | 70.00th=[ 359], 80.00th=[ 372], 90.00th=[ 380], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1984, max= 4096, per=34.60%, avg=2839.40, stdev=1139.49, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=16.15%, ctx=126, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180706: Thu Aug 27 06:28:44 2026 read: IOPS=2, BW=2313KiB/s (2369kB/s)(6144KiB/2656msec) clat (usec): min=442, max=222361, avg=147784.32, stdev=84519.00 lat (usec): min=443, max=222362, avg=147785.38, stdev=84518.97 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 96994], | 30.00th=[ 96994], 40.00th=[168821], 50.00th=[168821], 60.00th=[189793], | 70.00th=[208667], 80.00th=[208667], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 1984, max= 6023, per=57.09%, avg=3346.00, stdev=2318.47, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=2, BW=2313KiB/s (2369kB/s)(6144KiB/2656msec); 0 zone resets clat (msec): min=102, max=502, avg=271.79, stdev=144.57 lat (msec): min=102, max=502, avg=271.86, stdev=144.55 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 275], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1984, max= 2929, per=27.27%, avg=2237.75, stdev=461.23, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=15.56%, ctx=145, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180708: Thu Aug 27 06:28:44 2026 read: IOPS=1, BW=1817KiB/s (1860kB/s)(5120KiB/2818msec) clat (usec): min=441, max=177477, avg=79392.52, stdev=78955.41 lat (usec): min=442, max=177478, avg=79393.67, stdev=78955.20 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 441], | 30.00th=[ 478], 40.00th=[ 478], 50.00th=[ 86508], 60.00th=[ 86508], | 70.00th=[132645], 80.00th=[132645], 90.00th=[177210], 95.00th=[177210], | 99.00th=[177210], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2544KiB/s (2605kB/s)(7168KiB/2818msec); 0 zone resets clat (msec): min=65, max=806, avg=325.67, stdev=291.31 lat (msec): min=65, max=806, avg=325.76, stdev=291.35 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 94], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 169], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 651], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 3968, max= 6144, per=57.58%, avg=4725.00, stdev=1229.81, samples=3 iops : min= 3, max= 6, avg= 4.00, stdev= 1.73, samples=3 lat (usec) : 500=16.67% lat (msec) : 100=25.00%, 250=33.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=15.83%, ctx=142, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5861KiB/s (6002kB/s), 586KiB/s-3207KiB/s (600kB/s-3284kB/s), io=20.0MiB (20.0MB), run=2235-3494msec WRITE: bw=8206KiB/s (8403kB/s), 2291KiB/s-2931KiB/s (2346kB/s-3001kB/s), io=28.0MiB (29.4MB), run=2235-3494msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180709: Thu Aug 27 06:28:44 2026 read: IOPS=2, BW=2271KiB/s (2325kB/s)(7168KiB/3157msec) clat (msec): min=82, max=388, avg=189.92, stdev=130.27 lat (msec): min=82, max=388, avg=189.92, stdev=130.27 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 88], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 129], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 363], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2023, max= 4140, per=48.89%, avg=2730.00, stdev=1221.10, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1622KiB/s (1661kB/s)(5120KiB/3157msec); 0 zone resets clat (msec): min=117, max=807, avg=338.45, stdev=275.54 lat (msec): min=117, max=807, avg=338.53, stdev=275.53 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2023, max= 3953, per=34.12%, avg=2667.67, stdev=1113.13, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.06%, sys=6.27%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180710: Thu Aug 27 06:28:44 2026 read: IOPS=0, BW=638KiB/s (654kB/s)(2048KiB/3209msec) clat (msec): min=88, max=247, avg=167.71, stdev=112.52 lat (msec): min=88, max=247, avg=167.71, stdev=112.52 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 89], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 1372, max= 1976, per=29.98%, avg=1674.00, stdev=427.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3191KiB/s (3268kB/s)(10.0MiB/3209msec); 0 zone resets clat (msec): min=85, max=616, avg=273.57, stdev=170.27 lat (msec): min=85, max=616, avg=273.76, stdev=170.31 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 89], | 30.00th=[ 165], 40.00th=[ 186], 50.00th=[ 194], 60.00th=[ 279], | 70.00th=[ 300], 80.00th=[ 342], 90.00th=[ 481], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1372, max= 4055, per=29.32%, avg=2292.20, stdev=1023.82, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=5.08%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180711: Thu Aug 27 06:28:44 2026 read: IOPS=1, BW=1846KiB/s (1890kB/s)(6144KiB/3328msec) clat (msec): min=60, max=648, avg=250.76, stdev=262.06 lat (msec): min=60, max=648, avg=250.76, stdev=262.06 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 67], | 30.00th=[ 67], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 136], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2023, max= 4055, per=48.38%, avg=2701.67, stdev=1172.02, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1846KiB/s (1890kB/s)(6144KiB/3328msec); 0 zone resets clat (msec): min=108, max=468, avg=292.14, stdev=161.80 lat (msec): min=108, max=468, avg=292.23, stdev=161.80 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 368], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1878, max= 2027, per=25.41%, avg=1986.20, stdev=62.37, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=16.67% cpu : usr=0.06%, sys=6.82%, ctx=124, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180712: Thu Aug 27 06:28:44 2026 read: IOPS=1, BW=1396KiB/s (1430kB/s)(5120KiB/3667msec) clat (msec): min=41, max=197, avg=102.35, stdev=68.16 lat (msec): min=41, max=197, avg=102.35, stdev=68.16 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 42], | 30.00th=[ 60], 40.00th=[ 60], 50.00th=[ 63], 60.00th=[ 63], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1955KiB/s (2002kB/s)(7168KiB/3667msec); 0 zone resets clat (msec): min=43, max=903, avg=430.40, stdev=330.97 lat (msec): min=43, max=903, avg=430.50, stdev=330.97 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 153], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 401], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 726], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2023, max= 2043, per=25.99%, avg=2032.00, stdev= 8.87, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=16.67%, 100=16.67%, 250=33.33%, 500=8.33%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=5.43%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5585KiB/s (5719kB/s), 638KiB/s-2271KiB/s (654kB/s-2325kB/s), io=20.0MiB (20.0MB), run=3157-3667msec WRITE: bw=7819KiB/s (8007kB/s), 1622KiB/s-3191KiB/s (1661kB/s-3268kB/s), io=28.0MiB (29.4MB), run=3157-3667msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180720: Thu Aug 27 06:28:58 2026 read: IOPS=1, BW=5925KiB/s (6067kB/s)(12.0MiB/2074msec) clat (msec): min=615, max=772, avg=668.68, stdev=89.76 lat (msec): min=615, max=772, avg=668.68, stdev=89.76 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=15.87%, ctx=237, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180721: Thu Aug 27 06:28:58 2026 read: IOPS=0, BW=1771KiB/s (1813kB/s)(4096KiB/2313msec) clat (nsec): min=799951k, max=799951k, avg=799950947.00, stdev= 0.00 lat (nsec): min=799953k, max=799953k, avg=799953091.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3542KiB/s (3627kB/s)(8192KiB/2313msec); 0 zone resets clat (msec): min=661, max=781, avg=721.75, stdev=84.90 lat (msec): min=662, max=782, avg=722.06, stdev=84.91 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8110, max= 8110, per=87.18%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.31%, ctx=150, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180722: Thu Aug 27 06:28:58 2026 write: IOPS=0, BW=3936KiB/s (4030kB/s)(12.0MiB/3122msec); 0 zone resets clat (msec): min=313, max=2396, avg=1024.07, stdev=1188.75 lat (msec): min=314, max=2396, avg=1024.49, stdev=1188.87 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8094, max= 8175, per=87.44%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.06%, sys=3.78%, ctx=47, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180723: Thu Aug 27 06:28:58 2026 write: IOPS=0, BW=3489KiB/s (3573kB/s)(12.0MiB/3522msec); 0 zone resets clat (msec): min=472, max=2485, avg=1156.68, stdev=1151.33 lat (msec): min=473, max=2487, avg=1157.59, stdev=1151.80 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 6113, max= 8175, per=76.79%, avg=7144.00, stdev=1458.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.98%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7083KiB/s (7253kB/s), 1771KiB/s-5925KiB/s (1813kB/s-6067kB/s), io=16.0MiB (16.8MB), run=2074-2313msec WRITE: bw=9304KiB/s (9527kB/s), 3489KiB/s-3936KiB/s (3573kB/s-4030kB/s), io=32.0MiB (33.6MB), run=2313-3522msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180724: Thu Aug 27 06:28:58 2026 read: IOPS=1, BW=5692KiB/s (5828kB/s)(12.0MiB/2159msec) clat (msec): min=612, max=750, avg=698.41, stdev=74.80 lat (msec): min=612, max=750, avg=698.41, stdev=74.80 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=3.80%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180725: Thu Aug 27 06:28:58 2026 read: IOPS=0, BW=1376KiB/s (1409kB/s)(4096KiB/2977msec) clat (nsec): min=1323.2M, max=1323.2M, avg=1323225284.00, stdev= 0.00 lat (nsec): min=1323.2M, max=1323.2M, avg=1323227289.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2752KiB/s (2818kB/s)(8192KiB/2977msec); 0 zone resets clat (msec): min=634, max=962, avg=798.42, stdev=232.49 lat (msec): min=634, max=963, avg=798.75, stdev=232.55 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8078, max= 8078, per=92.45%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.10%, sys=3.26%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180726: Thu Aug 27 06:28:58 2026 write: IOPS=0, BW=3307KiB/s (3386kB/s)(12.0MiB/3716msec); 0 zone resets clat (msec): min=340, max=2959, avg=1216.23, stdev=1509.31 lat (msec): min=342, max=2959, avg=1216.98, stdev=1509.10 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 8126, max= 8126, per=93.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.07%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180727: Thu Aug 27 06:28:58 2026 write: IOPS=0, BW=3277KiB/s (3355kB/s)(12.0MiB/3750msec); 0 zone resets clat (msec): min=865, max=1721, avg=1229.33, stdev=442.31 lat (msec): min=866, max=1722, avg=1229.68, stdev=442.32 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8094, max= 8192, per=93.19%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.77%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5504KiB/s (5636kB/s), 1376KiB/s-5692KiB/s (1409kB/s-5828kB/s), io=16.0MiB (16.8MB), run=2159-2977msec WRITE: bw=8738KiB/s (8948kB/s), 2752KiB/s-3307KiB/s (2818kB/s-3386kB/s), io=32.0MiB (33.6MB), run=2977-3750msec