== sanity test 398b: DIO and buffer IO race ============== 14:36:44 (1787855804) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.41236 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179801: Thu Aug 27 14:39:00 2026 read: IOPS=12, BW=51.4KiB/s (52.7kB/s)(5992KiB/116523msec) clat (usec): min=41, max=672683, avg=41343.69, stdev=31475.64 lat (usec): min=42, max=672684, avg=41344.80, stdev=31475.57 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 98], 10.00th=[ 13435], 20.00th=[ 19792], | 30.00th=[ 24773], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[154141], 99.90th=[225444], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 119, per=24.73%, avg=50.94, stdev=21.56, samples=229 iops : min= 1, max= 29, avg=12.08, stdev= 5.43, samples=229 write: IOPS=13, BW=54.0KiB/s (55.3kB/s)(6296KiB/116523msec); 0 zone resets clat (usec): min=932, max=288353, avg=34421.16, stdev=37121.71 lat (usec): min=933, max=288355, avg=34422.59, stdev=37121.62 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1614], 20.00th=[ 3425], | 30.00th=[ 6587], 40.00th=[ 15533], 50.00th=[ 25035], 60.00th=[ 33162], | 70.00th=[ 43779], 80.00th=[ 58459], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[164627], 99.50th=[189793], 99.90th=[274727], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 119, per=24.83%, avg=53.39, stdev=21.88, samples=230 iops : min= 1, max= 29, avg=12.70, stdev= 5.49, samples=230 lat (usec) : 50=0.59%, 100=1.86%, 250=0.03%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.32%, 4=4.95%, 10=7.45%, 20=11.00%, 50=39.26% lat (msec) : 100=24.06%, 250=4.07%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.20%, ctx=6604, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179802: Thu Aug 27 14:39:00 2026 read: IOPS=13, BW=52.0KiB/s (53.3kB/s)(5940KiB/114176msec) clat (usec): min=37, max=265371, avg=40963.24, stdev=27350.34 lat (usec): min=37, max=265396, avg=40969.92, stdev=27351.48 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 570], 10.00th=[ 14222], 20.00th=[ 20055], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[123208], 99.50th=[149947], 99.90th=[233833], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 126, per=25.05%, avg=51.60, stdev=21.15, samples=224 iops : min= 1, max= 31, avg=12.25, stdev= 5.33, samples=224 write: IOPS=13, BW=55.6KiB/s (56.9kB/s)(6348KiB/114176msec); 0 zone resets clat (usec): min=972, max=767031, avg=33357.79, stdev=40303.50 lat (usec): min=973, max=767032, avg=33359.97, stdev=40303.30 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1188], 10.00th=[ 1401], 20.00th=[ 2769], | 30.00th=[ 5800], 40.00th=[ 12518], 50.00th=[ 22676], 60.00th=[ 30802], | 70.00th=[ 41157], 80.00th=[ 58983], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[149947], 99.50th=[175113], 99.90th=[233833], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 135, per=25.58%, avg=55.00, stdev=23.68, samples=224 iops : min= 1, max= 33, avg=13.10, stdev= 5.98, samples=224 lat (usec) : 50=0.49%, 100=1.73%, 250=0.20%, 750=0.07%, 1000=0.13% lat (msec) : 2=7.62%, 4=5.34%, 10=6.87%, 20=11.43%, 50=38.51% lat (msec) : 100=23.08%, 250=4.49%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.32%, ctx=6424, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179803: Thu Aug 27 14:39:00 2026 read: IOPS=13, BW=52.1KiB/s (53.3kB/s)(6028KiB/115735msec) clat (usec): min=42, max=783636, avg=42205.23, stdev=34367.95 lat (usec): min=43, max=783637, avg=42206.54, stdev=34367.83 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 95], 10.00th=[ 13960], 20.00th=[ 20579], | 30.00th=[ 25560], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[129500], 99.50th=[183501], 99.90th=[346031], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 119, per=25.01%, avg=51.53, stdev=20.87, samples=228 iops : min= 1, max= 29, avg=12.23, stdev= 5.24, samples=228 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6260KiB/115735msec); 0 zone resets clat (usec): min=943, max=267330, avg=33030.58, stdev=34544.65 lat (usec): min=944, max=267331, avg=33033.39, stdev=34544.36 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1450], 20.00th=[ 3130], | 30.00th=[ 6849], 40.00th=[ 14877], 50.00th=[ 23987], 60.00th=[ 31851], | 70.00th=[ 43779], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[149947], 99.50th=[168821], 99.90th=[235930], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=53.62, stdev=22.43, samples=227 iops : min= 1, max= 29, avg=12.75, stdev= 5.63, samples=227 lat (usec) : 50=0.26%, 100=2.21%, 250=0.20%, 750=0.03%, 1000=0.13% lat (msec) : 2=7.29%, 4=4.92%, 10=6.15%, 20=10.87%, 50=40.04% lat (msec) : 100=23.57%, 250=4.20%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.32%, ctx=6555, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179804: Thu Aug 27 14:39:00 2026 read: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6052KiB/116438msec) clat (usec): min=33, max=659093, avg=42258.33, stdev=31277.88 lat (usec): min=33, max=659094, avg=42263.97, stdev=31278.64 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 545], 10.00th=[ 14484], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[126354], 99.50th=[160433], 99.90th=[210764], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 8, max= 111, per=24.90%, avg=51.29, stdev=20.21, samples=230 iops : min= 2, max= 27, avg=12.17, stdev= 5.09, samples=230 write: IOPS=13, BW=53.6KiB/s (54.8kB/s)(6236KiB/116438msec); 0 zone resets clat (usec): min=951, max=296367, avg=33401.17, stdev=35349.54 lat (usec): min=951, max=296369, avg=33404.29, stdev=35349.56 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1614], 20.00th=[ 3654], | 30.00th=[ 6783], 40.00th=[ 12780], 50.00th=[ 23462], 60.00th=[ 31589], | 70.00th=[ 43254], 80.00th=[ 58459], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[149947], 99.50th=[173016], 99.90th=[225444], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 135, per=24.65%, avg=53.00, stdev=23.81, samples=229 iops : min= 1, max= 33, avg=12.61, stdev= 5.98, samples=229 lat (usec) : 50=0.39%, 100=1.79%, 250=0.20%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=6.05%, 4=5.21%, 10=7.75%, 20=10.64%, 50=39.26% lat (msec) : 100=24.06%, 250=4.36%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.25%, ctx=6468, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=206KiB/s (211kB/s), 51.4KiB/s-52.1KiB/s (52.7kB/s-53.3kB/s), io=23.4MiB (24.6MB), run=114176-116523msec WRITE: bw=216KiB/s (221kB/s), 53.6KiB/s-55.6KiB/s (54.8kB/s-56.9kB/s), io=24.6MiB (25.7MB), run=114176-116523msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179806: Thu Aug 27 14:39:35 2026 read: IOPS=10, BW=40.0KiB/s (40.0kB/s)(5992KiB/149657msec) clat (msec): min=5, max=693, avg=39.49, stdev=40.92 lat (msec): min=5, max=693, avg=39.50, stdev=40.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 87], 95.00th=[ 114], | 99.00th=[ 176], 99.50th=[ 226], 99.90th=[ 372], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 152, per=25.29%, avg=40.21, stdev=29.39, samples=291 iops : min= 1, max= 38, avg= 9.40, stdev= 7.42, samples=291 write: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6296KiB/149657msec); 0 zone resets clat (msec): min=7, max=356, avg=57.42, stdev=42.90 lat (msec): min=7, max=356, avg=57.43, stdev=42.90 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 207], 99.50th=[ 271], 99.90th=[ 342], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 144, per=25.37%, avg=42.11, stdev=28.57, samples=292 iops : min= 1, max= 36, avg= 9.88, stdev= 7.21, samples=292 lat (msec) : 10=4.00%, 20=19.60%, 50=42.48%, 100=23.21%, 250=10.29% lat (msec) : 500=0.39%, 750=0.03% cpu : usr=0.06%, sys=1.82%, ctx=4775, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179807: Thu Aug 27 14:39:35 2026 read: IOPS=9, BW=39.7KiB/s (40.7kB/s)(5940KiB/149474msec) clat (msec): min=5, max=833, avg=39.54, stdev=41.98 lat (msec): min=5, max=833, avg=39.54, stdev=41.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 60], 90.00th=[ 90], 95.00th=[ 118], | 99.00th=[ 174], 99.50th=[ 213], 99.90th=[ 268], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 205, per=25.10%, avg=39.90, stdev=30.72, samples=290 iops : min= 1, max= 51, avg= 9.32, stdev= 7.76, samples=290 write: IOPS=10, BW=42.5KiB/s (43.5kB/s)(6348KiB/149474msec); 0 zone resets clat (msec): min=10, max=319, avg=57.11, stdev=41.86 lat (msec): min=10, max=319, avg=57.11, stdev=41.86 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 55], | 70.00th=[ 70], 80.00th=[ 87], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 207], 99.50th=[ 257], 99.90th=[ 309], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 144, per=25.45%, avg=42.25, stdev=28.66, samples=292 iops : min= 1, max= 36, avg= 9.91, stdev= 7.25, samples=292 lat (msec) : 10=3.97%, 20=20.18%, 50=41.60%, 100=23.14%, 250=10.74% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=1.81%, ctx=4695, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179808: Thu Aug 27 14:39:35 2026 read: IOPS=10, BW=40.0KiB/s (40.0kB/s)(6028KiB/150670msec) clat (msec): min=5, max=296, avg=40.12, stdev=38.99 lat (msec): min=5, max=296, avg=40.12, stdev=38.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 93], 95.00th=[ 122], | 99.00th=[ 194], 99.50th=[ 222], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 176, per=25.27%, avg=40.18, stdev=28.52, samples=293 iops : min= 1, max= 44, avg= 9.39, stdev= 7.22, samples=293 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6260KiB/150670msec); 0 zone resets clat (msec): min=9, max=849, avg=57.57, stdev=48.65 lat (msec): min=9, max=849, avg=57.57, stdev=48.65 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 245], 99.50th=[ 292], 99.90th=[ 363], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 135, per=25.22%, avg=41.86, stdev=28.95, samples=292 iops : min= 1, max= 33, avg= 9.82, stdev= 7.32, samples=292 lat (msec) : 10=3.97%, 20=18.85%, 50=43.82%, 100=22.30%, 250=10.42% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.06%, sys=1.74%, ctx=4797, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179809: Thu Aug 27 14:39:35 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6052KiB/148579msec) clat (msec): min=5, max=376, avg=39.18, stdev=39.27 lat (msec): min=5, max=376, avg=39.18, stdev=39.27 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 88], 95.00th=[ 118], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 347], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 198, per=26.10%, avg=41.50, stdev=30.88, samples=284 iops : min= 1, max= 49, avg= 9.72, stdev= 7.80, samples=284 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6236KiB/148579msec); 0 zone resets clat (msec): min=7, max=845, avg=57.22, stdev=46.88 lat (msec): min=7, max=845, avg=57.22, stdev=46.89 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 222], 99.50th=[ 247], 99.90th=[ 334], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 135, per=25.10%, avg=41.67, stdev=28.95, samples=291 iops : min= 1, max= 33, avg= 9.76, stdev= 7.32, samples=291 lat (msec) : 10=4.04%, 20=20.87%, 50=41.73%, 100=22.40%, 250=10.55% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.05%, sys=1.76%, ctx=4794, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (163kB/s), 39.7KiB/s-40.7KiB/s (40.7kB/s-41.7kB/s), io=23.4MiB (24.6MB), run=148579-150670msec WRITE: bw=167KiB/s (171kB/s), 41.5KiB/s-42.5KiB/s (42.5kB/s-43.5kB/s), io=24.6MiB (25.7MB), run=148579-150670msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179855: Thu Aug 27 14:40:18 2026 read: IOPS=11, BW=192KiB/s (197kB/s)(5920KiB/30843msec) clat (usec): min=41, max=324938, avg=45252.82, stdev=34463.35 lat (usec): min=41, max=324940, avg=45265.09, stdev=34477.13 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 161], 20.00th=[ 20841], | 30.00th=[ 26608], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 54789], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[168821], 99.50th=[185598], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 477, per=25.51%, avg=191.83, stdev=91.05, samples=60 iops : min= 1, max= 29, avg=11.18, stdev= 5.72, samples=60 write: IOPS=12, BW=206KiB/s (211kB/s)(6368KiB/30843msec); 0 zone resets clat (usec): min=1358, max=199306, avg=35328.11, stdev=34223.53 lat (usec): min=1361, max=199308, avg=35335.83, stdev=34232.16 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2245], 10.00th=[ 3032], 20.00th=[ 5276], | 30.00th=[ 8979], 40.00th=[ 18482], 50.00th=[ 26084], 60.00th=[ 33162], | 70.00th=[ 45876], 80.00th=[ 61080], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[132645], 99.50th=[156238], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 61, max= 444, per=26.19%, avg=207.13, stdev=90.18, samples=60 iops : min= 3, max= 27, avg=12.15, stdev= 5.61, samples=60 lat (usec) : 50=0.65%, 100=3.78%, 250=0.39%, 500=0.13% lat (msec) : 2=2.21%, 4=4.69%, 10=10.42%, 20=8.59%, 50=38.28% lat (msec) : 100=25.52%, 250=5.21%, 500=0.13% cpu : usr=0.06%, sys=5.42%, ctx=1674, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179856: Thu Aug 27 14:40:18 2026 read: IOPS=11, BW=180KiB/s (185kB/s)(5744KiB/31846msec) clat (usec): min=40, max=165817, avg=46740.61, stdev=29109.96 lat (usec): min=40, max=165818, avg=46745.06, stdev=29109.99 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 15533], 20.00th=[ 23987], | 30.00th=[ 29754], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 66323], 90.00th=[ 85459], 95.00th=[101188], | 99.00th=[139461], 99.50th=[158335], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 48, max= 351, per=23.87%, avg=179.53, stdev=67.14, samples=62 iops : min= 3, max= 21, avg=10.44, stdev= 4.21, samples=62 write: IOPS=12, BW=205KiB/s (210kB/s)(6544KiB/31846msec); 0 zone resets clat (usec): min=1465, max=323929, avg=36734.71, stdev=38793.36 lat (usec): min=1466, max=323930, avg=36737.13, stdev=38793.53 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2311], 10.00th=[ 3228], 20.00th=[ 5997], | 30.00th=[ 10028], 40.00th=[ 17957], 50.00th=[ 26084], 60.00th=[ 33424], | 70.00th=[ 47449], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[181404], 99.50th=[210764], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 507, per=25.83%, avg=204.32, stdev=101.92, samples=62 iops : min= 1, max= 31, avg=11.97, stdev= 6.46, samples=62 lat (usec) : 50=0.26%, 100=2.60%, 500=0.26% lat (msec) : 2=1.69%, 4=5.21%, 10=9.38%, 20=10.03%, 50=37.50% lat (msec) : 100=27.99%, 250=4.95%, 500=0.13% cpu : usr=0.07%, sys=5.49%, ctx=1653, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179857: Thu Aug 27 14:40:18 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31111msec) clat (usec): min=37, max=228689, avg=43224.01, stdev=28290.23 lat (usec): min=38, max=228690, avg=43226.69, stdev=28289.95 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 90], 10.00th=[ 16188], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[152044], 99.50th=[154141], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 62, max= 382, per=26.80%, avg=201.53, stdev=76.96, samples=60 iops : min= 3, max= 23, avg=11.82, stdev= 4.84, samples=60 write: IOPS=12, BW=194KiB/s (199kB/s)(6032KiB/31111msec); 0 zone resets clat (usec): min=1424, max=271340, avg=37614.48, stdev=38094.49 lat (usec): min=1425, max=271342, avg=37616.53, stdev=38094.51 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2376], 10.00th=[ 3458], 20.00th=[ 6849], | 30.00th=[ 11731], 40.00th=[ 17957], 50.00th=[ 26608], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 61604], 90.00th=[ 94897], 95.00th=[115868], | 99.00th=[166724], 99.50th=[183501], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 61, max= 381, per=24.11%, avg=190.73, stdev=78.59, samples=60 iops : min= 3, max= 23, avg=11.12, stdev= 4.95, samples=60 lat (usec) : 50=0.26%, 100=2.73%, 250=0.52%, 750=0.13% lat (msec) : 2=1.69%, 4=4.04%, 10=8.07%, 20=11.59%, 50=41.54% lat (msec) : 100=23.31%, 250=5.99%, 500=0.13% cpu : usr=0.06%, sys=5.41%, ctx=1706, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179858: Thu Aug 27 14:40:18 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6032KiB/29952msec) clat (usec): min=49, max=172614, avg=44530.55, stdev=29447.29 lat (usec): min=50, max=172616, avg=44541.71, stdev=29450.21 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 1369], 20.00th=[ 23200], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 55313], 80.00th=[ 64750], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[156238], 99.50th=[166724], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 62, max= 445, per=26.66%, avg=200.48, stdev=81.71, samples=58 iops : min= 3, max= 27, avg=11.76, stdev= 5.11, samples=58 write: IOPS=13, BW=209KiB/s (214kB/s)(6256KiB/29952msec); 0 zone resets clat (usec): min=1488, max=214866, avg=33531.47, stdev=35069.61 lat (usec): min=1489, max=214870, avg=33533.49, stdev=35069.64 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2114], 10.00th=[ 2966], 20.00th=[ 4883], | 30.00th=[ 7504], 40.00th=[ 15008], 50.00th=[ 22414], 60.00th=[ 30802], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[147850], 99.50th=[181404], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 27, max= 414, per=26.44%, avg=209.10, stdev=88.12, samples=58 iops : min= 1, max= 25, avg=12.29, stdev= 5.54, samples=58 lat (usec) : 50=0.13%, 100=4.17%, 250=0.39%, 1000=0.13% lat (msec) : 2=2.21%, 4=6.38%, 10=9.51%, 20=9.11%, 50=37.76% lat (msec) : 100=25.26%, 250=4.95% cpu : usr=0.05%, sys=5.52%, ctx=1656, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=752KiB/s (770kB/s), 180KiB/s-201KiB/s (185kB/s-206kB/s), io=23.4MiB (24.5MB), run=29952-31846msec WRITE: bw=791KiB/s (810kB/s), 194KiB/s-209KiB/s (199kB/s-214kB/s), io=24.6MiB (25.8MB), run=29952-31846msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179850: Thu Aug 27 14:40:28 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(5920KiB/42645msec) clat (msec): min=7, max=263, avg=43.75, stdev=38.28 lat (msec): min=7, max=263, avg=43.78, stdev=38.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 65], 90.00th=[ 89], 95.00th=[ 128], | 99.00th=[ 194], 99.50th=[ 213], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 30, max= 373, per=24.61%, avg=138.04, stdev=84.02, samples=81 iops : min= 1, max= 23, avg= 7.85, stdev= 5.31, samples=81 write: IOPS=9, BW=149KiB/s (153kB/s)(6368KiB/42645msec); 0 zone resets clat (msec): min=12, max=403, avg=65.89, stdev=48.06 lat (msec): min=13, max=403, avg=65.89, stdev=48.06 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 74], 80.00th=[ 97], 90.00th=[ 127], 95.00th=[ 159], | 99.00th=[ 218], 99.50th=[ 359], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 378, per=25.23%, avg=148.85, stdev=83.48, samples=82 iops : min= 1, max= 23, avg= 8.55, stdev= 5.27, samples=82 lat (msec) : 10=1.04%, 20=13.80%, 50=46.48%, 100=24.87%, 250=13.41% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.78%, ctx=1149, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179851: Thu Aug 27 14:40:28 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5744KiB/42334msec) clat (msec): min=7, max=297, avg=43.13, stdev=39.49 lat (msec): min=7, max=297, avg=43.14, stdev=39.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 128], | 99.00th=[ 188], 99.50th=[ 207], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 22, max= 435, per=25.00%, avg=140.24, stdev=88.35, samples=80 iops : min= 1, max= 27, avg= 8.00, stdev= 5.54, samples=80 write: IOPS=9, BW=155KiB/s (158kB/s)(6544KiB/42334msec); 0 zone resets clat (msec): min=13, max=276, avg=64.88, stdev=39.80 lat (msec): min=13, max=276, avg=64.89, stdev=39.79 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 79], 80.00th=[ 96], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 201], 99.50th=[ 213], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 378, per=26.06%, avg=153.78, stdev=85.26, samples=83 iops : min= 1, max= 23, avg= 8.84, stdev= 5.39, samples=83 lat (msec) : 10=0.91%, 20=13.41%, 50=45.70%, 100=26.56%, 250=13.15% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.74%, ctx=1077, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179852: Thu Aug 27 14:40:28 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(6256KiB/42436msec) clat (msec): min=7, max=194, avg=42.87, stdev=34.62 lat (msec): min=7, max=194, avg=42.87, stdev=34.62 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 123], | 99.00th=[ 167], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 31, max= 447, per=26.32%, avg=147.66, stdev=98.56, samples=83 iops : min= 1, max= 27, avg= 8.46, stdev= 6.15, samples=83 write: IOPS=8, BW=142KiB/s (146kB/s)(6032KiB/42436msec); 0 zone resets clat (msec): min=16, max=362, avg=67.87, stdev=46.60 lat (msec): min=16, max=362, avg=67.88, stdev=46.60 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 72], 80.00th=[ 93], 90.00th=[ 134], 95.00th=[ 176], | 99.00th=[ 203], 99.50th=[ 279], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 404, per=23.70%, avg=139.82, stdev=71.73, samples=83 iops : min= 1, max= 25, avg= 7.98, stdev= 4.53, samples=83 lat (msec) : 10=0.39%, 20=13.41%, 50=45.44%, 100=27.86%, 250=12.63% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.73%, ctx=1096, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179853: Thu Aug 27 14:40:28 2026 read: IOPS=8, BW=142KiB/s (146kB/s)(6032KiB/42403msec) clat (msec): min=8, max=263, avg=42.93, stdev=37.21 lat (msec): min=8, max=263, avg=42.94, stdev=37.21 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 92], 95.00th=[ 133], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 30, max= 415, per=25.43%, avg=142.68, stdev=85.03, samples=82 iops : min= 1, max= 25, avg= 8.16, stdev= 5.34, samples=82 write: IOPS=9, BW=148KiB/s (151kB/s)(6256KiB/42403msec); 0 zone resets clat (msec): min=16, max=395, avg=66.27, stdev=46.18 lat (msec): min=16, max=395, avg=66.35, stdev=46.17 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 94], 90.00th=[ 120], 95.00th=[ 150], | 99.00th=[ 234], 99.50th=[ 359], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 56, max= 383, per=24.98%, avg=147.37, stdev=78.65, samples=83 iops : min= 3, max= 23, avg= 8.45, stdev= 4.93, samples=83 lat (msec) : 10=0.26%, 20=11.72%, 50=50.00%, 100=24.87%, 250=12.63% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.81%, ctx=1058, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=562KiB/s (575kB/s), 136KiB/s-147KiB/s (139kB/s-151kB/s), io=23.4MiB (24.5MB), run=42334-42645msec WRITE: bw=591KiB/s (605kB/s), 142KiB/s-155KiB/s (146kB/s-158kB/s), io=24.6MiB (25.8MB), run=42334-42645msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179879: Thu Aug 27 14:40:43 2026 read: IOPS=2, BW=2171KiB/s (2224kB/s)(7168KiB/3301msec) clat (msec): min=33, max=373, avg=183.20, stdev=126.70 lat (msec): min=33, max=373, avg=183.20, stdev=126.70 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 178], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 284], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2019, max= 4087, per=57.47%, avg=2736.75, stdev=968.83, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1551KiB/s (1588kB/s)(5120KiB/3301msec); 0 zone resets clat (msec): min=122, max=554, avg=351.28, stdev=176.14 lat (msec): min=122, max=555, avg=351.36, stdev=176.11 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1899, max= 4039, per=39.93%, avg=2662.00, stdev=1194.84, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=14.85%, ctx=219, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179881: Thu Aug 27 14:40:43 2026 read: IOPS=0, BW=476KiB/s (488kB/s)(2048KiB/4300msec) clat (usec): min=535, max=525472, avg=263004.11, stdev=371186.40 lat (usec): min=536, max=525474, avg=263005.44, stdev=371187.17 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 537], 60.00th=[526386], | 70.00th=[526386], 80.00th=[526386], 90.00th=[526386], 95.00th=[526386], | 99.00th=[526386], 99.50th=[526386], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 1400, max= 1899, per=34.64%, avg=1649.50, stdev=352.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2381KiB/s (2439kB/s)(10.0MiB/4300msec); 0 zone resets clat (msec): min=148, max=746, avg=362.08, stdev=196.82 lat (msec): min=148, max=746, avg=362.21, stdev=196.78 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 186], | 30.00th=[ 205], 40.00th=[ 236], 50.00th=[ 275], 60.00th=[ 334], | 70.00th=[ 435], 80.00th=[ 447], 90.00th=[ 609], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1946, max= 4096, per=39.83%, avg=2655.67, stdev=1005.62, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=15.63%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179882: Thu Aug 27 14:40:43 2026 read: IOPS=1, BW=1756KiB/s (1798kB/s)(6144KiB/3499msec) clat (usec): min=481, max=237425, avg=140660.75, stdev=110836.86 lat (usec): min=482, max=237426, avg=140661.84, stdev=110836.82 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 1303], | 30.00th=[ 1303], 40.00th=[181404], 50.00th=[181404], 60.00th=[187696], | 70.00th=[235930], 80.00th=[235930], 90.00th=[238027], 95.00th=[238027], | 99.00th=[238027], 99.50th=[238027], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 1928, max= 4087, per=70.66%, avg=3364.67, stdev=1244.20, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1756KiB/s (1798kB/s)(6144KiB/3499msec); 0 zone resets clat (msec): min=120, max=693, avg=416.22, stdev=223.56 lat (msec): min=120, max=693, avg=416.27, stdev=223.55 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 443], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1899, max= 4047, per=37.60%, avg=2507.00, stdev=1028.85, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=13.18%, ctx=209, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179883: Thu Aug 27 14:40:43 2026 read: IOPS=1, BW=1859KiB/s (1904kB/s)(5120KiB/2754msec) clat (usec): min=326, max=297321, avg=102824.90, stdev=143058.94 lat (usec): min=326, max=297322, avg=102825.76, stdev=143059.18 clat percentiles (usec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 461], 40.00th=[ 461], 50.00th=[ 775], 60.00th=[ 775], | 70.00th=[214959], 80.00th=[214959], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2603KiB/s (2665kB/s)(7168KiB/2754msec); 0 zone resets clat (msec): min=110, max=701, avg=316.67, stdev=183.71 lat (msec): min=110, max=701, avg=316.91, stdev=183.63 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 241], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 266], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 334], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 2048, max= 4087, per=44.93%, avg=2995.50, stdev=1100.38, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=19.65%, ctx=86, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4763KiB/s (4877kB/s), 476KiB/s-2171KiB/s (488kB/s-2224kB/s), io=20.0MiB (20.0MB), run=2754-4300msec WRITE: bw=6668KiB/s (6828kB/s), 1551KiB/s-2603KiB/s (1588kB/s-2665kB/s), io=28.0MiB (29.4MB), run=2754-4300msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179884: Thu Aug 27 14:40:44 2026 read: IOPS=1, BW=1812KiB/s (1855kB/s)(7168KiB/3956msec) clat (msec): min=86, max=410, avg=187.51, stdev=113.46 lat (msec): min=86, max=410, avg=187.51, stdev=113.46 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 90], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 190], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 222], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2019, max= 4112, per=57.49%, avg=2554.50, stdev=1038.40, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1294KiB/s (1325kB/s)(5120KiB/3956msec); 0 zone resets clat (msec): min=282, max=1109, avg=518.55, stdev=339.72 lat (msec): min=282, max=1109, avg=518.71, stdev=339.68 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 2035, max= 4087, per=43.78%, avg=2723.33, stdev=1180.99, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=5.31%, ctx=106, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179885: Thu Aug 27 14:40:44 2026 read: IOPS=0, BW=444KiB/s (455kB/s)(2048KiB/4609msec) clat (msec): min=342, max=411, avg=377.34, stdev=48.83 lat (msec): min=342, max=414, avg=378.45, stdev=50.40 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1458, max= 2019, per=39.13%, avg=1738.50, stdev=396.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2222KiB/s (2275kB/s)(10.0MiB/4609msec); 0 zone resets clat (msec): min=109, max=728, avg=359.86, stdev=209.18 lat (msec): min=109, max=728, avg=359.96, stdev=209.15 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 144], | 30.00th=[ 190], 40.00th=[ 199], 50.00th=[ 317], 60.00th=[ 321], | 70.00th=[ 506], 80.00th=[ 527], 90.00th=[ 558], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1921, max= 4071, per=43.10%, avg=2681.00, stdev=1044.36, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=6.27%, ctx=143, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179886: Thu Aug 27 14:40:44 2026 read: IOPS=1, BW=1473KiB/s (1508kB/s)(6144KiB/4172msec) clat (msec): min=83, max=505, avg=192.11, stdev=161.42 lat (msec): min=83, max=505, avg=192.11, stdev=161.42 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 140], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1921, max= 4039, per=56.48%, avg=2509.50, stdev=1021.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1473KiB/s (1508kB/s)(6144KiB/4172msec); 0 zone resets clat (msec): min=174, max=990, avg=481.23, stdev=338.44 lat (msec): min=174, max=991, avg=481.30, stdev=338.43 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 388], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 2019, max= 2864, per=36.03%, avg=2241.25, stdev=415.30, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=5.06%, ctx=138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179887: Thu Aug 27 14:40:44 2026 read: IOPS=1, BW=1224KiB/s (1253kB/s)(5120KiB/4184msec) clat (msec): min=66, max=395, avg=191.74, stdev=124.59 lat (msec): min=66, max=395, avg=191.74, stdev=124.59 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 4039, max= 4087, per=91.45%, avg=4063.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1713KiB/s (1754kB/s)(7168KiB/4184msec); 0 zone resets clat (msec): min=140, max=893, avg=421.03, stdev=286.14 lat (msec): min=140, max=893, avg=421.14, stdev=286.20 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 157], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 388], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 709], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1408, max= 2039, per=30.30%, avg=1884.40, stdev=270.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.54%, ctx=89, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4443KiB/s (4550kB/s), 444KiB/s-1812KiB/s (455kB/s-1855kB/s), io=20.0MiB (20.0MB), run=3956-4609msec WRITE: bw=6221KiB/s (6370kB/s), 1294KiB/s-2222KiB/s (1325kB/s-2275kB/s), io=28.0MiB (29.4MB), run=3956-4609msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179896: Thu Aug 27 14:41:00 2026 read: IOPS=1, BW=5018KiB/s (5138kB/s)(12.0MiB/2449msec) clat (msec): min=369, max=1153, avg=761.32, stdev=392.07 lat (msec): min=369, max=1153, avg=761.32, stdev=392.07 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.86%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179898: Thu Aug 27 14:41:00 2026 read: IOPS=0, BW=1180KiB/s (1208kB/s)(4096KiB/3471msec) clat (nsec): min=2037.6M, max=2037.6M, avg=2037604011.00, stdev= 0.00 lat (nsec): min=2037.6M, max=2037.6M, avg=2037610504.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2039], 5.00th=[ 2039], 10.00th=[ 2039], 20.00th=[ 2039], | 30.00th=[ 2039], 40.00th=[ 2039], 50.00th=[ 2039], 60.00th=[ 2039], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2360KiB/s (2417kB/s)(8192KiB/3471msec); 0 zone resets clat (msec): min=320, max=901, avg=611.20, stdev=410.66 lat (msec): min=321, max=901, avg=611.68, stdev=410.54 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.57%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179899: Thu Aug 27 14:41:00 2026 write: IOPS=2, BW=9204KiB/s (9425kB/s)(12.0MiB/1335msec); 0 zone resets clat (msec): min=243, max=772, avg=432.70, stdev=294.60 lat (msec): min=244, max=775, avg=434.22, stdev=295.91 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7801, max= 8031, per=83.86%, avg=7916.00, stdev=162.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.55%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179901: Thu Aug 27 14:41:00 2026 write: IOPS=1, BW=4546KiB/s (4655kB/s)(12.0MiB/2703msec); 0 zone resets clat (msec): min=409, max=1669, avg=863.08, stdev=699.80 lat (msec): min=409, max=1669, avg=863.53, stdev=699.70 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 5728, max= 7892, per=72.14%, avg=6810.00, stdev=1530.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.40%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4720KiB/s (4834kB/s), 1180KiB/s-5018KiB/s (1208kB/s-5138kB/s), io=16.0MiB (16.8MB), run=2449-3471msec WRITE: bw=9441KiB/s (9667kB/s), 2360KiB/s-9204KiB/s (2417kB/s-9425kB/s), io=32.0MiB (33.6MB), run=1335-3471msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179894: Thu Aug 27 14:41:00 2026 read: IOPS=0, BW=3947KiB/s (4042kB/s)(12.0MiB/3113msec) clat (msec): min=915, max=1013, avg=974.77, stdev=52.16 lat (msec): min=915, max=1013, avg=974.77, stdev=52.16 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7757, max= 8192, per=100.00%, avg=7974.50, stdev=307.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.03%, sys=10.70%, ctx=441, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179895: Thu Aug 27 14:41:00 2026 read: IOPS=0, BW=1562KiB/s (1600kB/s)(4096KiB/2622msec) clat (nsec): min=1148.9M, max=1148.9M, avg=1148932884.00, stdev= 0.00 lat (nsec): min=1148.9M, max=1148.9M, avg=1148935349.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3124KiB/s (3199kB/s)(8192KiB/2622msec); 0 zone resets clat (msec): min=511, max=877, avg=694.65, stdev=258.86 lat (msec): min=511, max=879, avg=695.62, stdev=259.80 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8192, max= 8192, per=87.95%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.14%, ctx=212, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179897: Thu Aug 27 14:41:00 2026 write: IOPS=0, BW=3493KiB/s (3577kB/s)(12.0MiB/3518msec); 0 zone resets clat (msec): min=408, max=1868, avg=1130.91, stdev=730.04 lat (msec): min=408, max=1868, avg=1131.18, stdev=729.96 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8192, max= 8192, per=87.95%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.04%, ctx=47, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179900: Thu Aug 27 14:41:00 2026 write: IOPS=1, BW=4688KiB/s (4801kB/s)(12.0MiB/2621msec); 0 zone resets clat (msec): min=316, max=1826, avg=823.29, stdev=869.09 lat (msec): min=316, max=1827, avg=823.81, stdev=869.01 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 6320, max= 7757, per=75.57%, avg=7038.50, stdev=1016.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.74%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5263KiB/s (5389kB/s), 1562KiB/s-3947KiB/s (1600kB/s-4042kB/s), io=16.0MiB (16.8MB), run=2622-3113msec WRITE: bw=9314KiB/s (9538kB/s), 3124KiB/s-4688KiB/s (3199kB/s-4801kB/s), io=32.0MiB (33.6MB), run=2621-3518msec