== sanity test 398b: DIO and buffer IO race ============== 00:29:13 (1788841753) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.85482 s, 10.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179655: Tue Sep 8 00:31:15 2026 read: IOPS=14, BW=56.5KiB/s (57.9kB/s)(5992KiB/105997msec) clat (usec): min=44, max=843402, avg=39460.99, stdev=34010.25 lat (usec): min=45, max=843403, avg=39464.15, stdev=34010.74 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 9241], 10.00th=[ 13960], 20.00th=[ 19006], | 30.00th=[ 22938], 40.00th=[ 27132], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[130548], 99.50th=[149947], 99.90th=[238027], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 135, per=24.91%, avg=56.31, stdev=23.31, samples=209 iops : min= 1, max= 33, avg=13.44, stdev= 5.88, samples=209 write: IOPS=14, BW=59.4KiB/s (60.8kB/s)(6296KiB/105997msec); 0 zone resets clat (usec): min=874, max=189433, avg=29497.88, stdev=31346.65 lat (usec): min=876, max=189435, avg=29512.44, stdev=31341.63 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1582], 20.00th=[ 3228], | 30.00th=[ 5538], 40.00th=[ 11338], 50.00th=[ 20055], 60.00th=[ 28181], | 70.00th=[ 38536], 80.00th=[ 52167], 90.00th=[ 70779], 95.00th=[ 94897], | 99.00th=[135267], 99.50th=[156238], 99.90th=[166724], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 7, max= 190, per=25.07%, avg=59.41, stdev=25.88, samples=208 iops : min= 1, max= 47, avg=14.23, stdev= 6.51, samples=208 lat (usec) : 50=0.42%, 100=1.37%, 250=0.20%, 500=0.03%, 1000=0.13% lat (msec) : 2=6.58%, 4=5.40%, 10=8.30%, 20=14.16%, 50=40.01% lat (msec) : 100=19.43%, 250=3.94%, 1000=0.03% cpu : usr=0.08%, sys=6.14%, ctx=6649, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179657: Tue Sep 8 00:31:15 2026 read: IOPS=14, BW=56.2KiB/s (57.5kB/s)(5940KiB/105731msec) clat (usec): min=41, max=334617, avg=37757.97, stdev=27834.86 lat (usec): min=42, max=334618, avg=37761.76, stdev=27834.73 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9634], 10.00th=[ 13435], 20.00th=[ 18482], | 30.00th=[ 22938], 40.00th=[ 26608], 50.00th=[ 31851], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[133694], 99.50th=[156238], 99.90th=[252707], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 127, per=24.68%, avg=55.77, stdev=24.05, samples=208 iops : min= 1, max= 31, avg=13.31, stdev= 6.07, samples=208 write: IOPS=15, BW=60.0KiB/s (61.5kB/s)(6348KiB/105731msec); 0 zone resets clat (usec): min=871, max=818639, avg=31047.64, stdev=37950.95 lat (usec): min=872, max=818641, avg=31049.97, stdev=37953.27 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1254], 10.00th=[ 1827], 20.00th=[ 3556], | 30.00th=[ 6980], 40.00th=[ 14877], 50.00th=[ 22152], 60.00th=[ 29230], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 70779], 95.00th=[ 92799], | 99.00th=[152044], 99.50th=[179307], 99.90th=[274727], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 150, per=25.38%, avg=60.14, stdev=27.83, samples=206 iops : min= 1, max= 37, avg=14.40, stdev= 6.99, samples=206 lat (usec) : 50=0.23%, 100=1.43%, 250=0.10%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=5.92%, 4=5.40%, 10=7.03%, 20=15.43%, 50=42.25% lat (msec) : 100=18.29%, 250=3.45%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=6.22%, ctx=6613, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179659: Tue Sep 8 00:31:15 2026 read: IOPS=14, BW=57.1KiB/s (58.4kB/s)(6028KiB/105616msec) clat (usec): min=25, max=740634, avg=38291.48, stdev=34253.17 lat (usec): min=25, max=740635, avg=38294.99, stdev=34254.96 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 163], 10.00th=[ 12911], 20.00th=[ 17957], | 30.00th=[ 21890], 40.00th=[ 26346], 50.00th=[ 30540], 60.00th=[ 36439], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 70779], 95.00th=[ 90702], | 99.00th=[154141], 99.50th=[181404], 99.90th=[265290], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 126, per=25.31%, avg=57.20, stdev=24.64, samples=207 iops : min= 1, max= 31, avg=13.67, stdev= 6.20, samples=207 write: IOPS=14, BW=59.3KiB/s (60.7kB/s)(6260KiB/105616msec); 0 zone resets clat (usec): min=865, max=222609, avg=30370.38, stdev=32767.31 lat (usec): min=877, max=222611, avg=30373.40, stdev=32766.28 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1287], 10.00th=[ 1795], 20.00th=[ 3621], | 30.00th=[ 6718], 40.00th=[ 13698], 50.00th=[ 20841], 60.00th=[ 28443], | 70.00th=[ 38011], 80.00th=[ 51643], 90.00th=[ 71828], 95.00th=[ 92799], | 99.00th=[152044], 99.50th=[191890], 99.90th=[217056], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 166, per=24.91%, avg=59.05, stdev=27.85, samples=208 iops : min= 1, max= 41, avg=14.14, stdev= 7.01, samples=208 lat (usec) : 50=0.39%, 100=1.95%, 250=0.16%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.02%, 4=5.08%, 10=7.91%, 20=15.53%, 50=40.49% lat (msec) : 100=18.36%, 250=3.78%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=6.38%, ctx=6617, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179662: Tue Sep 8 00:31:15 2026 read: IOPS=14, BW=57.2KiB/s (58.6kB/s)(6052KiB/105806msec) clat (usec): min=34, max=204092, avg=38450.50, stdev=26129.52 lat (usec): min=34, max=204093, avg=38454.99, stdev=26130.37 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 7046], 10.00th=[ 13829], 20.00th=[ 18482], | 30.00th=[ 22938], 40.00th=[ 27919], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[130548], 99.50th=[141558], 99.90th=[187696], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 7, max= 126, per=25.48%, avg=57.59, stdev=23.46, samples=205 iops : min= 1, max= 31, avg=13.78, stdev= 5.94, samples=205 write: IOPS=14, BW=58.9KiB/s (60.4kB/s)(6236KiB/105806msec); 0 zone resets clat (usec): min=951, max=758607, avg=30253.15, stdev=37658.53 lat (usec): min=952, max=758610, avg=30259.99, stdev=37662.73 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1762], 20.00th=[ 3326], | 30.00th=[ 5669], 40.00th=[ 11207], 50.00th=[ 19268], 60.00th=[ 26870], | 70.00th=[ 36963], 80.00th=[ 51643], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[156238], 99.90th=[304088], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 158, per=24.83%, avg=58.84, stdev=27.63, samples=207 iops : min= 1, max= 39, avg=14.08, stdev= 6.93, samples=207 lat (usec) : 50=0.29%, 100=1.63%, 250=0.36%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.05%, 4=6.09%, 10=7.91%, 20=14.65%, 50=39.81% lat (msec) : 100=18.91%, 250=4.00%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=6.20%, ctx=6720, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=227KiB/s (232kB/s), 56.2KiB/s-57.2KiB/s (57.5kB/s-58.6kB/s), io=23.4MiB (24.6MB), run=105616-105997msec WRITE: bw=237KiB/s (243kB/s), 58.9KiB/s-60.0KiB/s (60.4kB/s-61.5kB/s), io=24.6MiB (25.7MB), run=105616-105997msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179656: Tue Sep 8 00:31:47 2026 read: IOPS=10, BW=43.3KiB/s (44.4kB/s)(5992KiB/138337msec) clat (msec): min=4, max=842, avg=36.44, stdev=43.90 lat (msec): min=4, max=842, avg=36.44, stdev=43.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 334], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 152, per=25.13%, avg=43.48, stdev=32.02, samples=270 iops : min= 1, max= 38, avg=10.26, stdev= 8.04, samples=270 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6296KiB/138337msec); 0 zone resets clat (msec): min=9, max=336, avg=52.98, stdev=40.58 lat (msec): min=9, max=336, avg=52.99, stdev=40.58 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 61], 80.00th=[ 82], 90.00th=[ 109], 95.00th=[ 134], | 99.00th=[ 207], 99.50th=[ 222], 99.90th=[ 321], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 135, per=25.31%, avg=45.82, stdev=31.24, samples=269 iops : min= 1, max= 33, avg=10.84, stdev= 7.87, samples=269 lat (msec) : 10=4.62%, 20=23.73%, 50=43.00%, 100=18.91%, 250=9.38% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.07%, sys=2.09%, ctx=4921, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179658: Tue Sep 8 00:31:47 2026 read: IOPS=10, BW=43.2KiB/s (44.2kB/s)(5940KiB/137638msec) clat (msec): min=5, max=711, avg=36.04, stdev=41.27 lat (msec): min=5, max=711, avg=36.04, stdev=41.27 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 82], 95.00th=[ 108], | 99.00th=[ 203], 99.50th=[ 230], 99.90th=[ 384], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 160, per=25.35%, avg=43.86, stdev=32.02, samples=264 iops : min= 1, max= 40, avg=10.34, stdev= 8.06, samples=264 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6348KiB/137638msec); 0 zone resets clat (msec): min=9, max=337, avg=52.78, stdev=40.50 lat (msec): min=9, max=337, avg=52.78, stdev=40.50 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 48], | 70.00th=[ 60], 80.00th=[ 77], 90.00th=[ 106], 95.00th=[ 132], | 99.00th=[ 213], 99.50th=[ 249], 99.90th=[ 296], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 136, per=25.49%, avg=46.15, stdev=30.35, samples=268 iops : min= 1, max= 34, avg=10.92, stdev= 7.63, samples=268 lat (msec) : 10=4.39%, 20=22.53%, 50=44.30%, 100=19.76%, 250=8.66% lat (msec) : 500=0.33%, 750=0.03% cpu : usr=0.05%, sys=2.11%, ctx=4829, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179660: Tue Sep 8 00:31:47 2026 read: IOPS=11, BW=44.1KiB/s (45.1kB/s)(6028KiB/136837msec) clat (msec): min=5, max=294, avg=35.75, stdev=37.33 lat (msec): min=5, max=294, avg=35.75, stdev=37.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 81], 95.00th=[ 110], | 99.00th=[ 194], 99.50th=[ 234], 99.90th=[ 288], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 167, per=25.75%, avg=44.54, stdev=31.67, samples=265 iops : min= 1, max= 41, avg=10.52, stdev= 7.96, samples=265 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6260KiB/136837msec); 0 zone resets clat (msec): min=9, max=729, avg=52.77, stdev=43.33 lat (msec): min=9, max=729, avg=52.77, stdev=43.33 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 47], | 70.00th=[ 61], 80.00th=[ 78], 90.00th=[ 103], 95.00th=[ 130], | 99.00th=[ 205], 99.50th=[ 255], 99.90th=[ 342], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 135, per=25.36%, avg=45.91, stdev=30.52, samples=267 iops : min= 1, max= 33, avg=10.87, stdev= 7.68, samples=267 lat (msec) : 10=4.92%, 20=21.68%, 50=44.63%, 100=20.25%, 250=8.17% lat (msec) : 500=0.33%, 750=0.03% cpu : usr=0.06%, sys=2.17%, ctx=4805, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179661: Tue Sep 8 00:31:47 2026 read: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6052KiB/137638msec) clat (msec): min=4, max=271, avg=35.35, stdev=35.80 lat (msec): min=4, max=271, avg=35.35, stdev=35.80 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 79], 95.00th=[ 108], | 99.00th=[ 180], 99.50th=[ 224], 99.90th=[ 262], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 136, per=26.03%, avg=45.04, stdev=30.98, samples=262 iops : min= 1, max= 34, avg=10.65, stdev= 7.78, samples=262 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6236KiB/137638msec); 0 zone resets clat (msec): min=10, max=728, avg=53.75, stdev=44.67 lat (msec): min=10, max=728, avg=53.75, stdev=44.67 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 47], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 107], 95.00th=[ 130], | 99.00th=[ 222], 99.50th=[ 253], 99.90th=[ 347], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 143, per=25.14%, avg=45.51, stdev=29.79, samples=267 iops : min= 1, max= 35, avg=10.76, stdev= 7.50, samples=267 lat (msec) : 10=4.79%, 20=22.95%, 50=43.49%, 100=19.99%, 250=8.43% lat (msec) : 500=0.33%, 750=0.03% cpu : usr=0.06%, sys=2.19%, ctx=4838, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.2KiB/s-44.1KiB/s (44.2kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=136837-138337msec WRITE: bw=182KiB/s (186kB/s), 45.3KiB/s-46.1KiB/s (46.4kB/s-47.2kB/s), io=24.6MiB (25.7MB), run=136837-138337msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179703: Tue Sep 8 00:32:22 2026 read: IOPS=14, BW=236KiB/s (241kB/s)(5920KiB/25127msec) clat (usec): min=50, max=117313, avg=35579.86, stdev=20548.63 lat (usec): min=51, max=117314, avg=35580.78, stdev=20548.66 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 109], 10.00th=[ 14091], 20.00th=[ 20841], | 30.00th=[ 24249], 40.00th=[ 27657], 50.00th=[ 32637], 60.00th=[ 37487], | 70.00th=[ 42730], 80.00th=[ 49546], 90.00th=[ 61604], 95.00th=[ 71828], | 99.00th=[107480], 99.50th=[111674], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 95, max= 415, per=25.50%, avg=234.39, stdev=70.69, samples=49 iops : min= 5, max= 25, avg=13.94, stdev= 4.44, samples=49 write: IOPS=15, BW=253KiB/s (260kB/s)(6368KiB/25127msec); 0 zone resets clat (usec): min=1448, max=138994, avg=29703.57, stdev=26834.77 lat (usec): min=1449, max=138996, avg=29709.34, stdev=26834.18 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2245], 10.00th=[ 2966], 20.00th=[ 4948], | 30.00th=[ 8455], 40.00th=[ 14746], 50.00th=[ 22414], 60.00th=[ 30278], | 70.00th=[ 39584], 80.00th=[ 53216], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[107480], 99.50th=[114820], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 95, max= 541, per=26.25%, avg=253.84, stdev=91.58, samples=49 iops : min= 5, max= 33, avg=15.16, stdev= 5.70, samples=49 lat (usec) : 100=2.21%, 250=0.52%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.82%, 4=6.51%, 10=9.90%, 20=11.85%, 50=45.96% lat (msec) : 100=19.40%, 250=1.56% cpu : usr=0.06%, sys=7.83%, ctx=1800, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179704: Tue Sep 8 00:32:22 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(5744KiB/25764msec) clat (usec): min=39, max=220899, avg=37505.74, stdev=26629.89 lat (usec): min=39, max=220900, avg=37507.61, stdev=26630.54 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 84], 10.00th=[ 13042], 20.00th=[ 20317], | 30.00th=[ 24249], 40.00th=[ 27919], 50.00th=[ 31851], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 52167], 90.00th=[ 72877], 95.00th=[ 84411], | 99.00th=[125305], 99.50th=[183501], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 63, max= 352, per=24.22%, avg=222.58, stdev=75.16, samples=50 iops : min= 3, max= 22, avg=13.20, stdev= 4.69, samples=50 write: IOPS=15, BW=254KiB/s (260kB/s)(6544KiB/25764msec); 0 zone resets clat (usec): min=1417, max=174056, avg=29834.60, stdev=30129.14 lat (usec): min=1419, max=174057, avg=29840.79, stdev=30128.14 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2245], 10.00th=[ 2835], 20.00th=[ 5145], | 30.00th=[ 8586], 40.00th=[ 15008], 50.00th=[ 21890], 60.00th=[ 27657], | 70.00th=[ 36963], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 88605], | 99.00th=[147850], 99.50th=[164627], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 94, max= 475, per=26.08%, avg=252.16, stdev=93.35, samples=50 iops : min= 5, max= 29, avg=15.06, stdev= 5.94, samples=50 lat (usec) : 50=0.39%, 100=2.73%, 250=0.78%, 500=0.13% lat (msec) : 2=2.21%, 4=5.47%, 10=9.64%, 20=12.24%, 50=45.96% lat (msec) : 100=17.06%, 250=3.39% cpu : usr=0.09%, sys=7.41%, ctx=1831, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179705: Tue Sep 8 00:32:22 2026 read: IOPS=15, BW=240KiB/s (246kB/s)(6256KiB/26051msec) clat (usec): min=46, max=167269, avg=36663.81, stdev=24574.67 lat (usec): min=47, max=167270, avg=36665.02, stdev=24574.27 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 11469], 20.00th=[ 19792], | 30.00th=[ 24249], 40.00th=[ 27657], 50.00th=[ 31851], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 52167], 90.00th=[ 66847], 95.00th=[ 83362], | 99.00th=[123208], 99.50th=[143655], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 88, max= 446, per=26.22%, avg=240.98, stdev=78.82, samples=51 iops : min= 5, max= 27, avg=14.35, stdev= 5.01, samples=51 write: IOPS=14, BW=232KiB/s (237kB/s)(6032KiB/26051msec); 0 zone resets clat (usec): min=1552, max=162961, avg=30244.99, stdev=27962.53 lat (usec): min=1553, max=162963, avg=30246.87, stdev=27962.64 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2343], 10.00th=[ 3589], 20.00th=[ 6456], | 30.00th=[ 9896], 40.00th=[ 15795], 50.00th=[ 22414], 60.00th=[ 30016], | 70.00th=[ 38011], 80.00th=[ 49546], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[112722], 99.50th=[156238], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 88, max= 509, per=23.56%, avg=227.84, stdev=83.51, samples=51 iops : min= 5, max= 31, avg=13.53, stdev= 5.25, samples=51 lat (usec) : 50=0.39%, 100=3.26%, 250=0.78%, 500=0.13%, 750=0.13% lat (msec) : 2=1.69%, 4=4.56%, 10=8.98%, 20=12.89%, 50=46.09% lat (msec) : 100=18.49%, 250=2.60% cpu : usr=0.12%, sys=7.70%, ctx=1928, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179707: Tue Sep 8 00:32:22 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(6032KiB/25953msec) clat (usec): min=47, max=146732, avg=37955.18, stdev=24044.54 lat (usec): min=47, max=146733, avg=37958.34, stdev=24043.86 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 89], 10.00th=[ 13566], 20.00th=[ 19530], | 30.00th=[ 24773], 40.00th=[ 31065], 50.00th=[ 34341], 60.00th=[ 39060], | 70.00th=[ 44827], 80.00th=[ 53216], 90.00th=[ 68682], 95.00th=[ 80217], | 99.00th=[123208], 99.50th=[127402], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 31, max= 407, per=25.25%, avg=232.02, stdev=75.80, samples=51 iops : min= 1, max= 25, avg=13.80, stdev= 4.78, samples=51 write: IOPS=15, BW=241KiB/s (247kB/s)(6256KiB/25953msec); 0 zone resets clat (usec): min=1450, max=159998, avg=29390.87, stdev=29304.11 lat (usec): min=1452, max=160000, avg=29395.30, stdev=29302.94 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2409], 10.00th=[ 3490], 20.00th=[ 4883], | 30.00th=[ 7242], 40.00th=[ 11076], 50.00th=[ 19530], 60.00th=[ 28443], | 70.00th=[ 38011], 80.00th=[ 51643], 90.00th=[ 69731], 95.00th=[ 90702], | 99.00th=[124257], 99.50th=[154141], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 63, max= 384, per=24.89%, avg=240.73, stdev=75.00, samples=51 iops : min= 3, max= 24, avg=14.35, stdev= 4.73, samples=51 lat (usec) : 50=0.13%, 100=2.47%, 250=0.39%, 500=0.39%, 750=0.26% lat (msec) : 2=1.82%, 4=5.86%, 10=12.24%, 20=12.11%, 50=42.06% lat (msec) : 100=19.79%, 250=2.47% cpu : usr=0.10%, sys=7.70%, ctx=1881, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=919KiB/s (941kB/s), 223KiB/s-240KiB/s (228kB/s-246kB/s), io=23.4MiB (24.5MB), run=25127-26051msec WRITE: bw=967KiB/s (991kB/s), 232KiB/s-254KiB/s (237kB/s-260kB/s), io=24.6MiB (25.8MB), run=25127-26051msec fio: pid=179706, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=179706: Tue Sep 8 00:32:31 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5168KiB/32637msec) clat (msec): min=5, max=222, avg=38.45, stdev=32.36 lat (msec): min=5, max=222, avg=38.46, stdev=32.36 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 86], 95.00th=[ 106], | 99.00th=[ 161], 99.50th=[ 165], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 478, per=23.89%, avg=159.37, stdev=99.84, samples=63 iops : min= 1, max= 29, avg= 9.17, stdev= 6.29, samples=63 write: IOPS=10, BW=172KiB/s (176kB/s)(5616KiB/32637msec); 0 zone resets clat (msec): min=15, max=213, avg=57.06, stdev=36.50 lat (msec): min=15, max=213, avg=57.06, stdev=36.49 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 102], 95.00th=[ 127], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 22, max= 446, per=24.55%, avg=172.36, stdev=93.42, samples=64 iops : min= 1, max= 27, avg= 9.98, stdev= 5.87, samples=64 lat (msec) : 10=1.78%, 20=14.37%, 50=50.52%, 100=24.15%, 250=9.04% cpu : usr=0.05%, sys=2.36%, ctx=1069, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=324,351,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179708: Tue Sep 8 00:32:31 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(5744KiB/34779msec) clat (msec): min=6, max=220, avg=35.27, stdev=31.26 lat (msec): min=6, max=220, avg=35.27, stdev=31.26 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 83], 95.00th=[ 102], | 99.00th=[ 132], 99.50th=[ 203], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 447, per=25.34%, avg=168.98, stdev=104.87, samples=66 iops : min= 1, max= 27, avg= 9.76, stdev= 6.62, samples=66 write: IOPS=11, BW=188KiB/s (193kB/s)(6544KiB/34779msec); 0 zone resets clat (msec): min=13, max=207, avg=53.57, stdev=35.45 lat (msec): min=13, max=207, avg=53.57, stdev=35.45 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 105], 95.00th=[ 132], | 99.00th=[ 176], 99.50th=[ 180], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 447, per=26.31%, avg=184.72, stdev=106.72, samples=68 iops : min= 1, max= 27, avg=10.75, stdev= 6.67, samples=68 lat (msec) : 10=2.47%, 20=20.05%, 50=46.48%, 100=22.53%, 250=8.46% cpu : usr=0.07%, sys=2.35%, ctx=1208, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179709: Tue Sep 8 00:32:31 2026 read: IOPS=11, BW=180KiB/s (185kB/s)(6256KiB/34681msec) clat (msec): min=6, max=219, avg=35.81, stdev=32.12 lat (msec): min=6, max=219, avg=35.81, stdev=32.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 83], 95.00th=[ 104], | 99.00th=[ 163], 99.50th=[ 167], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 571, per=27.13%, avg=180.94, stdev=126.85, samples=68 iops : min= 1, max= 35, avg=10.51, stdev= 7.97, samples=68 write: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34681msec); 0 zone resets clat (msec): min=11, max=215, avg=54.59, stdev=37.09 lat (msec): min=11, max=215, avg=54.60, stdev=37.09 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 80], 90.00th=[ 105], 95.00th=[ 128], | 99.00th=[ 188], 99.50th=[ 205], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 32, max= 415, per=24.37%, avg=171.04, stdev=99.91, samples=68 iops : min= 2, max= 25, avg= 9.90, stdev= 6.24, samples=68 lat (msec) : 10=3.65%, 20=19.66%, 50=46.88%, 100=20.83%, 250=8.98% cpu : usr=0.06%, sys=2.39%, ctx=1227, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179710: Tue Sep 8 00:32:31 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34604msec) clat (msec): min=6, max=221, avg=36.67, stdev=32.72 lat (msec): min=6, max=221, avg=36.67, stdev=32.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 53], 90.00th=[ 87], 95.00th=[ 109], | 99.00th=[ 161], 99.50th=[ 186], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 479, per=25.92%, avg=172.87, stdev=105.71, samples=68 iops : min= 1, max= 29, avg=10.00, stdev= 6.64, samples=68 write: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34604msec); 0 zone resets clat (msec): min=13, max=202, avg=52.51, stdev=35.17 lat (msec): min=13, max=202, avg=52.51, stdev=35.17 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 49], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 99], 95.00th=[ 121], | 99.00th=[ 188], 99.50th=[ 201], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 31, max= 447, per=25.79%, avg=181.01, stdev=103.89, samples=68 iops : min= 1, max= 27, avg=10.51, stdev= 6.54, samples=68 lat (msec) : 10=1.95%, 20=20.18%, 50=48.44%, 100=21.35%, 250=8.07% cpu : usr=0.07%, sys=2.47%, ctx=1228, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=667KiB/s (683kB/s), 158KiB/s-180KiB/s (162kB/s-185kB/s), io=22.7MiB (23.8MB), run=32637-34779msec WRITE: bw=703KiB/s (720kB/s), 172KiB/s-188KiB/s (176kB/s-193kB/s), io=23.9MiB (25.0MB), run=32637-34779msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179725: Tue Sep 8 00:32:44 2026 read: IOPS=1, BW=1951KiB/s (1998kB/s)(7168KiB/3674msec) clat (msec): min=145, max=319, avg=223.80, stdev=73.75 lat (msec): min=145, max=319, avg=223.80, stdev=73.75 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 148], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 234], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 300], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1528, max= 4087, per=66.35%, avg=2933.25, stdev=1347.97, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1394KiB/s (1427kB/s)(5120KiB/3674msec); 0 zone resets clat (msec): min=214, max=671, avg=380.37, stdev=180.84 lat (msec): min=214, max=671, avg=380.45, stdev=180.85 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2039, max= 4087, per=44.00%, avg=2723.00, stdev=1181.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=17.86%, ctx=228, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179726: Tue Sep 8 00:32:44 2026 read: IOPS=0, BW=442KiB/s (453kB/s)(2048KiB/4632msec) clat (msec): min=304, max=538, avg=421.90, stdev=165.59 lat (msec): min=304, max=538, avg=421.90, stdev=165.59 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1635, max= 2031, per=41.46%, avg=1833.00, stdev=280.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2211KiB/s (2264kB/s)(10.0MiB/4632msec); 0 zone resets clat (msec): min=144, max=646, avg=358.13, stdev=192.10 lat (msec): min=144, max=646, avg=358.22, stdev=192.10 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 159], | 30.00th=[ 163], 40.00th=[ 236], 50.00th=[ 259], 60.00th=[ 401], | 70.00th=[ 464], 80.00th=[ 489], 90.00th=[ 625], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1892, max= 4087, per=38.05%, avg=2355.17, stdev=850.45, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=25.00% cpu : usr=0.00%, sys=17.49%, ctx=188, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179727: Tue Sep 8 00:32:44 2026 read: IOPS=1, BW=1517KiB/s (1554kB/s)(6144KiB/4049msec) clat (usec): min=590, max=658786, avg=207221.25, stdev=245211.01 lat (usec): min=592, max=658786, avg=207222.58, stdev=245210.64 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 1270], | 30.00th=[ 1270], 40.00th=[110625], 50.00th=[110625], 60.00th=[219153], | 70.00th=[252707], 80.00th=[252707], 90.00th=[658506], 95.00th=[658506], | 99.00th=[658506], 99.50th=[658506], 99.90th=[658506], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 2043, max= 4087, per=76.85%, avg=3397.67, stdev=1173.24, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1517KiB/s (1554kB/s)(6144KiB/4049msec); 0 zone resets clat (msec): min=126, max=839, avg=456.17, stdev=300.26 lat (msec): min=126, max=839, avg=456.25, stdev=300.25 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 659], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2031, max= 3145, per=37.41%, avg=2315.50, stdev=553.03, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=8.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=14.28%, ctx=192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179728: Tue Sep 8 00:32:44 2026 read: IOPS=1, BW=1232KiB/s (1262kB/s)(5120KiB/4155msec) clat (usec): min=568, max=332556, avg=197453.72, stdev=163043.32 lat (usec): min=569, max=332557, avg=197455.10, stdev=163043.33 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 39060], 40.00th=[ 39060], 50.00th=[304088], 60.00th=[304088], | 70.00th=[312476], 80.00th=[312476], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 3785, max= 4063, per=88.76%, avg=3924.00, stdev=196.58, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1725KiB/s (1767kB/s)(7168KiB/4155msec); 0 zone resets clat (msec): min=107, max=969, avg=418.24, stdev=294.96 lat (msec): min=107, max=969, avg=418.33, stdev=294.98 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 257], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 288], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 659], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1600, max= 2043, per=31.20%, avg=1931.25, stdev=220.84, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=15.26%, ctx=171, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4421KiB/s (4528kB/s), 442KiB/s-1951KiB/s (453kB/s-1998kB/s), io=20.0MiB (20.0MB), run=3674-4632msec WRITE: bw=6190KiB/s (6339kB/s), 1394KiB/s-2211KiB/s (1427kB/s-2264kB/s), io=28.0MiB (29.4MB), run=3674-4632msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179721: Tue Sep 8 00:32:44 2026 read: IOPS=1, BW=1594KiB/s (1632kB/s)(7168KiB/4498msec) clat (msec): min=97, max=767, avg=318.50, stdev=246.43 lat (msec): min=97, max=767, avg=318.50, stdev=246.43 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 146], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 167], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 451], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1605, max= 3961, per=55.77%, avg=2314.00, stdev=937.86, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1138KiB/s (1166kB/s)(5120KiB/4498msec); 0 zone resets clat (msec): min=175, max=676, avg=404.50, stdev=190.68 lat (msec): min=175, max=676, avg=404.60, stdev=190.70 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2027, max= 4015, per=46.43%, avg=2696.67, stdev=1141.76, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.43%, ctx=99, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179722: Tue Sep 8 00:32:44 2026 read: IOPS=0, BW=447KiB/s (458kB/s)(2048KiB/4582msec) clat (msec): min=377, max=823, avg=600.73, stdev=315.26 lat (msec): min=377, max=823, avg=600.74, stdev=315.26 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1615, max= 2048, per=44.14%, avg=1831.50, stdev=306.18, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2235KiB/s (2288kB/s)(10.0MiB/4582msec); 0 zone resets clat (msec): min=138, max=448, avg=324.95, stdev=120.31 lat (msec): min=138, max=448, avg=325.02, stdev=120.31 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 182], | 30.00th=[ 209], 40.00th=[ 234], 50.00th=[ 368], 60.00th=[ 397], | 70.00th=[ 405], 80.00th=[ 426], 90.00th=[ 443], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2007, max= 3961, per=45.72%, avg=2655.50, stdev=966.00, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 0.89, samples=6 lat (msec) : 250=33.33%, 500=58.33%, 1000=8.33% cpu : usr=0.00%, sys=6.66%, ctx=112, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179723: Tue Sep 8 00:32:44 2026 read: IOPS=1, BW=1359KiB/s (1392kB/s)(6144KiB/4520msec) clat (msec): min=114, max=855, avg=357.10, stdev=276.74 lat (msec): min=114, max=855, avg=357.11, stdev=276.74 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 355], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 2035, max= 3961, per=60.81%, avg=2523.00, stdev=958.69, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1359KiB/s (1392kB/s)(6144KiB/4520msec); 0 zone resets clat (msec): min=101, max=687, avg=391.72, stdev=234.63 lat (msec): min=102, max=687, avg=391.80, stdev=234.63 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 498], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1921, max= 3121, per=38.86%, avg=2257.25, stdev=576.95, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.97%, ctx=107, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179724: Tue Sep 8 00:32:44 2026 read: IOPS=1, BW=1037KiB/s (1062kB/s)(5120KiB/4936msec) clat (msec): min=41, max=816, avg=375.30, stdev=327.32 lat (msec): min=41, max=816, avg=375.30, stdev=327.32 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 42], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2048, max= 4096, per=65.82%, avg=2730.67, stdev=1182.41, samples=3 iops : min= 2, max= 4, avg= 2.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1452KiB/s (1487kB/s)(7168KiB/4936msec); 0 zone resets clat (msec): min=145, max=859, avg=408.61, stdev=260.48 lat (msec): min=145, max=859, avg=408.68, stdev=260.48 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 199], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 309], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 609], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1597, max= 4096, per=40.41%, avg=2347.00, stdev=994.48, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=16.67%, 750=25.00% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=6.06%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4149KiB/s (4249kB/s), 447KiB/s-1594KiB/s (458kB/s-1632kB/s), io=20.0MiB (20.0MB), run=4498-4936msec WRITE: bw=5809KiB/s (5948kB/s), 1138KiB/s-2235KiB/s (1166kB/s-2288kB/s), io=28.0MiB (29.4MB), run=4498-4936msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179736: Tue Sep 8 00:32:56 2026 read: IOPS=1, BW=5933KiB/s (6076kB/s)(12.0MiB/2071msec) clat (msec): min=624, max=702, avg=675.28, stdev=43.95 lat (msec): min=624, max=702, avg=675.28, stdev=43.95 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 5483, max= 8192, per=100.00%, avg=6837.50, stdev=1915.55, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=20.43%, ctx=407, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179738: Tue Sep 8 00:32:56 2026 read: IOPS=0, BW=1459KiB/s (1494kB/s)(4096KiB/2808msec) clat (nsec): min=702646k, max=702646k, avg=702645730.00, stdev= 0.00 lat (nsec): min=702648k, max=702648k, avg=702647817.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2917KiB/s (2987kB/s)(8192KiB/2808msec); 0 zone resets clat (msec): min=378, max=1676, avg=1027.19, stdev=917.77 lat (msec): min=378, max=1676, avg=1027.52, stdev=917.76 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8175, max= 8175, per=76.85%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.13%, ctx=177, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Tue Sep 8 00:32:56 2026 write: IOPS=0, BW=3990KiB/s (4085kB/s)(12.0MiB/3080msec); 0 zone resets clat (msec): min=861, max=1042, avg=961.32, stdev=92.13 lat (msec): min=861, max=1042, avg=961.69, stdev=92.07 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8126, max= 8175, per=76.62%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.03%, sys=5.29%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Tue Sep 8 00:32:56 2026 write: IOPS=1, BW=5135KiB/s (5258kB/s)(12.0MiB/2393msec); 0 zone resets clat (msec): min=525, max=1032, avg=755.30, stdev=256.87 lat (msec): min=525, max=1032, avg=755.70, stdev=256.92 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8175, max= 8192, per=76.93%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.08%, sys=5.31%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5835KiB/s (5975kB/s), 1459KiB/s-5933KiB/s (1494kB/s-6076kB/s), io=16.0MiB (16.8MB), run=2071-2808msec WRITE: bw=10.4MiB/s (10.9MB/s), 2917KiB/s-5135KiB/s (2987kB/s-5258kB/s), io=32.0MiB (33.6MB), run=2393-3080msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179735: Tue Sep 8 00:32:56 2026 read: IOPS=1, BW=7709KiB/s (7894kB/s)(12.0MiB/1594msec) clat (msec): min=216, max=849, avg=498.59, stdev=322.21 lat (msec): min=216, max=849, avg=498.60, stdev=322.21 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.41%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179737: Tue Sep 8 00:32:56 2026 read: IOPS=0, BW=1273KiB/s (1303kB/s)(4096KiB/3218msec) clat (nsec): min=1216.5M, max=1216.5M, avg=1216453479.00, stdev= 0.00 lat (nsec): min=1216.5M, max=1216.5M, avg=1216454710.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2546KiB/s (2607kB/s)(8192KiB/3218msec); 0 zone resets clat (msec): min=343, max=1458, avg=900.72, stdev=788.24 lat (msec): min=343, max=1458, avg=900.94, stdev=788.15 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8143, max= 8143, per=79.97%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.00%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179739: Tue Sep 8 00:32:56 2026 write: IOPS=0, BW=3959KiB/s (4054kB/s)(12.0MiB/3104msec); 0 zone resets clat (msec): min=619, max=1798, avg=1017.91, stdev=676.37 lat (msec): min=620, max=1799, avg=1018.25, stdev=676.26 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8175, max= 8175, per=80.29%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.83%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179741: Tue Sep 8 00:32:56 2026 write: IOPS=1, BW=4809KiB/s (4925kB/s)(12.0MiB/2555msec); 0 zone resets clat (msec): min=367, max=1124, avg=830.96, stdev=406.10 lat (msec): min=367, max=1124, avg=831.35, stdev=406.14 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8110, max= 8175, per=79.97%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.97%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5091KiB/s (5214kB/s), 1273KiB/s-7709KiB/s (1303kB/s-7894kB/s), io=16.0MiB (16.8MB), run=1594-3218msec WRITE: bw=9.94MiB/s (10.4MB/s), 2546KiB/s-4809KiB/s (2607kB/s-4925kB/s), io=32.0MiB (33.6MB), run=2555-3218msec