== sanity test 398b: DIO and buffer IO race ============== 16:21:29 (1789590089) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.65127 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174079: Wed Sep 16 16:23:22 2026 read: IOPS=15, BW=61.2KiB/s (62.6kB/s)(5992KiB/97952msec) clat (usec): min=36, max=285892, avg=31445.10, stdev=24389.91 lat (usec): min=36, max=285894, avg=31448.36, stdev=24389.62 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 155], 20.00th=[ 14484], | 30.00th=[ 19006], 40.00th=[ 22676], 50.00th=[ 27132], 60.00th=[ 32637], | 70.00th=[ 39060], 80.00th=[ 46924], 90.00th=[ 59507], 95.00th=[ 71828], | 99.00th=[108528], 99.50th=[121111], 99.90th=[270533], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 127, per=24.65%, avg=60.40, stdev=22.37, samples=194 iops : min= 1, max= 31, avg=14.47, stdev= 5.63, samples=194 write: IOPS=16, BW=64.3KiB/s (65.8kB/s)(6296KiB/97952msec); 0 zone resets clat (usec): min=996, max=634403, avg=32047.49, stdev=34415.18 lat (usec): min=997, max=634403, avg=32050.52, stdev=34414.81 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1532], 10.00th=[ 2409], 20.00th=[ 4146], | 30.00th=[ 8094], 40.00th=[ 15926], 50.00th=[ 24511], 60.00th=[ 32375], | 70.00th=[ 42206], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[130548], 99.50th=[152044], 99.90th=[320865], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 127, per=24.97%, avg=63.91, stdev=21.79, samples=193 iops : min= 1, max= 31, avg=15.35, stdev= 5.50, samples=193 lat (usec) : 50=0.29%, 100=3.65%, 250=1.17%, 500=0.29%, 1000=0.10% lat (msec) : 2=4.00%, 4=5.73%, 10=8.27%, 20=14.58%, 50=41.80% lat (msec) : 100=17.97%, 250=2.02%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=7.75%, ctx=6927, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174080: Wed Sep 16 16:23:22 2026 read: IOPS=15, BW=62.6KiB/s (64.1kB/s)(5940KiB/94828msec) clat (usec): min=32, max=662321, avg=32072.22, stdev=30423.40 lat (usec): min=32, max=662322, avg=32076.14, stdev=30422.35 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 76], 10.00th=[ 3130], 20.00th=[ 15795], | 30.00th=[ 19268], 40.00th=[ 22414], 50.00th=[ 26346], 60.00th=[ 31851], | 70.00th=[ 37487], 80.00th=[ 45351], 90.00th=[ 59507], 95.00th=[ 72877], | 99.00th=[112722], 99.50th=[162530], 99.90th=[387974], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 135, per=25.35%, avg=62.10, stdev=22.78, samples=188 iops : min= 1, max= 33, avg=14.89, stdev= 5.73, samples=188 write: IOPS=16, BW=66.9KiB/s (68.5kB/s)(6348KiB/94828msec); 0 zone resets clat (usec): min=1068, max=230473, avg=29510.40, stdev=29629.54 lat (usec): min=1069, max=230475, avg=29514.76, stdev=29628.69 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1450], 10.00th=[ 2147], 20.00th=[ 3621], | 30.00th=[ 6521], 40.00th=[ 12911], 50.00th=[ 22152], 60.00th=[ 30016], | 70.00th=[ 39060], 80.00th=[ 51643], 90.00th=[ 67634], 95.00th=[ 87557], | 99.00th=[124257], 99.50th=[137364], 99.90th=[214959], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 159, per=26.06%, avg=66.72, stdev=26.16, samples=187 iops : min= 1, max= 39, avg=16.06, stdev= 6.59, samples=187 lat (usec) : 50=0.26%, 100=3.26%, 250=0.75%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.72%, 4=6.71%, 10=8.11%, 20=15.98%, 50=41.50% lat (msec) : 100=15.98%, 250=2.41%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=7.77%, ctx=6775, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174081: Wed Sep 16 16:23:22 2026 read: IOPS=15, BW=61.8KiB/s (63.2kB/s)(6028KiB/97602msec) clat (usec): min=31, max=855390, avg=31811.17, stdev=31741.77 lat (usec): min=32, max=855391, avg=31814.34, stdev=31742.12 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 71], 10.00th=[ 219], 20.00th=[ 14746], | 30.00th=[ 19006], 40.00th=[ 22676], 50.00th=[ 26346], 60.00th=[ 32113], | 70.00th=[ 38536], 80.00th=[ 46924], 90.00th=[ 60031], 95.00th=[ 71828], | 99.00th=[106431], 99.50th=[143655], 99.90th=[238027], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 127, per=25.09%, avg=61.46, stdev=24.26, samples=192 iops : min= 1, max= 31, avg=14.74, stdev= 6.10, samples=192 write: IOPS=16, BW=64.1KiB/s (65.7kB/s)(6260KiB/97602msec); 0 zone resets clat (usec): min=1022, max=376612, avg=31462.26, stdev=32687.64 lat (usec): min=1023, max=376614, avg=31470.77, stdev=32693.43 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1516], 10.00th=[ 2180], 20.00th=[ 3851], | 30.00th=[ 6718], 40.00th=[ 13566], 50.00th=[ 24249], 60.00th=[ 32900], | 70.00th=[ 41157], 80.00th=[ 52691], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[143655], 99.50th=[181404], 99.90th=[214959], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 15, max= 128, per=24.75%, avg=63.37, stdev=24.27, samples=193 iops : min= 3, max= 32, avg=15.21, stdev= 6.11, samples=193 lat (usec) : 50=0.36%, 100=3.78%, 250=0.85%, 500=0.26%, 750=0.16% lat (usec) : 1000=0.07% lat (msec) : 2=4.69%, 4=5.92%, 10=8.14%, 20=15.30%, 50=40.92% lat (msec) : 100=17.09%, 250=2.41%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=7.62%, ctx=6951, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174082: Wed Sep 16 16:23:22 2026 read: IOPS=15, BW=62.4KiB/s (63.9kB/s)(6052KiB/97034msec) clat (usec): min=35, max=658598, avg=31292.31, stdev=28795.56 lat (usec): min=35, max=658598, avg=31295.31, stdev=28795.15 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 69], 10.00th=[ 113], 20.00th=[ 14746], | 30.00th=[ 18744], 40.00th=[ 22938], 50.00th=[ 26608], 60.00th=[ 31327], | 70.00th=[ 37487], 80.00th=[ 46400], 90.00th=[ 57934], 95.00th=[ 71828], | 99.00th=[103285], 99.50th=[116917], 99.90th=[350225], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 15, max= 128, per=25.24%, avg=61.83, stdev=22.78, samples=191 iops : min= 3, max= 32, avg=14.83, stdev= 5.75, samples=191 write: IOPS=16, BW=64.3KiB/s (65.8kB/s)(6236KiB/97034msec); 0 zone resets clat (usec): min=998, max=364726, avg=31618.66, stdev=31964.11 lat (usec): min=1000, max=364727, avg=31620.68, stdev=31964.21 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1532], 10.00th=[ 2278], 20.00th=[ 4359], | 30.00th=[ 7308], 40.00th=[ 15270], 50.00th=[ 24249], 60.00th=[ 32375], | 70.00th=[ 43254], 80.00th=[ 54789], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[135267], 99.50th=[162530], 99.90th=[325059], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 127, per=24.79%, avg=63.46, stdev=22.63, samples=192 iops : min= 1, max= 31, avg=15.24, stdev= 5.70, samples=192 lat (usec) : 50=0.39%, 100=4.23%, 250=0.78%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.30%, 4=5.27%, 10=8.53%, 20=16.11%, 50=40.56% lat (msec) : 100=17.71%, 250=1.76%, 500=0.13%, 750=0.03% cpu : usr=0.10%, sys=7.67%, ctx=6968, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=245KiB/s (251kB/s), 61.2KiB/s-62.6KiB/s (62.6kB/s-64.1kB/s), io=23.4MiB (24.6MB), run=94828-97952msec WRITE: bw=257KiB/s (263kB/s), 64.1KiB/s-66.9KiB/s (65.7kB/s-68.5kB/s), io=24.6MiB (25.7MB), run=94828-97952msec fio: pid=174086, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=174084: Wed Sep 16 16:25:13 2026 read: IOPS=7, BW=28.9KiB/s (29.6kB/s)(5992KiB/207069msec) clat (msec): min=5, max=925, avg=29.84, stdev=34.72 lat (msec): min=5, max=925, avg=29.85, stdev=34.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 61], 95.00th=[ 78], | 99.00th=[ 118], 99.50th=[ 142], 99.90th=[ 321], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 104, per=27.10%, avg=30.35, stdev=19.65, samples=385 iops : min= 1, max= 26, avg= 7.01, stdev= 4.97, samples=385 write: IOPS=7, BW=30.4KiB/s (31.1kB/s)(6296KiB/207069msec); 0 zone resets clat (msec): min=36, max=373, avg=103.06, stdev=46.42 lat (msec): min=36, max=373, avg=103.07, stdev=46.42 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 74], 40.00th=[ 82], 50.00th=[ 89], 60.00th=[ 102], | 70.00th=[ 118], 80.00th=[ 138], 90.00th=[ 167], 95.00th=[ 199], | 99.00th=[ 249], 99.50th=[ 279], 99.90th=[ 338], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 64, per=25.73%, avg=30.10, stdev=12.67, samples=407 iops : min= 1, max= 16, avg= 6.94, stdev= 3.23, samples=407 lat (msec) : 10=4.85%, 20=17.77%, 50=21.58%, 100=33.98%, 250=21.22% lat (msec) : 500=0.55%, 1000=0.03% cpu : usr=0.06%, sys=1.69%, ctx=5611, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174085: Wed Sep 16 16:25:13 2026 read: IOPS=7, BW=28.5KiB/s (29.2kB/s)(5940KiB/208537msec) clat (msec): min=5, max=697, avg=29.36, stdev=31.29 lat (msec): min=5, max=697, avg=29.36, stdev=31.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 58], 95.00th=[ 74], | 99.00th=[ 122], 99.50th=[ 148], 99.90th=[ 342], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 103, per=27.16%, avg=30.42, stdev=19.43, samples=380 iops : min= 1, max= 25, avg= 7.03, stdev= 4.91, samples=380 write: IOPS=7, BW=30.4KiB/s (31.2kB/s)(6348KiB/208537msec); 0 zone resets clat (msec): min=31, max=405, avg=103.84, stdev=46.89 lat (msec): min=31, max=405, avg=103.84, stdev=46.89 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 75], 40.00th=[ 84], 50.00th=[ 93], 60.00th=[ 104], | 70.00th=[ 117], 80.00th=[ 133], 90.00th=[ 165], 95.00th=[ 197], | 99.00th=[ 259], 99.50th=[ 305], 99.90th=[ 401], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 64, per=25.68%, avg=30.05, stdev=12.49, samples=411 iops : min= 1, max= 16, avg= 6.93, stdev= 3.18, samples=411 lat (msec) : 10=4.98%, 20=17.51%, 50=21.78%, 100=32.39%, 250=22.53% lat (msec) : 500=0.78%, 750=0.03% cpu : usr=0.05%, sys=1.69%, ctx=5587, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=174086: Wed Sep 16 16:25:13 2026 read: IOPS=7, BW=28.1KiB/s (28.8kB/s)(5448KiB/193971msec) clat (msec): min=6, max=324, avg=31.84, stdev=28.23 lat (msec): min=6, max=324, avg=31.85, stdev=28.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 62], 95.00th=[ 86], | 99.00th=[ 142], 99.50th=[ 184], 99.90th=[ 236], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 119, per=26.00%, avg=29.12, stdev=19.23, samples=364 iops : min= 1, max= 29, avg= 6.70, stdev= 4.84, samples=364 write: IOPS=7, BW=29.1KiB/s (29.8kB/s)(5648KiB/193971msec); 0 zone resets clat (msec): min=34, max=769, avg=106.49, stdev=51.07 lat (msec): min=34, max=769, avg=106.50, stdev=51.07 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 52], 10.00th=[ 57], 20.00th=[ 68], | 30.00th=[ 77], 40.00th=[ 85], 50.00th=[ 94], 60.00th=[ 106], | 70.00th=[ 120], 80.00th=[ 140], 90.00th=[ 171], 95.00th=[ 203], | 99.00th=[ 259], 99.50th=[ 292], 99.90th=[ 388], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 64, per=24.62%, avg=28.80, stdev=12.62, samples=381 iops : min= 1, max= 16, avg= 6.61, stdev= 3.23, samples=381 lat (msec) : 10=4.11%, 20=16.65%, 50=21.91%, 100=32.90%, 250=23.64% lat (msec) : 500=0.72%, 1000=0.04% cpu : usr=0.06%, sys=1.69%, ctx=4930, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1363,1412,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174087: Wed Sep 16 16:25:13 2026 read: IOPS=7, BW=29.0KiB/s (29.7kB/s)(6052KiB/208650msec) clat (msec): min=5, max=344, avg=30.76, stdev=29.16 lat (msec): min=5, max=344, avg=30.76, stdev=29.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 59], 95.00th=[ 81], | 99.00th=[ 153], 99.50th=[ 226], 99.90th=[ 321], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 127, per=26.90%, avg=30.13, stdev=19.95, samples=391 iops : min= 1, max= 31, avg= 6.94, stdev= 5.02, samples=391 write: IOPS=7, BW=29.9KiB/s (30.6kB/s)(6236KiB/208650msec); 0 zone resets clat (msec): min=34, max=847, avg=103.88, stdev=50.35 lat (msec): min=34, max=847, avg=103.88, stdev=50.35 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 67], | 30.00th=[ 74], 40.00th=[ 82], 50.00th=[ 91], 60.00th=[ 104], | 70.00th=[ 116], 80.00th=[ 136], 90.00th=[ 167], 95.00th=[ 197], | 99.00th=[ 253], 99.50th=[ 300], 99.90th=[ 409], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 64, per=25.20%, avg=29.48, stdev=12.64, samples=411 iops : min= 1, max= 16, avg= 6.79, stdev= 3.24, samples=411 lat (msec) : 10=4.52%, 20=17.55%, 50=21.78%, 100=33.69%, 250=21.71% lat (msec) : 500=0.72%, 1000=0.03% cpu : usr=0.06%, sys=1.70%, ctx=5677, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=112KiB/s (115kB/s), 28.1KiB/s-29.0KiB/s (28.8kB/s-29.7kB/s), io=22.9MiB (23.0MB), run=193971-208650msec WRITE: bw=118KiB/s (120kB/s), 29.1KiB/s-30.4KiB/s (29.8kB/s-31.2kB/s), io=23.0MiB (25.1MB), run=193971-208650msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174129: Wed Sep 16 16:25:44 2026 read: IOPS=16, BW=269KiB/s (276kB/s)(5920KiB/21972msec) clat (usec): min=41, max=144018, avg=29789.34, stdev=25032.44 lat (usec): min=41, max=144020, avg=29792.72, stdev=25030.32 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 117], | 30.00th=[ 17171], 40.00th=[ 23462], 50.00th=[ 26870], 60.00th=[ 32637], | 70.00th=[ 39060], 80.00th=[ 46400], 90.00th=[ 56886], 95.00th=[ 73925], | 99.00th=[121111], 99.50th=[137364], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 64, max= 446, per=24.59%, avg=268.07, stdev=87.51, samples=43 iops : min= 4, max= 27, avg=15.98, stdev= 5.42, samples=43 write: IOPS=18, BW=290KiB/s (297kB/s)(6368KiB/21972msec); 0 zone resets clat (usec): min=1437, max=179281, avg=27076.76, stdev=26695.42 lat (usec): min=1440, max=179284, avg=27080.06, stdev=26695.23 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2409], 10.00th=[ 3195], 20.00th=[ 4424], | 30.00th=[ 6652], 40.00th=[ 9634], 50.00th=[ 18482], 60.00th=[ 27395], | 70.00th=[ 37487], 80.00th=[ 49021], 90.00th=[ 64750], 95.00th=[ 81265], | 99.00th=[103285], 99.50th=[156238], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 126, max= 447, per=25.26%, avg=289.44, stdev=90.26, samples=43 iops : min= 7, max= 27, avg=17.33, stdev= 5.59, samples=43 lat (usec) : 50=0.78%, 100=7.42%, 250=2.47%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.82%, 4=6.90%, 10=13.41%, 20=10.29%, 50=38.80% lat (msec) : 100=16.41%, 250=1.30% cpu : usr=0.10%, sys=8.77%, ctx=1577, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174130: Wed Sep 16 16:25:44 2026 read: IOPS=16, BW=268KiB/s (274kB/s)(5744KiB/21463msec) clat (usec): min=41, max=148067, avg=31122.27, stdev=24813.29 lat (usec): min=41, max=148069, avg=31123.73, stdev=24813.31 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 64], 10.00th=[ 78], 20.00th=[ 709], | 30.00th=[ 19530], 40.00th=[ 24249], 50.00th=[ 28705], 60.00th=[ 33817], | 70.00th=[ 41157], 80.00th=[ 49021], 90.00th=[ 63701], 95.00th=[ 74974], | 99.00th=[115868], 99.50th=[124257], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 63, max= 443, per=24.43%, avg=266.31, stdev=92.64, samples=42 iops : min= 3, max= 27, avg=15.88, stdev= 5.80, samples=42 write: IOPS=19, BW=305KiB/s (312kB/s)(6544KiB/21463msec); 0 zone resets clat (usec): min=1499, max=176640, avg=24759.44, stdev=26716.79 lat (usec): min=1501, max=176642, avg=24765.36, stdev=26716.51 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2376], 10.00th=[ 3097], 20.00th=[ 4293], | 30.00th=[ 6194], 40.00th=[ 9110], 50.00th=[ 14091], 60.00th=[ 21890], | 70.00th=[ 32113], 80.00th=[ 42206], 90.00th=[ 61604], 95.00th=[ 72877], | 99.00th=[114820], 99.50th=[147850], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 127, max= 508, per=26.52%, avg=303.88, stdev=98.83, samples=42 iops : min= 7, max= 31, avg=18.24, stdev= 6.12, samples=42 lat (usec) : 50=0.65%, 100=6.12%, 250=2.08%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=1.95%, 4=7.94%, 10=13.15%, 20=11.46%, 50=38.67% lat (msec) : 100=15.49%, 250=1.56% cpu : usr=0.10%, sys=9.30%, ctx=1525, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174131: Wed Sep 16 16:25:44 2026 read: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21613msec) clat (usec): min=40, max=256850, avg=31475.42, stdev=26120.29 lat (usec): min=41, max=256852, avg=31476.84, stdev=26120.25 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 67], 10.00th=[ 85], 20.00th=[ 5538], | 30.00th=[ 20055], 40.00th=[ 25297], 50.00th=[ 29230], 60.00th=[ 34341], | 70.00th=[ 39584], 80.00th=[ 45876], 90.00th=[ 58983], 95.00th=[ 71828], | 99.00th=[103285], 99.50th=[158335], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 62, max= 447, per=26.84%, avg=292.60, stdev=91.39, samples=42 iops : min= 3, max= 27, avg=17.52, stdev= 5.71, samples=42 write: IOPS=17, BW=279KiB/s (286kB/s)(6032KiB/21613msec); 0 zone resets clat (usec): min=1668, max=117851, avg=24280.99, stdev=24636.31 lat (usec): min=1670, max=117854, avg=24283.60, stdev=24636.28 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2089], 10.00th=[ 2933], 20.00th=[ 4490], | 30.00th=[ 6128], 40.00th=[ 7963], 50.00th=[ 15008], 60.00th=[ 21365], | 70.00th=[ 31065], 80.00th=[ 46400], 90.00th=[ 61080], 95.00th=[ 74974], | 99.00th=[105382], 99.50th=[115868], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 63, max= 479, per=24.20%, avg=277.31, stdev=99.52, samples=42 iops : min= 3, max= 29, avg=16.57, stdev= 6.15, samples=42 lat (usec) : 50=0.65%, 100=5.34%, 250=2.73%, 500=0.65%, 750=0.39% lat (usec) : 1000=0.26% lat (msec) : 2=2.34%, 4=7.03%, 10=12.89%, 20=11.85%, 50=39.32% lat (msec) : 100=15.36%, 250=1.04%, 500=0.13% cpu : usr=0.14%, sys=9.17%, ctx=1574, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174132: Wed Sep 16 16:25:44 2026 read: IOPS=17, BW=279KiB/s (285kB/s)(6032KiB/21654msec) clat (usec): min=39, max=203206, avg=29440.46, stdev=26563.50 lat (usec): min=39, max=203208, avg=29441.80, stdev=26563.69 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 80], 20.00th=[ 147], | 30.00th=[ 17171], 40.00th=[ 22414], 50.00th=[ 26870], 60.00th=[ 32113], | 70.00th=[ 38011], 80.00th=[ 45876], 90.00th=[ 58983], 95.00th=[ 73925], | 99.00th=[121111], 99.50th=[189793], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 32, max= 480, per=25.48%, avg=277.74, stdev=89.92, samples=43 iops : min= 2, max= 30, avg=16.60, stdev= 5.58, samples=43 write: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21654msec); 0 zone resets clat (usec): min=1511, max=224796, avg=26836.91, stdev=27467.67 lat (usec): min=1514, max=224800, avg=26840.21, stdev=27467.32 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2573], 10.00th=[ 3359], 20.00th=[ 5080], | 30.00th=[ 7635], 40.00th=[ 11600], 50.00th=[ 17695], 60.00th=[ 25297], | 70.00th=[ 32637], 80.00th=[ 45351], 90.00th=[ 63701], 95.00th=[ 84411], | 99.00th=[108528], 99.50th=[133694], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 94, max= 448, per=25.21%, avg=288.95, stdev=81.57, samples=43 iops : min= 5, max= 28, avg=17.30, stdev= 5.19, samples=43 lat (usec) : 50=0.39%, 100=7.29%, 250=3.52%, 500=0.91%, 1000=0.13% lat (msec) : 2=1.17%, 4=5.73%, 10=12.24%, 20=12.11%, 50=40.10% lat (msec) : 100=14.71%, 250=1.69% cpu : usr=0.09%, sys=8.92%, ctx=1562, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1090KiB/s (1116kB/s), 268KiB/s-289KiB/s (274kB/s-296kB/s), io=23.4MiB (24.5MB), run=21463-21972msec WRITE: bw=1147KiB/s (1174kB/s), 279KiB/s-305KiB/s (286kB/s-312kB/s), io=24.6MiB (25.8MB), run=21463-21972msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174134: Wed Sep 16 16:26:17 2026 read: IOPS=6, BW=110KiB/s (112kB/s)(5920KiB/53896msec) clat (msec): min=6, max=215, avg=30.43, stdev=29.58 lat (msec): min=6, max=215, avg=30.43, stdev=29.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 38], 90.00th=[ 62], 95.00th=[ 87], | 99.00th=[ 180], 99.50th=[ 207], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 30, max= 447, per=25.89%, avg=114.19, stdev=72.72, samples=101 iops : min= 1, max= 27, avg= 6.36, stdev= 4.54, samples=101 write: IOPS=7, BW=118KiB/s (121kB/s)(6368KiB/53896msec); 0 zone resets clat (msec): min=40, max=293, avg=106.87, stdev=44.83 lat (msec): min=40, max=293, avg=106.88, stdev=44.83 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 81], 40.00th=[ 87], 50.00th=[ 94], 60.00th=[ 107], | 70.00th=[ 120], 80.00th=[ 140], 90.00th=[ 165], 95.00th=[ 203], | 99.00th=[ 259], 99.50th=[ 284], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 24, max= 223, per=25.37%, avg=117.72, stdev=44.98, samples=106 iops : min= 1, max= 13, avg= 6.59, stdev= 2.86, samples=106 lat (msec) : 10=4.30%, 20=18.23%, 50=19.79%, 100=33.07%, 250=24.09% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.89%, ctx=1419, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174135: Wed Sep 16 16:26:17 2026 read: IOPS=6, BW=106KiB/s (108kB/s)(5744KiB/54219msec) clat (msec): min=7, max=332, avg=30.24, stdev=31.46 lat (msec): min=7, max=332, avg=30.24, stdev=31.46 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 65], 95.00th=[ 88], | 99.00th=[ 159], 99.50th=[ 186], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 24, max= 351, per=25.99%, avg=114.63, stdev=69.36, samples=98 iops : min= 1, max= 21, avg= 6.42, stdev= 4.37, samples=98 write: IOPS=7, BW=121KiB/s (124kB/s)(6544KiB/54219msec); 0 zone resets clat (msec): min=38, max=276, avg=105.85, stdev=44.07 lat (msec): min=38, max=276, avg=105.85, stdev=44.07 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 79], 40.00th=[ 87], 50.00th=[ 95], 60.00th=[ 106], | 70.00th=[ 116], 80.00th=[ 136], 90.00th=[ 165], 95.00th=[ 203], | 99.00th=[ 251], 99.50th=[ 257], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 224, per=25.88%, avg=120.08, stdev=45.50, samples=107 iops : min= 1, max= 14, avg= 6.75, stdev= 2.88, samples=107 lat (msec) : 10=3.65%, 20=19.66%, 50=18.36%, 100=32.94%, 250=24.61% lat (msec) : 500=0.78% cpu : usr=0.07%, sys=1.75%, ctx=1378, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174136: Wed Sep 16 16:26:17 2026 read: IOPS=7, BW=120KiB/s (122kB/s)(6256KiB/52308msec) clat (msec): min=5, max=186, avg=29.45, stdev=25.03 lat (msec): min=5, max=186, avg=29.45, stdev=25.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 61], 95.00th=[ 84], | 99.00th=[ 142], 99.50th=[ 161], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 446, per=28.68%, avg=126.47, stdev=82.46, samples=98 iops : min= 1, max= 27, avg= 7.13, stdev= 5.21, samples=98 write: IOPS=7, BW=115KiB/s (118kB/s)(6032KiB/52308msec); 0 zone resets clat (msec): min=42, max=340, avg=107.95, stdev=46.45 lat (msec): min=42, max=340, avg=107.95, stdev=46.44 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 70], | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 101], 60.00th=[ 109], | 70.00th=[ 120], 80.00th=[ 138], 90.00th=[ 167], 95.00th=[ 201], | 99.00th=[ 255], 99.50th=[ 338], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 223, per=25.00%, avg=116.01, stdev=42.43, samples=102 iops : min= 1, max= 13, avg= 6.50, stdev= 2.66, samples=102 lat (msec) : 10=2.60%, 20=20.44%, 50=21.74%, 100=29.56%, 250=25.13% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.74%, ctx=1426, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174137: Wed Sep 16 16:26:17 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(6032KiB/53411msec) clat (msec): min=6, max=332, avg=32.50, stdev=33.42 lat (msec): min=6, max=332, avg=32.50, stdev=33.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 66], 95.00th=[ 102], | 99.00th=[ 165], 99.50th=[ 192], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 25, max= 347, per=26.83%, avg=118.31, stdev=75.48, samples=99 iops : min= 1, max= 21, avg= 6.63, stdev= 4.76, samples=99 write: IOPS=7, BW=117KiB/s (120kB/s)(6256KiB/53411msec); 0 zone resets clat (msec): min=41, max=357, avg=105.11, stdev=42.06 lat (msec): min=41, max=358, avg=105.11, stdev=42.06 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 58], 10.00th=[ 63], 20.00th=[ 70], | 30.00th=[ 78], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 108], | 70.00th=[ 118], 80.00th=[ 133], 90.00th=[ 161], 95.00th=[ 186], | 99.00th=[ 230], 99.50th=[ 284], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 192, per=25.12%, avg=116.56, stdev=42.34, samples=105 iops : min= 1, max= 12, avg= 6.52, stdev= 2.70, samples=105 lat (msec) : 10=2.21%, 20=20.44%, 50=19.27%, 100=32.42%, 250=25.26% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=1.85%, ctx=1395, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=442KiB/s (452kB/s), 106KiB/s-120KiB/s (108kB/s-122kB/s), io=23.4MiB (24.5MB), run=52308-54219msec WRITE: bw=465KiB/s (476kB/s), 115KiB/s-121KiB/s (118kB/s-124kB/s), io=24.6MiB (25.8MB), run=52308-54219msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174155: Wed Sep 16 16:26:31 2026 read: IOPS=1, BW=1543KiB/s (1581kB/s)(7168KiB/4644msec) clat (msec): min=8, max=670, avg=224.63, stdev=213.94 lat (msec): min=8, max=670, avg=224.63, stdev=213.93 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 127], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 148], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 292], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1984, max= 5829, per=90.61%, avg=2963.75, stdev=1910.25, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1102KiB/s (1129kB/s)(5120KiB/4644msec); 0 zone resets clat (msec): min=141, max=2122, avg=601.06, stdev=852.57 lat (msec): min=141, max=2122, avg=601.14, stdev=852.58 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 1984, max= 3771, per=56.64%, avg=2594.00, stdev=1019.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=14.04%, ctx=158, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174156: Wed Sep 16 16:26:31 2026 read: IOPS=0, BW=327KiB/s (335kB/s)(2048KiB/6260msec) clat (msec): min=233, max=2234, avg=1234.23, stdev=1414.73 lat (msec): min=233, max=2234, avg=1234.23, stdev=1414.73 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1984, max= 2031, per=61.37%, avg=2007.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1636KiB/s (1675kB/s)(10.0MiB/6260msec); 0 zone resets clat (msec): min=122, max=742, avg=366.68, stdev=211.70 lat (msec): min=122, max=742, avg=366.82, stdev=211.73 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 130], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 313], 60.00th=[ 384], | 70.00th=[ 468], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1984, max= 4087, per=66.00%, avg=3022.67, stdev=1102.81, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=13.24%, ctx=541, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174158: Wed Sep 16 16:26:31 2026 read: IOPS=1, BW=1032KiB/s (1057kB/s)(6144KiB/5952msec) clat (msec): min=2, max=292, avg=183.15, stdev=100.28 lat (msec): min=2, max=292, avg=183.15, stdev=100.28 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 209], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1885, max= 4079, per=75.91%, avg=2483.00, stdev=1065.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1032KiB/s (1057kB/s)(6144KiB/5952msec); 0 zone resets clat (msec): min=131, max=2774, avg=783.35, stdev=992.22 lat (msec): min=131, max=2774, avg=783.57, stdev=992.18 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 567], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1885, max= 2039, per=43.45%, avg=1990.00, stdev=62.16, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.80%, ctx=293, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174160: Wed Sep 16 16:26:31 2026 read: IOPS=0, BW=881KiB/s (902kB/s)(5120KiB/5810msec) clat (usec): min=582, max=111792, avg=23712.41, stdev=49261.16 lat (usec): min=583, max=111793, avg=23713.61, stdev=49260.84 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 586], | 30.00th=[ 914], 40.00th=[ 914], 50.00th=[ 1004], 60.00th=[ 1004], | 70.00th=[ 4293], 80.00th=[ 4293], 90.00th=[111674], 95.00th=[111674], | 99.00th=[111674], 99.50th=[111674], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1234KiB/s (1263kB/s)(7168KiB/5810msec); 0 zone resets clat (msec): min=247, max=2662, avg=778.76, stdev=861.08 lat (msec): min=247, max=2663, avg=779.03, stdev=861.29 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 342], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 405], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 953], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1984, max= 4071, per=55.16%, avg=2526.25, stdev=1030.08, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=16.67%, 500=33.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=11.09%, ctx=152, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3272KiB/s (3350kB/s), 327KiB/s-1543KiB/s (335kB/s-1581kB/s), io=20.0MiB (20.0MB), run=4644-6260msec WRITE: bw=4580KiB/s (4690kB/s), 1032KiB/s-1636KiB/s (1057kB/s-1675kB/s), io=28.0MiB (29.4MB), run=4644-6260msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174154: Wed Sep 16 16:26:31 2026 read: IOPS=1, BW=1247KiB/s (1277kB/s)(7168KiB/5746msec) clat (msec): min=72, max=348, avg=186.59, stdev=109.88 lat (msec): min=72, max=348, avg=186.60, stdev=109.88 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 80], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 275], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1988, max= 4332, per=100.00%, avg=3458.33, stdev=1280.86, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=891KiB/s (912kB/s)(5120KiB/5746msec); 0 zone resets clat (msec): min=255, max=2629, avg=852.88, stdev=1008.92 lat (msec): min=255, max=2630, avg=852.96, stdev=1008.95 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1988, max= 4079, per=65.65%, avg=2703.33, stdev=1191.68, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=16.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=4.18%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174157: Wed Sep 16 16:26:31 2026 read: IOPS=0, BW=294KiB/s (301kB/s)(2048KiB/6962msec) clat (msec): min=314, max=2236, avg=1275.48, stdev=1359.38 lat (msec): min=314, max=2236, avg=1275.48, stdev=1359.38 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1988, max= 2035, per=68.40%, avg=2011.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1471KiB/s (1506kB/s)(10.0MiB/6962msec); 0 zone resets clat (msec): min=158, max=724, avg=422.38, stdev=202.00 lat (msec): min=158, max=724, avg=422.49, stdev=201.99 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 178], | 30.00th=[ 239], 40.00th=[ 326], 50.00th=[ 363], 60.00th=[ 426], | 70.00th=[ 575], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1988, max= 4023, per=56.25%, avg=2316.57, stdev=752.76, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.79, samples=7 lat (msec) : 250=25.00%, 500=33.33%, 750=33.33%, >=2000=8.33% cpu : usr=0.03%, sys=4.37%, ctx=169, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174159: Wed Sep 16 16:26:31 2026 read: IOPS=0, BW=924KiB/s (947kB/s)(6144KiB/6646msec) clat (msec): min=69, max=612, avg=244.65, stdev=200.71 lat (msec): min=69, max=612, avg=244.66, stdev=200.71 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 241], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2011, max= 2048, per=69.07%, avg=2031.25, stdev=16.01, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=0, BW=924KiB/s (947kB/s)(6144KiB/6646msec); 0 zone resets clat (msec): min=157, max=2504, avg=853.49, stdev=852.50 lat (msec): min=157, max=2504, avg=853.61, stdev=852.58 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 726], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 2027, max= 4055, per=65.70%, avg=2705.67, stdev=1168.56, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.95%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174161: Wed Sep 16 16:26:31 2026 read: IOPS=0, BW=765KiB/s (783kB/s)(5120KiB/6693msec) clat (msec): min=72, max=811, avg=356.24, stdev=298.07 lat (msec): min=72, max=811, avg=356.24, stdev=298.07 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1988, max= 2039, per=68.56%, avg=2016.25, stdev=22.05, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1071KiB/s (1097kB/s)(7168KiB/6693msec); 0 zone resets clat (msec): min=186, max=2386, avg=672.39, stdev=767.75 lat (msec): min=186, max=2387, avg=672.51, stdev=767.75 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 300], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 368], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 600], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 2011, max= 2048, per=49.36%, avg=2032.80, stdev=14.57, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=4.60%, ctx=174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2942KiB/s (3012kB/s), 294KiB/s-1247KiB/s (301kB/s-1277kB/s), io=20.0MiB (20.0MB), run=5746-6962msec WRITE: bw=4118KiB/s (4217kB/s), 891KiB/s-1471KiB/s (912kB/s-1506kB/s), io=28.0MiB (29.4MB), run=5746-6962msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=174168: Wed Sep 16 16:26:44 2026 read: IOPS=1, BW=4787KiB/s (4902kB/s)(12.0MiB/2567msec) clat (msec): min=717, max=909, avg=836.74, stdev=104.09 lat (msec): min=717, max=909, avg=836.74, stdev=104.09 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=17.96%, ctx=419, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174169: Wed Sep 16 16:26:44 2026 read: IOPS=0, BW=1334KiB/s (1366kB/s)(4096KiB/3070msec) clat (nsec): min=722840k, max=722840k, avg=722839584.00, stdev= 0.00 lat (nsec): min=722843k, max=722843k, avg=722842869.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2668KiB/s (2732kB/s)(8192KiB/3070msec); 0 zone resets clat (msec): min=704, max=1549, avg=1126.78, stdev=597.66 lat (msec): min=704, max=1551, avg=1127.98, stdev=598.76 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8175, max= 8175, per=87.82%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.37%, ctx=144, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174170: Wed Sep 16 16:26:44 2026 write: IOPS=0, BW=3491KiB/s (3575kB/s)(12.0MiB/3520msec); 0 zone resets clat (msec): min=383, max=2141, avg=1161.94, stdev=895.83 lat (msec): min=384, max=2141, avg=1162.33, stdev=895.82 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 8159, max= 8159, per=87.65%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=9.12%, ctx=108, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174171: Wed Sep 16 16:26:44 2026 write: IOPS=1, BW=5101KiB/s (5223kB/s)(12.0MiB/2409msec); 0 zone resets clat (msec): min=351, max=1420, avg=790.03, stdev=560.05 lat (msec): min=352, max=1421, avg=790.63, stdev=559.89 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.73%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5337KiB/s (5465kB/s), 1334KiB/s-4787KiB/s (1366kB/s-4902kB/s), io=16.0MiB (16.8MB), run=2567-3070msec WRITE: bw=9309KiB/s (9533kB/s), 2668KiB/s-5101KiB/s (2732kB/s-5223kB/s), io=32.0MiB (33.6MB), run=2409-3520msec rand-rw: (groupid=0, jobs=1): err= 0: pid=174173: Wed Sep 16 16:26:44 2026 read: IOPS=1, BW=4730KiB/s (4843kB/s)(12.0MiB/2598msec) clat (msec): min=251, max=1276, avg=860.30, stdev=539.15 lat (msec): min=251, max=1276, avg=860.30, stdev=539.15 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.78%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174174: Wed Sep 16 16:26:44 2026 read: IOPS=0, BW=1147KiB/s (1175kB/s)(4096KiB/3571msec) clat (nsec): min=903644k, max=903644k, avg=903643833.00, stdev= 0.00 lat (nsec): min=903647k, max=903647k, avg=903646618.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2294KiB/s (2349kB/s)(8192KiB/3571msec); 0 zone resets clat (msec): min=1050, max=1613, avg=1332.11, stdev=397.94 lat (msec): min=1051, max=1614, avg=1332.73, stdev=398.28 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8143, max= 8143, per=88.74%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.06%, sys=3.95%, ctx=46, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174175: Wed Sep 16 16:26:44 2026 write: IOPS=0, BW=3505KiB/s (3589kB/s)(12.0MiB/3506msec); 0 zone resets clat (msec): min=402, max=1669, avg=1161.89, stdev=669.67 lat (msec): min=403, max=1669, avg=1164.18, stdev=670.78 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8094, max= 8143, per=88.48%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.59%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=174176: Wed Sep 16 16:26:44 2026 write: IOPS=1, BW=4815KiB/s (4931kB/s)(12.0MiB/2552msec); 0 zone resets clat (msec): min=562, max=1254, avg=821.75, stdev=377.43 lat (msec): min=563, max=1255, avg=822.45, stdev=377.20 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8062, max= 8143, per=88.30%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.88%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4588KiB/s (4698kB/s), 1147KiB/s-4730KiB/s (1175kB/s-4843kB/s), io=16.0MiB (16.8MB), run=2598-3571msec WRITE: bw=9176KiB/s (9396kB/s), 2294KiB/s-4815KiB/s (2349kB/s-4931kB/s), io=32.0MiB (33.6MB), run=2552-3571msec