== sanity test 398b: DIO and buffer IO race ============== 09:11:09 (1788354669) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.58614 s, 19.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=157341: Wed Sep 2 09:12:10 2026 read: IOPS=28, BW=113KiB/s (115kB/s)(5992KiB/53154msec) clat (usec): min=34, max=617439, avg=18920.70, stdev=18986.01 lat (usec): min=35, max=617440, avg=18921.46, stdev=18986.05 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 6063], 10.00th=[ 7963], 20.00th=[ 10028], | 30.00th=[ 11994], 40.00th=[ 14222], 50.00th=[ 16581], 60.00th=[ 19006], | 70.00th=[ 21890], 80.00th=[ 26346], 90.00th=[ 31589], 95.00th=[ 37487], | 99.00th=[ 58983], 99.50th=[ 69731], 99.90th=[ 96994], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 13, max= 232, per=24.78%, avg=111.50, stdev=36.48, samples=105 iops : min= 3, max= 58, avg=27.39, stdev= 9.13, samples=105 write: IOPS=29, BW=118KiB/s (121kB/s)(6296KiB/53154msec); 0 zone resets clat (usec): min=720, max=106644, avg=15632.71, stdev=12140.26 lat (usec): min=720, max=106645, avg=15633.96, stdev=12140.76 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2868], 10.00th=[ 3359], 20.00th=[ 5080], | 30.00th=[ 7308], 40.00th=[ 10159], 50.00th=[ 12911], 60.00th=[ 15664], | 70.00th=[ 19530], 80.00th=[ 23987], 90.00th=[ 32113], 95.00th=[ 39060], | 99.00th=[ 51643], 99.50th=[ 59507], 99.90th=[100140], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 23, max= 224, per=25.03%, avg=117.91, stdev=40.86, samples=104 iops : min= 5, max= 56, avg=28.99, stdev=10.27, samples=104 lat (usec) : 50=0.03%, 100=0.33%, 250=1.20%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=0.68%, 4=6.80%, 10=20.64%, 20=37.50%, 50=30.83% lat (msec) : 100=1.50%, 250=0.07%, 750=0.03% cpu : usr=0.11%, sys=29.16%, ctx=10097, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157342: Wed Sep 2 09:12:10 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(5940KiB/53329msec) clat (usec): min=28, max=132418, avg=18749.36, stdev=11597.35 lat (usec): min=29, max=132420, avg=18750.10, stdev=11597.36 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 6325], 10.00th=[ 8094], 20.00th=[ 9765], | 30.00th=[ 12256], 40.00th=[ 14353], 50.00th=[ 16450], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 26608], 90.00th=[ 32900], 95.00th=[ 36963], | 99.00th=[ 57934], 99.50th=[ 66847], 99.90th=[119014], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 6, max= 248, per=24.69%, avg=111.12, stdev=40.65, samples=106 iops : min= 1, max= 62, avg=27.30, stdev=10.18, samples=106 write: IOPS=29, BW=119KiB/s (122kB/s)(6348KiB/53329msec); 0 zone resets clat (usec): min=710, max=616741, avg=15939.37, stdev=19288.06 lat (usec): min=711, max=616742, avg=15940.75, stdev=19288.02 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 2638], 10.00th=[ 3326], 20.00th=[ 5080], | 30.00th=[ 7242], 40.00th=[ 10028], 50.00th=[ 12780], 60.00th=[ 16319], | 70.00th=[ 19530], 80.00th=[ 23725], 90.00th=[ 32113], 95.00th=[ 39060], | 99.00th=[ 53216], 99.50th=[ 63177], 99.90th=[101188], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 31, max= 368, per=25.39%, avg=119.58, stdev=44.91, samples=105 iops : min= 7, max= 92, avg=29.42, stdev=11.32, samples=105 lat (usec) : 50=0.07%, 100=0.42%, 250=0.91%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=1.11%, 4=6.18%, 10=21.45%, 20=37.30%, 50=30.70% lat (msec) : 100=1.24%, 250=0.13%, 750=0.03% cpu : usr=0.14%, sys=29.25%, ctx=10113, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157343: Wed Sep 2 09:12:10 2026 read: IOPS=28, BW=115KiB/s (117kB/s)(6028KiB/52613msec) clat (usec): min=34, max=613456, avg=18537.59, stdev=19044.76 lat (usec): min=35, max=613456, avg=18538.92, stdev=19044.98 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 5800], 10.00th=[ 7701], 20.00th=[ 9765], | 30.00th=[ 11994], 40.00th=[ 14091], 50.00th=[ 16057], 60.00th=[ 18220], | 70.00th=[ 21365], 80.00th=[ 25297], 90.00th=[ 31327], 95.00th=[ 36439], | 99.00th=[ 53216], 99.50th=[ 71828], 99.90th=[117965], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 63, max= 231, per=25.59%, avg=115.15, stdev=37.19, samples=103 iops : min= 15, max= 57, avg=28.30, stdev= 9.38, samples=103 write: IOPS=29, BW=119KiB/s (122kB/s)(6260KiB/52613msec); 0 zone resets clat (usec): min=734, max=101011, avg=15643.09, stdev=12405.78 lat (usec): min=735, max=101012, avg=15644.17, stdev=12405.93 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2638], 10.00th=[ 3195], 20.00th=[ 4686], | 30.00th=[ 7177], 40.00th=[ 9765], 50.00th=[ 12911], 60.00th=[ 15533], | 70.00th=[ 19530], 80.00th=[ 24249], 90.00th=[ 32375], 95.00th=[ 40633], | 99.00th=[ 55837], 99.50th=[ 60031], 99.90th=[ 87557], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 20, max= 239, per=25.07%, avg=118.09, stdev=41.82, samples=104 iops : min= 5, max= 59, avg=29.04, stdev=10.46, samples=104 lat (usec) : 50=0.07%, 100=0.72%, 250=1.24%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=0.98%, 4=7.00%, 10=20.51%, 20=37.99%, 50=29.65% lat (msec) : 100=1.43%, 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=29.25%, ctx=9829, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157345: Wed Sep 2 09:12:10 2026 read: IOPS=28, BW=114KiB/s (117kB/s)(6052KiB/52926msec) clat (usec): min=56, max=116884, avg=18325.19, stdev=11326.86 lat (usec): min=57, max=116884, avg=18325.98, stdev=11326.94 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 5997], 10.00th=[ 7832], 20.00th=[ 10028], | 30.00th=[ 11994], 40.00th=[ 13960], 50.00th=[ 16188], 60.00th=[ 18482], | 70.00th=[ 21627], 80.00th=[ 25560], 90.00th=[ 31327], 95.00th=[ 37487], | 99.00th=[ 56361], 99.50th=[ 68682], 99.90th=[106431], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 47, max= 208, per=25.55%, avg=114.97, stdev=39.03, samples=104 iops : min= 11, max= 52, avg=28.26, stdev= 9.81, samples=104 write: IOPS=29, BW=118KiB/s (121kB/s)(6236KiB/52926msec); 0 zone resets clat (usec): min=743, max=652811, avg=16026.10, stdev=19967.94 lat (usec): min=744, max=652812, avg=16027.47, stdev=19967.80 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2638], 10.00th=[ 3261], 20.00th=[ 5014], | 30.00th=[ 7504], 40.00th=[ 10290], 50.00th=[ 12911], 60.00th=[ 16319], | 70.00th=[ 20055], 80.00th=[ 24249], 90.00th=[ 31851], 95.00th=[ 39060], | 99.00th=[ 51119], 99.50th=[ 57934], 99.90th=[ 95945], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 55, max= 231, per=25.13%, avg=118.36, stdev=40.27, samples=104 iops : min= 13, max= 57, avg=29.11, stdev=10.12, samples=104 lat (usec) : 100=0.52%, 250=1.33%, 500=0.03%, 750=0.07%, 1000=0.03% lat (msec) : 2=1.07%, 4=6.54%, 10=19.89%, 20=38.12%, 50=30.99% lat (msec) : 100=1.27%, 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=29.03%, ctx=10103, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=450KiB/s (461kB/s), 111KiB/s-115KiB/s (114kB/s-117kB/s), io=23.4MiB (24.6MB), run=52613-53329msec WRITE: bw=471KiB/s (483kB/s), 118KiB/s-119KiB/s (121kB/s-122kB/s), io=24.6MiB (25.7MB), run=52613-53329msec rand-rw: (groupid=0, jobs=1): err= 0: pid=157344: Wed Sep 2 09:12:31 2026 read: IOPS=20, BW=81.0KiB/s (82.9kB/s)(5992KiB/73972msec) clat (msec): min=2, max=625, avg=15.36, stdev=21.18 lat (msec): min=2, max=625, avg=15.36, stdev=21.18 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 71], 99.50th=[ 81], 99.90th=[ 110], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 16, max= 232, per=25.08%, avg=81.26, stdev=44.43, samples=146 iops : min= 4, max= 58, avg=19.99, stdev=11.28, samples=146 write: IOPS=21, BW=85.1KiB/s (87.2kB/s)(6296KiB/73972msec); 0 zone resets clat (msec): min=11, max=155, avg=32.27, stdev=16.70 lat (msec): min=11, max=155, avg=32.27, stdev=16.70 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 54], 95.00th=[ 64], | 99.00th=[ 96], 99.50th=[ 115], 99.90th=[ 142], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 15, max= 184, per=25.18%, avg=85.38, stdev=41.65, samples=146 iops : min= 3, max= 46, avg=21.02, stdev=10.62, samples=146 lat (msec) : 4=5.92%, 10=18.20%, 20=22.88%, 50=44.76%, 100=7.75% lat (msec) : 250=0.46%, 750=0.03% cpu : usr=0.07%, sys=11.07%, ctx=6385, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157346: Wed Sep 2 09:12:31 2026 read: IOPS=20, BW=80.6KiB/s (82.6kB/s)(5940KiB/73671msec) clat (msec): min=2, max=619, avg=14.94, stdev=20.49 lat (msec): min=2, max=619, avg=14.94, stdev=20.49 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 42], | 99.00th=[ 62], 99.50th=[ 71], 99.90th=[ 101], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8, max= 280, per=25.00%, avg=81.00, stdev=48.89, samples=145 iops : min= 2, max= 70, avg=19.92, stdev=12.40, samples=145 write: IOPS=21, BW=86.2KiB/s (88.2kB/s)(6348KiB/73671msec); 0 zone resets clat (msec): min=12, max=160, avg=32.33, stdev=17.16 lat (msec): min=12, max=160, avg=32.33, stdev=17.16 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 36], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 99], 99.50th=[ 117], 99.90th=[ 138], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 31, max= 184, per=25.49%, avg=86.41, stdev=41.99, samples=145 iops : min= 7, max= 46, avg=21.28, stdev=10.69, samples=145 lat (msec) : 4=5.83%, 10=19.04%, 20=22.07%, 50=45.77%, 100=6.77% lat (msec) : 250=0.49%, 750=0.03% cpu : usr=0.11%, sys=11.22%, ctx=6423, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157347: Wed Sep 2 09:12:31 2026 read: IOPS=20, BW=81.6KiB/s (83.5kB/s)(6028KiB/73891msec) clat (msec): min=2, max=110, avg=15.33, stdev=14.76 lat (msec): min=2, max=110, avg=15.33, stdev=14.76 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 33], 95.00th=[ 45], | 99.00th=[ 72], 99.50th=[ 86], 99.90th=[ 108], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 15, max= 232, per=25.32%, avg=82.03, stdev=45.72, samples=146 iops : min= 3, max= 58, avg=20.18, stdev=11.61, samples=146 write: IOPS=21, BW=84.7KiB/s (86.8kB/s)(6260KiB/73891msec); 0 zone resets clat (msec): min=11, max=634, avg=32.34, stdev=22.46 lat (msec): min=11, max=634, avg=32.34, stdev=22.46 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 51], 95.00th=[ 63], | 99.00th=[ 100], 99.50th=[ 126], 99.90th=[ 165], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 16, max= 184, per=25.09%, avg=85.04, stdev=41.59, samples=146 iops : min= 4, max= 46, avg=20.94, stdev=10.60, samples=146 lat (msec) : 4=5.79%, 10=18.72%, 20=22.07%, 50=46.29%, 100=6.51% lat (msec) : 250=0.59%, 750=0.03% cpu : usr=0.09%, sys=11.36%, ctx=6446, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157348: Wed Sep 2 09:12:31 2026 read: IOPS=20, BW=81.0KiB/s (83.9kB/s)(6052KiB/73836msec) clat (msec): min=2, max=105, avg=15.20, stdev=14.20 lat (msec): min=2, max=105, avg=15.21, stdev=14.20 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 45], | 99.00th=[ 69], 99.50th=[ 77], 99.90th=[ 103], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 23, max= 272, per=25.44%, avg=82.42, stdev=48.00, samples=146 iops : min= 5, max= 68, avg=20.28, stdev=12.18, samples=146 write: IOPS=21, BW=84.5KiB/s (86.5kB/s)(6236KiB/73836msec); 0 zone resets clat (msec): min=13, max=648, avg=32.49, stdev=22.33 lat (msec): min=13, max=648, avg=32.49, stdev=22.33 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 36], 80.00th=[ 42], 90.00th=[ 54], 95.00th=[ 64], | 99.00th=[ 91], 99.50th=[ 111], 99.90th=[ 136], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 23, max= 200, per=25.04%, avg=84.88, stdev=41.03, samples=146 iops : min= 5, max= 50, avg=20.90, stdev=10.46, samples=146 lat (msec) : 4=5.79%, 10=19.14%, 20=21.78%, 50=45.44%, 100=7.39% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.07%, sys=11.30%, ctx=6495, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=325KiB/s (332kB/s), 80.6KiB/s-81.0KiB/s (82.6kB/s-83.9kB/s), io=23.4MiB (24.6MB), run=73671-73972msec WRITE: bw=340KiB/s (348kB/s), 84.5KiB/s-86.2KiB/s (86.5kB/s-88.2kB/s), io=24.6MiB (25.7MB), run=73671-73972msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=157374: Wed Sep 2 09:12:48 2026 read: IOPS=30, BW=489KiB/s (500kB/s)(5920KiB/12117msec) clat (usec): min=35, max=60869, avg=16018.92, stdev=9470.40 lat (usec): min=35, max=60869, avg=16019.56, stdev=9470.45 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 121], 10.00th=[ 3589], 20.00th=[ 9765], | 30.00th=[11207], 40.00th=[12911], 50.00th=[14877], 60.00th=[16712], | 70.00th=[20055], 80.00th=[22414], 90.00th=[27132], 95.00th=[30802], | 99.00th=[46924], 99.50th=[56361], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 286, max= 830, per=24.58%, avg=479.04, stdev=123.62, samples=23 iops : min= 17, max= 51, avg=29.30, stdev= 7.80, samples=23 write: IOPS=32, BW=526KiB/s (538kB/s)(6368KiB/12117msec); 0 zone resets clat (usec): min=849, max=81449, avg=15430.23, stdev=12075.11 lat (usec): min=850, max=81450, avg=15431.43, stdev=12075.28 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 3556], 10.00th=[ 4293], 20.00th=[ 5145], | 30.00th=[ 7504], 40.00th=[ 9503], 50.00th=[11994], 60.00th=[15139], | 70.00th=[18744], 80.00th=[22938], 90.00th=[31065], 95.00th=[39060], | 99.00th=[62129], 99.50th=[69731], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 318, max= 798, per=25.16%, avg=516.13, stdev=126.03, samples=23 iops : min= 19, max= 49, avg=31.65, stdev= 7.90, samples=23 lat (usec) : 50=0.26%, 100=0.91%, 250=3.39%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.65%, 4=3.52%, 10=22.40%, 20=40.10%, 50=27.47% lat (msec) : 100=1.04% cpu : usr=0.07%, sys=31.41%, ctx=2772, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157376: Wed Sep 2 09:12:48 2026 read: IOPS=29, BW=477KiB/s (489kB/s)(5744KiB/12037msec) clat (usec): min=56, max=62004, avg=16719.13, stdev=9429.64 lat (usec): min=57, max=62005, avg=16719.82, stdev=9429.69 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 114], 10.00th=[ 7177], 20.00th=[10290], | 30.00th=[11731], 40.00th=[13304], 50.00th=[15270], 60.00th=[17695], | 70.00th=[20317], 80.00th=[23987], 90.00th=[28181], 95.00th=[32637], | 99.00th=[46924], 99.50th=[52691], 99.90th=[62129], 99.95th=[62129], | 99.99th=[62129] bw ( KiB/s): min= 256, max= 736, per=24.30%, avg=473.70, stdev=127.34, samples=23 iops : min= 16, max= 46, avg=29.00, stdev= 8.05, samples=23 write: IOPS=33, BW=544KiB/s (557kB/s)(6544KiB/12037msec); 0 zone resets clat (usec): min=1108, max=103790, avg=14660.06, stdev=11431.39 lat (usec): min=1109, max=103791, avg=14661.25, stdev=11431.41 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3654], 10.00th=[ 4359], 20.00th=[ 5407], | 30.00th=[ 7111], 40.00th=[ 9634], 50.00th=[ 11994], 60.00th=[ 14615], | 70.00th=[ 17695], 80.00th=[ 21890], 90.00th=[ 28443], 95.00th=[ 35390], | 99.00th=[ 45351], 99.50th=[ 54789], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 352, max= 830, per=25.95%, avg=532.26, stdev=132.04, samples=23 iops : min= 22, max= 51, avg=32.65, stdev= 8.20, samples=23 lat (usec) : 100=1.43%, 250=2.21%, 500=0.26% lat (msec) : 2=0.65%, 4=2.99%, 10=23.05%, 20=42.19%, 50=26.43% lat (msec) : 100=0.65%, 250=0.13% cpu : usr=0.13%, sys=32.34%, ctx=2819, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157377: Wed Sep 2 09:12:48 2026 read: IOPS=31, BW=509KiB/s (522kB/s)(6256KiB/12284msec) clat (usec): min=28, max=118355, avg=17163.62, stdev=11396.46 lat (usec): min=28, max=118356, avg=17164.33, stdev=11396.49 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 106], 10.00th=[ 208], 20.00th=[ 9765], | 30.00th=[ 11731], 40.00th=[ 13829], 50.00th=[ 15795], 60.00th=[ 18220], | 70.00th=[ 20579], 80.00th=[ 25035], 90.00th=[ 28967], 95.00th=[ 34341], | 99.00th=[ 53216], 99.50th=[ 68682], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 255, max= 766, per=25.88%, avg=504.33, stdev=118.31, samples=24 iops : min= 15, max= 47, avg=30.92, stdev= 7.31, samples=24 write: IOPS=30, BW=491KiB/s (503kB/s)(6032KiB/12284msec); 0 zone resets clat (usec): min=1068, max=82879, avg=14613.44, stdev=10773.34 lat (usec): min=1070, max=82881, avg=14614.85, stdev=10773.45 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 3392], 10.00th=[ 4293], 20.00th=[ 5145], | 30.00th=[ 6980], 40.00th=[ 9765], 50.00th=[11994], 60.00th=[14877], | 70.00th=[18482], 80.00th=[22938], 90.00th=[28443], 95.00th=[32375], | 99.00th=[48497], 99.50th=[71828], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 254, max= 672, per=23.38%, avg=479.58, stdev=128.55, samples=24 iops : min= 15, max= 42, avg=29.33, stdev= 8.13, samples=24 lat (usec) : 50=0.39%, 100=1.82%, 250=2.99% lat (msec) : 2=0.65%, 4=3.39%, 10=22.01%, 20=39.32%, 50=28.52% lat (msec) : 100=0.78%, 250=0.13% cpu : usr=0.10%, sys=30.99%, ctx=2799, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157378: Wed Sep 2 09:12:48 2026 read: IOPS=31, BW=507KiB/s (520kB/s)(6032KiB/11888msec) clat (usec): min=32, max=115087, avg=16399.91, stdev=11208.13 lat (usec): min=32, max=115087, avg=16409.67, stdev=11203.61 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 104], 10.00th=[ 120], 20.00th=[ 9765], | 30.00th=[ 11469], 40.00th=[ 13698], 50.00th=[ 15795], 60.00th=[ 17957], | 70.00th=[ 20317], 80.00th=[ 23200], 90.00th=[ 30016], 95.00th=[ 35390], | 99.00th=[ 44303], 99.50th=[ 49021], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 288, max= 734, per=25.70%, avg=500.83, stdev=107.33, samples=23 iops : min= 18, max= 45, avg=30.70, stdev= 6.60, samples=23 write: IOPS=32, BW=526KiB/s (539kB/s)(6256KiB/11888msec); 0 zone resets clat (usec): min=849, max=79694, avg=14532.20, stdev=11211.85 lat (usec): min=850, max=79695, avg=14533.38, stdev=11211.86 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 3458], 10.00th=[ 4424], 20.00th=[ 5080], | 30.00th=[ 6128], 40.00th=[ 9372], 50.00th=[11600], 60.00th=[14091], | 70.00th=[17171], 80.00th=[21890], 90.00th=[30802], 95.00th=[37487], | 99.00th=[47449], 99.50th=[67634], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 318, max= 800, per=25.46%, avg=522.09, stdev=155.31, samples=23 iops : min= 19, max= 50, avg=32.00, stdev= 9.83, samples=23 lat (usec) : 50=0.13%, 100=1.95%, 250=4.69%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.43%, 4=2.86%, 10=21.22%, 20=40.10%, 50=26.82% lat (msec) : 100=0.39%, 250=0.13% cpu : usr=0.10%, sys=31.08%, ctx=2710, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1950KiB/s (1997kB/s), 477KiB/s-509KiB/s (489kB/s-522kB/s), io=23.4MiB (24.5MB), run=11888-12284msec WRITE: bw=2051KiB/s (2101kB/s), 491KiB/s-544KiB/s (503kB/s-557kB/s), io=24.6MiB (25.8MB), run=11888-12284msec rand-rw: (groupid=0, jobs=1): err= 0: pid=157379: Wed Sep 2 09:12:53 2026 read: IOPS=21, BW=343KiB/s (351kB/s)(5920KiB/17249msec) clat (usec): min=2834, max=91922, avg=13809.48, stdev=13522.29 lat (usec): min=2835, max=91923, avg=13810.20, stdev=13522.23 clat percentiles (usec): | 1.00th=[ 3294], 5.00th=[ 3785], 10.00th=[ 4178], 20.00th=[ 4817], | 30.00th=[ 5538], 40.00th=[ 6390], 50.00th=[ 8848], 60.00th=[11207], | 70.00th=[14484], 80.00th=[20055], 90.00th=[32375], 95.00th=[40633], | 99.00th=[67634], 99.50th=[83362], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 126, max= 960, per=25.07%, avg=342.50, stdev=189.86, samples=34 iops : min= 7, max= 60, avg=20.91, stdev=12.06, samples=34 write: IOPS=23, BW=369KiB/s (378kB/s)(6368KiB/17249msec); 0 zone resets clat (msec): min=13, max=118, avg=30.31, stdev=15.78 lat (msec): min=13, max=118, avg=30.31, stdev=15.78 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 52], 95.00th=[ 58], | 99.00th=[ 92], 99.50th=[ 117], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 159, max= 736, per=25.68%, avg=369.24, stdev=181.71, samples=34 iops : min= 9, max= 46, avg=22.59, stdev=11.60, samples=34 lat (msec) : 4=3.39%, 10=23.70%, 20=25.39%, 50=40.23%, 100=7.03% lat (msec) : 250=0.26% cpu : usr=0.09%, sys=11.82%, ctx=1674, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157380: Wed Sep 2 09:12:53 2026 read: IOPS=20, BW=328KiB/s (336kB/s)(5744KiB/17523msec) clat (msec): min=2, max=114, avg=14.17, stdev=14.29 lat (msec): min=2, max=114, avg=14.17, stdev=14.29 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 11], | 70.00th=[ 17], 80.00th=[ 21], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 61], 99.50th=[ 77], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 95, max= 768, per=23.64%, avg=322.94, stdev=196.98, samples=34 iops : min= 5, max= 48, avg=19.68, stdev=12.59, samples=34 write: IOPS=23, BW=373KiB/s (382kB/s)(6544KiB/17523msec); 0 zone resets clat (msec): min=10, max=115, avg=30.32, stdev=16.31 lat (msec): min=10, max=115, avg=30.32, stdev=16.31 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 52], 95.00th=[ 67], | 99.00th=[ 89], 99.50th=[ 101], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 159, max= 704, per=25.12%, avg=361.26, stdev=173.07, samples=34 iops : min= 9, max= 44, avg=22.09, stdev=11.03, samples=34 lat (msec) : 4=4.56%, 10=22.14%, 20=24.09%, 50=42.19%, 100=6.64% lat (msec) : 250=0.39% cpu : usr=0.11%, sys=11.57%, ctx=1632, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157381: Wed Sep 2 09:12:53 2026 read: IOPS=22, BW=363KiB/s (372kB/s)(6256KiB/17234msec) clat (usec): min=2857, max=74010, avg=13871.10, stdev=13580.79 lat (usec): min=2858, max=74011, avg=13871.92, stdev=13580.79 clat percentiles (usec): | 1.00th=[ 3064], 5.00th=[ 3654], 10.00th=[ 4047], 20.00th=[ 4621], | 30.00th=[ 5145], 40.00th=[ 5866], 50.00th=[ 7439], 60.00th=[11338], | 70.00th=[15533], 80.00th=[21103], 90.00th=[33817], 95.00th=[42730], | 99.00th=[66847], 99.50th=[70779], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 63, max= 862, per=26.77%, avg=365.65, stdev=238.07, samples=34 iops : min= 3, max= 53, avg=22.35, stdev=15.09, samples=34 write: IOPS=21, BW=350KiB/s (358kB/s)(6032KiB/17234msec); 0 zone resets clat (msec): min=11, max=141, avg=31.10, stdev=17.53 lat (msec): min=11, max=141, avg=31.11, stdev=17.53 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 41], 90.00th=[ 54], 95.00th=[ 67], | 99.00th=[ 92], 99.50th=[ 123], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 127, max= 736, per=24.23%, avg=348.44, stdev=183.23, samples=34 iops : min= 7, max= 46, avg=21.29, stdev=11.72, samples=34 lat (msec) : 4=4.82%, 10=24.09%, 20=26.04%, 50=37.76%, 100=7.03% lat (msec) : 250=0.26% cpu : usr=0.09%, sys=11.64%, ctx=1671, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157382: Wed Sep 2 09:12:53 2026 read: IOPS=21, BW=348KiB/s (357kB/s)(6032KiB/17309msec) clat (usec): min=3083, max=97667, avg=14632.88, stdev=14178.70 lat (usec): min=3083, max=97668, avg=14633.67, stdev=14178.62 clat percentiles (usec): | 1.00th=[ 3294], 5.00th=[ 3818], 10.00th=[ 4178], 20.00th=[ 4752], | 30.00th=[ 5342], 40.00th=[ 6325], 50.00th=[ 9241], 60.00th=[12518], | 70.00th=[16188], 80.00th=[22414], 90.00th=[35390], 95.00th=[42206], | 99.00th=[64750], 99.50th=[84411], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 158, max= 800, per=25.27%, avg=345.18, stdev=175.74, samples=34 iops : min= 9, max= 50, avg=21.09, stdev=11.21, samples=34 write: IOPS=22, BW=361KiB/s (370kB/s)(6256KiB/17309msec); 0 zone resets clat (msec): min=13, max=131, avg=29.96, stdev=15.32 lat (msec): min=13, max=131, avg=29.96, stdev=15.32 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 19], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 53], 95.00th=[ 59], | 99.00th=[ 88], 99.50th=[ 94], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 95, max= 736, per=24.95%, avg=358.74, stdev=179.40, samples=34 iops : min= 5, max= 46, avg=21.94, stdev=11.43, samples=34 lat (msec) : 4=3.52%, 10=22.79%, 20=25.13%, 50=41.28%, 100=7.16% lat (msec) : 250=0.13% cpu : usr=0.12%, sys=11.46%, ctx=1598, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1367KiB/s (1400kB/s), 328KiB/s-363KiB/s (336kB/s-372kB/s), io=23.4MiB (24.5MB), run=17234-17523msec WRITE: bw=1438KiB/s (1473kB/s), 350KiB/s-373KiB/s (358kB/s-382kB/s), io=24.6MiB (25.8MB), run=17234-17523msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=157394: Wed Sep 2 09:13:01 2026 read: IOPS=2, BW=3063KiB/s (3137kB/s)(7168KiB/2340msec) clat (msec): min=50, max=536, avg=183.91, stdev=169.64 lat (msec): min=50, max=536, avg=183.91, stdev=169.64 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 89], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 104], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 264], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1777, max= 4096, per=43.86%, avg=2984.00, stdev=1242.64, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=2, BW=2188KiB/s (2241kB/s)(5120KiB/2340msec); 0 zone resets clat (msec): min=66, max=573, avg=189.12, stdev=215.64 lat (msec): min=66, max=573, avg=189.18, stdev=215.64 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 105], 60.00th=[ 105], | 70.00th=[ 118], 80.00th=[ 118], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2048, max= 4015, per=28.38%, avg=2703.67, stdev=1135.65, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=41.67%, 250=33.33%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=15.60%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157395: Wed Sep 2 09:13:01 2026 read: IOPS=0, BW=689KiB/s (706kB/s)(2048KiB/2972msec) clat (msec): min=44, max=253, avg=149.12, stdev=147.34 lat (msec): min=44, max=253, avg=149.12, stdev=147.34 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 45], 40.00th=[ 45], 50.00th=[ 45], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 1796, max= 2048, per=28.25%, avg=1922.00, stdev=178.19, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3445KiB/s (3528kB/s)(10.0MiB/2972msec); 0 zone resets clat (msec): min=64, max=917, avg=257.07, stdev=250.81 lat (msec): min=64, max=917, avg=257.13, stdev=250.82 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 95], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 180], 60.00th=[ 192], | 70.00th=[ 279], 80.00th=[ 292], 90.00th=[ 342], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 2048, max= 6144, per=42.72%, avg=4069.00, stdev=2048.53, samples=3 iops : min= 2, max= 6, avg= 3.67, stdev= 2.08, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=16.73%, ctx=113, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157396: Wed Sep 2 09:13:01 2026 read: IOPS=1, BW=2041KiB/s (2090kB/s)(6144KiB/3010msec) clat (msec): min=17, max=357, avg=171.83, stdev=112.06 lat (msec): min=17, max=357, avg=171.83, stdev=112.06 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 192], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2007, max= 4096, per=39.94%, avg=2717.00, stdev=1194.42, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=2041KiB/s (2090kB/s)(6144KiB/3010msec); 0 zone resets clat (msec): min=30, max=604, avg=320.70, stdev=195.78 lat (msec): min=30, max=604, avg=320.77, stdev=195.77 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 368], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1777, max= 2048, per=20.68%, avg=1970.00, stdev=130.11, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 20=8.33%, 50=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=12.43%, ctx=319, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157397: Wed Sep 2 09:13:01 2026 read: IOPS=1, BW=1948KiB/s (1995kB/s)(5120KiB/2628msec) clat (msec): min=77, max=310, avg=175.72, stdev=104.58 lat (msec): min=77, max=310, avg=175.73, stdev=104.58 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 2007, max= 6144, per=59.91%, avg=4075.50, stdev=2925.30, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2728KiB/s (2793kB/s)(7168KiB/2628msec); 0 zone resets clat (msec): min=63, max=535, avg=246.55, stdev=169.16 lat (msec): min=64, max=535, avg=246.61, stdev=169.16 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 87], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 239], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 351], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1790, max= 6144, per=36.74%, avg=3499.25, stdev=2023.89, samples=4 iops : min= 1, max= 6, avg= 3.00, stdev= 2.16, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=13.82%, ctx=133, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6804KiB/s (6967kB/s), 689KiB/s-3063KiB/s (706kB/s-3137kB/s), io=20.0MiB (20.0MB), run=2340-3010msec WRITE: bw=9526KiB/s (9754kB/s), 2041KiB/s-3445KiB/s (2090kB/s-3528kB/s), io=28.0MiB (29.4MB), run=2340-3010msec rand-rw: (groupid=0, jobs=1): err= 0: pid=157390: Wed Sep 2 09:13:01 2026 read: IOPS=3, BW=3563KiB/s (3648kB/s)(7168KiB/2012msec) clat (usec): min=491, max=218658, avg=122529.09, stdev=66566.25 lat (usec): min=492, max=218659, avg=122530.40, stdev=66566.34 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[108528], | 30.00th=[111674], 40.00th=[111674], 50.00th=[111674], 60.00th=[145753], | 70.00th=[145753], 80.00th=[160433], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 2023, max= 5287, per=52.73%, avg=3722.00, stdev=1636.12, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2545KiB/s (2606kB/s)(5120KiB/2012msec); 0 zone resets clat (msec): min=118, max=465, avg=219.80, stdev=142.78 lat (msec): min=119, max=465, avg=219.85, stdev=142.77 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1762, max= 3856, per=25.77%, avg=2547.00, stdev=1141.11, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=83.33%, 500=8.33% cpu : usr=0.00%, sys=48.63%, ctx=1266, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157391: Wed Sep 2 09:13:01 2026 read: IOPS=0, BW=710KiB/s (727kB/s)(2048KiB/2884msec) clat (usec): min=140806, max=141748, avg=141277.55, stdev=665.93 lat (usec): min=140808, max=141750, avg=141279.35, stdev=666.35 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 142], 95.00th=[ 142], | 99.00th=[ 142], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 1741, max= 2048, per=26.84%, avg=1894.50, stdev=217.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3551KiB/s (3636kB/s)(10.0MiB/2884msec); 0 zone resets clat (msec): min=76, max=582, avg=256.73, stdev=151.71 lat (msec): min=76, max=582, avg=256.79, stdev=151.72 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 100], | 30.00th=[ 153], 40.00th=[ 207], 50.00th=[ 215], 60.00th=[ 249], | 70.00th=[ 279], 80.00th=[ 288], 90.00th=[ 422], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 4096, max= 6144, per=54.05%, avg=5341.67, stdev=1093.61, samples=3 iops : min= 4, max= 6, avg= 5.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=44.33%, ctx=409, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157392: Wed Sep 2 09:13:01 2026 read: IOPS=2, BW=3043KiB/s (3116kB/s)(6144KiB/2019msec) clat (usec): min=436, max=226466, avg=141768.48, stdev=76571.24 lat (usec): min=437, max=226467, avg=141770.96, stdev=76571.19 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 437], 10.00th=[ 437], 20.00th=[135267], | 30.00th=[135267], 40.00th=[141558], 50.00th=[141558], 60.00th=[164627], | 70.00th=[181404], 80.00th=[181404], 90.00th=[225444], 95.00th=[225444], | 99.00th=[225444], 99.50th=[225444], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 3856, max= 6071, per=70.31%, avg=4963.50, stdev=1566.24, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=3043KiB/s (3116kB/s)(6144KiB/2019msec); 0 zone resets clat (msec): min=113, max=351, avg=192.23, stdev=88.93 lat (msec): min=114, max=352, avg=192.28, stdev=88.93 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 199], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2023, max= 3856, per=31.45%, avg=3108.67, stdev=962.20, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=83.33%, 500=8.33% cpu : usr=0.05%, sys=52.97%, ctx=582, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157393: Wed Sep 2 09:13:01 2026 read: IOPS=1, BW=1765KiB/s (1807kB/s)(5120KiB/2901msec) clat (usec): min=308, max=174054, avg=58290.36, stdev=81729.15 lat (usec): min=308, max=174054, avg=58291.02, stdev=81728.89 clat percentiles (usec): | 1.00th=[ 310], 5.00th=[ 310], 10.00th=[ 310], 20.00th=[ 310], | 30.00th=[ 383], 40.00th=[ 383], 50.00th=[ 898], 60.00th=[ 898], | 70.00th=[115868], 80.00th=[115868], 90.00th=[173016], 95.00th=[173016], | 99.00th=[173016], 99.50th=[173016], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 2048, max= 6144, per=58.03%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2471KiB/s (2530kB/s)(7168KiB/2901msec); 0 zone resets clat (msec): min=126, max=723, avg=355.69, stdev=235.47 lat (msec): min=126, max=723, avg=355.74, stdev=235.48 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 155], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 275], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 617], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1744, max= 4096, per=25.07%, avg=2477.75, stdev=1087.60, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=32.17%, ctx=587, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7060KiB/s (7229kB/s), 710KiB/s-3563KiB/s (727kB/s-3648kB/s), io=20.0MiB (20.0MB), run=2012-2901msec WRITE: bw=9883KiB/s (10.1MB/s), 2471KiB/s-3551KiB/s (2530kB/s-3636kB/s), io=28.0MiB (29.4MB), run=2012-2901msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=157403: Wed Sep 2 09:13:09 2026 read: IOPS=2, BW=9854KiB/s (10.1MB/s)(12.0MiB/1247msec) clat (msec): min=357, max=429, avg=404.75, stdev=41.20 lat (msec): min=357, max=429, avg=404.75, stdev=41.20 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7275, max= 7861, per=84.45%, avg=7568.00, stdev=414.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=53.93%, ctx=2496, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157404: Wed Sep 2 09:13:09 2026 read: IOPS=0, BW=2241KiB/s (2294kB/s)(4096KiB/1828msec) clat (nsec): min=418609k, max=418609k, avg=418609415.00, stdev= 0.00 lat (nsec): min=418612k, max=418612k, avg=418611765.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7275, max= 7275, per=81.18%, avg=7275.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4481KiB/s (4589kB/s)(8192KiB/1828msec); 0 zone resets clat (msec): min=455, max=911, avg=683.69, stdev=322.38 lat (msec): min=456, max=911, avg=684.00, stdev=322.35 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7861, max= 7861, per=43.85%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.11%, sys=13.19%, ctx=676, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157405: Wed Sep 2 09:13:09 2026 write: IOPS=1, BW=7862KiB/s (8050kB/s)(12.0MiB/1563msec); 0 zone resets clat (msec): min=247, max=1054, avg=517.84, stdev=465.12 lat (msec): min=247, max=1055, avg=518.06, stdev=465.16 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min=14550, max=14550, per=81.17%, avg=14550.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.94%, ctx=84, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157406: Wed Sep 2 09:13:09 2026 write: IOPS=1, BW=8026KiB/s (8219kB/s)(12.0MiB/1531msec); 0 zone resets clat (msec): min=186, max=1008, avg=502.25, stdev=442.64 lat (msec): min=187, max=1008, avg=502.51, stdev=442.66 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7275, max= 7275, per=40.59%, avg=7275.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.22%, ctx=89, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8963KiB/s (9178kB/s), 2241KiB/s-9854KiB/s (2294kB/s-10.1MB/s), io=16.0MiB (16.8MB), run=1247-1828msec WRITE: bw=17.5MiB/s (18.4MB/s), 4481KiB/s-8026KiB/s (4589kB/s-8219kB/s), io=32.0MiB (33.6MB), run=1531-1828msec rand-rw: (groupid=0, jobs=1): err= 0: pid=157408: Wed Sep 2 09:13:09 2026 read: IOPS=2, BW=10.7MiB/s (11.3MB/s)(12.0MiB/1117msec) clat (msec): min=314, max=433, avg=358.92, stdev=65.34 lat (msec): min=314, max=433, avg=358.93, stdev=65.34 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7876, max= 8192, per=85.23%, avg=8034.00, stdev=223.45, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=21.51%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157409: Wed Sep 2 09:13:09 2026 read: IOPS=0, BW=2357KiB/s (2413kB/s)(4096KiB/1738msec) clat (nsec): min=1031.5M, max=1031.5M, avg=1031525552.00, stdev= 0.00 lat (nsec): min=1031.5M, max=1031.5M, avg=1031526382.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8175, max= 8175, per=86.73%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4713KiB/s (4827kB/s)(8192KiB/1738msec); 0 zone resets clat (msec): min=169, max=508, avg=338.83, stdev=239.57 lat (msec): min=169, max=508, avg=339.11, stdev=239.60 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.17%, sys=13.07%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157410: Wed Sep 2 09:13:09 2026 write: IOPS=1, BW=7186KiB/s (7358kB/s)(12.0MiB/1710msec); 0 zone resets clat (msec): min=138, max=790, avg=548.24, stdev=356.57 lat (msec): min=139, max=790, avg=548.50, stdev=356.58 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8192, max= 8192, per=43.45%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.12%, sys=13.75%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157411: Wed Sep 2 09:13:09 2026 write: IOPS=1, BW=7728KiB/s (7914kB/s)(12.0MiB/1590msec); 0 zone resets clat (msec): min=180, max=754, avg=525.40, stdev=304.43 lat (msec): min=180, max=755, avg=525.70, stdev=304.45 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8175, max= 8192, per=43.41%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=17.31%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9427KiB/s (9653kB/s), 2357KiB/s-10.7MiB/s (2413kB/s-11.3MB/s), io=16.0MiB (16.8MB), run=1117-1738msec WRITE: bw=18.4MiB/s (19.3MB/s), 4713KiB/s-7728KiB/s (4827kB/s-7914kB/s), io=32.0MiB (33.6MB), run=1590-1738msec