== sanity test 398b: DIO and buffer IO race ============== 13:20:51 (1785777651) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.26873 s, 6.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144629: Mon Aug 3 13:24:23 2026 read: IOPS=8, BW=32.1KiB/s (32.9kB/s)(5992KiB/186569msec) clat (usec): min=31, max=1138.3k, avg=62068.40, stdev=53271.03 lat (usec): min=31, max=1138.3k, avg=62069.86, stdev=53271.16 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 15664], | 20.00th=[ 29492], 30.00th=[ 36439], 40.00th=[ 44303], | 50.00th=[ 52691], 60.00th=[ 62129], 70.00th=[ 73925], | 80.00th=[ 90702], 90.00th=[ 117965], 95.00th=[ 137364], | 99.00th=[ 206570], 99.50th=[ 229639], 99.90th=[ 557843], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 87, per=25.27%, avg=32.35, stdev=15.18, samples=357 iops : min= 1, max= 21, avg= 7.43, stdev= 3.83, samples=357 write: IOPS=8, BW=33.7KiB/s (34.6kB/s)(6296KiB/186569msec); 0 zone resets clat (usec): min=992, max=589595, avg=59134.91, stdev=60381.54 lat (usec): min=993, max=589597, avg=59137.93, stdev=60382.75 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 2769], 20.00th=[ 6849], | 30.00th=[ 13042], 40.00th=[ 27657], 50.00th=[ 44827], 60.00th=[ 62129], | 70.00th=[ 78119], 80.00th=[100140], 90.00th=[137364], 95.00th=[177210], | 99.00th=[250610], 99.50th=[299893], 99.90th=[467665], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 79, per=25.30%, avg=33.90, stdev=16.56, samples=358 iops : min= 1, max= 19, avg= 7.81, stdev= 4.19, samples=358 lat (usec) : 50=0.75%, 100=3.26%, 250=0.20%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.07% lat (msec) : 2=4.33%, 4=2.21%, 10=6.90%, 20=5.99%, 50=26.07% lat (msec) : 100=32.10%, 250=17.29%, 500=0.62%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=3.43%, ctx=6442, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144630: Mon Aug 3 13:24:23 2026 read: IOPS=8, BW=32.0KiB/s (32.8kB/s)(5940KiB/185453msec) clat (usec): min=31, max=626874, avg=61296.44, stdev=51039.16 lat (usec): min=31, max=626874, avg=61300.18, stdev=51038.28 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 1795], 20.00th=[ 27395], | 30.00th=[ 36439], 40.00th=[ 42730], 50.00th=[ 52167], 60.00th=[ 61080], | 70.00th=[ 72877], 80.00th=[ 88605], 90.00th=[113771], 95.00th=[143655], | 99.00th=[233833], 99.50th=[308282], 99.90th=[463471], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 5, max= 86, per=25.24%, avg=32.30, stdev=15.69, samples=355 iops : min= 1, max= 21, avg= 7.42, stdev= 3.95, samples=355 write: IOPS=8, BW=34.2KiB/s (35.1kB/s)(6348KiB/185453msec); 0 zone resets clat (usec): min=1104, max=1120.8k, avg=59182.41, stdev=64653.50 lat (usec): min=1105, max=1120.8k, avg=59191.51, stdev=64656.44 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 2769], | 20.00th=[ 6849], 30.00th=[ 12649], 40.00th=[ 27132], | 50.00th=[ 43254], 60.00th=[ 60556], 70.00th=[ 76022], | 80.00th=[ 101188], 90.00th=[ 139461], 95.00th=[ 170918], | 99.00th=[ 265290], 99.50th=[ 295699], 99.90th=[ 354419], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 95, per=25.74%, avg=34.50, stdev=17.05, samples=355 iops : min= 1, max= 23, avg= 7.96, stdev= 4.30, samples=355 lat (usec) : 50=0.52%, 100=3.78%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.56%, 4=2.18%, 10=7.29%, 20=5.96%, 50=26.63% lat (msec) : 100=30.70%, 250=16.76%, 500=1.07%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=3.47%, ctx=6333, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144631: Mon Aug 3 13:24:23 2026 read: IOPS=8, BW=32.3KiB/s (33.0kB/s)(6028KiB/186820msec) clat (usec): min=36, max=1147.3k, avg=62242.72, stdev=51815.59 lat (usec): min=36, max=1147.3k, avg=62250.66, stdev=51816.07 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 17171], | 20.00th=[ 28967], 30.00th=[ 35914], 40.00th=[ 43779], | 50.00th=[ 53740], 60.00th=[ 64750], 70.00th=[ 76022], | 80.00th=[ 91751], 90.00th=[ 115868], 95.00th=[ 137364], | 99.00th=[ 191890], 99.50th=[ 256902], 99.90th=[ 408945], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 5, max= 94, per=25.27%, avg=32.34, stdev=16.31, samples=359 iops : min= 1, max= 23, avg= 7.43, stdev= 4.13, samples=359 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6260KiB/186820msec); 0 zone resets clat (usec): min=1068, max=612656, avg=59081.21, stdev=61226.51 lat (usec): min=1071, max=612658, avg=59085.34, stdev=61225.83 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1385], 10.00th=[ 2638], 20.00th=[ 6521], | 30.00th=[ 12518], 40.00th=[ 26346], 50.00th=[ 43254], 60.00th=[ 60031], | 70.00th=[ 78119], 80.00th=[104334], 90.00th=[137364], 95.00th=[170918], | 99.00th=[248513], 99.50th=[312476], 99.90th=[471860], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 94, per=24.68%, avg=33.07, stdev=16.20, samples=365 iops : min= 1, max= 23, avg= 7.61, stdev= 4.08, samples=365 lat (usec) : 50=0.39%, 100=3.29%, 250=0.33%, 750=0.10%, 1000=0.03% lat (msec) : 2=4.49%, 4=2.41%, 10=7.00%, 20=5.83%, 50=26.86% lat (msec) : 100=30.34%, 250=18.20%, 500=0.68%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=3.54%, ctx=6406, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144632: Mon Aug 3 13:24:23 2026 read: IOPS=8, BW=32.4KiB/s (33.1kB/s)(6052KiB/187005msec) clat (usec): min=35, max=387638, avg=59499.36, stdev=44332.68 lat (usec): min=35, max=387639, avg=59503.18, stdev=44332.37 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 93], 20.00th=[ 26870], | 30.00th=[ 36439], 40.00th=[ 44303], 50.00th=[ 53216], 60.00th=[ 61080], | 70.00th=[ 72877], 80.00th=[ 87557], 90.00th=[112722], 95.00th=[137364], | 99.00th=[217056], 99.50th=[244319], 99.90th=[367002], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 107, per=25.58%, avg=32.74, stdev=15.88, samples=356 iops : min= 1, max= 26, avg= 7.53, stdev= 4.00, samples=356 write: IOPS=8, BW=33.3KiB/s (34.1kB/s)(6236KiB/187005msec); 0 zone resets clat (usec): min=1031, max=1556.0k, avg=61811.44, stdev=74402.65 lat (usec): min=1031, max=1556.0k, avg=61815.53, stdev=74404.35 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 2573], | 20.00th=[ 6587], 30.00th=[ 12780], 40.00th=[ 27919], | 50.00th=[ 44303], 60.00th=[ 61080], 70.00th=[ 79168], | 80.00th=[ 105382], 90.00th=[ 141558], 95.00th=[ 181404], | 99.00th=[ 283116], 99.50th=[ 325059], 99.90th=[ 513803], | 99.95th=[1551893], 99.99th=[1551893] bw ( KiB/s): min= 7, max= 95, per=24.93%, avg=33.41, stdev=15.83, samples=359 iops : min= 1, max= 23, avg= 7.70, stdev= 3.99, samples=359 lat (usec) : 50=1.04%, 100=3.91%, 250=0.16%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=4.49%, 4=2.21%, 10=7.23%, 20=5.66%, 50=25.39% lat (msec) : 100=31.38%, 250=17.15%, 500=1.07%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=3.34%, ctx=6311, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (131kB/s), 32.0KiB/s-32.4KiB/s (32.8kB/s-33.1kB/s), io=23.4MiB (24.6MB), run=185453-187005msec WRITE: bw=134KiB/s (138kB/s), 33.3KiB/s-34.2KiB/s (34.1kB/s-35.1kB/s), io=24.6MiB (25.7MB), run=185453-187005msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144625: Mon Aug 3 13:27:44 2026 read: IOPS=3, BW=15.7KiB/s (16.0kB/s)(5992KiB/382581msec) clat (msec): min=5, max=1172, avg=50.31, stdev=60.55 lat (msec): min=5, max=1172, avg=50.31, stdev=60.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 67], 90.00th=[ 115], 95.00th=[ 157], | 99.00th=[ 275], 99.50th=[ 351], 99.90th=[ 550], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 87, per=32.30%, avg=19.70, stdev=14.27, samples=581 iops : min= 1, max= 21, avg= 4.26, stdev= 3.63, samples=581 write: IOPS=4, BW=16.5KiB/s (16.9kB/s)(6296KiB/382581msec); 0 zone resets clat (msec): min=39, max=872, avg=194.84, stdev=94.56 lat (msec): min=39, max=872, avg=194.84, stdev=94.56 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 79], 10.00th=[ 92], 20.00th=[ 117], | 30.00th=[ 140], 40.00th=[ 159], 50.00th=[ 178], 60.00th=[ 199], | 70.00th=[ 228], 80.00th=[ 264], 90.00th=[ 313], 95.00th=[ 372], | 99.00th=[ 510], 99.50th=[ 567], 99.90th=[ 651], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 48, per=25.49%, avg=16.31, stdev= 8.11, samples=731 iops : min= 1, max= 12, avg= 3.41, stdev= 2.09, samples=731 lat (msec) : 10=1.24%, 20=10.97%, 50=23.05%, 100=14.55%, 250=38.28% lat (msec) : 500=11.26%, 750=0.59%, 1000=0.03%, 2000=0.03% cpu : usr=0.03%, sys=0.91%, ctx=5047, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144626: Mon Aug 3 13:27:44 2026 read: IOPS=3, BW=15.3KiB/s (15.7kB/s)(5940KiB/387658msec) clat (msec): min=6, max=1204, avg=51.22, stdev=63.05 lat (msec): min=6, max=1204, avg=51.22, stdev=63.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 69], 90.00th=[ 111], 95.00th=[ 157], | 99.00th=[ 284], 99.50th=[ 342], 99.90th=[ 584], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 80, per=31.91%, avg=19.47, stdev=13.57, samples=583 iops : min= 1, max= 20, avg= 4.21, stdev= 3.44, samples=583 write: IOPS=4, BW=16.4KiB/s (16.8kB/s)(6348KiB/387658msec); 0 zone resets clat (msec): min=37, max=821, avg=195.96, stdev=97.18 lat (msec): min=37, max=821, avg=195.96, stdev=97.18 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 80], 10.00th=[ 93], 20.00th=[ 118], | 30.00th=[ 136], 40.00th=[ 157], 50.00th=[ 180], 60.00th=[ 201], | 70.00th=[ 226], 80.00th=[ 257], 90.00th=[ 326], 95.00th=[ 380], | 99.00th=[ 531], 99.50th=[ 592], 99.90th=[ 785], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 55, per=25.89%, avg=16.57, stdev= 8.28, samples=726 iops : min= 1, max= 13, avg= 3.48, stdev= 2.14, samples=726 lat (msec) : 10=1.56%, 20=10.29%, 50=22.49%, 100=14.58%, 250=39.10% lat (msec) : 500=11.23%, 750=0.65%, 1000=0.07%, 2000=0.03% cpu : usr=0.03%, sys=0.94%, ctx=5097, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144627: Mon Aug 3 13:27:44 2026 read: IOPS=3, BW=15.6KiB/s (15.9kB/s)(6028KiB/387417msec) clat (msec): min=5, max=574, avg=51.31, stdev=53.64 lat (msec): min=5, max=574, avg=51.32, stdev=53.64 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 75], 90.00th=[ 113], 95.00th=[ 155], | 99.00th=[ 251], 99.50th=[ 317], 99.90th=[ 535], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 87, per=31.33%, avg=19.11, stdev=13.80, samples=602 iops : min= 1, max= 21, avg= 4.13, stdev= 3.49, samples=602 write: IOPS=4, BW=16.2KiB/s (16.5kB/s)(6260KiB/387417msec); 0 zone resets clat (msec): min=44, max=1279, avg=197.71, stdev=101.53 lat (msec): min=44, max=1279, avg=197.71, stdev=101.53 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 79], 10.00th=[ 92], 20.00th=[ 116], | 30.00th=[ 140], 40.00th=[ 161], 50.00th=[ 180], 60.00th=[ 205], | 70.00th=[ 230], 80.00th=[ 257], 90.00th=[ 321], 95.00th=[ 380], | 99.00th=[ 523], 99.50th=[ 575], 99.90th=[ 969], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 47, per=25.71%, avg=16.45, stdev= 8.00, samples=720 iops : min= 1, max= 11, avg= 3.45, stdev= 2.07, samples=720 lat (msec) : 10=1.27%, 20=10.61%, 50=22.30%, 100=15.36%, 250=38.64% lat (msec) : 500=11.17%, 750=0.52%, 1000=0.10%, 2000=0.03% cpu : usr=0.03%, sys=0.93%, ctx=5039, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144628: Mon Aug 3 13:27:44 2026 read: IOPS=3, BW=15.8KiB/s (16.2kB/s)(6052KiB/383166msec) clat (msec): min=6, max=582, avg=50.00, stdev=53.33 lat (msec): min=6, max=582, avg=50.01, stdev=53.33 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 67], 90.00th=[ 115], 95.00th=[ 150], | 99.00th=[ 251], 99.50th=[ 355], 99.90th=[ 575], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 88, per=32.72%, avg=19.96, stdev=13.94, samples=580 iops : min= 1, max= 22, avg= 4.33, stdev= 3.54, samples=580 write: IOPS=4, BW=16.3KiB/s (16.7kB/s)(6236KiB/383166msec); 0 zone resets clat (msec): min=53, max=1544, avg=196.91, stdev=104.70 lat (msec): min=53, max=1544, avg=196.91, stdev=104.70 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 79], 10.00th=[ 93], 20.00th=[ 118], | 30.00th=[ 138], 40.00th=[ 159], 50.00th=[ 178], 60.00th=[ 197], | 70.00th=[ 228], 80.00th=[ 262], 90.00th=[ 317], 95.00th=[ 380], | 99.00th=[ 550], 99.50th=[ 651], 99.90th=[ 969], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7, max= 48, per=25.56%, avg=16.36, stdev= 8.11, samples=722 iops : min= 1, max= 12, avg= 3.42, stdev= 2.09, samples=722 lat (msec) : 10=0.81%, 20=11.39%, 50=22.85%, 100=14.45%, 250=38.31% lat (msec) : 500=11.43%, 750=0.55%, 1000=0.16%, 2000=0.03% cpu : usr=0.03%, sys=0.95%, ctx=4955, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=61.9KiB/s (63.4kB/s), 15.3KiB/s-15.8KiB/s (15.7kB/s-16.2kB/s), io=23.4MiB (24.6MB), run=382581-387658msec WRITE: bw=64.9KiB/s (66.4kB/s), 16.2KiB/s-16.5KiB/s (16.5kB/s-16.9kB/s), io=24.6MiB (25.7MB), run=382581-387658msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144705: Mon Aug 3 13:28:37 2026 read: IOPS=9, BW=149KiB/s (152kB/s)(5920KiB/39804msec) clat (usec): min=32, max=304676, avg=58106.30, stdev=45363.61 lat (usec): min=32, max=304676, avg=58108.78, stdev=45365.19 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 18744], | 30.00th=[ 35914], 40.00th=[ 43254], 50.00th=[ 54789], 60.00th=[ 63701], | 70.00th=[ 73925], 80.00th=[ 89654], 90.00th=[111674], 95.00th=[130548], | 99.00th=[219153], 99.50th=[254804], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 346, per=24.95%, avg=149.95, stdev=59.26, samples=77 iops : min= 1, max= 21, avg= 8.58, stdev= 3.75, samples=77 write: IOPS=9, BW=160KiB/s (164kB/s)(6368KiB/39804msec); 0 zone resets clat (usec): min=1517, max=265932, avg=45050.22, stdev=49506.62 lat (usec): min=1518, max=265934, avg=45054.65, stdev=49508.84 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2671], 10.00th=[ 4817], 20.00th=[ 7570], | 30.00th=[ 10683], 40.00th=[ 14615], 50.00th=[ 26608], 60.00th=[ 39584], | 70.00th=[ 54789], 80.00th=[ 74974], 90.00th=[113771], 95.00th=[154141], | 99.00th=[244319], 99.50th=[246416], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 23, max= 372, per=25.28%, avg=160.04, stdev=72.43, samples=78 iops : min= 1, max= 23, avg= 9.23, stdev= 4.63, samples=78 lat (usec) : 50=0.91%, 100=5.99%, 250=0.91%, 500=0.26% lat (msec) : 2=2.34%, 4=2.21%, 10=11.20%, 20=9.51%, 50=23.31% lat (msec) : 100=28.52%, 250=14.45%, 500=0.39% cpu : usr=0.06%, sys=3.93%, ctx=1435, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144707: Mon Aug 3 13:28:37 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(5744KiB/37244msec) clat (usec): min=33, max=324868, avg=56153.18, stdev=43193.55 lat (usec): min=33, max=324868, avg=56216.20, stdev=43238.09 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 363], | 30.00th=[ 34866], 40.00th=[ 43779], 50.00th=[ 53740], 60.00th=[ 64226], | 70.00th=[ 76022], 80.00th=[ 89654], 90.00th=[110625], 95.00th=[130548], | 99.00th=[168821], 99.50th=[187696], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 286, per=25.71%, avg=154.52, stdev=58.11, samples=73 iops : min= 1, max= 17, avg= 8.88, stdev= 3.68, samples=73 write: IOPS=10, BW=176KiB/s (180kB/s)(6544KiB/37244msec); 0 zone resets clat (usec): min=1497, max=301563, avg=40863.96, stdev=45506.96 lat (usec): min=1498, max=301564, avg=40865.85, stdev=45506.91 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2114], 10.00th=[ 5145], 20.00th=[ 7635], | 30.00th=[ 10159], 40.00th=[ 13698], 50.00th=[ 22676], 60.00th=[ 34341], | 70.00th=[ 50594], 80.00th=[ 70779], 90.00th=[102237], 95.00th=[129500], | 99.00th=[198181], 99.50th=[227541], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 30, max= 374, per=27.62%, avg=174.85, stdev=84.23, samples=73 iops : min= 1, max= 23, avg=10.16, stdev= 5.35, samples=73 lat (usec) : 50=1.30%, 100=7.16%, 250=0.65%, 500=0.26%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=1.56%, 10=11.72%, 20=10.29%, 50=22.79% lat (msec) : 100=28.65%, 250=12.24%, 500=0.39% cpu : usr=0.05%, sys=3.77%, ctx=1342, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144709: Mon Aug 3 13:28:37 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(6256KiB/38592msec) clat (usec): min=35, max=255103, avg=53307.51, stdev=42649.09 lat (usec): min=35, max=255105, avg=53308.68, stdev=42649.14 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 1139], | 30.00th=[ 31851], 40.00th=[ 41157], 50.00th=[ 52167], 60.00th=[ 58983], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[105382], 95.00th=[127402], | 99.00th=[200279], 99.50th=[250610], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 372, per=27.62%, avg=166.00, stdev=66.03, samples=74 iops : min= 1, max= 23, avg= 9.59, stdev= 4.18, samples=74 write: IOPS=9, BW=156KiB/s (160kB/s)(6032KiB/38592msec); 0 zone resets clat (usec): min=1539, max=352678, avg=46785.48, stdev=53826.64 lat (usec): min=1541, max=352680, avg=46806.86, stdev=53825.43 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3785], 10.00th=[ 5800], 20.00th=[ 8586], | 30.00th=[ 11469], 40.00th=[ 14746], 50.00th=[ 28443], 60.00th=[ 39584], | 70.00th=[ 53216], 80.00th=[ 78119], 90.00th=[114820], 95.00th=[162530], | 99.00th=[258999], 99.50th=[325059], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 383, per=24.50%, avg=155.08, stdev=73.81, samples=75 iops : min= 1, max= 23, avg= 8.92, stdev= 4.67, samples=75 lat (usec) : 50=1.04%, 100=7.81%, 250=1.04%, 500=0.13%, 750=0.13% lat (msec) : 2=1.56%, 4=1.56%, 10=10.94%, 20=10.16%, 50=23.70% lat (msec) : 100=28.65%, 250=12.50%, 500=0.78% cpu : usr=0.03%, sys=3.92%, ctx=1387, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144711: Mon Aug 3 13:28:37 2026 read: IOPS=9, BW=153KiB/s (157kB/s)(6032KiB/39407msec) clat (usec): min=32, max=268052, avg=56954.56, stdev=47877.67 lat (usec): min=32, max=268053, avg=56956.00, stdev=47877.63 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 109], | 30.00th=[ 29754], 40.00th=[ 43254], 50.00th=[ 53740], 60.00th=[ 65274], | 70.00th=[ 76022], 80.00th=[ 92799], 90.00th=[109577], 95.00th=[132645], | 99.00th=[233833], 99.50th=[261096], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 320, per=25.22%, avg=151.57, stdev=67.00, samples=77 iops : min= 1, max= 20, avg= 8.68, stdev= 4.23, samples=77 write: IOPS=9, BW=159KiB/s (163kB/s)(6256KiB/39407msec); 0 zone resets clat (usec): min=1317, max=225280, avg=45208.97, stdev=46628.03 lat (usec): min=1320, max=225282, avg=45212.08, stdev=46628.43 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2114], 10.00th=[ 4883], 20.00th=[ 6980], | 30.00th=[ 10421], 40.00th=[ 15926], 50.00th=[ 26084], 60.00th=[ 46400], | 70.00th=[ 60031], 80.00th=[ 77071], 90.00th=[110625], 95.00th=[143655], | 99.00th=[196084], 99.50th=[208667], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 380, per=25.07%, avg=158.68, stdev=67.59, samples=77 iops : min= 1, max= 23, avg= 9.13, stdev= 4.28, samples=77 lat (usec) : 50=1.69%, 100=7.94%, 250=1.17%, 750=0.13% lat (msec) : 2=2.73%, 4=2.47%, 10=10.16%, 20=8.46%, 50=19.53% lat (msec) : 100=31.25%, 250=14.19%, 500=0.26% cpu : usr=0.05%, sys=3.87%, ctx=1407, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=602KiB/s (616kB/s), 149KiB/s-162KiB/s (152kB/s-166kB/s), io=23.4MiB (24.5MB), run=37244-39804msec WRITE: bw=633KiB/s (648kB/s), 156KiB/s-176KiB/s (160kB/s-180kB/s), io=24.6MiB (25.8MB), run=37244-39804msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144706: Mon Aug 3 13:29:35 2026 read: IOPS=3, BW=60.5KiB/s (61.9kB/s)(5920KiB/97928msec) clat (msec): min=8, max=420, avg=54.89, stdev=59.04 lat (msec): min=8, max=420, avg=54.89, stdev=59.04 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 68], 90.00th=[ 128], 95.00th=[ 176], | 99.00th=[ 292], 99.50th=[ 326], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 29, max= 256, per=31.10%, avg=75.89, stdev=49.27, samples=153 iops : min= 1, max= 16, avg= 3.97, stdev= 3.21, samples=153 write: IOPS=4, BW=65.0KiB/s (66.6kB/s)(6368KiB/97928msec); 0 zone resets clat (msec): min=43, max=607, avg=194.04, stdev=82.86 lat (msec): min=43, max=607, avg=194.04, stdev=82.86 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 87], 10.00th=[ 104], 20.00th=[ 129], | 30.00th=[ 144], 40.00th=[ 163], 50.00th=[ 178], 60.00th=[ 203], | 70.00th=[ 224], 80.00th=[ 249], 90.00th=[ 309], 95.00th=[ 338], | 99.00th=[ 489], 99.50th=[ 567], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 29, max= 159, per=25.97%, avg=66.75, stdev=28.94, samples=187 iops : min= 1, max= 9, avg= 3.42, stdev= 1.90, samples=187 lat (msec) : 10=0.26%, 20=8.33%, 50=25.91%, 100=11.46%, 250=42.32% lat (msec) : 500=11.33%, 750=0.39% cpu : usr=0.03%, sys=0.95%, ctx=1258, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144708: Mon Aug 3 13:29:35 2026 read: IOPS=3, BW=58.7KiB/s (60.1kB/s)(5744KiB/97794msec) clat (msec): min=6, max=513, avg=57.87, stdev=67.01 lat (msec): min=6, max=513, avg=57.87, stdev=67.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 73], 90.00th=[ 131], 95.00th=[ 211], | 99.00th=[ 330], 99.50th=[ 464], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 23, max= 223, per=31.11%, avg=75.90, stdev=45.83, samples=147 iops : min= 1, max= 13, avg= 4.01, stdev= 2.91, samples=147 write: IOPS=4, BW=66.9KiB/s (68.5kB/s)(6544KiB/97794msec); 0 zone resets clat (msec): min=46, max=527, avg=187.14, stdev=78.14 lat (msec): min=46, max=527, avg=187.14, stdev=78.14 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 81], 10.00th=[ 95], 20.00th=[ 121], | 30.00th=[ 144], 40.00th=[ 161], 50.00th=[ 174], 60.00th=[ 194], | 70.00th=[ 215], 80.00th=[ 239], 90.00th=[ 296], 95.00th=[ 334], | 99.00th=[ 430], 99.50th=[ 489], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 30, max= 160, per=27.83%, avg=71.53, stdev=29.75, samples=179 iops : min= 1, max= 10, avg= 3.72, stdev= 1.89, samples=179 lat (msec) : 10=0.52%, 20=8.20%, 50=24.48%, 100=14.19%, 250=41.28% lat (msec) : 500=11.07%, 750=0.26% cpu : usr=0.02%, sys=0.91%, ctx=1215, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144710: Mon Aug 3 13:29:35 2026 read: IOPS=4, BW=66.3KiB/s (67.9kB/s)(6256KiB/94382msec) clat (msec): min=6, max=389, avg=52.61, stdev=52.61 lat (msec): min=6, max=389, avg=52.61, stdev=52.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 52], 80.00th=[ 68], 90.00th=[ 120], 95.00th=[ 144], | 99.00th=[ 271], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 29, max= 286, per=33.61%, avg=82.01, stdev=52.58, samples=150 iops : min= 1, max= 17, avg= 4.37, stdev= 3.31, samples=150 write: IOPS=3, BW=63.9KiB/s (65.4kB/s)(6032KiB/94382msec); 0 zone resets clat (msec): min=47, max=627, avg=195.54, stdev=88.41 lat (msec): min=47, max=627, avg=195.54, stdev=88.41 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 88], 10.00th=[ 103], 20.00th=[ 128], | 30.00th=[ 142], 40.00th=[ 161], 50.00th=[ 178], 60.00th=[ 201], | 70.00th=[ 224], 80.00th=[ 255], 90.00th=[ 305], 95.00th=[ 380], | 99.00th=[ 502], 99.50th=[ 558], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 29, max= 192, per=25.63%, avg=65.88, stdev=29.83, samples=178 iops : min= 1, max= 12, avg= 3.34, stdev= 1.94, samples=178 lat (msec) : 10=0.78%, 20=8.98%, 50=25.65%, 100=13.41%, 250=39.97% lat (msec) : 500=10.68%, 750=0.52% cpu : usr=0.03%, sys=0.96%, ctx=1260, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144712: Mon Aug 3 13:29:35 2026 read: IOPS=3, BW=62.8KiB/s (64.3kB/s)(6032KiB/96086msec) clat (msec): min=6, max=353, avg=51.75, stdev=50.31 lat (msec): min=6, max=353, avg=51.75, stdev=50.31 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 69], 90.00th=[ 114], 95.00th=[ 161], | 99.00th=[ 251], 99.50th=[ 330], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 29, max= 320, per=31.45%, avg=76.73, stdev=49.51, samples=153 iops : min= 1, max= 20, avg= 4.02, stdev= 3.14, samples=153 write: IOPS=4, BW=65.1KiB/s (66.7kB/s)(6256KiB/96086msec); 0 zone resets clat (msec): min=46, max=595, avg=195.10, stdev=86.02 lat (msec): min=46, max=595, avg=195.10, stdev=86.02 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 85], 10.00th=[ 104], 20.00th=[ 125], | 30.00th=[ 144], 40.00th=[ 161], 50.00th=[ 178], 60.00th=[ 203], | 70.00th=[ 222], 80.00th=[ 255], 90.00th=[ 313], 95.00th=[ 363], | 99.00th=[ 498], 99.50th=[ 567], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 23, max= 159, per=25.62%, avg=65.85, stdev=30.82, samples=186 iops : min= 1, max= 9, avg= 3.35, stdev= 2.01, samples=186 lat (msec) : 10=0.52%, 20=8.46%, 50=26.43%, 100=11.33%, 250=41.67% lat (msec) : 500=11.20%, 750=0.39% cpu : usr=0.02%, sys=0.96%, ctx=1278, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=245KiB/s (250kB/s), 58.7KiB/s-66.3KiB/s (60.1kB/s-67.9kB/s), io=23.4MiB (24.5MB), run=94382-97928msec WRITE: bw=257KiB/s (264kB/s), 63.9KiB/s-66.9KiB/s (65.4kB/s-68.5kB/s), io=24.6MiB (25.8MB), run=94382-97928msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144740: Mon Aug 3 13:29:50 2026 read: IOPS=1, BW=1701KiB/s (1742kB/s)(7168KiB/4213msec) clat (msec): min=142, max=515, avg=277.60, stdev=126.86 lat (msec): min=142, max=515, avg=277.60, stdev=126.86 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 182], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 271], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 334], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1932, max= 3710, per=89.82%, avg=2626.25, stdev=824.72, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1215KiB/s (1244kB/s)(5120KiB/4213msec); 0 zone resets clat (msec): min=309, max=638, avg=448.59, stdev=138.58 lat (msec): min=309, max=638, avg=448.69, stdev=138.55 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1845, max= 2039, per=47.22%, avg=1933.25, stdev=80.08, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=25.00%, 500=50.00%, 750=25.00% cpu : usr=0.00%, sys=10.28%, ctx=255, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144741: Mon Aug 3 13:29:50 2026 read: IOPS=0, BW=292KiB/s (299kB/s)(2048KiB/7003msec) clat (msec): min=353, max=362, avg=358.14, stdev= 6.55 lat (msec): min=353, max=362, avg=358.14, stdev= 6.56 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1410, max= 2043, per=59.05%, avg=1726.50, stdev=447.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1462KiB/s (1497kB/s)(10.0MiB/7003msec); 0 zone resets clat (msec): min=236, max=1493, avg=625.39, stdev=478.90 lat (msec): min=236, max=1493, avg=626.03, stdev=479.15 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 243], | 30.00th=[ 271], 40.00th=[ 279], 50.00th=[ 376], 60.00th=[ 426], | 70.00th=[ 617], 80.00th=[ 927], 90.00th=[ 1385], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 1809, max= 3968, per=70.26%, avg=2876.50, stdev=1008.32, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=6.80%, ctx=137, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144742: Mon Aug 3 13:29:50 2026 read: IOPS=1, BW=1129KiB/s (1156kB/s)(6144KiB/5442msec) clat (usec): min=806, max=851568, avg=392105.59, stdev=341591.11 lat (usec): min=808, max=851569, avg=392106.93, stdev=341590.99 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 27657], | 30.00th=[ 27657], 40.00th=[304088], 50.00th=[304088], 60.00th=[541066], | 70.00th=[633340], 80.00th=[633340], 90.00th=[851444], 95.00th=[851444], | 99.00th=[851444], 99.50th=[851444], 99.90th=[851444], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 1855, max= 4079, per=84.59%, avg=2473.50, stdev=1073.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1129KiB/s (1156kB/s)(6144KiB/5442msec); 0 zone resets clat (msec): min=145, max=1136, avg=511.16, stdev=387.47 lat (msec): min=145, max=1136, avg=511.23, stdev=387.48 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 368], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1809, max= 2840, per=51.70%, avg=2116.40, stdev=417.85, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 1000=8.33% lat (msec) : 50=8.33%, 250=16.67%, 500=25.00%, 750=16.67%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=7.13%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144743: Mon Aug 3 13:29:50 2026 read: IOPS=1, BW=1249KiB/s (1279kB/s)(5120KiB/4099msec) clat (usec): min=1659, max=392334, avg=227699.52, stdev=149117.21 lat (usec): min=1660, max=392335, avg=227700.82, stdev=149117.24 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1663], 10.00th=[ 1663], 20.00th=[ 1663], | 30.00th=[189793], 40.00th=[189793], 50.00th=[231736], 60.00th=[231736], | 70.00th=[325059], 80.00th=[325059], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 1845, max= 5752, per=100.00%, avg=3798.50, stdev=2762.67, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1749KiB/s (1791kB/s)(7168KiB/4099msec); 0 zone resets clat (msec): min=267, max=982, avg=417.84, stdev=253.95 lat (msec): min=267, max=982, avg=418.39, stdev=253.81 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 275], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 342], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 414], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1370, max= 4079, per=62.59%, avg=2562.60, stdev=1237.05, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 2=8.33%, 250=16.67%, 500=66.67%, 1000=8.33% cpu : usr=0.02%, sys=8.69%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2924KiB/s (2995kB/s), 292KiB/s-1701KiB/s (299kB/s-1742kB/s), io=20.0MiB (20.0MB), run=4099-7003msec WRITE: bw=4094KiB/s (4193kB/s), 1129KiB/s-1749KiB/s (1156kB/s-1791kB/s), io=28.0MiB (29.4MB), run=4099-7003msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144745: Mon Aug 3 13:29:51 2026 read: IOPS=1, BW=1073KiB/s (1098kB/s)(7168KiB/6683msec) clat (msec): min=94, max=1757, avg=478.14, stdev=609.72 lat (msec): min=94, max=1757, avg=478.14, stdev=609.72 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 121], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 222], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 768], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1345, max= 4079, per=79.90%, avg=2268.40, stdev=1051.60, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=766KiB/s (785kB/s)(5120KiB/6683msec); 0 zone resets clat (msec): min=340, max=994, avg=627.74, stdev=234.34 lat (msec): min=340, max=995, avg=629.15, stdev=234.16 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1831, max= 2027, per=48.89%, avg=1943.50, stdev=85.34, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=8.33%, 750=25.00%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.11%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144746: Mon Aug 3 13:29:51 2026 read: IOPS=0, BW=285KiB/s (292kB/s)(2048KiB/7178msec) clat (msec): min=138, max=212, avg=175.48, stdev=52.84 lat (msec): min=138, max=212, avg=175.48, stdev=52.84 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 213], 95.00th=[ 213], | 99.00th=[ 213], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 1641, max= 2027, per=64.60%, avg=1834.00, stdev=272.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1427KiB/s (1461kB/s)(10.0MiB/7178msec); 0 zone resets clat (msec): min=282, max=1369, avg=671.79, stdev=354.83 lat (msec): min=283, max=1369, avg=671.87, stdev=354.83 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 355], | 30.00th=[ 384], 40.00th=[ 460], 50.00th=[ 464], 60.00th=[ 634], | 70.00th=[ 793], 80.00th=[ 978], 90.00th=[ 1011], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1831, max= 3878, per=55.75%, avg=2215.88, stdev=675.48, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 250=16.67%, 500=41.67%, 750=8.33%, 1000=16.67%, 2000=16.67% cpu : usr=0.00%, sys=3.01%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144747: Mon Aug 3 13:29:51 2026 read: IOPS=0, BW=916KiB/s (937kB/s)(6144KiB/6711msec) clat (msec): min=107, max=808, avg=287.60, stdev=260.16 lat (msec): min=107, max=808, avg=287.60, stdev=260.16 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 203], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2000, max= 2035, per=70.91%, avg=2013.00, stdev=15.48, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=916KiB/s (937kB/s)(6144KiB/6711msec); 0 zone resets clat (msec): min=254, max=2095, avg=784.88, stdev=690.25 lat (msec): min=254, max=2096, avg=785.00, stdev=690.23 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 642], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 2000, max= 3757, per=61.51%, avg=2445.00, stdev=874.73, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=1.65%, ctx=106, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144748: Mon Aug 3 13:29:51 2026 read: IOPS=0, BW=710KiB/s (727kB/s)(5120KiB/7212msec) clat (msec): min=121, max=261, avg=175.35, stdev=56.54 lat (msec): min=121, max=261, avg=175.35, stdev=56.54 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1976, max= 4096, per=94.63%, avg=2686.67, stdev=1220.53, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=0, BW=994KiB/s (1018kB/s)(7168KiB/7212msec); 0 zone resets clat (msec): min=210, max=1984, avg=878.28, stdev=658.48 lat (msec): min=210, max=1984, avg=878.39, stdev=658.47 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 222], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 735], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1284], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1442, max= 3878, per=55.68%, avg=2213.40, stdev=954.52, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, 2000=25.00% cpu : usr=0.04%, sys=2.54%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2840KiB/s (2908kB/s), 285KiB/s-1073KiB/s (292kB/s-1098kB/s), io=20.0MiB (20.0MB), run=6683-7212msec WRITE: bw=3976KiB/s (4071kB/s), 766KiB/s-1427KiB/s (785kB/s-1461kB/s), io=28.0MiB (29.4MB), run=6683-7212msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144756: Mon Aug 3 13:30:14 2026 read: IOPS=0, BW=2626KiB/s (2689kB/s)(12.0MiB/4679msec) clat (msec): min=1404, max=1554, avg=1489.67, stdev=77.30 lat (msec): min=1404, max=1554, avg=1489.67, stdev=77.30 clat percentiles (msec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7772, max= 7984, per=100.00%, avg=7878.00, stdev=149.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=5.73%, ctx=249, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144757: Mon Aug 3 13:30:14 2026 read: IOPS=0, BW=819KiB/s (839kB/s)(4096KiB/5001msec) clat (nsec): min=1387.2M, max=1387.2M, avg=1387186428.00, stdev= 0.00 lat (nsec): min=1387.2M, max=1387.2M, avg=1387187627.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1638KiB/s (1677kB/s)(8192KiB/5001msec); 0 zone resets clat (msec): min=880, max=2683, avg=1782.09, stdev=1275.13 lat (msec): min=881, max=2684, avg=1782.80, stdev=1274.66 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 2668], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.46%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144758: Mon Aug 3 13:30:14 2026 write: IOPS=0, BW=2446KiB/s (2505kB/s)(12.0MiB/5024msec); 0 zone resets clat (msec): min=799, max=2229, avg=1670.73, stdev=764.23 lat (msec): min=802, max=2229, avg=1671.92, stdev=762.76 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 1989], 50.00th=[ 1989], 60.00th=[ 1989], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 7861, max= 8062, per=100.00%, avg=7961.50, stdev=142.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.83%, ctx=96, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144759: Mon Aug 3 13:30:14 2026 write: IOPS=0, BW=2763KiB/s (2829kB/s)(12.0MiB/4448msec); 0 zone resets clat (msec): min=610, max=2576, avg=1464.75, stdev=1007.62 lat (msec): min=610, max=2576, avg=1465.14, stdev=1007.66 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 5649, max= 8015, per=100.00%, avg=6832.00, stdev=1673.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.13%, sys=2.18%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3276KiB/s (3355kB/s), 819KiB/s-2626KiB/s (839kB/s-2689kB/s), io=16.0MiB (16.8MB), run=4679-5001msec WRITE: bw=6522KiB/s (6679kB/s), 1638KiB/s-2763KiB/s (1677kB/s-2829kB/s), io=32.0MiB (33.6MB), run=4448-5024msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144762: Mon Aug 3 13:30:15 2026 read: IOPS=0, BW=2098KiB/s (2149kB/s)(12.0MiB/5856msec) clat (msec): min=270, max=2852, avg=1951.30, stdev=1456.49 lat (msec): min=270, max=2852, avg=1951.30, stdev=1456.49 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 2735], 50.00th=[ 2735], 60.00th=[ 2735], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8031, max= 8159, per=100.00%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.30%, ctx=33, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144763: Mon Aug 3 13:30:15 2026 read: IOPS=0, BW=764KiB/s (783kB/s)(4096KiB/5358msec) clat (nsec): min=1818.0M, max=1818.0M, avg=1818960759.00, stdev= 0.00 lat (nsec): min=1818.0M, max=1818.0M, avg=1818962117.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1821], 5.00th=[ 1821], 10.00th=[ 1821], 20.00th=[ 1821], | 30.00th=[ 1821], 40.00th=[ 1821], 50.00th=[ 1821], 60.00th=[ 1821], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1529KiB/s (1566kB/s)(8192KiB/5358msec); 0 zone resets clat (msec): min=739, max=2796, avg=1767.91, stdev=1453.95 lat (msec): min=741, max=2796, avg=1768.72, stdev=1453.38 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 2802], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 7713, max= 7713, per=100.00%, avg=7713.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.70%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144764: Mon Aug 3 13:30:15 2026 write: IOPS=0, BW=2353KiB/s (2410kB/s)(12.0MiB/5222msec); 0 zone resets clat (msec): min=453, max=2423, avg=1738.29, stdev=1113.50 lat (msec): min=453, max=2425, avg=1739.89, stdev=1114.69 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8047, max= 8159, per=100.00%, avg=8103.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.88%, ctx=46, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144765: Mon Aug 3 13:30:15 2026 write: IOPS=0, BW=2887KiB/s (2956kB/s)(12.0MiB/4257msec); 0 zone resets clat (msec): min=928, max=1751, avg=1416.28, stdev=432.38 lat (msec): min=928, max=1753, avg=1417.22, stdev=433.07 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1569], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 7937, max= 8159, per=100.00%, avg=8048.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.77%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2798KiB/s (2865kB/s), 764KiB/s-2098KiB/s (783kB/s-2149kB/s), io=16.0MiB (16.8MB), run=5358-5856msec WRITE: bw=6116KiB/s (6262kB/s), 1529KiB/s-2887KiB/s (1566kB/s-2956kB/s), io=32.0MiB (33.6MB), run=4257-5358msec