== sanity test 398b: DIO and buffer IO race ============== 13:23:31 (1772475811) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.79564 s, 18.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181447: Mon Mar 2 13:24:32 2026 read: IOPS=29, BW=116KiB/s (119kB/s)(5992KiB/51608msec) clat (usec): min=35, max=652763, avg=18768.04, stdev=19082.89 lat (usec): min=35, max=652763, avg=18768.81, stdev=19082.90 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 7635], 10.00th=[ 8717], 20.00th=[ 10814], | 30.00th=[ 12649], 40.00th=[ 14353], 50.00th=[ 16712], 60.00th=[ 19006], | 70.00th=[ 21627], 80.00th=[ 24773], 90.00th=[ 30016], 95.00th=[ 35390], | 99.00th=[ 51643], 99.50th=[ 62653], 99.90th=[ 90702], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 6, max= 183, per=25.03%, avg=115.89, stdev=26.70, samples=102 iops : min= 1, max= 45, avg=28.54, stdev= 6.70, samples=102 write: IOPS=30, BW=122KiB/s (125kB/s)(6296KiB/51608msec); 0 zone resets clat (usec): min=793, max=89502, avg=14806.16, stdev=12082.74 lat (usec): min=794, max=89503, avg=14810.65, stdev=12082.67 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 2114], 10.00th=[ 2671], 20.00th=[ 3556], | 30.00th=[ 5932], 40.00th=[ 9503], 50.00th=[12256], 60.00th=[14877], | 70.00th=[19006], 80.00th=[23987], 90.00th=[31327], 95.00th=[37487], | 99.00th=[52167], 99.50th=[58459], 99.90th=[87557], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 55, max= 192, per=25.41%, avg=122.99, stdev=30.61, samples=101 iops : min= 13, max= 48, avg=30.32, stdev= 7.73, samples=101 lat (usec) : 50=0.07%, 100=0.62%, 250=0.55%, 750=0.03%, 1000=0.36% lat (msec) : 2=1.89%, 4=9.57%, 10=15.72%, 20=39.49%, 50=30.44% lat (msec) : 100=1.24%, 750=0.03% cpu : usr=0.17%, sys=21.31%, ctx=8837, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181448: Mon Mar 2 13:24:32 2026 read: IOPS=28, BW=115KiB/s (118kB/s)(5940KiB/51575msec) clat (usec): min=40, max=93340, avg=18471.28, stdev=9578.52 lat (usec): min=41, max=93341, avg=18473.68, stdev=9579.88 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 7504], 10.00th=[ 9110], 20.00th=[11076], | 30.00th=[12780], 40.00th=[14484], 50.00th=[16909], 60.00th=[19268], | 70.00th=[21890], 80.00th=[25035], 90.00th=[29754], 95.00th=[34341], | 99.00th=[52691], 99.50th=[58983], 99.90th=[73925], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 6, max= 184, per=24.82%, avg=114.93, stdev=28.64, samples=102 iops : min= 1, max= 46, avg=28.30, stdev= 7.14, samples=102 write: IOPS=30, BW=123KiB/s (126kB/s)(6348KiB/51575msec); 0 zone resets clat (usec): min=810, max=649751, avg=15111.57, stdev=19761.29 lat (usec): min=811, max=649752, avg=15112.55, stdev=19761.26 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 2147], 10.00th=[ 2835], 20.00th=[ 3490], | 30.00th=[ 6128], 40.00th=[ 9896], 50.00th=[ 12256], 60.00th=[ 15139], | 70.00th=[ 19268], 80.00th=[ 23725], 90.00th=[ 30802], 95.00th=[ 36963], | 99.00th=[ 52691], 99.50th=[ 60556], 99.90th=[ 79168], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 63, max= 208, per=25.56%, avg=123.72, stdev=32.53, samples=101 iops : min= 15, max= 52, avg=30.50, stdev= 8.19, samples=101 lat (usec) : 50=0.10%, 100=0.33%, 250=0.75%, 1000=0.29% lat (msec) : 2=2.08%, 4=9.77%, 10=14.62%, 20=39.52%, 50=31.35% lat (msec) : 100=1.17%, 750=0.03% cpu : usr=0.13%, sys=21.24%, ctx=8620, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181449: Mon Mar 2 13:24:32 2026 read: IOPS=29, BW=117KiB/s (120kB/s)(6028KiB/51543msec) clat (usec): min=43, max=85415, avg=18499.07, stdev=10024.48 lat (usec): min=44, max=85415, avg=18499.86, stdev=10024.50 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 7373], 10.00th=[ 8717], 20.00th=[10683], | 30.00th=[12518], 40.00th=[14353], 50.00th=[16909], 60.00th=[19268], | 70.00th=[21890], 80.00th=[25297], 90.00th=[31065], 95.00th=[35914], | 99.00th=[51643], 99.50th=[63177], 99.90th=[79168], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 63, max= 215, per=25.48%, avg=117.99, stdev=26.00, samples=101 iops : min= 15, max= 53, avg=29.07, stdev= 6.57, samples=101 write: IOPS=30, BW=121KiB/s (124kB/s)(6260KiB/51543msec); 0 zone resets clat (usec): min=864, max=653813, avg=15015.67, stdev=19924.68 lat (usec): min=865, max=653814, avg=15016.81, stdev=19924.61 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2212], 10.00th=[ 2966], 20.00th=[ 3687], | 30.00th=[ 6521], 40.00th=[ 9372], 50.00th=[ 11994], 60.00th=[ 14746], | 70.00th=[ 18482], 80.00th=[ 23200], 90.00th=[ 30802], 95.00th=[ 38011], | 99.00th=[ 53216], 99.50th=[ 64750], 99.90th=[ 79168], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 13, max= 192, per=25.01%, avg=121.06, stdev=34.58, samples=102 iops : min= 3, max= 48, avg=29.83, stdev= 8.65, samples=102 lat (usec) : 50=0.10%, 100=0.55%, 250=0.85%, 750=0.03%, 1000=0.10% lat (msec) : 2=1.69%, 4=9.34%, 10=16.60%, 20=38.87%, 50=30.70% lat (msec) : 100=1.14%, 750=0.03% cpu : usr=0.13%, sys=21.37%, ctx=8612, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181450: Mon Mar 2 13:24:32 2026 read: IOPS=29, BW=117KiB/s (120kB/s)(6052KiB/51840msec) clat (usec): min=45, max=78292, avg=18145.37, stdev=9126.96 lat (usec): min=46, max=78292, avg=18146.13, stdev=9126.99 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 7570], 10.00th=[ 8717], 20.00th=[10552], | 30.00th=[12256], 40.00th=[14484], 50.00th=[17171], 60.00th=[19268], | 70.00th=[21627], 80.00th=[24773], 90.00th=[29492], 95.00th=[34866], | 99.00th=[45876], 99.50th=[50594], 99.90th=[60556], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 48, max= 184, per=25.40%, avg=117.61, stdev=26.36, samples=102 iops : min= 12, max= 46, avg=28.97, stdev= 6.62, samples=102 write: IOPS=30, BW=120KiB/s (123kB/s)(6236KiB/51840msec); 0 zone resets clat (usec): min=824, max=706778, avg=15531.04, stdev=21190.03 lat (usec): min=824, max=706780, avg=15531.98, stdev=21190.05 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 2147], 10.00th=[ 2933], 20.00th=[ 3916], | 30.00th=[ 7046], 40.00th=[ 10159], 50.00th=[ 12518], 60.00th=[ 15401], | 70.00th=[ 19530], 80.00th=[ 23987], 90.00th=[ 30802], 95.00th=[ 37487], | 99.00th=[ 52167], 99.50th=[ 65799], 99.90th=[ 87557], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 48, max= 200, per=25.03%, avg=121.14, stdev=28.38, samples=102 iops : min= 12, max= 50, avg=29.85, stdev= 7.12, samples=102 lat (usec) : 50=0.07%, 100=0.29%, 250=1.04%, 500=0.10%, 1000=0.33% lat (msec) : 2=1.73%, 4=8.30%, 10=16.60%, 20=39.06%, 50=31.48% lat (msec) : 100=0.98%, 750=0.03% cpu : usr=0.14%, sys=21.13%, ctx=8802, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=463KiB/s (474kB/s), 115KiB/s-117KiB/s (118kB/s-120kB/s), io=23.4MiB (24.6MB), run=51543-51840msec WRITE: bw=485KiB/s (497kB/s), 120KiB/s-123KiB/s (123kB/s-126kB/s), io=24.6MiB (25.7MB), run=51543-51840msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181443: Mon Mar 2 13:24:43 2026 read: IOPS=23, BW=95.6KiB/s (97.9kB/s)(5992KiB/62682msec) clat (msec): min=3, max=657, avg=17.59, stdev=21.43 lat (msec): min=3, max=657, avg=17.59, stdev=21.43 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 38], 95.00th=[ 46], | 99.00th=[ 67], 99.50th=[ 83], 99.90th=[ 94], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 39, max= 296, per=25.16%, avg=95.87, stdev=55.78, samples=123 iops : min= 9, max= 74, avg=23.59, stdev=14.08, samples=123 write: IOPS=25, BW=100KiB/s (103kB/s)(6296KiB/62682msec); 0 zone resets clat (msec): min=5, max=107, avg=22.96, stdev=14.66 lat (msec): min=5, max=107, avg=22.96, stdev=14.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 50], | 99.00th=[ 75], 99.50th=[ 92], 99.90th=[ 105], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 15, max= 312, per=25.23%, avg=100.67, stdev=57.20, samples=123 iops : min= 3, max= 78, avg=24.79, stdev=14.41, samples=123 lat (msec) : 4=0.49%, 10=25.85%, 20=35.58%, 50=33.89%, 100=4.10% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.12%, sys=10.82%, ctx=5858, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181444: Mon Mar 2 13:24:43 2026 read: IOPS=23, BW=95.4KiB/s (97.7kB/s)(5940KiB/62280msec) clat (msec): min=3, max=696, avg=17.36, stdev=22.11 lat (msec): min=3, max=696, avg=17.36, stdev=22.11 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 45], | 99.00th=[ 66], 99.50th=[ 74], 99.90th=[ 97], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 15, max= 312, per=25.20%, avg=96.00, stdev=58.93, samples=122 iops : min= 3, max= 78, avg=23.61, stdev=14.87, samples=122 write: IOPS=25, BW=102KiB/s (104kB/s)(6348KiB/62280msec); 0 zone resets clat (msec): min=5, max=116, avg=22.88, stdev=14.58 lat (msec): min=5, max=116, avg=22.88, stdev=14.58 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 51], | 99.00th=[ 73], 99.50th=[ 85], 99.90th=[ 100], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 39, max= 296, per=25.65%, avg=102.35, stdev=56.07, samples=122 iops : min= 9, max= 74, avg=25.20, stdev=14.13, samples=122 lat (msec) : 4=0.42%, 10=25.46%, 20=37.66%, 50=32.32%, 100=4.07% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=10.89%, ctx=5875, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181445: Mon Mar 2 13:24:43 2026 read: IOPS=23, BW=95.8KiB/s (98.1kB/s)(6028KiB/62952msec) clat (usec): min=2926, max=96008, avg=17103.93, stdev=13821.88 lat (usec): min=2926, max=96009, avg=17104.68, stdev=13821.89 clat percentiles (usec): | 1.00th=[ 3851], 5.00th=[ 4752], 10.00th=[ 5473], 20.00th=[ 6587], | 30.00th=[ 8586], 40.00th=[10421], 50.00th=[12256], 60.00th=[14484], | 70.00th=[17957], 80.00th=[25822], 90.00th=[36963], 95.00th=[45876], | 99.00th=[64226], 99.50th=[68682], 99.90th=[92799], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 16, max= 288, per=25.21%, avg=96.06, stdev=59.39, samples=124 iops : min= 4, max= 72, avg=23.64, stdev=14.96, samples=124 write: IOPS=24, BW=99.4KiB/s (102kB/s)(6260KiB/62952msec); 0 zone resets clat (msec): min=5, max=712, avg=23.62, stdev=23.13 lat (msec): min=5, max=712, avg=23.63, stdev=23.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 77], 99.50th=[ 85], 99.90th=[ 109], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 31, max= 272, per=24.96%, avg=99.60, stdev=58.84, samples=124 iops : min= 7, max= 68, avg=24.52, stdev=14.83, samples=124 lat (msec) : 4=0.78%, 10=26.04%, 20=36.65%, 50=31.58%, 100=4.88% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=10.61%, ctx=5838, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181446: Mon Mar 2 13:24:43 2026 read: IOPS=24, BW=96.3KiB/s (98.6kB/s)(6052KiB/62831msec) clat (usec): min=2999, max=96728, avg=17191.31, stdev=14247.53 lat (usec): min=2999, max=96728, avg=17192.00, stdev=14247.56 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 4817], 10.00th=[ 5538], 20.00th=[ 6783], | 30.00th=[ 8455], 40.00th=[10290], 50.00th=[11994], 60.00th=[14615], | 70.00th=[18220], 80.00th=[24773], 90.00th=[38011], 95.00th=[48497], | 99.00th=[66847], 99.50th=[74974], 99.90th=[95945], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 15, max= 303, per=25.47%, avg=97.02, stdev=58.90, samples=124 iops : min= 3, max= 75, avg=23.88, stdev=14.83, samples=124 write: IOPS=24, BW=99.2KiB/s (102kB/s)(6236KiB/62831msec); 0 zone resets clat (msec): min=5, max=701, avg=23.49, stdev=22.82 lat (msec): min=5, max=701, avg=23.49, stdev=22.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 78], 99.50th=[ 86], 99.90th=[ 106], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 39, max= 280, per=25.03%, avg=99.87, stdev=57.40, samples=124 iops : min= 9, max= 70, avg=24.59, stdev=14.48, samples=124 lat (msec) : 4=0.39%, 10=26.95%, 20=35.55%, 50=32.00%, 100=5.01% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=10.71%, ctx=5881, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=381KiB/s (391kB/s), 95.4KiB/s-96.3KiB/s (97.7kB/s-98.6kB/s), io=23.4MiB (24.6MB), run=62280-62952msec WRITE: bw=399KiB/s (409kB/s), 99.2KiB/s-102KiB/s (102kB/s-104kB/s), io=24.6MiB (25.7MB), run=62280-62952msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181471: Mon Mar 2 13:25:01 2026 read: IOPS=24, BW=398KiB/s (407kB/s)(5920KiB/14890msec) clat (usec): min=45, max=78407, avg=19983.79, stdev=11135.01 lat (usec): min=45, max=78408, avg=19984.40, stdev=11135.05 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 133], 10.00th=[ 9896], 20.00th=[11994], | 30.00th=[13960], 40.00th=[16319], 50.00th=[18482], 60.00th=[20055], | 70.00th=[23987], 80.00th=[27657], 90.00th=[31065], 95.00th=[39060], | 99.00th=[66323], 99.50th=[71828], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 223, max= 640, per=24.50%, avg=390.34, stdev=101.86, samples=29 iops : min= 13, max= 40, avg=23.76, stdev= 6.51, samples=29 write: IOPS=26, BW=428KiB/s (438kB/s)(6368KiB/14890msec); 0 zone resets clat (usec): min=1157, max=66578, avg=18505.41, stdev=13048.98 lat (usec): min=1157, max=66579, avg=18507.00, stdev=13049.13 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3294], 10.00th=[ 3916], 20.00th=[ 6063], | 30.00th=[10028], 40.00th=[13566], 50.00th=[16188], 60.00th=[19530], | 70.00th=[22938], 80.00th=[27395], 90.00th=[35390], 95.00th=[46400], | 99.00th=[57934], 99.50th=[65274], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 125, max= 638, per=25.35%, avg=424.93, stdev=119.93, samples=29 iops : min= 7, max= 39, avg=25.93, stdev= 7.50, samples=29 lat (usec) : 50=0.13%, 100=0.65%, 250=1.69%, 500=0.13% lat (msec) : 2=0.78%, 4=4.56%, 10=12.50%, 20=39.32%, 50=37.76% lat (msec) : 100=2.47% cpu : usr=0.09%, sys=22.71%, ctx=2463, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181473: Mon Mar 2 13:25:01 2026 read: IOPS=24, BW=394KiB/s (404kB/s)(5744KiB/14567msec) clat (usec): min=37, max=88074, avg=21100.50, stdev=11051.78 lat (usec): min=37, max=88076, avg=21101.16, stdev=11051.82 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 4948], 10.00th=[10945], 20.00th=[13042], | 30.00th=[15139], 40.00th=[17171], 50.00th=[19006], 60.00th=[21890], | 70.00th=[25035], 80.00th=[28443], 90.00th=[34341], 95.00th=[40633], | 99.00th=[57410], 99.50th=[61080], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 255, max= 538, per=24.59%, avg=391.75, stdev=79.12, samples=28 iops : min= 15, max= 33, avg=23.86, stdev= 5.00, samples=28 write: IOPS=28, BW=449KiB/s (460kB/s)(6544KiB/14567msec); 0 zone resets clat (usec): min=1088, max=93060, avg=17018.54, stdev=12891.29 lat (usec): min=1089, max=93062, avg=17019.74, stdev=12891.30 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 3458], 10.00th=[ 4178], 20.00th=[ 5669], | 30.00th=[ 8094], 40.00th=[11469], 50.00th=[14484], 60.00th=[16909], | 70.00th=[20579], 80.00th=[26084], 90.00th=[33817], 95.00th=[43779], | 99.00th=[56361], 99.50th=[65274], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 188, max= 608, per=26.20%, avg=439.11, stdev=105.27, samples=28 iops : min= 11, max= 38, avg=26.82, stdev= 6.64, samples=28 lat (usec) : 50=0.26%, 100=0.39%, 250=1.56% lat (msec) : 2=0.91%, 4=3.12%, 10=15.89%, 20=39.19%, 50=35.94% lat (msec) : 100=2.73% cpu : usr=0.05%, sys=23.44%, ctx=2493, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181475: Mon Mar 2 13:25:01 2026 read: IOPS=26, BW=416KiB/s (426kB/s)(6256KiB/15029msec) clat (usec): min=30, max=71128, avg=20795.56, stdev=10931.43 lat (usec): min=30, max=71129, avg=20806.54, stdev=10939.74 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 7832], 10.00th=[10159], 20.00th=[13042], | 30.00th=[15008], 40.00th=[16909], 50.00th=[19006], 60.00th=[21627], | 70.00th=[23987], 80.00th=[27395], 90.00th=[32900], 95.00th=[40633], | 99.00th=[65799], 99.50th=[67634], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 160, max= 672, per=26.04%, avg=414.79, stdev=106.01, samples=29 iops : min= 10, max= 42, avg=25.31, stdev= 6.65, samples=29 write: IOPS=25, BW=401KiB/s (411kB/s)(6032KiB/15029msec); 0 zone resets clat (usec): min=1455, max=89890, avg=17993.90, stdev=13002.53 lat (usec): min=1456, max=89891, avg=17995.24, stdev=13002.58 clat percentiles (usec): | 1.00th=[ 2573], 5.00th=[ 3621], 10.00th=[ 4424], 20.00th=[ 6194], | 30.00th=[ 9503], 40.00th=[12780], 50.00th=[14877], 60.00th=[17695], | 70.00th=[21890], 80.00th=[28181], 90.00th=[36439], 95.00th=[42730], | 99.00th=[57410], 99.50th=[72877], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 223, max= 638, per=23.16%, avg=388.24, stdev=102.63, samples=29 iops : min= 13, max= 39, avg=23.66, stdev= 6.35, samples=29 lat (usec) : 50=0.26%, 100=0.13%, 250=1.30%, 500=0.13%, 750=0.13% lat (msec) : 2=0.39%, 4=3.26%, 10=14.06%, 20=39.32%, 50=38.93% lat (msec) : 100=2.08% cpu : usr=0.08%, sys=22.81%, ctx=2606, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181477: Mon Mar 2 13:25:01 2026 read: IOPS=26, BW=425KiB/s (435kB/s)(6032KiB/14205msec) clat (usec): min=52, max=67872, avg=19488.72, stdev=10196.86 lat (usec): min=53, max=67873, avg=19489.34, stdev=10196.86 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 123], 10.00th=[ 9503], 20.00th=[11994], | 30.00th=[13960], 40.00th=[16057], 50.00th=[18220], 60.00th=[20579], | 70.00th=[23200], 80.00th=[26608], 90.00th=[32900], 95.00th=[36963], | 99.00th=[55313], 99.50th=[58983], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 157, max= 576, per=26.61%, avg=423.82, stdev=88.27, samples=28 iops : min= 9, max= 36, avg=25.89, stdev= 5.61, samples=28 write: IOPS=27, BW=440KiB/s (451kB/s)(6256KiB/14205msec); 0 zone resets clat (usec): min=1353, max=76974, avg=17277.80, stdev=12972.91 lat (usec): min=1354, max=76976, avg=17280.00, stdev=12972.10 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 3032], 10.00th=[ 4228], 20.00th=[ 5735], | 30.00th=[ 8094], 40.00th=[10683], 50.00th=[13960], 60.00th=[17433], | 70.00th=[22414], 80.00th=[28443], 90.00th=[33817], 95.00th=[40633], | 99.00th=[65274], 99.50th=[71828], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 255, max= 736, per=26.42%, avg=442.86, stdev=95.64, samples=28 iops : min= 15, max= 46, avg=27.07, stdev= 6.05, samples=28 lat (usec) : 100=1.43%, 250=1.30%, 500=0.26% lat (msec) : 2=0.91%, 4=3.52%, 10=17.71%, 20=35.42%, 50=37.89% lat (msec) : 100=1.56% cpu : usr=0.11%, sys=23.33%, ctx=2403, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1594KiB/s (1632kB/s), 394KiB/s-425KiB/s (404kB/s-435kB/s), io=23.4MiB (24.5MB), run=14205-15029msec WRITE: bw=1677KiB/s (1717kB/s), 401KiB/s-449KiB/s (411kB/s-460kB/s), io=24.6MiB (25.8MB), run=14205-15029msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181472: Mon Mar 2 13:25:04 2026 read: IOPS=21, BW=339KiB/s (347kB/s)(5920KiB/17453msec) clat (usec): min=3974, max=81710, avg=19538.38, stdev=14095.60 lat (usec): min=3975, max=81711, avg=19539.15, stdev=14095.61 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5735], 10.00th=[ 6980], 20.00th=[ 9765], | 30.00th=[10945], 40.00th=[12649], 50.00th=[14091], 60.00th=[16450], | 70.00th=[21365], 80.00th=[26346], 90.00th=[41681], 95.00th=[52167], | 99.00th=[64750], 99.50th=[74974], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 160, max= 800, per=24.02%, avg=326.85, stdev=166.82, samples=34 iops : min= 10, max= 50, avg=19.97, stdev=10.49, samples=34 write: IOPS=22, BW=365KiB/s (374kB/s)(6368KiB/17453msec); 0 zone resets clat (msec): min=5, max=106, avg=25.46, stdev=15.96 lat (msec): min=5, max=106, avg=25.46, stdev=15.96 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 47], 95.00th=[ 57], | 99.00th=[ 74], 99.50th=[ 80], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 160, max= 864, per=24.75%, avg=354.47, stdev=168.93, samples=34 iops : min= 10, max= 54, avg=21.71, stdev=10.58, samples=34 lat (msec) : 4=0.13%, 10=16.93%, 20=40.10%, 50=35.81%, 100=6.90% lat (msec) : 250=0.13% cpu : usr=0.06%, sys=11.45%, ctx=1641, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181474: Mon Mar 2 13:25:04 2026 read: IOPS=21, BW=337KiB/s (345kB/s)(5744KiB/17054msec) clat (usec): min=3488, max=65246, avg=19388.73, stdev=13196.45 lat (usec): min=3488, max=65247, avg=19389.67, stdev=13196.41 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5800], 10.00th=[ 6849], 20.00th=[ 9372], | 30.00th=[11338], 40.00th=[13042], 50.00th=[14746], 60.00th=[17695], | 70.00th=[20579], 80.00th=[28705], 90.00th=[39584], 95.00th=[50594], | 99.00th=[63701], 99.50th=[64226], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 127, max= 702, per=24.20%, avg=329.33, stdev=151.79, samples=33 iops : min= 7, max= 43, avg=20.12, stdev= 9.52, samples=33 write: IOPS=23, BW=384KiB/s (393kB/s)(6544KiB/17054msec); 0 zone resets clat (usec): min=6595, max=98087, avg=24400.72, stdev=15114.86 lat (usec): min=6596, max=98088, avg=24402.24, stdev=15114.90 clat percentiles (usec): | 1.00th=[ 6980], 5.00th=[ 8225], 10.00th=[ 9110], 20.00th=[11600], | 30.00th=[14091], 40.00th=[16450], 50.00th=[19792], 60.00th=[24511], | 70.00th=[29754], 80.00th=[34866], 90.00th=[45876], 95.00th=[53740], | 99.00th=[68682], 99.50th=[76022], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 126, max= 928, per=25.80%, avg=369.48, stdev=186.10, samples=33 iops : min= 7, max= 58, avg=22.64, stdev=11.62, samples=33 lat (msec) : 4=0.13%, 10=16.80%, 20=42.06%, 50=35.16%, 100=5.86% cpu : usr=0.07%, sys=11.63%, ctx=1617, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181476: Mon Mar 2 13:25:04 2026 read: IOPS=22, BW=362KiB/s (371kB/s)(6256KiB/17271msec) clat (usec): min=3728, max=67716, avg=19003.80, stdev=13213.16 lat (usec): min=3729, max=67717, avg=19004.71, stdev=13213.15 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5538], 10.00th=[ 6980], 20.00th=[ 9110], | 30.00th=[10683], 40.00th=[12125], 50.00th=[14091], 60.00th=[16909], | 70.00th=[21365], 80.00th=[27657], 90.00th=[39584], 95.00th=[47973], | 99.00th=[56886], 99.50th=[67634], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 127, max= 1053, per=26.50%, avg=360.68, stdev=197.02, samples=34 iops : min= 7, max= 65, avg=22.09, stdev=12.38, samples=34 write: IOPS=21, BW=349KiB/s (358kB/s)(6032KiB/17271msec); 0 zone resets clat (msec): min=5, max=108, avg=25.99, stdev=16.91 lat (msec): min=5, max=108, avg=25.99, stdev=16.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 40], 90.00th=[ 49], 95.00th=[ 58], | 99.00th=[ 88], 99.50th=[ 91], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 191, max= 986, per=23.93%, avg=342.74, stdev=169.20, samples=34 iops : min= 11, max= 61, avg=20.97, stdev=10.61, samples=34 lat (msec) : 4=0.26%, 10=18.49%, 20=39.06%, 50=35.94%, 100=6.12% lat (msec) : 250=0.13% cpu : usr=0.05%, sys=11.34%, ctx=1629, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181478: Mon Mar 2 13:25:04 2026 read: IOPS=21, BW=343KiB/s (351kB/s)(6032KiB/17594msec) clat (usec): min=3748, max=71062, avg=19460.06, stdev=13783.74 lat (usec): min=3750, max=71062, avg=19461.04, stdev=13783.81 clat percentiles (usec): | 1.00th=[ 4178], 5.00th=[ 5014], 10.00th=[ 6259], 20.00th=[ 8291], | 30.00th=[11076], 40.00th=[12911], 50.00th=[14746], 60.00th=[17695], | 70.00th=[21890], 80.00th=[29754], 90.00th=[41157], 95.00th=[47973], | 99.00th=[63701], 99.50th=[64750], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 159, max= 960, per=25.17%, avg=342.51, stdev=203.51, samples=35 iops : min= 9, max= 60, avg=20.94, stdev=12.83, samples=35 write: IOPS=22, BW=356KiB/s (364kB/s)(6256KiB/17594msec); 0 zone resets clat (msec): min=5, max=108, avg=25.93, stdev=16.95 lat (msec): min=5, max=108, avg=25.93, stdev=16.95 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 59], | 99.00th=[ 80], 99.50th=[ 103], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 128, max= 1049, per=24.87%, avg=356.11, stdev=205.17, samples=35 iops : min= 8, max= 65, avg=21.80, stdev=12.90, samples=35 lat (msec) : 4=0.13%, 10=19.92%, 20=36.72%, 50=36.07%, 100=6.90% lat (msec) : 250=0.26% cpu : usr=0.05%, sys=11.06%, ctx=1618, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1361KiB/s (1394kB/s), 337KiB/s-362KiB/s (345kB/s-371kB/s), io=23.4MiB (24.5MB), run=17054-17594msec WRITE: bw=1432KiB/s (1467kB/s), 349KiB/s-384KiB/s (358kB/s-393kB/s), io=24.6MiB (25.8MB), run=17054-17594msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181486: Mon Mar 2 13:25:13 2026 read: IOPS=3, BW=3284KiB/s (3362kB/s)(7168KiB/2183msec) clat (usec): min=520, max=263244, avg=134876.15, stdev=79802.13 lat (usec): min=521, max=263245, avg=134877.40, stdev=79802.18 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[108528], | 30.00th=[110625], 40.00th=[110625], 50.00th=[129500], 60.00th=[152044], | 70.00th=[152044], 80.00th=[179307], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 2048, max= 5351, per=45.75%, avg=3818.00, stdev=1664.21, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2345KiB/s (2402kB/s)(5120KiB/2183msec); 0 zone resets clat (msec): min=153, max=338, avg=245.31, stdev=78.34 lat (msec): min=153, max=338, avg=245.37, stdev=78.34 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2027, max= 4096, per=23.31%, avg=2723.67, stdev=1188.52, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=51.15%, ctx=822, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181487: Mon Mar 2 13:25:13 2026 read: IOPS=0, BW=835KiB/s (855kB/s)(2048KiB/2454msec) clat (usec): min=476, max=149054, avg=74765.41, stdev=105059.94 lat (usec): min=478, max=149056, avg=74767.48, stdev=105060.77 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 478], 50.00th=[ 478], 60.00th=[149947], | 70.00th=[149947], 80.00th=[149947], 90.00th=[149947], 95.00th=[149947], | 99.00th=[149947], 99.50th=[149947], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 1818, max= 2048, per=23.16%, avg=1933.00, stdev=162.63, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=4, BW=4173KiB/s (4273kB/s)(10.0MiB/2454msec); 0 zone resets clat (msec): min=114, max=426, avg=223.05, stdev=100.97 lat (msec): min=114, max=426, avg=223.12, stdev=100.97 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 131], | 30.00th=[ 146], 40.00th=[ 176], 50.00th=[ 197], 60.00th=[ 209], | 70.00th=[ 213], 80.00th=[ 255], 90.00th=[ 363], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2048, max= 8110, per=46.51%, avg=5434.00, stdev=3092.74, samples=3 iops : min= 2, max= 7, avg= 5.00, stdev= 2.65, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.04%, sys=53.89%, ctx=373, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181488: Mon Mar 2 13:25:13 2026 read: IOPS=2, BW=2747KiB/s (2812kB/s)(6144KiB/2237msec) clat (usec): min=466, max=207097, avg=96218.50, stdev=89029.82 lat (usec): min=467, max=207098, avg=96219.73, stdev=89029.87 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[ 57934], 50.00th=[ 57934], 60.00th=[139461], | 70.00th=[170918], 80.00th=[170918], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 2027, max= 6144, per=40.82%, avg=3406.33, stdev=2370.91, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 write: IOPS=2, BW=2747KiB/s (2812kB/s)(6144KiB/2237msec); 0 zone resets clat (msec): min=105, max=483, avg=271.00, stdev=136.16 lat (msec): min=105, max=483, avg=271.06, stdev=136.15 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 288], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 2027, max= 3631, per=20.87%, avg=2438.50, stdev=795.06, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=41.55%, ctx=339, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181489: Mon Mar 2 13:25:13 2026 read: IOPS=2, BW=2449KiB/s (2507kB/s)(5120KiB/2091msec) clat (usec): min=393, max=193293, avg=66826.72, stdev=92868.51 lat (usec): min=394, max=193295, avg=66827.88, stdev=92868.72 clat percentiles (usec): | 1.00th=[ 396], 5.00th=[ 396], 10.00th=[ 396], 20.00th=[ 396], | 30.00th=[ 416], 40.00th=[ 416], 50.00th=[ 519], 60.00th=[ 519], | 70.00th=[139461], 80.00th=[139461], 90.00th=[193987], 95.00th=[193987], | 99.00th=[193987], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 8192, max= 8192, per=98.17%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3428KiB/s (3510kB/s)(7168KiB/2091msec); 0 zone resets clat (msec): min=153, max=428, avg=248.46, stdev=115.78 lat (msec): min=153, max=428, avg=248.53, stdev=115.79 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 211], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 401], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1838, max= 4096, per=25.76%, avg=3009.25, stdev=1234.29, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=58.33%, 500=16.67% cpu : usr=0.05%, sys=53.11%, ctx=201, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8346KiB/s (8546kB/s), 835KiB/s-3284KiB/s (855kB/s-3362kB/s), io=20.0MiB (20.0MB), run=2091-2454msec WRITE: bw=11.4MiB/s (11.0MB/s), 2345KiB/s-4173KiB/s (2402kB/s-4273kB/s), io=28.0MiB (29.4MB), run=2091-2454msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181490: Mon Mar 2 13:25:13 2026 read: IOPS=2, BW=2515KiB/s (2575kB/s)(7168KiB/2850msec) clat (msec): min=47, max=731, avg=214.17, stdev=252.53 lat (msec): min=47, max=731, avg=214.17, stdev=252.53 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 67], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 99], 60.00th=[ 99], | 70.00th=[ 99], 80.00th=[ 368], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1762, max= 4023, per=35.22%, avg=2469.00, stdev=1044.59, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1796KiB/s (1840kB/s)(5120KiB/2850msec); 0 zone resets clat (msec): min=81, max=481, avg=227.89, stdev=189.79 lat (msec): min=81, max=482, avg=227.96, stdev=189.79 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 104], 60.00th=[ 104], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2011, max= 4096, per=31.11%, avg=3053.50, stdev=1474.32, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (msec) : 50=8.33%, 100=50.00%, 250=8.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=17.23%, ctx=124, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181491: Mon Mar 2 13:25:13 2026 read: IOPS=0, BW=724KiB/s (741kB/s)(2048KiB/2830msec) clat (msec): min=97, max=454, avg=275.68, stdev=252.48 lat (msec): min=97, max=454, avg=275.68, stdev=252.48 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1721, max= 2048, per=26.88%, avg=1884.50, stdev=231.22, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3618KiB/s (3705kB/s)(10.0MiB/2830msec); 0 zone resets clat (msec): min=80, max=575, avg=223.09, stdev=174.78 lat (msec): min=80, max=575, avg=223.16, stdev=174.78 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 106], | 30.00th=[ 109], 40.00th=[ 133], 50.00th=[ 136], 60.00th=[ 144], | 70.00th=[ 159], 80.00th=[ 300], 90.00th=[ 489], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2011, max= 8192, per=41.61%, avg=4084.50, stdev=2905.07, samples=4 iops : min= 1, max= 8, avg= 3.50, stdev= 3.11, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=15.66%, ctx=213, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181492: Mon Mar 2 13:25:13 2026 read: IOPS=2, BW=2206KiB/s (2259kB/s)(6144KiB/2785msec) clat (msec): min=53, max=463, avg=167.82, stdev=157.80 lat (msec): min=53, max=463, avg=167.82, stdev=157.80 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 54], 40.00th=[ 93], 50.00th=[ 93], 60.00th=[ 121], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2011, max= 4087, per=38.73%, avg=2715.33, stdev=1188.04, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2206KiB/s (2259kB/s)(6144KiB/2785msec); 0 zone resets clat (msec): min=56, max=383, avg=260.85, stdev=123.36 lat (msec): min=56, max=383, avg=260.93, stdev=123.36 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 321], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1759, max= 2048, per=20.02%, avg=1965.25, stdev=138.47, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=41.67% cpu : usr=0.07%, sys=21.70%, ctx=156, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181493: Mon Mar 2 13:25:13 2026 read: IOPS=1, BW=1753KiB/s (1795kB/s)(5120KiB/2921msec) clat (msec): min=23, max=423, avg=143.41, stdev=164.51 lat (msec): min=23, max=423, avg=143.42, stdev=164.51 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], | 30.00th=[ 47], 40.00th=[ 47], 50.00th=[ 67], 60.00th=[ 67], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 4096, max= 4096, per=58.42%, avg=4096.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2454KiB/s (2513kB/s)(7168KiB/2921msec); 0 zone resets clat (msec): min=39, max=588, avg=283.96, stdev=240.58 lat (msec): min=39, max=588, avg=284.03, stdev=240.58 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 45], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 321], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 567], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2043, max= 4023, per=27.56%, avg=2704.67, stdev=1141.71, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=33.33%, 100=16.67%, 250=8.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=13.56%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7011KiB/s (7180kB/s), 724KiB/s-2515KiB/s (741kB/s-2575kB/s), io=20.0MiB (20.0MB), run=2785-2921msec WRITE: bw=9816KiB/s (10.1MB/s), 1796KiB/s-3618KiB/s (1840kB/s-3705kB/s), io=28.0MiB (29.4MB), run=2785-2921msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181499: Mon Mar 2 13:25:21 2026 read: IOPS=2, BW=8715KiB/s (8924kB/s)(12.0MiB/1410msec) clat (msec): min=427, max=512, avg=458.25, stdev=47.49 lat (msec): min=427, max=512, avg=458.25, stdev=47.49 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7406, max= 8192, per=79.45%, avg=7799.00, stdev=555.79, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=55.93%, ctx=2152, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181500: Mon Mar 2 13:25:21 2026 read: IOPS=0, BW=2454KiB/s (2513kB/s)(4096KiB/1669msec) clat (nsec): min=570733k, max=570733k, avg=570733148.00, stdev= 0.00 lat (nsec): min=570735k, max=570735k, avg=570735231.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 8192, max= 8192, per=83.46%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4908KiB/s (5026kB/s)(8192KiB/1669msec); 0 zone resets clat (msec): min=383, max=671, avg=527.55, stdev=203.26 lat (msec): min=384, max=671, avg=527.82, stdev=203.23 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8175, max= 8175, per=50.40%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=23.44%, ctx=280, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181501: Mon Mar 2 13:25:21 2026 write: IOPS=1, BW=6132KiB/s (6279kB/s)(12.0MiB/2004msec); 0 zone resets clat (msec): min=203, max=1527, avg=662.24, stdev=749.44 lat (msec): min=204, max=1527, avg=662.50, stdev=749.52 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8175, max= 8175, per=50.40%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.28%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181502: Mon Mar 2 13:25:21 2026 write: IOPS=1, BW=6083KiB/s (6229kB/s)(12.0MiB/2020msec); 0 zone resets clat (msec): min=321, max=1291, avg=661.85, stdev=546.25 lat (msec): min=321, max=1292, avg=662.14, stdev=546.36 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7327, max= 8192, per=47.84%, avg=7759.50, stdev=611.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.02%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9817KiB/s (10.1MB/s), 2454KiB/s-8715KiB/s (2513kB/s-8924kB/s), io=16.0MiB (16.8MB), run=1410-1669msec WRITE: bw=15.8MiB/s (16.6MB/s), 4908KiB/s-6132KiB/s (5026kB/s-6279kB/s), io=32.0MiB (33.6MB), run=1669-2020msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181504: Mon Mar 2 13:25:21 2026 read: IOPS=2, BW=8225KiB/s (8422kB/s)(12.0MiB/1494msec) clat (msec): min=373, max=622, avg=477.55, stdev=129.44 lat (msec): min=373, max=622, avg=477.56, stdev=129.45 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 5527, max= 8192, per=76.28%, avg=6859.50, stdev=1884.44, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=17.08%, ctx=83, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181505: Mon Mar 2 13:25:21 2026 read: IOPS=0, BW=2248KiB/s (2302kB/s)(4096KiB/1822msec) clat (nsec): min=971669k, max=971669k, avg=971669226.00, stdev= 0.00 lat (nsec): min=971671k, max=971671k, avg=971671469.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8192, max= 8192, per=91.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4496KiB/s (4604kB/s)(8192KiB/1822msec); 0 zone resets clat (msec): min=250, max=455, avg=352.84, stdev=145.29 lat (msec): min=250, max=455, avg=353.19, stdev=145.22 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.64%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181506: Mon Mar 2 13:25:21 2026 write: IOPS=1, BW=5922KiB/s (6064kB/s)(12.0MiB/2075msec); 0 zone resets clat (msec): min=86, max=1606, avg=678.09, stdev=814.14 lat (msec): min=86, max=1606, avg=678.48, stdev=814.13 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min=16094, max=16094, per=100.00%, avg=16094.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.14%, sys=10.90%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181507: Mon Mar 2 13:25:21 2026 write: IOPS=1, BW=6231KiB/s (6381kB/s)(12.0MiB/1972msec); 0 zone resets clat (msec): min=620, max=679, avg=648.08, stdev=29.93 lat (msec): min=620, max=680, avg=648.40, stdev=29.94 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5720, max= 8047, per=43.59%, avg=6883.50, stdev=1645.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.10%, sys=12.68%, ctx=141, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8992KiB/s (9208kB/s), 2248KiB/s-8225KiB/s (2302kB/s-8422kB/s), io=16.0MiB (16.8MB), run=1494-1822msec WRITE: bw=15.4MiB/s (16.2MB/s), 4496KiB/s-6231KiB/s (4604kB/s-6381kB/s), io=32.0MiB (33.6MB), run=1822-2075msec