== sanity test 398b: DIO and buffer IO race ============== 08:55:10 (1775220910) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.66893 s, 13.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148113: Fri Apr 3 08:56:38 2026 read: IOPS=19, BW=79.3KiB/s (81.2kB/s)(5992KiB/75575msec) clat (usec): min=34, max=627586, avg=25119.89, stdev=24315.07 lat (usec): min=34, max=627587, avg=25120.85, stdev=24315.08 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 77], 10.00th=[ 8356], 20.00th=[ 12256], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 20841], 60.00th=[ 24773], | 70.00th=[ 30540], 80.00th=[ 36439], 90.00th=[ 45876], 95.00th=[ 53740], | 99.00th=[ 91751], 99.50th=[109577], 99.90th=[246416], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 16, max= 159, per=24.93%, avg=79.03, stdev=27.97, samples=149 iops : min= 4, max= 39, avg=19.19, stdev= 7.00, samples=149 write: IOPS=20, BW=83.3KiB/s (85.3kB/s)(6296KiB/75575msec); 0 zone resets clat (usec): min=863, max=187508, avg=23907.26, stdev=22984.26 lat (usec): min=864, max=187509, avg=23908.66, stdev=22984.26 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1450], 10.00th=[ 2008], 20.00th=[ 3523], | 30.00th=[ 6325], 40.00th=[ 12911], 50.00th=[ 18744], 60.00th=[ 24249], | 70.00th=[ 30278], 80.00th=[ 40109], 90.00th=[ 54264], 95.00th=[ 67634], | 99.00th=[ 99091], 99.50th=[120062], 99.90th=[175113], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 15, max= 166, per=25.04%, avg=83.14, stdev=24.96, samples=149 iops : min= 3, max= 41, avg=20.23, stdev= 6.29, samples=149 lat (usec) : 50=0.59%, 100=2.83%, 250=0.49%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.08%, 4=6.25%, 10=8.92%, 20=25.85%, 50=39.94% lat (msec) : 100=9.02%, 250=0.75%, 750=0.03% cpu : usr=0.10%, sys=10.18%, ctx=7247, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148114: Fri Apr 3 08:56:38 2026 read: IOPS=19, BW=78.8KiB/s (80.7kB/s)(5940KiB/75333msec) clat (usec): min=24, max=284654, avg=24939.74, stdev=18148.96 lat (usec): min=24, max=284655, avg=24941.85, stdev=18153.17 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 80], 10.00th=[ 8586], 20.00th=[ 13042], | 30.00th=[ 15533], 40.00th=[ 18220], 50.00th=[ 21627], 60.00th=[ 25822], | 70.00th=[ 30802], 80.00th=[ 36963], 90.00th=[ 44303], 95.00th=[ 52167], | 99.00th=[ 78119], 99.50th=[ 92799], 99.90th=[231736], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 23, max= 152, per=24.87%, avg=78.82, stdev=24.80, samples=148 iops : min= 5, max= 38, avg=19.14, stdev= 6.26, samples=148 write: IOPS=21, BW=84.3KiB/s (86.3kB/s)(6348KiB/75333msec); 0 zone resets clat (usec): min=1049, max=599935, avg=23942.34, stdev=26816.01 lat (usec): min=1050, max=599936, avg=23945.23, stdev=26815.86 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1516], 10.00th=[ 2089], 20.00th=[ 3556], | 30.00th=[ 6063], 40.00th=[ 12387], 50.00th=[ 18482], 60.00th=[ 24511], | 70.00th=[ 31065], 80.00th=[ 39060], 90.00th=[ 53216], 95.00th=[ 66847], | 99.00th=[104334], 99.50th=[126354], 99.90th=[179307], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 160, per=25.30%, avg=83.98, stdev=26.64, samples=148 iops : min= 1, max= 40, avg=20.44, stdev= 6.67, samples=148 lat (usec) : 50=0.49%, 100=2.73%, 250=0.68%, 500=0.10%, 1000=0.03% lat (msec) : 2=4.72%, 4=7.00%, 10=8.50%, 20=24.97%, 50=41.70% lat (msec) : 100=8.33%, 250=0.68%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=10.09%, ctx=7275, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148115: Fri Apr 3 08:56:38 2026 read: IOPS=19, BW=79.9KiB/s (81.8kB/s)(6028KiB/75474msec) clat (usec): min=28, max=255268, avg=23924.61, stdev=17779.03 lat (usec): min=28, max=255268, avg=23926.52, stdev=17778.98 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 84], 10.00th=[ 8717], 20.00th=[ 12780], | 30.00th=[ 15533], 40.00th=[ 17957], 50.00th=[ 20579], 60.00th=[ 23725], | 70.00th=[ 28181], 80.00th=[ 33817], 90.00th=[ 43254], 95.00th=[ 51119], | 99.00th=[ 80217], 99.50th=[ 91751], 99.90th=[221250], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 15, max= 143, per=25.21%, avg=79.93, stdev=24.83, samples=149 iops : min= 3, max= 35, avg=19.42, stdev= 6.25, samples=149 write: IOPS=20, BW=82.9KiB/s (84.9kB/s)(6260KiB/75474msec); 0 zone resets clat (usec): min=938, max=580469, avg=24987.18, stdev=28101.18 lat (usec): min=939, max=580469, avg=24988.52, stdev=28101.11 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1582], 10.00th=[ 2114], 20.00th=[ 3425], | 30.00th=[ 6521], 40.00th=[ 13698], 50.00th=[ 20055], 60.00th=[ 25560], | 70.00th=[ 33162], 80.00th=[ 41157], 90.00th=[ 53740], 95.00th=[ 66847], | 99.00th=[ 94897], 99.50th=[143655], 99.90th=[270533], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 23, max= 143, per=24.98%, avg=82.95, stdev=26.39, samples=149 iops : min= 5, max= 35, avg=20.17, stdev= 6.60, samples=149 lat (usec) : 50=0.75%, 100=2.38%, 250=0.49%, 500=0.13%, 1000=0.16% lat (msec) : 2=4.69%, 4=6.87%, 10=8.59%, 20=24.93%, 50=42.12% lat (msec) : 100=8.30%, 250=0.46%, 500=0.10%, 750=0.03% cpu : usr=0.10%, sys=9.97%, ctx=7233, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148116: Fri Apr 3 08:56:38 2026 read: IOPS=20, BW=80.6KiB/s (82.6kB/s)(6052KiB/75041msec) clat (usec): min=31, max=207395, avg=23869.83, stdev=16956.39 lat (usec): min=31, max=207395, avg=23870.85, stdev=16956.39 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 8356], 20.00th=[ 12649], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 20579], 60.00th=[ 24249], | 70.00th=[ 28443], 80.00th=[ 34866], 90.00th=[ 43779], 95.00th=[ 52167], | 99.00th=[ 79168], 99.50th=[ 96994], 99.90th=[145753], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 23, max= 136, per=25.49%, avg=80.80, stdev=25.16, samples=148 iops : min= 5, max= 34, avg=19.64, stdev= 6.35, samples=148 write: IOPS=20, BW=83.1KiB/s (85.1kB/s)(6236KiB/75041msec); 0 zone resets clat (usec): min=1054, max=587621, avg=24784.52, stdev=28982.28 lat (usec): min=1055, max=587623, avg=24786.84, stdev=28982.04 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1614], 10.00th=[ 2212], 20.00th=[ 3589], | 30.00th=[ 6521], 40.00th=[ 13435], 50.00th=[ 19268], 60.00th=[ 25297], | 70.00th=[ 32113], 80.00th=[ 40633], 90.00th=[ 51643], 95.00th=[ 67634], | 99.00th=[106431], 99.50th=[132645], 99.90th=[320865], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 16, max= 159, per=25.06%, avg=83.21, stdev=26.93, samples=148 iops : min= 4, max= 39, avg=20.24, stdev= 6.77, samples=148 lat (usec) : 50=0.91%, 100=2.73%, 250=0.52%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.13%, 4=7.32%, 10=8.14%, 20=25.81%, 50=41.67% lat (msec) : 100=7.68%, 250=0.75%, 500=0.07%, 750=0.03% cpu : usr=0.11%, sys=9.96%, ctx=7135, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=318KiB/s (325kB/s), 78.8KiB/s-80.6KiB/s (80.7kB/s-82.6kB/s), io=23.4MiB (24.6MB), run=75041-75575msec WRITE: bw=333KiB/s (341kB/s), 82.9KiB/s-84.3KiB/s (84.9kB/s-86.3kB/s), io=24.6MiB (25.7MB), run=75041-75575msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148118: Fri Apr 3 08:58:04 2026 read: IOPS=9, BW=37.0KiB/s (37.9kB/s)(5992KiB/161879msec) clat (msec): min=5, max=639, avg=22.40, stdev=24.41 lat (msec): min=5, max=639, avg=22.40, stdev=24.41 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 59], | 99.00th=[ 97], 99.50th=[ 107], 99.90th=[ 215], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 111, per=25.53%, avg=37.78, stdev=22.47, samples=311 iops : min= 1, max= 27, avg= 8.88, stdev= 5.69, samples=311 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6296KiB/161879msec); 0 zone resets clat (msec): min=30, max=311, avg=81.47, stdev=33.95 lat (msec): min=30, max=311, avg=81.47, stdev=33.95 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 43], 10.00th=[ 47], 20.00th=[ 55], | 30.00th=[ 62], 40.00th=[ 68], 50.00th=[ 74], 60.00th=[ 82], | 70.00th=[ 91], 80.00th=[ 104], 90.00th=[ 124], 95.00th=[ 146], | 99.00th=[ 192], 99.50th=[ 245], 99.90th=[ 296], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 80, per=24.77%, avg=38.40, stdev=14.11, samples=321 iops : min= 1, max= 20, avg= 9.03, stdev= 3.58, samples=321 lat (msec) : 10=9.90%, 20=20.28%, 50=21.74%, 100=36.04%, 250=11.82% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.05%, sys=2.34%, ctx=5687, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148119: Fri Apr 3 08:58:04 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(5940KiB/161111msec) clat (msec): min=4, max=735, avg=22.09, stdev=25.40 lat (msec): min=4, max=735, avg=22.09, stdev=25.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 88], 99.50th=[ 104], 99.90th=[ 197], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 104, per=25.50%, avg=37.74, stdev=22.52, samples=308 iops : min= 1, max= 26, avg= 8.87, stdev= 5.70, samples=308 write: IOPS=9, BW=39.4KiB/s (40.3kB/s)(6348KiB/161111msec); 0 zone resets clat (msec): min=29, max=318, avg=80.79, stdev=32.73 lat (msec): min=29, max=318, avg=80.80, stdev=32.73 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 43], 10.00th=[ 47], 20.00th=[ 55], | 30.00th=[ 62], 40.00th=[ 67], 50.00th=[ 73], 60.00th=[ 81], | 70.00th=[ 91], 80.00th=[ 104], 90.00th=[ 126], 95.00th=[ 142], | 99.00th=[ 180], 99.50th=[ 201], 99.90th=[ 300], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 79, per=25.12%, avg=38.94, stdev=14.03, samples=319 iops : min= 1, max= 19, avg= 9.17, stdev= 3.57, samples=319 lat (msec) : 10=10.06%, 20=19.43%, 50=23.08%, 100=35.55%, 250=11.72% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.04%, sys=2.34%, ctx=5673, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148120: Fri Apr 3 08:58:04 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6028KiB/161667msec) clat (msec): min=4, max=280, avg=23.11, stdev=21.18 lat (msec): min=4, max=280, avg=23.12, stdev=21.18 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 45], 95.00th=[ 62], | 99.00th=[ 102], 99.50th=[ 131], 99.90th=[ 241], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 136, per=25.10%, avg=37.15, stdev=22.33, samples=317 iops : min= 1, max= 34, avg= 8.72, stdev= 5.63, samples=317 write: IOPS=9, BW=38.7KiB/s (39.7kB/s)(6260KiB/161667msec); 0 zone resets clat (msec): min=28, max=807, avg=80.97, stdev=37.14 lat (msec): min=28, max=807, avg=80.97, stdev=37.14 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 44], 10.00th=[ 48], 20.00th=[ 54], | 30.00th=[ 61], 40.00th=[ 66], 50.00th=[ 73], 60.00th=[ 81], | 70.00th=[ 90], 80.00th=[ 105], 90.00th=[ 126], 95.00th=[ 144], | 99.00th=[ 197], 99.50th=[ 203], 99.90th=[ 251], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 72, per=24.66%, avg=38.22, stdev=14.90, samples=320 iops : min= 1, max= 18, avg= 8.99, stdev= 3.80, samples=320 lat (msec) : 10=9.41%, 20=20.28%, 50=22.59%, 100=35.71%, 250=11.91% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=2.32%, ctx=5730, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148121: Fri Apr 3 08:58:04 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6052KiB/161034msec) clat (msec): min=4, max=281, avg=22.59, stdev=21.47 lat (msec): min=4, max=281, avg=22.59, stdev=21.46 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 44], 95.00th=[ 59], | 99.00th=[ 105], 99.50th=[ 129], 99.90th=[ 239], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 111, per=25.67%, avg=37.99, stdev=22.52, samples=312 iops : min= 1, max= 27, avg= 8.93, stdev= 5.67, samples=312 write: IOPS=9, BW=38.7KiB/s (39.7kB/s)(6236KiB/161034msec); 0 zone resets clat (msec): min=27, max=817, avg=81.32, stdev=38.68 lat (msec): min=27, max=817, avg=81.32, stdev=38.68 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 43], 10.00th=[ 48], 20.00th=[ 54], | 30.00th=[ 60], 40.00th=[ 67], 50.00th=[ 73], 60.00th=[ 82], | 70.00th=[ 91], 80.00th=[ 104], 90.00th=[ 127], 95.00th=[ 144], | 99.00th=[ 194], 99.50th=[ 222], 99.90th=[ 321], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 72, per=24.67%, avg=38.24, stdev=14.37, samples=319 iops : min= 1, max= 18, avg= 8.99, stdev= 3.67, samples=319 lat (msec) : 10=9.51%, 20=21.00%, 50=22.01%, 100=35.45%, 250=11.82% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=2.31%, ctx=5794, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=148KiB/s (152kB/s), 36.9KiB/s-37.6KiB/s (37.8kB/s-38.5kB/s), io=23.4MiB (24.6MB), run=161034-161879msec WRITE: bw=155KiB/s (159kB/s), 38.7KiB/s-39.4KiB/s (39.7kB/s-40.3kB/s), io=24.6MiB (25.7MB), run=161034-161879msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148164: Fri Apr 3 08:58:29 2026 read: IOPS=21, BW=349KiB/s (358kB/s)(5920KiB/16950msec) clat (usec): min=37, max=167404, avg=22461.85, stdev=19510.02 lat (usec): min=37, max=167405, avg=22463.69, stdev=19512.78 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 120], | 30.00th=[ 14615], 40.00th=[ 16909], 50.00th=[ 20841], 60.00th=[ 25035], | 70.00th=[ 28443], 80.00th=[ 33817], 90.00th=[ 42206], 95.00th=[ 50070], | 99.00th=[ 91751], 99.50th=[116917], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 191, max= 569, per=24.30%, avg=343.39, stdev=95.72, samples=33 iops : min= 11, max= 35, avg=20.76, stdev= 6.01, samples=33 write: IOPS=23, BW=376KiB/s (385kB/s)(6368KiB/16950msec); 0 zone resets clat (usec): min=1430, max=115700, avg=21527.11, stdev=20248.51 lat (usec): min=1432, max=115701, avg=21529.78, stdev=20248.74 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1860], 10.00th=[ 2474], 20.00th=[ 4178], | 30.00th=[ 5932], 40.00th=[ 9765], 50.00th=[ 16909], 60.00th=[ 21103], | 70.00th=[ 26346], 80.00th=[ 36439], 90.00th=[ 50594], 95.00th=[ 64750], | 99.00th=[ 86508], 99.50th=[ 89654], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 191, max= 574, per=25.05%, avg=372.30, stdev=102.37, samples=33 iops : min= 11, max= 35, avg=22.58, stdev= 6.43, samples=33 lat (usec) : 50=1.30%, 100=7.42%, 250=1.30%, 500=0.26%, 750=0.13% lat (msec) : 2=3.12%, 4=7.42%, 10=11.46%, 20=20.96%, 50=38.41% lat (msec) : 100=7.68%, 250=0.52% cpu : usr=0.13%, sys=12.44%, ctx=1622, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148165: Fri Apr 3 08:58:29 2026 read: IOPS=21, BW=344KiB/s (353kB/s)(5744KiB/16680msec) clat (usec): min=34, max=147086, avg=21850.98, stdev=17552.38 lat (usec): min=35, max=147087, avg=21855.60, stdev=17551.59 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 108], | 30.00th=[ 13698], 40.00th=[ 17695], 50.00th=[ 20841], 60.00th=[ 25297], | 70.00th=[ 30278], 80.00th=[ 34866], 90.00th=[ 43254], 95.00th=[ 52167], | 99.00th=[ 63701], 99.50th=[ 74974], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 54, max= 510, per=24.48%, avg=345.91, stdev=109.54, samples=33 iops : min= 3, max= 31, avg=20.91, stdev= 6.85, samples=33 write: IOPS=24, BW=392KiB/s (402kB/s)(6544KiB/16680msec); 0 zone resets clat (usec): min=1496, max=139703, avg=21152.27, stdev=20881.06 lat (usec): min=1497, max=139705, avg=21154.35, stdev=20881.04 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2343], 10.00th=[ 2933], 20.00th=[ 4555], | 30.00th=[ 5932], 40.00th=[ 8848], 50.00th=[ 15401], 60.00th=[ 21103], | 70.00th=[ 27919], 80.00th=[ 34866], 90.00th=[ 45351], 95.00th=[ 58983], | 99.00th=[102237], 99.50th=[111674], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 189, max= 670, per=26.41%, avg=392.42, stdev=101.86, samples=33 iops : min= 11, max= 41, avg=23.82, stdev= 6.41, samples=33 lat (usec) : 50=1.56%, 100=7.16%, 250=1.95%, 500=0.39%, 750=0.13% lat (msec) : 2=1.56%, 4=7.81%, 10=12.89%, 20=19.66%, 50=39.71% lat (msec) : 100=6.25%, 250=0.91% cpu : usr=0.14%, sys=12.75%, ctx=1723, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148166: Fri Apr 3 08:58:29 2026 read: IOPS=23, BW=377KiB/s (386kB/s)(6256KiB/16577msec) clat (usec): min=39, max=85827, avg=21423.85, stdev=16932.33 lat (usec): min=39, max=85828, avg=21425.12, stdev=16932.46 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 111], | 30.00th=[13304], 40.00th=[17433], 50.00th=[21103], 60.00th=[24249], | 70.00th=[28967], 80.00th=[34341], 90.00th=[42730], 95.00th=[49021], | 99.00th=[77071], 99.50th=[78119], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 192, max= 606, per=26.97%, avg=381.03, stdev=113.28, samples=32 iops : min= 12, max= 37, avg=23.12, stdev= 7.05, samples=32 write: IOPS=22, BW=364KiB/s (373kB/s)(6032KiB/16577msec); 0 zone resets clat (usec): min=1613, max=121880, avg=21349.31, stdev=20688.98 lat (usec): min=1614, max=121882, avg=21351.28, stdev=20689.00 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2409], 10.00th=[ 3130], 20.00th=[ 4359], | 30.00th=[ 6521], 40.00th=[ 9110], 50.00th=[ 15270], 60.00th=[ 20317], | 70.00th=[ 26608], 80.00th=[ 35914], 90.00th=[ 50594], 95.00th=[ 62653], | 99.00th=[ 91751], 99.50th=[121111], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 159, max= 736, per=24.34%, avg=361.66, stdev=128.49, samples=32 iops : min= 9, max= 46, avg=21.91, stdev= 8.07, samples=32 lat (usec) : 50=0.78%, 100=8.98%, 250=2.08%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.04%, 4=7.94%, 10=12.63%, 20=19.14%, 50=39.71% lat (msec) : 100=6.77%, 250=0.39% cpu : usr=0.12%, sys=12.28%, ctx=1704, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148167: Fri Apr 3 08:58:29 2026 read: IOPS=22, BW=367KiB/s (376kB/s)(6032KiB/16424msec) clat (usec): min=35, max=200041, avg=22002.56, stdev=20638.07 lat (usec): min=35, max=200043, avg=22003.80, stdev=20637.92 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 99], | 30.00th=[ 12387], 40.00th=[ 16712], 50.00th=[ 20579], 60.00th=[ 26084], | 70.00th=[ 30278], 80.00th=[ 33817], 90.00th=[ 43779], 95.00th=[ 52691], | 99.00th=[ 86508], 99.50th=[124257], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 108, max= 608, per=25.71%, avg=363.34, stdev=116.11, samples=32 iops : min= 6, max= 38, avg=22.00, stdev= 7.24, samples=32 write: IOPS=23, BW=381KiB/s (390kB/s)(6256KiB/16424msec); 0 zone resets clat (usec): min=1472, max=186015, avg=20404.48, stdev=21443.07 lat (usec): min=1472, max=186017, avg=20406.34, stdev=21443.09 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2278], 10.00th=[ 2933], 20.00th=[ 4359], | 30.00th=[ 5735], 40.00th=[ 8029], 50.00th=[ 13042], 60.00th=[ 19792], | 70.00th=[ 26084], 80.00th=[ 33424], 90.00th=[ 45351], 95.00th=[ 59507], | 99.00th=[107480], 99.50th=[116917], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 136, max= 604, per=25.52%, avg=379.16, stdev=124.33, samples=32 iops : min= 8, max= 37, avg=23.00, stdev= 7.77, samples=32 lat (usec) : 50=1.30%, 100=8.85%, 250=2.60%, 500=0.78%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.56%, 4=6.64%, 10=13.80%, 20=18.49%, 50=38.93% lat (msec) : 100=5.73%, 250=0.91% cpu : usr=0.12%, sys=12.15%, ctx=1616, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1413KiB/s (1447kB/s), 344KiB/s-377KiB/s (353kB/s-386kB/s), io=23.4MiB (24.5MB), run=16424-16950msec WRITE: bw=1487KiB/s (1522kB/s), 364KiB/s-392KiB/s (373kB/s-402kB/s), io=24.6MiB (25.8MB), run=16424-16950msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148159: Fri Apr 3 08:58:54 2026 read: IOPS=8, BW=141KiB/s (145kB/s)(5920KiB/41892msec) clat (msec): min=6, max=224, avg=24.94, stdev=23.88 lat (msec): min=6, max=224, avg=24.94, stdev=23.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 21], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 42], 95.00th=[ 59], | 99.00th=[ 163], 99.50th=[ 201], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 414, per=25.44%, avg=144.26, stdev=80.49, samples=81 iops : min= 1, max= 25, avg= 8.36, stdev= 5.07, samples=81 write: IOPS=9, BW=152KiB/s (156kB/s)(6368KiB/41892msec); 0 zone resets clat (msec): min=35, max=207, avg=81.68, stdev=31.32 lat (msec): min=35, max=207, avg=81.69, stdev=31.32 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 43], 10.00th=[ 48], 20.00th=[ 55], | 30.00th=[ 62], 40.00th=[ 68], 50.00th=[ 75], 60.00th=[ 85], | 70.00th=[ 93], 80.00th=[ 105], 90.00th=[ 128], 95.00th=[ 146], | 99.00th=[ 176], 99.50th=[ 197], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 287, per=25.45%, avg=151.70, stdev=54.44, samples=83 iops : min= 1, max= 17, avg= 8.81, stdev= 3.53, samples=83 lat (msec) : 10=4.04%, 20=22.79%, 50=24.87%, 100=35.42%, 250=12.89% cpu : usr=0.04%, sys=2.56%, ctx=1460, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148160: Fri Apr 3 08:58:54 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5744KiB/42222msec) clat (msec): min=6, max=125, avg=25.27, stdev=19.12 lat (msec): min=6, max=125, avg=25.27, stdev=19.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 49], 95.00th=[ 66], | 99.00th=[ 101], 99.50th=[ 122], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 29, max= 383, per=24.97%, avg=141.58, stdev=80.72, samples=79 iops : min= 1, max= 23, avg= 8.16, stdev= 5.10, samples=79 write: IOPS=9, BW=155KiB/s (159kB/s)(6544KiB/42222msec); 0 zone resets clat (msec): min=29, max=220, avg=80.93, stdev=32.21 lat (msec): min=29, max=220, avg=80.94, stdev=32.21 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 45], 10.00th=[ 49], 20.00th=[ 56], | 30.00th=[ 62], 40.00th=[ 67], 50.00th=[ 74], 60.00th=[ 80], | 70.00th=[ 89], 80.00th=[ 103], 90.00th=[ 128], 95.00th=[ 144], | 99.00th=[ 188], 99.50th=[ 201], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 255, per=25.76%, avg=153.53, stdev=52.95, samples=83 iops : min= 1, max= 15, avg= 8.93, stdev= 3.44, samples=83 lat (msec) : 10=4.56%, 20=19.14%, 50=24.74%, 100=39.84%, 250=11.72% cpu : usr=0.04%, sys=2.64%, ctx=1535, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148161: Fri Apr 3 08:58:54 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(6256KiB/40576msec) clat (msec): min=6, max=221, avg=23.71, stdev=20.52 lat (msec): min=6, max=221, avg=23.71, stdev=20.52 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 25], 80.00th=[ 29], 90.00th=[ 45], 95.00th=[ 61], | 99.00th=[ 104], 99.50th=[ 161], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 480, per=27.68%, avg=156.92, stdev=104.05, samples=79 iops : min= 1, max= 30, avg= 9.13, stdev= 6.61, samples=79 write: IOPS=9, BW=149KiB/s (152kB/s)(6032KiB/40576msec); 0 zone resets clat (msec): min=33, max=315, avg=82.76, stdev=37.74 lat (msec): min=33, max=315, avg=82.76, stdev=37.74 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 44], 10.00th=[ 49], 20.00th=[ 55], | 30.00th=[ 61], 40.00th=[ 67], 50.00th=[ 72], 60.00th=[ 81], | 70.00th=[ 90], 80.00th=[ 106], 90.00th=[ 133], 95.00th=[ 153], | 99.00th=[ 232], 99.50th=[ 243], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 287, per=24.73%, avg=147.38, stdev=53.89, samples=80 iops : min= 1, max= 17, avg= 8.52, stdev= 3.45, samples=80 lat (msec) : 10=6.64%, 20=22.27%, 50=24.61%, 100=34.51%, 250=11.85% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.73%, ctx=1527, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148162: Fri Apr 3 08:58:54 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6032KiB/41576msec) clat (msec): min=5, max=174, avg=24.06, stdev=19.94 lat (msec): min=5, max=174, avg=24.06, stdev=19.94 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 45], 95.00th=[ 67], | 99.00th=[ 126], 99.50th=[ 150], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 352, per=26.25%, avg=148.85, stdev=77.88, samples=79 iops : min= 1, max= 22, avg= 8.63, stdev= 4.99, samples=79 write: IOPS=9, BW=150KiB/s (154kB/s)(6256KiB/41576msec); 0 zone resets clat (msec): min=30, max=308, avg=82.90, stdev=36.79 lat (msec): min=30, max=308, avg=82.91, stdev=36.79 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 44], 10.00th=[ 50], 20.00th=[ 55], | 30.00th=[ 63], 40.00th=[ 70], 50.00th=[ 75], 60.00th=[ 82], | 70.00th=[ 89], 80.00th=[ 102], 90.00th=[ 124], 95.00th=[ 161], | 99.00th=[ 236], 99.50th=[ 239], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 287, per=25.09%, avg=149.56, stdev=56.52, samples=82 iops : min= 1, max= 17, avg= 8.67, stdev= 3.59, samples=82 lat (msec) : 10=4.95%, 20=23.05%, 50=22.53%, 100=38.15%, 250=11.20% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.75%, ctx=1581, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=567KiB/s (581kB/s), 136KiB/s-154KiB/s (139kB/s-158kB/s), io=23.4MiB (24.5MB), run=40576-42222msec WRITE: bw=597KiB/s (611kB/s), 149KiB/s-155KiB/s (152kB/s-159kB/s), io=24.6MiB (25.8MB), run=40576-42222msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148178: Fri Apr 3 08:59:05 2026 read: IOPS=1, BW=1701KiB/s (1742kB/s)(7168KiB/4213msec) clat (usec): min=1541, max=1969.7k, avg=404718.71, stdev=694391.88 lat (usec): min=1543, max=1969.7k, avg=404720.02, stdev=694391.81 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1549], 10.00th=[ 1549], | 20.00th=[ 86508], 30.00th=[ 156238], 40.00th=[ 156238], | 50.00th=[ 187696], 60.00th=[ 212861], 70.00th=[ 212861], | 80.00th=[ 217056], 90.00th=[1971323], 95.00th=[1971323], | 99.00th=[1971323], 99.50th=[1971323], 99.90th=[1971323], | 99.95th=[1971323], 99.99th=[1971323] bw ( KiB/s): min= 1868, max= 4096, per=71.07%, avg=3022.50, stdev=1236.35, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1215KiB/s (1244kB/s)(5120KiB/4213msec); 0 zone resets clat (msec): min=93, max=431, avg=258.97, stdev=120.63 lat (msec): min=93, max=431, avg=259.04, stdev=120.64 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 2039, max= 4079, per=45.69%, avg=2720.33, stdev=1176.64, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 100=16.67%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=18.00%, ctx=699, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148179: Fri Apr 3 08:59:05 2026 read: IOPS=0, BW=425KiB/s (436kB/s)(2048KiB/4815msec) clat (msec): min=182, max=214, avg=198.44, stdev=22.47 lat (msec): min=182, max=214, avg=198.44, stdev=22.47 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 1921, max= 2039, per=46.56%, avg=1980.00, stdev=83.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2127KiB/s (2178kB/s)(10.0MiB/4815msec); 0 zone resets clat (msec): min=80, max=2253, avg=433.81, stdev=690.57 lat (msec): min=80, max=2253, avg=434.05, stdev=690.49 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 99], | 30.00th=[ 126], 40.00th=[ 131], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 188], 80.00th=[ 201], 90.00th=[ 961], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 2039, max= 8192, per=80.11%, avg=4770.00, stdev=3134.16, samples=3 iops : min= 1, max= 8, avg= 4.00, stdev= 3.61, samples=3 lat (msec) : 100=16.67%, 250=66.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=16.83%, ctx=138, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148180: Fri Apr 3 08:59:05 2026 read: IOPS=1, BW=1482KiB/s (1517kB/s)(6144KiB/4146msec) clat (msec): min=3, max=198, avg=114.32, stdev=80.26 lat (msec): min=3, max=198, avg=114.32, stdev=80.26 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 38], | 30.00th=[ 38], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 2039, max= 6144, per=80.12%, avg=3407.33, stdev=2370.02, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1482KiB/s (1517kB/s)(6144KiB/4146msec); 0 zone resets clat (msec): min=143, max=2340, avg=572.10, stdev=869.20 lat (msec): min=143, max=2340, avg=572.17, stdev=869.21 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 266], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2039, max= 4096, per=50.01%, avg=2977.75, stdev=1093.84, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 4=8.33%, 50=8.33%, 250=58.33%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=15.15%, ctx=313, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148181: Fri Apr 3 08:59:05 2026 read: IOPS=1, BW=1296KiB/s (1327kB/s)(5120KiB/3952msec) clat (usec): min=500, max=218123, avg=63031.35, stdev=91430.96 lat (usec): min=501, max=218124, avg=63032.29, stdev=91430.96 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 644], 40.00th=[ 644], 50.00th=[ 24249], 60.00th=[ 24249], | 70.00th=[ 71828], 80.00th=[ 71828], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1814KiB/s (1857kB/s)(7168KiB/3952msec); 0 zone resets clat (msec): min=168, max=2251, avg=505.81, stdev=771.91 lat (msec): min=168, max=2251, avg=505.90, stdev=771.95 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 201], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 330], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1946, max= 4096, per=42.51%, avg=2531.00, stdev=1044.30, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 100=8.33%, 250=50.00%, 500=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=15.82%, ctx=220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4253KiB/s (4355kB/s), 425KiB/s-1701KiB/s (436kB/s-1742kB/s), io=20.0MiB (20.0MB), run=3952-4815msec WRITE: bw=5955KiB/s (6098kB/s), 1215KiB/s-2127KiB/s (1244kB/s-2178kB/s), io=28.0MiB (29.4MB), run=3952-4815msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148183: Fri Apr 3 08:59:06 2026 read: IOPS=1, BW=1351KiB/s (1384kB/s)(7168KiB/5305msec) clat (msec): min=47, max=1825, avg=570.42, stdev=707.27 lat (msec): min=47, max=1825, avg=570.42, stdev=707.27 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 75], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 253], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 1334], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 2039, max= 4079, per=78.12%, avg=3015.25, stdev=1127.34, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=965KiB/s (988kB/s)(5120KiB/5305msec); 0 zone resets clat (msec): min=81, max=610, avg=240.89, stdev=216.25 lat (msec): min=81, max=610, avg=241.33, stdev=216.01 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2048, max= 6119, per=75.56%, avg=4083.50, stdev=2878.63, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.02%, sys=2.68%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148184: Fri Apr 3 08:59:06 2026 read: IOPS=0, BW=402KiB/s (412kB/s)(2048KiB/5089msec) clat (usec): min=66394, max=71117, avg=68756.31, stdev=3339.55 lat (usec): min=66397, max=71119, avg=68758.61, stdev=3338.94 clat percentiles (usec): | 1.00th=[66323], 5.00th=[66323], 10.00th=[66323], 20.00th=[66323], | 30.00th=[66323], 40.00th=[66323], 50.00th=[66323], 60.00th=[70779], | 70.00th=[70779], 80.00th=[70779], 90.00th=[70779], 95.00th=[70779], | 99.00th=[70779], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 1519, max= 2048, per=46.20%, avg=1783.50, stdev=374.06, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2012KiB/s (2060kB/s)(10.0MiB/5089msec); 0 zone resets clat (msec): min=125, max=2523, avg=484.99, stdev=735.60 lat (msec): min=125, max=2523, avg=485.09, stdev=735.60 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 150], | 30.00th=[ 155], 40.00th=[ 157], 50.00th=[ 171], 60.00th=[ 271], | 70.00th=[ 300], 80.00th=[ 309], 90.00th=[ 693], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1950, max= 4096, per=65.79%, avg=3555.25, stdev=1070.20, samples=4 iops : min= 1, max= 4, avg= 3.00, stdev= 1.41, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=6.78%, ctx=196, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148185: Fri Apr 3 08:59:06 2026 read: IOPS=1, BW=1210KiB/s (1239kB/s)(6144KiB/5076msec) clat (msec): min=83, max=603, avg=210.34, stdev=197.00 lat (msec): min=83, max=603, avg=210.34, stdev=197.00 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 165], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 4079, max= 4096, per=100.00%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1210KiB/s (1239kB/s)(6144KiB/5076msec); 0 zone resets clat (msec): min=92, max=2823, avg=617.61, stdev=1084.89 lat (msec): min=92, max=2824, avg=617.79, stdev=1085.12 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 207], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2048, max= 4079, per=56.37%, avg=3046.00, stdev=1015.95, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=25.00%, 250=50.00%, 500=8.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=4.97%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148186: Fri Apr 3 08:59:06 2026 read: IOPS=0, BW=996KiB/s (1020kB/s)(5120KiB/5141msec) clat (msec): min=60, max=232, avg=141.97, stdev=81.31 lat (msec): min=60, max=232, avg=141.97, stdev=81.31 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 77], 40.00th=[ 77], 50.00th=[ 117], 60.00th=[ 117], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 4079, max= 4096, per=100.00%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1394KiB/s (1428kB/s)(7168KiB/5141msec); 0 zone resets clat (msec): min=96, max=2758, avg=616.21, stdev=978.30 lat (msec): min=96, max=2758, avg=616.32, stdev=978.29 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 124], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 176], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 827], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1486, max= 4096, per=47.06%, avg=2543.33, stdev=1373.70, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 100=25.00%, 250=58.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.53%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3861KiB/s (3953kB/s), 402KiB/s-1351KiB/s (412kB/s-1384kB/s), io=20.0MiB (20.0MB), run=5076-5305msec WRITE: bw=5405KiB/s (5534kB/s), 965KiB/s-2012KiB/s (988kB/s-2060kB/s), io=28.0MiB (29.4MB), run=5076-5305msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148192: Fri Apr 3 08:59:16 2026 read: IOPS=1, BW=6927KiB/s (7093kB/s)(12.0MiB/1774msec) clat (msec): min=446, max=688, avg=579.34, stdev=123.17 lat (msec): min=446, max=688, avg=579.35, stdev=123.17 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7787, max= 8047, per=86.93%, avg=7917.00, stdev=183.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=22.79%, ctx=219, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148193: Fri Apr 3 08:59:16 2026 read: IOPS=0, BW=2277KiB/s (2331kB/s)(4096KiB/1799msec) clat (nsec): min=410008k, max=410008k, avg=410007830.00, stdev= 0.00 lat (nsec): min=410010k, max=410010k, avg=410009848.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 5634, max= 5634, per=61.86%, avg=5634.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4554KiB/s (4663kB/s)(8192KiB/1799msec); 0 zone resets clat (msec): min=367, max=974, avg=671.17, stdev=429.37 lat (msec): min=367, max=975, avg=671.54, stdev=429.43 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7787, max= 7787, per=52.50%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.62%, ctx=133, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148194: Fri Apr 3 08:59:16 2026 write: IOPS=1, BW=5563KiB/s (5696kB/s)(12.0MiB/2209msec); 0 zone resets clat (msec): min=263, max=1124, avg=728.05, stdev=434.79 lat (msec): min=263, max=1125, avg=728.44, stdev=435.01 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7787, max= 7787, per=52.50%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.02%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148195: Fri Apr 3 08:59:16 2026 write: IOPS=1, BW=6884KiB/s (7049kB/s)(12.0MiB/1785msec); 0 zone resets clat (msec): min=418, max=862, avg=590.16, stdev=238.47 lat (msec): min=419, max=862, avg=590.44, stdev=238.49 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 6150, max= 8175, per=48.29%, avg=7162.50, stdev=1431.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.82%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9107KiB/s (9326kB/s), 2277KiB/s-6927KiB/s (2331kB/s-7093kB/s), io=16.0MiB (16.8MB), run=1774-1799msec WRITE: bw=14.5MiB/s (15.2MB/s), 4554KiB/s-6884KiB/s (4663kB/s-7049kB/s), io=32.0MiB (33.6MB), run=1785-2209msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148197: Fri Apr 3 08:59:16 2026 read: IOPS=1, BW=5694KiB/s (5831kB/s)(12.0MiB/2158msec) clat (msec): min=109, max=1462, avg=718.81, stdev=686.21 lat (msec): min=109, max=1462, avg=718.81, stdev=686.21 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 6360, max= 8192, per=95.84%, avg=7276.00, stdev=1295.42, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.59%, ctx=23, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148198: Fri Apr 3 08:59:16 2026 read: IOPS=0, BW=2032KiB/s (2081kB/s)(4096KiB/2016msec) clat (nsec): min=315641k, max=315641k, avg=315640945.00, stdev= 0.00 lat (nsec): min=315644k, max=315644k, avg=315643541.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4063KiB/s (4161kB/s)(8192KiB/2016msec); 0 zone resets clat (msec): min=272, max=1384, avg=828.67, stdev=786.56 lat (msec): min=272, max=1385, avg=829.00, stdev=786.53 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8175, max= 8175, per=50.30%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.00%, ctx=39, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148199: Fri Apr 3 08:59:16 2026 write: IOPS=1, BW=6209KiB/s (6358kB/s)(12.0MiB/1979msec); 0 zone resets clat (msec): min=263, max=1185, avg=658.77, stdev=474.52 lat (msec): min=263, max=1185, avg=659.13, stdev=474.63 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 5919, max= 5919, per=36.42%, avg=5919.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.57%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148200: Fri Apr 3 08:59:16 2026 write: IOPS=1, BW=6785KiB/s (6948kB/s)(12.0MiB/1811msec); 0 zone resets clat (msec): min=258, max=1135, avg=583.36, stdev=480.59 lat (msec): min=258, max=1135, avg=583.71, stdev=480.62 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8126, max= 8126, per=50.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.29%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7592KiB/s (7774kB/s), 2032KiB/s-5694KiB/s (2081kB/s-5831kB/s), io=16.0MiB (16.8MB), run=2016-2158msec WRITE: bw=15.9MiB/s (16.6MB/s), 4063KiB/s-6785KiB/s (4161kB/s-6948kB/s), io=32.0MiB (33.6MB), run=1811-2016msec