== sanity test 398b: DIO and buffer IO race ============== 00:31:28 (1782534688) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.34147 s, 15.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182363: Sat Jun 27 00:32:37 2026 read: IOPS=25, BW=101KiB/s (103kB/s)(5992KiB/59482msec) clat (usec): min=53, max=114014, avg=21294.35, stdev=11910.94 lat (usec): min=54, max=114015, avg=21295.46, stdev=11910.84 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 7701], 10.00th=[ 9634], 20.00th=[ 12125], | 30.00th=[ 14615], 40.00th=[ 16909], 50.00th=[ 19006], 60.00th=[ 21627], | 70.00th=[ 24511], 80.00th=[ 28705], 90.00th=[ 35390], 95.00th=[ 42730], | 99.00th=[ 64226], 99.50th=[ 71828], 99.90th=[ 93848], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 33, max= 191, per=24.99%, avg=100.47, stdev=31.62, samples=118 iops : min= 8, max= 47, avg=24.75, stdev= 7.93, samples=118 write: IOPS=26, BW=106KiB/s (108kB/s)(6296KiB/59482msec); 0 zone resets clat (usec): min=772, max=625564, avg=17384.78, stdev=19566.05 lat (usec): min=773, max=625565, avg=17385.90, stdev=19566.08 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2900], 10.00th=[ 3687], 20.00th=[ 5735], | 30.00th=[ 8455], 40.00th=[ 11338], 50.00th=[ 14484], 60.00th=[ 17433], | 70.00th=[ 21365], 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 52167], 99.50th=[ 56361], 99.90th=[ 65799], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 20, max= 216, per=25.08%, avg=105.58, stdev=34.89, samples=118 iops : min= 5, max= 54, avg=26.03, stdev= 8.72, samples=118 lat (usec) : 100=0.20%, 250=0.85%, 500=0.16%, 1000=0.13% lat (msec) : 2=0.65%, 4=4.88%, 10=17.02%, 20=36.04%, 50=38.02% lat (msec) : 100=1.99%, 250=0.03%, 750=0.03% cpu : usr=0.10%, sys=26.46%, ctx=10139, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182364: Sat Jun 27 00:32:37 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(5940KiB/59279msec) clat (usec): min=54, max=622816, avg=21774.27, stdev=19113.51 lat (usec): min=55, max=622817, avg=21775.52, stdev=19113.23 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 7701], 10.00th=[ 9896], 20.00th=[ 12125], | 30.00th=[ 14484], 40.00th=[ 16909], 50.00th=[ 19268], 60.00th=[ 22152], | 70.00th=[ 25560], 80.00th=[ 30016], 90.00th=[ 36439], 95.00th=[ 41681], | 99.00th=[ 54264], 99.50th=[ 57410], 99.90th=[ 82314], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 26, max= 183, per=24.81%, avg=99.74, stdev=30.00, samples=117 iops : min= 6, max= 45, avg=24.57, stdev= 7.51, samples=117 write: IOPS=26, BW=107KiB/s (110kB/s)(6348KiB/59279msec); 0 zone resets clat (usec): min=708, max=78440, avg=16848.43, stdev=12356.02 lat (usec): min=708, max=78440, avg=16853.23, stdev=12357.57 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2966], 10.00th=[ 3458], 20.00th=[ 5473], | 30.00th=[ 8586], 40.00th=[11207], 50.00th=[14091], 60.00th=[17433], | 70.00th=[21627], 80.00th=[26346], 90.00th=[33817], 95.00th=[41681], | 99.00th=[55313], 99.50th=[61080], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 40, max= 239, per=25.18%, avg=105.99, stdev=37.80, samples=117 iops : min= 10, max= 59, avg=26.13, stdev= 9.49, samples=117 lat (usec) : 100=0.26%, 250=0.78%, 500=0.07%, 750=0.03%, 1000=0.10% lat (msec) : 2=0.72%, 4=5.92%, 10=15.92%, 20=35.94%, 50=38.74% lat (msec) : 100=1.50%, 750=0.03% cpu : usr=0.10%, sys=26.41%, ctx=10070, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182365: Sat Jun 27 00:32:37 2026 read: IOPS=25, BW=102KiB/s (105kB/s)(6028KiB/58918msec) clat (usec): min=50, max=95522, avg=20491.32, stdev=11290.09 lat (usec): min=51, max=95524, avg=20492.40, stdev=11290.19 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 7963], 10.00th=[ 9634], 20.00th=[11600], | 30.00th=[13829], 40.00th=[15926], 50.00th=[18220], 60.00th=[20841], | 70.00th=[24249], 80.00th=[28181], 90.00th=[34866], 95.00th=[41681], | 99.00th=[58459], 99.50th=[67634], 99.90th=[76022], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 40, max= 192, per=25.42%, avg=102.19, stdev=34.80, samples=117 iops : min= 10, max= 48, avg=25.19, stdev= 8.71, samples=117 write: IOPS=26, BW=106KiB/s (109kB/s)(6260KiB/58918msec); 0 zone resets clat (usec): min=647, max=622863, avg=17794.12, stdev=19808.39 lat (usec): min=647, max=622864, avg=17795.29, stdev=19808.44 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2835], 10.00th=[ 3556], 20.00th=[ 5669], | 30.00th=[ 8848], 40.00th=[ 11994], 50.00th=[ 15139], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 27132], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 56361], 99.50th=[ 60556], 99.90th=[100140], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 31, max= 200, per=25.18%, avg=106.02, stdev=35.21, samples=117 iops : min= 7, max= 50, avg=26.15, stdev= 8.85, samples=117 lat (usec) : 100=0.42%, 250=0.85%, 500=0.13%, 750=0.10%, 1000=0.29% lat (msec) : 2=0.68%, 4=5.18%, 10=15.43%, 20=37.57%, 50=37.27% lat (msec) : 100=2.02%, 250=0.03%, 750=0.03% cpu : usr=0.10%, sys=26.43%, ctx=9954, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182366: Sat Jun 27 00:32:37 2026 read: IOPS=25, BW=101KiB/s (104kB/s)(6052KiB/59643msec) clat (usec): min=38, max=631415, avg=21394.82, stdev=19133.13 lat (usec): min=38, max=631416, avg=21395.86, stdev=19133.24 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 7832], 10.00th=[ 9503], 20.00th=[ 11863], | 30.00th=[ 14615], 40.00th=[ 16909], 50.00th=[ 19006], 60.00th=[ 21890], | 70.00th=[ 25297], 80.00th=[ 28705], 90.00th=[ 35390], 95.00th=[ 41681], | 99.00th=[ 55313], 99.50th=[ 64226], 99.90th=[ 70779], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 33, max= 231, per=25.17%, avg=101.20, stdev=32.05, samples=118 iops : min= 8, max= 57, avg=24.94, stdev= 8.01, samples=118 write: IOPS=26, BW=105KiB/s (107kB/s)(6236KiB/59643msec); 0 zone resets clat (usec): min=669, max=86521, avg=17370.60, stdev=13063.67 lat (usec): min=670, max=86523, avg=17372.99, stdev=13065.82 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 2868], 10.00th=[ 3359], 20.00th=[ 5407], | 30.00th=[ 8586], 40.00th=[11338], 50.00th=[14353], 60.00th=[18220], | 70.00th=[22414], 80.00th=[27395], 90.00th=[35390], 95.00th=[42206], | 99.00th=[57410], 99.50th=[66847], 99.90th=[79168], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 39, max= 240, per=24.77%, avg=104.30, stdev=37.90, samples=118 iops : min= 9, max= 60, avg=25.71, stdev= 9.50, samples=118 lat (usec) : 50=0.07%, 100=0.29%, 250=0.88%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=6.15%, 10=15.49%, 20=35.09%, 50=38.80% lat (msec) : 100=2.05%, 750=0.03% cpu : usr=0.13%, sys=26.26%, ctx=10028, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=403KiB/s (412kB/s), 100KiB/s-102KiB/s (103kB/s-105kB/s), io=23.4MiB (24.6MB), run=58918-59643msec WRITE: bw=422KiB/s (432kB/s), 105KiB/s-107KiB/s (107kB/s-110kB/s), io=24.6MiB (25.7MB), run=58918-59643msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182368: Sat Jun 27 00:32:44 2026 read: IOPS=22, BW=89.6KiB/s (91.7kB/s)(5992KiB/66897msec) clat (msec): min=2, max=638, avg=19.90, stdev=21.72 lat (msec): min=2, max=638, avg=19.90, stdev=21.72 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 68], 99.50th=[ 84], 99.90th=[ 95], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 15, max= 320, per=25.11%, avg=89.89, stdev=59.78, samples=132 iops : min= 3, max= 80, avg=22.05, stdev=15.02, samples=132 write: IOPS=23, BW=94.1KiB/s (96.4kB/s)(6296KiB/66897msec); 0 zone resets clat (msec): min=4, max=119, avg=23.53, stdev=16.07 lat (msec): min=4, max=119, avg=23.53, stdev=16.07 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 55], | 99.00th=[ 78], 99.50th=[ 90], 99.90th=[ 106], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 24, max= 376, per=25.17%, avg=94.39, stdev=62.20, samples=132 iops : min= 6, max= 94, avg=23.17, stdev=15.63, samples=132 lat (msec) : 4=0.49%, 10=27.25%, 20=29.13%, 50=37.30%, 100=5.70% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.10%, sys=14.74%, ctx=6751, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182369: Sat Jun 27 00:32:44 2026 read: IOPS=22, BW=88.6KiB/s (90.8kB/s)(5940KiB/67025msec) clat (msec): min=2, max=635, avg=19.74, stdev=21.77 lat (msec): min=2, max=635, avg=19.74, stdev=21.77 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 41], 95.00th=[ 52], | 99.00th=[ 72], 99.50th=[ 79], 99.90th=[ 91], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 24, max= 383, per=24.74%, avg=88.57, stdev=62.42, samples=132 iops : min= 6, max= 95, avg=21.71, stdev=15.67, samples=132 write: IOPS=23, BW=94.7KiB/s (96.0kB/s)(6348KiB/67025msec); 0 zone resets clat (msec): min=4, max=109, avg=23.73, stdev=16.46 lat (msec): min=4, max=109, avg=23.73, stdev=16.46 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 80], 99.50th=[ 99], 99.90th=[ 108], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 16, max= 368, per=25.17%, avg=94.38, stdev=61.29, samples=132 iops : min= 4, max= 92, avg=23.17, stdev=15.41, samples=132 lat (msec) : 4=0.68%, 10=26.53%, 20=30.70%, 50=35.74%, 100=6.12% lat (msec) : 250=0.20%, 750=0.03% cpu : usr=0.10%, sys=14.71%, ctx=6882, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182370: Sat Jun 27 00:32:44 2026 read: IOPS=22, BW=90.2KiB/s (92.4kB/s)(6028KiB/66817msec) clat (usec): min=3176, max=93123, avg=19365.11, stdev=14400.85 lat (usec): min=3176, max=93124, avg=19366.27, stdev=14400.76 clat percentiles (usec): | 1.00th=[ 3884], 5.00th=[ 5014], 10.00th=[ 6063], 20.00th=[ 7635], | 30.00th=[ 9503], 40.00th=[12125], 50.00th=[15008], 60.00th=[18220], | 70.00th=[22676], 80.00th=[28705], 90.00th=[40109], 95.00th=[51119], | 99.00th=[65274], 99.50th=[70779], 99.90th=[87557], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 23, max= 336, per=25.31%, avg=90.62, stdev=60.91, samples=132 iops : min= 5, max= 84, avg=22.23, stdev=15.31, samples=132 write: IOPS=23, BW=93.7KiB/s (95.9kB/s)(6260KiB/66817msec); 0 zone resets clat (msec): min=4, max=639, avg=24.01, stdev=22.41 lat (msec): min=4, max=639, avg=24.01, stdev=22.41 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 57], | 99.00th=[ 78], 99.50th=[ 88], 99.90th=[ 109], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 23, max= 352, per=25.09%, avg=94.09, stdev=59.29, samples=132 iops : min= 5, max= 88, avg=23.09, stdev=14.91, samples=132 lat (msec) : 4=0.65%, 10=26.66%, 20=30.27%, 50=36.26%, 100=5.96% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.09%, sys=14.84%, ctx=6769, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182371: Sat Jun 27 00:32:44 2026 read: IOPS=22, BW=90.8KiB/s (92.0kB/s)(6052KiB/66668msec) clat (usec): min=2927, max=96289, avg=19242.48, stdev=13985.39 lat (usec): min=2927, max=96290, avg=19243.36, stdev=13985.47 clat percentiles (usec): | 1.00th=[ 4178], 5.00th=[ 5145], 10.00th=[ 6128], 20.00th=[ 7832], | 30.00th=[ 9765], 40.00th=[12518], 50.00th=[15008], 60.00th=[18744], | 70.00th=[22676], 80.00th=[28443], 90.00th=[38536], 95.00th=[47449], | 99.00th=[65274], 99.50th=[74974], 99.90th=[87557], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 24, max= 288, per=25.30%, avg=90.58, stdev=55.32, samples=131 iops : min= 6, max= 72, avg=22.22, stdev=13.92, samples=131 write: IOPS=23, BW=93.5KiB/s (95.8kB/s)(6236KiB/66668msec); 0 zone resets clat (msec): min=4, max=645, avg=24.06, stdev=22.28 lat (msec): min=4, max=645, avg=24.06, stdev=22.28 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 78], 99.50th=[ 88], 99.90th=[ 121], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 31, max= 376, per=24.97%, avg=93.63, stdev=59.66, samples=131 iops : min= 7, max= 94, avg=22.98, stdev=15.00, samples=131 lat (msec) : 4=0.39%, 10=25.55%, 20=31.09%, 50=37.21%, 100=5.66% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.09%, sys=15.03%, ctx=6952, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=358KiB/s (367kB/s), 88.6KiB/s-90.8KiB/s (90.8kB/s-92.0kB/s), io=23.4MiB (24.6MB), run=66668-67025msec WRITE: bw=375KiB/s (384kB/s), 93.5KiB/s-94.7KiB/s (95.8kB/s-96.0kB/s), io=24.6MiB (25.7MB), run=66668-67025msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182397: Sat Jun 27 00:33:06 2026 read: IOPS=21, BW=351KiB/s (360kB/s)(5920KiB/16859msec) clat (usec): min=76, max=70654, avg=22794.28, stdev=11298.34 lat (usec): min=77, max=70656, avg=22808.78, stdev=11286.67 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 6390], 10.00th=[11469], 20.00th=[14615], | 30.00th=[16712], 40.00th=[19006], 50.00th=[21103], 60.00th=[23200], | 70.00th=[26870], 80.00th=[31327], 90.00th=[37487], 95.00th=[45351], | 99.00th=[54789], 99.50th=[58983], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 191, max= 544, per=24.40%, avg=344.24, stdev=91.96, samples=33 iops : min= 11, max= 34, avg=21.12, stdev= 5.82, samples=33 write: IOPS=23, BW=378KiB/s (387kB/s)(6368KiB/16859msec); 0 zone resets clat (usec): min=1074, max=73368, avg=20910.66, stdev=14165.49 lat (usec): min=1075, max=73369, avg=20912.31, stdev=14165.42 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 4424], 10.00th=[ 5342], 20.00th=[ 7963], | 30.00th=[10421], 40.00th=[14353], 50.00th=[17695], 60.00th=[21890], | 70.00th=[25297], 80.00th=[33162], 90.00th=[43254], 95.00th=[48497], | 99.00th=[59507], 99.50th=[71828], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 160, max= 608, per=25.27%, avg=374.94, stdev=94.83, samples=33 iops : min= 10, max= 38, avg=23.06, stdev= 5.96, samples=33 lat (usec) : 100=0.26%, 250=1.69%, 500=0.13%, 750=0.13% lat (msec) : 2=0.78%, 4=1.30%, 10=13.15%, 20=33.33%, 50=46.22% lat (msec) : 100=2.99% cpu : usr=0.08%, sys=27.03%, ctx=3090, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182398: Sat Jun 27 00:33:06 2026 read: IOPS=21, BW=339KiB/s (347kB/s)(5744KiB/16963msec) clat (usec): min=68, max=61017, avg=23038.28, stdev=11617.85 lat (usec): min=69, max=61018, avg=23039.15, stdev=11617.91 clat percentiles (usec): | 1.00th=[ 102], 5.00th=[ 8291], 10.00th=[11076], 20.00th=[14091], | 30.00th=[16188], 40.00th=[18220], 50.00th=[20579], 60.00th=[23987], | 70.00th=[27132], 80.00th=[32375], 90.00th=[39584], 95.00th=[45876], | 99.00th=[54789], 99.50th=[60556], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 159, max= 541, per=23.88%, avg=336.94, stdev=121.27, samples=33 iops : min= 9, max= 33, avg=20.67, stdev= 7.67, samples=33 write: IOPS=24, BW=386KiB/s (395kB/s)(6544KiB/16963msec); 0 zone resets clat (usec): min=1355, max=78223, avg=21179.38, stdev=14334.36 lat (usec): min=1355, max=78225, avg=21181.33, stdev=14335.46 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 4883], 10.00th=[ 5866], 20.00th=[ 8455], | 30.00th=[11600], 40.00th=[14484], 50.00th=[17433], 60.00th=[21365], | 70.00th=[26608], 80.00th=[31851], 90.00th=[42206], 95.00th=[50070], | 99.00th=[68682], 99.50th=[70779], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 224, max= 608, per=25.38%, avg=376.70, stdev=104.75, samples=33 iops : min= 14, max= 38, avg=23.15, stdev= 6.59, samples=33 lat (usec) : 100=0.39%, 250=1.43% lat (msec) : 2=0.13%, 4=0.91%, 10=13.80%, 20=35.55%, 50=43.62% lat (msec) : 100=4.17% cpu : usr=0.12%, sys=26.88%, ctx=3209, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182399: Sat Jun 27 00:33:06 2026 read: IOPS=23, BW=369KiB/s (377kB/s)(6256KiB/16972msec) clat (usec): min=49, max=77480, avg=22606.68, stdev=12383.20 lat (usec): min=50, max=77482, avg=22607.56, stdev=12383.28 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 251], 10.00th=[10683], 20.00th=[13566], | 30.00th=[16057], 40.00th=[17957], 50.00th=[20841], 60.00th=[23462], | 70.00th=[26870], 80.00th=[30540], 90.00th=[38011], 95.00th=[46924], | 99.00th=[67634], 99.50th=[74974], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 190, max= 672, per=25.87%, avg=365.06, stdev=99.47, samples=33 iops : min= 11, max= 42, avg=22.42, stdev= 6.30, samples=33 write: IOPS=22, BW=355KiB/s (364kB/s)(6032KiB/16972msec); 0 zone resets clat (usec): min=1260, max=78511, avg=21385.07, stdev=14581.43 lat (usec): min=1261, max=78514, avg=21386.68, stdev=14581.52 clat percentiles (usec): | 1.00th=[ 2245], 5.00th=[ 4686], 10.00th=[ 6325], 20.00th=[ 9110], | 30.00th=[11863], 40.00th=[14484], 50.00th=[18482], 60.00th=[21890], | 70.00th=[25822], 80.00th=[31327], 90.00th=[41157], 95.00th=[50070], | 99.00th=[67634], 99.50th=[74974], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 127, max= 544, per=23.24%, avg=344.91, stdev=107.13, samples=33 iops : min= 7, max= 34, avg=21.18, stdev= 6.74, samples=33 lat (usec) : 50=0.13%, 100=0.65%, 250=1.69%, 500=0.39% lat (msec) : 2=0.39%, 4=0.91%, 10=12.11%, 20=33.72%, 50=45.96% lat (msec) : 100=4.04% cpu : usr=0.06%, sys=26.39%, ctx=3100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182400: Sat Jun 27 00:33:06 2026 read: IOPS=22, BW=365KiB/s (374kB/s)(6032KiB/16521msec) clat (usec): min=75, max=72609, avg=23144.90, stdev=12397.02 lat (usec): min=77, max=72610, avg=23145.74, stdev=12397.13 clat percentiles (usec): | 1.00th=[ 113], 5.00th=[ 231], 10.00th=[ 9896], 20.00th=[13304], | 30.00th=[16319], 40.00th=[19530], 50.00th=[21627], 60.00th=[25035], | 70.00th=[28705], 80.00th=[32637], 90.00th=[38536], 95.00th=[44303], | 99.00th=[66323], 99.50th=[71828], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 191, max= 480, per=25.34%, avg=357.59, stdev=89.73, samples=32 iops : min= 11, max= 30, avg=21.94, stdev= 5.66, samples=32 write: IOPS=23, BW=379KiB/s (388kB/s)(6256KiB/16521msec); 0 zone resets clat (usec): min=1225, max=74333, avg=19701.12, stdev=13913.86 lat (usec): min=1227, max=74335, avg=19702.77, stdev=13914.00 clat percentiles (usec): | 1.00th=[ 3195], 5.00th=[ 4424], 10.00th=[ 5145], 20.00th=[ 8225], | 30.00th=[10290], 40.00th=[13173], 50.00th=[16057], 60.00th=[19792], | 70.00th=[24249], 80.00th=[29754], 90.00th=[40109], 95.00th=[49021], | 99.00th=[68682], 99.50th=[71828], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 159, max= 669, per=25.33%, avg=375.94, stdev=113.53, samples=32 iops : min= 9, max= 41, avg=23.09, stdev= 7.08, samples=32 lat (usec) : 100=0.26%, 250=2.47%, 500=0.52% lat (msec) : 2=0.26%, 4=1.17%, 10=14.97%, 20=32.03%, 50=45.05% lat (msec) : 100=3.26% cpu : usr=0.13%, sys=27.60%, ctx=2968, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1411KiB/s (1445kB/s), 339KiB/s-369KiB/s (347kB/s-377kB/s), io=23.4MiB (24.5MB), run=16521-16972msec WRITE: bw=1485KiB/s (1520kB/s), 355KiB/s-386KiB/s (364kB/s-395kB/s), io=24.6MiB (25.8MB), run=16521-16972msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182392: Sat Jun 27 00:33:08 2026 read: IOPS=19, BW=317KiB/s (325kB/s)(5920KiB/18679msec) clat (usec): min=3644, max=95340, avg=21616.76, stdev=17138.70 lat (usec): min=3644, max=95341, avg=21617.52, stdev=17138.80 clat percentiles (usec): | 1.00th=[ 4015], 5.00th=[ 5407], 10.00th=[ 6259], 20.00th=[ 8225], | 30.00th=[10290], 40.00th=[12780], 50.00th=[15795], 60.00th=[19530], | 70.00th=[24773], 80.00th=[35390], 90.00th=[42730], 95.00th=[59507], | 99.00th=[83362], 99.50th=[93848], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 95, max= 896, per=23.42%, avg=299.28, stdev=181.82, samples=36 iops : min= 5, max= 56, avg=18.14, stdev=11.45, samples=36 write: IOPS=21, BW=341KiB/s (349kB/s)(6368KiB/18679msec); 0 zone resets clat (usec): min=5278, max=92875, avg=26704.77, stdev=17600.21 lat (usec): min=5280, max=92877, avg=26706.59, stdev=17600.50 clat percentiles (usec): | 1.00th=[ 6063], 5.00th=[ 7046], 10.00th=[ 7832], 20.00th=[10552], | 30.00th=[13566], 40.00th=[17957], 50.00th=[22676], 60.00th=[27919], | 70.00th=[33817], 80.00th=[41157], 90.00th=[50594], 95.00th=[62129], | 99.00th=[79168], 99.50th=[86508], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 64, max= 1149, per=24.13%, avg=324.50, stdev=191.03, samples=36 iops : min= 4, max= 71, avg=19.72, stdev=12.00, samples=36 lat (msec) : 4=0.52%, 10=22.53%, 20=29.82%, 50=38.15%, 100=8.98% cpu : usr=0.07%, sys=13.82%, ctx=1870, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182393: Sat Jun 27 00:33:08 2026 read: IOPS=19, BW=307KiB/s (314kB/s)(5744KiB/18734msec) clat (usec): min=3045, max=92901, avg=21263.69, stdev=16714.68 lat (usec): min=3046, max=92902, avg=21264.44, stdev=16714.77 clat percentiles (usec): | 1.00th=[ 3621], 5.00th=[ 5473], 10.00th=[ 6063], 20.00th=[ 8455], | 30.00th=[10552], 40.00th=[13304], 50.00th=[16450], 60.00th=[19006], | 70.00th=[23725], 80.00th=[31589], 90.00th=[45351], 95.00th=[55313], | 99.00th=[82314], 99.50th=[91751], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 64, max= 864, per=23.70%, avg=302.86, stdev=174.63, samples=37 iops : min= 4, max= 54, avg=18.38, stdev=11.00, samples=37 write: IOPS=21, BW=349KiB/s (358kB/s)(6544KiB/18734msec); 0 zone resets clat (usec): min=4603, max=99546, avg=27047.27, stdev=18065.20 lat (usec): min=4604, max=99548, avg=27048.88, stdev=18065.39 clat percentiles (usec): | 1.00th=[ 5342], 5.00th=[ 7373], 10.00th=[ 8455], 20.00th=[10683], | 30.00th=[13173], 40.00th=[17695], 50.00th=[22152], 60.00th=[29230], | 70.00th=[34341], 80.00th=[41157], 90.00th=[51119], 95.00th=[59507], | 99.00th=[83362], 99.50th=[96994], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 127, max= 1181, per=25.61%, avg=344.49, stdev=231.65, samples=37 iops : min= 7, max= 73, avg=20.97, stdev=14.59, samples=37 lat (msec) : 4=0.65%, 10=22.66%, 20=29.04%, 50=37.76%, 100=9.90% cpu : usr=0.13%, sys=13.88%, ctx=1814, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182394: Sat Jun 27 00:33:08 2026 read: IOPS=20, BW=335KiB/s (343kB/s)(6256KiB/18658msec) clat (msec): min=4, max=111, avg=21.30, stdev=17.14 lat (msec): min=4, max=111, avg=21.30, stdev=17.14 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 46], 95.00th=[ 61], | 99.00th=[ 81], 99.50th=[ 85], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 95, max= 1184, per=25.29%, avg=323.17, stdev=213.68, samples=36 iops : min= 5, max= 74, avg=19.64, stdev=13.46, samples=36 write: IOPS=20, BW=323KiB/s (331kB/s)(6032KiB/18658msec); 0 zone resets clat (msec): min=5, max=100, avg=27.28, stdev=17.98 lat (msec): min=5, max=100, avg=27.28, stdev=17.99 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 54], 95.00th=[ 64], | 99.00th=[ 83], 99.50th=[ 96], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 128, max= 894, per=22.64%, avg=304.53, stdev=163.88, samples=36 iops : min= 8, max= 55, avg=18.47, stdev=10.30, samples=36 lat (msec) : 10=21.48%, 20=32.03%, 50=36.59%, 100=9.64%, 250=0.26% cpu : usr=0.09%, sys=13.86%, ctx=1856, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182395: Sat Jun 27 00:33:08 2026 read: IOPS=20, BW=323KiB/s (331kB/s)(6032KiB/18683msec) clat (usec): min=4583, max=89226, avg=21770.31, stdev=16433.94 lat (usec): min=4583, max=89227, avg=21771.13, stdev=16433.96 clat percentiles (usec): | 1.00th=[ 5080], 5.00th=[ 5735], 10.00th=[ 6783], 20.00th=[ 8717], | 30.00th=[10552], 40.00th=[13173], 50.00th=[17171], 60.00th=[20055], | 70.00th=[24511], 80.00th=[34866], 90.00th=[44827], 95.00th=[57410], | 99.00th=[79168], 99.50th=[83362], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 128, max= 1181, per=25.23%, avg=322.41, stdev=218.24, samples=37 iops : min= 8, max= 73, avg=19.59, stdev=13.68, samples=37 write: IOPS=20, BW=335KiB/s (343kB/s)(6256KiB/18683msec); 0 zone resets clat (msec): min=6, max=104, avg=26.74, stdev=17.25 lat (msec): min=6, max=104, avg=26.74, stdev=17.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 60], | 99.00th=[ 85], 99.50th=[ 89], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 95, max= 928, per=24.93%, avg=335.30, stdev=191.08, samples=37 iops : min= 5, max= 58, avg=20.41, stdev=12.10, samples=37 lat (msec) : 10=21.48%, 20=30.60%, 50=38.80%, 100=8.98%, 250=0.13% cpu : usr=0.07%, sys=13.97%, ctx=1814, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1279KiB/s (1309kB/s), 307KiB/s-335KiB/s (314kB/s-343kB/s), io=23.4MiB (24.5MB), run=18658-18734msec WRITE: bw=1345KiB/s (1377kB/s), 323KiB/s-349KiB/s (331kB/s-358kB/s), io=24.6MiB (25.8MB), run=18658-18734msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182422: Sat Jun 27 00:33:16 2026 read: IOPS=3, BW=3287KiB/s (3365kB/s)(7168KiB/2181msec) clat (msec): min=47, max=313, avg=137.09, stdev=85.62 lat (msec): min=47, max=313, avg=137.09, stdev=85.62 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 78], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 126], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 146], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2048, max= 5342, per=48.57%, avg=3781.00, stdev=1653.72, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2348KiB/s (2404kB/s)(5120KiB/2181msec); 0 zone resets clat (msec): min=132, max=352, avg=225.59, stdev=79.72 lat (msec): min=132, max=352, avg=225.66, stdev=79.71 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 211], 60.00th=[ 211], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1780, max= 4096, per=22.71%, avg=2475.00, stdev=1086.58, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=66.67%, 500=16.67% cpu : usr=0.00%, sys=20.05%, ctx=161, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182423: Sat Jun 27 00:33:16 2026 read: IOPS=0, BW=778KiB/s (797kB/s)(2048KiB/2631msec) clat (msec): min=46, max=401, avg=224.14, stdev=250.52 lat (msec): min=46, max=401, avg=224.14, stdev=250.52 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 47], | 30.00th=[ 47], 40.00th=[ 47], 50.00th=[ 47], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1831, max= 2048, per=24.92%, avg=1939.50, stdev=153.44, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3892KiB/s (3985kB/s)(10.0MiB/2631msec); 0 zone resets clat (msec): min=41, max=444, avg=217.14, stdev=137.46 lat (msec): min=41, max=444, avg=217.21, stdev=137.47 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 65], | 30.00th=[ 77], 40.00th=[ 102], 50.00th=[ 251], 60.00th=[ 255], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 334], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1831, max= 8192, per=41.30%, avg=4500.25, stdev=3099.01, samples=4 iops : min= 1, max= 8, avg= 4.00, stdev= 3.16, samples=4 lat (msec) : 50=16.67%, 100=16.67%, 250=16.67%, 500=50.00% cpu : usr=0.11%, sys=18.37%, ctx=94, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182425: Sat Jun 27 00:33:16 2026 read: IOPS=2, BW=2422KiB/s (2480kB/s)(6144KiB/2537msec) clat (msec): min=53, max=583, avg=223.54, stdev=222.87 lat (msec): min=53, max=583, avg=223.54, stdev=222.87 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 91], 50.00th=[ 91], 60.00th=[ 142], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2048, max= 3953, per=34.47%, avg=2683.00, stdev=1099.85, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 write: IOPS=2, BW=2422KiB/s (2480kB/s)(6144KiB/2537msec); 0 zone resets clat (msec): min=39, max=373, avg=197.81, stdev=116.40 lat (msec): min=39, max=373, avg=197.88, stdev=116.39 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 218], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 3567, max= 3953, per=34.50%, avg=3760.00, stdev=272.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=13.49%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182427: Sat Jun 27 00:33:16 2026 read: IOPS=2, BW=2076KiB/s (2126kB/s)(5120KiB/2466msec) clat (msec): min=45, max=422, avg=242.28, stdev=165.43 lat (msec): min=45, max=422, avg=242.28, stdev=165.43 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2048, max= 4096, per=39.47%, avg=3072.00, stdev=1448.15, samples=2 iops : min= 2, max= 4, avg= 3.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2907KiB/s (2976kB/s)(7168KiB/2466msec); 0 zone resets clat (msec): min=73, max=329, avg=174.76, stdev=110.21 lat (msec): min=73, max=329, avg=174.83, stdev=110.20 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 125], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 309], 90.00th=[ 330], 95.00th=[ 330], rand-rw: (groupid=0, jobs=1): err= 0: pid=182424: Sat Jun 27 00:33:16 2026 read: IOPS=3, BW=3158KiB/s (3233kB/s)(7168KiB/2270msec) clat (msec): min=115, max=190, avg=148.83, stdev=30.72 lat (msec): min=115, max=190, avg=148.84, stdev=30.72 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 124], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 140], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 182], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 2048, max= 5555, per=50.84%, avg=3852.00, stdev=1755.68, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2256KiB/s (2310kB/s)(5120KiB/2270msec); 0 zone resets clat (msec): min=158, max=365, avg=229.89, stdev=88.19 lat (msec): min=158, max=365, avg=229.95, stdev=88.19 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1976, max= 4096, per=25.52%, avg=2706.67, stdev=1203.74, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 250=83.33%, 500=16.67% cpu : usr=0.04%, sys=49.58%, ctx=1009, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182426: Sat Jun 27 00:33:16 2026 read: IOPS=0, BW=758KiB/s (776kB/s)(2048KiB/2703msec) clat (msec): min=115, max=226, avg=170.94, stdev=78.73 lat (msec): min=115, max=226, avg=170.94, stdev=78.73 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 1861, max= 2048, per=25.80%, avg=1954.50, stdev=132.23, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3788KiB/s (3879kB/s)(10.0MiB/2703msec); 0 zone resets clat (msec): min=31, max=762, avg=230.84, stdev=214.48 lat (msec): min=31, max=762, avg=230.91, stdev=214.50 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 34], | 30.00th=[ 74], 40.00th=[ 125], 50.00th=[ 174], 60.00th=[ 230], | 70.00th=[ 279], 80.00th=[ 284], 90.00th=[ 321], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1861, max= 4096, per=33.01%, avg=3501.50, stdev=1095.74, samples=4 iops : min= 1, max= 4, avg= 3.00, stdev= 1.41, samples=4 lat (msec) : 50=16.67%, 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=43.15%, ctx=484, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182428: Sat Jun 27 00:33:16 2026 read: IOPS=2, BW=2717KiB/s (2783kB/s)(6144KiB/2261msec) clat (usec): min=480, max=223165, avg=9 | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], 9205.70, stdev=92824.22 lat (usec): min=481, max=223166, avg=99206.81, stdev=92824.25 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 10028], | 30.00th=[ 10028], 40.00th=[ 44827], 50.00th=[ 44827], 60.00th=[158335], | 70.00th=[158335], 80.00th=[158335], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 2048, max= 4096, per=44.43%, avg=3365.67, stdev=1143.37, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2717KiB/s (2783kB/s)(6144KiB/2261msec); 0 zone resets clat (msec): min=174, max=500, avg=275.21, stdev=121.44 lat (msec): min=174, max=500, avg=275.29, stdev=121.46 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 288], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1851, max= 4096, per=28.16%, avg=2987.00, stdev=1202.12, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (usec) : 500=8.33% lat (msec) : 10=8.33%, 50=8.33%, 250=50.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=45.97%, ctx=583, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182429: Sat Jun 27 00:33:16 2026 read: IOPS=2, BW=2501KiB/s (2561kB/s)(5120KiB/2047msec) clat (usec): min=373, max=154452, avg=31233.67, stdev=68881.22 lat (usec): min=374, max=154453, avg=31234.31, stdev=68881.37 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 375], 10.00th=[ 375], 20.00th=[ 375], | 30.00th=[ 379], 40.00th=[ 379], 50.00th=[ 482], 60.00th=[ 482], | 70.00th=[ 486], 80.00th=[ 486], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3502KiB/s (3586kB/s)(7168KiB/2047msec); 0 zone resets clat (msec): min=120, max=445, avg=259.89, stdev=134.37 lat (msec): min=121, max=445, avg=259.95, stdev=134.37 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 136], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 222], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 422], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1841, max= 4096, per=24.87%, avg=2637.67, stdev=1264.76, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 500=33.33% lat (msec) : 250=41.67%, 500=25.00% cpu : usr=0.05%, sys=46.24%, ctx=313, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7577KiB/s (7759kB/s), 758KiB/s-3158KiB/s (776kB/s-3233kB/s), io=20.0MiB (20.0MB), run=2047-2703msec WRITE: bw=10.4MiB/s (10.9MB/s), 2256KiB/s-3788KiB/s (2310kB/s-3879kB/s), io=28.0MiB ( | 99.99th=[ 330] 29.4MB), run=2047-2703msec bw ( KiB/s): min= 1845, max= 5930, per=35.67%, avg=3887.50, stdev=2888.53, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=41.67% cpu : usr=0.04%, sys=20.08%, ctx=252, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7784KiB/s (7971kB/s), 778KiB/s-3287KiB/s (797kB/s-3365kB/s), io=20.0MiB (20.0MB), run=2181-2631msec WRITE: bw=10.6MiB/s (11.2MB/s), 2348KiB/s-3892KiB/s (2404kB/s-3985kB/s), io=28.0MiB (29.4MB), run=2181-2631msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182439: Sat Jun 27 00:33:25 2026 read: IOPS=1, BW=6403KiB/s (6557kB/s)(12.0MiB/1919msec) clat (msec): min=127, max=1225, avg=580.64, stdev=573.47 lat (msec): min=127, max=1225, avg=580.64, stdev=573.47 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8143, max= 8143, per=95.38%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.11%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182441: Sat Jun 27 00:33:25 2026 read: IOPS=0, BW=2440KiB/s (2498kB/s)(4096KiB/1679msec) clat (nsec): min=566466k, max=566466k, avg=566465610.00, stdev= 0.00 lat (nsec): min=566467k, max=566467k, avg=566467285.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 5688, max= 5688, per=66.63%, avg=5688.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4879KiB/s (4996kB/s)(8192KiB/1679msec); 0 zone resets clat (msec): min=389, max=620, avg=504.89, stdev=163.49 lat (msec): min=389, max=620, avg=505.20, stdev=163.53 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=16.27%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182442: Sat Jun 27 00:33:25 2026 write: IOPS=1, BW=7511KiB/s (7691kB/s)(12.0MiB/1636msec); 0 zone resets clat (msec): min=163, max=885, avg=486.11, stdev=366.96 lat (msec): min=164, max=885, avg=486.39, stdev=366.93 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8192, max= 8192, per=41.98%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=19.02%, ctx=70, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182443: Sat Jun 27 00:33:25 2026 write: IOPS=1, BW=7336KiB/s (7512kB/s)(12.0MiB/1675msec); 0 zone resets clat (msec): min=134, max=1089, avg=500.59, stdev=515.08 lat (msec): min=134, max=1089, avg=500.86, stdev=515.07 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min=11702, max=11702, per=59.96%, avg=11702.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.95%, ctx=177, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8538KiB/s (8743kB/s), 2440KiB/s-6403KiB/s (2498kB/s-6557kB/s), io=16.0MiB (16.8MB), run=1679-1919msec WRITE: bw=19.1MiB/s (19.0MB/s), 4879KiB/s-7511KiB/s (4996kB/s-7691kB/s), io=32.0MiB (33.6MB), run=1636-1679msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182436: Sat Jun 27 00:33:25 2026 read: IOPS=2, BW=8771KiB/s (8981kB/s)(12.0MiB/1401msec) clat (msec): min=392, max=482, avg=424.21, stdev=50.45 lat (msec): min=392, max=482, avg=424.21, stdev=50.45 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 5704, max= 8192, per=59.42%, avg=6948.00, stdev=1759.28, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=60.50%, ctx=2714, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182437: Sat Jun 27 00:33:25 2026 read: IOPS=0, BW=3054KiB/s (3128kB/s)(4096KiB/1341msec) clat (nsec): min=485749k, max=485749k, avg=485749106.00, stdev= 0.00 lat (nsec): min=485751k, max=485751k, avg=485751367.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 8192, max= 8192, per=70.05%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6109KiB/s (6255kB/s)(8192KiB/1341msec); 0 zone resets clat (msec): min=305, max=388, avg=346.58, stdev=58.62 lat (msec): min=305, max=388, avg=346.85, stdev=58.57 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 8192, max= 8192, per=51.93%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=26.27%, ctx=784, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182438: Sat Jun 27 00:33:25 2026 write: IOPS=1, BW=5916KiB/s (6058kB/s)(12.0MiB/2077msec); 0 zone resets clat (msec): min=64, max=1747, avg=636.31, stdev=962.18 lat (msec): min=64, max=1750, avg=637.64, stdev=964.01 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 65], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 99], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8192, max= 8192, per=51.93%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.87%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182440: Sat Jun 27 00:33:25 2026 write: IOPS=1, BW=8000KiB/s (8192kB/s)(12.0MiB/1536msec); 0 zone resets clat (msec): min=117, max=1040, avg=452.06, stdev=511.49 lat (msec): min=118, max=1041, avg=452.29, stdev=511.55 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min=11889, max=11889, per=75.36%, avg=11889.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=20.78%, ctx=117, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.4MiB/s (11.0MB/s), 3054KiB/s-8771KiB/s (3128kB/s-8981kB/s), io=16.0MiB (16.8MB), run=1341-1401msec WRITE: bw=15.4MiB/s (16.2MB/s), 5916KiB/s-8000KiB/s (6058kB/s-8192kB/s), io=32.0MiB (33.6MB), run=1341-2077msec