== sanity test 398b: DIO and buffer IO race ============== 03:56:57 (1780387017) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.95794 s, 17.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149222: Tue Jun 2 03:58:05 2026 read: IOPS=24, BW=99.3KiB/s (102kB/s)(5992KiB/60365msec) clat (usec): min=41, max=726210, avg=21973.23, stdev=21689.95 lat (usec): min=41, max=726212, avg=21974.42, stdev=21689.94 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 7242], 10.00th=[ 8979], 20.00th=[ 12387], | 30.00th=[ 14615], 40.00th=[ 17171], 50.00th=[ 19792], 60.00th=[ 22414], | 70.00th=[ 26084], 80.00th=[ 30016], 90.00th=[ 36439], 95.00th=[ 41157], | 99.00th=[ 62129], 99.50th=[ 71828], 99.90th=[ 99091], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 6, max= 200, per=24.94%, avg=99.02, stdev=30.94, samples=120 iops : min= 1, max= 50, avg=24.31, stdev= 7.81, samples=120 write: IOPS=26, BW=104KiB/s (107kB/s)(6296KiB/60365msec); 0 zone resets clat (usec): min=773, max=107451, avg=17251.08, stdev=13831.66 lat (usec): min=773, max=107453, avg=17252.34, stdev=13831.77 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2868], 10.00th=[ 3425], 20.00th=[ 5342], | 30.00th=[ 8160], 40.00th=[ 11207], 50.00th=[ 14222], 60.00th=[ 17433], | 70.00th=[ 21103], 80.00th=[ 26608], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 67634], 99.50th=[ 79168], 99.90th=[104334], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 31, max= 248, per=25.22%, avg=104.92, stdev=38.85, samples=119 iops : min= 7, max= 62, avg=25.78, stdev= 9.78, samples=119 lat (usec) : 50=0.07%, 100=0.29%, 250=1.20%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=0.98%, 4=5.70%, 10=16.47%, 20=34.28%, 50=38.22% lat (msec) : 100=2.41%, 250=0.10%, 750=0.03% cpu : usr=0.14%, sys=27.68%, ctx=9826, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149224: Tue Jun 2 03:58:05 2026 read: IOPS=25, BW=101KiB/s (103kB/s)(5940KiB/58999msec) clat (usec): min=28, max=105176, avg=20758.44, stdev=11701.37 lat (usec): min=29, max=105178, avg=20759.45, stdev=11701.46 clat percentiles (usec): | 1.00th=[ 113], 5.00th=[ 6980], 10.00th=[ 8848], 20.00th=[ 11469], | 30.00th=[ 13698], 40.00th=[ 15926], 50.00th=[ 19006], 60.00th=[ 21627], | 70.00th=[ 24773], 80.00th=[ 29230], 90.00th=[ 35914], 95.00th=[ 41157], | 99.00th=[ 57934], 99.50th=[ 65274], 99.90th=[ 85459], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 6, max= 192, per=25.25%, avg=100.26, stdev=31.70, samples=117 iops : min= 1, max= 48, avg=24.61, stdev= 8.00, samples=117 write: IOPS=26, BW=108KiB/s (110kB/s)(6348KiB/58999msec); 0 zone resets clat (usec): min=689, max=728437, avg=17554.34, stdev=22669.53 lat (usec): min=690, max=728439, avg=17555.72, stdev=22669.63 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2737], 10.00th=[ 3490], 20.00th=[ 5211], | 30.00th=[ 7635], 40.00th=[ 10814], 50.00th=[ 14091], 60.00th=[ 17957], | 70.00th=[ 21627], 80.00th=[ 26346], 90.00th=[ 34341], 95.00th=[ 43254], | 99.00th=[ 66847], 99.50th=[ 80217], 99.90th=[135267], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 48, max= 239, per=25.92%, avg=107.83, stdev=35.18, samples=116 iops : min= 12, max= 59, avg=26.50, stdev= 8.85, samples=116 lat (usec) : 50=0.07%, 100=0.36%, 250=0.94%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=1.30%, 4=5.14%, 10=18.26%, 20=34.34%, 50=36.78% lat (msec) : 100=2.18%, 250=0.13%, 750=0.03% cpu : usr=0.12%, sys=28.00%, ctx=9710, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149227: Tue Jun 2 03:58:05 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(6028KiB/60002msec) clat (usec): min=48, max=128203, avg=20531.73, stdev=11756.01 lat (usec): min=49, max=128205, avg=20532.88, stdev=11756.06 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 6849], 10.00th=[ 8848], 20.00th=[ 11731], | 30.00th=[ 13960], 40.00th=[ 16188], 50.00th=[ 18482], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 28967], 90.00th=[ 34341], 95.00th=[ 39584], | 99.00th=[ 56886], 99.50th=[ 67634], 99.90th=[110625], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 31, max= 207, per=25.37%, avg=100.72, stdev=31.92, samples=118 iops : min= 7, max= 51, avg=24.73, stdev= 8.05, samples=118 write: IOPS=26, BW=104KiB/s (107kB/s)(6260KiB/60002msec); 0 zone resets clat (usec): min=955, max=725762, avg=18383.22, stdev=22748.26 lat (usec): min=956, max=725764, avg=18384.60, stdev=22748.30 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2933], 10.00th=[ 3785], 20.00th=[ 5669], | 30.00th=[ 8455], 40.00th=[ 11600], 50.00th=[ 14746], 60.00th=[ 18220], | 70.00th=[ 22152], 80.00th=[ 27919], 90.00th=[ 35914], 95.00th=[ 43254], | 99.00th=[ 68682], 99.50th=[ 79168], 99.90th=[123208], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 13, max= 184, per=24.90%, avg=103.59, stdev=33.64, samples=119 iops : min= 3, max= 46, avg=25.45, stdev= 8.49, samples=119 lat (usec) : 50=0.03%, 100=0.46%, 250=1.27%, 500=0.03%, 1000=0.03% lat (msec) : 2=0.88%, 4=4.82%, 10=16.86%, 20=35.87%, 50=37.04% lat (msec) : 100=2.54%, 250=0.13%, 750=0.03% cpu : usr=0.17%, sys=27.30%, ctx=9800, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149229: Tue Jun 2 03:58:05 2026 read: IOPS=25, BW=100KiB/s (103kB/s)(6052KiB/60339msec) clat (usec): min=47, max=142155, avg=21109.50, stdev=12993.28 lat (usec): min=47, max=142156, avg=21111.06, stdev=12992.90 clat percentiles (usec): | 1.00th=[ 104], 5.00th=[ 5932], 10.00th=[ 8586], 20.00th=[ 11207], | 30.00th=[ 13960], 40.00th=[ 16581], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 25560], 80.00th=[ 29230], 90.00th=[ 35914], 95.00th=[ 42730], | 99.00th=[ 65274], 99.50th=[ 79168], 99.90th=[113771], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 47, max= 216, per=25.64%, avg=101.80, stdev=31.54, samples=118 iops : min= 11, max= 54, avg=25.01, stdev= 7.98, samples=118 write: IOPS=25, BW=103KiB/s (106kB/s)(6236KiB/60339msec); 0 zone resets clat (usec): min=984, max=782242, avg=18019.47, stdev=23591.90 lat (usec): min=985, max=782245, avg=18021.54, stdev=23592.48 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2868], 10.00th=[ 3621], 20.00th=[ 5407], | 30.00th=[ 7767], 40.00th=[ 11469], 50.00th=[ 14615], 60.00th=[ 18220], | 70.00th=[ 22152], 80.00th=[ 27657], 90.00th=[ 36439], 95.00th=[ 43779], | 99.00th=[ 63177], 99.50th=[ 71828], 99.90th=[ 87557], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 216, per=24.96%, avg=103.84, stdev=39.53, samples=119 iops : min= 1, max= 54, avg=25.51, stdev= 9.94, samples=119 lat (usec) : 50=0.03%, 100=0.36%, 250=1.60%, 500=0.20%, 1000=0.03% lat (msec) : 2=0.81%, 4=5.34%, 10=17.09%, 20=34.64%, 50=37.43% lat (msec) : 100=2.31%, 250=0.13%, 1000=0.03% cpu : usr=0.13%, sys=27.42%, ctx=9743, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=398KiB/s (407kB/s), 99.3KiB/s-101KiB/s (102kB/s-103kB/s), io=23.4MiB (24.6MB), run=58999-60365msec WRITE: bw=416KiB/s (426kB/s), 103KiB/s-108KiB/s (106kB/s-110kB/s), io=24.6MiB (25.7MB), run=58999-60365msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149223: Tue Jun 2 03:58:34 2026 read: IOPS=16, BW=66.9KiB/s (68.5kB/s)(5992KiB/89557msec) clat (msec): min=3, max=734, avg=18.35, stdev=24.79 lat (msec): min=3, max=734, avg=18.35, stdev=24.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 52], | 99.00th=[ 77], 99.50th=[ 96], 99.90th=[ 159], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 15, max= 184, per=24.94%, avg=66.85, stdev=35.24, samples=177 iops : min= 3, max= 46, avg=16.41, stdev= 8.93, samples=177 write: IOPS=17, BW=70.3KiB/s (71.0kB/s)(6296KiB/89557msec); 0 zone resets clat (msec): min=14, max=194, avg=39.24, stdev=17.66 lat (msec): min=14, max=194, avg=39.24, stdev=17.66 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 51], 90.00th=[ 62], 95.00th=[ 73], | 99.00th=[ 102], 99.50th=[ 122], 99.90th=[ 155], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 7, max= 160, per=25.12%, avg=70.33, stdev=30.94, samples=177 iops : min= 1, max= 40, avg=17.28, stdev= 7.88, samples=177 lat (msec) : 4=0.62%, 10=20.08%, 20=16.08%, 50=49.87%, 100=12.60% lat (msec) : 250=0.72%, 750=0.03% cpu : usr=0.11%, sys=10.11%, ctx=6544, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149225: Tue Jun 2 03:58:34 2026 read: IOPS=16, BW=66.6KiB/s (68.2kB/s)(5940KiB/89212msec) clat (msec): min=2, max=745, avg=17.88, stdev=24.59 lat (msec): min=2, max=745, avg=17.88, stdev=24.59 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 52], | 99.00th=[ 77], 99.50th=[ 84], 99.90th=[ 127], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 192, per=24.95%, avg=66.86, stdev=37.57, samples=176 iops : min= 1, max= 48, avg=16.41, stdev= 9.49, samples=176 write: IOPS=17, BW=71.2KiB/s (72.9kB/s)(6348KiB/89212msec); 0 zone resets clat (msec): min=15, max=157, avg=39.30, stdev=18.01 lat (msec): min=15, max=157, avg=39.30, stdev=18.01 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 51], 90.00th=[ 62], 95.00th=[ 73], | 99.00th=[ 106], 99.50th=[ 123], 99.90th=[ 157], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 7, max= 152, per=25.44%, avg=71.23, stdev=30.67, samples=176 iops : min= 1, max= 38, avg=17.50, stdev= 7.82, samples=176 lat (msec) : 4=0.85%, 10=20.05%, 20=16.02%, 50=50.16%, 100=12.17% lat (msec) : 250=0.72%, 750=0.03% cpu : usr=0.12%, sys=10.03%, ctx=6501, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149226: Tue Jun 2 03:58:34 2026 read: IOPS=16, BW=67.3KiB/s (68.9kB/s)(6028KiB/89537msec) clat (msec): min=3, max=160, avg=18.23, stdev=16.61 lat (msec): min=3, max=160, avg=18.23, stdev=16.61 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 79], 99.50th=[ 89], 99.90th=[ 157], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 15, max= 192, per=25.31%, avg=67.82, stdev=34.97, samples=176 iops : min= 3, max= 48, avg=16.65, stdev= 8.84, samples=176 write: IOPS=17, BW=69.9KiB/s (71.6kB/s)(6260KiB/89537msec); 0 zone resets clat (msec): min=14, max=765, avg=39.47, stdev=25.75 lat (msec): min=14, max=765, avg=39.48, stdev=25.75 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 51], 90.00th=[ 62], 95.00th=[ 75], | 99.00th=[ 106], 99.50th=[ 122], 99.90th=[ 159], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 15, max= 160, per=24.97%, avg=69.92, stdev=31.62, samples=177 iops : min= 3, max= 40, avg=17.18, stdev= 8.05, samples=177 lat (msec) : 4=0.81%, 10=19.11%, 20=16.60%, 50=50.46%, 100=12.11% lat (msec) : 250=0.88%, 1000=0.03% cpu : usr=0.10%, sys=10.20%, ctx=6589, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149228: Tue Jun 2 03:58:34 2026 read: IOPS=17, BW=68.2KiB/s (69.9kB/s)(6052KiB/88719msec) clat (msec): min=3, max=114, avg=17.31, stdev=15.38 lat (msec): min=3, max=114, avg=17.31, stdev=15.38 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 70], 99.50th=[ 79], 99.90th=[ 101], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 8, max= 200, per=25.85%, avg=69.28, stdev=38.12, samples=173 iops : min= 2, max= 50, avg=17.01, stdev= 9.60, samples=173 write: IOPS=17, BW=70.3KiB/s (71.0kB/s)(6236KiB/88719msec); 0 zone resets clat (msec): min=14, max=770, avg=39.92, stdev=26.15 lat (msec): min=14, max=770, avg=39.93, stdev=26.15 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 39], | 70.00th=[ 44], 80.00th=[ 51], 90.00th=[ 63], 95.00th=[ 74], | 99.00th=[ 109], 99.50th=[ 126], 99.90th=[ 194], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 15, max= 152, per=25.14%, avg=70.40, stdev=31.59, samples=175 iops : min= 3, max= 38, avg=17.29, stdev= 8.05, samples=175 lat (msec) : 4=0.81%, 10=21.22%, 20=14.81%, 50=49.87%, 100=12.37% lat (msec) : 250=0.88%, 1000=0.03% cpu : usr=0.11%, sys=10.01%, ctx=6467, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=268KiB/s (275kB/s), 66.6KiB/s-68.2KiB/s (68.2kB/s-69.9kB/s), io=23.4MiB (24.6MB), run=88719-89557msec WRITE: bw=281KiB/s (287kB/s), 69.9KiB/s-71.2KiB/s (71.6kB/s-72.9kB/s), io=24.6MiB (25.7MB), run=88719-89557msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149263: Tue Jun 2 03:58:55 2026 read: IOPS=23, BW=382KiB/s (391kB/s)(5920KiB/15496msec) clat (usec): min=40, max=128866, avg=20554.95, stdev=15270.66 lat (usec): min=41, max=128868, avg=20556.09, stdev=15270.82 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 106], 10.00th=[ 186], 20.00th=[ 10945], | 30.00th=[ 13435], 40.00th=[ 15664], 50.00th=[ 18482], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 30278], 90.00th=[ 37487], 95.00th=[ 47973], | 99.00th=[ 63177], 99.50th=[ 95945], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 212, max= 544, per=24.73%, avg=382.13, stdev=91.82, samples=30 iops : min= 13, max= 34, avg=23.43, stdev= 5.83, samples=30 write: IOPS=25, BW=411KiB/s (421kB/s)(6368KiB/15496msec); 0 zone resets clat (usec): min=1169, max=95856, avg=19495.80, stdev=16207.28 lat (usec): min=1170, max=95858, avg=19498.20, stdev=16207.93 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 3523], 10.00th=[ 4490], 20.00th=[ 6325], | 30.00th=[ 8455], 40.00th=[11600], 50.00th=[13829], 60.00th=[17957], | 70.00th=[23462], 80.00th=[32375], 90.00th=[39584], 95.00th=[51119], | 99.00th=[73925], 99.50th=[93848], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 159, max= 698, per=25.54%, avg=415.33, stdev=103.50, samples=30 iops : min= 9, max= 43, avg=25.50, stdev= 6.53, samples=30 lat (usec) : 50=0.13%, 100=1.69%, 250=3.91%, 500=1.04%, 750=0.13% lat (msec) : 2=0.65%, 4=3.26%, 10=15.49%, 20=33.07%, 50=35.94% lat (msec) : 100=4.56%, 250=0.13% cpu : usr=0.15%, sys=29.73%, ctx=2534, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149264: Tue Jun 2 03:58:55 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(5744KiB/15431msec) clat (usec): min=40, max=179674, avg=22221.64, stdev=17108.69 lat (usec): min=40, max=179675, avg=22223.67, stdev=17108.79 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 141], 10.00th=[ 219], 20.00th=[ 11207], | 30.00th=[ 14484], 40.00th=[ 17957], 50.00th=[ 20317], 60.00th=[ 23200], | 70.00th=[ 26346], 80.00th=[ 30540], 90.00th=[ 40633], 95.00th=[ 52167], | 99.00th=[ 80217], 99.50th=[ 84411], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 126, max= 576, per=24.07%, avg=371.87, stdev=105.89, samples=30 iops : min= 7, max= 36, avg=22.77, stdev= 6.69, samples=30 write: IOPS=26, BW=424KiB/s (434kB/s)(6544KiB/15431msec); 0 zone resets clat (usec): min=1195, max=87554, avg=18083.64, stdev=14193.83 lat (usec): min=1195, max=87555, avg=18085.77, stdev=14193.97 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 4080], 10.00th=[ 4490], 20.00th=[ 6063], | 30.00th=[ 8717], 40.00th=[11207], 50.00th=[13566], 60.00th=[17171], | 70.00th=[21890], 80.00th=[27919], 90.00th=[40633], 95.00th=[47973], | 99.00th=[62129], 99.50th=[66847], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 189, max= 672, per=25.73%, avg=418.40, stdev=132.32, samples=30 iops : min= 11, max= 42, avg=25.70, stdev= 8.47, samples=30 lat (usec) : 50=0.13%, 100=0.91%, 250=4.17%, 500=0.65%, 750=0.13% lat (msec) : 2=0.78%, 4=1.82%, 10=17.71%, 20=31.77%, 50=37.37% lat (msec) : 100=4.43%, 250=0.13% cpu : usr=0.14%, sys=30.29%, ctx=2645, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149265: Tue Jun 2 03:58:55 2026 read: IOPS=25, BW=406KiB/s (416kB/s)(6256KiB/15412msec) clat (usec): min=44, max=80051, avg=20175.30, stdev=13891.99 lat (usec): min=45, max=80051, avg=20176.90, stdev=13891.50 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 114], 10.00th=[ 151], 20.00th=[10552], | 30.00th=[13698], 40.00th=[16909], 50.00th=[19530], 60.00th=[21890], | 70.00th=[25035], 80.00th=[29492], 90.00th=[36963], 95.00th=[45876], | 99.00th=[68682], 99.50th=[74974], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 223, max= 576, per=26.39%, avg=407.80, stdev=103.34, samples=30 iops : min= 13, max= 36, avg=25.03, stdev= 6.47, samples=30 write: IOPS=24, BW=391KiB/s (401kB/s)(6032KiB/15412msec); 0 zone resets clat (usec): min=1235, max=138391, avg=19663.70, stdev=16112.27 lat (usec): min=1238, max=138394, avg=19665.96, stdev=16112.39 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 43], 95.00th=[ 50], | 99.00th=[ 65], 99.50th=[ 83], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 191, max= 603, per=23.82%, avg=387.27, stdev=104.56, samples=30 iops : min= 11, max= 37, avg=23.73, stdev= 6.56, samples=30 lat (usec) : 50=0.13%, 100=1.69%, 250=5.73%, 500=0.65%, 1000=0.13% lat (msec) : 2=0.39%, 4=2.73%, 10=15.49%, 20=29.82%, 50=39.32% lat (msec) : 100=3.78%, 250=0.13% cpu : usr=0.13%, sys=30.11%, ctx=2600, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149266: Tue Jun 2 03:58:55 2026 read: IOPS=25, BW=402KiB/s (412kB/s)(6032KiB/15007msec) clat (usec): min=47, max=71598, avg=19798.88, stdev=13535.09 lat (usec): min=47, max=71599, avg=19800.21, stdev=13535.19 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 106], 10.00th=[ 165], 20.00th=[10421], | 30.00th=[13042], 40.00th=[15270], 50.00th=[18220], 60.00th=[21627], | 70.00th=[24511], 80.00th=[28967], 90.00th=[38536], 95.00th=[43254], | 99.00th=[65274], 99.50th=[70779], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 192, max= 634, per=25.93%, avg=400.62, stdev=95.60, samples=29 iops : min= 12, max= 39, avg=24.59, stdev= 6.13, samples=29 write: IOPS=26, BW=417KiB/s (427kB/s)(6256KiB/15007msec); 0 zone resets clat (usec): min=1207, max=120161, avg=19208.11, stdev=15378.65 lat (usec): min=1208, max=120164, avg=19210.26, stdev=15378.70 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 3523], 10.00th=[ 4686], 20.00th=[ 7308], | 30.00th=[ 9634], 40.00th=[ 11731], 50.00th=[ 14746], 60.00th=[ 18482], | 70.00th=[ 23462], 80.00th=[ 30016], 90.00th=[ 39060], 95.00th=[ 46924], | 99.00th=[ 74974], 99.50th=[ 89654], 99.90th=[120062], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 192, max= 605, per=25.61%, avg=416.41, stdev=113.46, samples=29 iops : min= 12, max= 37, avg=25.59, stdev= 7.10, samples=29 lat (usec) : 50=0.13%, 100=1.43%, 250=4.95%, 500=1.04% lat (msec) : 2=0.65%, 4=2.47%, 10=14.71%, 20=33.59%, 50=38.02% lat (msec) : 100=2.86%, 250=0.13% cpu : usr=0.12%, sys=30.35%, ctx=2602, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1546KiB/s (1583kB/s), 372KiB/s-406KiB/s (381kB/s-416kB/s), io=23.4MiB (24.5MB), run=15007-15496msec WRITE: bw=1626KiB/s (1665kB/s), 391KiB/s-424KiB/s (401kB/s-434kB/s), io=24.6MiB (25.8MB), run=15007-15496msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149267: Tue Jun 2 03:59:06 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(5920KiB/25620msec) clat (msec): min=4, max=110, avg=20.08, stdev=17.48 lat (msec): min=4, max=110, avg=20.08, stdev=17.48 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 45], 95.00th=[ 66], | 99.00th=[ 84], 99.50th=[ 103], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 32, max= 544, per=24.57%, avg=228.04, stdev=116.66, samples=50 iops : min= 2, max= 34, avg=13.90, stdev= 7.41, samples=50 write: IOPS=15, BW=249KiB/s (255kB/s)(6368KiB/25620msec); 0 zone resets clat (msec): min=18, max=150, avg=45.61, stdev=22.07 lat (msec): min=18, max=150, avg=45.61, stdev=22.07 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 29], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 58], 90.00th=[ 78], 95.00th=[ 95], | 99.00th=[ 122], 99.50th=[ 131], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 95, max= 480, per=25.32%, avg=247.36, stdev=110.49, samples=50 iops : min= 5, max= 30, avg=15.12, stdev= 7.06, samples=50 lat (msec) : 10=13.67%, 20=20.96%, 50=45.96%, 100=17.32%, 250=2.08% cpu : usr=0.10%, sys=9.84%, ctx=1818, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149268: Tue Jun 2 03:59:06 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(5744KiB/25788msec) clat (msec): min=4, max=122, avg=19.61, stdev=17.65 lat (msec): min=4, max=122, avg=19.61, stdev=17.65 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 43], 95.00th=[ 61], | 99.00th=[ 88], 99.50th=[ 114], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 32, max= 606, per=23.94%, avg=222.14, stdev=130.54, samples=51 iops : min= 2, max= 37, avg=13.55, stdev= 8.26, samples=51 write: IOPS=15, BW=254KiB/s (260kB/s)(6544KiB/25788msec); 0 zone resets clat (msec): min=19, max=183, avg=45.65, stdev=20.98 lat (msec): min=19, max=183, avg=45.65, stdev=20.98 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 34], 40.00th=[ 37], 50.00th=[ 40], 60.00th=[ 43], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 72], 95.00th=[ 82], | 99.00th=[ 117], 99.50th=[ 123], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 95, max= 448, per=25.81%, avg=252.12, stdev=97.25, samples=51 iops : min= 5, max= 28, avg=15.41, stdev= 6.24, samples=51 lat (msec) : 10=15.76%, 20=17.58%, 50=48.83%, 100=16.15%, 250=1.69% cpu : usr=0.10%, sys=9.95%, ctx=1807, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149269: Tue Jun 2 03:59:06 2026 read: IOPS=15, BW=245KiB/s (251kB/s)(6256KiB/25483msec) clat (msec): min=4, max=143, avg=22.07, stdev=20.88 lat (msec): min=4, max=143, avg=22.07, stdev=20.88 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 32], 90.00th=[ 52], 95.00th=[ 68], | 99.00th=[ 104], 99.50th=[ 121], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 95, max= 672, per=26.72%, avg=248.00, stdev=137.29, samples=50 iops : min= 5, max= 42, avg=15.16, stdev= 8.72, samples=50 write: IOPS=14, BW=237KiB/s (242kB/s)(6032KiB/25483msec); 0 zone resets clat (msec): min=19, max=184, avg=44.23, stdev=21.64 lat (msec): min=19, max=184, avg=44.23, stdev=21.64 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 29], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 38], 60.00th=[ 43], | 70.00th=[ 47], 80.00th=[ 57], 90.00th=[ 70], 95.00th=[ 85], | 99.00th=[ 124], 99.50th=[ 169], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 63, max= 447, per=24.00%, avg=234.46, stdev=108.25, samples=50 iops : min= 3, max= 27, avg=14.30, stdev= 6.93, samples=50 lat (msec) : 10=15.23%, 20=19.79%, 50=46.22%, 100=17.06%, 250=1.69% cpu : usr=0.12%, sys=10.23%, ctx=1850, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149270: Tue Jun 2 03:59:06 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(6032KiB/25726msec) clat (msec): min=4, max=139, avg=20.93, stdev=19.32 lat (msec): min=4, max=139, avg=20.93, stdev=19.32 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 47], 95.00th=[ 62], | 99.00th=[ 101], 99.50th=[ 118], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 63, max= 480, per=25.11%, avg=232.98, stdev=110.10, samples=51 iops : min= 3, max= 30, avg=14.22, stdev= 7.02, samples=51 write: IOPS=15, BW=243KiB/s (249kB/s)(6256KiB/25726msec); 0 zone resets clat (msec): min=17, max=170, avg=45.11, stdev=21.50 lat (msec): min=17, max=170, avg=45.11, stdev=21.50 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 30], | 30.00th=[ 33], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 72], 95.00th=[ 88], | 99.00th=[ 124], 99.50th=[ 163], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 63, max= 416, per=24.87%, avg=242.94, stdev=107.14, samples=51 iops : min= 3, max= 26, avg=14.84, stdev= 6.88, samples=51 lat (msec) : 10=13.80%, 20=20.96%, 50=47.40%, 100=15.76%, 250=2.08% cpu : usr=0.10%, sys=9.99%, ctx=1821, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=929KiB/s (951kB/s), 223KiB/s-245KiB/s (228kB/s-251kB/s), io=23.4MiB (24.5MB), run=25483-25788msec WRITE: bw=977KiB/s (1001kB/s), 237KiB/s-254KiB/s (242kB/s-260kB/s), io=24.6MiB (25.8MB), run=25483-25788msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149284: Tue Jun 2 03:59:15 2026 read: IOPS=3, BW=3720KiB/s (3809kB/s)(7168KiB/1927msec) clat (usec): min=600, max=340428, avg=108310.06, stdev=114719.63 lat (usec): min=602, max=340429, avg=108311.74, stdev=114719.76 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 1582], | 30.00th=[ 80217], 40.00th=[ 80217], 50.00th=[ 94897], 60.00th=[100140], | 70.00th=[100140], 80.00th=[141558], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 2048, max= 4946, per=50.74%, avg=3614.33, stdev=1463.18, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2657KiB/s (2721kB/s)(5120KiB/1927msec); 0 zone resets clat (msec): min=159, max=292, avg=229.59, stdev=50.49 lat (msec): min=159, max=292, avg=229.66, stdev=50.51 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1924, max= 6144, per=40.45%, avg=4034.00, stdev=2983.99, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=25.00%, 250=33.33%, 500=25.00% cpu : usr=0.10%, sys=46.73%, ctx=1075, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149285: Tue Jun 2 03:59:15 2026 read: IOPS=0, BW=712KiB/s (729kB/s)(2048KiB/2875msec) clat (msec): min=112, max=199, avg=155.72, stdev=61.69 lat (msec): min=112, max=199, avg=155.72, stdev=61.69 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 1662, max= 2048, per=26.04%, avg=1855.00, stdev=272.94, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3562KiB/s (3647kB/s)(10.0MiB/2875msec); 0 zone resets clat (msec): min=141, max=532, avg=248.83, stdev=126.46 lat (msec): min=141, max=533, avg=248.92, stdev=126.45 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 146], | 30.00th=[ 165], 40.00th=[ 194], 50.00th=[ 201], 60.00th=[ 209], | 70.00th=[ 211], 80.00th=[ 284], 90.00th=[ 405], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1662, max= 6144, per=39.49%, avg=3937.75, stdev=1832.98, samples=4 iops : min= 1, max= 6, avg= 3.50, stdev= 2.08, samples=4 lat (msec) : 250=75.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=41.09%, ctx=620, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149286: Tue Jun 2 03:59:15 2026 read: IOPS=2, BW=2643KiB/s (2706kB/s)(6144KiB/2325msec) clat (usec): min=531, max=267450, avg=140815.92, stdev=111020.26 lat (usec): min=532, max=267452, avg=140817.18, stdev=111020.17 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 13435], | 30.00th=[ 13435], 40.00th=[145753], 50.00th=[145753], 60.00th=[191890], | 70.00th=[223347], 80.00th=[223347], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 4096, max= 5774, per=69.28%, avg=4935.00, stdev=1186.53, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2643KiB/s (2706kB/s)(6144KiB/2325msec); 0 zone resets clat (msec): min=136, max=499, avg=233.92, stdev=138.27 lat (msec): min=136, max=499, avg=234.00, stdev=138.28 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 178], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2048, max= 3849, per=28.20%, avg=2812.00, stdev=909.92, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=43.93%, ctx=827, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149287: Tue Jun 2 03:59:15 2026 read: IOPS=1, BW=1975KiB/s (2023kB/s)(5120KiB/2592msec) clat (msec): min=91, max=302, avg=162.13, stdev=83.88 lat (msec): min=91, max=302, avg=162.13, stdev=83.88 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2048, max= 6144, per=57.50%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2765KiB/s (2832kB/s)(7168KiB/2592msec); 0 zone resets clat (msec): min=128, max=421, avg=245.57, stdev=106.06 lat (msec): min=128, max=421, avg=245.65, stdev=106.05 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 142], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 218], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 317], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1667, max= 3849, per=25.28%, avg=2521.33, stdev=1165.47, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=45.58%, ctx=795, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7123KiB/s (7294kB/s), 712KiB/s-3720KiB/s (729kB/s-3809kB/s), io=20.0MiB (20.0MB), run=1927-2875msec WRITE: bw=9973KiB/s (10.2MB/s), 2643KiB/s-3562KiB/s (2706kB/s-3647kB/s), io=28.0MiB (29.4MB), run=1927-2875msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149279: Tue Jun 2 03:59:15 2026 read: IOPS=2, BW=2834KiB/s (2902kB/s)(7168KiB/2529msec) clat (msec): min=47, max=864, avg=228.10, stdev=306.05 lat (msec): min=47, max=864, avg=228.10, stdev=306.05 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 57], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 80], 60.00th=[ 92], | 70.00th=[ 92], 80.00th=[ 393], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1969, max= 5206, per=45.93%, avg=3074.33, stdev=1846.50, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=2025KiB/s (2073kB/s)(5120KiB/2529msec); 0 zone resets clat (msec): min=99, max=290, avg=183.43, stdev=71.35 lat (msec): min=99, max=290, avg=183.55, stdev=71.33 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1735, max= 6144, per=42.03%, avg=3939.50, stdev=3117.63, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 50=8.33%, 100=41.67%, 250=25.00%, 500=16.67%, 1000=8.33% cpu : usr=0.12%, sys=12.74%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149280: Tue Jun 2 03:59:15 2026 read: IOPS=0, BW=669KiB/s (686kB/s)(2048KiB/3059msec) clat (msec): min=40, max=563, avg=301.79, stdev=369.64 lat (msec): min=40, max=563, avg=301.79, stdev=369.64 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 41], | 30.00th=[ 41], 40.00th=[ 41], 50.00th=[ 41], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1735, max= 2048, per=28.26%, avg=1891.50, stdev=221.32, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3347KiB/s (3428kB/s)(10.0MiB/3059msec); 0 zone resets clat (msec): min=77, max=767, avg=242.48, stdev=207.61 lat (msec): min=77, max=767, avg=242.56, stdev=207.61 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 87], | 30.00th=[ 88], 40.00th=[ 96], 50.00th=[ 192], 60.00th=[ 243], | 70.00th=[ 247], 80.00th=[ 284], 90.00th=[ 347], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1969, max= 5206, per=29.94%, avg=2806.25, stdev=1600.12, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=16.22%, ctx=189, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149281: Tue Jun 2 03:59:15 2026 read: IOPS=1, BW=2023KiB/s (2072kB/s)(6144KiB/3037msec) clat (msec): min=139, max=573, avg=316.26, stdev=169.07 lat (msec): min=139, max=573, avg=316.26, stdev=169.07 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 275], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2007, max= 4096, per=40.56%, avg=2715.33, stdev=1195.83, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=2023KiB/s (2072kB/s)(6144KiB/3037msec); 0 zone resets clat (msec): min=68, max=415, avg=182.65, stdev=137.33 lat (msec): min=68, max=415, avg=182.74, stdev=137.32 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 194], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1969, max= 3465, per=25.41%, avg=2381.25, stdev=723.40, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=11.82%, ctx=276, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149282: Tue Jun 2 03:59:15 2026 read: IOPS=1, BW=1751KiB/s (1793kB/s)(5120KiB/2924msec) clat (msec): min=60, max=453, avg=320.21, stdev=166.80 lat (msec): min=60, max=453, avg=320.21, stdev=166.80 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2007, max= 4096, per=40.56%, avg=2715.33, stdev=1195.83, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2451KiB/s (2510kB/s)(7168KiB/2924msec); 0 zone resets clat (msec): min=67, max=330, avg=181.53, stdev=108.11 lat (msec): min=67, max=330, avg=181.62, stdev=108.11 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 89], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 326], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 2043, max= 3938, per=33.60%, avg=3148.67, stdev=986.31, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=50.00% cpu : usr=0.00%, sys=12.73%, ctx=339, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6695KiB/s (6856kB/s), 669KiB/s-2834KiB/s (686kB/s-2902kB/s), io=20.0MiB (20.0MB), run=2529-3059msec WRITE: bw=9373KiB/s (9598kB/s), 2023KiB/s-3347KiB/s (2072kB/s-3428kB/s), io=28.0MiB (29.4MB), run=2529-3059msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149293: Tue Jun 2 03:59:23 2026 read: IOPS=1, BW=6311KiB/s (6463kB/s)(12.0MiB/1947msec) clat (msec): min=420, max=964, avg=638.25, stdev=288.01 lat (msec): min=420, max=964, avg=638.26, stdev=288.00 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=39.83%, ctx=2147, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149294: Tue Jun 2 03:59:23 2026 read: IOPS=0, BW=1680KiB/s (1720kB/s)(4096KiB/2438msec) clat (nsec): min=254910k, max=254910k, avg=254909719.00, stdev= 0.00 lat (nsec): min=254913k, max=254913k, avg=254913434.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 255], 95.00th=[ 255], | 99.00th=[ 255], 99.50th=[ 255], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 5461, max= 5461, per=81.26%, avg=5461.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3360KiB/s (3441kB/s)(8192KiB/2438msec); 0 zone resets clat (msec): min=892, max=1222, avg=1057.51, stdev=232.80 lat (msec): min=893, max=1222, avg=1057.76, stdev=232.75 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8192, max= 8192, per=66.38%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.60%, ctx=699, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149295: Tue Jun 2 03:59:23 2026 write: IOPS=1, BW=4628KiB/s (4739kB/s)(12.0MiB/2655msec); 0 zone resets clat (msec): min=134, max=1684, avg=858.64, stdev=780.40 lat (msec): min=134, max=1685, avg=859.09, stdev=780.67 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8192, max= 8192, per=66.38%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=9.12%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149296: Tue Jun 2 03:59:23 2026 write: IOPS=1, BW=6089KiB/s (6235kB/s)(12.0MiB/2018msec); 0 zone resets clat (msec): min=376, max=1088, avg=659.01, stdev=377.80 lat (msec): min=377, max=1088, avg=659.49, stdev=377.80 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8175, max= 8192, per=66.31%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=18.49%, ctx=155, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6720KiB/s (6882kB/s), 1680KiB/s-6311KiB/s (1720kB/s-6463kB/s), io=16.0MiB (16.8MB), run=1947-2438msec WRITE: bw=12.1MiB/s (12.6MB/s), 3360KiB/s-6089KiB/s (3441kB/s-6235kB/s), io=32.0MiB (33.6MB), run=2018-2655msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149298: Tue Jun 2 03:59:24 2026 read: IOPS=1, BW=5951KiB/s (6093kB/s)(12.0MiB/2065msec) clat (msec): min=194, max=1135, avg=674.76, stdev=470.62 lat (msec): min=194, max=1135, avg=674.76, stdev=470.62 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.02%, ctx=184, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149299: Tue Jun 2 03:59:24 2026 read: IOPS=0, BW=1614KiB/s (1653kB/s)(4096KiB/2538msec) clat (nsec): min=1015.2M, max=1015.2M, avg=1015152309.00, stdev= 0.00 lat (nsec): min=1015.2M, max=1015.2M, avg=1015155049.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3228KiB/s (3305kB/s)(8192KiB/2538msec); 0 zone resets clat (msec): min=592, max=908, avg=750.74, stdev=223.14 lat (msec): min=593, max=908, avg=751.02, stdev=223.12 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8192, max= 8192, per=63.45%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=13.95%, ctx=44, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149300: Tue Jun 2 03:59:24 2026 write: IOPS=1, BW=5338KiB/s (5466kB/s)(12.0MiB/2302msec); 0 zone resets clat (msec): min=149, max=1310, avg=749.01, stdev=581.20 lat (msec): min=149, max=1310, avg=749.43, stdev=581.43 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8175, max= 8192, per=63.39%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.13%, sys=11.21%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149301: Tue Jun 2 03:59:24 2026 write: IOPS=1, BW=5655KiB/s (5791kB/s)(12.0MiB/2173msec); 0 zone resets clat (msec): min=116, max=1210, avg=718.16, stdev=555.11 lat (msec): min=116, max=1210, avg=718.54, stdev=555.25 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8175, max= 8175, per=63.32%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.05%, sys=11.60%, ctx=48, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6455KiB/s (6610kB/s), 1614KiB/s-5951KiB/s (1653kB/s-6093kB/s), io=16.0MiB (16.8MB), run=2065-2538msec WRITE: bw=12.6MiB/s (13.2MB/s), 3228KiB/s-5655KiB/s (3305kB/s-5791kB/s), io=32.0MiB (33.6MB), run=2173-2538msec