== sanity test 398b: DIO and buffer IO race ============== 22:23:22 (1781663002) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.65479 s, 19.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191569: Tue Jun 16 22:24:43 2026 read: IOPS=20, BW=83.9KiB/s (85.9kB/s)(5992KiB/71416msec) clat (usec): min=34, max=723569, avg=25514.91, stdev=22305.80 lat (usec): min=34, max=723570, avg=25515.60, stdev=22305.83 clat percentiles (usec): | 1.00th=[ 126], 5.00th=[ 8848], 10.00th=[ 11338], 20.00th=[ 14091], | 30.00th=[ 17171], 40.00th=[ 20055], 50.00th=[ 22938], 60.00th=[ 26346], | 70.00th=[ 29754], 80.00th=[ 34866], 90.00th=[ 42730], 95.00th=[ 49021], | 99.00th=[ 66847], 99.50th=[ 72877], 99.90th=[108528], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 13, max= 200, per=25.21%, avg=83.70, stdev=30.23, samples=142 iops : min= 3, max= 50, avg=20.48, stdev= 7.59, samples=142 write: IOPS=22, BW=88.2KiB/s (90.3kB/s)(6296KiB/71416msec); 0 zone resets clat (usec): min=802, max=91753, avg=20945.45, stdev=15155.00 lat (usec): min=802, max=91754, avg=20946.25, stdev=15154.95 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 3032], 10.00th=[ 4178], 20.00th=[ 7046], | 30.00th=[10421], 40.00th=[14222], 50.00th=[17957], 60.00th=[21627], | 70.00th=[26608], 80.00th=[33162], 90.00th=[42730], 95.00th=[49546], | 99.00th=[67634], 99.50th=[69731], 99.90th=[87557], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 23, max= 192, per=25.42%, avg=88.45, stdev=33.29, samples=141 iops : min= 5, max= 48, avg=21.67, stdev= 8.36, samples=141 lat (usec) : 50=0.10%, 100=0.13%, 250=0.62%, 500=0.20%, 1000=0.75% lat (msec) : 2=0.49%, 4=3.71%, 10=12.24%, 20=29.88%, 50=47.14% lat (msec) : 100=4.69%, 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=26.85%, ctx=10550, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191570: Tue Jun 16 22:24:43 2026 read: IOPS=20, BW=82.8KiB/s (84.8kB/s)(5940KiB/71769msec) clat (usec): min=82, max=678109, avg=25781.74, stdev=21708.06 lat (usec): min=83, max=678111, avg=25782.38, stdev=21708.09 clat percentiles (usec): | 1.00th=[ 131], 5.00th=[ 8717], 10.00th=[ 10945], 20.00th=[ 14091], | 30.00th=[ 17171], 40.00th=[ 19792], 50.00th=[ 22938], 60.00th=[ 26608], | 70.00th=[ 30278], 80.00th=[ 35390], 90.00th=[ 43254], 95.00th=[ 50594], | 99.00th=[ 71828], 99.50th=[ 76022], 99.90th=[ 90702], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 31, max= 168, per=24.99%, avg=82.96, stdev=28.78, samples=141 iops : min= 7, max= 42, avg=20.29, stdev= 7.19, samples=141 write: IOPS=22, BW=88.5KiB/s (90.6kB/s)(6348KiB/71769msec); 0 zone resets clat (usec): min=790, max=86733, avg=20967.58, stdev=14957.48 lat (usec): min=791, max=86733, avg=20968.31, stdev=14957.50 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 3392], 10.00th=[ 4686], 20.00th=[ 7373], | 30.00th=[11076], 40.00th=[14484], 50.00th=[18220], 60.00th=[21627], | 70.00th=[26084], 80.00th=[32900], 90.00th=[41681], 95.00th=[49021], | 99.00th=[67634], 99.50th=[77071], 99.90th=[83362], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 31, max= 192, per=25.42%, avg=88.45, stdev=31.80, samples=141 iops : min= 7, max= 48, avg=21.67, stdev= 8.00, samples=141 lat (usec) : 100=0.07%, 250=1.04%, 500=0.07%, 1000=0.42% lat (msec) : 2=0.33%, 4=3.52%, 10=11.85%, 20=31.28%, 50=46.42% lat (msec) : 100=4.98%, 750=0.03% cpu : usr=0.07%, sys=26.87%, ctx=10797, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191571: Tue Jun 16 22:24:43 2026 read: IOPS=20, BW=83.6KiB/s (85.6kB/s)(6028KiB/72120msec) clat (usec): min=33, max=85822, avg=25013.46, stdev=12899.59 lat (usec): min=34, max=85823, avg=25014.21, stdev=12899.56 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 8979], 10.00th=[11076], 20.00th=[14353], | 30.00th=[17171], 40.00th=[19792], 50.00th=[22676], 60.00th=[26346], | 70.00th=[30016], 80.00th=[34341], 90.00th=[42206], 95.00th=[49546], | 99.00th=[63701], 99.50th=[69731], 99.90th=[84411], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 31, max= 190, per=25.17%, avg=83.58, stdev=29.79, samples=142 iops : min= 7, max= 47, avg=20.45, stdev= 7.49, samples=142 write: IOPS=21, BW=86.8KiB/s (88.9kB/s)(6260KiB/72120msec); 0 zone resets clat (usec): min=821, max=680746, avg=21857.33, stdev=22720.94 lat (usec): min=822, max=680748, avg=21858.13, stdev=22720.97 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 3163], 10.00th=[ 4555], 20.00th=[ 7439], | 30.00th=[ 10814], 40.00th=[ 14615], 50.00th=[ 17957], 60.00th=[ 22414], | 70.00th=[ 27657], 80.00th=[ 33162], 90.00th=[ 43779], 95.00th=[ 52167], | 99.00th=[ 68682], 99.50th=[ 74974], 99.90th=[104334], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 23, max= 200, per=24.91%, avg=86.70, stdev=30.49, samples=142 iops : min= 5, max= 50, avg=21.23, stdev= 7.69, samples=142 lat (usec) : 50=0.03%, 100=0.16%, 250=0.85%, 500=0.13%, 1000=0.52% lat (msec) : 2=0.49%, 4=3.68%, 10=11.46%, 20=30.24%, 50=47.20% lat (msec) : 100=5.18%, 250=0.03%, 750=0.03% cpu : usr=0.06%, sys=26.52%, ctx=10744, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191572: Tue Jun 16 22:24:43 2026 read: IOPS=21, BW=85.5KiB/s (87.5kB/s)(6052KiB/70804msec) clat (usec): min=34, max=130560, avg=25024.36, stdev=14201.32 lat (usec): min=34, max=130560, avg=25026.52, stdev=14202.67 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 8225], 10.00th=[ 10552], 20.00th=[ 13960], | 30.00th=[ 17171], 40.00th=[ 19792], 50.00th=[ 22414], 60.00th=[ 25560], | 70.00th=[ 29754], 80.00th=[ 34866], 90.00th=[ 42730], 95.00th=[ 50070], | 99.00th=[ 71828], 99.50th=[ 74974], 99.90th=[121111], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 31, max= 167, per=25.87%, avg=85.89, stdev=28.04, samples=139 iops : min= 7, max= 41, avg=21.02, stdev= 7.02, samples=139 write: IOPS=22, BW=88.1KiB/s (90.2kB/s)(6236KiB/70804msec); 0 zone resets clat (usec): min=790, max=669676, avg=20990.94, stdev=21728.19 lat (usec): min=790, max=669676, avg=20991.69, stdev=21728.20 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 3163], 10.00th=[ 4113], 20.00th=[ 7373], | 30.00th=[ 11338], 40.00th=[ 14484], 50.00th=[ 17957], 60.00th=[ 21627], | 70.00th=[ 26608], 80.00th=[ 32375], 90.00th=[ 40109], 95.00th=[ 47449], | 99.00th=[ 62653], 99.50th=[ 70779], 99.90th=[ 88605], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 13, max= 174, per=25.23%, avg=87.81, stdev=31.55, samples=140 iops : min= 3, max= 43, avg=21.51, stdev= 7.94, samples=140 lat (usec) : 50=0.03%, 100=0.26%, 250=1.04%, 500=0.13%, 1000=0.52% lat (msec) : 2=0.52%, 4=3.74%, 10=11.59%, 20=30.47%, 50=47.30% lat (msec) : 100=4.26%, 250=0.10%, 750=0.03% cpu : usr=0.07%, sys=26.87%, ctx=10672, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=333KiB/s (341kB/s), 82.8KiB/s-85.5KiB/s (84.8kB/s-87.5kB/s), io=23.4MiB (24.6MB), run=70804-72120msec WRITE: bw=349KiB/s (357kB/s), 86.8KiB/s-88.5KiB/s (88.9kB/s-90.6kB/s), io=24.6MiB (25.7MB), run=70804-72120msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191574: Tue Jun 16 22:24:51 2026 read: IOPS=18, BW=74.5KiB/s (76.2kB/s)(5992KiB/80474msec) clat (msec): min=2, max=722, avg=23.93, stdev=24.50 lat (msec): min=2, max=722, avg=23.94, stdev=24.50 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 48], 95.00th=[ 59], | 99.00th=[ 85], 99.50th=[ 92], 99.90th=[ 105], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 262, per=25.15%, avg=74.69, stdev=45.95, samples=159 iops : min= 1, max= 65, avg=18.21, stdev=11.57, samples=159 write: IOPS=19, BW=78.2KiB/s (80.1kB/s)(6296KiB/80474msec); 0 zone resets clat (msec): min=6, max=134, avg=28.26, stdev=18.08 lat (msec): min=6, max=134, avg=28.26, stdev=18.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 62], | 99.00th=[ 85], 99.50th=[ 105], 99.90th=[ 127], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 31, max= 264, per=25.21%, avg=78.42, stdev=47.69, samples=159 iops : min= 7, max= 66, avg=19.14, stdev=11.98, samples=159 lat (msec) : 4=0.13%, 10=15.85%, 20=31.67%, 50=41.99%, 100=9.99% lat (msec) : 250=0.33%, 750=0.03% cpu : usr=0.07%, sys=15.83%, ctx=7562, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191575: Tue Jun 16 22:24:51 2026 read: IOPS=18, BW=73.8KiB/s (75.5kB/s)(5940KiB/80521msec) clat (msec): min=3, max=683, avg=24.36, stdev=24.62 lat (msec): min=3, max=683, avg=24.36, stdev=24.62 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 49], 95.00th=[ 61], | 99.00th=[ 91], 99.50th=[ 99], 99.90th=[ 140], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 15, max= 264, per=24.89%, avg=73.93, stdev=47.31, samples=159 iops : min= 3, max= 66, avg=18.02, stdev=11.88, samples=159 write: IOPS=19, BW=78.8KiB/s (80.7kB/s)(6348KiB/80521msec); 0 zone resets clat (msec): min=5, max=124, avg=27.85, stdev=17.71 lat (msec): min=5, max=124, avg=27.86, stdev=17.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 61], | 99.00th=[ 83], 99.50th=[ 102], 99.90th=[ 124], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 23, max= 247, per=25.39%, avg=78.97, stdev=46.56, samples=159 iops : min= 5, max= 61, avg=19.28, stdev=11.70, samples=159 lat (msec) : 4=0.10%, 10=16.96%, 20=29.88%, 50=42.12%, 100=10.48% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.05%, sys=15.92%, ctx=7442, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191576: Tue Jun 16 22:24:51 2026 read: IOPS=18, BW=74.7KiB/s (76.5kB/s)(6028KiB/80674msec) clat (msec): min=2, max=138, avg=23.57, stdev=17.48 lat (msec): min=2, max=138, avg=23.57, stdev=17.48 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 49], 95.00th=[ 58], | 99.00th=[ 84], 99.50th=[ 99], 99.90th=[ 116], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 15, max= 278, per=25.04%, avg=74.38, stdev=50.13, samples=159 iops : min= 3, max= 69, avg=18.13, stdev=12.59, samples=159 write: IOPS=19, BW=77.6KiB/s (79.5kB/s)(6260KiB/80674msec); 0 zone resets clat (msec): min=4, max=682, avg=28.77, stdev=24.71 lat (msec): min=4, max=682, avg=28.78, stdev=24.71 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 65], | 99.00th=[ 90], 99.50th=[ 105], 99.90th=[ 133], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 255, per=24.79%, avg=77.11, stdev=45.40, samples=159 iops : min= 1, max= 63, avg=18.81, stdev=11.41, samples=159 lat (msec) : 4=0.36%, 10=17.51%, 20=28.97%, 50=42.45%, 100=10.25% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.07%, sys=15.77%, ctx=7409, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191577: Tue Jun 16 22:24:51 2026 read: IOPS=18, BW=75.1KiB/s (76.9kB/s)(6052KiB/80567msec) clat (msec): min=4, max=123, avg=23.60, stdev=17.13 lat (msec): min=4, max=123, avg=23.60, stdev=17.13 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 47], 95.00th=[ 59], | 99.00th=[ 83], 99.50th=[ 95], 99.90th=[ 111], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 8, max= 304, per=25.34%, avg=75.25, stdev=47.81, samples=159 iops : min= 2, max= 76, avg=18.35, stdev=12.02, samples=159 write: IOPS=19, BW=77.4KiB/s (79.3kB/s)(6236KiB/80567msec); 0 zone resets clat (msec): min=6, max=665, avg=28.68, stdev=24.50 lat (msec): min=6, max=665, avg=28.68, stdev=24.50 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 54], 95.00th=[ 62], | 99.00th=[ 90], 99.50th=[ 106], 99.90th=[ 138], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 23, max= 264, per=24.87%, avg=77.35, stdev=47.98, samples=159 iops : min= 5, max= 66, avg=18.87, stdev=12.05, samples=159 lat (msec) : 10=17.55%, 20=29.20%, 50=42.68%, 100=10.06%, 250=0.49% lat (msec) : 750=0.03% cpu : usr=0.06%, sys=15.79%, ctx=7604, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=298KiB/s (305kB/s), 73.8KiB/s-75.1KiB/s (75.5kB/s-76.9kB/s), io=23.4MiB (24.6MB), run=80474-80674msec WRITE: bw=312KiB/s (319kB/s), 77.4KiB/s-78.8KiB/s (79.3kB/s-80.7kB/s), io=24.6MiB (25.7MB), run=80474-80674msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191606: Tue Jun 16 22:25:24 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(5920KiB/26537msec) clat (usec): min=63, max=108247, avg=35605.62, stdev=16788.02 lat (usec): min=63, max=108248, avg=35606.20, stdev=16788.02 clat percentiles (usec): | 1.00th=[ 153], 5.00th=[ 10945], 10.00th=[ 17171], 20.00th=[ 22938], | 30.00th=[ 27132], 40.00th=[ 31065], 50.00th=[ 34341], 60.00th=[ 38011], | 70.00th=[ 42730], 80.00th=[ 47973], 90.00th=[ 55837], 95.00th=[ 61604], | 99.00th=[ 93848], 99.50th=[ 99091], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 96, max= 414, per=25.42%, avg=222.15, stdev=63.59, samples=52 iops : min= 6, max= 25, avg=13.31, stdev= 4.02, samples=52 write: IOPS=14, BW=240KiB/s (246kB/s)(6368KiB/26537msec); 0 zone resets clat (usec): min=1575, max=125097, avg=33372.02, stdev=19391.94 lat (usec): min=1576, max=125098, avg=33373.08, stdev=19391.96 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 21], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 42], 80.00th=[ 48], 90.00th=[ 60], 95.00th=[ 70], | 99.00th=[ 99], 99.50th=[ 109], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 64, max= 480, per=26.08%, avg=239.98, stdev=72.27, samples=52 iops : min= 4, max= 30, avg=14.42, stdev= 4.50, samples=52 lat (usec) : 100=0.26%, 250=1.04%, 500=0.91% lat (msec) : 2=0.26%, 4=0.26%, 10=2.47%, 20=17.45%, 50=60.29% lat (msec) : 100=16.54%, 250=0.52% cpu : usr=0.04%, sys=29.22%, ctx=3513, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191607: Tue Jun 16 22:25:24 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5744KiB/26522msec) clat (usec): min=149, max=104776, avg=37621.82, stdev=16686.23 lat (usec): min=149, max=104777, avg=37622.61, stdev=16686.02 clat percentiles (usec): | 1.00th=[ 215], 5.00th=[ 16712], 10.00th=[ 19268], 20.00th=[ 23725], | 30.00th=[ 27657], 40.00th=[ 32637], 50.00th=[ 36439], 60.00th=[ 40109], | 70.00th=[ 44827], 80.00th=[ 51119], 90.00th=[ 59507], 95.00th=[ 64750], | 99.00th=[ 86508], 99.50th=[ 96994], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 94, max= 352, per=24.69%, avg=215.83, stdev=58.59, samples=52 iops : min= 5, max= 22, avg=12.92, stdev= 3.76, samples=52 write: IOPS=15, BW=247KiB/s (253kB/s)(6544KiB/26522msec); 0 zone resets clat (usec): min=1296, max=107607, avg=31637.81, stdev=18160.88 lat (usec): min=1297, max=107608, avg=31638.87, stdev=18160.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 59], 95.00th=[ 70], | 99.00th=[ 83], 99.50th=[ 88], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 64, max= 480, per=26.67%, avg=245.40, stdev=88.01, samples=52 iops : min= 4, max= 30, avg=14.77, stdev= 5.57, samples=52 lat (usec) : 250=0.78%, 500=0.52% lat (msec) : 2=0.26%, 4=0.13%, 10=2.60%, 20=16.41%, 50=60.42% lat (msec) : 100=18.49%, 250=0.39% cpu : usr=0.03%, sys=29.85%, ctx=3618, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191608: Tue Jun 16 22:25:24 2026 read: IOPS=14, BW=228KiB/s (234kB/s)(6256KiB/27391msec) clat (usec): min=141, max=144028, avg=37944.70, stdev=17753.93 lat (usec): min=142, max=144029, avg=37945.36, stdev=17753.93 clat percentiles (usec): | 1.00th=[ 198], 5.00th=[ 15664], 10.00th=[ 19006], 20.00th=[ 24511], | 30.00th=[ 28443], 40.00th=[ 31851], 50.00th=[ 35914], 60.00th=[ 40109], | 70.00th=[ 44827], 80.00th=[ 51119], 90.00th=[ 58983], 95.00th=[ 70779], | 99.00th=[ 88605], 99.50th=[102237], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 95, max= 352, per=26.10%, avg=228.15, stdev=66.05, samples=54 iops : min= 5, max= 22, avg=13.70, stdev= 4.25, samples=54 write: IOPS=13, BW=220KiB/s (226kB/s)(6032KiB/27391msec); 0 zone resets clat (usec): min=1484, max=113384, avg=33245.88, stdev=18358.70 lat (usec): min=1486, max=113385, avg=33247.18, stdev=18358.70 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 49], 90.00th=[ 57], 95.00th=[ 69], | 99.00th=[ 88], 99.50th=[ 94], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 63, max= 448, per=23.50%, avg=216.19, stdev=78.78, samples=54 iops : min= 3, max= 28, avg=12.96, stdev= 4.94, samples=54 lat (usec) : 250=1.04%, 500=0.39% lat (msec) : 2=0.13%, 4=0.13%, 10=2.86%, 20=13.80%, 50=61.98% lat (msec) : 100=19.27%, 250=0.39% cpu : usr=0.04%, sys=28.66%, ctx=3706, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191609: Tue Jun 16 22:25:24 2026 read: IOPS=14, BW=237KiB/s (243kB/s)(6032KiB/25454msec) clat (usec): min=159, max=108039, avg=34770.43, stdev=17518.29 lat (usec): min=160, max=108040, avg=34771.04, stdev=17518.28 clat percentiles (usec): | 1.00th=[ 196], 5.00th=[ 265], 10.00th=[ 16909], 20.00th=[ 22152], | 30.00th=[ 25822], 40.00th=[ 29754], 50.00th=[ 33817], 60.00th=[ 38011], | 70.00th=[ 42206], 80.00th=[ 47973], 90.00th=[ 56886], 95.00th=[ 64750], | 99.00th=[ 82314], 99.50th=[ 86508], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 63, max= 384, per=26.89%, avg=234.98, stdev=74.47, samples=50 iops : min= 3, max= 24, avg=14.10, stdev= 4.83, samples=50 write: IOPS=15, BW=246KiB/s (252kB/s)(6256KiB/25454msec); 0 zone resets clat (usec): min=1158, max=126638, avg=31350.75, stdev=18421.50 lat (usec): min=1159, max=126639, avg=31352.05, stdev=18421.49 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 67], | 99.00th=[ 84], 99.50th=[ 111], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 63, max= 445, per=26.60%, avg=244.74, stdev=77.42, samples=50 iops : min= 3, max= 27, avg=14.72, stdev= 4.81, samples=50 lat (usec) : 250=1.82%, 500=1.69% lat (msec) : 2=0.39%, 4=0.52%, 10=3.78%, 20=14.71%, 50=61.20% lat (msec) : 100=15.49%, 250=0.39% cpu : usr=0.04%, sys=29.87%, ctx=3402, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=874KiB/s (895kB/s), 217KiB/s-237KiB/s (222kB/s-243kB/s), io=23.4MiB (24.5MB), run=25454-27391msec WRITE: bw=920KiB/s (942kB/s), 220KiB/s-247KiB/s (226kB/s-253kB/s), io=24.6MiB (25.8MB), run=25454-27391msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191611: Tue Jun 16 22:25:26 2026 read: IOPS=13, BW=208KiB/s (213kB/s)(5920KiB/28422msec) clat (msec): min=6, max=146, avg=33.54, stdev=23.23 lat (msec): min=6, max=146, avg=33.54, stdev=23.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 68], 95.00th=[ 84], | 99.00th=[ 100], 99.50th=[ 124], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 64, max= 734, per=24.07%, avg=202.39, stdev=120.53, samples=56 iops : min= 4, max= 45, avg=12.09, stdev= 7.53, samples=56 write: IOPS=14, BW=224KiB/s (229kB/s)(6368KiB/28422msec); 0 zone resets clat (msec): min=7, max=156, avg=39.99, stdev=25.22 lat (msec): min=7, max=156, avg=39.99, stdev=25.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 62], 90.00th=[ 78], 95.00th=[ 88], | 99.00th=[ 115], 99.50th=[ 133], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 64, max= 736, per=24.82%, avg=219.70, stdev=121.82, samples=56 iops : min= 4, max= 46, avg=13.18, stdev= 7.66, samples=56 lat (msec) : 10=7.03%, 20=20.83%, 50=46.09%, 100=24.35%, 250=1.69% cpu : usr=0.05%, sys=15.99%, ctx=2262, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191612: Tue Jun 16 22:25:26 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(5744KiB/28448msec) clat (msec): min=4, max=114, avg=34.22, stdev=21.42 lat (msec): min=4, max=114, avg=34.22, stdev=21.42 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 68], 95.00th=[ 80], | 99.00th=[ 101], 99.50th=[ 106], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 63, max= 640, per=23.63%, avg=198.75, stdev=111.55, samples=56 iops : min= 3, max= 40, avg=11.86, stdev= 7.02, samples=56 write: IOPS=14, BW=230KiB/s (236kB/s)(6544KiB/28448msec); 0 zone resets clat (msec): min=6, max=161, avg=39.28, stdev=24.66 lat (msec): min=6, max=161, avg=39.28, stdev=24.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 60], 90.00th=[ 77], 95.00th=[ 85], | 99.00th=[ 112], 99.50th=[ 121], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 64, max= 670, per=25.09%, avg=222.07, stdev=125.65, samples=56 iops : min= 4, max= 41, avg=13.32, stdev= 7.92, samples=56 lat (msec) : 10=5.08%, 20=22.53%, 50=47.14%, 100=23.57%, 250=1.69% cpu : usr=0.06%, sys=15.94%, ctx=2344, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191613: Tue Jun 16 22:25:26 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(6256KiB/28461msec) clat (msec): min=3, max=123, avg=32.25, stdev=22.16 lat (msec): min=3, max=123, avg=32.25, stdev=22.16 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 65], 95.00th=[ 81], | 99.00th=[ 112], 99.50th=[ 116], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 63, max= 896, per=25.66%, avg=215.80, stdev=139.99, samples=56 iops : min= 3, max= 56, avg=12.93, stdev= 8.79, samples=56 write: IOPS=13, BW=212KiB/s (217kB/s)(6032KiB/28461msec); 0 zone resets clat (msec): min=5, max=171, avg=41.76, stdev=26.00 lat (msec): min=5, max=171, avg=41.76, stdev=26.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 19], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 63], 90.00th=[ 77], 95.00th=[ 87], | 99.00th=[ 121], 99.50th=[ 155], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 64, max= 638, per=23.08%, avg=204.27, stdev=95.93, samples=56 iops : min= 4, max= 39, avg=12.21, stdev= 6.05, samples=56 lat (msec) : 4=0.13%, 10=5.60%, 20=23.18%, 50=45.70%, 100=23.44% lat (msec) : 250=1.95% cpu : usr=0.04%, sys=15.81%, ctx=2253, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191614: Tue Jun 16 22:25:26 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(6032KiB/28407msec) clat (msec): min=5, max=144, avg=34.97, stdev=24.03 lat (msec): min=5, max=144, avg=34.97, stdev=24.03 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 69], 95.00th=[ 85], | 99.00th=[ 109], 99.50th=[ 133], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 734, per=24.72%, avg=207.89, stdev=121.42, samples=56 iops : min= 1, max= 45, avg=12.43, stdev= 7.62, samples=56 write: IOPS=13, BW=220KiB/s (226kB/s)(6256KiB/28407msec); 0 zone resets clat (msec): min=7, max=154, avg=38.69, stdev=23.05 lat (msec): min=7, max=154, avg=38.69, stdev=23.05 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 55], 90.00th=[ 72], 95.00th=[ 87], | 99.00th=[ 106], 99.50th=[ 121], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 32, max= 704, per=24.43%, avg=216.23, stdev=112.34, samples=56 iops : min= 2, max= 44, avg=12.95, stdev= 7.10, samples=56 lat (msec) : 10=5.08%, 20=22.27%, 50=49.35%, 100=20.96%, 250=2.34% cpu : usr=0.04%, sys=16.06%, ctx=2349, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=842KiB/s (862kB/s), 202KiB/s-220KiB/s (207kB/s-225kB/s), io=23.4MiB (24.5MB), run=28407-28461msec WRITE: bw=885KiB/s (907kB/s), 212KiB/s-230KiB/s (217kB/s-236kB/s), io=24.6MiB (25.8MB), run=28407-28461msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191625: Tue Jun 16 22:25:40 2026 read: IOPS=1, BW=1323KiB/s (1355kB/s)(7168KiB/5418msec) clat (usec): min=750, max=1580.8k, avg=388588.11, stdev=547303.71 lat (usec): min=751, max=1580.8k, avg=388589.14, stdev=547303.48 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], | 20.00th=[ 758], 30.00th=[ 196084], 40.00th=[ 196084], | 50.00th=[ 208667], 60.00th=[ 320865], 70.00th=[ 320865], | 80.00th=[ 413139], 90.00th=[1585447], 95.00th=[1585447], | 99.00th=[1585447], 99.50th=[1585447], 99.90th=[1585447], | 99.95th=[1585447], 99.99th=[1585447] bw ( KiB/s): min= 1587, max= 3828, per=68.26%, avg=2277.80, stdev=886.82, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=0, BW=945KiB/s (968kB/s)(5120KiB/5418msec); 0 zone resets clat (msec): min=182, max=1159, avg=512.26, stdev=378.98 lat (msec): min=182, max=1159, avg=512.32, stdev=378.95 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1878, max= 2048, per=42.18%, avg=1970.75, stdev=87.58, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=16.67% lat (msec) : 250=25.00%, 500=41.67%, 2000=16.67% cpu : usr=0.02%, sys=41.02%, ctx=1336, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191627: Tue Jun 16 22:25:40 2026 read: IOPS=0, BW=338KiB/s (346kB/s)(2048KiB/6061msec) clat (msec): min=246, max=451, avg=348.86, stdev=145.00 lat (msec): min=246, max=451, avg=348.86, stdev=145.00 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1595, max= 1878, per=52.04%, avg=1736.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1689KiB/s (1730kB/s)(10.0MiB/6061msec); 0 zone resets clat (msec): min=75, max=2419, avg=532.19, stdev=719.69 lat (msec): min=75, max=2419, avg=532.26, stdev=719.68 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 85], | 30.00th=[ 109], 40.00th=[ 230], 50.00th=[ 236], 60.00th=[ 305], | 70.00th=[ 397], 80.00th=[ 435], 90.00th=[ 1036], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1878, max= 8192, per=77.54%, avg=3622.60, stdev=2704.37, samples=5 iops : min= 1, max= 8, avg= 3.00, stdev= 2.92, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=34.72%, ctx=431, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191629: Tue Jun 16 22:25:40 2026 read: IOPS=0, BW=1012KiB/s (1036kB/s)(6144KiB/6072msec) clat (usec): min=560, max=447667, avg=290554.98, stdev=159789.49 lat (usec): min=562, max=447668, avg=290556.37, stdev=159789.04 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[263193], | 30.00th=[263193], 40.00th=[270533], 50.00th=[270533], 60.00th=[354419], | 70.00th=[408945], 80.00th=[408945], 90.00th=[446694], 95.00th=[446694], | 99.00th=[446694], 99.50th=[446694], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 1878, max= 2048, per=59.67%, avg=1991.20, stdev=69.10, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=1012KiB/s (1036kB/s)(6144KiB/6072msec); 0 zone resets clat (msec): min=304, max=2053, avg=696.22, stdev=677.50 lat (msec): min=304, max=2053, avg=696.27, stdev=677.49 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 493], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 2007, max= 2048, per=43.64%, avg=2038.80, stdev=17.91, samples=5 iops : min= 1, max= 2, avg= 1.60, stdev= 0.55, samples=5 lat (usec) : 750=8.33% lat (msec) : 500=75.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=38.30%, ctx=704, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191631: Tue Jun 16 22:25:40 2026 read: IOPS=0, BW=834KiB/s (854kB/s)(5120KiB/6136msec) clat (usec): min=542, max=388787, avg=91905.41, stdev=168581.42 lat (usec): min=543, max=388788, avg=91906.34, stdev=168581.23 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[ 553], 40.00th=[ 553], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 68682], 80.00th=[ 68682], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 1878, max= 6023, per=100.00%, avg=3950.50, stdev=2930.96, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1168KiB/s (1196kB/s)(7168KiB/6136msec); 0 zone resets clat (msec): min=249, max=1949, avg=783.52, stdev=597.49 lat (msec): min=249, max=1950, avg=783.59, stdev=597.49 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 372], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 600], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 1200], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 1577, max= 2043, per=40.21%, avg=1878.40, stdev=179.95, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=25.00% lat (msec) : 100=8.33%, 250=8.33%, 500=25.00%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=29.47%, ctx=443, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3338KiB/s (3418kB/s), 338KiB/s-1323KiB/s (346kB/s-1355kB/s), io=20.0MiB (20.0MB), run=5418-6136msec WRITE: bw=4673KiB/s (4785kB/s), 945KiB/s-1689KiB/s (968kB/s-1730kB/s), io=28.0MiB (29.4MB), run=5418-6136msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191624: Tue Jun 16 22:25:40 2026 read: IOPS=1, BW=1163KiB/s (1191kB/s)(7168KiB/6164msec) clat (msec): min=85, max=1561, avg=423.95, stdev=544.28 lat (msec): min=85, max=1561, avg=423.95, stdev=544.28 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 105], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 150], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 684], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1667, max= 2048, per=60.67%, avg=1954.33, stdev=144.65, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=831KiB/s (851kB/s)(5120KiB/6164msec); 0 zone resets clat (msec): min=400, max=1040, avg=635.14, stdev=261.93 lat (msec): min=400, max=1040, avg=635.23, stdev=261.92 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1957, max= 2048, per=44.91%, avg=2025.25, stdev=45.50, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 2000=16.67% cpu : usr=0.02%, sys=17.44%, ctx=315, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191626: Tue Jun 16 22:25:40 2026 read: IOPS=0, BW=322KiB/s (330kB/s)(2048KiB/6357msec) clat (msec): min=109, max=365, avg=237.59, stdev=181.16 lat (msec): min=109, max=365, avg=237.59, stdev=181.16 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1675, max= 1957, per=56.38%, avg=1816.00, stdev=199.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1611KiB/s (1649kB/s)(10.0MiB/6357msec); 0 zone resets clat (msec): min=60, max=3244, avg=585.16, stdev=961.15 lat (msec): min=60, max=3244, avg=585.24, stdev=961.14 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 88], | 30.00th=[ 122], 40.00th=[ 128], 50.00th=[ 142], 60.00th=[ 321], | 70.00th=[ 456], 80.00th=[ 592], 90.00th=[ 701], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1675, max= 6144, per=77.35%, avg=3488.50, stdev=2063.47, samples=4 iops : min= 1, max= 6, avg= 3.00, stdev= 2.16, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=16.33%, ctx=208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191628: Tue Jun 16 22:25:40 2026 read: IOPS=1, BW=1110KiB/s (1136kB/s)(6144KiB/5537msec) clat (msec): min=99, max=603, avg=288.70, stdev=217.08 lat (msec): min=99, max=603, avg=288.70, stdev=217.08 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 222], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2048, max= 3992, per=100.00%, avg=3318.33, stdev=1100.81, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1110KiB/s (1136kB/s)(6144KiB/5537msec); 0 zone resets clat (msec): min=117, max=2058, avg=622.21, stdev=727.75 lat (msec): min=117, max=2058, avg=622.28, stdev=727.74 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 481], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 1681, max= 2048, per=43.00%, avg=1939.40, stdev=148.15, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=18.41%, ctx=180, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191630: Tue Jun 16 22:25:40 2026 read: IOPS=1, BW=1091KiB/s (1117kB/s)(5120KiB/4693msec) clat (msec): min=95, max=444, avg=263.59, stdev=139.16 lat (msec): min=95, max=444, avg=263.59, stdev=139.16 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1996, max= 6144, per=100.00%, avg=4070.00, stdev=2933.08, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1527KiB/s (1564kB/s)(7168KiB/4693msec); 0 zone resets clat (msec): min=98, max=1281, avg=480.79, stdev=397.37 lat (msec): min=98, max=1281, avg=480.88, stdev=397.38 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 120], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 414], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 609], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 2015, max= 4096, per=59.75%, avg=2694.60, stdev=948.77, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=16.11%, ctx=119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3222KiB/s (3299kB/s), 322KiB/s-1163KiB/s (330kB/s-1191kB/s), io=20.0MiB (20.0MB), run=4693-6357msec WRITE: bw=4510KiB/s (4619kB/s), 831KiB/s-1611KiB/s (851kB/s-1649kB/s), io=28.0MiB (29.4MB), run=4693-6357msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191642: Tue Jun 16 22:25:53 2026 read: IOPS=1, BW=4896KiB/s (5013kB/s)(12.0MiB/2510msec) clat (msec): min=754, max=993, avg=835.81, stdev=136.40 lat (msec): min=754, max=993, avg=835.81, stdev=136.40 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.04%, sys=52.77%, ctx=3054, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191643: Tue Jun 16 22:25:53 2026 read: IOPS=0, BW=1257KiB/s (1287kB/s)(4096KiB/3258msec) clat (nsec): min=731047k, max=731047k, avg=731047338.00, stdev= 0.00 lat (nsec): min=731049k, max=731049k, avg=731048918.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2514KiB/s (2575kB/s)(8192KiB/3258msec); 0 zone resets clat (msec): min=888, max=1634, avg=1261.28, stdev=527.61 lat (msec): min=889, max=1634, avg=1262.12, stdev=526.89 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8159, max= 8159, per=82.79%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.12%, sys=21.25%, ctx=894, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191644: Tue Jun 16 22:25:53 2026 write: IOPS=0, BW=3696KiB/s (3784kB/s)(12.0MiB/3325msec); 0 zone resets clat (msec): min=250, max=1810, avg=1107.37, stdev=791.54 lat (msec): min=250, max=1810, avg=1107.69, stdev=791.44 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8192, max= 8192, per=83.13%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=16.16%, ctx=113, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191645: Tue Jun 16 22:25:53 2026 write: IOPS=1, BW=4195KiB/s (4296kB/s)(12.0MiB/2929msec); 0 zone resets clat (msec): min=647, max=1267, avg=975.01, stdev=311.50 lat (msec): min=647, max=1267, avg=975.22, stdev=311.51 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8159, max= 8192, per=82.96%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.07%, sys=19.84%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5029KiB/s (5150kB/s), 1257KiB/s-4896KiB/s (1287kB/s-5013kB/s), io=16.0MiB (16.8MB), run=2510-3258msec WRITE: bw=9855KiB/s (10.1MB/s), 2514KiB/s-4195KiB/s (2575kB/s-4296kB/s), io=32.0MiB (33.6MB), run=2929-3325msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191637: Tue Jun 16 22:25:53 2026 read: IOPS=1, BW=6260KiB/s (6410kB/s)(12.0MiB/1963msec) clat (msec): min=227, max=1087, avg=607.22, stdev=438.92 lat (msec): min=227, max=1087, avg=607.22, stdev=438.92 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7907, max= 8126, per=100.00%, avg=8016.50, stdev=154.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=32.67%, ctx=90, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191638: Tue Jun 16 22:25:53 2026 read: IOPS=0, BW=1080KiB/s (1106kB/s)(4096KiB/3791msec) clat (nsec): min=1288.2M, max=1288.2M, avg=1288213347.00, stdev= 0.00 lat (nsec): min=1288.2M, max=1288.2M, avg=1288214318.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2161KiB/s (2213kB/s)(8192KiB/3791msec); 0 zone resets clat (msec): min=659, max=1715, avg=1187.05, stdev=746.75 lat (msec): min=659, max=1717, avg=1188.21, stdev=747.88 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8159, max= 8159, per=94.40%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.59%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191639: Tue Jun 16 22:25:53 2026 write: IOPS=0, BW=3541KiB/s (3626kB/s)(12.0MiB/3470msec); 0 zone resets clat (msec): min=307, max=2138, avg=1109.91, stdev=936.01 lat (msec): min=307, max=2138, avg=1110.16, stdev=935.94 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 8078, max= 8078, per=93.46%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=20.78%, ctx=166, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191640: Tue Jun 16 22:25:53 2026 write: IOPS=0, BW=3999KiB/s (4095kB/s)(12.0MiB/3073msec); 0 zone resets clat (msec): min=298, max=1445, avg=984.11, stdev=605.52 lat (msec): min=298, max=1446, avg=984.35, stdev=605.62 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 5475, max= 8192, per=79.06%, avg=6833.50, stdev=1921.21, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=21.97%, ctx=110, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4322KiB/s (4426kB/s), 1080KiB/s-6260KiB/s (1106kB/s-6410kB/s), io=16.0MiB (16.8MB), run=1963-3791msec WRITE: bw=8644KiB/s (8851kB/s), 2161KiB/s-3999KiB/s (2213kB/s-4095kB/s), io=32.0MiB (33.6MB), run=3073-3791msec