== sanity test 398b: DIO and buffer IO race ============== 22:47:48 (1786762068) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.87473 s, 10.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179557: Fri Aug 14 22:49:46 2026 read: IOPS=14, BW=58.9KiB/s (60.3kB/s)(5992KiB/101808msec) clat (usec): min=44, max=675275, avg=37859.03, stdev=29376.04 lat (usec): min=45, max=675276, avg=37863.00, stdev=29377.12 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11076], 10.00th=[ 14877], 20.00th=[ 20055], | 30.00th=[ 23725], 40.00th=[ 27919], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 52691], 90.00th=[ 65799], 95.00th=[ 80217], | 99.00th=[122160], 99.50th=[154141], 99.90th=[267387], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 127, per=25.09%, avg=58.21, stdev=22.33, samples=201 iops : min= 1, max= 31, avg=13.92, stdev= 5.64, samples=201 write: IOPS=15, BW=61.8KiB/s (63.3kB/s)(6296KiB/101808msec); 0 zone resets clat (usec): min=1119, max=206606, avg=28394.17, stdev=28453.86 lat (usec): min=1120, max=206608, avg=28396.38, stdev=28453.23 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1565], 10.00th=[ 2180], 20.00th=[ 4015], | 30.00th=[ 6915], 40.00th=[ 13042], 50.00th=[ 20841], 60.00th=[ 27395], | 70.00th=[ 35914], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 88605], | 99.00th=[120062], 99.50th=[125305], 99.90th=[179307], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 7, max= 127, per=25.32%, avg=61.52, stdev=26.05, samples=200 iops : min= 1, max= 31, avg=14.76, stdev= 6.55, samples=200 lat (usec) : 50=0.23%, 100=1.07%, 250=0.13%, 500=0.07%, 750=0.10% lat (msec) : 2=4.46%, 4=5.73%, 10=8.79%, 20=13.61%, 50=45.31% lat (msec) : 100=17.87%, 250=2.57%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=6.62%, ctx=6983, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179558: Fri Aug 14 22:49:46 2026 read: IOPS=14, BW=58.1KiB/s (59.5kB/s)(5940KiB/102163msec) clat (usec): min=40, max=211784, avg=37961.00, stdev=24593.59 lat (usec): min=41, max=211784, avg=37963.67, stdev=24592.52 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11994], 10.00th=[ 14877], 20.00th=[ 19268], | 30.00th=[ 23462], 40.00th=[ 27657], 50.00th=[ 32113], 60.00th=[ 36963], | 70.00th=[ 43779], 80.00th=[ 53216], 90.00th=[ 67634], 95.00th=[ 86508], | 99.00th=[119014], 99.50th=[143655], 99.90th=[156238], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 136, per=24.87%, avg=57.70, stdev=20.46, samples=202 iops : min= 1, max= 34, avg=13.80, stdev= 5.14, samples=202 write: IOPS=15, BW=62.1KiB/s (63.6kB/s)(6348KiB/102163msec); 0 zone resets clat (usec): min=1112, max=596773, avg=28613.32, stdev=31351.01 lat (usec): min=1113, max=596775, avg=28618.32, stdev=31353.17 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1582], 10.00th=[ 2180], 20.00th=[ 3818], | 30.00th=[ 7373], 40.00th=[ 14222], 50.00th=[ 20841], 60.00th=[ 27657], | 70.00th=[ 36963], 80.00th=[ 47973], 90.00th=[ 65799], 95.00th=[ 84411], | 99.00th=[127402], 99.50th=[149947], 99.90th=[170918], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 135, per=25.31%, avg=61.50, stdev=26.63, samples=202 iops : min= 1, max= 33, avg=14.75, stdev= 6.72, samples=202 lat (usec) : 50=0.13%, 100=1.27%, 250=0.10% lat (msec) : 2=4.07%, 4=6.61%, 10=7.55%, 20=15.89%, 50=43.68% lat (msec) : 100=17.87%, 250=2.80%, 750=0.03% cpu : usr=0.07%, sys=6.68%, ctx=6920, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179560: Fri Aug 14 22:49:46 2026 read: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6028KiB/103145msec) clat (usec): min=42, max=223746, avg=37308.38, stdev=24320.28 lat (usec): min=42, max=223747, avg=37309.71, stdev=24320.30 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11076], 10.00th=[ 14746], 20.00th=[ 19530], | 30.00th=[ 22938], 40.00th=[ 26870], 50.00th=[ 31589], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 52167], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[122160], 99.50th=[145753], 99.90th=[173016], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 127, per=25.19%, avg=58.43, stdev=22.23, samples=202 iops : min= 1, max= 31, avg=13.98, stdev= 5.60, samples=202 write: IOPS=15, BW=60.7KiB/s (62.1kB/s)(6260KiB/103145msec); 0 zone resets clat (usec): min=1148, max=672627, avg=29697.83, stdev=34432.62 lat (usec): min=1148, max=672628, avg=29704.57, stdev=34431.30 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1614], 10.00th=[ 2409], 20.00th=[ 4359], | 30.00th=[ 7504], 40.00th=[ 14353], 50.00th=[ 21627], 60.00th=[ 28181], | 70.00th=[ 35390], 80.00th=[ 47973], 90.00th=[ 68682], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[168821], 99.90th=[240124], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 151, per=24.80%, avg=60.27, stdev=24.17, samples=203 iops : min= 1, max= 37, avg=14.44, stdev= 6.09, samples=203 lat (usec) : 50=0.23%, 100=1.27%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.94%, 4=5.24%, 10=8.85%, 20=15.17%, 50=44.40% lat (msec) : 100=17.71%, 250=2.93%, 750=0.03% cpu : usr=0.08%, sys=6.55%, ctx=7033, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179562: Fri Aug 14 22:49:46 2026 read: IOPS=14, BW=58.5KiB/s (59.9kB/s)(6052KiB/103395msec) clat (usec): min=34, max=230210, avg=36801.14, stdev=24087.42 lat (usec): min=35, max=230211, avg=36802.79, stdev=24087.29 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10945], 10.00th=[ 14877], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 51643], 90.00th=[ 65274], 95.00th=[ 80217], | 99.00th=[111674], 99.50th=[154141], 99.90th=[208667], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 135, per=25.27%, avg=58.62, stdev=22.87, samples=203 iops : min= 1, max= 33, avg=14.02, stdev= 5.78, samples=203 write: IOPS=15, BW=60.3KiB/s (61.8kB/s)(6236KiB/103395msec); 0 zone resets clat (usec): min=905, max=667577, avg=30354.71, stdev=32779.45 lat (usec): min=906, max=667578, avg=30357.15, stdev=32779.29 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1647], 10.00th=[ 2409], 20.00th=[ 4424], | 30.00th=[ 8848], 40.00th=[ 16712], 50.00th=[ 22676], 60.00th=[ 29230], | 70.00th=[ 39060], 80.00th=[ 50070], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[130548], 99.50th=[147850], 99.90th=[210764], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 127, per=24.86%, avg=60.41, stdev=24.40, samples=203 iops : min= 1, max= 31, avg=14.47, stdev= 6.13, samples=203 lat (usec) : 50=0.23%, 100=1.33%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.65%, 4=5.66%, 10=7.16%, 20=16.05%, 50=44.82% lat (msec) : 100=18.65%, 250=2.18%, 750=0.03% cpu : usr=0.08%, sys=6.52%, ctx=7048, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=232KiB/s (238kB/s), 58.1KiB/s-58.9KiB/s (59.5kB/s-60.3kB/s), io=23.4MiB (24.6MB), run=101808-103395msec WRITE: bw=243KiB/s (249kB/s), 60.3KiB/s-62.1KiB/s (61.8kB/s-63.6kB/s), io=24.6MiB (25.7MB), run=101808-103395msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179559: Fri Aug 14 22:50:17 2026 read: IOPS=11, BW=44.6KiB/s (45.6kB/s)(5992KiB/134477msec) clat (msec): min=5, max=697, avg=34.89, stdev=36.16 lat (msec): min=5, max=697, avg=34.89, stdev=36.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 49], 90.00th=[ 77], 95.00th=[ 106], | 99.00th=[ 167], 99.50th=[ 186], 99.90th=[ 224], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 167, per=24.89%, avg=44.30, stdev=30.43, samples=263 iops : min= 1, max= 41, avg=10.46, stdev= 7.65, samples=263 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6296KiB/134477msec); 0 zone resets clat (msec): min=7, max=310, avg=51.99, stdev=36.36 lat (msec): min=7, max=310, avg=52.00, stdev=36.36 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 61], 80.00th=[ 78], 90.00th=[ 100], 95.00th=[ 124], | 99.00th=[ 178], 99.50th=[ 207], 99.90th=[ 284], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 133, per=25.00%, avg=46.50, stdev=28.23, samples=263 iops : min= 1, max= 33, avg=11.01, stdev= 7.13, samples=263 lat (msec) : 10=3.84%, 20=22.27%, 50=45.05%, 100=20.96%, 250=7.71% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.06%, sys=2.63%, ctx=4982, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179561: Fri Aug 14 22:50:17 2026 read: IOPS=11, BW=44.3KiB/s (45.3kB/s)(5940KiB/134189msec) clat (msec): min=5, max=622, avg=35.29, stdev=36.02 lat (msec): min=5, max=622, avg=35.29, stdev=36.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 79], 95.00th=[ 106], | 99.00th=[ 165], 99.50th=[ 194], 99.90th=[ 220], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 151, per=25.02%, avg=44.54, stdev=30.12, samples=261 iops : min= 1, max= 37, avg=10.52, stdev= 7.59, samples=261 write: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6348KiB/134189msec); 0 zone resets clat (msec): min=9, max=324, avg=51.31, stdev=36.88 lat (msec): min=9, max=324, avg=51.31, stdev=36.88 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 75], 90.00th=[ 99], 95.00th=[ 128], | 99.00th=[ 178], 99.50th=[ 222], 99.90th=[ 264], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 159, per=25.21%, avg=46.89, stdev=28.95, samples=265 iops : min= 1, max= 39, avg=11.11, stdev= 7.29, samples=265 lat (msec) : 10=3.68%, 20=21.94%, 50=46.42%, 100=20.15%, 250=7.62% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.05%, sys=2.69%, ctx=4952, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179563: Fri Aug 14 22:50:17 2026 read: IOPS=11, BW=45.1KiB/s (46.1kB/s)(6028KiB/133800msec) clat (msec): min=5, max=251, avg=35.08, stdev=30.54 lat (msec): min=5, max=251, avg=35.09, stdev=30.54 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 104], | 99.00th=[ 144], 99.50th=[ 159], 99.90th=[ 197], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 7, max= 159, per=25.46%, avg=45.32, stdev=29.33, samples=260 iops : min= 1, max= 39, avg=10.72, stdev= 7.37, samples=260 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6260KiB/133800msec); 0 zone resets clat (msec): min=10, max=645, avg=51.49, stdev=38.27 lat (msec): min=10, max=645, avg=51.49, stdev=38.26 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 59], 80.00th=[ 75], 90.00th=[ 99], 95.00th=[ 125], | 99.00th=[ 178], 99.50th=[ 194], 99.90th=[ 284], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 135, per=25.13%, avg=46.75, stdev=28.71, samples=262 iops : min= 1, max= 33, avg=11.07, stdev= 7.23, samples=262 lat (msec) : 10=3.71%, 20=21.06%, 50=45.70%, 100=22.01%, 250=7.39% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.05%, sys=2.80%, ctx=5041, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179564: Fri Aug 14 22:50:17 2026 read: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6052KiB/133324msec) clat (msec): min=5, max=295, avg=34.19, stdev=31.87 lat (msec): min=5, max=295, avg=34.19, stdev=31.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 80], 95.00th=[ 102], | 99.00th=[ 157], 99.50th=[ 184], 99.90th=[ 207], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 151, per=25.97%, avg=46.23, stdev=29.63, samples=256 iops : min= 1, max= 37, avg=10.94, stdev= 7.46, samples=256 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6236KiB/133324msec); 0 zone resets clat (msec): min=10, max=658, avg=52.12, stdev=39.16 lat (msec): min=10, max=658, avg=52.12, stdev=39.16 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 75], 90.00th=[ 103], 95.00th=[ 125], | 99.00th=[ 180], 99.50th=[ 205], 99.90th=[ 288], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 126, per=24.89%, avg=46.30, stdev=27.76, samples=263 iops : min= 1, max= 31, avg=10.96, stdev= 7.00, samples=263 lat (msec) : 10=3.91%, 20=21.19%, 50=46.74%, 100=20.05%, 250=7.98% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.05%, sys=2.73%, ctx=5062, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=179KiB/s (183kB/s), 44.3KiB/s-45.4KiB/s (45.3kB/s-46.5kB/s), io=23.4MiB (24.6MB), run=133324-134477msec WRITE: bw=187KiB/s (191kB/s), 46.8KiB/s-47.3KiB/s (47.9kB/s-48.4kB/s), io=24.6MiB (25.7MB), run=133324-134477msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179606: Fri Aug 14 22:50:53 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(5920KiB/26452msec) clat (usec): min=32, max=134642, avg=37179.17, stdev=23457.97 lat (usec): min=32, max=134643, avg=37180.45, stdev=23458.06 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 60], 10.00th=[ 108], 20.00th=[ 20579], | 30.00th=[ 25560], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 40109], | 70.00th=[ 45351], 80.00th=[ 55313], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[109577], 99.50th=[112722], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 62, max= 478, per=25.15%, avg=223.33, stdev=80.83, samples=52 iops : min= 3, max= 29, avg=13.21, stdev= 5.07, samples=52 write: IOPS=15, BW=241KiB/s (247kB/s)(6368KiB/26452msec); 0 zone resets clat (usec): min=1868, max=193948, avg=31749.39, stdev=32131.58 lat (usec): min=1870, max=193951, avg=31758.61, stdev=32127.41 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 15], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 78], 95.00th=[ 94], | 99.00th=[ 157], 99.50th=[ 182], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 63, max= 480, per=25.85%, avg=241.42, stdev=92.32, samples=52 iops : min= 3, max= 30, avg=14.35, stdev= 5.85, samples=52 lat (usec) : 50=0.91%, 100=3.39%, 250=0.78%, 500=0.52%, 750=0.13% lat (msec) : 2=0.52%, 4=6.12%, 10=10.68%, 20=10.81%, 50=41.54% lat (msec) : 100=21.35%, 250=3.26% cpu : usr=0.07%, sys=7.39%, ctx=1889, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179607: Fri Aug 14 22:50:53 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5744KiB/26957msec) clat (usec): min=50, max=231986, avg=39231.71, stdev=25687.22 lat (usec): min=50, max=231987, avg=39232.78, stdev=25687.22 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 78], 10.00th=[ 16319], 20.00th=[ 21103], | 30.00th=[ 25822], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 46400], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[121111], 99.50th=[147850], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 62, max= 413, per=24.38%, avg=216.52, stdev=78.83, samples=52 iops : min= 3, max= 25, avg=12.79, stdev= 4.96, samples=52 write: IOPS=15, BW=243KiB/s (249kB/s)(6544KiB/26957msec); 0 zone resets clat (usec): min=1490, max=219789, avg=31377.82, stdev=29910.18 lat (usec): min=1491, max=219791, avg=31399.80, stdev=29895.20 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2671], 10.00th=[ 3884], 20.00th=[ 5932], | 30.00th=[ 9765], 40.00th=[ 16581], 50.00th=[ 23462], 60.00th=[ 29492], | 70.00th=[ 39060], 80.00th=[ 51643], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[122160], 99.50th=[149947], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 95, max= 510, per=25.90%, avg=241.89, stdev=75.35, samples=53 iops : min= 5, max= 31, avg=14.38, stdev= 4.77, samples=53 lat (usec) : 100=2.73%, 250=0.39%, 750=0.13% lat (msec) : 2=1.69%, 4=3.78%, 10=10.94%, 20=12.24%, 50=45.70% lat (msec) : 100=19.66%, 250=2.73% cpu : usr=0.07%, sys=7.35%, ctx=1870, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179608: Fri Aug 14 22:50:53 2026 read: IOPS=14, BW=235KiB/s (241kB/s)(6256KiB/26625msec) clat (usec): min=39, max=146121, avg=37906.12, stdev=23940.01 lat (usec): min=40, max=146194, avg=37907.55, stdev=23940.76 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 10290], 20.00th=[ 20579], | 30.00th=[ 25560], 40.00th=[ 30802], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 53216], 90.00th=[ 65274], 95.00th=[ 82314], | 99.00th=[127402], 99.50th=[137364], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 94, max= 445, per=26.44%, avg=234.81, stdev=82.20, samples=52 iops : min= 5, max= 27, avg=13.94, stdev= 5.21, samples=52 write: IOPS=14, BW=227KiB/s (232kB/s)(6032KiB/26625msec); 0 zone resets clat (usec): min=1637, max=172402, avg=31257.19, stdev=26786.46 lat (usec): min=1639, max=172405, avg=31259.63, stdev=26787.07 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2737], 10.00th=[ 3916], 20.00th=[ 7767], | 30.00th=[ 12125], 40.00th=[ 17695], 50.00th=[ 24249], 60.00th=[ 32375], | 70.00th=[ 41157], 80.00th=[ 50594], 90.00th=[ 66847], 95.00th=[ 80217], | 99.00th=[123208], 99.50th=[139461], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 95, max= 604, per=23.81%, avg=222.37, stdev=87.39, samples=52 iops : min= 5, max= 37, avg=13.15, stdev= 5.47, samples=52 lat (usec) : 50=0.52%, 100=3.78%, 250=0.26%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=4.17%, 10=8.07%, 20=12.76%, 50=46.35% lat (msec) : 100=21.09%, 250=1.95% cpu : usr=0.08%, sys=7.10%, ctx=1976, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179609: Fri Aug 14 22:50:53 2026 read: IOPS=14, BW=238KiB/s (244kB/s)(6032KiB/25350msec) clat (usec): min=33, max=201685, avg=37504.57, stdev=26894.57 lat (usec): min=33, max=201686, avg=37506.79, stdev=26894.54 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 194], 20.00th=[ 19268], | 30.00th=[ 22938], 40.00th=[ 28705], 50.00th=[ 33162], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 54789], 90.00th=[ 66847], 95.00th=[ 81265], | 99.00th=[141558], 99.50th=[158335], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 94, max= 381, per=26.56%, avg=235.86, stdev=69.37, samples=49 iops : min= 5, max= 23, avg=14.00, stdev= 4.34, samples=49 write: IOPS=15, BW=247KiB/s (253kB/s)(6256KiB/25350msec); 0 zone resets clat (usec): min=1596, max=166874, avg=28540.18, stdev=26177.18 lat (usec): min=1597, max=166876, avg=28542.15, stdev=26177.12 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2376], 10.00th=[ 3720], 20.00th=[ 5997], | 30.00th=[ 8979], 40.00th=[ 13829], 50.00th=[ 20317], 60.00th=[ 28967], | 70.00th=[ 36963], 80.00th=[ 49546], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[117965], 99.50th=[130548], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 31, max= 636, per=26.26%, avg=245.22, stdev=109.91, samples=49 iops : min= 1, max= 39, avg=14.57, stdev= 6.95, samples=49 lat (usec) : 50=0.39%, 100=4.17%, 250=0.65%, 500=0.13% lat (msec) : 2=1.17%, 4=5.21%, 10=10.68%, 20=13.41%, 50=41.93% lat (msec) : 100=19.92%, 250=2.34% cpu : usr=0.06%, sys=7.46%, ctx=1910, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=889KiB/s (910kB/s), 213KiB/s-238KiB/s (218kB/s-244kB/s), io=23.4MiB (24.5MB), run=25350-26957msec WRITE: bw=935KiB/s (957kB/s), 227KiB/s-247KiB/s (232kB/s-253kB/s), io=24.6MiB (25.8MB), run=25350-26957msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179601: Fri Aug 14 22:51:01 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5920KiB/34907msec) clat (msec): min=8, max=199, avg=37.52, stdev=31.29 lat (msec): min=8, max=199, avg=37.52, stdev=31.29 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 107], | 99.00th=[ 140], 99.50th=[ 194], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 477, per=24.99%, avg=169.42, stdev=104.74, samples=69 iops : min= 1, max= 29, avg= 9.80, stdev= 6.56, samples=69 write: IOPS=11, BW=182KiB/s (187kB/s)(6368KiB/34907msec); 0 zone resets clat (msec): min=12, max=238, avg=52.54, stdev=35.19 lat (msec): min=12, max=238, avg=52.55, stdev=35.19 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 49], | 70.00th=[ 62], 80.00th=[ 74], 90.00th=[ 100], 95.00th=[ 122], | 99.00th=[ 192], 99.50th=[ 222], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 478, per=25.51%, avg=181.86, stdev=97.12, samples=69 iops : min= 1, max= 29, avg=10.59, stdev= 6.12, samples=69 lat (msec) : 10=0.91%, 20=19.53%, 50=49.09%, 100=22.79%, 250=7.68% cpu : usr=0.04%, sys=2.82%, ctx=1259, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179602: Fri Aug 14 22:51:01 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(5744KiB/35305msec) clat (msec): min=6, max=195, avg=36.77, stdev=30.19 lat (msec): min=6, max=195, avg=36.77, stdev=30.19 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 96], | 99.00th=[ 144], 99.50th=[ 194], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 446, per=23.80%, avg=161.38, stdev=98.62, samples=69 iops : min= 1, max= 27, avg= 9.30, stdev= 6.18, samples=69 write: IOPS=11, BW=185KiB/s (190kB/s)(6544KiB/35305msec); 0 zone resets clat (msec): min=11, max=231, avg=53.77, stdev=34.44 lat (msec): min=11, max=231, avg=53.78, stdev=34.44 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 77], 90.00th=[ 104], 95.00th=[ 117], | 99.00th=[ 178], 99.50th=[ 190], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 509, per=25.46%, avg=181.54, stdev=104.51, samples=69 iops : min= 1, max= 31, avg=10.57, stdev= 6.57, samples=69 lat (msec) : 10=1.82%, 20=17.06%, 50=48.83%, 100=25.00%, 250=7.29% cpu : usr=0.05%, sys=2.76%, ctx=1248, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179603: Fri Aug 14 22:51:01 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34595msec) clat (msec): min=6, max=180, avg=34.54, stdev=26.59 lat (msec): min=6, max=180, avg=34.54, stdev=26.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 70], 95.00th=[ 91], | 99.00th=[ 134], 99.50th=[ 138], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 31, max= 605, per=26.75%, avg=181.34, stdev=122.43, samples=68 iops : min= 1, max= 37, avg=10.56, stdev= 7.68, samples=68 write: IOPS=10, BW=174KiB/s (179kB/s)(6032KiB/34595msec); 0 zone resets clat (msec): min=14, max=244, avg=55.60, stdev=37.32 lat (msec): min=14, max=244, avg=55.62, stdev=37.34 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 81], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 188], 99.50th=[ 209], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 62, max= 478, per=24.19%, avg=172.47, stdev=94.49, samples=68 iops : min= 3, max= 29, avg=10.00, stdev= 5.90, samples=68 lat (msec) : 10=1.56%, 20=20.05%, 50=47.79%, 100=22.66%, 250=7.94% cpu : usr=0.04%, sys=2.99%, ctx=1263, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179604: Fri Aug 14 22:51:01 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(6032KiB/35071msec) clat (msec): min=7, max=199, avg=36.25, stdev=29.41 lat (msec): min=7, max=199, avg=36.26, stdev=29.41 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 99], | 99.00th=[ 153], 99.50th=[ 199], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 478, per=25.42%, avg=172.32, stdev=97.59, samples=68 iops : min= 1, max= 29, avg= 9.99, stdev= 6.13, samples=68 write: IOPS=11, BW=178KiB/s (183kB/s)(6256KiB/35071msec); 0 zone resets clat (msec): min=12, max=229, avg=54.62, stdev=36.39 lat (msec): min=12, max=229, avg=54.63, stdev=36.39 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 79], 90.00th=[ 100], 95.00th=[ 124], | 99.00th=[ 201], 99.50th=[ 222], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 62, max= 540, per=24.85%, avg=177.19, stdev=98.06, samples=69 iops : min= 3, max= 33, avg=10.29, stdev= 6.15, samples=69 lat (msec) : 10=1.04%, 20=18.10%, 50=49.74%, 100=24.09%, 250=7.03% cpu : usr=0.05%, sys=3.05%, ctx=1238, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=678KiB/s (695kB/s), 163KiB/s-181KiB/s (167kB/s-185kB/s), io=23.4MiB (24.5MB), run=34595-35305msec WRITE: bw=714KiB/s (731kB/s), 174KiB/s-185KiB/s (179kB/s-190kB/s), io=24.6MiB (25.8MB), run=34595-35305msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179619: Fri Aug 14 22:51:14 2026 read: IOPS=1, BW=1908KiB/s (1954kB/s)(7168KiB/3757msec) clat (msec): min=64, max=262, avg=171.47, stdev=57.77 lat (msec): min=64, max=263, avg=171.47, stdev=57.77 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 165], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 188], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 1892, max= 4071, per=67.75%, avg=3016.25, stdev=1219.24, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1363KiB/s (1395kB/s)(5120KiB/3757msec); 0 zone resets clat (msec): min=113, max=652, avg=474.55, stdev=209.96 lat (msec): min=113, max=652, avg=474.66, stdev=209.98 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2039, max= 4096, per=43.71%, avg=2724.67, stdev=1187.61, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=33.33% cpu : usr=0.08%, sys=6.04%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179620: Fri Aug 14 22:51:14 2026 read: IOPS=0, BW=445KiB/s (456kB/s)(2048KiB/4600msec) clat (msec): min=84, max=231, avg=158.03, stdev=104.19 lat (msec): min=84, max=231, avg=158.03, stdev=104.19 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 85], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 1988, max= 2031, per=45.14%, avg=2009.50, stdev=30.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2226KiB/s (2280kB/s)(10.0MiB/4600msec); 0 zone resets clat (msec): min=72, max=881, avg=399.96, stdev=261.84 lat (msec): min=72, max=881, avg=400.04, stdev=261.84 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 163], | 30.00th=[ 171], 40.00th=[ 211], 50.00th=[ 305], 60.00th=[ 439], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 701], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2019, max= 6071, per=41.89%, avg=2611.14, stdev=1525.68, samples=7 iops : min= 1, max= 5, avg= 1.71, stdev= 1.50, samples=7 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.04%, sys=7.83%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179621: Fri Aug 14 22:51:14 2026 read: IOPS=1, BW=1705KiB/s (1746kB/s)(6144KiB/3603msec) clat (msec): min=101, max=496, avg=229.32, stdev=150.62 lat (msec): min=101, max=496, avg=229.32, stdev=150.62 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 251], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2035, max= 4071, per=57.19%, avg=2546.00, stdev=1016.67, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1705KiB/s (1746kB/s)(6144KiB/3603msec); 0 zone resets clat (msec): min=116, max=651, avg=360.03, stdev=194.28 lat (msec): min=117, max=652, avg=360.25, stdev=194.29 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 376], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1980, max= 4071, per=39.05%, avg=2433.80, stdev=915.60, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=6.47%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179622: Fri Aug 14 22:51:14 2026 read: IOPS=1, BW=1191KiB/s (1220kB/s)(5120KiB/4299msec) clat (msec): min=80, max=532, avg=233.59, stdev=180.37 lat (msec): min=80, max=532, avg=233.59, stdev=180.37 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2039, max= 4063, per=61.02%, avg=2716.67, stdev=1165.97, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1667KiB/s (1707kB/s)(7168KiB/4299msec); 0 zone resets clat (msec): min=176, max=800, avg=414.69, stdev=189.77 lat (msec): min=176, max=800, avg=414.85, stdev=189.74 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 342], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 401], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 422], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2039, max= 4071, per=48.92%, avg=3049.25, stdev=1161.42, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=6.47%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4452KiB/s (4559kB/s), 445KiB/s-1908KiB/s (456kB/s-1954kB/s), io=20.0MiB (20.0MB), run=3603-4600msec WRITE: bw=6233KiB/s (6383kB/s), 1363KiB/s-2226KiB/s (1395kB/s-2280kB/s), io=28.0MiB (29.4MB), run=3603-4600msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179624: Fri Aug 14 22:51:14 2026 read: IOPS=2, BW=2802KiB/s (2869kB/s)(7168KiB/2558msec) clat (usec): min=569, max=319765, avg=155922.62, stdev=94347.12 lat (usec): min=571, max=319766, avg=155924.09, stdev=94346.77 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[131597], | 30.00th=[141558], 40.00th=[141558], 50.00th=[147850], 60.00th=[154141], | 70.00th=[154141], 80.00th=[196084], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 1783, max= 5555, per=65.00%, avg=2839.25, stdev=1813.77, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=2002KiB/s (2050kB/s)(5120KiB/2558msec); 0 zone resets clat (msec): min=119, max=472, avg=283.29, stdev=158.23 lat (msec): min=119, max=472, avg=283.79, stdev=158.72 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2035, max= 5351, per=60.38%, avg=3693.00, stdev=2344.77, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.08%, sys=28.20%, ctx=233, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179625: Fri Aug 14 22:51:14 2026 read: IOPS=0, BW=437KiB/s (447kB/s)(2048KiB/4688msec) clat (usec): min=513, max=312985, avg=156749.67, stdev=220951.54 lat (usec): min=514, max=312987, avg=156750.72, stdev=220951.71 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 515], 60.00th=[312476], | 70.00th=[312476], 80.00th=[312476], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2035, max= 2043, per=46.68%, avg=2039.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2184KiB/s (2237kB/s)(10.0MiB/4688msec); 0 zone resets clat (msec): min=121, max=787, avg=410.78, stdev=246.61 lat (msec): min=122, max=787, avg=410.85, stdev=246.61 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 131], | 30.00th=[ 176], 40.00th=[ 326], 50.00th=[ 330], 60.00th=[ 380], | 70.00th=[ 472], 80.00th=[ 634], 90.00th=[ 760], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1783, max= 6119, per=42.10%, avg=2574.57, stdev=1565.66, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=18.20%, ctx=207, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179626: Fri Aug 14 22:51:14 2026 read: IOPS=1, BW=1574KiB/s (1612kB/s)(6144KiB/3903msec) clat (usec): min=1446, max=667967, avg=204335.37, stdev=254271.34 lat (usec): min=1448, max=667968, avg=204336.64, stdev=254271.05 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1450], 10.00th=[ 1450], 20.00th=[ 4080], | 30.00th=[ 4080], 40.00th=[112722], 50.00th=[112722], 60.00th=[124257], | 70.00th=[316670], 80.00th=[316670], 90.00th=[666895], 95.00th=[666895], | 99.00th=[666895], 99.50th=[666895], 99.90th=[666895], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 1984, max= 5896, per=75.72%, avg=3307.67, stdev=2241.76, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1574KiB/s (1612kB/s)(6144KiB/3903msec); 0 zone resets clat (msec): min=155, max=793, avg=425.50, stdev=214.15 lat (msec): min=155, max=793, avg=425.63, stdev=214.24 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 443], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1858, max= 2043, per=32.33%, avg=1977.00, stdev=74.29, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 2=8.33%, 10=8.33%, 250=25.00%, 500=41.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=15.79%, ctx=143, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179627: Fri Aug 14 22:51:14 2026 read: IOPS=1, BW=1390KiB/s (1424kB/s)(5120KiB/3683msec) clat (usec): min=417, max=190067, avg=45512.95, stdev=82257.82 lat (usec): min=418, max=190068, avg=45513.76, stdev=82257.93 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], 20.00th=[ 416], | 30.00th=[ 478], 40.00th=[ 478], 50.00th=[ 603], 60.00th=[ 603], | 70.00th=[ 35914], 80.00th=[ 35914], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1946KiB/s (1993kB/s)(7168KiB/3683msec); 0 zone resets clat (msec): min=199, max=633, avg=467.82, stdev=156.12 lat (msec): min=199, max=633, avg=467.89, stdev=156.14 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 372], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 502], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 600], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1783, max= 4087, per=37.87%, avg=2316.17, stdev=872.63, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 50=8.33%, 250=16.67%, 500=16.67%, 750=33.33% cpu : usr=0.00%, sys=19.77%, ctx=248, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4369KiB/s (4473kB/s), 437KiB/s-2802KiB/s (447kB/s-2869kB/s), io=20.0MiB (20.0MB), run=2558-4688msec WRITE: bw=6116KiB/s (6263kB/s), 1574KiB/s-2184KiB/s (1612kB/s-2237kB/s), io=28.0MiB (29.4MB), run=2558-4688msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179633: Fri Aug 14 22:51:28 2026 read: IOPS=0, BW=2556KiB/s (2617kB/s)(12.0MiB/4808msec) clat (msec): min=696, max=2901, avg=1512.71, stdev=1208.96 lat (msec): min=696, max=2901, avg=1512.71, stdev=1208.96 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=11.05%, ctx=812, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179634: Fri Aug 14 22:51:28 2026 read: IOPS=0, BW=910KiB/s (932kB/s)(4096KiB/4500msec) clat (nsec): min=2905.9M, max=2905.9M, avg=2905920118.00, stdev= 0.00 lat (nsec): min=2905.9M, max=2905.9M, avg=2905922643.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2903], 5.00th=[ 2903], 10.00th=[ 2903], 20.00th=[ 2903], | 30.00th=[ 2903], 40.00th=[ 2903], 50.00th=[ 2903], 60.00th=[ 2903], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1820KiB/s (1864kB/s)(8192KiB/4500msec); 0 zone resets clat (msec): min=488, max=809, avg=648.81, stdev=227.41 lat (msec): min=488, max=811, avg=649.82, stdev=228.32 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.09%, sys=5.91%, ctx=429, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179635: Fri Aug 14 22:51:28 2026 write: IOPS=0, BW=2471KiB/s (2531kB/s)(12.0MiB/4972msec); 0 zone resets clat (msec): min=796, max=3070, avg=1554.72, stdev=1312.86 lat (msec): min=797, max=3071, avg=1555.20, stdev=1313.07 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.89%, ctx=131, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179636: Fri Aug 14 22:51:28 2026 write: IOPS=0, BW=3286KiB/s (3365kB/s)(12.0MiB/3739msec); 0 zone resets clat (msec): min=212, max=2854, avg=1159.03, stdev=1471.63 lat (msec): min=213, max=2854, avg=1159.38, stdev=1471.64 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 6086, max= 8159, per=100.00%, avg=7122.50, stdev=1465.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=4.20%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3408KiB/s (3489kB/s), 910KiB/s-2556KiB/s (932kB/s-2617kB/s), io=16.0MiB (16.8MB), run=4500-4808msec WRITE: bw=6591KiB/s (6749kB/s), 1820KiB/s-3286KiB/s (1864kB/s-3365kB/s), io=32.0MiB (33.6MB), run=3739-4972msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179638: Fri Aug 14 22:51:29 2026 read: IOPS=0, BW=2786KiB/s (2853kB/s)(12.0MiB/4411msec) clat (msec): min=416, max=2997, avg=1452.35, stdev=1363.47 lat (msec): min=416, max=2997, avg=1452.36, stdev=1363.47 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.15%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179639: Fri Aug 14 22:51:29 2026 read: IOPS=0, BW=950KiB/s (973kB/s)(4096KiB/4312msec) clat (nsec): min=3458.2M, max=3458.2M, avg=3458231875.00, stdev= 0.00 lat (nsec): min=3458.2M, max=3458.2M, avg=3458233874.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3473], 5.00th=[ 3473], 10.00th=[ 3473], 20.00th=[ 3473], | 30.00th=[ 3473], 40.00th=[ 3473], 50.00th=[ 3473], 60.00th=[ 3473], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1900KiB/s (1945kB/s)(8192KiB/4312msec); 0 zone resets clat (msec): min=172, max=676, avg=424.82, stdev=356.32 lat (msec): min=173, max=678, avg=426.02, stdev=356.55 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.53%, ctx=54, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179640: Fri Aug 14 22:51:29 2026 write: IOPS=0, BW=2744KiB/s (2810kB/s)(12.0MiB/4478msec); 0 zone resets clat (msec): min=313, max=3253, avg=1485.17, stdev=1558.10 lat (msec): min=313, max=3253, avg=1485.64, stdev=1558.24 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=2.26%, ctx=36, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179641: Fri Aug 14 22:51:29 2026 write: IOPS=0, BW=3322KiB/s (3402kB/s)(12.0MiB/3699msec); 0 zone resets clat (msec): min=127, max=3423, avg=1231.96, stdev=1898.12 lat (msec): min=127, max=3424, avg=1232.39, stdev=1898.46 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min=15937, max=15937, per=100.00%, avg=15937.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.87%, ctx=35, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3714KiB/s (3803kB/s), 950KiB/s-2786KiB/s (973kB/s-2853kB/s), io=16.0MiB (16.8MB), run=4312-4411msec WRITE: bw=7318KiB/s (7493kB/s), 1900KiB/s-3322KiB/s (1945kB/s-3402kB/s), io=32.0MiB (33.6MB), run=3699-4478msec