== sanity test 398b: DIO and buffer IO race ============== 22:35:20 (1788834920) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.49054 s, 7.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182487: Mon Sep 7 22:37:30 2026 read: IOPS=13, BW=54.2KiB/s (55.5kB/s)(5992KiB/110625msec) clat (usec): min=35, max=948002, avg=41254.71, stdev=36022.51 lat (usec): min=35, max=948003, avg=41256.14, stdev=36022.32 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 10552], 10.00th=[ 15139], 20.00th=[ 20055], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 47973], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[139461], 99.50th=[162530], 99.90th=[258999], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 5, max= 119, per=25.02%, avg=53.79, stdev=20.58, samples=218 iops : min= 1, max= 29, avg=12.78, stdev= 5.17, samples=218 write: IOPS=14, BW=56.9KiB/s (58.3kB/s)(6296KiB/110625msec); 0 zone resets clat (usec): min=813, max=234445, avg=30750.58, stdev=32456.35 lat (usec): min=814, max=234447, avg=30761.22, stdev=32450.27 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1369], 20.00th=[ 3163], | 30.00th=[ 6325], 40.00th=[ 13829], 50.00th=[ 21890], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[162530], 99.90th=[210764], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 134, per=25.34%, avg=57.00, stdev=23.32, samples=216 iops : min= 1, max= 33, avg=13.58, stdev= 5.85, samples=216 lat (usec) : 50=0.13%, 100=1.40%, 250=0.03%, 500=0.10%, 1000=0.16% lat (msec) : 2=7.32%, 4=4.43%, 10=7.26%, 20=13.25%, 50=41.50% lat (msec) : 100=20.74%, 250=3.55%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.41%, ctx=6371, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182490: Mon Sep 7 22:37:30 2026 read: IOPS=13, BW=54.7KiB/s (55.0kB/s)(5940KiB/108670msec) clat (usec): min=35, max=263664, avg=39426.92, stdev=26745.19 lat (usec): min=35, max=263666, avg=39428.15, stdev=26745.27 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10290], 10.00th=[ 14746], 20.00th=[ 19530], | 30.00th=[ 24249], 40.00th=[ 28443], 50.00th=[ 32900], 60.00th=[ 39584], | 70.00th=[ 46924], 80.00th=[ 56361], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[131597], 99.50th=[170918], 99.90th=[210764], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 5, max= 111, per=25.34%, avg=54.49, stdev=20.43, samples=213 iops : min= 1, max= 27, avg=12.95, stdev= 5.13, samples=213 write: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6348KiB/108670msec); 0 zone resets clat (usec): min=707, max=926042, avg=31313.16, stdev=39242.96 lat (usec): min=707, max=926043, avg=31315.63, stdev=39242.99 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1385], 20.00th=[ 2966], | 30.00th=[ 6718], 40.00th=[ 13829], 50.00th=[ 20841], 60.00th=[ 30016], | 70.00th=[ 40633], 80.00th=[ 53740], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[160433], 99.90th=[212861], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 159, per=25.83%, avg=58.11, stdev=23.79, samples=213 iops : min= 1, max= 39, avg=13.87, stdev= 5.95, samples=213 lat (usec) : 50=0.20%, 100=1.37%, 250=0.10%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=7.85%, 4=4.17%, 10=6.71%, 20=14.19%, 50=40.95% lat (msec) : 100=20.67%, 250=3.45%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.52%, ctx=6353, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182492: Mon Sep 7 22:37:30 2026 read: IOPS=13, BW=54.0KiB/s (56.3kB/s)(6028KiB/109669msec) clat (usec): min=33, max=270368, avg=39901.29, stdev=26826.57 lat (usec): min=34, max=270369, avg=39904.89, stdev=26827.00 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10552], 10.00th=[ 14353], 20.00th=[ 19792], | 30.00th=[ 24511], 40.00th=[ 29492], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[166724], 99.90th=[198181], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 8, max= 133, per=25.55%, avg=54.94, stdev=20.58, samples=215 iops : min= 2, max= 33, avg=13.06, stdev= 5.15, samples=215 write: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6260KiB/109669msec); 0 zone resets clat (usec): min=812, max=877352, avg=31356.45, stdev=38430.33 lat (usec): min=813, max=877356, avg=31359.33, stdev=38431.21 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1483], 20.00th=[ 3294], | 30.00th=[ 6521], 40.00th=[ 14484], 50.00th=[ 22152], 60.00th=[ 30016], | 70.00th=[ 38536], 80.00th=[ 53740], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[130548], 99.50th=[149947], 99.90th=[252707], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 143, per=25.34%, avg=57.02, stdev=23.29, samples=215 iops : min= 1, max= 35, avg=13.59, stdev= 5.85, samples=215 lat (usec) : 50=0.23%, 100=1.24%, 250=0.23%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=6.38%, 4=5.11%, 10=7.00%, 20=13.57%, 50=41.60% lat (msec) : 100=20.67%, 250=3.52%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.35%, ctx=6405, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182494: Mon Sep 7 22:37:30 2026 read: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6052KiB/111625msec) clat (usec): min=36, max=248260, avg=39728.36, stdev=24665.34 lat (usec): min=43, max=248261, avg=39731.98, stdev=24664.86 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10290], 10.00th=[ 15139], 20.00th=[ 20317], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 56886], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[113771], 99.50th=[145753], 99.90th=[202376], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 119, per=25.24%, avg=54.27, stdev=18.85, samples=218 iops : min= 1, max= 29, avg=12.90, stdev= 4.72, samples=218 write: IOPS=13, BW=55.9KiB/s (57.2kB/s)(6236KiB/111625msec); 0 zone resets clat (usec): min=693, max=964571, avg=32762.60, stdev=40712.00 lat (usec): min=694, max=964572, avg=32764.82, stdev=40712.12 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1418], 20.00th=[ 3687], | 30.00th=[ 6849], 40.00th=[ 14484], 50.00th=[ 22938], 60.00th=[ 31851], | 70.00th=[ 41681], 80.00th=[ 56361], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[143655], 99.50th=[164627], 99.90th=[299893], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 111, per=24.73%, avg=55.64, stdev=20.56, samples=219 iops : min= 1, max= 27, avg=13.24, stdev= 5.16, samples=219 lat (usec) : 50=0.29%, 100=1.50%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.36% lat (msec) : 2=6.67%, 4=3.78%, 10=7.42%, 20=13.02%, 50=41.73% lat (msec) : 100=21.61%, 250=3.39%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.39%, ctx=6362, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=215KiB/s (220kB/s), 54.2KiB/s-54.0KiB/s (55.5kB/s-56.3kB/s), io=23.4MiB (24.6MB), run=108670-111625msec WRITE: bw=225KiB/s (231kB/s), 55.9KiB/s-58.4KiB/s (57.2kB/s-59.8kB/s), io=24.6MiB (25.7MB), run=108670-111625msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182488: Mon Sep 7 22:38:07 2026 read: IOPS=10, BW=40.5KiB/s (41.5kB/s)(5992KiB/147988msec) clat (msec): min=4, max=947, avg=38.61, stdev=41.17 lat (msec): min=4, max=947, avg=38.61, stdev=41.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 58], 90.00th=[ 86], 95.00th=[ 113], | 99.00th=[ 161], 99.50th=[ 186], 99.90th=[ 271], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 149, per=25.12%, avg=40.45, stdev=26.79, samples=287 iops : min= 1, max= 37, avg= 9.44, stdev= 6.72, samples=287 write: IOPS=10, BW=42.5KiB/s (43.6kB/s)(6296KiB/147988msec); 0 zone resets clat (msec): min=11, max=329, avg=57.04, stdev=39.20 lat (msec): min=11, max=329, avg=57.05, stdev=39.20 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 222], 99.90th=[ 264], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 125, per=25.22%, avg=42.62, stdev=24.94, samples=287 iops : min= 1, max= 31, avg= 9.98, stdev= 6.27, samples=287 lat (msec) : 10=3.09%, 20=17.87%, 50=46.29%, 100=22.82%, 250=9.77% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=1.91%, ctx=4848, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182489: Mon Sep 7 22:38:07 2026 read: IOPS=9, BW=39.0KiB/s (40.9kB/s)(5940KiB/148539msec) clat (msec): min=4, max=906, avg=39.32, stdev=42.47 lat (msec): min=4, max=906, avg=39.32, stdev=42.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 58], 90.00th=[ 91], 95.00th=[ 115], | 99.00th=[ 174], 99.50th=[ 209], 99.90th=[ 288], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 134, per=25.16%, avg=40.51, stdev=27.31, samples=284 iops : min= 1, max= 33, avg= 9.46, stdev= 6.86, samples=284 write: IOPS=10, BW=42.7KiB/s (43.8kB/s)(6348KiB/148539msec); 0 zone resets clat (msec): min=9, max=297, avg=56.55, stdev=38.47 lat (msec): min=9, max=297, avg=56.56, stdev=38.47 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 83], 90.00th=[ 108], 95.00th=[ 134], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 288], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 119, per=25.02%, avg=42.29, stdev=24.78, samples=290 iops : min= 1, max= 29, avg= 9.91, stdev= 6.23, samples=290 lat (msec) : 10=3.61%, 20=17.35%, 50=45.38%, 100=23.21%, 250=10.19% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=1.83%, ctx=4687, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182491: Mon Sep 7 22:38:07 2026 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6028KiB/148435msec) clat (msec): min=5, max=254, avg=38.45, stdev=34.02 lat (msec): min=5, max=254, avg=38.45, stdev=34.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 88], 95.00th=[ 113], | 99.00th=[ 163], 99.50th=[ 180], 99.90th=[ 234], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 127, per=25.43%, avg=40.94, stdev=25.42, samples=286 iops : min= 1, max= 31, avg= 9.56, stdev= 6.39, samples=286 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6260KiB/148435msec); 0 zone resets clat (msec): min=10, max=954, avg=57.56, stdev=45.06 lat (msec): min=10, max=954, avg=57.57, stdev=45.06 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 85], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 199], 99.50th=[ 218], 99.90th=[ 296], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 125, per=24.96%, avg=42.18, stdev=24.85, samples=288 iops : min= 1, max= 31, avg= 9.88, stdev= 6.25, samples=288 lat (msec) : 10=2.57%, 20=17.84%, 50=46.84%, 100=22.92%, 250=9.64% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=1.85%, ctx=4781, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182493: Mon Sep 7 22:38:07 2026 read: IOPS=10, BW=40.9KiB/s (41.9kB/s)(6052KiB/147796msec) clat (msec): min=5, max=292, avg=37.93, stdev=35.70 lat (msec): min=5, max=292, avg=37.94, stdev=35.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 167], 99.50th=[ 211], 99.90th=[ 279], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 151, per=26.20%, avg=42.18, stdev=27.48, samples=280 iops : min= 1, max= 37, avg= 9.87, stdev= 6.89, samples=280 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6236KiB/147796msec); 0 zone resets clat (msec): min=11, max=936, avg=57.75, stdev=45.15 lat (msec): min=11, max=936, avg=57.76, stdev=45.15 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 110], 95.00th=[ 138], | 99.00th=[ 199], 99.50th=[ 228], 99.90th=[ 334], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=42.15, stdev=24.62, samples=288 iops : min= 1, max= 29, avg= 9.87, stdev= 6.19, samples=288 lat (msec) : 10=2.57%, 20=18.42%, 50=46.65%, 100=22.40%, 250=9.77% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=1.89%, ctx=4728, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=162KiB/s (166kB/s), 39.0KiB/s-40.9KiB/s (40.9kB/s-41.9kB/s), io=23.4MiB (24.6MB), run=147796-148539msec WRITE: bw=169KiB/s (173kB/s), 42.2KiB/s-42.7KiB/s (43.2kB/s-43.8kB/s), io=24.6MiB (25.7MB), run=147796-148539msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182532: Mon Sep 7 22:38:55 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5920KiB/35187msec) clat (usec): min=36, max=270181, avg=50775.56, stdev=35145.36 lat (usec): min=36, max=270183, avg=50776.69, stdev=35145.42 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 6259], 20.00th=[ 24511], | 30.00th=[ 33162], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[110625], | 99.00th=[162530], 99.50th=[196084], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 62, max= 318, per=25.00%, avg=165.53, stdev=61.58, samples=68 iops : min= 3, max= 19, avg= 9.57, stdev= 3.90, samples=68 write: IOPS=11, BW=181KiB/s (185kB/s)(6368KiB/35187msec); 0 zone resets clat (usec): min=1328, max=291153, avg=40262.73, stdev=41532.73 lat (usec): min=1331, max=291155, avg=40274.84, stdev=41548.61 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1909], 10.00th=[ 2933], 20.00th=[ 5276], | 30.00th=[ 9765], 40.00th=[ 17957], 50.00th=[ 27657], 60.00th=[ 38536], | 70.00th=[ 52167], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[185598], 99.50th=[240124], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 377, per=25.92%, avg=180.65, stdev=72.69, samples=68 iops : min= 1, max= 23, avg=10.53, stdev= 4.63, samples=68 lat (usec) : 50=0.13%, 100=3.39%, 250=0.52%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.12%, 4=5.34%, 10=7.68%, 20=7.94%, 50=33.20% lat (msec) : 100=30.21%, 250=7.68%, 500=0.26% cpu : usr=0.07%, sys=5.16%, ctx=1707, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182533: Mon Sep 7 22:38:55 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5744KiB/36148msec) clat (usec): min=44, max=196370, avg=50274.49, stdev=32543.61 lat (usec): min=44, max=196371, avg=50275.65, stdev=32543.58 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 75], 10.00th=[ 18220], 20.00th=[ 26608], | 30.00th=[ 33162], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 51643], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[162530], 99.50th=[181404], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 22, max= 351, per=23.75%, avg=157.23, stdev=74.82, samples=70 iops : min= 1, max= 21, avg= 9.04, stdev= 4.70, samples=70 write: IOPS=11, BW=181KiB/s (185kB/s)(6544KiB/36148msec); 0 zone resets clat (usec): min=1485, max=369267, avg=43300.25, stdev=46113.91 lat (usec): min=1487, max=369269, avg=43303.74, stdev=46113.33 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1844], 10.00th=[ 3130], 20.00th=[ 7111], | 30.00th=[ 10945], 40.00th=[ 19792], 50.00th=[ 29492], 60.00th=[ 39584], | 70.00th=[ 53740], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[125305], | 99.00th=[191890], 99.50th=[206570], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 31, max= 384, per=25.54%, avg=178.01, stdev=78.41, samples=70 iops : min= 1, max= 24, avg=10.34, stdev= 5.00, samples=70 lat (usec) : 50=0.26%, 100=2.21%, 250=0.26%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.65%, 4=3.12%, 10=7.81%, 20=9.51%, 50=35.55% lat (msec) : 100=27.99%, 250=9.11%, 500=0.26% cpu : usr=0.08%, sys=4.90%, ctx=1669, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182534: Mon Sep 7 22:38:55 2026 read: IOPS=10, BW=175KiB/s (180kB/s)(6256KiB/35662msec) clat (usec): min=38, max=236537, avg=50790.95, stdev=36623.29 lat (usec): min=38, max=236538, avg=50792.19, stdev=36623.26 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 61], 10.00th=[ 15008], 20.00th=[ 24511], | 30.00th=[ 31065], 40.00th=[ 38536], 50.00th=[ 43779], 60.00th=[ 52167], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[110625], | 99.00th=[200279], 99.50th=[225444], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 62, max= 316, per=26.64%, avg=176.38, stdev=59.99, samples=69 iops : min= 3, max= 19, avg=10.26, stdev= 3.83, samples=69 write: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35662msec); 0 zone resets clat (usec): min=1378, max=245761, avg=41229.22, stdev=40775.79 lat (usec): min=1378, max=245764, avg=41233.87, stdev=40774.98 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1909], 10.00th=[ 3851], 20.00th=[ 7635], | 30.00th=[ 14484], 40.00th=[ 19530], 50.00th=[ 29754], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 66847], 90.00th=[103285], 95.00th=[121111], | 99.00th=[202376], 99.50th=[223347], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 60, max= 318, per=24.30%, avg=169.37, stdev=65.15, samples=68 iops : min= 3, max= 19, avg= 9.81, stdev= 4.09, samples=68 lat (usec) : 50=0.91%, 100=3.12%, 250=0.65% lat (msec) : 2=2.86%, 4=2.60%, 10=5.99%, 20=11.46%, 50=36.33% lat (msec) : 100=26.56%, 250=9.51% cpu : usr=0.06%, sys=4.91%, ctx=1699, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182535: Mon Sep 7 22:38:55 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34674msec) clat (usec): min=39, max=179116, avg=46635.42, stdev=33112.58 lat (usec): min=39, max=179117, avg=46636.52, stdev=33112.60 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 71], 20.00th=[ 23200], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 43254], 60.00th=[ 49546], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[149947], 99.50th=[168821], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 63, max= 384, per=25.85%, avg=171.15, stdev=67.54, samples=67 iops : min= 3, max= 24, avg= 9.93, stdev= 4.28, samples=67 write: IOPS=11, BW=180KiB/s (185kB/s)(6256KiB/34674msec); 0 zone resets clat (usec): min=1166, max=297389, avg=43466.70, stdev=44893.25 lat (usec): min=1169, max=297391, avg=43468.87, stdev=44893.35 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1909], 10.00th=[ 3359], 20.00th=[ 6915], | 30.00th=[ 11469], 40.00th=[ 20055], 50.00th=[ 29754], 60.00th=[ 41157], | 70.00th=[ 53216], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[124257], | 99.00th=[225444], 99.50th=[274727], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 62, max= 382, per=25.66%, avg=178.88, stdev=68.99, samples=67 iops : min= 3, max= 23, avg=10.40, stdev= 4.38, samples=67 lat (usec) : 50=0.65%, 100=5.60%, 250=0.39% lat (msec) : 2=3.12%, 4=3.12%, 10=7.42%, 20=7.68%, 50=36.46% lat (msec) : 100=26.82%, 250=8.46%, 500=0.26% cpu : usr=0.09%, sys=5.04%, ctx=1555, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=663KiB/s (679kB/s), 159KiB/s-175KiB/s (163kB/s-180kB/s), io=23.4MiB (24.5MB), run=34674-36148msec WRITE: bw=697KiB/s (714kB/s), 169KiB/s-181KiB/s (173kB/s-185kB/s), io=24.6MiB (25.8MB), run=34674-36148msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182536: Mon Sep 7 22:39:08 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5920KiB/47617msec) clat (msec): min=6, max=294, avg=48.21, stdev=42.42 lat (msec): min=6, max=294, avg=48.21, stdev=42.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 49], 80.00th=[ 68], 90.00th=[ 105], 95.00th=[ 146], | 99.00th=[ 201], 99.50th=[ 232], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 415, per=26.57%, avg=131.26, stdev=86.68, samples=89 iops : min= 1, max= 25, avg= 7.38, stdev= 5.49, samples=89 write: IOPS=8, BW=134KiB/s (137kB/s)(6368KiB/47617msec); 0 zone resets clat (msec): min=10, max=352, avg=74.09, stdev=50.03 lat (msec): min=10, max=352, avg=74.11, stdev=50.02 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 67], | 70.00th=[ 84], 80.00th=[ 111], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 230], 99.50th=[ 305], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 29, max= 447, per=25.66%, avg=133.44, stdev=79.32, samples=94 iops : min= 1, max= 27, avg= 7.52, stdev= 5.00, samples=94 lat (msec) : 10=1.04%, 20=11.07%, 50=44.53%, 100=24.87%, 250=18.10% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=1.58%, ctx=1177, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182537: Mon Sep 7 22:39:08 2026 read: IOPS=7, BW=119KiB/s (121kB/s)(5744KiB/48431msec) clat (msec): min=7, max=319, avg=49.87, stdev=47.41 lat (msec): min=7, max=319, avg=49.87, stdev=47.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 54], 80.00th=[ 69], 90.00th=[ 117], 95.00th=[ 165], | 99.00th=[ 218], 99.50th=[ 241], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 29, max= 378, per=25.42%, avg=125.56, stdev=81.26, samples=88 iops : min= 1, max= 23, avg= 7.03, stdev= 5.12, samples=88 write: IOPS=8, BW=135KiB/s (138kB/s)(6544KiB/48431msec); 0 zone resets clat (msec): min=12, max=371, avg=74.22, stdev=55.41 lat (msec): min=12, max=371, avg=74.22, stdev=55.41 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 67], | 70.00th=[ 83], 80.00th=[ 113], 90.00th=[ 148], 95.00th=[ 180], | 99.00th=[ 264], 99.50th=[ 347], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 436, per=25.89%, avg=134.63, stdev=83.72, samples=93 iops : min= 1, max= 27, avg= 7.61, stdev= 5.29, samples=93 lat (msec) : 10=0.91%, 20=12.50%, 50=39.71%, 100=29.30%, 250=16.80% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.66%, ctx=1260, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182538: Mon Sep 7 22:39:08 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(6256KiB/47362msec) clat (msec): min=8, max=286, avg=50.25, stdev=45.41 lat (msec): min=8, max=286, avg=50.25, stdev=45.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 113], 95.00th=[ 155], | 99.00th=[ 199], 99.50th=[ 259], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 448, per=27.11%, avg=133.95, stdev=97.92, samples=92 iops : min= 1, max= 28, avg= 7.55, stdev= 6.22, samples=92 write: IOPS=7, BW=127KiB/s (130kB/s)(6032KiB/47362msec); 0 zone resets clat (msec): min=15, max=361, avg=72.57, stdev=50.00 lat (msec): min=15, max=361, avg=72.58, stdev=50.01 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 67], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 142], 95.00th=[ 171], | 99.00th=[ 245], 99.50th=[ 300], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 383, per=24.68%, avg=128.35, stdev=73.73, samples=91 iops : min= 1, max= 23, avg= 7.21, stdev= 4.62, samples=91 lat (msec) : 10=1.17%, 20=11.07%, 50=44.27%, 100=25.91%, 250=16.93% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.56%, ctx=1192, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182539: Mon Sep 7 22:39:08 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6032KiB/48085msec) clat (msec): min=6, max=319, avg=52.19, stdev=49.99 lat (msec): min=6, max=319, avg=52.19, stdev=49.99 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 120], 95.00th=[ 169], | 99.00th=[ 230], 99.50th=[ 275], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 542, per=26.09%, avg=128.87, stdev=83.66, samples=90 iops : min= 1, max= 33, avg= 7.23, stdev= 5.27, samples=90 write: IOPS=8, BW=130KiB/s (133kB/s)(6256KiB/48085msec); 0 zone resets clat (msec): min=14, max=364, avg=71.94, stdev=50.06 lat (msec): min=14, max=364, avg=71.94, stdev=50.06 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 140], 95.00th=[ 165], | 99.00th=[ 253], 99.50th=[ 351], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 378, per=25.49%, avg=132.54, stdev=72.78, samples=91 iops : min= 1, max= 23, avg= 7.47, stdev= 4.61, samples=91 lat (msec) : 10=0.52%, 20=9.24%, 50=45.18%, 100=28.78%, 250=15.36% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.68%, ctx=1208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=495KiB/s (506kB/s), 119KiB/s-132KiB/s (121kB/s-135kB/s), io=23.4MiB (24.5MB), run=47362-48431msec WRITE: bw=520KiB/s (533kB/s), 127KiB/s-135KiB/s (130kB/s-138kB/s), io=24.6MiB (25.8MB), run=47362-48431msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182557: Mon Sep 7 22:39:27 2026 read: IOPS=2, BW=2133KiB/s (2185kB/s)(7168KiB/3360msec) clat (msec): min=3, max=400, avg=262.48, stdev=126.65 lat (msec): min=3, max=400, avg=262.48, stdev=126.65 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 234], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 279], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 338], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1825, max= 4023, per=62.95%, avg=2371.80, stdev=926.48, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1524KiB/s (1560kB/s)(5120KiB/3360msec); 0 zone resets clat (msec): min=175, max=316, avg=256.81, stdev=60.02 lat (msec): min=175, max=316, avg=257.12, stdev=59.96 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1973, max= 4023, per=50.65%, avg=2671.67, stdev=1170.51, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=33.33%, 500=58.33% cpu : usr=0.03%, sys=13.84%, ctx=198, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182559: Mon Sep 7 22:39:27 2026 read: IOPS=0, BW=377KiB/s (386kB/s)(2048KiB/5435msec) clat (msec): min=7, max=363, avg=185.86, stdev=251.68 lat (msec): min=7, max=363, avg=185.86, stdev=251.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 8], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2011, max= 2019, per=53.48%, avg=2015.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1884KiB/s (1929kB/s)(10.0MiB/5435msec); 0 zone resets clat (msec): min=216, max=620, avg=471.89, stdev=157.16 lat (msec): min=217, max=620, avg=474.95, stdev=154.62 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 241], | 30.00th=[ 338], 40.00th=[ 451], 50.00th=[ 502], 60.00th=[ 506], | 70.00th=[ 609], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1973, max= 4031, per=42.97%, avg=2266.75, stdev=713.14, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 10=8.33%, 250=16.67%, 500=25.00%, 750=50.00% cpu : usr=0.06%, sys=10.16%, ctx=182, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182560: Mon Sep 7 22:39:27 2026 read: IOPS=1, BW=1195KiB/s (1224kB/s)(6144KiB/5141msec) clat (usec): min=618, max=386218, avg=167910.29, stdev=151397.49 lat (usec): min=620, max=386220, avg=167911.59, stdev=151397.40 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 766], | 30.00th=[ 766], 40.00th=[141558], 50.00th=[141558], 60.00th=[238027], | 70.00th=[242222], 80.00th=[242222], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 4023, max= 4031, per=100.00%, avg=4027.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1195KiB/s (1224kB/s)(6144KiB/5141msec); 0 zone resets clat (msec): min=221, max=1675, avg=669.30, stdev=566.70 lat (msec): min=221, max=1675, avg=669.52, stdev=566.76 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 535], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1667, max= 2027, per=36.91%, avg=1947.00, stdev=156.67, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.50%, ctx=138, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182562: Mon Sep 7 22:39:27 2026 read: IOPS=0, BW=1011KiB/s (1036kB/s)(5120KiB/5062msec) clat (usec): min=513, max=831377, avg=250910.68, stdev=341597.20 lat (usec): min=515, max=831379, avg=250912.11, stdev=341597.30 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 758], 40.00th=[ 758], 50.00th=[185598], 60.00th=[185598], | 70.00th=[235930], 80.00th=[235930], 90.00th=[834667], 95.00th=[834667], | 99.00th=[834667], 99.50th=[834667], 99.90th=[834667], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 2011, max= 6047, per=100.00%, avg=4029.00, stdev=2853.88, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1416KiB/s (1450kB/s)(7168KiB/5062msec); 0 zone resets clat (msec): min=210, max=1357, avg=502.15, stdev=387.76 lat (msec): min=210, max=1357, avg=502.27, stdev=387.76 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 279], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 405], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 477], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 2011, max= 4055, per=45.93%, avg=2423.00, stdev=912.32, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.87%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3768KiB/s (3859kB/s), 377KiB/s-2133KiB/s (386kB/s-2185kB/s), io=20.0MiB (20.0MB), run=3360-5435msec WRITE: bw=5275KiB/s (5402kB/s), 1195KiB/s-1884KiB/s (1224kB/s-1929kB/s), io=28.0MiB (29.4MB), run=3360-5435msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182555: Mon Sep 7 22:39:27 2026 read: IOPS=1, BW=1504KiB/s (1540kB/s)(7168KiB/4765msec) clat (msec): min=52, max=1180, avg=379.32, stdev=401.49 lat (msec): min=52, max=1180, avg=379.32, stdev=401.49 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 140], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 178], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 634], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1454, max= 4071, per=64.75%, avg=2279.20, stdev=1025.67, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1075KiB/s (1100kB/s)(5120KiB/4765msec); 0 zone resets clat (msec): min=215, max=634, avg=362.42, stdev=163.02 lat (msec): min=215, max=634, avg=362.51, stdev=163.01 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2023, max= 3864, per=53.53%, avg=2638.00, stdev=1061.75, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=2.58%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182556: Mon Sep 7 22:39:27 2026 read: IOPS=0, BW=354KiB/s (362kB/s)(2048KiB/5789msec) clat (msec): min=187, max=690, avg=438.88, stdev=356.08 lat (msec): min=187, max=690, avg=438.88, stdev=356.07 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1648, max= 1932, per=50.85%, avg=1790.00, stdev=200.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1769KiB/s (1811kB/s)(10.0MiB/5789msec); 0 zone resets clat (msec): min=205, max=1093, avg=483.67, stdev=237.91 lat (msec): min=206, max=1094, avg=483.89, stdev=238.14 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 351], | 30.00th=[ 363], 40.00th=[ 368], 50.00th=[ 426], 60.00th=[ 451], | 70.00th=[ 489], 80.00th=[ 518], 90.00th=[ 575], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1992, max= 4063, per=52.28%, avg=2576.14, stdev=944.81, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=16.67%, 500=50.00%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=5.75%, ctx=151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182558: Mon Sep 7 22:39:27 2026 read: IOPS=1, BW=1056KiB/s (1081kB/s)(6144KiB/5818msec) clat (msec): min=237, max=816, avg=385.94, stdev=233.74 lat (msec): min=237, max=816, avg=385.94, stdev=233.74 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1924, max= 3864, per=69.90%, avg=2460.50, stdev=936.93, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1056KiB/s (1081kB/s)(6144KiB/5818msec); 0 zone resets clat (msec): min=119, max=1087, avg=574.33, stdev=420.65 lat (msec): min=119, max=1087, avg=574.42, stdev=420.64 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 844], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1924, max= 2876, per=44.94%, avg=2214.50, stdev=443.77, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=25.00%, 500=33.33%, 750=8.33%, 1000=25.00%, 2000=8.33% cpu : usr=0.02%, sys=3.23%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182561: Mon Sep 7 22:39:27 2026 read: IOPS=1, BW=1155KiB/s (1183kB/s)(5120KiB/4432msec) clat (msec): min=171, max=562, avg=331.01, stdev=188.76 lat (msec): min=171, max=562, avg=331.01, stdev=188.76 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2015, max= 4071, per=76.79%, avg=2703.00, stdev=1184.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1617KiB/s (1656kB/s)(7168KiB/4432msec); 0 zone resets clat (msec): min=123, max=577, avg=377.10, stdev=160.88 lat (msec): min=124, max=577, avg=377.28, stdev=160.87 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 271], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 376], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 567], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1546, max= 4096, per=54.61%, avg=2691.40, stdev=1192.70, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.02%, sys=2.62%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3520KiB/s (3605kB/s), 354KiB/s-1504KiB/s (362kB/s-1540kB/s), io=20.0MiB (20.0MB), run=4432-5818msec WRITE: bw=4928KiB/s (5046kB/s), 1056KiB/s-1769KiB/s (1081kB/s-1811kB/s), io=28.0MiB (29.4MB), run=4432-5818msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182570: Mon Sep 7 22:39:43 2026 read: IOPS=1, BW=4683KiB/s (4795kB/s)(12.0MiB/2624msec) clat (msec): min=726, max=897, avg=809.51, stdev=85.72 lat (msec): min=726, max=897, avg=809.51, stdev=85.72 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.59%, ctx=288, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182572: Mon Sep 7 22:39:43 2026 read: IOPS=0, BW=1263KiB/s (1294kB/s)(4096KiB/3242msec) clat (nsec): min=645352k, max=645352k, avg=645352379.00, stdev= 0.00 lat (nsec): min=645356k, max=645356k, avg=645355574.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2527KiB/s (2587kB/s)(8192KiB/3242msec); 0 zone resets clat (msec): min=199, max=2303, avg=1251.61, stdev=1487.99 lat (msec): min=203, max=2304, avg=1253.76, stdev=1485.58 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 2299], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7892, max= 7892, per=90.10%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.88%, ctx=153, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182574: Mon Sep 7 22:39:43 2026 write: IOPS=0, BW=3285KiB/s (3364kB/s)(12.0MiB/3741msec); 0 zone resets clat (msec): min=856, max=1442, avg=1197.89, stdev=304.92 lat (msec): min=860, max=1443, avg=1199.90, stdev=302.77 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7892, max= 8126, per=91.44%, avg=8009.00, stdev=165.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.38%, ctx=40, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182577: Mon Sep 7 22:39:43 2026 write: IOPS=1, BW=4800KiB/s (4915kB/s)(12.0MiB/2560msec); 0 zone resets clat (msec): min=407, max=1296, avg=836.21, stdev=445.49 lat (msec): min=407, max=1297, avg=839.78, stdev=445.20 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8143, max= 8192, per=93.25%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.65%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5054KiB/s (5175kB/s), 1263KiB/s-4683KiB/s (1294kB/s-4795kB/s), io=16.0MiB (16.8MB), run=2624-3242msec WRITE: bw=8759KiB/s (8969kB/s), 2527KiB/s-4800KiB/s (2587kB/s-4915kB/s), io=32.0MiB (33.6MB), run=2560-3741msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182571: Mon Sep 7 22:39:43 2026 read: IOPS=1, BW=4499KiB/s (4607kB/s)(12.0MiB/2731msec) clat (msec): min=763, max=872, avg=823.47, stdev=55.42 lat (msec): min=763, max=872, avg=823.47, stdev=55.42 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=3.99%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182573: Mon Sep 7 22:39:43 2026 read: IOPS=0, BW=1109KiB/s (1135kB/s)(4096KiB/3694msec) clat (nsec): min=960464k, max=960464k, avg=960463670.00, stdev= 0.00 lat (nsec): min=960467k, max=960467k, avg=960466549.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2218KiB/s (2271kB/s)(8192KiB/3694msec); 0 zone resets clat (msec): min=297, max=2340, avg=1319.36, stdev=1444.76 lat (msec): min=298, max=2341, avg=1319.61, stdev=1444.75 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8192, max= 8192, per=94.11%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.92%, ctx=35, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182575: Mon Sep 7 22:39:43 2026 write: IOPS=0, BW=3265KiB/s (3343kB/s)(12.0MiB/3764msec); 0 zone resets clat (msec): min=771, max=2115, avg=1238.45, stdev=759.75 lat (msec): min=771, max=2117, avg=1239.81, stdev=760.99 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 7907, max= 8143, per=92.19%, avg=8025.00, stdev=166.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.29%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182576: Mon Sep 7 22:39:43 2026 write: IOPS=1, BW=4403KiB/s (4508kB/s)(12.0MiB/2791msec); 0 zone resets clat (msec): min=238, max=1279, avg=885.79, stdev=565.17 lat (msec): min=238, max=1281, avg=886.94, stdev=565.80 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8094, max= 8126, per=93.16%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.19%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4435KiB/s (4542kB/s), 1109KiB/s-4499KiB/s (1135kB/s-4607kB/s), io=16.0MiB (16.8MB), run=2731-3694msec WRITE: bw=8706KiB/s (8915kB/s), 2218KiB/s-4403KiB/s (2271kB/s-4508kB/s), io=32.0MiB (33.6MB), run=2791-3764msec