== sanity test 398b: DIO and buffer IO race ============== 18:48:37 (1785970117) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.21037 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180052: Wed Aug 5 18:50:48 2026 read: IOPS=13, BW=53.7KiB/s (54.0kB/s)(5992KiB/111617msec) clat (usec): min=33, max=860401, avg=41393.87, stdev=33930.31 lat (usec): min=34, max=860403, avg=41395.01, stdev=33930.33 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11076], 10.00th=[ 15926], 20.00th=[ 21103], | 30.00th=[ 25560], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[164627], 99.90th=[221250], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 11, max= 111, per=25.50%, avg=53.55, stdev=19.27, samples=219 iops : min= 2, max= 27, avg=12.74, stdev= 4.85, samples=219 write: IOPS=14, BW=56.4KiB/s (57.8kB/s)(6296KiB/111617msec); 0 zone resets clat (usec): min=919, max=266742, avg=31222.83, stdev=33423.41 lat (usec): min=920, max=266743, avg=31229.48, stdev=33419.92 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1467], 20.00th=[ 2966], | 30.00th=[ 6587], 40.00th=[ 14615], 50.00th=[ 22152], 60.00th=[ 30016], | 70.00th=[ 39584], 80.00th=[ 53740], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[164627], 99.50th=[189793], 99.90th=[217056], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 127, per=25.69%, avg=56.53, stdev=23.36, samples=218 iops : min= 1, max= 31, avg=13.48, stdev= 5.87, samples=218 lat (usec) : 50=0.33%, 100=1.33%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=7.58%, 4=4.56%, 10=6.15%, 20=12.21%, 50=42.19% lat (msec) : 100=21.81%, 250=3.58%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.49%, ctx=6555, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180054: Wed Aug 5 18:50:48 2026 read: IOPS=13, BW=52.8KiB/s (54.1kB/s)(5940KiB/112408msec) clat (usec): min=41, max=241356, avg=41901.40, stdev=27312.68 lat (usec): min=41, max=241357, avg=41903.39, stdev=27315.59 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11338], 10.00th=[ 16450], 20.00th=[ 21103], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 36439], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[177210], 99.90th=[214959], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 5, max= 127, per=25.03%, avg=52.57, stdev=20.45, samples=220 iops : min= 1, max= 31, avg=12.49, stdev= 5.15, samples=220 write: IOPS=14, BW=56.5KiB/s (57.8kB/s)(6348KiB/112408msec); 0 zone resets clat (usec): min=947, max=831568, avg=31289.02, stdev=38475.30 lat (usec): min=949, max=831570, avg=31293.14, stdev=38473.56 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 1565], 20.00th=[ 3326], | 30.00th=[ 6980], 40.00th=[ 14746], 50.00th=[ 21890], 60.00th=[ 28705], | 70.00th=[ 38536], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[154141], 99.50th=[175113], 99.90th=[291505], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 128, per=25.62%, avg=56.37, stdev=25.22, samples=219 iops : min= 1, max= 32, avg=13.44, stdev= 6.34, samples=219 lat (usec) : 50=0.20%, 100=1.30%, 250=0.07%, 500=0.03%, 1000=0.07% lat (msec) : 2=6.74%, 4=4.92%, 10=6.64%, 20=12.96%, 50=41.99% lat (msec) : 100=21.29%, 250=3.74%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.51%, ctx=6570, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180056: Wed Aug 5 18:50:48 2026 read: IOPS=13, BW=53.7KiB/s (54.0kB/s)(6028KiB/112327msec) clat (usec): min=32, max=250830, avg=41977.84, stdev=28820.51 lat (usec): min=32, max=250830, avg=41984.72, stdev=28824.09 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10159], 10.00th=[ 15270], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 31065], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[183501], 99.90th=[242222], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 7, max= 111, per=25.69%, avg=53.96, stdev=19.90, samples=218 iops : min= 1, max= 27, avg=12.83, stdev= 5.01, samples=218 write: IOPS=13, BW=55.7KiB/s (57.1kB/s)(6260KiB/112327msec); 0 zone resets clat (usec): min=957, max=862249, avg=31009.17, stdev=38027.33 lat (usec): min=958, max=862254, avg=31011.73, stdev=38027.41 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1565], 20.00th=[ 3261], | 30.00th=[ 6390], 40.00th=[ 13960], 50.00th=[ 21103], 60.00th=[ 29492], | 70.00th=[ 40109], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[137364], 99.50th=[168821], 99.90th=[210764], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 151, per=25.32%, avg=55.71, stdev=24.68, samples=219 iops : min= 1, max= 37, avg=13.27, stdev= 6.20, samples=219 lat (usec) : 50=0.49%, 100=1.27%, 250=0.13%, 500=0.10%, 1000=0.03% lat (msec) : 2=6.41%, 4=5.44%, 10=6.58%, 20=12.92%, 50=41.15% lat (msec) : 100=21.68%, 250=3.74%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.55%, ctx=6644, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180057: Wed Aug 5 18:50:48 2026 read: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6052KiB/114118msec) clat (usec): min=34, max=244715, avg=41895.62, stdev=27871.43 lat (usec): min=35, max=244716, avg=41898.16, stdev=27871.98 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 10028], 10.00th=[ 15926], 20.00th=[ 20841], | 30.00th=[ 26346], 40.00th=[ 31065], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[166724], 99.90th=[204473], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 112, per=25.31%, avg=53.16, stdev=19.82, samples=223 iops : min= 1, max= 28, avg=12.63, stdev= 4.99, samples=223 write: IOPS=13, BW=54.6KiB/s (55.0kB/s)(6236KiB/114118msec); 0 zone resets clat (usec): min=840, max=792449, avg=32210.21, stdev=38765.88 lat (usec): min=841, max=792453, avg=32211.88, stdev=38765.94 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 1565], 20.00th=[ 3294], | 30.00th=[ 6980], 40.00th=[ 15533], 50.00th=[ 22152], 60.00th=[ 28967], | 70.00th=[ 39584], 80.00th=[ 54789], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[141558], 99.50th=[173016], 99.90th=[270533], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 151, per=24.88%, avg=54.73, stdev=22.15, samples=223 iops : min= 1, max= 37, avg=13.03, stdev= 5.57, samples=223 lat (usec) : 50=0.13%, 100=1.82%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.80%, 4=4.75%, 10=5.76%, 20=12.86%, 50=41.89% lat (msec) : 100=21.22%, 250=4.39%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.32%, ctx=6535, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=210KiB/s (215kB/s), 52.8KiB/s-53.7KiB/s (54.1kB/s-54.0kB/s), io=23.4MiB (24.6MB), run=111617-114118msec WRITE: bw=220KiB/s (226kB/s), 54.6KiB/s-56.5KiB/s (55.0kB/s-57.8kB/s), io=24.6MiB (25.7MB), run=111617-114118msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180053: Wed Aug 5 18:51:25 2026 read: IOPS=9, BW=39.0KiB/s (40.9kB/s)(5992KiB/149978msec) clat (msec): min=5, max=873, avg=39.80, stdev=41.22 lat (msec): min=5, max=873, avg=39.80, stdev=41.22 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 186], 99.50th=[ 213], 99.90th=[ 262], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 142, per=25.36%, avg=40.32, stdev=26.82, samples=290 iops : min= 1, max= 35, avg= 9.42, stdev= 6.74, samples=290 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6296KiB/149978msec); 0 zone resets clat (msec): min=9, max=339, avg=57.12, stdev=40.44 lat (msec): min=9, max=339, avg=57.12, stdev=40.44 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 111], 95.00th=[ 134], | 99.00th=[ 203], 99.50th=[ 247], 99.90th=[ 326], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 119, per=25.43%, avg=42.21, stdev=24.70, samples=291 iops : min= 1, max= 29, avg= 9.89, stdev= 6.21, samples=291 lat (msec) : 10=2.12%, 20=16.83%, 50=48.14%, 100=22.85%, 250=9.73% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=2.12%, ctx=4834, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180055: Wed Aug 5 18:51:25 2026 read: IOPS=9, BW=39.6KiB/s (40.6kB/s)(5940KiB/149968msec) clat (msec): min=5, max=774, avg=38.91, stdev=39.33 lat (msec): min=5, max=774, avg=38.91, stdev=39.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 84], 95.00th=[ 110], | 99.00th=[ 178], 99.50th=[ 205], 99.90th=[ 279], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 127, per=25.20%, avg=40.06, stdev=26.47, samples=289 iops : min= 1, max= 31, avg= 9.36, stdev= 6.65, samples=289 write: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6348KiB/149968msec); 0 zone resets clat (msec): min=10, max=321, avg=57.81, stdev=40.91 lat (msec): min=10, max=321, avg=57.81, stdev=40.91 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 83], 90.00th=[ 110], 95.00th=[ 142], | 99.00th=[ 207], 99.50th=[ 251], 99.90th=[ 313], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 135, per=25.37%, avg=42.12, stdev=24.99, samples=294 iops : min= 1, max= 33, avg= 9.87, stdev= 6.29, samples=294 lat (msec) : 10=2.44%, 20=17.35%, 50=47.20%, 100=23.21%, 250=9.47% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=2.25%, ctx=4918, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180058: Wed Aug 5 18:51:25 2026 read: IOPS=10, BW=40.0KiB/s (40.0kB/s)(6028KiB/150606msec) clat (msec): min=6, max=267, avg=39.30, stdev=34.58 lat (msec): min=6, max=267, avg=39.30, stdev=34.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 112], | 99.00th=[ 167], 99.50th=[ 186], 99.90th=[ 257], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 7, max= 134, per=25.38%, avg=40.36, stdev=26.35, samples=290 iops : min= 1, max= 33, avg= 9.43, stdev= 6.62, samples=290 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6260KiB/150606msec); 0 zone resets clat (msec): min=9, max=814, avg=58.11, stdev=46.17 lat (msec): min=9, max=814, avg=58.11, stdev=46.17 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 114], 95.00th=[ 144], | 99.00th=[ 213], 99.50th=[ 245], 99.90th=[ 292], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 136, per=24.71%, avg=41.02, stdev=25.64, samples=296 iops : min= 1, max= 34, avg= 9.60, stdev= 6.46, samples=296 lat (msec) : 10=2.86%, 20=17.35%, 50=46.58%, 100=22.88%, 250=10.03% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=2.19%, ctx=4943, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180059: Wed Aug 5 18:51:25 2026 read: IOPS=10, BW=40.3KiB/s (41.3kB/s)(6052KiB/150060msec) clat (msec): min=6, max=284, avg=38.87, stdev=35.58 lat (msec): min=6, max=284, avg=38.87, stdev=35.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 112], | 99.00th=[ 180], 99.50th=[ 228], 99.90th=[ 275], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 126, per=26.03%, avg=41.39, stdev=26.32, samples=285 iops : min= 1, max= 31, avg= 9.68, stdev= 6.64, samples=285 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6236KiB/150060msec); 0 zone resets clat (msec): min=11, max=781, avg=58.22, stdev=46.26 lat (msec): min=11, max=781, avg=58.22, stdev=46.26 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 86], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 218], 99.50th=[ 266], 99.90th=[ 338], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 120, per=24.88%, avg=41.29, stdev=25.17, samples=294 iops : min= 1, max= 30, avg= 9.66, stdev= 6.32, samples=294 lat (msec) : 10=2.96%, 20=16.83%, 50=47.75%, 100=21.88%, 250=10.19% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.05%, sys=2.18%, ctx=4824, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (163kB/s), 39.6KiB/s-40.3KiB/s (40.6kB/s-41.3kB/s), io=23.4MiB (24.6MB), run=149968-150606msec WRITE: bw=167KiB/s (171kB/s), 41.6KiB/s-42.3KiB/s (42.6kB/s-43.3kB/s), io=24.6MiB (25.7MB), run=149968-150606msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180097: Wed Aug 5 18:52:08 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5920KiB/32339msec) clat (usec): min=39, max=206501, avg=46963.16, stdev=31995.06 lat (usec): min=39, max=206502, avg=46964.91, stdev=31994.59 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 76], 20.00th=[ 23200], | 30.00th=[ 28443], 40.00th=[ 34341], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 70779], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[152044], 99.50th=[168821], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 61, max= 382, per=24.66%, avg=182.49, stdev=75.51, samples=63 iops : min= 3, max= 23, avg=10.63, stdev= 4.75, samples=63 write: IOPS=12, BW=197KiB/s (202kB/s)(6368KiB/32339msec); 0 zone resets clat (usec): min=1190, max=238105, avg=37104.91, stdev=35943.35 lat (usec): min=1191, max=238109, avg=37114.02, stdev=35945.48 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2147], 10.00th=[ 3720], 20.00th=[ 6521], | 30.00th=[ 11076], 40.00th=[ 17695], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 49021], 80.00th=[ 63701], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[145753], 99.50th=[191890], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 500, per=25.31%, avg=197.14, stdev=85.24, samples=63 iops : min= 1, max= 31, avg=11.59, stdev= 5.39, samples=63 lat (usec) : 50=0.78%, 100=4.17% lat (msec) : 2=1.95%, 4=3.65%, 10=9.11%, 20=10.42%, 50=35.81% lat (msec) : 100=27.60%, 250=6.51% cpu : usr=0.06%, sys=5.29%, ctx=1651, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180098: Wed Aug 5 18:52:08 2026 read: IOPS=11, BW=184KiB/s (189kB/s)(5744KiB/31173msec) clat (usec): min=39, max=194879, avg=46658.04, stdev=32609.04 lat (usec): min=40, max=194880, avg=46671.47, stdev=32607.08 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 2180], 20.00th=[ 23725], | 30.00th=[ 29754], 40.00th=[ 36439], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[170918], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 350, per=24.89%, avg=184.18, stdev=74.72, samples=60 iops : min= 1, max= 21, avg=10.77, stdev= 4.70, samples=60 write: IOPS=13, BW=210KiB/s (215kB/s)(6544KiB/31173msec); 0 zone resets clat (usec): min=1544, max=186028, avg=35129.89, stdev=34628.37 lat (usec): min=1546, max=186033, avg=35132.14, stdev=34628.43 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2114], 10.00th=[ 3195], 20.00th=[ 5932], | 30.00th=[ 10421], 40.00th=[ 17695], 50.00th=[ 24249], 60.00th=[ 32375], | 70.00th=[ 42730], 80.00th=[ 60031], 90.00th=[ 87557], 95.00th=[103285], | 99.00th=[154141], 99.50th=[170918], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 508, per=26.81%, avg=208.82, stdev=93.60, samples=60 iops : min= 1, max= 31, avg=12.32, stdev= 5.90, samples=60 lat (usec) : 50=0.13%, 100=3.78%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=1.95%, 4=5.86%, 10=8.20%, 20=10.03%, 50=38.41% lat (msec) : 100=25.00%, 250=6.12% cpu : usr=0.05%, sys=5.35%, ctx=1615, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180099: Wed Aug 5 18:52:08 2026 read: IOPS=12, BW=194KiB/s (198kB/s)(6256KiB/32311msec) clat (usec): min=45, max=270602, avg=47296.26, stdev=34483.11 lat (usec): min=46, max=270604, avg=47297.61, stdev=34483.13 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 11076], 20.00th=[ 23200], | 30.00th=[ 29230], 40.00th=[ 34341], 50.00th=[ 41681], 60.00th=[ 46400], | 70.00th=[ 56886], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[158335], 99.50th=[217056], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 377, per=26.30%, avg=194.60, stdev=74.23, samples=63 iops : min= 3, max= 23, avg=11.44, stdev= 4.64, samples=63 write: IOPS=11, BW=187KiB/s (191kB/s)(6032KiB/32311msec); 0 zone resets clat (usec): min=1588, max=220571, avg=36346.82, stdev=38211.39 lat (usec): min=1590, max=220573, avg=36351.86, stdev=38211.09 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2311], 10.00th=[ 3621], 20.00th=[ 6587], | 30.00th=[ 9765], 40.00th=[ 16188], 50.00th=[ 24511], 60.00th=[ 33162], | 70.00th=[ 44827], 80.00th=[ 60031], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[187696], 99.50th=[217056], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 60, max= 532, per=24.17%, avg=188.29, stdev=85.67, samples=62 iops : min= 3, max= 33, avg=11.05, stdev= 5.38, samples=62 lat (usec) : 50=0.26%, 100=3.91%, 250=0.39% lat (msec) : 2=1.82%, 4=3.91%, 10=9.64%, 20=10.55%, 50=37.50% lat (msec) : 100=25.26%, 250=6.64%, 500=0.13% cpu : usr=0.06%, sys=4.91%, ctx=1740, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180101: Wed Aug 5 18:52:08 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30954msec) clat (usec): min=41, max=181199, avg=43666.94, stdev=32185.93 lat (usec): min=42, max=181200, avg=43668.35, stdev=32185.87 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 19006], | 30.00th=[ 25822], 40.00th=[ 33424], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 54264], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[101188], | 99.00th=[162530], 99.50th=[177210], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 382, per=26.23%, avg=194.10, stdev=81.22, samples=60 iops : min= 1, max= 23, avg=11.38, stdev= 5.10, samples=60 write: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30954msec); 0 zone resets clat (usec): min=1511, max=193382, avg=36678.69, stdev=37910.77 lat (usec): min=1513, max=193384, avg=36682.50, stdev=37912.18 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2147], 10.00th=[ 3326], 20.00th=[ 5866], | 30.00th=[ 10552], 40.00th=[ 17433], 50.00th=[ 24511], 60.00th=[ 34341], | 70.00th=[ 44827], 80.00th=[ 57934], 90.00th=[ 85459], 95.00th=[120062], | 99.00th=[175113], 99.50th=[181404], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 469, per=26.05%, avg=202.92, stdev=87.57, samples=60 iops : min= 3, max= 29, avg=11.95, stdev= 5.54, samples=60 lat (usec) : 50=0.52%, 100=4.95%, 250=0.26%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.08%, 4=5.34%, 10=8.07%, 20=11.46%, 50=36.59% lat (msec) : 100=23.57%, 250=6.77% cpu : usr=0.10%, sys=5.34%, ctx=1570, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=741KiB/s (758kB/s), 183KiB/s-195KiB/s (187kB/s-200kB/s), io=23.4MiB (24.5MB), run=30954-32339msec WRITE: bw=779KiB/s (798kB/s), 187KiB/s-210KiB/s (191kB/s-215kB/s), io=24.6MiB (25.8MB), run=30954-32339msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180102: Wed Aug 5 18:52:22 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(5920KiB/45119msec) clat (msec): min=7, max=250, avg=48.20, stdev=38.60 lat (msec): min=7, max=250, avg=48.20, stdev=38.60 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 120], | 99.00th=[ 218], 99.50th=[ 236], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 319, per=26.00%, avg=134.95, stdev=76.11, samples=86 iops : min= 1, max= 19, avg= 7.64, stdev= 4.79, samples=86 write: IOPS=8, BW=141KiB/s (145kB/s)(6368KiB/45119msec); 0 zone resets clat (msec): min=17, max=327, avg=67.90, stdev=47.32 lat (msec): min=17, max=327, avg=67.91, stdev=47.31 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 97], 90.00th=[ 130], 95.00th=[ 155], | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 27, max= 349, per=26.04%, avg=142.44, stdev=71.74, samples=88 iops : min= 1, max= 21, avg= 8.10, stdev= 4.52, samples=88 lat (msec) : 10=0.13%, 20=7.16%, 50=51.17%, 100=27.73%, 250=13.15% lat (msec) : 500=0.65% cpu : usr=0.03%, sys=1.89%, ctx=1304, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180103: Wed Aug 5 18:52:22 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(5744KiB/46063msec) clat (msec): min=8, max=186, avg=50.61, stdev=35.64 lat (msec): min=8, max=186, avg=50.61, stdev=35.64 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 72], 90.00th=[ 103], 95.00th=[ 134], | 99.00th=[ 161], 99.50th=[ 182], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 27, max= 319, per=24.47%, avg=126.98, stdev=74.47, samples=87 iops : min= 1, max= 19, avg= 7.13, stdev= 4.71, samples=87 write: IOPS=8, BW=142KiB/s (145kB/s)(6544KiB/46063msec); 0 zone resets clat (msec): min=12, max=321, avg=67.87, stdev=48.64 lat (msec): min=12, max=321, avg=67.87, stdev=48.63 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 97], 90.00th=[ 130], 95.00th=[ 169], | 99.00th=[ 241], 99.50th=[ 313], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 382, per=25.45%, avg=139.21, stdev=73.44, samples=90 iops : min= 1, max= 23, avg= 7.89, stdev= 4.63, samples=90 lat (msec) : 10=0.26%, 20=6.64%, 50=48.96%, 100=29.43%, 250=14.19% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.95%, ctx=1205, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180104: Wed Aug 5 18:52:22 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45388msec) clat (msec): min=9, max=282, avg=49.42, stdev=38.43 lat (msec): min=9, max=282, avg=49.43, stdev=38.43 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 68], 90.00th=[ 104], 95.00th=[ 131], | 99.00th=[ 186], 99.50th=[ 213], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 28, max= 477, per=27.22%, avg=141.28, stdev=89.57, samples=87 iops : min= 1, max= 29, avg= 8.02, stdev= 5.65, samples=87 write: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45388msec); 0 zone resets clat (msec): min=15, max=342, avg=68.55, stdev=52.64 lat (msec): min=15, max=342, avg=68.55, stdev=52.64 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 94], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 383, per=23.85%, avg=130.45, stdev=74.22, samples=89 iops : min= 1, max= 23, avg= 7.35, stdev= 4.69, samples=89 lat (msec) : 10=0.26%, 20=8.85%, 50=50.26%, 100=26.17%, 250=13.54% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.93%, ctx=1235, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180105: Wed Aug 5 18:52:22 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45399msec) clat (msec): min=8, max=289, avg=51.00, stdev=39.93 lat (msec): min=8, max=289, avg=51.00, stdev=39.93 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 104], 95.00th=[ 131], | 99.00th=[ 182], 99.50th=[ 266], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 347, per=25.51%, avg=132.37, stdev=69.80, samples=88 iops : min= 1, max= 21, avg= 7.47, stdev= 4.41, samples=88 write: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45399msec); 0 zone resets clat (msec): min=16, max=349, avg=66.08, stdev=46.42 lat (msec): min=16, max=349, avg=66.08, stdev=46.42 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 92], 90.00th=[ 134], 95.00th=[ 161], | 99.00th=[ 245], 99.50th=[ 284], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 383, per=24.97%, avg=136.56, stdev=73.37, samples=89 iops : min= 1, max= 23, avg= 7.73, stdev= 4.63, samples=89 lat (msec) : 10=0.13%, 20=7.03%, 50=49.09%, 100=29.56%, 250=13.54% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=2.02%, ctx=1293, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=520KiB/s (532kB/s), 125KiB/s-138KiB/s (128kB/s-141kB/s), io=23.4MiB (24.5MB), run=45119-46063msec WRITE: bw=547KiB/s (560kB/s), 133KiB/s-142KiB/s (136kB/s-145kB/s), io=24.6MiB (25.8MB), run=45119-46063msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180125: Wed Aug 5 18:52:37 2026 read: IOPS=2, BW=2510KiB/s (2570kB/s)(7168KiB/2856msec) clat (msec): min=88, max=272, avg=198.34, stdev=58.86 lat (msec): min=88, max=272, avg=198.35, stdev=58.86 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 174], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 199], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 245], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1872, max= 4978, per=44.71%, avg=2729.00, stdev=1501.25, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1793KiB/s (1836kB/s)(5120KiB/2856msec); 0 zone resets clat (msec): min=129, max=569, avg=291.58, stdev=164.59 lat (msec): min=129, max=569, avg=291.70, stdev=164.57 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1872, max= 4071, per=29.26%, avg=2500.25, stdev=1049.78, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=14.78%, ctx=267, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180126: Wed Aug 5 18:52:37 2026 read: IOPS=0, BW=611KiB/s (625kB/s)(2048KiB/3354msec) clat (msec): min=2, max=195, avg=99.29, stdev=136.43 lat (msec): min=2, max=195, avg=99.29, stdev=136.43 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1484, max= 2035, per=28.83%, avg=1759.50, stdev=389.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3053KiB/s (3126kB/s)(10.0MiB/3354msec); 0 zone resets clat (msec): min=141, max=827, avg=315.06, stdev=205.05 lat (msec): min=141, max=827, avg=315.43, stdev=204.95 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 157], | 30.00th=[ 182], 40.00th=[ 249], 50.00th=[ 255], 60.00th=[ 259], | 70.00th=[ 288], 80.00th=[ 300], 90.00th=[ 493], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2031, max= 5616, per=41.47%, avg=3544.20, stdev=1525.96, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 4=8.33%, 250=41.67%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=13.96%, ctx=148, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180127: Wed Aug 5 18:52:37 2026 read: IOPS=1, BW=1831KiB/s (1875kB/s)(6144KiB/3355msec) clat (usec): min=514, max=603581, avg=232615.32, stdev=247532.50 lat (usec): min=741, max=603582, avg=232654.28, stdev=247489.92 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 1221], | 30.00th=[ 1221], 40.00th=[107480], 50.00th=[107480], 60.00th=[235930], | 70.00th=[446694], 80.00th=[446694], 90.00th=[599786], 95.00th=[599786], | 99.00th=[599786], 99.50th=[599786], 99.90th=[599786], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 2035, max= 4055, per=53.70%, avg=3278.00, stdev=1087.64, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1831KiB/s (1875kB/s)(6144KiB/3355msec); 0 zone resets clat (msec): min=189, max=516, avg=324.64, stdev=118.47 lat (msec): min=189, max=516, avg=324.72, stdev=118.50 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 338], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1992, max= 3141, per=26.27%, avg=2245.20, stdev=501.06, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=11.90%, ctx=176, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180128: Wed Aug 5 18:52:37 2026 read: IOPS=1, BW=1638KiB/s (1677kB/s)(5120KiB/3126msec) clat (usec): min=453, max=465698, avg=133731.03, stdev=192309.48 lat (usec): min=455, max=465700, avg=133732.25, stdev=192309.59 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 89654], 60.00th=[ 89654], | 70.00th=[111674], 80.00th=[111674], 90.00th=[467665], 95.00th=[467665], | 99.00th=[467665], 99.50th=[467665], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 2035, max= 6083, per=66.50%, avg=4059.00, stdev=2862.37, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2293KiB/s (2348kB/s)(7168KiB/3126msec); 0 zone resets clat (msec): min=191, max=622, avg=350.74, stdev=178.87 lat (msec): min=191, max=622, avg=350.86, stdev=178.85 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 203], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 266], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 584], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1625, max= 5616, per=36.15%, avg=3089.33, stdev=2197.37, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.13%, sys=10.94%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6104KiB/s (6251kB/s), 611KiB/s-2510KiB/s (625kB/s-2570kB/s), io=20.0MiB (20.0MB), run=2856-3355msec WRITE: bw=8546KiB/s (8751kB/s), 1793KiB/s-3053KiB/s (1836kB/s-3126kB/s), io=28.0MiB (29.4MB), run=2856-3355msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180120: Wed Aug 5 18:52:38 2026 read: IOPS=1, BW=1975KiB/s (2022kB/s)(7168KiB/3630msec) clat (msec): min=77, max=725, avg=293.27, stdev=248.31 lat (msec): min=77, max=725, avg=293.27, stdev=248.31 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 109], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 174], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 531], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2011, max= 4690, per=54.85%, avg=2699.25, stdev=1327.28, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=1, BW=1410KiB/s (1444kB/s)(5120KiB/3630msec); 0 zone resets clat (msec): min=100, max=695, avg=296.50, stdev=242.04 lat (msec): min=100, max=695, avg=297.46, stdev=242.05 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2011, max= 3893, per=36.24%, avg=2496.75, stdev=930.96, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=25.00% cpu : usr=0.03%, sys=3.55%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180121: Wed Aug 5 18:52:38 2026 read: IOPS=0, BW=511KiB/s (524kB/s)(2048KiB/4006msec) clat (msec): min=128, max=452, avg=290.22, stdev=229.37 lat (msec): min=128, max=452, avg=290.22, stdev=229.37 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1643, max= 2048, per=37.50%, avg=1845.50, stdev=286.38, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2556KiB/s (2618kB/s)(10.0MiB/4006msec); 0 zone resets clat (msec): min=147, max=684, avg=336.27, stdev=187.35 lat (msec): min=147, max=684, avg=336.39, stdev=187.38 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 184], | 30.00th=[ 194], 40.00th=[ 205], 50.00th=[ 279], 60.00th=[ 305], | 70.00th=[ 321], 80.00th=[ 414], 90.00th=[ 634], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1643, max= 4087, per=38.02%, avg=2619.50, stdev=1074.01, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.02%, sys=5.57%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180122: Wed Aug 5 18:52:38 2026 read: IOPS=1, BW=1477KiB/s (1512kB/s)(6144KiB/4161msec) clat (msec): min=53, max=856, avg=365.50, stdev=307.02 lat (msec): min=53, max=856, avg=365.51, stdev=307.02 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 447], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1946, max= 2048, per=41.01%, avg=2018.00, stdev=48.30, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1477KiB/s (1512kB/s)(6144KiB/4161msec); 0 zone resets clat (msec): min=109, max=866, avg=324.29, stdev=281.15 lat (msec): min=109, max=866, avg=324.41, stdev=281.15 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 300], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2048, max= 3255, per=35.56%, avg=2450.33, stdev=696.86, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.05%, sys=4.78%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180123: Wed Aug 5 18:52:38 2026 read: IOPS=1, BW=1817KiB/s (1860kB/s)(5120KiB/2818msec) clat (msec): min=69, max=285, avg=180.06, stdev=95.23 lat (msec): min=69, max=285, avg=180.06, stdev=95.23 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 2048, max= 5840, per=80.15%, avg=3944.00, stdev=2681.35, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2544KiB/s (2605kB/s)(7168KiB/2818msec); 0 zone resets clat (msec): min=101, max=539, avg=270.37, stdev=166.99 lat (msec): min=101, max=539, avg=270.47, stdev=166.98 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 174], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 197], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 477], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2011, max= 4096, per=42.16%, avg=2905.00, stdev=1043.35, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=3.19%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4922KiB/s (5040kB/s), 511KiB/s-1975KiB/s (524kB/s-2022kB/s), io=20.0MiB (20.0MB), run=2818-4161msec WRITE: bw=6891KiB/s (7056kB/s), 1410KiB/s-2556KiB/s (1444kB/s-2618kB/s), io=28.0MiB (29.4MB), run=2818-4161msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180137: Wed Aug 5 18:52:52 2026 read: IOPS=1, BW=5032KiB/s (5153kB/s)(12.0MiB/2442msec) clat (msec): min=721, max=875, avg=790.32, stdev=78.39 lat (msec): min=721, max=875, avg=790.32, stdev=78.39 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=15.32%, ctx=333, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180140: Wed Aug 5 18:52:52 2026 read: IOPS=0, BW=1201KiB/s (1230kB/s)(4096KiB/3411msec) clat (nsec): min=835006k, max=835006k, avg=835006358.00, stdev= 0.00 lat (nsec): min=835009k, max=835009k, avg=835008833.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2402KiB/s (2459kB/s)(8192KiB/3411msec); 0 zone resets clat (msec): min=541, max=1838, avg=1189.89, stdev=916.91 lat (msec): min=544, max=1838, avg=1191.36, stdev=915.42 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8047, max= 8047, per=83.77%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.40%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180141: Wed Aug 5 18:52:52 2026 write: IOPS=0, BW=3874KiB/s (3967kB/s)(12.0MiB/3172msec); 0 zone resets clat (msec): min=200, max=2514, avg=1021.88, stdev=1294.83 lat (msec): min=200, max=2514, avg=1022.68, stdev=1294.41 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 6564, max= 8192, per=76.81%, avg=7378.00, stdev=1151.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.88%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180142: Wed Aug 5 18:52:52 2026 write: IOPS=0, BW=3613KiB/s (3700kB/s)(12.0MiB/3401msec); 0 zone resets clat (msec): min=223, max=2306, avg=1116.22, stdev=1072.64 lat (msec): min=224, max=2306, avg=1116.74, stdev=1072.46 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8094, max= 8094, per=84.26%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.88%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4803KiB/s (4919kB/s), 1201KiB/s-5032KiB/s (1230kB/s-5153kB/s), io=16.0MiB (16.8MB), run=2442-3411msec WRITE: bw=9607KiB/s (9837kB/s), 2402KiB/s-3874KiB/s (2459kB/s-3967kB/s), io=32.0MiB (33.6MB), run=3172-3411msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180135: Wed Aug 5 18:52:52 2026 read: IOPS=0, BW=3317KiB/s (3397kB/s)(12.0MiB/3704msec) clat (msec): min=227, max=1869, avg=1173.26, stdev=849.29 lat (msec): min=227, max=1869, avg=1173.26, stdev=849.29 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8000, max= 8175, per=100.00%, avg=8087.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.48%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180136: Wed Aug 5 18:52:52 2026 read: IOPS=0, BW=1098KiB/s (1125kB/s)(4096KiB/3729msec) clat (nsec): min=1448.9M, max=1448.9M, avg=1448894813.00, stdev= 0.00 lat (nsec): min=1448.9M, max=1448.9M, avg=1448897183.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1452], 5.00th=[ 1452], 10.00th=[ 1452], 20.00th=[ 1452], | 30.00th=[ 1452], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2197KiB/s (2250kB/s)(8192KiB/3729msec); 0 zone resets clat (msec): min=803, max=1384, avg=1093.78, stdev=411.18 lat (msec): min=803, max=1384, avg=1094.17, stdev=411.29 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8000, max= 8000, per=91.04%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.71%, ctx=38, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180138: Wed Aug 5 18:52:52 2026 write: IOPS=1, BW=4451KiB/s (4557kB/s)(12.0MiB/2761msec); 0 zone resets clat (msec): min=603, max=1143, avg=901.50, stdev=273.95 lat (msec): min=604, max=1143, avg=901.88, stdev=274.00 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8000, max= 8192, per=92.14%, avg=8096.00, stdev=135.76, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.71%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180139: Wed Aug 5 18:52:52 2026 write: IOPS=1, BW=5063KiB/s (5185kB/s)(12.0MiB/2427msec); 0 zone resets clat (msec): min=315, max=1060, avg=744.20, stdev=384.87 lat (msec): min=316, max=1061, avg=744.53, stdev=384.86 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 5641, max= 8192, per=78.71%, avg=6916.50, stdev=1803.83, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.48%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4394KiB/s (4499kB/s), 1098KiB/s-3317KiB/s (1125kB/s-3397kB/s), io=16.0MiB (16.8MB), run=3704-3729msec WRITE: bw=8787KiB/s (8998kB/s), 2197KiB/s-5063KiB/s (2250kB/s-5185kB/s), io=32.0MiB (33.6MB), run=2427-3729msec