== sanity test 398b: DIO and buffer IO race ============== 01:58:12 (1787464692) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.4997 s, 5.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145437: Sun Aug 23 02:01:09 2026 read: IOPS=9, BW=39.2KiB/s (40.1kB/s)(5992KiB/152970msec) clat (usec): min=32, max=1226.3k, avg=48920.33, stdev=47746.97 lat (usec): min=33, max=1226.3k, avg=48923.30, stdev=47748.02 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 1336], | 20.00th=[ 22152], 30.00th=[ 28967], 40.00th=[ 34866], | 50.00th=[ 41157], 60.00th=[ 49021], 70.00th=[ 58459], | 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[ 115868], | 99.00th=[ 173016], 99.50th=[ 204473], 99.90th=[ 442500], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 6, max= 95, per=25.02%, avg=39.04, stdev=18.33, samples=297 iops : min= 1, max= 23, avg= 9.09, stdev= 4.62, samples=297 write: IOPS=10, BW=41.2KiB/s (42.1kB/s)(6296KiB/152970msec); 0 zone resets clat (usec): min=935, max=513130, avg=50245.05, stdev=54652.02 lat (usec): min=938, max=513132, avg=50253.23, stdev=54648.65 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1303], 10.00th=[ 1729], 20.00th=[ 5080], | 30.00th=[ 10421], 40.00th=[ 21103], 50.00th=[ 34341], 60.00th=[ 49546], | 70.00th=[ 65799], 80.00th=[ 88605], 90.00th=[121111], 95.00th=[147850], | 99.00th=[238027], 99.50th=[299893], 99.90th=[438305], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 7, max= 119, per=25.04%, avg=41.06, stdev=19.12, samples=297 iops : min= 1, max= 29, avg= 9.59, stdev= 4.81, samples=297 lat (usec) : 50=0.39%, 100=4.04%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.83%, 4=2.99%, 10=6.35%, 20=8.20%, 50=32.52% lat (msec) : 100=27.34%, 250=11.33%, 500=0.52%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.48%, ctx=6420, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145438: Sun Aug 23 02:01:09 2026 read: IOPS=9, BW=39.4KiB/s (40.3kB/s)(5940KiB/150941msec) clat (usec): min=32, max=535002, avg=49941.02, stdev=38502.93 lat (usec): min=33, max=535004, avg=49944.18, stdev=38504.20 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 709], 20.00th=[ 23725], | 30.00th=[ 30016], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 61604], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[112722], | 99.00th=[183501], 99.50th=[202376], 99.90th=[291505], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 6, max= 95, per=25.13%, avg=39.21, stdev=18.50, samples=294 iops : min= 1, max= 23, avg= 9.13, stdev= 4.66, samples=294 write: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6348KiB/150941msec); 0 zone resets clat (usec): min=949, max=1202.3k, avg=47963.07, stdev=59377.59 lat (usec): min=950, max=1202.3k, avg=47969.35, stdev=59384.07 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1237], 10.00th=[ 1450], | 20.00th=[ 4555], 30.00th=[ 10159], 40.00th=[ 20317], | 50.00th=[ 33817], 60.00th=[ 45876], 70.00th=[ 63701], | 80.00th=[ 83362], 90.00th=[ 112722], 95.00th=[ 141558], | 99.00th=[ 217056], 99.50th=[ 248513], 99.90th=[ 641729], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 7, max= 111, per=25.68%, avg=42.11, stdev=20.17, samples=293 iops : min= 1, max= 27, avg= 9.87, stdev= 5.10, samples=293 lat (usec) : 50=0.36%, 100=4.13%, 250=0.26%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.35%, 4=3.42%, 10=5.86%, 20=7.55%, 50=33.04% lat (msec) : 100=28.26%, 250=10.25%, 500=0.20%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=4.38%, ctx=6129, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145439: Sun Aug 23 02:01:09 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(6028KiB/152842msec) clat (usec): min=34, max=311344, avg=49234.87, stdev=35020.19 lat (usec): min=34, max=311345, avg=49236.95, stdev=35019.79 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 9372], 20.00th=[ 23462], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[164627], 99.50th=[198181], 99.90th=[270533], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 119, per=25.60%, avg=39.93, stdev=19.18, samples=293 iops : min= 1, max= 29, avg= 9.31, stdev= 4.82, samples=293 write: IOPS=10, BW=40.0KiB/s (41.9kB/s)(6260KiB/152842msec); 0 zone resets clat (usec): min=1008, max=1366.1k, avg=49844.61, stdev=65354.14 lat (usec): min=1010, max=1366.1k, avg=49856.15, stdev=65368.78 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1532], | 20.00th=[ 5014], 30.00th=[ 10028], 40.00th=[ 21103], | 50.00th=[ 33817], 60.00th=[ 45876], 70.00th=[ 60031], | 80.00th=[ 84411], 90.00th=[ 117965], 95.00th=[ 147850], | 99.00th=[ 265290], 99.50th=[ 308282], 99.90th=[ 692061], | 99.95th=[1367344], 99.99th=[1367344] bw ( KiB/s): min= 7, max= 119, per=24.95%, avg=40.92, stdev=17.97, samples=297 iops : min= 1, max= 29, avg= 9.55, stdev= 4.53, samples=297 lat (usec) : 50=0.33%, 100=3.55%, 250=0.42%, 500=0.13%, 750=0.07% lat (msec) : 2=5.99%, 4=2.70%, 10=7.06%, 20=7.68%, 50=32.65% lat (msec) : 100=28.48%, 250=10.32%, 500=0.52%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=4.37%, ctx=6407, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145440: Sun Aug 23 02:01:09 2026 read: IOPS=9, BW=39.8KiB/s (40.8kB/s)(6052KiB/152014msec) clat (usec): min=35, max=533590, avg=49981.88, stdev=40230.27 lat (usec): min=36, max=533591, avg=50001.11, stdev=40256.82 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 10945], 20.00th=[ 22938], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[111674], | 99.00th=[164627], 99.50th=[240124], 99.90th=[438305], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 7, max= 110, per=25.75%, avg=40.16, stdev=18.18, samples=292 iops : min= 1, max= 27, avg= 9.37, stdev= 4.57, samples=292 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6236KiB/152014msec); 0 zone resets clat (usec): min=967, max=1331.9k, avg=48587.92, stdev=59350.48 lat (usec): min=968, max=1331.9k, avg=48596.34, stdev=59350.37 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 1598], | 20.00th=[ 5014], 30.00th=[ 10814], 40.00th=[ 21365], | 50.00th=[ 35390], 60.00th=[ 47973], 70.00th=[ 62129], | 80.00th=[ 83362], 90.00th=[ 112722], 95.00th=[ 139461], | 99.00th=[ 212861], 99.50th=[ 278922], 99.90th=[ 404751], | 99.95th=[1333789], 99.99th=[1333789] bw ( KiB/s): min= 7, max= 127, per=25.03%, avg=41.04, stdev=18.71, samples=294 iops : min= 1, max= 31, avg= 9.59, stdev= 4.70, samples=294 lat (usec) : 50=0.39%, 100=3.45%, 250=0.39%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.89%, 4=2.93%, 10=6.32%, 20=8.14%, 50=33.04% lat (msec) : 100=28.13%, 250=10.45%, 500=0.49%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.43%, ctx=6314, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=157KiB/s (161kB/s), 39.2KiB/s-39.8KiB/s (40.1kB/s-40.8kB/s), io=23.4MiB (24.6MB), run=150941-152970msec WRITE: bw=164KiB/s (168kB/s), 40.0KiB/s-42.1KiB/s (41.9kB/s-43.1kB/s), io=24.6MiB (25.7MB), run=150941-152970msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145441: Sun Aug 23 02:04:16 2026 read: IOPS=4, BW=17.6KiB/s (18.0kB/s)(5992KiB/340204msec) clat (msec): min=5, max=1225, avg=46.28, stdev=53.07 lat (msec): min=5, max=1225, avg=46.29, stdev=53.07 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 92], 95.00th=[ 124], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 609], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 104, per=30.37%, avg=21.26, stdev=14.42, samples=540 iops : min= 1, max= 26, avg= 4.66, stdev= 3.65, samples=540 write: IOPS=4, BW=18.5KiB/s (18.9kB/s)(6296KiB/340204msec); 0 zone resets clat (msec): min=45, max=798, avg=171.76, stdev=78.44 lat (msec): min=45, max=798, avg=171.76, stdev=78.44 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 80], 10.00th=[ 93], 20.00th=[ 109], | 30.00th=[ 126], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 197], 80.00th=[ 226], 90.00th=[ 271], 95.00th=[ 313], | 99.00th=[ 447], 99.50th=[ 502], 99.90th=[ 651], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 47, per=25.05%, avg=18.29, stdev= 8.10, samples=655 iops : min= 1, max= 11, avg= 3.91, stdev= 2.08, samples=655 lat (msec) : 10=1.56%, 20=10.55%, 50=23.14%, 100=16.73%, 250=40.59% lat (msec) : 500=7.10%, 750=0.26%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.09%, ctx=5447, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145442: Sun Aug 23 02:04:16 2026 read: IOPS=4, BW=17.5KiB/s (17.0kB/s)(5940KiB/338739msec) clat (msec): min=5, max=1191, avg=45.87, stdev=48.90 lat (msec): min=5, max=1191, avg=45.88, stdev=48.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 126], | 99.00th=[ 199], 99.50th=[ 234], 99.90th=[ 380], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 85, per=29.48%, avg=20.63, stdev=14.23, samples=551 iops : min= 1, max= 21, avg= 4.50, stdev= 3.58, samples=551 write: IOPS=4, BW=18.7KiB/s (19.2kB/s)(6348KiB/338739msec); 0 zone resets clat (msec): min=32, max=793, avg=170.21, stdev=79.00 lat (msec): min=32, max=793, avg=170.21, stdev=79.00 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 78], 10.00th=[ 89], 20.00th=[ 106], | 30.00th=[ 123], 40.00th=[ 138], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 197], 80.00th=[ 226], 90.00th=[ 271], 95.00th=[ 317], | 99.00th=[ 439], 99.50th=[ 498], 99.90th=[ 659], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 48, per=25.30%, avg=18.47, stdev= 8.23, samples=655 iops : min= 1, max= 12, avg= 3.95, stdev= 2.12, samples=655 lat (msec) : 10=1.63%, 20=10.55%, 50=22.27%, 100=18.07%, 250=40.30% lat (msec) : 500=6.93%, 750=0.20%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.06%, ctx=5358, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145443: Sun Aug 23 02:04:16 2026 read: IOPS=4, BW=17.9KiB/s (18.3kB/s)(6028KiB/337208msec) clat (msec): min=6, max=610, avg=47.26, stdev=43.17 lat (msec): min=6, max=610, avg=47.26, stdev=43.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 67], 90.00th=[ 100], 95.00th=[ 123], | 99.00th=[ 201], 99.50th=[ 241], 99.90th=[ 409], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 111, per=29.40%, avg=20.58, stdev=14.03, samples=561 iops : min= 1, max= 27, avg= 4.48, stdev= 3.53, samples=561 write: IOPS=4, BW=18.6KiB/s (19.0kB/s)(6260KiB/337208msec); 0 zone resets clat (msec): min=41, max=1333, avg=169.64, stdev=84.71 lat (msec): min=41, max=1333, avg=169.64, stdev=84.71 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 106], | 30.00th=[ 123], 40.00th=[ 136], 50.00th=[ 153], 60.00th=[ 171], | 70.00th=[ 192], 80.00th=[ 222], 90.00th=[ 271], 95.00th=[ 313], | 99.00th=[ 443], 99.50th=[ 514], 99.90th=[ 793], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 55, per=25.38%, avg=18.53, stdev= 8.68, samples=644 iops : min= 1, max= 13, avg= 3.97, stdev= 2.21, samples=644 lat (msec) : 10=1.50%, 20=10.06%, 50=21.78%, 100=19.63%, 250=39.49% lat (msec) : 500=7.26%, 750=0.23%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.04%, ctx=5296, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145444: Sun Aug 23 02:04:16 2026 read: IOPS=4, BW=17.0KiB/s (18.4kB/s)(6052KiB/336443msec) clat (msec): min=6, max=460, avg=44.76, stdev=37.61 lat (msec): min=6, max=460, avg=44.76, stdev=37.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 65], 90.00th=[ 93], 95.00th=[ 116], | 99.00th=[ 184], 99.50th=[ 218], 99.90th=[ 334], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 88, per=30.26%, avg=21.18, stdev=14.61, samples=548 iops : min= 1, max= 22, avg= 4.63, stdev= 3.69, samples=548 write: IOPS=4, BW=18.5KiB/s (18.0kB/s)(6236KiB/336443msec); 0 zone resets clat (msec): min=41, max=1326, avg=172.06, stdev=83.76 lat (msec): min=41, max=1326, avg=172.06, stdev=83.76 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 79], 10.00th=[ 90], 20.00th=[ 109], | 30.00th=[ 123], 40.00th=[ 138], 50.00th=[ 155], 60.00th=[ 171], | 70.00th=[ 197], 80.00th=[ 228], 90.00th=[ 275], 95.00th=[ 326], | 99.00th=[ 439], 99.50th=[ 514], 99.90th=[ 659], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 40, per=24.92%, avg=18.19, stdev= 8.27, samples=653 iops : min= 1, max= 10, avg= 3.89, stdev= 2.12, samples=653 lat (msec) : 10=1.73%, 20=10.45%, 50=22.53%, 100=18.26%, 250=39.36% lat (msec) : 500=7.42%, 750=0.23%, 2000=0.03% cpu : usr=0.05%, sys=1.07%, ctx=5369, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=70.6KiB/s (72.3kB/s), 17.5KiB/s-17.0KiB/s (17.0kB/s-18.4kB/s), io=23.4MiB (24.6MB), run=336443-340204msec WRITE: bw=73.9KiB/s (75.7kB/s), 18.5KiB/s-18.7KiB/s (18.9kB/s-19.2kB/s), io=24.6MiB (25.7MB), run=336443-340204msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145515: Sun Aug 23 02:05:06 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(5920KiB/36886msec) clat (usec): min=37, max=274429, avg=51385.18, stdev=47785.98 lat (usec): min=37, max=274430, avg=51386.21, stdev=47786.03 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 76], | 30.00th=[ 15270], 40.00th=[ 35390], 50.00th=[ 45876], 60.00th=[ 56886], | 70.00th=[ 68682], 80.00th=[ 86508], 90.00th=[110625], 95.00th=[141558], | 99.00th=[206570], 99.50th=[235930], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 350, per=24.99%, avg=161.20, stdev=76.02, samples=71 iops : min= 1, max= 21, avg= 9.30, stdev= 4.82, samples=71 write: IOPS=10, BW=173KiB/s (177kB/s)(6368KiB/36886msec); 0 zone resets clat (usec): min=1255, max=363984, avg=44732.40, stdev=54172.76 lat (usec): min=1257, max=363986, avg=44736.94, stdev=54173.12 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1729], 10.00th=[ 2180], 20.00th=[ 5014], | 30.00th=[ 9503], 40.00th=[ 15926], 50.00th=[ 23462], 60.00th=[ 38536], | 70.00th=[ 53216], 80.00th=[ 70779], 90.00th=[115868], 95.00th=[164627], | 99.00th=[248513], 99.50th=[346031], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 31, max= 382, per=25.42%, avg=172.36, stdev=79.40, samples=72 iops : min= 1, max= 23, avg=10.01, stdev= 5.02, samples=72 lat (usec) : 50=1.56%, 100=10.42%, 250=1.17%, 500=0.39% lat (msec) : 2=4.95%, 4=3.65%, 10=8.33%, 20=8.07%, 50=22.14% lat (msec) : 100=25.78%, 250=13.02%, 500=0.52% cpu : usr=0.06%, sys=4.70%, ctx=1336, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145516: Sun Aug 23 02:05:06 2026 read: IOPS=9, BW=155KiB/s (158kB/s)(5744KiB/37114msec) clat (usec): min=38, max=332104, avg=53487.36, stdev=48288.21 lat (usec): min=38, max=332104, avg=53493.84, stdev=48282.93 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 80], | 30.00th=[ 27132], 40.00th=[ 39584], 50.00th=[ 49546], 60.00th=[ 62129], | 70.00th=[ 72877], 80.00th=[ 85459], 90.00th=[114820], 95.00th=[141558], | 99.00th=[200279], 99.50th=[258999], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 28, max= 300, per=23.90%, avg=154.12, stdev=59.41, samples=72 iops : min= 1, max= 18, avg= 8.85, stdev= 3.75, samples=72 write: IOPS=11, BW=176KiB/s (181kB/s)(6544KiB/37114msec); 0 zone resets clat (usec): min=1369, max=295445, avg=43103.15, stdev=45586.69 lat (usec): min=1370, max=295446, avg=43107.32, stdev=45587.41 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1860], 10.00th=[ 2507], 20.00th=[ 5342], | 30.00th=[ 9634], 40.00th=[ 16188], 50.00th=[ 28967], 60.00th=[ 40633], | 70.00th=[ 55313], 80.00th=[ 74974], 90.00th=[108528], 95.00th=[135267], | 99.00th=[193987], 99.50th=[221250], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 30, max= 445, per=25.94%, avg=175.88, stdev=92.42, samples=72 iops : min= 1, max= 27, avg=10.24, stdev= 5.84, samples=72 lat (usec) : 50=1.30%, 100=9.38%, 250=1.30%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.52%, 4=4.82%, 10=8.20%, 20=7.29%, 50=22.14% lat (msec) : 100=28.91%, 250=12.11%, 500=0.39% cpu : usr=0.07%, sys=4.81%, ctx=1378, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145517: Sun Aug 23 02:05:06 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36822msec) clat (usec): min=36, max=243593, avg=49796.57, stdev=47990.09 lat (usec): min=36, max=243594, avg=49798.12, stdev=47990.39 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 75], | 30.00th=[ 2089], 40.00th=[ 33424], 50.00th=[ 45351], 60.00th=[ 55837], | 70.00th=[ 67634], 80.00th=[ 82314], 90.00th=[113771], 95.00th=[139461], | 99.00th=[191890], 99.50th=[221250], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 29, max= 421, per=26.46%, avg=170.68, stdev=80.14, samples=72 iops : min= 1, max= 26, avg= 9.89, stdev= 5.11, samples=72 write: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36822msec); 0 zone resets clat (usec): min=1339, max=359630, avg=45384.57, stdev=50226.65 lat (usec): min=1340, max=359632, avg=45395.38, stdev=50229.01 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1663], 10.00th=[ 2180], 20.00th=[ 5735], | 30.00th=[ 10159], 40.00th=[ 16712], 50.00th=[ 30278], 60.00th=[ 42730], | 70.00th=[ 58983], 80.00th=[ 78119], 90.00th=[111674], 95.00th=[141558], | 99.00th=[214959], 99.50th=[248513], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 421, per=24.02%, avg=162.85, stdev=81.02, samples=72 iops : min= 1, max= 26, avg= 9.39, stdev= 5.08, samples=72 lat (usec) : 50=1.56%, 100=11.72%, 250=1.30%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.82%, 4=3.65%, 10=6.64%, 20=8.72%, 50=20.96% lat (msec) : 100=27.21%, 250=13.02%, 500=0.13% cpu : usr=0.07%, sys=4.92%, ctx=1367, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145518: Sun Aug 23 02:05:06 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(6032KiB/35585msec) clat (usec): min=32, max=461691, avg=46315.09, stdev=48494.06 lat (usec): min=33, max=461692, avg=46321.82, stdev=48504.43 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 69], | 30.00th=[ 143], 40.00th=[ 27395], 50.00th=[ 39584], 60.00th=[ 50070], | 70.00th=[ 65274], 80.00th=[ 84411], 90.00th=[108528], 95.00th=[132645], | 99.00th=[175113], 99.50th=[193987], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 31, max= 409, per=26.15%, avg=168.65, stdev=87.24, samples=69 iops : min= 1, max= 25, avg= 9.78, stdev= 5.50, samples=69 write: IOPS=10, BW=176KiB/s (180kB/s)(6256KiB/35585msec); 0 zone resets clat (usec): min=1384, max=236066, avg=45409.84, stdev=51372.43 lat (usec): min=1386, max=236069, avg=45418.59, stdev=51373.19 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2073], 10.00th=[ 3261], 20.00th=[ 6521], | 30.00th=[ 10028], 40.00th=[ 14353], 50.00th=[ 22414], 60.00th=[ 35914], | 70.00th=[ 57410], 80.00th=[ 83362], 90.00th=[123208], 95.00th=[160433], | 99.00th=[214959], 99.50th=[227541], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 30, max= 414, per=26.33%, avg=178.53, stdev=78.08, samples=68 iops : min= 1, max= 25, avg=10.41, stdev= 4.95, samples=68 lat (usec) : 50=1.82%, 100=11.98%, 250=1.43%, 500=0.26%, 750=0.13% lat (msec) : 2=2.21%, 4=4.43%, 10=9.24%, 20=10.81%, 50=20.96% lat (msec) : 100=23.05%, 250=13.54%, 500=0.13% cpu : usr=0.07%, sys=4.64%, ctx=1285, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=645KiB/s (661kB/s), 155KiB/s-170KiB/s (158kB/s-174kB/s), io=23.4MiB (24.5MB), run=35585-37114msec WRITE: bw=679KiB/s (695kB/s), 164KiB/s-176KiB/s (168kB/s-181kB/s), io=24.6MiB (25.8MB), run=35585-37114msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145520: Sun Aug 23 02:06:02 2026 read: IOPS=4, BW=65.3KiB/s (66.8kB/s)(5920KiB/90694msec) clat (msec): min=6, max=493, avg=48.43, stdev=53.61 lat (msec): min=6, max=493, avg=48.43, stdev=53.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 104], 95.00th=[ 146], | 99.00th=[ 338], 99.50th=[ 347], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 287, per=29.80%, avg=78.39, stdev=52.09, samples=148 iops : min= 1, max= 17, avg= 4.10, stdev= 3.31, samples=148 write: IOPS=4, BW=70.2KiB/s (71.9kB/s)(6368KiB/90694msec); 0 zone resets clat (msec): min=43, max=718, avg=182.49, stdev=94.44 lat (msec): min=43, max=718, avg=182.50, stdev=94.44 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 79], 10.00th=[ 93], 20.00th=[ 111], | 30.00th=[ 126], 40.00th=[ 144], 50.00th=[ 161], 60.00th=[ 180], | 70.00th=[ 199], 80.00th=[ 241], 90.00th=[ 313], 95.00th=[ 363], | 99.00th=[ 584], 99.50th=[ 659], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 30, max= 159, per=26.39%, avg=73.11, stdev=34.05, samples=171 iops : min= 1, max= 9, avg= 3.75, stdev= 2.20, samples=171 lat (msec) : 10=1.04%, 20=10.42%, 50=24.48%, 100=14.32%, 250=39.84% lat (msec) : 500=9.24%, 750=0.65% cpu : usr=0.03%, sys=1.09%, ctx=1356, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145521: Sun Aug 23 02:06:02 2026 read: IOPS=3, BW=63.2KiB/s (64.7kB/s)(5744KiB/90910msec) clat (msec): min=7, max=401, avg=45.95, stdev=47.54 lat (msec): min=7, max=401, avg=45.96, stdev=47.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 106], 95.00th=[ 136], | 99.00th=[ 259], 99.50th=[ 330], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 28, max= 255, per=30.85%, avg=81.14, stdev=50.90, samples=138 iops : min= 1, max= 15, avg= 4.27, stdev= 3.25, samples=138 write: IOPS=4, BW=71.0KiB/s (73.7kB/s)(6544KiB/90910msec); 0 zone resets clat (msec): min=49, max=633, avg=181.56, stdev=91.69 lat (msec): min=49, max=633, avg=181.56, stdev=91.69 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 80], 10.00th=[ 94], 20.00th=[ 114], | 30.00th=[ 128], 40.00th=[ 142], 50.00th=[ 157], 60.00th=[ 176], | 70.00th=[ 203], 80.00th=[ 243], 90.00th=[ 305], 95.00th=[ 355], | 99.00th=[ 518], 99.50th=[ 550], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 30, max= 191, per=26.53%, avg=73.48, stdev=33.18, samples=174 iops : min= 1, max= 11, avg= 3.78, stdev= 2.13, samples=174 lat (msec) : 10=1.43%, 20=10.29%, 50=23.44%, 100=14.58%, 250=40.10% lat (msec) : 500=9.24%, 750=0.91% cpu : usr=0.04%, sys=1.01%, ctx=1307, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145522: Sun Aug 23 02:06:02 2026 read: IOPS=4, BW=71.2KiB/s (72.9kB/s)(6256KiB/87894msec) clat (msec): min=8, max=310, avg=41.73, stdev=42.14 lat (msec): min=8, max=310, avg=41.73, stdev=42.14 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 48], 90.00th=[ 79], 95.00th=[ 117], | 99.00th=[ 247], 99.50th=[ 279], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 318, per=33.67%, avg=88.56, stdev=62.95, samples=139 iops : min= 1, max= 19, avg= 4.73, stdev= 3.93, samples=139 write: IOPS=4, BW=68.6KiB/s (70.3kB/s)(6032KiB/87894msec); 0 zone resets clat (msec): min=46, max=733, avg=189.55, stdev=107.18 lat (msec): min=46, max=733, avg=189.56, stdev=107.18 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 77], 10.00th=[ 93], 20.00th=[ 110], | 30.00th=[ 131], 40.00th=[ 150], 50.00th=[ 163], 60.00th=[ 180], | 70.00th=[ 197], 80.00th=[ 247], 90.00th=[ 317], 95.00th=[ 401], | 99.00th=[ 625], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 30, max= 159, per=25.32%, avg=70.14, stdev=31.36, samples=167 iops : min= 1, max= 9, avg= 3.57, stdev= 2.04, samples=167 lat (msec) : 10=0.52%, 20=13.41%, 50=28.13%, 100=11.20%, 250=36.59% lat (msec) : 500=8.85%, 750=1.30% cpu : usr=0.04%, sys=1.14%, ctx=1329, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145523: Sun Aug 23 02:06:02 2026 read: IOPS=4, BW=67.4KiB/s (68.0kB/s)(6032KiB/89539msec) clat (msec): min=8, max=356, avg=45.89, stdev=47.67 lat (msec): min=8, max=356, avg=45.89, stdev=47.67 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 100], 95.00th=[ 153], | 99.00th=[ 255], 99.50th=[ 279], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 288, per=31.31%, avg=82.35, stdev=59.13, samples=142 iops : min= 1, max= 18, avg= 4.36, stdev= 3.74, samples=142 write: IOPS=4, BW=69.9KiB/s (71.5kB/s)(6256KiB/89539msec); 0 zone resets clat (msec): min=42, max=836, avg=184.62, stdev=97.13 lat (msec): min=42, max=836, avg=184.63, stdev=97.13 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 80], 10.00th=[ 94], 20.00th=[ 115], | 30.00th=[ 129], 40.00th=[ 142], 50.00th=[ 163], 60.00th=[ 182], | 70.00th=[ 201], 80.00th=[ 247], 90.00th=[ 300], 95.00th=[ 355], | 99.00th=[ 518], 99.50th=[ 735], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 30, max= 191, per=25.80%, avg=71.47, stdev=33.13, samples=171 iops : min= 1, max= 11, avg= 3.68, stdev= 2.12, samples=171 lat (msec) : 10=0.65%, 20=12.50%, 50=23.31%, 100=14.32%, 250=39.06% lat (msec) : 500=9.51%, 750=0.52%, 1000=0.13% cpu : usr=0.04%, sys=1.05%, ctx=1361, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=263KiB/s (270kB/s), 63.2KiB/s-71.2KiB/s (64.7kB/s-72.9kB/s), io=23.4MiB (24.5MB), run=87894-90910msec WRITE: bw=277KiB/s (284kB/s), 68.6KiB/s-71.0KiB/s (70.3kB/s-73.7kB/s), io=24.6MiB (25.8MB), run=87894-90910msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145548: Sun Aug 23 02:06:23 2026 read: IOPS=0, BW=1001KiB/s (1025kB/s)(7168KiB/7160msec) clat (msec): min=99, max=2449, avg=619.30, stdev=818.57 lat (msec): min=99, max=2449, avg=619.30, stdev=818.57 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 228], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 330], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 550], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 2031, max= 4096, per=100.00%, avg=2970.50, stdev=1091.31, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=715KiB/s (732kB/s)(5120KiB/7160msec); 0 zone resets clat (msec): min=137, max=1198, avg=488.35, stdev=411.48 lat (msec): min=137, max=1198, avg=488.42, stdev=411.48 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1917, max= 4055, per=62.62%, avg=2507.50, stdev=1033.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.51%, ctx=442, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145549: Sun Aug 23 02:06:23 2026 read: IOPS=0, BW=324KiB/s (332kB/s)(2048KiB/6313msec) clat (usec): min=575, max=331553, avg=166064.18, stdev=234036.91 lat (usec): min=576, max=331555, avg=166065.92, stdev=234038.04 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 578], 60.00th=[333448], | 70.00th=[333448], 80.00th=[333448], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 1633, max= 2039, per=64.20%, avg=1836.00, stdev=287.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1622KiB/s (1661kB/s)(10.0MiB/6313msec); 0 zone resets clat (msec): min=112, max=3052, avg=574.56, stdev=908.53 lat (msec): min=112, max=3052, avg=574.75, stdev=908.50 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 133], | 30.00th=[ 140], 40.00th=[ 155], 50.00th=[ 184], 60.00th=[ 207], | 70.00th=[ 380], 80.00th=[ 405], 90.00th=[ 978], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 2027, max= 6119, per=91.52%, avg=3664.60, stdev=1707.28, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.19%, ctx=121, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145550: Sun Aug 23 02:06:23 2026 read: IOPS=1, BW=1149KiB/s (1176kB/s)(6144KiB/5348msec) clat (usec): min=560, max=430347, avg=150441.18, stdev=179687.11 lat (usec): min=561, max=430348, avg=150442.27, stdev=179687.02 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 2573], 50.00th=[ 2573], 60.00th=[200279], | 70.00th=[267387], 80.00th=[267387], 90.00th=[429917], 95.00th=[429917], | 99.00th=[429917], 99.50th=[429917], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 4055, max= 6144, per=100.00%, avg=5099.50, stdev=1477.15, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1149KiB/s (1176kB/s)(6144KiB/5348msec); 0 zone resets clat (msec): min=168, max=2735, avg=723.05, stdev=997.49 lat (msec): min=168, max=2735, avg=723.12, stdev=997.50 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 368], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1546, max= 4096, per=57.16%, avg=2288.80, stdev=1025.92, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.70%, ctx=142, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145551: Sun Aug 23 02:06:23 2026 read: IOPS=0, BW=750KiB/s (768kB/s)(5120KiB/6828msec) clat (usec): min=479, max=1055.8k, avg=388875.76, stdev=450320.79 lat (usec): min=480, max=1055.8k, avg=388876.97, stdev=450320.62 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], | 20.00th=[ 482], 30.00th=[ 2671], 40.00th=[ 2671], | 50.00th=[ 270533], 60.00th=[ 270533], 70.00th=[ 616563], | 80.00th=[ 616563], 90.00th=[1052771], 95.00th=[1052771], | 99.00th=[1052771], 99.50th=[1052771], 99.90th=[1052771], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 1917, max= 4055, per=93.28%, avg=2667.67, stdev=1202.82, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1050KiB/s (1075kB/s)(7168KiB/6828msec); 0 zone resets clat (msec): min=106, max=2961, avg=654.92, stdev=1036.77 lat (msec): min=106, max=2962, avg=654.99, stdev=1036.79 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 128], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 184], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 651], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1858, max= 4096, per=75.15%, avg=3009.00, stdev=1233.53, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=16.67%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.06%, sys=5.65%, ctx=127, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2860KiB/s (2929kB/s), 324KiB/s-1149KiB/s (332kB/s-1176kB/s), io=20.0MiB (20.0MB), run=5348-7160msec WRITE: bw=4004KiB/s (4101kB/s), 715KiB/s-1622KiB/s (732kB/s-1661kB/s), io=28.0MiB (29.4MB), run=5348-7160msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145544: Sun Aug 23 02:06:24 2026 read: IOPS=0, BW=1022KiB/s (1046kB/s)(7168KiB/7015msec) clat (msec): min=127, max=2304, avg=572.12, stdev=779.70 lat (msec): min=127, max=2304, avg=572.12, stdev=779.70 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 142], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 317], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 575], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1910, max= 3351, per=90.80%, avg=2265.40, stdev=609.01, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=730KiB/s (747kB/s)(5120KiB/7015msec); 0 zone resets clat (msec): min=277, max=1318, avg=545.57, stdev=435.82 lat (msec): min=282, max=1318, avg=546.62, stdev=435.06 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1984, max= 4079, per=72.27%, avg=2524.25, stdev=1036.63, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.08%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145545: Sun Aug 23 02:06:24 2026 read: IOPS=0, BW=279KiB/s (286kB/s)(2048KiB/7336msec) clat (msec): min=117, max=362, avg=239.97, stdev=173.42 lat (msec): min=117, max=362, avg=239.98, stdev=173.42 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1627, max= 2027, per=73.23%, avg=1827.00, stdev=282.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1396KiB/s (1429kB/s)(10.0MiB/7336msec); 0 zone resets clat (msec): min=194, max=3146, avg=680.00, stdev=911.81 lat (msec): min=194, max=3146, avg=680.10, stdev=911.81 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 234], 40.00th=[ 271], 50.00th=[ 292], 60.00th=[ 388], | 70.00th=[ 418], 80.00th=[ 510], 90.00th=[ 1150], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1627, max= 4087, per=72.69%, avg=2539.14, stdev=1045.13, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.51%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145546: Sun Aug 23 02:06:24 2026 read: IOPS=0, BW=792KiB/s (811kB/s)(6144KiB/7761msec) clat (msec): min=66, max=1486, avg=390.86, stdev=547.08 lat (msec): min=66, max=1486, avg=390.87, stdev=547.08 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 184], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 2019, max= 4023, per=100.00%, avg=2527.00, stdev=997.37, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=792KiB/s (811kB/s)(6144KiB/7761msec); 0 zone resets clat (msec): min=262, max=3092, avg=871.95, stdev=1106.55 lat (msec): min=262, max=3092, avg=872.13, stdev=1106.50 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 435], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1910, max= 4079, per=69.16%, avg=2415.60, stdev=931.33, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.87%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145547: Sun Aug 23 02:06:24 2026 read: IOPS=0, BW=624KiB/s (639kB/s)(5120KiB/8208msec) clat (msec): min=102, max=1443, avg=395.78, stdev=586.94 lat (msec): min=102, max=1443, avg=395.78, stdev=586.94 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 127], 60.00th=[ 127], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 2019, max= 4079, per=100.00%, avg=2708.33, stdev=1187.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=873KiB/s (894kB/s)(7168KiB/8208msec); 0 zone resets clat (msec): min=193, max=3061, avg=829.53, stdev=1063.87 lat (msec): min=193, max=3062, avg=829.71, stdev=1064.12 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 226], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 326], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 1351], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 2011, max= 4055, per=72.40%, avg=2529.00, stdev=1017.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 2000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=1.66%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2495KiB/s (2555kB/s), 279KiB/s-1022KiB/s (286kB/s-1046kB/s), io=20.0MiB (20.0MB), run=7015-8208msec WRITE: bw=3493KiB/s (3577kB/s), 730KiB/s-1396KiB/s (747kB/s-1429kB/s), io=28.0MiB (29.4MB), run=7015-8208msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145558: Sun Aug 23 02:06:41 2026 read: IOPS=0, BW=4081KiB/s (4179kB/s)(12.0MiB/3011msec) clat (msec): min=686, max=1104, avg=940.83, stdev=223.09 lat (msec): min=686, max=1104, avg=940.83, stdev=223.09 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.20%, ctx=184, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145559: Sun Aug 23 02:06:41 2026 read: IOPS=0, BW=1168KiB/s (1196kB/s)(4096KiB/3508msec) clat (nsec): min=1111.7M, max=1111.7M, avg=1111713446.00, stdev= 0.00 lat (nsec): min=1111.7M, max=1111.7M, avg=1111715784.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2335KiB/s (2391kB/s)(8192KiB/3508msec); 0 zone resets clat (msec): min=843, max=1360, avg=1102.05, stdev=366.16 lat (msec): min=845, max=1361, avg=1103.52, stdev=364.50 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.02%, ctx=128, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145560: Sun Aug 23 02:06:41 2026 write: IOPS=0, BW=3008KiB/s (3080kB/s)(12.0MiB/4085msec); 0 zone resets clat (msec): min=345, max=2175, avg=1326.93, stdev=922.18 lat (msec): min=345, max=2176, avg=1328.11, stdev=922.45 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.55%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145561: Sun Aug 23 02:06:41 2026 write: IOPS=0, BW=3334KiB/s (3414kB/s)(12.0MiB/3686msec); 0 zone resets clat (msec): min=535, max=2190, avg=1170.84, stdev=892.05 lat (msec): min=535, max=2200, avg=1174.35, stdev=897.32 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.58%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4670KiB/s (4783kB/s), 1168KiB/s-4081KiB/s (1196kB/s-4179kB/s), io=16.0MiB (16.8MB), run=3011-3508msec WRITE: bw=8022KiB/s (8214kB/s), 2335KiB/s-3334KiB/s (2391kB/s-3414kB/s), io=32.0MiB (33.6MB), run=3508-4085msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145563: Sun Aug 23 02:06:41 2026 read: IOPS=0, BW=3033KiB/s (3105kB/s)(12.0MiB/4052msec) clat (msec): min=329, max=2486, avg=1325.54, stdev=1088.05 lat (msec): min=329, max=2486, avg=1325.55, stdev=1088.05 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.42%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145564: Sun Aug 23 02:06:41 2026 read: IOPS=0, BW=1012KiB/s (1036kB/s)(4096KiB/4047msec) clat (nsec): min=2195.4M, max=2195.4M, avg=2195393388.00, stdev= 0.00 lat (nsec): min=2195.4M, max=2195.4M, avg=2195405117.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2198], 5.00th=[ 2198], 10.00th=[ 2198], 20.00th=[ 2198], | 30.00th=[ 2198], 40.00th=[ 2198], 50.00th=[ 2198], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2024KiB/s (2073kB/s)(8192KiB/4047msec); 0 zone resets clat (msec): min=386, max=1448, avg=917.60, stdev=750.76 lat (msec): min=387, max=1448, avg=917.89, stdev=750.73 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.45%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145565: Sun Aug 23 02:06:41 2026 write: IOPS=0, BW=3206KiB/s (3283kB/s)(12.0MiB/3833msec); 0 zone resets clat (msec): min=401, max=2088, avg=1276.07, stdev=845.00 lat (msec): min=401, max=2088, avg=1276.47, stdev=845.18 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 7772, max= 8126, per=98.18%, avg=7949.00, stdev=250.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.96%, ctx=37, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145566: Sun Aug 23 02:06:41 2026 write: IOPS=0, BW=3873KiB/s (3966kB/s)(12.0MiB/3173msec); 0 zone resets clat (msec): min=511, max=1418, avg=1057.13, stdev=480.78 lat (msec): min=511, max=1419, avg=1057.39, stdev=480.86 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7420, max= 8126, per=96.01%, avg=7773.00, stdev=499.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.41%, ctx=39, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4043KiB/s (4140kB/s), 1012KiB/s-3033KiB/s (1036kB/s-3105kB/s), io=16.0MiB (16.8MB), run=4047-4052msec WRITE: bw=8097KiB/s (8291kB/s), 2024KiB/s-3873KiB/s (2073kB/s-3966kB/s), io=32.0MiB (33.6MB), run=3173-4047msec