== sanity test 398b: DIO and buffer IO race ============== 03:13:20 (1779693200) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.04665 s, 10.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180324: Mon May 25 03:15:44 2026 read: IOPS=11, BW=47.4KiB/s (48.5kB/s)(5992KiB/126481msec) clat (usec): min=35, max=709576, avg=47338.10, stdev=36818.02 lat (usec): min=36, max=709578, avg=47340.18, stdev=36818.24 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11469], 10.00th=[ 16909], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[170918], 99.50th=[214959], 99.90th=[375391], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 14, max= 103, per=24.80%, avg=46.87, stdev=17.88, samples=248 iops : min= 3, max= 25, avg=11.06, stdev= 4.50, samples=248 write: IOPS=12, BW=49.8KiB/s (50.0kB/s)(6296KiB/126481msec); 0 zone resets clat (usec): min=1044, max=207370, avg=35205.77, stdev=35126.77 lat (usec): min=1044, max=207371, avg=35213.45, stdev=35130.39 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1303], 10.00th=[ 1450], 20.00th=[ 3752], | 30.00th=[ 8848], 40.00th=[ 16909], 50.00th=[ 24773], 60.00th=[ 33817], | 70.00th=[ 46924], 80.00th=[ 63177], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[149947], 99.50th=[175113], 99.90th=[200279], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 7, max= 157, per=25.01%, avg=49.52, stdev=23.68, samples=247 iops : min= 1, max= 39, avg=11.74, stdev= 5.98, samples=247 lat (usec) : 50=0.29%, 100=1.37%, 250=0.07%, 500=0.03%, 1000=0.03% lat (msec) : 2=7.03%, 4=3.61%, 10=5.70%, 20=11.39%, 50=38.44% lat (msec) : 100=26.33%, 250=5.60%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=4.65%, ctx=6431, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180325: Mon May 25 03:15:44 2026 read: IOPS=11, BW=47.4KiB/s (48.5kB/s)(5940KiB/125330msec) clat (usec): min=33, max=631700, avg=47805.81, stdev=34590.76 lat (usec): min=33, max=631702, avg=47807.73, stdev=34590.91 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 13042], 10.00th=[ 18220], 20.00th=[ 23987], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[166724], 99.50th=[200279], 99.90th=[252707], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 6, max= 102, per=24.91%, avg=47.08, stdev=17.53, samples=246 iops : min= 1, max= 25, avg=11.12, stdev= 4.42, samples=246 write: IOPS=12, BW=50.6KiB/s (51.9kB/s)(6348KiB/125330msec); 0 zone resets clat (usec): min=944, max=314392, avg=34124.12, stdev=34955.11 lat (usec): min=945, max=314394, avg=34127.80, stdev=34954.88 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1483], 20.00th=[ 3621], | 30.00th=[ 7111], 40.00th=[ 15008], 50.00th=[ 23987], 60.00th=[ 33424], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[147850], 99.50th=[158335], 99.90th=[235930], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 165, per=25.45%, avg=50.40, stdev=24.96, samples=246 iops : min= 1, max= 41, avg=11.95, stdev= 6.27, samples=246 lat (usec) : 50=0.13%, 100=1.20%, 250=0.07%, 500=0.03%, 1000=0.07% lat (msec) : 2=6.87%, 4=4.07%, 10=7.06%, 20=10.19%, 50=38.44% lat (msec) : 100=26.11%, 250=5.66%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=4.59%, ctx=6407, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180326: Mon May 25 03:15:44 2026 read: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6028KiB/123226msec) clat (usec): min=34, max=245127, avg=45862.42, stdev=29704.89 lat (usec): min=34, max=245129, avg=45878.80, stdev=29721.36 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10945], 10.00th=[ 17695], 20.00th=[ 24249], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 53740], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[183501], 99.90th=[242222], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 15, max= 118, per=25.83%, avg=48.82, stdev=18.79, samples=241 iops : min= 3, max= 29, avg=11.56, stdev= 4.73, samples=241 write: IOPS=12, BW=50.8KiB/s (52.0kB/s)(6260KiB/123226msec); 0 zone resets clat (usec): min=952, max=643052, avg=34451.33, stdev=39098.83 lat (usec): min=954, max=643054, avg=34455.36, stdev=39097.59 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1287], 10.00th=[ 1467], 20.00th=[ 3195], | 30.00th=[ 6915], 40.00th=[ 16188], 50.00th=[ 25035], 60.00th=[ 33162], | 70.00th=[ 43779], 80.00th=[ 55837], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[160433], 99.50th=[202376], 99.90th=[254804], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 143, per=25.63%, avg=50.75, stdev=21.55, samples=241 iops : min= 1, max= 35, avg=12.04, stdev= 5.43, samples=241 lat (usec) : 50=0.26%, 100=1.66%, 250=0.03%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.93%, 4=4.69%, 10=6.12%, 20=8.76%, 50=41.80% lat (msec) : 100=24.38%, 250=5.14%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=4.59%, ctx=6318, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180327: Mon May 25 03:15:44 2026 read: IOPS=12, BW=48.1KiB/s (49.3kB/s)(6052KiB/125800msec) clat (usec): min=35, max=348387, avg=45423.78, stdev=30272.27 lat (usec): min=35, max=348388, avg=45426.93, stdev=30271.32 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11207], 10.00th=[ 16712], 20.00th=[ 22414], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 54789], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[152044], 99.50th=[181404], 99.90th=[267387], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 111, per=25.52%, avg=48.23, stdev=18.46, samples=245 iops : min= 1, max= 27, avg=11.41, stdev= 4.62, samples=245 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6236KiB/125800msec); 0 zone resets clat (usec): min=988, max=667078, avg=36498.85, stdev=40274.98 lat (usec): min=989, max=667079, avg=36500.60, stdev=40275.20 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1582], 20.00th=[ 3818], | 30.00th=[ 7635], 40.00th=[ 16450], 50.00th=[ 25560], 60.00th=[ 35914], | 70.00th=[ 47449], 80.00th=[ 62129], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[160433], 99.50th=[187696], 99.90th=[263193], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 119, per=24.87%, avg=49.23, stdev=21.48, samples=247 iops : min= 1, max= 29, avg=11.66, stdev= 5.41, samples=247 lat (usec) : 50=0.29%, 100=1.50%, 250=0.07%, 1000=0.03% lat (msec) : 2=6.32%, 4=3.97%, 10=6.84%, 20=10.74%, 50=38.05% lat (msec) : 100=26.69%, 250=5.34%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=4.47%, ctx=6336, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (194kB/s), 47.4KiB/s-48.9KiB/s (48.5kB/s-50.1kB/s), io=23.4MiB (24.6MB), run=123226-126481msec WRITE: bw=199KiB/s (204kB/s), 49.6KiB/s-50.8KiB/s (50.8kB/s-52.0kB/s), io=24.6MiB (25.7MB), run=123226-126481msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180319: Mon May 25 03:16:23 2026 read: IOPS=9, BW=36.7KiB/s (37.6kB/s)(5992KiB/163400msec) clat (msec): min=5, max=823, avg=43.35, stdev=43.87 lat (msec): min=5, max=823, avg=43.36, stdev=43.87 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 94], 95.00th=[ 129], | 99.00th=[ 188], 99.50th=[ 215], 99.90th=[ 296], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 127, per=25.58%, avg=37.09, stdev=25.16, samples=315 iops : min= 1, max= 31, avg= 8.62, stdev= 6.31, samples=315 write: IOPS=9, BW=38.5KiB/s (39.5kB/s)(6296KiB/163400msec); 0 zone resets clat (msec): min=10, max=363, avg=62.33, stdev=43.37 lat (msec): min=10, max=363, avg=62.33, stdev=43.37 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 123], 95.00th=[ 148], | 99.00th=[ 201], 99.50th=[ 243], 99.90th=[ 326], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 135, per=25.30%, avg=38.45, stdev=23.97, samples=319 iops : min= 1, max= 33, avg= 8.96, stdev= 6.03, samples=319 lat (msec) : 10=2.18%, 20=15.92%, 50=44.50%, 100=24.64%, 250=12.40% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=1.91%, ctx=4873, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180320: Mon May 25 03:16:23 2026 read: IOPS=9, BW=36.1KiB/s (36.9kB/s)(5940KiB/164690msec) clat (msec): min=5, max=727, avg=43.32, stdev=42.60 lat (msec): min=5, max=727, avg=43.32, stdev=42.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 128], | 99.00th=[ 201], 99.50th=[ 218], 99.90th=[ 271], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 126, per=25.46%, avg=36.92, stdev=25.84, samples=313 iops : min= 1, max= 31, avg= 8.58, stdev= 6.51, samples=313 write: IOPS=9, BW=38.5KiB/s (39.5kB/s)(6348KiB/164690msec); 0 zone resets clat (msec): min=9, max=389, avg=63.00, stdev=47.13 lat (msec): min=9, max=389, avg=63.00, stdev=47.13 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 127], 95.00th=[ 159], | 99.00th=[ 234], 99.50th=[ 262], 99.90th=[ 347], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 135, per=25.34%, avg=38.51, stdev=23.87, samples=320 iops : min= 1, max= 33, avg= 8.98, stdev= 5.99, samples=320 lat (msec) : 10=2.25%, 20=15.79%, 50=44.53%, 100=24.84%, 250=12.21% lat (msec) : 500=0.36%, 750=0.03% cpu : usr=0.06%, sys=1.86%, ctx=4854, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180321: Mon May 25 03:16:23 2026 read: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6028KiB/165229msec) clat (msec): min=4, max=287, avg=44.21, stdev=40.12 lat (msec): min=4, max=287, avg=44.22, stdev=40.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 69], 90.00th=[ 102], 95.00th=[ 134], | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 253], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 183, per=25.22%, avg=36.57, stdev=25.73, samples=320 iops : min= 1, max= 45, avg= 8.49, stdev= 6.44, samples=320 write: IOPS=9, BW=37.9KiB/s (38.8kB/s)(6260KiB/165229msec); 0 zone resets clat (msec): min=10, max=754, avg=62.78, stdev=47.90 lat (msec): min=10, max=754, avg=62.79, stdev=47.90 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 70], 80.00th=[ 93], 90.00th=[ 126], 95.00th=[ 155], | 99.00th=[ 213], 99.50th=[ 253], 99.90th=[ 338], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 120, per=24.71%, avg=37.55, stdev=23.91, samples=323 iops : min= 1, max= 30, avg= 8.74, stdev= 6.01, samples=323 lat (msec) : 10=2.57%, 20=15.69%, 50=43.29%, 100=24.67%, 250=13.41% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=2.00%, ctx=5003, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180322: Mon May 25 03:16:23 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(6052KiB/163952msec) clat (msec): min=5, max=269, avg=43.41, stdev=39.52 lat (msec): min=5, max=269, avg=43.42, stdev=39.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 95], 95.00th=[ 130], | 99.00th=[ 207], 99.50th=[ 220], 99.90th=[ 253], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 191, per=25.99%, avg=37.68, stdev=26.42, samples=313 iops : min= 1, max= 47, avg= 8.76, stdev= 6.65, samples=313 write: IOPS=9, BW=38.0KiB/s (38.9kB/s)(6236KiB/163952msec); 0 zone resets clat (msec): min=11, max=751, avg=62.82, stdev=47.00 lat (msec): min=11, max=751, avg=62.82, stdev=47.00 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 74], 80.00th=[ 91], 90.00th=[ 121], 95.00th=[ 144], | 99.00th=[ 228], 99.50th=[ 255], 99.90th=[ 393], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=38.09, stdev=23.32, samples=319 iops : min= 1, max= 25, avg= 8.87, stdev= 5.86, samples=319 lat (msec) : 10=2.21%, 20=15.66%, 50=44.11%, 100=25.23%, 250=12.40% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.05%, sys=1.94%, ctx=4819, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=145KiB/s (149kB/s), 36.1KiB/s-36.9KiB/s (36.9kB/s-37.8kB/s), io=23.4MiB (24.6MB), run=163400-165229msec WRITE: bw=152KiB/s (156kB/s), 37.9KiB/s-38.5KiB/s (38.8kB/s-39.5kB/s), io=24.6MiB (25.7MB), run=163400-165229msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180373: Mon May 25 03:17:11 2026 read: IOPS=11, BW=179KiB/s (184kB/s)(5920KiB/33023msec) clat (usec): min=38, max=227140, avg=49091.25, stdev=33012.20 lat (usec): min=38, max=227141, avg=49093.62, stdev=33011.56 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 63], 10.00th=[ 9503], 20.00th=[ 23462], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 44827], 60.00th=[ 50594], | 70.00th=[ 58983], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[104334], | 99.00th=[152044], 99.50th=[173016], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 62, max= 384, per=26.68%, avg=179.80, stdev=71.63, samples=65 iops : min= 3, max= 24, avg=10.48, stdev= 4.50, samples=65 write: IOPS=12, BW=193KiB/s (197kB/s)(6368KiB/33023msec); 0 zone resets clat (usec): min=1299, max=243827, avg=36100.29, stdev=39212.19 lat (usec): min=1302, max=243829, avg=36113.67, stdev=39205.96 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1909], 10.00th=[ 3032], 20.00th=[ 5669], | 30.00th=[ 8848], 40.00th=[ 14091], 50.00th=[ 22414], 60.00th=[ 32113], | 70.00th=[ 43779], 80.00th=[ 58983], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[189793], 99.50th=[210764], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 22, max= 475, per=27.26%, avg=193.26, stdev=84.30, samples=65 iops : min= 1, max= 29, avg=11.32, stdev= 5.33, samples=65 lat (usec) : 50=0.91%, 100=2.99%, 250=0.39%, 500=0.13% lat (msec) : 2=2.73%, 4=4.69%, 10=10.16%, 20=10.81%, 50=33.33% lat (msec) : 100=27.60%, 250=6.25% cpu : usr=0.05%, sys=5.18%, ctx=1642, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180374: Mon May 25 03:17:11 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(5744KiB/35500msec) clat (usec): min=48, max=189800, avg=51225.08, stdev=33415.69 lat (usec): min=49, max=189801, avg=51227.48, stdev=33416.57 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 16712], 20.00th=[ 25822], | 30.00th=[ 34341], 40.00th=[ 39584], 50.00th=[ 44303], 60.00th=[ 51643], | 70.00th=[ 61604], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[160433], 99.50th=[183501], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 21, max= 319, per=23.94%, avg=161.38, stdev=70.82, samples=69 iops : min= 1, max= 19, avg= 9.30, stdev= 4.46, samples=69 write: IOPS=11, BW=184KiB/s (189kB/s)(6544KiB/35500msec); 0 zone resets clat (usec): min=1527, max=261857, avg=41539.14, stdev=41957.74 lat (usec): min=1529, max=261860, avg=41545.40, stdev=41961.98 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2343], 10.00th=[ 3589], 20.00th=[ 6980], | 30.00th=[ 10814], 40.00th=[ 19268], 50.00th=[ 28443], 60.00th=[ 39060], | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[102237], 95.00th=[130548], | 99.00th=[170918], 99.50th=[200279], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 479, per=25.79%, avg=182.88, stdev=85.60, samples=69 iops : min= 1, max= 29, avg=10.65, stdev= 5.42, samples=69 lat (usec) : 50=0.13%, 100=2.99%, 250=0.13%, 500=0.13% lat (msec) : 2=2.08%, 4=3.65%, 10=9.24%, 20=8.85%, 50=35.42% lat (msec) : 100=27.60%, 250=9.51%, 500=0.26% cpu : usr=0.05%, sys=4.75%, ctx=1757, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180375: Mon May 25 03:17:11 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(6256KiB/34249msec) clat (usec): min=39, max=223004, avg=49687.93, stdev=33627.92 lat (usec): min=39, max=223006, avg=49689.28, stdev=33627.97 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 17171], 20.00th=[ 25035], | 30.00th=[ 32113], 40.00th=[ 37487], 50.00th=[ 42730], 60.00th=[ 51119], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[105382], | 99.00th=[185598], 99.50th=[214959], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 43, max= 350, per=27.17%, avg=183.15, stdev=69.76, samples=67 iops : min= 2, max= 21, avg=10.67, stdev= 4.40, samples=67 write: IOPS=11, BW=176KiB/s (180kB/s)(6032KiB/34249msec); 0 zone resets clat (usec): min=1358, max=221616, avg=38344.97, stdev=39245.08 lat (usec): min=1361, max=221619, avg=38383.29, stdev=39236.16 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1975], 10.00th=[ 3228], 20.00th=[ 6849], | 30.00th=[ 10814], 40.00th=[ 16581], 50.00th=[ 27395], 60.00th=[ 36439], | 70.00th=[ 45351], 80.00th=[ 58983], 90.00th=[ 91751], 95.00th=[127402], | 99.00th=[181404], 99.50th=[214959], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 383, per=24.75%, avg=175.45, stdev=81.77, samples=66 iops : min= 1, max= 23, avg=10.20, stdev= 5.14, samples=66 lat (usec) : 50=0.39%, 100=3.52%, 250=0.13% lat (msec) : 2=2.60%, 4=3.65%, 10=8.20%, 20=8.72%, 50=37.89% lat (msec) : 100=27.60%, 250=7.29% cpu : usr=0.04%, sys=5.11%, ctx=1726, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180376: Mon May 25 03:17:11 2026 read: IOPS=11, BW=178KiB/s (182kB/s)(6032KiB/33895msec) clat (usec): min=37, max=212118, avg=47803.03, stdev=32038.81 lat (usec): min=37, max=212120, avg=47811.55, stdev=32038.67 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 83], 20.00th=[ 23987], | 30.00th=[ 31327], 40.00th=[ 38011], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[137364], 99.50th=[168821], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 63, max= 318, per=26.72%, avg=180.12, stdev=71.14, samples=65 iops : min= 3, max= 19, avg=10.49, stdev= 4.47, samples=65 write: IOPS=11, BW=185KiB/s (189kB/s)(6256KiB/33895msec); 0 zone resets clat (usec): min=1366, max=263502, avg=39800.09, stdev=45571.69 lat (usec): min=1369, max=263502, avg=39804.99, stdev=45569.94 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2147], 10.00th=[ 3458], 20.00th=[ 6390], | 30.00th=[ 9503], 40.00th=[ 15008], 50.00th=[ 22676], 60.00th=[ 31589], | 70.00th=[ 46924], 80.00th=[ 68682], 90.00th=[105382], 95.00th=[135267], | 99.00th=[221250], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 574, per=26.51%, avg=187.92, stdev=85.88, samples=65 iops : min= 1, max= 35, avg=10.98, stdev= 5.45, samples=65 lat (usec) : 50=0.52%, 100=4.95%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=2.47%, 4=4.56%, 10=9.24%, 20=9.24%, 50=33.46% lat (msec) : 100=26.56%, 250=8.33%, 500=0.26% cpu : usr=0.05%, sys=4.85%, ctx=1578, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=675KiB/s (691kB/s), 162KiB/s-183KiB/s (166kB/s-187kB/s), io=23.4MiB (24.5MB), run=33023-35500msec WRITE: bw=710KiB/s (727kB/s), 176KiB/s-193KiB/s (180kB/s-197kB/s), io=24.6MiB (25.8MB), run=33023-35500msec fio: pid=180369, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=180368: Mon May 25 03:17:23 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5920KiB/46838msec) clat (msec): min=5, max=414, avg=50.82, stdev=43.46 lat (msec): min=5, max=414, avg=50.82, stdev=43.46 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 44], | 70.00th=[ 52], 80.00th=[ 67], 90.00th=[ 96], 95.00th=[ 128], | 99.00th=[ 234], 99.50th=[ 334], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 31, max= 351, per=27.34%, avg=129.31, stdev=80.86, samples=89 iops : min= 1, max= 21, avg= 7.30, stdev= 5.12, samples=89 write: IOPS=8, BW=136KiB/s (139kB/s)(6368KiB/46838msec); 0 zone resets clat (msec): min=14, max=339, avg=70.20, stdev=53.12 lat (msec): min=14, max=339, avg=70.20, stdev=53.12 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 36], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 66], | 70.00th=[ 81], 80.00th=[ 103], 90.00th=[ 148], 95.00th=[ 180], | 99.00th=[ 255], 99.50th=[ 296], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 384, per=27.55%, avg=135.28, stdev=79.32, samples=92 iops : min= 1, max= 24, avg= 7.67, stdev= 5.03, samples=92 lat (msec) : 10=0.26%, 20=6.38%, 50=51.17%, 100=26.95%, 250=14.32% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=2.09%, ctx=1390, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=180369: Mon May 25 03:17:23 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(4160KiB/39905msec) clat (msec): min=10, max=273, avg=59.52, stdev=45.94 lat (msec): min=10, max=273, avg=59.52, stdev=45.94 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 53], | 70.00th=[ 69], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 157], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 23, max= 319, per=23.71%, avg=112.17, stdev=70.05, samples=71 iops : min= 1, max= 19, avg= 6.21, stdev= 4.40, samples=71 write: IOPS=7, BW=113KiB/s (116kB/s)(4528KiB/39905msec); 0 zone resets clat (msec): min=13, max=298, avg=85.55, stdev=54.85 lat (msec): min=13, max=298, avg=85.55, stdev=54.85 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 49], 40.00th=[ 59], 50.00th=[ 69], 60.00th=[ 86], | 70.00th=[ 109], 80.00th=[ 128], 90.00th=[ 169], 95.00th=[ 201], | 99.00th=[ 247], 99.50th=[ 259], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 288, per=23.68%, avg=116.26, stdev=61.12, samples=76 iops : min= 1, max= 18, avg= 6.49, stdev= 3.90, samples=76 lat (msec) : 20=6.62%, 50=36.95%, 100=31.43%, 250=24.26%, 500=0.55% cpu : usr=0.02%, sys=1.75%, ctx=873, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=261,283,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180370: Mon May 25 03:17:23 2026 read: IOPS=8, BW=135KiB/s (138kB/s)(6256KiB/46367msec) clat (msec): min=8, max=265, avg=49.93, stdev=40.07 lat (msec): min=8, max=265, avg=49.94, stdev=40.07 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 102], 95.00th=[ 144], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 30, max= 476, per=29.25%, avg=138.35, stdev=94.92, samples=89 iops : min= 1, max= 29, avg= 7.87, stdev= 5.97, samples=89 write: IOPS=8, BW=130KiB/s (133kB/s)(6032KiB/46367msec); 0 zone resets clat (msec): min=11, max=343, avg=70.33, stdev=53.54 lat (msec): min=11, max=343, avg=70.34, stdev=53.54 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 63], | 70.00th=[ 84], 80.00th=[ 113], 90.00th=[ 142], 95.00th=[ 174], | 99.00th=[ 259], 99.50th=[ 275], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 448, per=26.24%, avg=128.84, stdev=76.24, samples=91 iops : min= 1, max= 28, avg= 7.27, stdev= 4.85, samples=91 lat (msec) : 10=0.78%, 20=9.77%, 50=48.31%, 100=23.96%, 250=16.41% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.99%, ctx=1386, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180372: Mon May 25 03:17:23 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(6032KiB/47207msec) clat (msec): min=6, max=273, avg=53.24, stdev=45.17 lat (msec): min=6, max=273, avg=53.24, stdev=45.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 77], 90.00th=[ 116], 95.00th=[ 157], | 99.00th=[ 215], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 382, per=26.79%, avg=126.72, stdev=80.76, samples=90 iops : min= 1, max= 23, avg= 7.13, stdev= 5.08, samples=90 write: IOPS=8, BW=133KiB/s (136kB/s)(6256KiB/47207msec); 0 zone resets clat (msec): min=12, max=338, avg=68.63, stdev=53.69 lat (msec): min=12, max=338, avg=68.64, stdev=53.69 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 62], | 70.00th=[ 79], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 163], | 99.00th=[ 251], 99.50th=[ 334], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 416, per=26.61%, avg=130.65, stdev=81.24, samples=91 iops : min= 1, max= 26, avg= 7.38, stdev= 5.16, samples=91 lat (msec) : 10=1.30%, 20=8.33%, 50=49.09%, 100=23.96%, 250=16.41% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.94%, ctx=1399, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=474KiB/s (485kB/s), 104KiB/s-135KiB/s (107kB/s-138kB/s), io=21.8MiB (22.9MB), run=39905-47207msec WRITE: bw=491KiB/s (503kB/s), 113KiB/s-136KiB/s (116kB/s-139kB/s), io=22.6MiB (23.7MB), run=39905-47207msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180400: Mon May 25 03:17:38 2026 read: IOPS=1, BW=1287KiB/s (1318kB/s)(7168KiB/5569msec) clat (usec): min=1604, max=4025.2k, avg=629097.25, stdev=1500149.80 lat (usec): min=1605, max=4025.2k, avg=629098.70, stdev=1500149.68 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1598], 10.00th=[ 1598], | 20.00th=[ 1614], 30.00th=[ 2802], 40.00th=[ 2802], | 50.00th=[ 4686], 60.00th=[ 145753], 70.00th=[ 145753], | 80.00th=[ 223347], 90.00th=[4009755], 95.00th=[4009755], | 99.00th=[4009755], 99.50th=[4009755], 99.90th=[4009755], | 99.95th=[4009755], 99.99th=[4009755] bw ( KiB/s): min= 3065, max= 6131, per=100.00%, avg=4598.00, stdev=2167.99, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=0, BW=919KiB/s (941kB/s)(5120KiB/5569msec); 0 zone resets clat (msec): min=110, max=370, avg=209.40, stdev=99.81 lat (msec): min=110, max=370, avg=209.47, stdev=99.81 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2043, max= 4087, per=63.72%, avg=3065.00, stdev=1445.33, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 2=16.67%, 4=8.33%, 10=8.33%, 250=50.00%, 500=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=6.99%, ctx=445, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180401: Mon May 25 03:17:38 2026 read: IOPS=0, BW=344KiB/s (352kB/s)(2048KiB/5960msec) clat (msec): min=170, max=229, avg=199.82, stdev=41.61 lat (msec): min=170, max=229, avg=199.83, stdev=41.61 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 1492, max= 2027, per=51.21%, avg=1759.50, stdev=378.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1718KiB/s (1759kB/s)(10.0MiB/5960msec); 0 zone resets clat (msec): min=102, max=2458, avg=531.88, stdev=712.50 lat (msec): min=102, max=2458, avg=531.99, stdev=712.49 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 112], | 30.00th=[ 165], 40.00th=[ 186], 50.00th=[ 228], 60.00th=[ 268], | 70.00th=[ 485], 80.00th=[ 514], 90.00th=[ 810], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1961, max= 6083, per=54.12%, avg=2603.29, stdev=1534.67, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (msec) : 250=58.33%, 500=16.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.05%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180402: Mon May 25 03:17:38 2026 read: IOPS=1, BW=1051KiB/s (1076kB/s)(6144KiB/5847msec) clat (usec): min=440, max=384410, avg=169875.80, stdev=157549.87 lat (usec): min=441, max=384411, avg=169877.12, stdev=157549.86 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[130548], 50.00th=[130548], 60.00th=[198181], | 70.00th=[304088], 80.00th=[304088], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 2043, max= 4063, per=97.29%, avg=3343.00, stdev=1128.01, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1051KiB/s (1076kB/s)(6144KiB/5847msec); 0 zone resets clat (msec): min=118, max=2607, avg=761.56, stdev=935.11 lat (msec): min=118, max=2607, avg=761.62, stdev=935.09 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 481], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1961, max= 4087, per=50.58%, avg=2433.00, stdev=925.24, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.46%, ctx=127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180403: Mon May 25 03:17:38 2026 read: IOPS=0, BW=885KiB/s (906kB/s)(5120KiB/5788msec) clat (usec): min=517, max=234232, avg=122261.16, stdev=112728.08 lat (usec): min=519, max=234236, avg=122262.61, stdev=112728.44 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 519], | 30.00th=[ 545], 40.00th=[ 545], 50.00th=[185598], 60.00th=[185598], | 70.00th=[189793], 80.00th=[189793], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1238KiB/s (1268kB/s)(7168KiB/5788msec); 0 zone resets clat (msec): min=183, max=2528, avg=699.25, stdev=827.15 lat (msec): min=183, max=2528, avg=699.32, stdev=827.13 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 234], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 397], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 760], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2031, max= 4063, per=50.82%, avg=2444.60, stdev=904.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.07%, ctx=134, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3436KiB/s (3519kB/s), 344KiB/s-1287KiB/s (352kB/s-1318kB/s), io=20.0MiB (20.0MB), run=5569-5960msec WRITE: bw=4811KiB/s (4926kB/s), 919KiB/s-1718KiB/s (941kB/s-1759kB/s), io=28.0MiB (29.4MB), run=5569-5960msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180395: Mon May 25 03:17:39 2026 read: IOPS=1, BW=1105KiB/s (1131kB/s)(7168KiB/6489msec) clat (msec): min=62, max=3369, avg=705.82, stdev=1212.19 lat (msec): min=62, max=3369, avg=705.82, stdev=1212.19 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 90], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 184], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 927], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1973, max= 2035, per=63.56%, avg=2006.00, stdev=29.73, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=789KiB/s (808kB/s)(5120KiB/6489msec); 0 zone resets clat (msec): min=50, max=563, avg=245.00, stdev=203.65 lat (msec): min=50, max=563, avg=245.22, stdev=203.71 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 51], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2031, max= 2035, per=46.02%, avg=2033.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.27%, ctx=64, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180396: Mon May 25 03:17:39 2026 read: IOPS=0, BW=337KiB/s (346kB/s)(2048KiB/6069msec) clat (msec): min=145, max=279, avg=212.75, stdev=94.43 lat (msec): min=145, max=279, avg=212.75, stdev=94.43 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1365, max= 2027, per=53.74%, avg=1696.00, stdev=468.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1687KiB/s (1728kB/s)(10.0MiB/6069msec); 0 zone resets clat (msec): min=131, max=2466, avg=538.39, stdev=693.75 lat (msec): min=131, max=2466, avg=538.48, stdev=693.75 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 159], | 30.00th=[ 163], 40.00th=[ 313], 50.00th=[ 330], 60.00th=[ 334], | 70.00th=[ 409], 80.00th=[ 468], 90.00th=[ 609], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1988, max= 6011, per=81.80%, avg=3613.80, stdev=1677.66, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.59%, ctx=94, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180397: Mon May 25 03:17:39 2026 read: IOPS=0, BW=1014KiB/s (1039kB/s)(6144KiB/6058msec) clat (msec): min=71, max=584, avg=299.82, stdev=216.62 lat (msec): min=71, max=584, avg=299.82, stdev=216.62 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 422], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2007, max= 4031, per=100.00%, avg=3343.33, stdev=1157.46, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=1014KiB/s (1039kB/s)(6144KiB/6058msec); 0 zone resets clat (msec): min=141, max=2774, avg=688.29, stdev=1033.89 lat (msec): min=142, max=2774, avg=688.43, stdev=1033.87 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 363], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1988, max= 2741, per=48.69%, avg=2151.00, stdev=330.08, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.07%, sys=2.89%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180398: Mon May 25 03:17:39 2026 read: IOPS=0, BW=910KiB/s (932kB/s)(5120KiB/5625msec) clat (msec): min=141, max=452, avg=302.37, stdev=119.05 lat (msec): min=141, max=452, avg=302.38, stdev=119.05 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2015, max= 3992, per=84.85%, avg=2678.00, stdev=1137.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1274KiB/s (1305kB/s)(7168KiB/5625msec); 0 zone resets clat (msec): min=120, max=2753, avg=585.57, stdev=968.48 lat (msec): min=121, max=2753, avg=585.72, stdev=968.46 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 130], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 161], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 567], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1988, max= 4162, per=61.54%, avg=2719.00, stdev=1249.71, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.09%, sys=1.72%, ctx=44, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3156KiB/s (3232kB/s), 337KiB/s-1105KiB/s (346kB/s-1131kB/s), io=20.0MiB (20.0MB), run=5625-6489msec WRITE: bw=4419KiB/s (4525kB/s), 789KiB/s-1687KiB/s (808kB/s-1728kB/s), io=28.0MiB (29.4MB), run=5625-6489msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180409: Mon May 25 03:17:52 2026 read: IOPS=1, BW=5689KiB/s (5825kB/s)(12.0MiB/2160msec) clat (msec): min=493, max=936, avg=719.36, stdev=221.49 lat (msec): min=493, max=936, avg=719.36, stdev=221.49 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 6649, max= 8126, per=100.00%, avg=7387.50, stdev=1044.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=12.74%, ctx=208, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180410: Mon May 25 03:17:52 2026 read: IOPS=0, BW=1431KiB/s (1466kB/s)(4096KiB/2862msec) clat (nsec): min=833150k, max=833150k, avg=833150003.00, stdev= 0.00 lat (nsec): min=833153k, max=833153k, avg=833152756.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2862KiB/s (2931kB/s)(8192KiB/2862msec); 0 zone resets clat (msec): min=831, max=1120, avg=976.01, stdev=204.64 lat (msec): min=831, max=1121, avg=976.42, stdev=204.76 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8126, max= 8126, per=71.89%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.03%, ctx=459, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180411: Mon May 25 03:17:52 2026 write: IOPS=1, BW=4239KiB/s (4340kB/s)(12.0MiB/2899msec); 0 zone resets clat (msec): min=300, max=1433, avg=922.39, stdev=574.89 lat (msec): min=300, max=1434, avg=922.82, stdev=574.85 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8159, max= 8159, per=72.18%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=5.04%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180412: Mon May 25 03:17:52 2026 write: IOPS=2, BW=10.2MiB/s (10.7MB/s)(12.0MiB/1181msec); 0 zone resets clat (msec): min=143, max=797, avg=392.66, stdev=354.01 lat (msec): min=143, max=799, avg=393.38, stdev=354.45 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min=13234, max=13234, per=100.00%, avg=13234.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.10%, ctx=32, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5725KiB/s (5862kB/s), 1431KiB/s-5689KiB/s (1466kB/s-5825kB/s), io=16.0MiB (16.8MB), run=2160-2862msec WRITE: bw=11.0MiB/s (11.6MB/s), 2862KiB/s-10.2MiB/s (2931kB/s-10.7MB/s), io=32.0MiB (33.6MB), run=1181-2899msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180414: Mon May 25 03:17:53 2026 read: IOPS=1, BW=4511KiB/s (4619kB/s)(12.0MiB/2724msec) clat (msec): min=240, max=1471, avg=889.86, stdev=618.21 lat (msec): min=240, max=1471, avg=889.86, stdev=618.21 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.18%, sys=3.56%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180415: Mon May 25 03:17:53 2026 read: IOPS=0, BW=1526KiB/s (1563kB/s)(4096KiB/2684msec) clat (nsec): min=1096.6M, max=1096.6M, avg=1096574678.00, stdev= 0.00 lat (nsec): min=1096.6M, max=1096.6M, avg=1096577290.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3052KiB/s (3125kB/s)(8192KiB/2684msec); 0 zone resets clat (msec): min=746, max=833, avg=789.97, stdev=61.63 lat (msec): min=746, max=838, avg=792.69, stdev=64.62 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8126, max= 8126, per=73.73%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.51%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180416: Mon May 25 03:17:53 2026 write: IOPS=1, BW=4133KiB/s (4232kB/s)(12.0MiB/2973msec); 0 zone resets clat (msec): min=178, max=1756, avg=960.08, stdev=789.00 lat (msec): min=179, max=1757, avg=960.71, stdev=789.31 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8126, max= 8126, per=73.73%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.06%, ctx=39, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180417: Mon May 25 03:17:53 2026 write: IOPS=1, BW=5466KiB/s (5597kB/s)(12.0MiB/2248msec); 0 zone resets clat (msec): min=698, max=766, avg=732.64, stdev=33.55 lat (msec): min=700, max=766, avg=733.55, stdev=32.93 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8094, max= 8143, per=73.66%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.58%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6015KiB/s (6159kB/s), 1526KiB/s-4511KiB/s (1563kB/s-4619kB/s), io=16.0MiB (16.8MB), run=2684-2724msec WRITE: bw=10.8MiB/s (11.3MB/s), 3052KiB/s-5466KiB/s (3125kB/s-5597kB/s), io=32.0MiB (33.6MB), run=2248-2973msec