== sanity test 398b: DIO and buffer IO race ============== 03:56:37 (1785398197) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.91486 s, 5.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144365: Thu Jul 30 03:59:58 2026 read: IOPS=8, BW=34.8KiB/s (35.6kB/s)(5992KiB/172341msec) clat (usec): min=30, max=631542, avg=57021.37, stdev=43360.61 lat (usec): min=30, max=631543, avg=57026.14, stdev=43366.98 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 71], 20.00th=[ 25035], | 30.00th=[ 33817], 40.00th=[ 41157], 50.00th=[ 49546], 60.00th=[ 58459], | 70.00th=[ 71828], 80.00th=[ 87557], 90.00th=[108528], 95.00th=[130548], | 99.00th=[198181], 99.50th=[206570], 99.90th=[312476], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 96, per=25.36%, avg=35.00, stdev=16.29, samples=330 iops : min= 1, max= 24, avg= 8.11, stdev= 4.11, samples=330 write: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6296KiB/172341msec); 0 zone resets clat (usec): min=1003, max=1290.4k, avg=54895.94, stdev=64654.34 lat (usec): min=1003, max=1290.4k, avg=54900.14, stdev=64652.60 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1287], | 20.00th=[ 4752], 30.00th=[ 10028], 40.00th=[ 23987], | 50.00th=[ 41157], 60.00th=[ 56361], 70.00th=[ 72877], | 80.00th=[ 95945], 90.00th=[ 128451], 95.00th=[ 158335], | 99.00th=[ 242222], 99.50th=[ 299893], 99.90th=[ 557843], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 7, max= 87, per=25.24%, avg=36.60, stdev=16.27, samples=332 iops : min= 1, max= 21, avg= 8.50, stdev= 4.11, samples=332 lat (usec) : 50=1.89%, 100=3.32%, 250=0.10%, 500=0.03% lat (msec) : 2=7.55%, 4=2.15%, 10=5.86%, 20=6.15%, 50=25.75% lat (msec) : 100=31.09%, 250=15.59%, 500=0.42%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=3.56%, ctx=5987, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144366: Thu Jul 30 03:59:58 2026 read: IOPS=8, BW=34.6KiB/s (35.4kB/s)(5940KiB/171762msec) clat (usec): min=33, max=1260.7k, avg=57689.07, stdev=55677.68 lat (usec): min=33, max=1260.7k, avg=57690.58, stdev=55677.80 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 165], | 20.00th=[ 23987], 30.00th=[ 32637], 40.00th=[ 40633], | 50.00th=[ 48497], 60.00th=[ 58459], 70.00th=[ 69731], | 80.00th=[ 84411], 90.00th=[ 108528], 95.00th=[ 133694], | 99.00th=[ 212861], 99.50th=[ 283116], 99.90th=[ 633340], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 7, max= 94, per=25.04%, avg=34.56, stdev=16.28, samples=332 iops : min= 1, max= 23, avg= 7.99, stdev= 4.11, samples=332 write: IOPS=9, BW=36.0KiB/s (37.8kB/s)(6348KiB/171762msec); 0 zone resets clat (usec): min=931, max=376807, avg=53942.36, stdev=55780.73 lat (usec): min=932, max=376808, avg=53944.43, stdev=55780.06 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1270], 20.00th=[ 4293], | 30.00th=[ 9503], 40.00th=[ 22152], 50.00th=[ 40633], 60.00th=[ 55837], | 70.00th=[ 73925], 80.00th=[ 95945], 90.00th=[128451], 95.00th=[162530], | 99.00th=[240124], 99.50th=[270533], 99.90th=[333448], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 108, per=25.65%, avg=37.19, stdev=17.74, samples=330 iops : min= 1, max= 27, avg= 8.65, stdev= 4.49, samples=330 lat (usec) : 50=1.43%, 100=3.29%, 250=0.13%, 750=0.07%, 1000=0.20% lat (msec) : 2=8.07%, 4=2.02%, 10=6.05%, 20=6.54%, 50=25.85% lat (msec) : 100=30.50%, 250=15.10%, 500=0.68%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=3.42%, ctx=5919, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144367: Thu Jul 30 03:59:58 2026 read: IOPS=8, BW=34.8KiB/s (35.6kB/s)(6028KiB/173254msec) clat (usec): min=29, max=1554.9k, avg=57428.35, stdev=60158.24 lat (usec): min=30, max=1554.9k, avg=57429.45, stdev=60158.25 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 53], 10.00th=[ 97], | 20.00th=[ 23987], 30.00th=[ 32375], 40.00th=[ 40109], | 50.00th=[ 47449], 60.00th=[ 55837], 70.00th=[ 67634], | 80.00th=[ 84411], 90.00th=[ 110625], 95.00th=[ 135267], | 99.00th=[ 221250], 99.50th=[ 295699], 99.90th=[ 534774], | 99.95th=[1551893], 99.99th=[1551893] bw ( KiB/s): min= 7, max= 109, per=25.51%, avg=35.20, stdev=17.57, samples=331 iops : min= 1, max= 27, avg= 8.15, stdev= 4.45, samples=331 write: IOPS=9, BW=36.1KiB/s (36.0kB/s)(6260KiB/173254msec); 0 zone resets clat (usec): min=909, max=715268, avg=55104.49, stdev=58477.27 lat (usec): min=910, max=715270, avg=55107.05, stdev=58476.54 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1205], 10.00th=[ 1303], 20.00th=[ 4948], | 30.00th=[ 10814], 40.00th=[ 25822], 50.00th=[ 41681], 60.00th=[ 54789], | 70.00th=[ 72877], 80.00th=[ 95945], 90.00th=[135267], 95.00th=[160433], | 99.00th=[238027], 99.50th=[283116], 99.90th=[421528], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 119, per=25.20%, avg=36.54, stdev=17.36, samples=331 iops : min= 1, max= 29, avg= 8.50, stdev= 4.39, samples=331 lat (usec) : 50=1.76%, 100=3.16%, 250=0.16%, 1000=0.16% lat (msec) : 2=7.39%, 4=1.73%, 10=5.70%, 20=6.77%, 50=27.83% lat (msec) : 100=29.17%, 250=15.40%, 500=0.68%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=3.49%, ctx=5890, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144368: Thu Jul 30 03:59:58 2026 read: IOPS=8, BW=35.3KiB/s (36.2kB/s)(6052KiB/171339msec) clat (usec): min=32, max=1374.6k, avg=56717.51, stdev=53419.47 lat (usec): min=32, max=1374.6k, avg=56721.19, stdev=53420.27 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 52], 10.00th=[ 76], | 20.00th=[ 25035], 30.00th=[ 32900], 40.00th=[ 40109], | 50.00th=[ 47973], 60.00th=[ 57934], 70.00th=[ 69731], | 80.00th=[ 85459], 90.00th=[ 106431], 95.00th=[ 127402], | 99.00th=[ 179307], 99.50th=[ 219153], 99.90th=[ 387974], | 99.95th=[1367344], 99.99th=[1367344] bw ( KiB/s): min= 7, max= 87, per=25.94%, avg=35.79, stdev=16.53, samples=327 iops : min= 1, max= 21, avg= 8.30, stdev= 4.18, samples=327 write: IOPS=9, BW=36.4KiB/s (37.3kB/s)(6236KiB/171339msec); 0 zone resets clat (usec): min=812, max=530708, avg=54519.41, stdev=58319.57 lat (usec): min=812, max=530709, avg=54523.60, stdev=58321.59 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1303], 20.00th=[ 4817], | 30.00th=[ 10421], 40.00th=[ 24773], 50.00th=[ 39584], 60.00th=[ 55313], | 70.00th=[ 72877], 80.00th=[ 95945], 90.00th=[127402], 95.00th=[160433], | 99.00th=[240124], 99.50th=[295699], 99.90th=[484443], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 119, per=24.98%, avg=36.22, stdev=18.11, samples=332 iops : min= 1, max= 29, avg= 8.42, stdev= 4.57, samples=332 lat (usec) : 50=1.89%, 100=3.09%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=7.36%, 4=2.31%, 10=5.57%, 20=5.86%, 50=27.99% lat (msec) : 100=29.69%, 250=15.40%, 500=0.55%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=3.44%, ctx=5833, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=139KiB/s (142kB/s), 34.6KiB/s-35.3KiB/s (35.4kB/s-36.2kB/s), io=23.4MiB (24.6MB), run=171339-173254msec WRITE: bw=145KiB/s (149kB/s), 36.1KiB/s-36.0KiB/s (36.0kB/s-37.8kB/s), io=24.6MiB (25.7MB), run=171339-173254msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144370: Thu Jul 30 04:03:20 2026 read: IOPS=4, BW=16.1KiB/s (16.5kB/s)(5992KiB/372276msec) clat (msec): min=5, max=1636, avg=51.75, stdev=65.45 lat (msec): min=5, max=1636, avg=51.76, stdev=65.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 103], 95.00th=[ 144], | 99.00th=[ 262], 99.50th=[ 326], 99.90th=[ 609], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7, max= 88, per=30.98%, avg=19.83, stdev=13.28, samples=579 iops : min= 1, max= 22, avg= 4.33, stdev= 3.39, samples=579 write: IOPS=4, BW=16.9KiB/s (17.3kB/s)(6296KiB/372276msec); 0 zone resets clat (msec): min=53, max=781, avg=187.16, stdev=83.47 lat (msec): min=53, max=781, avg=187.16, stdev=83.47 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 86], 10.00th=[ 101], 20.00th=[ 118], | 30.00th=[ 136], 40.00th=[ 153], 50.00th=[ 171], 60.00th=[ 190], | 70.00th=[ 215], 80.00th=[ 249], 90.00th=[ 300], 95.00th=[ 342], | 99.00th=[ 451], 99.50th=[ 481], 99.90th=[ 651], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 40, per=25.33%, avg=16.97, stdev= 7.65, samples=706 iops : min= 1, max= 10, avg= 3.61, stdev= 1.98, samples=706 lat (msec) : 10=1.66%, 20=9.90%, 50=20.93%, 100=16.11%, 250=40.79% lat (msec) : 500=10.35%, 750=0.20%, 1000=0.03%, 2000=0.03% cpu : usr=0.03%, sys=0.89%, ctx=5124, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144371: Thu Jul 30 04:03:20 2026 read: IOPS=3, BW=15.8KiB/s (16.2kB/s)(5940KiB/374802msec) clat (msec): min=5, max=1433, avg=49.52, stdev=57.05 lat (msec): min=5, max=1433, avg=49.52, stdev=57.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 70], 90.00th=[ 103], 95.00th=[ 133], | 99.00th=[ 213], 99.50th=[ 259], 99.90th=[ 456], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 87, per=31.29%, avg=20.02, stdev=13.41, samples=568 iops : min= 1, max= 21, avg= 4.38, stdev= 3.40, samples=568 write: IOPS=4, BW=16.9KiB/s (17.3kB/s)(6348KiB/374802msec); 0 zone resets clat (msec): min=48, max=966, avg=189.73, stdev=86.48 lat (msec): min=48, max=966, avg=189.74, stdev=86.48 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 87], 10.00th=[ 102], 20.00th=[ 124], | 30.00th=[ 140], 40.00th=[ 155], 50.00th=[ 171], 60.00th=[ 192], | 70.00th=[ 218], 80.00th=[ 245], 90.00th=[ 300], 95.00th=[ 355], | 99.00th=[ 477], 99.50th=[ 518], 99.90th=[ 877], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 40, per=25.13%, avg=16.84, stdev= 7.40, samples=717 iops : min= 1, max= 10, avg= 3.58, stdev= 1.91, samples=717 lat (msec) : 10=1.53%, 20=10.25%, 50=21.16%, 100=15.20%, 250=42.19% lat (msec) : 500=9.31%, 750=0.23%, 1000=0.10%, 2000=0.03% cpu : usr=0.03%, sys=0.90%, ctx=5108, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144373: Thu Jul 30 04:03:20 2026 read: IOPS=4, BW=16.3KiB/s (16.7kB/s)(6028KiB/370324msec) clat (msec): min=5, max=768, avg=52.37, stdev=53.48 lat (msec): min=5, max=768, avg=52.37, stdev=53.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 75], 90.00th=[ 111], 95.00th=[ 144], | 99.00th=[ 243], 99.50th=[ 309], 99.90th=[ 510], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 79, per=30.79%, avg=19.70, stdev=13.09, samples=586 iops : min= 1, max= 19, avg= 4.31, stdev= 3.31, samples=586 write: IOPS=4, BW=16.9KiB/s (17.3kB/s)(6260KiB/370324msec); 0 zone resets clat (msec): min=47, max=1496, avg=186.12, stdev=87.39 lat (msec): min=47, max=1496, avg=186.13, stdev=87.39 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 89], 10.00th=[ 104], 20.00th=[ 121], | 30.00th=[ 134], 40.00th=[ 153], 50.00th=[ 169], 60.00th=[ 188], | 70.00th=[ 209], 80.00th=[ 243], 90.00th=[ 296], 95.00th=[ 338], | 99.00th=[ 435], 99.50th=[ 472], 99.90th=[ 768], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7, max= 40, per=25.31%, avg=16.95, stdev= 7.68, samples=702 iops : min= 1, max= 10, avg= 3.61, stdev= 2.00, samples=702 lat (msec) : 10=1.66%, 20=8.72%, 50=22.04%, 100=15.27%, 250=42.55% lat (msec) : 500=9.54%, 750=0.13%, 1000=0.07%, 2000=0.03% cpu : usr=0.02%, sys=0.91%, ctx=5177, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144374: Thu Jul 30 04:03:20 2026 read: IOPS=4, BW=16.5KiB/s (16.9kB/s)(6052KiB/367536msec) clat (msec): min=5, max=618, avg=50.71, stdev=49.53 lat (msec): min=5, max=618, avg=50.71, stdev=49.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 114], 95.00th=[ 148], | 99.00th=[ 234], 99.50th=[ 268], 99.90th=[ 468], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 72, per=31.33%, avg=20.05, stdev=13.45, samples=578 iops : min= 1, max= 18, avg= 4.39, stdev= 3.39, samples=578 write: IOPS=4, BW=16.0KiB/s (17.4kB/s)(6236KiB/367536msec); 0 zone resets clat (msec): min=56, max=1635, avg=186.43, stdev=91.85 lat (msec): min=56, max=1635, avg=186.43, stdev=91.85 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 89], 10.00th=[ 102], 20.00th=[ 121], | 30.00th=[ 136], 40.00th=[ 150], 50.00th=[ 167], 60.00th=[ 186], | 70.00th=[ 213], 80.00th=[ 243], 90.00th=[ 288], 95.00th=[ 338], | 99.00th=[ 468], 99.50th=[ 642], 99.90th=[ 869], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7, max= 48, per=25.44%, avg=17.05, stdev= 7.65, samples=695 iops : min= 1, max= 12, avg= 3.63, stdev= 1.99, samples=695 lat (msec) : 10=1.69%, 20=9.70%, 50=21.61%, 100=14.81%, 250=43.00% lat (msec) : 500=8.76%, 750=0.33%, 1000=0.07%, 2000=0.03% cpu : usr=0.02%, sys=0.91%, ctx=5056, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=64.1KiB/s (65.6kB/s), 15.8KiB/s-16.5KiB/s (16.2kB/s-16.9kB/s), io=23.4MiB (24.6MB), run=367536-374802msec WRITE: bw=67.1KiB/s (68.7kB/s), 16.9KiB/s-16.0KiB/s (17.3kB/s-17.4kB/s), io=24.6MiB (25.7MB), run=367536-374802msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144455: Thu Jul 30 04:04:08 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5920KiB/34579msec) clat (usec): min=32, max=253140, avg=49236.72, stdev=39809.12 lat (usec): min=32, max=253141, avg=49241.83, stdev=39810.67 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 83], | 30.00th=[ 30016], 40.00th=[ 35914], 50.00th=[ 45351], 60.00th=[ 54264], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[101188], 95.00th=[116917], | 99.00th=[173016], 99.50th=[227541], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 440, per=24.72%, avg=171.03, stdev=78.08, samples=68 iops : min= 1, max= 27, avg= 9.94, stdev= 4.92, samples=68 write: IOPS=11, BW=184KiB/s (189kB/s)(6368KiB/34579msec); 0 zone resets clat (usec): min=1484, max=335074, avg=40882.97, stdev=45548.06 lat (usec): min=1485, max=335075, avg=40884.87, stdev=45548.03 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1696], 10.00th=[ 1860], 20.00th=[ 6259], | 30.00th=[ 9765], 40.00th=[ 17171], 50.00th=[ 29492], 60.00th=[ 39584], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[278922], 99.50th=[320865], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 31, max= 372, per=25.20%, avg=183.46, stdev=76.76, samples=68 iops : min= 1, max= 23, avg=10.72, stdev= 4.89, samples=68 lat (usec) : 50=2.47%, 100=7.29%, 250=0.65% lat (msec) : 2=5.86%, 4=1.95%, 10=8.20%, 20=7.81%, 50=28.65% lat (msec) : 100=27.86%, 250=8.59%, 500=0.65% cpu : usr=0.05%, sys=3.76%, ctx=1336, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144456: Thu Jul 30 04:04:08 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(5744KiB/34509msec) clat (usec): min=44, max=218394, avg=51049.97, stdev=39647.87 lat (usec): min=44, max=218395, avg=51050.93, stdev=39647.87 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 19792], | 30.00th=[ 33424], 40.00th=[ 40633], 50.00th=[ 46924], 60.00th=[ 53740], | 70.00th=[ 63701], 80.00th=[ 74974], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[187696], 99.50th=[204473], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 362, per=23.86%, avg=165.09, stdev=77.40, samples=67 iops : min= 1, max= 22, avg= 9.55, stdev= 4.92, samples=67 write: IOPS=11, BW=190KiB/s (194kB/s)(6544KiB/34509msec); 0 zone resets clat (usec): min=1417, max=257528, avg=39057.72, stdev=43040.94 lat (usec): min=1417, max=257529, avg=39059.36, stdev=43040.89 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1663], 10.00th=[ 1827], 20.00th=[ 4948], | 30.00th=[ 8848], 40.00th=[ 13173], 50.00th=[ 21627], 60.00th=[ 34866], | 70.00th=[ 51119], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[179307], 99.50th=[210764], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 62, max= 414, per=25.91%, avg=188.66, stdev=73.08, samples=67 iops : min= 3, max= 25, avg=11.06, stdev= 4.62, samples=67 lat (usec) : 50=0.52%, 100=6.90%, 250=0.26% lat (msec) : 2=6.90%, 4=2.73%, 10=9.38%, 20=8.33%, 50=27.99% lat (msec) : 100=27.86%, 250=8.98%, 500=0.13% cpu : usr=0.06%, sys=4.03%, ctx=1311, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144457: Thu Jul 30 04:04:08 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6256KiB/33820msec) clat (usec): min=31, max=281181, avg=47060.53, stdev=37313.44 lat (usec): min=31, max=281182, avg=47063.97, stdev=37312.24 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 17171], | 30.00th=[ 29754], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 58459], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[173016], 99.50th=[221250], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 377, per=26.93%, avg=186.36, stdev=77.26, samples=66 iops : min= 1, max= 23, avg=10.91, stdev= 4.89, samples=66 write: IOPS=11, BW=178KiB/s (183kB/s)(6032KiB/33820msec); 0 zone resets clat (usec): min=1356, max=233792, avg=40330.02, stdev=43342.25 lat (usec): min=1357, max=233793, avg=40331.96, stdev=43342.26 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1631], 10.00th=[ 1958], 20.00th=[ 6456], | 30.00th=[ 10290], 40.00th=[ 15664], 50.00th=[ 25297], 60.00th=[ 36963], | 70.00th=[ 50070], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[128451], | 99.00th=[212861], 99.50th=[231736], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 472, per=24.39%, avg=177.55, stdev=83.86, samples=66 iops : min= 1, max= 29, avg=10.35, stdev= 5.32, samples=66 lat (usec) : 50=1.43%, 100=7.03%, 250=0.52%, 500=0.13%, 1000=0.26% lat (msec) : 2=5.08%, 4=1.69%, 10=7.68%, 20=9.64%, 50=31.38% lat (msec) : 100=27.08%, 250=7.94%, 500=0.13% cpu : usr=0.07%, sys=3.87%, ctx=1363, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144459: Thu Jul 30 04:04:08 2026 read: IOPS=11, BW=180KiB/s (185kB/s)(6032KiB/33436msec) clat (usec): min=36, max=279513, avg=50296.86, stdev=40372.44 lat (usec): min=36, max=279515, avg=50298.04, stdev=40372.21 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 375], | 30.00th=[ 32375], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 55313], | 70.00th=[ 66323], 80.00th=[ 77071], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[204473], 99.50th=[214959], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 399, per=26.41%, avg=182.78, stdev=77.35, samples=64 iops : min= 1, max= 24, avg=10.67, stdev= 4.91, samples=64 write: IOPS=11, BW=187KiB/s (192kB/s)(6256KiB/33436msec); 0 zone resets clat (usec): min=1378, max=325841, avg=36338.95, stdev=43506.62 lat (usec): min=1380, max=325843, avg=36340.81, stdev=43506.49 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1745], 10.00th=[ 1909], 20.00th=[ 4555], | 30.00th=[ 7439], 40.00th=[ 10552], 50.00th=[ 16909], 60.00th=[ 33424], | 70.00th=[ 45351], 80.00th=[ 65799], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[200279], 99.50th=[248513], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 472, per=25.85%, avg=188.20, stdev=74.33, samples=65 iops : min= 1, max= 29, avg=11.03, stdev= 4.70, samples=65 lat (usec) : 50=1.95%, 100=7.68%, 250=0.13%, 500=0.13% lat (msec) : 2=5.73%, 4=3.78%, 10=10.03%, 20=7.55%, 50=26.82% lat (msec) : 100=27.99%, 250=7.94%, 500=0.26% cpu : usr=0.08%, sys=3.98%, ctx=1323, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=693KiB/s (709kB/s), 166KiB/s-185KiB/s (170kB/s-189kB/s), io=23.4MiB (24.5MB), run=33436-34579msec WRITE: bw=729KiB/s (746kB/s), 178KiB/s-190KiB/s (183kB/s-194kB/s), io=24.6MiB (25.8MB), run=33436-34579msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144460: Thu Jul 30 04:04:58 2026 read: IOPS=4, BW=69.8KiB/s (71.5kB/s)(5920KiB/84786msec) clat (msec): min=6, max=415, avg=47.15, stdev=48.78 lat (msec): min=6, max=415, avg=47.15, stdev=48.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 96], 95.00th=[ 150], | 99.00th=[ 257], 99.50th=[ 363], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 285, per=29.30%, avg=82.61, stdev=50.88, samples=140 iops : min= 1, max= 17, avg= 4.39, stdev= 3.26, samples=140 write: IOPS=4, BW=75.1KiB/s (76.9kB/s)(6368KiB/84786msec); 0 zone resets clat (msec): min=53, max=512, avg=168.94, stdev=67.22 lat (msec): min=53, max=512, avg=168.94, stdev=67.22 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 88], 10.00th=[ 99], 20.00th=[ 113], | 30.00th=[ 130], 40.00th=[ 144], 50.00th=[ 159], 60.00th=[ 171], | 70.00th=[ 190], 80.00th=[ 211], 90.00th=[ 257], 95.00th=[ 296], | 99.00th=[ 418], 99.50th=[ 464], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 27, max= 160, per=25.43%, avg=75.52, stdev=31.97, samples=165 iops : min= 1, max= 10, avg= 3.92, stdev= 2.07, samples=165 lat (msec) : 10=1.30%, 20=9.38%, 50=24.61%, 100=13.93%, 250=44.66% lat (msec) : 500=5.99%, 750=0.13% cpu : usr=0.02%, sys=1.01%, ctx=1238, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144461: Thu Jul 30 04:04:58 2026 read: IOPS=4, BW=68.2KiB/s (69.8kB/s)(5744KiB/84215msec) clat (msec): min=5, max=358, avg=44.11, stdev=44.73 lat (msec): min=5, max=358, avg=44.12, stdev=44.73 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 89], 95.00th=[ 125], | 99.00th=[ 247], 99.50th=[ 279], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 27, max= 316, per=29.50%, avg=83.18, stdev=51.99, samples=136 iops : min= 1, max= 19, avg= 4.42, stdev= 3.34, samples=136 write: IOPS=4, BW=77.7KiB/s (79.6kB/s)(6544KiB/84215msec); 0 zone resets clat (msec): min=68, max=457, avg=166.35, stdev=65.79 lat (msec): min=68, max=457, avg=166.35, stdev=65.79 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 85], 10.00th=[ 95], 20.00th=[ 110], | 30.00th=[ 128], 40.00th=[ 140], 50.00th=[ 157], 60.00th=[ 174], | 70.00th=[ 188], 80.00th=[ 211], 90.00th=[ 251], 95.00th=[ 300], | 99.00th=[ 384], 99.50th=[ 401], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 27, max= 159, per=26.51%, avg=78.74, stdev=30.77, samples=163 iops : min= 1, max= 9, avg= 4.13, stdev= 2.01, samples=163 lat (msec) : 10=0.78%, 20=10.68%, 50=23.96%, 100=14.06%, 250=44.92% lat (msec) : 500=5.60% cpu : usr=0.02%, sys=1.00%, ctx=1289, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144462: Thu Jul 30 04:04:58 2026 read: IOPS=4, BW=77.7KiB/s (79.5kB/s)(6256KiB/80555msec) clat (msec): min=6, max=361, avg=44.99, stdev=45.58 lat (msec): min=6, max=361, avg=44.99, stdev=45.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 85], 95.00th=[ 131], | 99.00th=[ 264], 99.50th=[ 338], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 287, per=31.20%, avg=87.97, stdev=58.72, samples=140 iops : min= 1, max= 17, avg= 4.71, stdev= 3.78, samples=140 write: IOPS=4, BW=74.9KiB/s (76.7kB/s)(6032KiB/80555msec); 0 zone resets clat (msec): min=48, max=423, avg=166.22, stdev=64.11 lat (msec): min=48, max=423, avg=166.22, stdev=64.11 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 88], 10.00th=[ 96], 20.00th=[ 114], | 30.00th=[ 126], 40.00th=[ 138], 50.00th=[ 157], 60.00th=[ 174], | 70.00th=[ 190], 80.00th=[ 213], 90.00th=[ 249], 95.00th=[ 288], | 99.00th=[ 388], 99.50th=[ 405], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 27, max= 160, per=25.85%, avg=76.76, stdev=27.58, samples=154 iops : min= 1, max= 10, avg= 4.01, stdev= 1.83, samples=154 lat (msec) : 10=1.82%, 20=10.68%, 50=25.65%, 100=14.19%, 250=42.32% lat (msec) : 500=5.34% cpu : usr=0.02%, sys=1.10%, ctx=1243, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144463: Thu Jul 30 04:04:58 2026 read: IOPS=4, BW=72.6KiB/s (74.4kB/s)(6032KiB/83050msec) clat (msec): min=6, max=295, avg=48.58, stdev=48.61 lat (msec): min=6, max=295, avg=48.58, stdev=48.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 106], 95.00th=[ 174], | 99.00th=[ 271], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 411, per=30.21%, avg=85.19, stdev=61.94, samples=137 iops : min= 1, max= 25, avg= 4.53, stdev= 3.88, samples=137 write: IOPS=4, BW=75.3KiB/s (77.1kB/s)(6256KiB/83050msec); 0 zone resets clat (msec): min=42, max=562, avg=165.04, stdev=67.38 lat (msec): min=42, max=562, avg=165.04, stdev=67.38 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 84], 10.00th=[ 95], 20.00th=[ 112], | 30.00th=[ 128], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 169], | 70.00th=[ 182], 80.00th=[ 207], 90.00th=[ 259], 95.00th=[ 288], | 99.00th=[ 393], 99.50th=[ 418], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 27, max= 160, per=25.44%, avg=75.57, stdev=31.97, samples=162 iops : min= 1, max= 10, avg= 3.93, stdev= 2.10, samples=162 lat (msec) : 10=1.56%, 20=10.03%, 50=25.00%, 100=14.19%, 250=43.10% lat (msec) : 500=5.99%, 750=0.13% cpu : usr=0.02%, sys=1.01%, ctx=1274, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=282KiB/s (289kB/s), 68.2KiB/s-77.7KiB/s (69.8kB/s-79.5kB/s), io=23.4MiB (24.5MB), run=80555-84786msec WRITE: bw=297KiB/s (304kB/s), 74.9KiB/s-77.7KiB/s (76.7kB/s-79.6kB/s), io=24.6MiB (25.8MB), run=80555-84786msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144490: Thu Jul 30 04:05:20 2026 read: IOPS=1, BW=1192KiB/s (1221kB/s)(7168KiB/6013msec) clat (msec): min=259, max=1335, avg=473.11, stdev=382.80 lat (msec): min=259, max=1335, avg=473.12, stdev=382.80 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 292], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 376], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1404, max= 2043, per=60.79%, avg=1905.67, stdev=250.33, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=851KiB/s (872kB/s)(5120KiB/6013msec); 0 zone resets clat (msec): min=323, max=1024, avg=535.84, stdev=300.57 lat (msec): min=323, max=1024, avg=536.14, stdev=300.66 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1765, max= 4055, per=56.34%, avg=2473.50, stdev=1062.10, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 500=75.00%, 750=8.33%, 2000=16.67% cpu : usr=0.02%, sys=7.47%, ctx=214, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144491: Thu Jul 30 04:05:20 2026 read: IOPS=0, BW=367KiB/s (376kB/s)(2048KiB/5579msec) clat (msec): min=302, max=340, avg=321.43, stdev=26.96 lat (msec): min=302, max=340, avg=321.43, stdev=26.96 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1442, max= 2039, per=55.52%, avg=1740.50, stdev=422.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1835KiB/s (1880kB/s)(10.0MiB/5579msec); 0 zone resets clat (msec): min=150, max=979, avg=491.86, stdev=278.46 lat (msec): min=151, max=979, avg=491.94, stdev=278.47 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 186], | 30.00th=[ 330], 40.00th=[ 347], 50.00th=[ 363], 60.00th=[ 447], | 70.00th=[ 531], 80.00th=[ 760], 90.00th=[ 827], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1996, max= 6119, per=69.32%, avg=3043.17, stdev=1712.47, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=25.00% cpu : usr=0.02%, sys=7.30%, ctx=141, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144492: Thu Jul 30 04:05:20 2026 read: IOPS=0, BW=954KiB/s (977kB/s)(6144KiB/6439msec) clat (usec): min=492, max=911971, avg=365653.90, stdev=356252.63 lat (usec): min=494, max=911972, avg=365655.25, stdev=356252.48 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 2245], | 30.00th=[ 2245], 40.00th=[231736], 50.00th=[231736], 60.00th=[484443], | 70.00th=[566232], 80.00th=[566232], 90.00th=[910164], 95.00th=[910164], | 99.00th=[910164], 99.50th=[910164], 99.90th=[910164], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 1765, max= 2043, per=63.11%, avg=1978.60, stdev=119.79, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=954KiB/s (977kB/s)(6144KiB/6439msec); 0 zone resets clat (msec): min=305, max=1781, avg=707.17, stdev=544.32 lat (msec): min=305, max=1781, avg=707.23, stdev=544.33 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 489], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1765, max= 4071, per=54.44%, avg=2389.80, stdev=947.22, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=8.33%, 500=41.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=5.45%, ctx=180, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144493: Thu Jul 30 04:05:20 2026 read: IOPS=0, BW=784KiB/s (803kB/s)(5120KiB/6531msec) clat (usec): min=846, max=863992, avg=300533.58, stdev=351774.85 lat (usec): min=849, max=863993, avg=300534.87, stdev=351774.21 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 848], 10.00th=[ 848], 20.00th=[ 848], | 30.00th=[ 5276], 40.00th=[ 5276], 50.00th=[316670], 60.00th=[316670], | 70.00th=[316670], 80.00th=[316670], 90.00th=[859833], 95.00th=[859833], | 99.00th=[859833], 99.50th=[859833], 99.90th=[859833], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 1765, max= 4039, per=83.39%, avg=2614.33, stdev=1241.38, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1098KiB/s (1124kB/s)(7168KiB/6531msec); 0 zone resets clat (msec): min=271, max=1832, avg=717.41, stdev=587.64 lat (msec): min=271, max=1832, avg=717.79, stdev=587.62 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 313], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 388], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 1183], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 2035, max= 4079, per=69.54%, avg=3053.00, stdev=1175.50, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 10=8.33%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=4.03%, ctx=107, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3136KiB/s (3211kB/s), 367KiB/s-1192KiB/s (376kB/s-1221kB/s), io=20.0MiB (20.0MB), run=5579-6531msec WRITE: bw=4390KiB/s (4496kB/s), 851KiB/s-1835KiB/s (872kB/s-1880kB/s), io=28.0MiB (29.4MB), run=5579-6531msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144485: Thu Jul 30 04:05:20 2026 read: IOPS=1, BW=1292KiB/s (1323kB/s)(7168KiB/5549msec) clat (msec): min=159, max=734, avg=323.64, stdev=204.57 lat (msec): min=159, max=734, avg=323.65, stdev=204.57 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 215], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 430], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1812, max= 3799, per=85.34%, avg=2302.40, stdev=840.17, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=923KiB/s (945kB/s)(5120KiB/5549msec); 0 zone resets clat (msec): min=434, max=957, avg=636.59, stdev=221.87 lat (msec): min=435, max=957, avg=637.23, stdev=221.47 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1906, max= 2048, per=52.84%, avg=1995.60, stdev=62.72, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.02%, sys=2.09%, ctx=104, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144486: Thu Jul 30 04:05:20 2026 read: IOPS=0, BW=291KiB/s (298kB/s)(2048KiB/7033msec) clat (msec): min=255, max=991, avg=623.69, stdev=520.60 lat (msec): min=255, max=991, avg=623.69, stdev=520.60 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1835, max= 2043, per=71.87%, avg=1939.00, stdev=147.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1456KiB/s (1491kB/s)(10.0MiB/7033msec); 0 zone resets clat (msec): min=204, max=1141, avg=573.37, stdev=277.55 lat (msec): min=204, max=1141, avg=573.45, stdev=277.54 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 266], | 30.00th=[ 355], 40.00th=[ 518], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 634], 80.00th=[ 701], 90.00th=[ 827], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1765, max= 2031, per=51.25%, avg=1935.75, stdev=100.13, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (msec) : 250=8.33%, 500=25.00%, 750=41.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.03%, sys=3.54%, ctx=110, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144487: Thu Jul 30 04:05:20 2026 read: IOPS=0, BW=809KiB/s (829kB/s)(6144KiB/7590msec) clat (msec): min=97, max=1593, avg=668.53, stdev=668.84 lat (msec): min=97, max=1593, avg=668.53, stdev=668.84 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 380], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1954, max= 2048, per=74.92%, avg=2021.40, stdev=38.41, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=809KiB/s (829kB/s)(6144KiB/7590msec); 0 zone resets clat (msec): min=279, max=1572, avg=575.11, stdev=501.22 lat (msec): min=279, max=1577, avg=575.89, stdev=502.89 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 380], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1906, max= 3624, per=63.60%, avg=2402.25, stdev=816.96, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=8.33%, 500=50.00%, 750=8.33%, 2000=25.00% cpu : usr=0.01%, sys=1.55%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144488: Thu Jul 30 04:05:20 2026 read: IOPS=0, BW=988KiB/s (1012kB/s)(5120KiB/5182msec) clat (msec): min=134, max=418, avg=249.93, stdev=114.55 lat (msec): min=134, max=418, avg=249.93, stdev=114.55 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1965, max= 6107, per=100.00%, avg=4036.00, stdev=2928.84, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1383KiB/s (1416kB/s)(7168KiB/5182msec); 0 zone resets clat (msec): min=293, max=1069, avg=554.83, stdev=250.45 lat (msec): min=293, max=1070, avg=555.07, stdev=250.83 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 380], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 531], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 609], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1383, max= 3813, per=58.58%, avg=2212.67, stdev=824.41, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=1.62%, ctx=43, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2698KiB/s (2763kB/s), 291KiB/s-1292KiB/s (298kB/s-1323kB/s), io=20.0MiB (20.0MB), run=5182-7590msec WRITE: bw=3778KiB/s (3868kB/s), 809KiB/s-1456KiB/s (829kB/s-1491kB/s), io=28.0MiB (29.4MB), run=5182-7590msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144501: Thu Jul 30 04:05:42 2026 read: IOPS=1, BW=5222KiB/s (5348kB/s)(12.0MiB/2353msec) clat (msec): min=530, max=906, avg=714.68, stdev=188.10 lat (msec): min=530, max=906, avg=714.68, stdev=188.10 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7984, max= 8031, per=100.00%, avg=8007.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.21%, sys=4.72%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144502: Thu Jul 30 04:05:42 2026 read: IOPS=0, BW=1202KiB/s (1231kB/s)(4096KiB/3407msec) clat (nsec): min=381037k, max=381037k, avg=381036764.00, stdev= 0.00 lat (nsec): min=381039k, max=381039k, avg=381039199.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 6606, max= 6606, per=100.00%, avg=6606.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2404KiB/s (2462kB/s)(8192KiB/3407msec); 0 zone resets clat (msec): min=830, max=1964, avg=1397.19, stdev=801.70 lat (msec): min=830, max=1966, avg=1398.29, stdev=802.87 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 1972], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 7515, max= 7515, per=90.32%, avg=7515.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.06%, sys=4.11%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144503: Thu Jul 30 04:05:42 2026 write: IOPS=0, BW=3120KiB/s (3195kB/s)(12.0MiB/3938msec); 0 zone resets clat (msec): min=1068, max=1539, avg=1263.45, stdev=245.57 lat (msec): min=1068, max=1539, avg=1263.74, stdev=245.56 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7515, max= 7907, per=92.68%, avg=7711.00, stdev=277.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.20%, sys=3.76%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144504: Thu Jul 30 04:05:42 2026 write: IOPS=1, BW=6238KiB/s (6387kB/s)(12.0MiB/1970msec); 0 zone resets clat (msec): min=502, max=717, avg=579.43, stdev=120.02 lat (msec): min=502, max=717, avg=580.67, stdev=119.28 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7515, max= 7984, per=93.14%, avg=7749.50, stdev=331.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=4.32%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4809KiB/s (4924kB/s), 1202KiB/s-5222KiB/s (1231kB/s-5348kB/s), io=16.0MiB (16.8MB), run=2353-3407msec WRITE: bw=8321KiB/s (8521kB/s), 2404KiB/s-6238KiB/s (2462kB/s-6387kB/s), io=32.0MiB (33.6MB), run=1970-3938msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144506: Thu Jul 30 04:05:45 2026 read: IOPS=0, BW=2804KiB/s (2871kB/s)(12.0MiB/4382msec) clat (msec): min=1331, max=1647, avg=1460.46, stdev=165.42 lat (msec): min=1331, max=1647, avg=1460.46, stdev=165.42 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8031, max= 8062, per=100.00%, avg=8046.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=5.89%, ctx=161, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144507: Thu Jul 30 04:05:45 2026 read: IOPS=0, BW=858KiB/s (878kB/s)(4096KiB/4775msec) clat (nsec): min=1409.4M, max=1409.4M, avg=1409399842.00, stdev= 0.00 lat (nsec): min=1409.4M, max=1409.4M, avg=1409401654.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1418], 5.00th=[ 1418], 10.00th=[ 1418], 20.00th=[ 1418], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1716KiB/s (1757kB/s)(8192KiB/4775msec); 0 zone resets clat (msec): min=1314, max=2047, avg=1681.16, stdev=517.88 lat (msec): min=1315, max=2047, avg=1681.59, stdev=518.07 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 2056], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.23%, sys=2.35%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144508: Thu Jul 30 04:05:45 2026 write: IOPS=0, BW=2345KiB/s (2401kB/s)(12.0MiB/5241msec); 0 zone resets clat (msec): min=1154, max=2128, avg=1746.32, stdev=519.92 lat (msec): min=1154, max=2129, avg=1746.63, stdev=519.89 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1955], 50.00th=[ 1955], 60.00th=[ 1955], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.68%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144509: Thu Jul 30 04:05:45 2026 write: IOPS=0, BW=3287KiB/s (3366kB/s)(12.0MiB/3738msec); 0 zone resets clat (msec): min=1103, max=1455, avg=1243.54, stdev=186.45 lat (msec): min=1104, max=1455, avg=1245.44, stdev=185.51 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.11%, sys=2.30%, ctx=28, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3431KiB/s (3514kB/s), 858KiB/s-2804KiB/s (878kB/s-2871kB/s), io=16.0MiB (16.8MB), run=4382-4775msec WRITE: bw=6252KiB/s (6402kB/s), 1716KiB/s-3287KiB/s (1757kB/s-3366kB/s), io=32.0MiB (33.6MB), run=3738-5241msec