== sanity test 398b: DIO and buffer IO race ============== 14:26:25 (1785954385) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 9.01233 s, 5.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144436: Wed Aug 5 14:29:45 2026 read: IOPS=8, BW=34.7KiB/s (35.6kB/s)(5992KiB/172433msec) clat (usec): min=30, max=935554, avg=56220.01, stdev=50194.74 lat (usec): min=30, max=935555, avg=56221.25, stdev=50194.75 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 82], 20.00th=[ 25560], | 30.00th=[ 32637], 40.00th=[ 39060], 50.00th=[ 47449], 60.00th=[ 56361], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[105382], 95.00th=[128451], | 99.00th=[208667], 99.50th=[283116], 99.90th=[557843], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 86, per=25.41%, avg=34.81, stdev=16.58, samples=333 iops : min= 1, max= 21, avg= 8.05, stdev= 4.20, samples=333 write: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6296KiB/172433msec); 0 zone resets clat (usec): min=1015, max=504231, avg=55655.70, stdev=59404.53 lat (usec): min=1016, max=504233, avg=55665.40, stdev=59407.48 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1270], 10.00th=[ 1483], 20.00th=[ 6128], | 30.00th=[ 11731], 40.00th=[ 24249], 50.00th=[ 38536], 60.00th=[ 55313], | 70.00th=[ 73925], 80.00th=[ 96994], 90.00th=[132645], 95.00th=[166724], | 99.00th=[252707], 99.50th=[308282], 99.90th=[396362], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 6, max= 95, per=25.44%, avg=36.38, stdev=17.40, samples=335 iops : min= 1, max= 23, avg= 8.44, stdev= 4.39, samples=335 lat (usec) : 50=1.24%, 100=3.78%, 250=0.13%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.25%, 4=1.76%, 10=6.61%, 20=6.80%, 50=28.35% lat (msec) : 100=29.62%, 250=14.45%, 500=0.81%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=4.13%, ctx=6256, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144437: Wed Aug 5 14:29:45 2026 read: IOPS=8, BW=33.0KiB/s (34.8kB/s)(5940KiB/174732msec) clat (usec): min=31, max=573219, avg=57158.94, stdev=48090.74 lat (usec): min=32, max=573220, avg=57165.31, stdev=48089.84 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 2999], 20.00th=[ 25560], | 30.00th=[ 33162], 40.00th=[ 39584], 50.00th=[ 47973], 60.00th=[ 57410], | 70.00th=[ 68682], 80.00th=[ 82314], 90.00th=[107480], 95.00th=[137364], | 99.00th=[210764], 99.50th=[267387], 99.90th=[541066], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 87, per=25.05%, avg=34.32, stdev=16.10, samples=334 iops : min= 1, max= 21, avg= 7.92, stdev= 4.07, samples=334 write: IOPS=9, BW=36.3KiB/s (37.2kB/s)(6348KiB/174732msec); 0 zone resets clat (usec): min=985, max=898231, avg=56244.73, stdev=65524.57 lat (usec): min=985, max=898233, avg=56247.90, stdev=65523.34 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1434], 20.00th=[ 5538], | 30.00th=[ 10945], 40.00th=[ 25035], 50.00th=[ 40109], 60.00th=[ 55313], | 70.00th=[ 70779], 80.00th=[ 96994], 90.00th=[132645], 95.00th=[166724], | 99.00th=[246416], 99.50th=[337642], 99.90th=[893387], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 119, per=25.28%, avg=36.14, stdev=18.11, samples=338 iops : min= 1, max= 29, avg= 8.37, stdev= 4.57, samples=338 lat (usec) : 50=1.14%, 100=3.22%, 250=0.29%, 500=0.03%, 1000=0.03% lat (msec) : 2=6.35%, 4=1.95%, 10=6.54%, 20=6.64%, 50=27.96% lat (msec) : 100=30.08%, 250=14.97%, 500=0.59%, 750=0.13%, 1000=0.07% cpu : usr=0.06%, sys=4.01%, ctx=6285, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144438: Wed Aug 5 14:29:45 2026 read: IOPS=8, BW=34.8KiB/s (35.7kB/s)(6028KiB/172984msec) clat (usec): min=28, max=479742, avg=54783.50, stdev=43178.39 lat (usec): min=28, max=479744, avg=54786.89, stdev=43178.46 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 145], 20.00th=[ 25560], | 30.00th=[ 33162], 40.00th=[ 39060], 50.00th=[ 46400], 60.00th=[ 54264], | 70.00th=[ 66323], 80.00th=[ 82314], 90.00th=[105382], 95.00th=[128451], | 99.00th=[185598], 99.50th=[242222], 99.90th=[400557], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 86, per=25.66%, avg=35.16, stdev=17.63, samples=331 iops : min= 1, max= 21, avg= 8.14, stdev= 4.44, samples=331 write: IOPS=9, BW=36.2KiB/s (37.1kB/s)(6260KiB/172984msec); 0 zone resets clat (usec): min=1050, max=1450.9k, avg=57381.96, stdev=70535.24 lat (usec): min=1052, max=1450.9k, avg=57384.34, stdev=70534.85 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1270], 10.00th=[ 1516], | 20.00th=[ 5604], 30.00th=[ 11207], 40.00th=[ 26084], | 50.00th=[ 39584], 60.00th=[ 55313], 70.00th=[ 73925], | 80.00th=[ 95945], 90.00th=[ 137364], 95.00th=[ 170918], | 99.00th=[ 238027], 99.50th=[ 304088], 99.90th=[ 641729], | 99.95th=[1451230], 99.99th=[1451230] bw ( KiB/s): min= 7, max= 99, per=25.31%, avg=36.20, stdev=17.10, samples=334 iops : min= 1, max= 24, avg= 8.40, stdev= 4.31, samples=334 lat (usec) : 50=1.46%, 100=3.32%, 250=0.23%, 500=0.07%, 750=0.03% lat (msec) : 2=6.12%, 4=2.41%, 10=6.51%, 20=6.02%, 50=30.21% lat (msec) : 100=28.26%, 250=14.68%, 500=0.59%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=3.98%, ctx=6209, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144439: Wed Aug 5 14:29:45 2026 read: IOPS=8, BW=34.8KiB/s (35.6kB/s)(6052KiB/173919msec) clat (usec): min=28, max=899288, avg=57552.89, stdev=49235.15 lat (usec): min=28, max=899289, avg=57567.21, stdev=49246.80 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 143], 20.00th=[ 26084], | 30.00th=[ 33817], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 57934], | 70.00th=[ 71828], 80.00th=[ 85459], 90.00th=[110625], 95.00th=[133694], | 99.00th=[183501], 99.50th=[214959], 99.90th=[708838], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 86, per=25.84%, avg=35.40, stdev=16.40, samples=331 iops : min= 1, max= 21, avg= 8.19, stdev= 4.15, samples=331 write: IOPS=8, BW=35.9KiB/s (36.7kB/s)(6236KiB/173919msec); 0 zone resets clat (usec): min=934, max=916087, avg=55345.74, stdev=61166.57 lat (usec): min=935, max=916087, avg=55348.21, stdev=61167.44 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1287], 10.00th=[ 1893], 20.00th=[ 5997], | 30.00th=[ 11207], 40.00th=[ 23987], 50.00th=[ 40109], 60.00th=[ 55313], | 70.00th=[ 72877], 80.00th=[ 94897], 90.00th=[131597], 95.00th=[164627], | 99.00th=[238027], 99.50th=[291505], 99.90th=[438305], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 142, per=25.11%, avg=35.91, stdev=17.77, samples=336 iops : min= 1, max= 35, avg= 8.32, stdev= 4.47, samples=336 lat (usec) : 50=1.27%, 100=3.61%, 250=0.13%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.21%, 4=2.18%, 10=7.36%, 20=6.09%, 50=28.26% lat (msec) : 100=29.72%, 250=15.46%, 500=0.46%, 750=0.03%, 1000=0.07% cpu : usr=0.06%, sys=4.06%, ctx=6336, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=137KiB/s (141kB/s), 33.0KiB/s-34.8KiB/s (34.8kB/s-35.7kB/s), io=23.4MiB (24.6MB), run=172433-174732msec WRITE: bw=144KiB/s (147kB/s), 35.9KiB/s-36.5KiB/s (36.7kB/s-37.4kB/s), io=24.6MiB (25.7MB), run=172433-174732msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144441: Wed Aug 5 14:33:21 2026 read: IOPS=3, BW=15.4KiB/s (15.7kB/s)(5992KiB/390312msec) clat (msec): min=6, max=986, avg=51.33, stdev=51.44 lat (msec): min=6, max=986, avg=51.33, stdev=51.44 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 109], 95.00th=[ 142], | 99.00th=[ 213], 99.50th=[ 271], 99.90th=[ 518], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 87, per=31.04%, avg=18.93, stdev=13.09, samples=604 iops : min= 1, max= 21, avg= 4.10, stdev= 3.31, samples=604 write: IOPS=4, BW=16.1KiB/s (16.5kB/s)(6296KiB/390312msec); 0 zone resets clat (msec): min=34, max=660, avg=199.04, stdev=93.20 lat (msec): min=34, max=660, avg=199.04, stdev=93.20 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 87], 10.00th=[ 100], 20.00th=[ 122], | 30.00th=[ 140], 40.00th=[ 159], 50.00th=[ 180], 60.00th=[ 203], | 70.00th=[ 234], 80.00th=[ 264], 90.00th=[ 321], 95.00th=[ 380], | 99.00th=[ 506], 99.50th=[ 550], 99.90th=[ 651], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 47, per=24.90%, avg=15.94, stdev= 7.57, samples=748 iops : min= 1, max= 11, avg= 3.35, stdev= 1.96, samples=748 lat (msec) : 10=0.91%, 20=9.38%, 50=21.68%, 100=16.60%, 250=39.19% lat (msec) : 500=11.62%, 750=0.59%, 1000=0.03% cpu : usr=0.03%, sys=1.03%, ctx=5425, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144442: Wed Aug 5 14:33:21 2026 read: IOPS=3, BW=15.2KiB/s (15.6kB/s)(5940KiB/389995msec) clat (msec): min=5, max=1520, avg=51.97, stdev=61.86 lat (msec): min=5, max=1520, avg=51.98, stdev=61.86 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 100], 95.00th=[ 140], | 99.00th=[ 245], 99.50th=[ 326], 99.90th=[ 617], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7, max= 79, per=31.73%, avg=19.35, stdev=13.30, samples=587 iops : min= 1, max= 19, avg= 4.21, stdev= 3.36, samples=587 write: IOPS=4, BW=16.3KiB/s (16.7kB/s)(6348KiB/389995msec); 0 zone resets clat (msec): min=36, max=985, avg=197.01, stdev=95.46 lat (msec): min=36, max=985, avg=197.02, stdev=95.46 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 86], 10.00th=[ 102], 20.00th=[ 122], | 30.00th=[ 140], 40.00th=[ 159], 50.00th=[ 176], 60.00th=[ 199], | 70.00th=[ 226], 80.00th=[ 262], 90.00th=[ 321], 95.00th=[ 376], | 99.00th=[ 527], 99.50th=[ 575], 99.90th=[ 693], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 55, per=25.44%, avg=16.28, stdev= 7.65, samples=740 iops : min= 1, max= 13, avg= 3.44, stdev= 1.98, samples=740 lat (msec) : 10=0.98%, 20=8.30%, 50=22.49%, 100=16.83%, 250=39.00% lat (msec) : 500=11.65%, 750=0.68%, 1000=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.03%, ctx=5444, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144443: Wed Aug 5 14:33:21 2026 read: IOPS=3, BW=15.5KiB/s (15.9kB/s)(6028KiB/389095msec) clat (msec): min=6, max=532, avg=52.60, stdev=48.50 lat (msec): min=6, max=532, avg=52.61, stdev=48.51 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 72], 90.00th=[ 107], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 288], 99.90th=[ 430], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 111, per=31.77%, avg=19.38, stdev=13.07, samples=595 iops : min= 1, max= 27, avg= 4.23, stdev= 3.29, samples=595 write: IOPS=4, BW=16.1KiB/s (16.5kB/s)(6260KiB/389095msec); 0 zone resets clat (msec): min=31, max=1647, avg=197.87, stdev=98.43 lat (msec): min=31, max=1647, avg=197.87, stdev=98.43 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 88], 10.00th=[ 104], 20.00th=[ 124], | 30.00th=[ 140], 40.00th=[ 159], 50.00th=[ 178], 60.00th=[ 199], | 70.00th=[ 224], 80.00th=[ 262], 90.00th=[ 326], 95.00th=[ 376], | 99.00th=[ 510], 99.50th=[ 558], 99.90th=[ 718], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7, max= 47, per=25.19%, avg=16.12, stdev= 7.64, samples=737 iops : min= 1, max= 11, avg= 3.40, stdev= 1.97, samples=737 lat (msec) : 10=1.04%, 20=8.72%, 50=21.88%, 100=16.54%, 250=39.71% lat (msec) : 500=11.56%, 750=0.52%, 2000=0.03% cpu : usr=0.03%, sys=1.00%, ctx=5268, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144444: Wed Aug 5 14:33:21 2026 read: IOPS=3, BW=15.6KiB/s (15.0kB/s)(6052KiB/387903msec) clat (msec): min=6, max=478, avg=50.75, stdev=48.17 lat (msec): min=6, max=478, avg=50.75, stdev=48.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 70], 90.00th=[ 104], 95.00th=[ 136], | 99.00th=[ 230], 99.50th=[ 338], 99.90th=[ 460], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 110, per=32.31%, avg=19.71, stdev=13.99, samples=587 iops : min= 1, max= 27, avg= 4.30, stdev= 3.55, samples=587 write: IOPS=4, BW=16.1KiB/s (16.5kB/s)(6236KiB/387903msec); 0 zone resets clat (msec): min=53, max=1652, avg=199.47, stdev=103.56 lat (msec): min=53, max=1652, avg=199.47, stdev=103.56 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 87], 10.00th=[ 100], 20.00th=[ 121], | 30.00th=[ 140], 40.00th=[ 159], 50.00th=[ 180], 60.00th=[ 201], | 70.00th=[ 228], 80.00th=[ 264], 90.00th=[ 326], 95.00th=[ 384], | 99.00th=[ 527], 99.50th=[ 567], 99.90th=[ 995], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 6, max= 39, per=24.89%, avg=15.93, stdev= 7.65, samples=741 iops : min= 1, max= 9, avg= 3.35, stdev= 1.98, samples=741 lat (msec) : 10=1.04%, 20=8.24%, 50=23.31%, 100=16.63%, 250=38.57% lat (msec) : 500=11.52%, 750=0.59%, 1000=0.07%, 2000=0.03% cpu : usr=0.03%, sys=1.01%, ctx=5383, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=61.5KiB/s (62.0kB/s), 15.2KiB/s-15.6KiB/s (15.6kB/s-15.0kB/s), io=23.4MiB (24.6MB), run=387903-390312msec WRITE: bw=64.4KiB/s (65.0kB/s), 16.1KiB/s-16.3KiB/s (16.5kB/s-16.7kB/s), io=24.6MiB (25.7MB), run=387903-390312msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144520: Wed Aug 5 14:34:16 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5920KiB/37149msec) clat (usec): min=31, max=240777, avg=54701.75, stdev=43071.33 lat (usec): min=31, max=240778, avg=54704.26, stdev=43070.46 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 408], | 30.00th=[ 33424], 40.00th=[ 42206], 50.00th=[ 51119], 60.00th=[ 58983], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[106431], 95.00th=[132645], | 99.00th=[189793], 99.50th=[235930], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 376, per=26.63%, avg=163.80, stdev=69.10, samples=71 iops : min= 1, max= 23, avg= 9.48, stdev= 4.39, samples=71 write: IOPS=10, BW=171KiB/s (176kB/s)(6368KiB/37149msec); 0 zone resets clat (usec): min=1386, max=303249, avg=42168.98, stdev=44616.05 lat (usec): min=1388, max=303250, avg=42170.92, stdev=44616.13 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1729], 10.00th=[ 2073], 20.00th=[ 6980], | 30.00th=[ 10945], 40.00th=[ 16909], 50.00th=[ 25035], 60.00th=[ 37487], | 70.00th=[ 54789], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[127402], | 99.00th=[227541], 99.50th=[252707], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 305, per=26.44%, avg=171.05, stdev=68.05, samples=73 iops : min= 1, max= 19, avg= 9.95, stdev= 4.31, samples=73 lat (usec) : 50=1.30%, 100=7.94%, 250=0.26%, 500=0.13% lat (msec) : 2=4.82%, 4=2.08%, 10=8.46%, 20=8.20%, 50=25.13% lat (msec) : 100=29.56%, 250=11.85%, 500=0.26% cpu : usr=0.06%, sys=4.98%, ctx=1419, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144521: Wed Aug 5 14:34:16 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(5744KiB/38872msec) clat (usec): min=36, max=308864, avg=55039.69, stdev=42787.40 lat (usec): min=36, max=308866, avg=55054.70, stdev=42780.28 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 22152], | 30.00th=[ 36439], 40.00th=[ 43779], 50.00th=[ 52691], 60.00th=[ 60556], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[101188], 95.00th=[119014], | 99.00th=[240124], 99.50th=[267387], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 341, per=24.37%, avg=149.85, stdev=71.21, samples=75 iops : min= 1, max= 21, avg= 8.59, stdev= 4.51, samples=75 write: IOPS=10, BW=168KiB/s (172kB/s)(6544KiB/38872msec); 0 zone resets clat (usec): min=1443, max=545234, avg=44967.25, stdev=53191.46 lat (usec): min=1444, max=545237, avg=44969.38, stdev=53191.31 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1926], 10.00th=[ 4293], 20.00th=[ 8848], | 30.00th=[ 11600], 40.00th=[ 16057], 50.00th=[ 26084], 60.00th=[ 40633], | 70.00th=[ 55837], 80.00th=[ 77071], 90.00th=[105382], 95.00th=[133694], | 99.00th=[204473], 99.50th=[312476], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 30, max= 383, per=26.41%, avg=170.88, stdev=81.90, samples=75 iops : min= 1, max= 23, avg= 9.92, stdev= 5.14, samples=75 lat (usec) : 50=1.04%, 100=6.64%, 250=0.52% lat (msec) : 2=3.26%, 4=1.43%, 10=8.07%, 20=11.46%, 50=24.48% lat (msec) : 100=31.64%, 250=10.81%, 500=0.52%, 750=0.13% cpu : usr=0.07%, sys=4.47%, ctx=1425, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144522: Wed Aug 5 14:34:16 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38929msec) clat (usec): min=33, max=324252, avg=54191.61, stdev=48592.47 lat (usec): min=33, max=324253, avg=54199.77, stdev=48589.06 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 77], | 30.00th=[ 30016], 40.00th=[ 39584], 50.00th=[ 47449], 60.00th=[ 58983], | 70.00th=[ 71828], 80.00th=[ 84411], 90.00th=[106431], 95.00th=[128451], | 99.00th=[248513], 99.50th=[283116], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 412, per=26.59%, avg=163.55, stdev=77.59, samples=75 iops : min= 1, max= 25, avg= 9.44, stdev= 4.90, samples=75 write: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38929msec); 0 zone resets clat (usec): min=1429, max=263616, avg=45915.68, stdev=45586.03 lat (usec): min=1431, max=263617, avg=45917.62, stdev=45585.99 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1844], 10.00th=[ 5211], 20.00th=[ 8717], | 30.00th=[ 12256], 40.00th=[ 17957], 50.00th=[ 29492], 60.00th=[ 44827], | 70.00th=[ 61080], 80.00th=[ 80217], 90.00th=[106431], 95.00th=[132645], | 99.00th=[204473], 99.50th=[227541], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 349, per=23.93%, avg=154.83, stdev=69.96, samples=75 iops : min= 1, max= 21, avg= 8.91, stdev= 4.42, samples=75 lat (usec) : 50=1.17%, 100=9.51%, 250=0.13%, 500=0.13% lat (msec) : 2=3.26%, 4=1.17%, 10=7.55%, 20=10.16%, 50=24.74% lat (msec) : 100=30.08%, 250=11.59%, 500=0.52% cpu : usr=0.06%, sys=4.58%, ctx=1405, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144523: Wed Aug 5 14:34:16 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(6032KiB/38573msec) clat (usec): min=30, max=330657, avg=50758.73, stdev=40358.75 lat (usec): min=30, max=330658, avg=50768.00, stdev=40348.75 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 178], | 30.00th=[ 29754], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 59507], | 70.00th=[ 66847], 80.00th=[ 78119], 90.00th=[ 99091], 95.00th=[117965], | 99.00th=[170918], 99.50th=[179307], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 347, per=26.25%, avg=161.43, stdev=68.25, samples=72 iops : min= 1, max= 21, avg= 9.32, stdev= 4.31, samples=72 write: IOPS=10, BW=162KiB/s (166kB/s)(6256KiB/38573msec); 0 zone resets clat (usec): min=1401, max=521896, avg=47768.77, stdev=54573.32 lat (usec): min=1402, max=521900, avg=47773.19, stdev=54573.24 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1827], 10.00th=[ 4621], 20.00th=[ 8455], | 30.00th=[ 13566], 40.00th=[ 20841], 50.00th=[ 31851], 60.00th=[ 41681], | 70.00th=[ 58459], 80.00th=[ 72877], 90.00th=[108528], 95.00th=[154141], | 99.00th=[225444], 99.50th=[354419], 99.90th=[522191], 99.95th=[522191], | 99.99th=[522191] bw ( KiB/s): min= 31, max= 373, per=25.31%, avg=163.74, stdev=69.71, samples=74 iops : min= 1, max= 23, avg= 9.47, stdev= 4.42, samples=74 lat (usec) : 50=1.82%, 100=7.81%, 250=0.26%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.78%, 4=1.17%, 10=7.68%, 20=8.85%, 50=25.91% lat (msec) : 100=31.51%, 250=10.42%, 500=0.39%, 750=0.13% cpu : usr=0.04%, sys=4.66%, ctx=1422, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=615KiB/s (630kB/s), 148KiB/s-161KiB/s (151kB/s-165kB/s), io=23.4MiB (24.5MB), run=37149-38929msec WRITE: bw=647KiB/s (663kB/s), 155KiB/s-171KiB/s (159kB/s-176kB/s), io=24.6MiB (25.8MB), run=37149-38929msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144524: Wed Aug 5 14:35:10 2026 read: IOPS=3, BW=63.8KiB/s (65.3kB/s)(5920KiB/92820msec) clat (msec): min=8, max=424, avg=51.93, stdev=54.62 lat (msec): min=8, max=424, avg=51.93, stdev=54.62 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 108], 95.00th=[ 174], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 28, max= 286, per=30.82%, avg=78.91, stdev=48.28, samples=147 iops : min= 1, max= 17, avg= 4.14, stdev= 3.09, samples=147 write: IOPS=4, BW=68.6KiB/s (70.3kB/s)(6368KiB/92820msec); 0 zone resets clat (msec): min=49, max=619, avg=183.89, stdev=86.10 lat (msec): min=49, max=619, avg=183.89, stdev=86.10 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 81], 10.00th=[ 95], 20.00th=[ 113], | 30.00th=[ 129], 40.00th=[ 148], 50.00th=[ 169], 60.00th=[ 190], | 70.00th=[ 211], 80.00th=[ 243], 90.00th=[ 292], 95.00th=[ 334], | 99.00th=[ 481], 99.50th=[ 592], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 29, max= 160, per=26.42%, avg=71.34, stdev=32.11, samples=175 iops : min= 1, max= 10, avg= 3.69, stdev= 2.07, samples=175 lat (msec) : 10=0.26%, 20=9.11%, 50=24.74%, 100=15.10%, 250=40.76% lat (msec) : 500=9.77%, 750=0.26% cpu : usr=0.04%, sys=1.17%, ctx=1390, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144525: Wed Aug 5 14:35:10 2026 read: IOPS=3, BW=61.5KiB/s (63.0kB/s)(5744KiB/93325msec) clat (msec): min=8, max=357, avg=49.56, stdev=49.22 lat (msec): min=8, max=357, avg=49.56, stdev=49.22 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 67], 90.00th=[ 108], 95.00th=[ 163], | 99.00th=[ 247], 99.50th=[ 259], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 29, max= 255, per=31.04%, avg=79.46, stdev=53.07, samples=142 iops : min= 1, max= 15, avg= 4.19, stdev= 3.34, samples=142 write: IOPS=4, BW=70.1KiB/s (71.8kB/s)(6544KiB/93325msec); 0 zone resets clat (msec): min=53, max=621, avg=182.49, stdev=87.22 lat (msec): min=53, max=621, avg=182.49, stdev=87.22 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 75], 10.00th=[ 94], 20.00th=[ 113], | 30.00th=[ 132], 40.00th=[ 148], 50.00th=[ 167], 60.00th=[ 182], | 70.00th=[ 207], 80.00th=[ 232], 90.00th=[ 309], 95.00th=[ 351], | 99.00th=[ 456], 99.50th=[ 506], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 29, max= 159, per=26.63%, avg=71.90, stdev=33.49, samples=178 iops : min= 1, max= 9, avg= 3.72, stdev= 2.16, samples=178 lat (msec) : 10=0.78%, 20=8.98%, 50=23.83%, 100=15.63%, 250=41.54% lat (msec) : 500=8.85%, 750=0.39% cpu : usr=0.02%, sys=1.10%, ctx=1389, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144526: Wed Aug 5 14:35:10 2026 read: IOPS=4, BW=70.6KiB/s (72.3kB/s)(6256KiB/88665msec) clat (msec): min=8, max=545, avg=46.67, stdev=49.75 lat (msec): min=8, max=545, avg=46.67, stdev=49.75 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 97], 95.00th=[ 138], | 99.00th=[ 239], 99.50th=[ 257], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 29, max= 254, per=33.13%, avg=84.81, stdev=57.41, samples=145 iops : min= 1, max= 15, avg= 4.52, stdev= 3.64, samples=145 write: IOPS=4, BW=68.0KiB/s (69.7kB/s)(6032KiB/88665msec); 0 zone resets clat (msec): min=46, max=604, avg=185.43, stdev=85.36 lat (msec): min=46, max=604, avg=185.43, stdev=85.36 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 79], 10.00th=[ 96], 20.00th=[ 118], | 30.00th=[ 134], 40.00th=[ 148], 50.00th=[ 171], 60.00th=[ 190], | 70.00th=[ 209], 80.00th=[ 247], 90.00th=[ 305], 95.00th=[ 355], | 99.00th=[ 456], 99.50th=[ 489], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 29, max= 191, per=26.22%, avg=70.79, stdev=31.50, samples=166 iops : min= 1, max= 11, avg= 3.64, stdev= 2.04, samples=166 lat (msec) : 10=1.30%, 20=8.98%, 50=29.56%, 100=11.85%, 250=38.80% lat (msec) : 500=9.24%, 750=0.26% cpu : usr=0.03%, sys=1.19%, ctx=1382, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144527: Wed Aug 5 14:35:10 2026 read: IOPS=4, BW=65.7KiB/s (67.2kB/s)(6032KiB/91858msec) clat (msec): min=7, max=309, avg=51.71, stdev=51.54 lat (msec): min=7, max=309, avg=51.71, stdev=51.54 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 108], 95.00th=[ 182], | 99.00th=[ 266], 99.50th=[ 305], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 29, max= 319, per=30.95%, avg=79.24, stdev=55.34, samples=148 iops : min= 1, max= 19, avg= 4.17, stdev= 3.52, samples=148 write: IOPS=4, BW=68.1KiB/s (69.7kB/s)(6256KiB/91858msec); 0 zone resets clat (msec): min=55, max=528, avg=184.83, stdev=83.59 lat (msec): min=55, max=528, avg=184.84, stdev=83.59 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 80], 10.00th=[ 99], 20.00th=[ 118], | 30.00th=[ 132], 40.00th=[ 153], 50.00th=[ 169], 60.00th=[ 188], | 70.00th=[ 215], 80.00th=[ 243], 90.00th=[ 288], 95.00th=[ 351], | 99.00th=[ 472], 99.50th=[ 514], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 28, max= 159, per=25.92%, avg=69.99, stdev=30.95, samples=175 iops : min= 1, max= 9, avg= 3.59, stdev= 2.00, samples=175 lat (msec) : 10=0.39%, 20=9.24%, 50=24.61%, 100=14.19%, 250=42.06% lat (msec) : 500=9.24%, 750=0.26% cpu : usr=0.04%, sys=1.19%, ctx=1369, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=257KiB/s (263kB/s), 61.5KiB/s-70.6KiB/s (63.0kB/s-72.3kB/s), io=23.4MiB (24.5MB), run=88665-93325msec WRITE: bw=270KiB/s (277kB/s), 68.0KiB/s-70.1KiB/s (69.7kB/s-71.8kB/s), io=24.6MiB (25.8MB), run=88665-93325msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144550: Wed Aug 5 14:35:36 2026 read: IOPS=0, BW=742KiB/s (760kB/s)(7168KiB/9662msec) clat (msec): min=219, max=324, avg=273.01, stdev=35.45 lat (msec): min=219, max=324, avg=273.02, stdev=35.45 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 251], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 271], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 309], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1861, max= 4071, per=100.00%, avg=2395.40, stdev=939.14, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=530KiB/s (543kB/s)(5120KiB/9662msec); 0 zone resets clat (msec): min=353, max=5601, avg=1504.00, stdev=2294.00 lat (msec): min=359, max=5603, avg=1505.33, stdev=2293.83 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 5604], 95.00th=[ 5604], | 99.00th=[ 5604], 99.50th=[ 5604], 99.90th=[ 5604], 99.95th=[ 5604], | 99.99th=[ 5604] bw ( KiB/s): min= 1988, max= 2039, per=67.89%, avg=2014.25, stdev=21.84, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=16.67%, 500=66.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.29%, ctx=188, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144551: Wed Aug 5 14:35:36 2026 read: IOPS=0, BW=224KiB/s (230kB/s)(2048KiB/9123msec) clat (usec): min=1502, max=210995, avg=106249.10, stdev=148133.53 lat (usec): min=1504, max=210998, avg=106251.30, stdev=148134.62 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1500], 10.00th=[ 1500], 20.00th=[ 1500], | 30.00th=[ 1500], 40.00th=[ 1500], 50.00th=[ 1500], 60.00th=[210764], | 70.00th=[210764], 80.00th=[210764], 90.00th=[210764], 95.00th=[210764], | 99.00th=[210764], 99.50th=[210764], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 1497, max= 1988, per=82.23%, avg=1742.50, stdev=347.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1122KiB/s (1149kB/s)(10.0MiB/9123msec); 0 zone resets clat (msec): min=169, max=4750, avg=886.28, stdev=1380.44 lat (msec): min=169, max=4750, avg=886.34, stdev=1380.43 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 247], | 30.00th=[ 275], 40.00th=[ 351], 50.00th=[ 368], 60.00th=[ 451], | 70.00th=[ 531], 80.00th=[ 701], 90.00th=[ 1020], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1497, max= 4071, per=74.43%, avg=2208.38, stdev=774.43, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 2=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.70%, ctx=165, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144553: Wed Aug 5 14:35:36 2026 read: IOPS=0, BW=661KiB/s (677kB/s)(6144KiB/9294msec) clat (usec): min=492, max=4933.5k, avg=948540.30, stdev=1962311.38 lat (usec): min=493, max=4933.5k, avg=948541.72, stdev=1962311.23 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], | 20.00th=[ 562], 30.00th=[ 562], 40.00th=[ 2008], | 50.00th=[ 2008], 60.00th=[ 261096], 70.00th=[ 492831], | 80.00th=[ 492831], 90.00th=[4932502], 95.00th=[4932502], | 99.00th=[4932502], 99.50th=[4932502], 99.90th=[4932502], | 99.95th=[4932502], 99.99th=[4932502] bw ( KiB/s): min= 1988, max= 4079, per=100.00%, avg=2531.25, stdev=1032.03, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=661KiB/s (677kB/s)(6144KiB/9294msec); 0 zone resets clat (msec): min=183, max=1263, avg=545.99, stdev=375.23 lat (msec): min=183, max=1263, avg=546.07, stdev=375.24 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 485], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 2003, max= 2039, per=68.16%, avg=2022.20, stdev=17.06, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 250=8.33%, 500=41.67%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=5.08%, ctx=590, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144555: Wed Aug 5 14:35:36 2026 read: IOPS=0, BW=545KiB/s (558kB/s)(5120KiB/9392msec) clat (usec): min=453, max=313574, avg=114976.73, stdev=157303.67 lat (usec): min=454, max=313575, avg=114978.19, stdev=157303.95 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 553], 40.00th=[ 553], 50.00th=[ 1958], 60.00th=[ 1958], | 70.00th=[258999], 80.00th=[258999], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2039, max= 6107, per=100.00%, avg=4073.00, stdev=2876.51, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=763KiB/s (782kB/s)(7168KiB/9392msec); 0 zone resets clat (msec): min=253, max=5125, avg=1217.44, stdev=1744.37 lat (msec): min=253, max=5125, avg=1217.85, stdev=1744.15 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 330], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 584], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 1053], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 1988, max= 2039, per=68.14%, avg=2021.83, stdev=20.63, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 500=41.67%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.45%, ctx=156, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2120KiB/s (2171kB/s), 224KiB/s-742KiB/s (230kB/s-760kB/s), io=20.0MiB (20.0MB), run=9123-9662msec WRITE: bw=2968KiB/s (3039kB/s), 530KiB/s-1122KiB/s (543kB/s-1149kB/s), io=28.0MiB (29.4MB), run=9123-9662msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144548: Wed Aug 5 14:35:37 2026 read: IOPS=0, BW=772KiB/s (791kB/s)(7168KiB/9282msec) clat (msec): min=92, max=257, avg=158.50, stdev=62.05 lat (msec): min=92, max=257, avg=158.51, stdev=62.05 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 101], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 134], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 222], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1946, max= 4785, per=100.00%, avg=2698.25, stdev=1391.76, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=552KiB/s (565kB/s)(5120KiB/9282msec); 0 zone resets clat (msec): min=365, max=5710, avg=1619.69, stdev=2305.93 lat (msec): min=365, max=5711, avg=1620.02, stdev=2305.78 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 5738], 95.00th=[ 5738], | 99.00th=[ 5738], 99.50th=[ 5738], 99.90th=[ 5738], 99.95th=[ 5738], | 99.99th=[ 5738] bw ( KiB/s): min= 1946, max= 4096, per=98.44%, avg=2523.00, stdev=1049.33, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=1.45%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144549: Wed Aug 5 14:35:37 2026 read: IOPS=0, BW=197KiB/s (202kB/s)(2048KiB/10402msec) clat (msec): min=128, max=139, avg=133.95, stdev= 7.63 lat (msec): min=128, max=139, avg=133.95, stdev= 7.63 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 140], 95.00th=[ 140], | 99.00th=[ 140], 99.50th=[ 140], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 1756, max= 2035, per=100.00%, avg=1895.50, stdev=197.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=984KiB/s (1008kB/s)(10.0MiB/10402msec); 0 zone resets clat (msec): min=236, max=4852, avg=987.29, stdev=1384.88 lat (msec): min=236, max=4852, avg=987.51, stdev=1384.81 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 393], 50.00th=[ 430], 60.00th=[ 651], | 70.00th=[ 667], 80.00th=[ 986], 90.00th=[ 1011], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 1946, max= 2043, per=78.65%, avg=2015.78, stdev=28.64, samples=9 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=9 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=1.88%, ctx=111, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144552: Wed Aug 5 14:35:37 2026 read: IOPS=0, BW=549KiB/s (562kB/s)(6144KiB/11185msec) clat (msec): min=107, max=5504, avg=1180.86, stdev=2136.26 lat (msec): min=107, max=5504, avg=1180.87, stdev=2136.26 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 262], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 5537], 95.00th=[ 5537], | 99.00th=[ 5537], 99.50th=[ 5537], 99.90th=[ 5537], 99.95th=[ 5537], | 99.99th=[ 5537] bw ( KiB/s): min= 2011, max= 2048, per=100.00%, avg=2027.20, stdev=17.04, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=549KiB/s (562kB/s)(6144KiB/11185msec); 0 zone resets clat (msec): min=291, max=1152, avg=673.96, stdev=382.79 lat (msec): min=291, max=1152, avg=674.04, stdev=382.78 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 600], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1448, max= 2043, per=74.03%, avg=1897.40, stdev=254.11, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=1.21%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144554: Wed Aug 5 14:35:37 2026 read: IOPS=0, BW=482KiB/s (493kB/s)(5120KiB/10632msec) clat (msec): min=132, max=5190, avg=1378.97, stdev=2172.06 lat (msec): min=132, max=5190, avg=1378.98, stdev=2172.06 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 2015, max= 2048, per=100.00%, avg=2030.25, stdev=15.82, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=0, BW=674KiB/s (690kB/s)(7168KiB/10632msec); 0 zone resets clat (msec): min=170, max=954, avg=518.94, stdev=276.78 lat (msec): min=170, max=954, avg=519.04, stdev=276.79 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 271], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 485], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 802], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1646, max= 4039, per=91.85%, avg=2354.20, stdev=956.37, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=1.51%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1831KiB/s (1875kB/s), 197KiB/s-772KiB/s (202kB/s-791kB/s), io=20.0MiB (20.0MB), run=9282-11185msec WRITE: bw=2563KiB/s (2625kB/s), 549KiB/s-984KiB/s (562kB/s-1008kB/s), io=28.0MiB (29.4MB), run=9282-11185msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144564: Wed Aug 5 14:35:57 2026 read: IOPS=0, BW=3318KiB/s (3398kB/s)(12.0MiB/3703msec) clat (msec): min=715, max=1494, avg=1203.24, stdev=424.70 lat (msec): min=715, max=1494, avg=1203.24, stdev=424.70 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7953, max= 8159, per=100.00%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.05%, ctx=39, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144565: Wed Aug 5 14:35:57 2026 read: IOPS=0, BW=982KiB/s (1006kB/s)(4096KiB/4170msec) clat (nsec): min=2019.6M, max=2019.6M, avg=2019557483.00, stdev= 0.00 lat (nsec): min=2019.6M, max=2019.6M, avg=2019559498.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2022], 5.00th=[ 2022], 10.00th=[ 2022], 20.00th=[ 2022], | 30.00th=[ 2022], 40.00th=[ 2022], 50.00th=[ 2022], 60.00th=[ 2022], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1965KiB/s (2012kB/s)(8192KiB/4170msec); 0 zone resets clat (msec): min=531, max=1399, avg=965.77, stdev=613.85 lat (msec): min=532, max=1400, avg=966.05, stdev=613.83 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.23%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144567: Wed Aug 5 14:35:57 2026 write: IOPS=1, BW=6021KiB/s (6165kB/s)(12.0MiB/2041msec); 0 zone resets clat (msec): min=466, max=788, avg=593.48, stdev=171.12 lat (msec): min=469, max=788, avg=595.48, stdev=169.75 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8031, max= 8094, per=100.00%, avg=8062.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=6.52%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144569: Wed Aug 5 14:35:57 2026 write: IOPS=1, BW=4639KiB/s (4750kB/s)(12.0MiB/2649msec); 0 zone resets clat (msec): min=487, max=1152, avg=848.17, stdev=335.88 lat (msec): min=490, max=1153, avg=849.36, stdev=334.56 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 5979, max= 8031, per=89.14%, avg=7005.00, stdev=1450.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.78%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3929KiB/s (4023kB/s), 982KiB/s-3318KiB/s (1006kB/s-3398kB/s), io=16.0MiB (16.8MB), run=3703-4170msec WRITE: bw=7858KiB/s (8047kB/s), 1965KiB/s-6021KiB/s (2012kB/s-6165kB/s), io=32.0MiB (33.6MB), run=2041-4170msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144566: Wed Aug 5 14:35:57 2026 read: IOPS=0, BW=3539KiB/s (3624kB/s)(12.0MiB/3472msec) clat (msec): min=963, max=1138, avg=1055.31, stdev=87.94 lat (msec): min=963, max=1138, avg=1055.31, stdev=87.94 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.80%, ctx=243, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144568: Wed Aug 5 14:35:57 2026 read: IOPS=0, BW=1094KiB/s (1121kB/s)(4096KiB/3743msec) clat (nsec): min=983067k, max=983067k, avg=983066621.00, stdev= 0.00 lat (nsec): min=983069k, max=983069k, avg=983068931.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2189KiB/s (2241kB/s)(8192KiB/3743msec); 0 zone resets clat (msec): min=972, max=1492, avg=1232.60, stdev=367.52 lat (msec): min=973, max=1492, avg=1232.90, stdev=367.49 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.21%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144570: Wed Aug 5 14:35:57 2026 write: IOPS=0, BW=2988KiB/s (3060kB/s)(12.0MiB/4112msec); 0 zone resets clat (msec): min=576, max=1781, avg=1328.74, stdev=656.29 lat (msec): min=576, max=1784, avg=1332.86, stdev=659.23 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7937, max= 8031, per=100.00%, avg=7984.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.07%, sys=3.45%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144571: Wed Aug 5 14:35:57 2026 write: IOPS=0, BW=3955KiB/s (4050kB/s)(12.0MiB/3107msec); 0 zone resets clat (msec): min=503, max=1256, avg=955.84, stdev=398.89 lat (msec): min=506, max=1256, avg=956.98, stdev=397.45 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.34%, ctx=75, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4377KiB/s (4482kB/s), 1094KiB/s-3539KiB/s (1121kB/s-3624kB/s), io=16.0MiB (16.8MB), run=3472-3743msec WRITE: bw=7969KiB/s (8160kB/s), 2189KiB/s-3955KiB/s (2241kB/s-4050kB/s), io=32.0MiB (33.6MB), run=3107-4112msec