== sanity test 398b: DIO and buffer IO race ============== 09:49:19 (1790948959) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.88348 s, 7.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145400: Fri Oct 2 09:51:37 2026 read: IOPS=12, BW=50.1KiB/s (51.3kB/s)(5992KiB/119640msec) clat (usec): min=33, max=1180.9k, avg=40551.65, stdev=43376.99 lat (usec): min=33, max=1180.9k, avg=40553.69, stdev=43376.75 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 11469], | 20.00th=[ 18482], 30.00th=[ 23462], 40.00th=[ 27657], | 50.00th=[ 32637], 60.00th=[ 39060], 70.00th=[ 48497], | 80.00th=[ 57410], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[ 137364], 99.50th=[ 198181], 99.90th=[ 484443], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 110, per=25.13%, avg=50.00, stdev=19.49, samples=233 iops : min= 1, max= 27, avg=11.87, stdev= 4.90, samples=233 write: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6296KiB/119640msec); 0 zone resets clat (usec): min=717, max=341533, avg=37133.46, stdev=37143.49 lat (usec): min=718, max=341535, avg=37137.76, stdev=37144.64 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1237], 10.00th=[ 1582], 20.00th=[ 3654], | 30.00th=[ 7767], 40.00th=[ 17433], 50.00th=[ 27657], 60.00th=[ 38011], | 70.00th=[ 50594], 80.00th=[ 65274], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[149947], 99.50th=[170918], 99.90th=[231736], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 159, per=25.19%, avg=52.64, stdev=21.09, samples=233 iops : min= 1, max= 39, avg=12.54, stdev= 5.32, samples=233 lat (usec) : 50=0.33%, 100=3.12%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.35%, 4=4.49%, 10=6.38%, 20=11.33%, 50=38.48% lat (msec) : 100=23.67%, 250=5.18%, 500=0.16%, 2000=0.03% cpu : usr=0.07%, sys=4.86%, ctx=6439, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145401: Fri Oct 2 09:51:37 2026 read: IOPS=12, BW=49.9KiB/s (51.1kB/s)(5940KiB/118989msec) clat (usec): min=28, max=454708, avg=39701.97, stdev=30153.75 lat (usec): min=28, max=454708, avg=39705.54, stdev=30153.20 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 11207], 20.00th=[ 18744], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[141558], 99.50th=[168821], 99.90th=[219153], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 103, per=24.90%, avg=49.56, stdev=20.10, samples=234 iops : min= 1, max= 25, avg=11.76, stdev= 5.07, samples=234 write: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6348KiB/118989msec); 0 zone resets clat (usec): min=855, max=1091.6k, avg=37529.42, stdev=47627.02 lat (usec): min=856, max=1091.6k, avg=37535.13, stdev=47625.55 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1221], 10.00th=[ 1532], | 20.00th=[ 3916], 30.00th=[ 7439], 40.00th=[ 17171], | 50.00th=[ 27395], 60.00th=[ 35390], 70.00th=[ 47973], | 80.00th=[ 62653], 90.00th=[ 83362], 95.00th=[ 111674], | 99.00th=[ 185598], 99.50th=[ 221250], 99.90th=[ 375391], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 152, per=25.37%, avg=53.03, stdev=22.63, samples=234 iops : min= 1, max= 38, avg=12.63, stdev= 5.72, samples=234 lat (usec) : 50=0.20%, 100=3.09%, 250=0.29%, 500=0.13%, 1000=0.23% lat (msec) : 2=6.32%, 4=4.07%, 10=7.19%, 20=11.39%, 50=39.00% lat (msec) : 100=22.95%, 250=4.98%, 500=0.13%, 2000=0.03% cpu : usr=0.07%, sys=4.90%, ctx=6546, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145402: Fri Oct 2 09:51:37 2026 read: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6028KiB/120104msec) clat (usec): min=32, max=416898, avg=38926.29, stdev=30063.50 lat (usec): min=32, max=416900, avg=38929.55, stdev=30062.87 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 60], 10.00th=[ 10421], 20.00th=[ 18482], | 30.00th=[ 22938], 40.00th=[ 27657], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 84411], | 99.00th=[143655], 99.50th=[173016], 99.90th=[291505], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 110, per=25.41%, avg=50.56, stdev=21.43, samples=232 iops : min= 1, max= 27, avg=12.02, stdev= 5.41, samples=232 write: IOPS=13, BW=52.1KiB/s (53.4kB/s)(6260KiB/120104msec); 0 zone resets clat (usec): min=711, max=1340.4k, avg=38929.36, stdev=53312.87 lat (usec): min=712, max=1340.4k, avg=38931.17, stdev=53312.75 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1598], | 20.00th=[ 3556], 30.00th=[ 7242], 40.00th=[ 16909], | 50.00th=[ 27657], 60.00th=[ 36963], 70.00th=[ 50070], | 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[ 114820], | 99.00th=[ 196084], 99.50th=[ 225444], 99.90th=[ 367002], | 99.95th=[1333789], 99.99th=[1333789] bw ( KiB/s): min= 7, max= 119, per=24.95%, avg=52.15, stdev=21.76, samples=233 iops : min= 1, max= 29, avg=12.42, stdev= 5.48, samples=233 lat (usec) : 50=0.36%, 100=3.55%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.36% lat (msec) : 2=6.12%, 4=4.65%, 10=6.93%, 20=11.10%, 50=38.15% lat (msec) : 100=23.63%, 250=4.72%, 500=0.23%, 2000=0.03% cpu : usr=0.07%, sys=4.84%, ctx=6449, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145403: Fri Oct 2 09:51:37 2026 read: IOPS=12, BW=50.8KiB/s (52.1kB/s)(6052KiB/119039msec) clat (usec): min=35, max=277518, avg=38496.17, stdev=27548.01 lat (usec): min=35, max=277520, avg=38498.83, stdev=27547.65 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 10814], 20.00th=[ 19530], | 30.00th=[ 23987], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[121111], 99.50th=[168821], 99.90th=[265290], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 112, per=25.51%, avg=50.76, stdev=21.12, samples=233 iops : min= 1, max= 28, avg=12.06, stdev= 5.33, samples=233 write: IOPS=13, BW=52.4KiB/s (53.6kB/s)(6236KiB/119039msec); 0 zone resets clat (usec): min=666, max=1140.6k, avg=38687.86, stdev=48535.92 lat (usec): min=667, max=1140.6k, avg=38693.32, stdev=48533.96 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1565], | 20.00th=[ 4293], 30.00th=[ 9241], 40.00th=[ 18482], | 50.00th=[ 28181], 60.00th=[ 39060], 70.00th=[ 49546], | 80.00th=[ 65274], 90.00th=[ 87557], 95.00th=[ 107480], | 99.00th=[ 179307], 99.50th=[ 229639], 99.90th=[ 408945], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 119, per=24.99%, avg=52.24, stdev=20.67, samples=233 iops : min= 1, max= 29, avg=12.43, stdev= 5.18, samples=233 lat (usec) : 50=0.55%, 100=3.22%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.45%, 4=3.29%, 10=6.58%, 20=10.61%, 50=41.24% lat (msec) : 100=22.75%, 250=4.59%, 500=0.20%, 2000=0.03% cpu : usr=0.05%, sys=4.80%, ctx=6368, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=200KiB/s (205kB/s), 49.9KiB/s-50.8KiB/s (51.1kB/s-52.1kB/s), io=23.4MiB (24.6MB), run=118989-120104msec WRITE: bw=209KiB/s (214kB/s), 52.1KiB/s-53.3KiB/s (53.4kB/s-54.6kB/s), io=24.6MiB (25.7MB), run=118989-120104msec fio: pid=145405, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145405: Fri Oct 2 09:53:47 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(4296KiB/197067msec) clat (msec): min=5, max=1190, avg=39.54, stdev=51.24 lat (msec): min=5, max=1190, avg=39.54, stdev=51.24 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 81], 95.00th=[ 108], | 99.00th=[ 199], 99.50th=[ 239], 99.90th=[ 368], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 95, per=27.68%, avg=24.63, stdev=15.89, samples=336 iops : min= 1, max= 23, avg= 5.50, stdev= 3.99, samples=336 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(4492KiB/197067msec); 0 zone resets clat (msec): min=31, max=522, avg=137.37, stdev=63.74 lat (msec): min=31, max=522, avg=137.37, stdev=63.74 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 85], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 126], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 182], 90.00th=[ 222], 95.00th=[ 251], | 99.00th=[ 347], 99.50th=[ 376], 99.90th=[ 485], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 56, per=24.15%, avg=22.46, stdev=10.88, samples=384 iops : min= 1, max= 14, avg= 4.95, stdev= 2.79, samples=384 lat (msec) : 10=3.91%, 20=14.10%, 50=20.20%, 100=24.16%, 250=34.71% lat (msec) : 500=2.78%, 750=0.05%, 2000=0.05% cpu : usr=0.03%, sys=1.10%, ctx=3663, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1075,1123,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145406: Fri Oct 2 09:53:47 2026 read: IOPS=5, BW=23.8KiB/s (24.4kB/s)(5940KiB/249390msec) clat (msec): min=4, max=1039, avg=34.80, stdev=40.57 lat (msec): min=4, max=1039, avg=34.80, stdev=40.57 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 68], 95.00th=[ 89], | 99.00th=[ 165], 99.50th=[ 222], 99.90th=[ 347], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 95, per=30.08%, avg=26.77, stdev=17.91, samples=429 iops : min= 1, max= 23, avg= 6.06, stdev= 4.51, samples=429 write: IOPS=6, BW=25.5KiB/s (26.1kB/s)(6348KiB/249390msec); 0 zone resets clat (msec): min=30, max=528, avg=124.31, stdev=62.60 lat (msec): min=30, max=528, avg=124.31, stdev=62.60 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 72], | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 111], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 167], 90.00th=[ 211], 95.00th=[ 241], | 99.00th=[ 321], 99.50th=[ 384], 99.90th=[ 451], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 64, per=26.89%, avg=25.01, stdev=11.93, samples=490 iops : min= 1, max= 16, avg= 5.61, stdev= 3.06, samples=490 lat (msec) : 10=4.56%, 20=13.57%, 50=23.44%, 100=27.31%, 250=28.68% lat (msec) : 500=2.38%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.23%, ctx=5518, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145407: Fri Oct 2 09:53:47 2026 read: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6028KiB/250355msec) clat (msec): min=3, max=337, avg=36.22, stdev=35.01 lat (msec): min=3, max=337, avg=36.22, stdev=35.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 73], 95.00th=[ 96], | 99.00th=[ 186], 99.50th=[ 232], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 95, per=29.25%, avg=26.03, stdev=16.84, samples=448 iops : min= 1, max= 23, avg= 5.87, stdev= 4.26, samples=448 write: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6260KiB/250355msec); 0 zone resets clat (msec): min=29, max=1315, avg=124.89, stdev=68.78 lat (msec): min=29, max=1315, avg=124.90, stdev=68.78 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 62], 20.00th=[ 73], | 30.00th=[ 86], 40.00th=[ 99], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 207], 95.00th=[ 243], | 99.00th=[ 342], 99.50th=[ 368], 99.90th=[ 464], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7, max= 64, per=26.50%, avg=24.64, stdev=12.14, samples=490 iops : min= 1, max= 16, avg= 5.52, stdev= 3.11, samples=490 lat (msec) : 4=0.03%, 10=4.36%, 20=13.28%, 50=23.83%, 100=26.33% lat (msec) : 250=29.65%, 500=2.47%, 2000=0.03% cpu : usr=0.04%, sys=1.30%, ctx=5670, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145408: Fri Oct 2 09:53:47 2026 read: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6052KiB/248049msec) clat (msec): min=4, max=514, avg=32.70, stdev=30.47 lat (msec): min=4, max=514, avg=32.71, stdev=30.47 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 65], 95.00th=[ 87], | 99.00th=[ 144], 99.50th=[ 174], 99.90th=[ 284], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7, max= 95, per=29.62%, avg=26.36, stdev=18.15, samples=444 iops : min= 1, max= 23, avg= 5.95, stdev= 4.56, samples=444 write: IOPS=6, BW=25.1KiB/s (25.7kB/s)(6236KiB/248049msec); 0 zone resets clat (msec): min=29, max=1212, avg=127.08, stdev=67.55 lat (msec): min=29, max=1212, avg=127.09, stdev=67.55 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 114], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 209], 95.00th=[ 243], | 99.00th=[ 338], 99.50th=[ 380], 99.90th=[ 477], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 64, per=26.42%, avg=24.57, stdev=11.57, samples=489 iops : min= 1, max= 16, avg= 5.50, stdev= 2.96, samples=489 lat (msec) : 10=4.95%, 20=14.29%, 50=23.93%, 100=25.00%, 250=29.72% lat (msec) : 500=2.05%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5560, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.1KiB/s (91.3kB/s), 21.8KiB/s-24.4KiB/s (22.3kB/s-24.0kB/s), io=21.8MiB (22.9MB), run=197067-250355msec WRITE: bw=93.2KiB/s (95.4kB/s), 22.8KiB/s-25.5KiB/s (23.3kB/s-26.1kB/s), io=22.8MiB (23.9MB), run=197067-250355msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145464: Fri Oct 2 09:54:25 2026 read: IOPS=15, BW=242KiB/s (247kB/s)(5920KiB/24513msec) clat (usec): min=39, max=159304, avg=34369.22, stdev=27402.87 lat (usec): min=39, max=159305, avg=34370.32, stdev=27402.88 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 105], | 30.00th=[ 20579], 40.00th=[ 26346], 50.00th=[ 33162], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 66847], 95.00th=[ 79168], | 99.00th=[120062], 99.50th=[135267], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 125, max= 508, per=27.96%, avg=241.02, stdev=79.79, samples=48 iops : min= 7, max= 31, avg=14.38, stdev= 5.07, samples=48 write: IOPS=16, BW=260KiB/s (266kB/s)(6368KiB/24513msec); 0 zone resets clat (usec): min=1001, max=221680, avg=29553.57, stdev=32633.75 lat (usec): min=1003, max=221683, avg=29556.43, stdev=32633.84 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1762], 10.00th=[ 2278], 20.00th=[ 3818], | 30.00th=[ 7111], 40.00th=[ 10814], 50.00th=[ 17171], 60.00th=[ 27132], | 70.00th=[ 35390], 80.00th=[ 47449], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[147850], 99.50th=[152044], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 64, max= 440, per=28.62%, avg=259.62, stdev=82.03, samples=48 iops : min= 4, max= 27, avg=15.56, stdev= 5.12, samples=48 lat (usec) : 50=2.08%, 100=7.03%, 250=2.08%, 500=0.26% lat (msec) : 2=4.43%, 4=6.77%, 10=8.72%, 20=10.16%, 50=35.94% lat (msec) : 100=19.40%, 250=3.12% cpu : usr=0.07%, sys=6.44%, ctx=1443, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145465: Fri Oct 2 09:54:25 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(5744KiB/27763msec) clat (usec): min=40, max=210883, avg=40276.93, stdev=31719.58 lat (usec): min=41, max=210885, avg=40278.01, stdev=31719.56 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 15008], | 30.00th=[ 22676], 40.00th=[ 30016], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 55313], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[160433], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 49, max= 412, per=24.43%, avg=210.60, stdev=74.43, samples=53 iops : min= 3, max= 25, avg=12.47, stdev= 4.68, samples=53 write: IOPS=14, BW=236KiB/s (241kB/s)(6544KiB/27763msec); 0 zone resets clat (usec): min=1254, max=307554, avg=32413.18, stdev=38221.94 lat (usec): min=1255, max=307555, avg=32416.54, stdev=38222.48 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1762], 10.00th=[ 2409], 20.00th=[ 4424], | 30.00th=[ 7570], 40.00th=[ 11731], 50.00th=[ 19792], 60.00th=[ 30540], | 70.00th=[ 39584], 80.00th=[ 54264], 90.00th=[ 77071], 95.00th=[100140], | 99.00th=[200279], 99.50th=[225444], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 90, max= 479, per=25.99%, avg=235.74, stdev=99.48, samples=54 iops : min= 5, max= 29, avg=14.04, stdev= 6.25, samples=54 lat (usec) : 50=1.43%, 100=5.08%, 250=1.43%, 750=0.13% lat (msec) : 2=4.43%, 4=5.60%, 10=10.03%, 20=10.81%, 50=33.72% lat (msec) : 100=23.18%, 250=4.04%, 500=0.13% cpu : usr=0.07%, sys=6.04%, ctx=1527, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145466: Fri Oct 2 09:54:25 2026 read: IOPS=14, BW=229KiB/s (235kB/s)(6256KiB/27290msec) clat (usec): min=36, max=168005, avg=35603.85, stdev=28849.41 lat (usec): min=36, max=168007, avg=35605.12, stdev=28849.43 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 2442], | 30.00th=[ 21627], 40.00th=[ 26608], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 85459], | 99.00th=[130548], 99.50th=[162530], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 95, max= 442, per=26.78%, avg=230.87, stdev=83.97, samples=53 iops : min= 5, max= 27, avg=13.74, stdev= 5.33, samples=53 write: IOPS=13, BW=221KiB/s (226kB/s)(6032KiB/27290msec); 0 zone resets clat (usec): min=1258, max=226151, avg=35374.87, stdev=35047.90 lat (usec): min=1260, max=226152, avg=35381.86, stdev=35045.51 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1860], 10.00th=[ 2638], 20.00th=[ 5276], | 30.00th=[ 8291], 40.00th=[ 12911], 50.00th=[ 22938], 60.00th=[ 35914], | 70.00th=[ 49546], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[100140], | 99.00th=[141558], 99.50th=[193987], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 94, max= 379, per=24.15%, avg=219.02, stdev=75.04, samples=53 iops : min= 5, max= 23, avg=12.98, stdev= 4.70, samples=53 lat (usec) : 50=1.04%, 100=7.94%, 250=0.52%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.52%, 4=4.69%, 10=9.51%, 20=9.77%, 50=36.07% lat (msec) : 100=22.53%, 250=4.04% cpu : usr=0.08%, sys=6.29%, ctx=1511, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145467: Fri Oct 2 09:54:25 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(6032KiB/27230msec) clat (usec): min=35, max=244660, avg=36887.93, stdev=32852.21 lat (usec): min=36, max=244661, avg=36889.04, stdev=32852.22 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 102], | 30.00th=[ 19006], 40.00th=[ 25822], 50.00th=[ 34341], 60.00th=[ 42206], | 70.00th=[ 51119], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 86508], | 99.00th=[131597], 99.50th=[240124], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 63, max= 442, per=26.16%, avg=225.46, stdev=94.81, samples=52 iops : min= 3, max= 27, avg=13.40, stdev= 5.98, samples=52 write: IOPS=14, BW=230KiB/s (235kB/s)(6256KiB/27230msec); 0 zone resets clat (usec): min=1337, max=208232, avg=33913.92, stdev=37453.18 lat (usec): min=1338, max=208234, avg=33916.19, stdev=37453.28 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1811], 10.00th=[ 2212], 20.00th=[ 4015], | 30.00th=[ 8717], 40.00th=[ 13042], 50.00th=[ 22414], 60.00th=[ 32113], | 70.00th=[ 41681], 80.00th=[ 55313], 90.00th=[ 79168], 95.00th=[111674], | 99.00th=[183501], 99.50th=[198181], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 63, max= 515, per=25.43%, avg=230.68, stdev=97.45, samples=53 iops : min= 3, max= 32, avg=13.74, stdev= 6.19, samples=53 lat (usec) : 50=1.69%, 100=7.94%, 250=1.43%, 500=0.26%, 750=0.39% lat (msec) : 2=4.56%, 4=5.86%, 10=8.07%, 20=8.85%, 50=33.20% lat (msec) : 100=23.44%, 250=4.30% cpu : usr=0.08%, sys=5.98%, ctx=1507, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=863KiB/s (883kB/s), 207KiB/s-242KiB/s (212kB/s-247kB/s), io=23.4MiB (24.5MB), run=24513-27763msec WRITE: bw=908KiB/s (929kB/s), 221KiB/s-260KiB/s (226kB/s-266kB/s), io=24.6MiB (25.8MB), run=24513-27763msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145459: Fri Oct 2 09:55:00 2026 read: IOPS=5, BW=93.3KiB/s (95.5kB/s)(5920KiB/63458msec) clat (msec): min=6, max=338, avg=37.11, stdev=36.42 lat (msec): min=6, max=338, avg=37.12, stdev=36.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 104], | 99.00th=[ 165], 99.50th=[ 203], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 379, per=26.41%, avg=99.05, stdev=69.12, samples=117 iops : min= 1, max= 23, avg= 5.39, stdev= 4.41, samples=117 write: IOPS=6, BW=100KiB/s (103kB/s)(6368KiB/63458msec); 0 zone resets clat (msec): min=38, max=419, avg=124.65, stdev=62.32 lat (msec): min=38, max=419, avg=124.65, stdev=62.32 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 122], | 70.00th=[ 140], 80.00th=[ 163], 90.00th=[ 205], 95.00th=[ 253], | 99.00th=[ 338], 99.50th=[ 401], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 31, max= 192, per=25.79%, avg=101.63, stdev=47.27, samples=123 iops : min= 1, max= 12, avg= 5.55, stdev= 3.05, samples=123 lat (msec) : 10=3.26%, 20=16.93%, 50=18.88%, 100=27.08%, 250=31.12% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.27%, ctx=1304, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145460: Fri Oct 2 09:55:00 2026 read: IOPS=5, BW=89.9KiB/s (92.1kB/s)(5744KiB/63864msec) clat (msec): min=5, max=340, avg=34.07, stdev=34.63 lat (msec): min=5, max=340, avg=34.07, stdev=34.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 91], | 99.00th=[ 178], 99.50th=[ 224], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 21, max= 383, per=26.94%, avg=101.03, stdev=62.99, samples=110 iops : min= 1, max= 23, avg= 5.53, stdev= 4.02, samples=110 write: IOPS=6, BW=102KiB/s (105kB/s)(6544KiB/63864msec); 0 zone resets clat (msec): min=40, max=427, avg=125.99, stdev=66.03 lat (msec): min=40, max=427, avg=125.99, stdev=66.03 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 73], | 30.00th=[ 86], 40.00th=[ 94], 50.00th=[ 107], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 243], | 99.00th=[ 368], 99.50th=[ 393], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 224, per=25.84%, avg=101.80, stdev=46.30, samples=124 iops : min= 1, max= 14, avg= 5.56, stdev= 3.00, samples=124 lat (msec) : 10=3.52%, 20=16.41%, 50=20.31%, 100=27.99%, 250=29.17% lat (msec) : 500=2.60% cpu : usr=0.03%, sys=1.31%, ctx=1327, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145461: Fri Oct 2 09:55:00 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(6256KiB/61729msec) clat (msec): min=5, max=341, avg=35.47, stdev=34.46 lat (msec): min=5, max=341, avg=35.47, stdev=34.46 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 80], 95.00th=[ 104], | 99.00th=[ 190], 99.50th=[ 213], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 383, per=29.22%, avg=109.57, stdev=78.11, samples=112 iops : min= 1, max= 23, avg= 6.05, stdev= 4.97, samples=112 write: IOPS=6, BW=97.7KiB/s (100kB/s)(6032KiB/61729msec); 0 zone resets clat (msec): min=33, max=381, avg=126.64, stdev=60.14 lat (msec): min=33, max=381, avg=126.64, stdev=60.15 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 91], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 125], | 70.00th=[ 142], 80.00th=[ 169], 90.00th=[ 213], 95.00th=[ 247], | 99.00th=[ 326], 99.50th=[ 359], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 223, per=24.70%, avg=97.31, stdev=41.24, samples=120 iops : min= 1, max= 13, avg= 5.27, stdev= 2.66, samples=120 lat (msec) : 10=3.39%, 20=17.45%, 50=20.96%, 100=26.69%, 250=29.43% lat (msec) : 500=2.08% cpu : usr=0.03%, sys=1.26%, ctx=1264, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145462: Fri Oct 2 09:55:00 2026 read: IOPS=5, BW=95.4KiB/s (97.6kB/s)(6032KiB/63258msec) clat (msec): min=6, max=314, avg=37.11, stdev=40.55 lat (msec): min=6, max=314, avg=37.11, stdev=40.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 50], 90.00th=[ 84], 95.00th=[ 120], | 99.00th=[ 188], 99.50th=[ 284], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 347, per=29.96%, avg=112.35, stdev=67.54, samples=104 iops : min= 1, max= 21, avg= 6.22, stdev= 4.29, samples=104 write: IOPS=6, BW=98.9KiB/s (101kB/s)(6256KiB/63258msec); 0 zone resets clat (msec): min=32, max=412, avg=125.91, stdev=64.55 lat (msec): min=32, max=412, avg=125.92, stdev=64.55 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 100], 50.00th=[ 110], 60.00th=[ 122], | 70.00th=[ 142], 80.00th=[ 163], 90.00th=[ 209], 95.00th=[ 249], | 99.00th=[ 380], 99.50th=[ 397], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 31, max= 223, per=25.34%, avg=99.84, stdev=46.55, samples=122 iops : min= 1, max= 13, avg= 5.44, stdev= 3.00, samples=122 lat (msec) : 10=2.99%, 20=18.36%, 50=19.53%, 100=25.13%, 250=31.25% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.31%, ctx=1339, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=375KiB/s (384kB/s), 89.9KiB/s-101KiB/s (92.1kB/s-104kB/s), io=23.4MiB (24.5MB), run=61729-63864msec WRITE: bw=395KiB/s (404kB/s), 97.7KiB/s-102KiB/s (100kB/s-105kB/s), io=24.6MiB (25.8MB), run=61729-63864msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145486: Fri Oct 2 09:55:16 2026 read: IOPS=1, BW=1493KiB/s (1529kB/s)(7168KiB/4802msec) clat (usec): min=805, max=239868, avg=145653.24, stdev=77428.76 lat (usec): min=806, max=239869, avg=145654.55, stdev=77428.79 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[102237], | 30.00th=[132645], 40.00th=[132645], 50.00th=[168821], 60.00th=[187696], | 70.00th=[187696], 80.00th=[187696], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 4031, max= 4096, per=100.00%, avg=4063.50, stdev=45.96, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1066KiB/s (1092kB/s)(5120KiB/4802msec); 0 zone resets clat (msec): min=100, max=2712, avg=702.32, stdev=1126.16 lat (msec): min=100, max=2712, avg=702.42, stdev=1126.15 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 2015, max= 6107, per=95.82%, avg=4061.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 1000=8.33% lat (msec) : 250=75.00%, 500=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.25%, ctx=166, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145487: Fri Oct 2 09:55:16 2026 read: IOPS=0, BW=336KiB/s (344kB/s)(2048KiB/6095msec) clat (msec): min=275, max=2863, avg=1569.29, stdev=1830.32 lat (msec): min=275, max=2863, avg=1569.29, stdev=1830.32 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 2869], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1961, max= 2027, per=65.87%, avg=1994.00, stdev=46.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1680KiB/s (1720kB/s)(10.0MiB/6095msec); 0 zone resets clat (msec): min=114, max=409, avg=286.69, stdev=115.33 lat (msec): min=114, max=409, avg=286.77, stdev=115.33 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 146], | 30.00th=[ 174], 40.00th=[ 226], 50.00th=[ 271], 60.00th=[ 351], | 70.00th=[ 384], 80.00th=[ 388], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1957, max= 6095, per=75.21%, avg=3187.20, stdev=1831.88, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=33.33%, 500=58.33%, >=2000=8.33% cpu : usr=0.05%, sys=8.20%, ctx=636, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145488: Fri Oct 2 09:55:16 2026 read: IOPS=0, BW=908KiB/s (930kB/s)(6144KiB/6764msec) clat (usec): min=517, max=298425, avg=144398.37, stdev=122952.83 lat (usec): min=519, max=298425, avg=144399.52, stdev=122952.52 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 529], | 30.00th=[ 529], 40.00th=[141558], 50.00th=[141558], 60.00th=[187696], | 70.00th=[235930], 80.00th=[235930], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 1957, max= 4039, per=82.33%, avg=2492.00, stdev=1031.63, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=908KiB/s (930kB/s)(6144KiB/6764msec); 0 zone resets clat (msec): min=153, max=3190, avg=935.33, stdev=1141.06 lat (msec): min=154, max=3190, avg=935.43, stdev=1141.06 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 481], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1957, max= 4023, per=56.17%, avg=2380.40, stdev=918.41, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=33.33%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.40%, ctx=166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145489: Fri Oct 2 09:55:16 2026 read: IOPS=0, BW=759KiB/s (777kB/s)(5120KiB/6750msec) clat (usec): min=343, max=436939, avg=160810.52, stdev=191264.81 lat (usec): min=343, max=436941, avg=160811.73, stdev=191265.15 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 343], 10.00th=[ 343], 20.00th=[ 343], | 30.00th=[ 457], 40.00th=[ 457], 50.00th=[ 89654], 60.00th=[ 89654], | 70.00th=[278922], 80.00th=[278922], 90.00th=[438305], 95.00th=[438305], | 99.00th=[438305], 99.50th=[438305], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 1961, max= 6059, per=100.00%, avg=4010.00, stdev=2897.72, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1062KiB/s (1087kB/s)(7168KiB/6750msec); 0 zone resets clat (msec): min=123, max=3134, avg=805.02, stdev=1050.18 lat (msec): min=123, max=3134, avg=805.15, stdev=1050.20 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 213], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 510], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 735], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 2000, max= 3915, per=56.52%, avg=2395.20, stdev=849.67, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67% lat (msec) : 100=8.33%, 250=16.67%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=6.25%, ctx=157, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3028KiB/s (3100kB/s), 336KiB/s-1493KiB/s (344kB/s-1529kB/s), io=20.0MiB (20.0MB), run=4802-6764msec WRITE: bw=4239KiB/s (4341kB/s), 908KiB/s-1680KiB/s (930kB/s-1720kB/s), io=28.0MiB (29.4MB), run=4802-6764msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145481: Fri Oct 2 09:55:16 2026 read: IOPS=1, BW=1069KiB/s (1095kB/s)(7168KiB/6705msec) clat (msec): min=65, max=564, avg=161.78, stdev=178.89 lat (msec): min=65, max=564, avg=161.78, stdev=178.89 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 70], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 104], 60.00th=[ 108], | 70.00th=[ 108], 80.00th=[ 128], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2015, max= 4266, per=100.00%, avg=3432.00, stdev=1233.56, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=764KiB/s (782kB/s)(5120KiB/6705msec); 0 zone resets clat (msec): min=584, max=2949, avg=1101.31, stdev=1034.38 lat (msec): min=584, max=2949, avg=1101.41, stdev=1034.37 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 1917, max= 2015, per=48.03%, avg=1966.00, stdev=48.70, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 750=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.66%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145482: Fri Oct 2 09:55:16 2026 read: IOPS=0, BW=293KiB/s (300kB/s)(2048KiB/7000msec) clat (msec): min=150, max=2825, avg=1488.04, stdev=1891.50 lat (msec): min=150, max=2825, avg=1488.04, stdev=1891.51 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 2836], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2015, max= 2048, per=69.50%, avg=2031.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1463KiB/s (1498kB/s)(10.0MiB/7000msec); 0 zone resets clat (msec): min=105, max=994, avg=370.31, stdev=292.97 lat (msec): min=105, max=994, avg=370.40, stdev=292.96 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 148], | 30.00th=[ 155], 40.00th=[ 213], 50.00th=[ 224], 60.00th=[ 321], | 70.00th=[ 380], 80.00th=[ 388], 90.00th=[ 776], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1917, max= 4031, per=77.34%, avg=3165.40, stdev=1104.06, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.50%, ctx=94, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145483: Fri Oct 2 09:55:16 2026 read: IOPS=0, BW=932KiB/s (955kB/s)(6144KiB/6590msec) clat (msec): min=85, max=151, avg=124.21, stdev=23.02 lat (msec): min=85, max=151, avg=124.21, stdev=23.02 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 127], 50.00th=[ 127], 60.00th=[ 136], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 2015, max= 3864, per=100.00%, avg=3216.67, stdev=1041.71, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=932KiB/s (955kB/s)(6144KiB/6590msec); 0 zone resets clat (msec): min=313, max=3078, avg=929.07, stdev=1066.67 lat (msec): min=318, max=3080, avg=930.12, stdev=1066.78 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 634], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1917, max= 2015, per=48.23%, avg=1974.20, stdev=45.99, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.99%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145484: Fri Oct 2 09:55:16 2026 read: IOPS=0, BW=731KiB/s (748kB/s)(5120KiB/7005msec) clat (msec): min=56, max=619, avg=356.12, stdev=209.34 lat (msec): min=56, max=619, avg=356.12, stdev=209.34 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1885, max= 2015, per=66.99%, avg=1958.00, stdev=60.60, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=1023KiB/s (1048kB/s)(7168KiB/7005msec); 0 zone resets clat (msec): min=91, max=3035, avg=713.71, stdev=1047.84 lat (msec): min=91, max=3036, avg=713.89, stdev=1047.86 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 127], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 296], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 709], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1885, max= 2007, per=47.93%, avg=1961.80, stdev=56.72, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.07%, ctx=80, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2924KiB/s (2994kB/s), 293KiB/s-1069KiB/s (300kB/s-1095kB/s), io=20.0MiB (20.0MB), run=6590-7005msec WRITE: bw=4093KiB/s (4191kB/s), 764KiB/s-1463KiB/s (782kB/s-1498kB/s), io=28.0MiB (29.4MB), run=6590-7005msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145497: Fri Oct 2 09:55:31 2026 read: IOPS=0, BW=4022KiB/s (4119kB/s)(12.0MiB/3055msec) clat (msec): min=321, max=1293, avg=952.91, stdev=547.66 lat (msec): min=321, max=1293, avg=952.91, stdev=547.66 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.75%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145499: Fri Oct 2 09:55:31 2026 read: IOPS=0, BW=1168KiB/s (1196kB/s)(4096KiB/3506msec) clat (nsec): min=1615.3M, max=1615.3M, avg=1615264955.00, stdev= 0.00 lat (nsec): min=1615.3M, max=1615.3M, avg=1615268062.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1620], 5.00th=[ 1620], 10.00th=[ 1620], 20.00th=[ 1620], | 30.00th=[ 1620], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2337KiB/s (2393kB/s)(8192KiB/3506msec); 0 zone resets clat (msec): min=678, max=1006, avg=842.38, stdev=232.05 lat (msec): min=678, max=1006, avg=842.80, stdev=232.04 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8159, max= 8159, per=87.30%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.34%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145500: Fri Oct 2 09:55:31 2026 write: IOPS=0, BW=3762KiB/s (3853kB/s)(12.0MiB/3266msec); 0 zone resets clat (msec): min=525, max=1424, avg=1031.38, stdev=459.91 lat (msec): min=526, max=1425, avg=1032.55, stdev=460.30 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8031, max= 8110, per=86.35%, avg=8070.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.06%, sys=4.66%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145501: Fri Oct 2 09:55:31 2026 write: IOPS=1, BW=4276KiB/s (4378kB/s)(12.0MiB/2874msec); 0 zone resets clat (msec): min=496, max=1630, avg=904.91, stdev=629.94 lat (msec): min=499, max=1630, avg=906.22, stdev=629.06 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 6104, max= 7907, per=74.96%, avg=7005.50, stdev=1274.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.86%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4673KiB/s (4785kB/s), 1168KiB/s-4022KiB/s (1196kB/s-4119kB/s), io=16.0MiB (16.8MB), run=3055-3506msec WRITE: bw=9346KiB/s (9571kB/s), 2337KiB/s-4276KiB/s (2393kB/s-4378kB/s), io=32.0MiB (33.6MB), run=2874-3506msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145502: Fri Oct 2 09:55:32 2026 read: IOPS=1, BW=4836KiB/s (4952kB/s)(12.0MiB/2541msec) clat (msec): min=596, max=1014, avg=820.79, stdev=210.77 lat (msec): min=596, max=1014, avg=820.79, stdev=210.77 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=10.87%, ctx=431, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145503: Fri Oct 2 09:55:32 2026 read: IOPS=0, BW=1471KiB/s (1507kB/s)(4096KiB/2784msec) clat (nsec): min=872467k, max=872467k, avg=872467046.00, stdev= 0.00 lat (nsec): min=872470k, max=872470k, avg=872469568.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2943KiB/s (3013kB/s)(8192KiB/2784msec); 0 zone resets clat (msec): min=610, max=1227, avg=918.73, stdev=436.19 lat (msec): min=610, max=1232, avg=921.35, stdev=439.40 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8175, max= 8175, per=87.85%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.46%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145504: Fri Oct 2 09:55:32 2026 write: IOPS=0, BW=3490KiB/s (3574kB/s)(12.0MiB/3521msec); 0 zone resets clat (msec): min=241, max=2036, avg=1156.29, stdev=898.01 lat (msec): min=243, max=2037, avg=1157.72, stdev=897.42 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8094, max= 8094, per=86.98%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=4.01%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145505: Fri Oct 2 09:55:32 2026 write: IOPS=0, BW=3806KiB/s (3897kB/s)(12.0MiB/3229msec); 0 zone resets clat (msec): min=242, max=2052, avg=1056.62, stdev=918.82 lat (msec): min=242, max=2053, avg=1057.10, stdev=918.84 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8094, max= 8126, per=87.15%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.31%, sys=2.79%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5885KiB/s (6026kB/s), 1471KiB/s-4836KiB/s (1507kB/s-4952kB/s), io=16.0MiB (16.8MB), run=2541-2784msec WRITE: bw=9306KiB/s (9530kB/s), 2943KiB/s-3806KiB/s (3013kB/s-3897kB/s), io=32.0MiB (33.6MB), run=2784-3521msec