== sanity test 398b: DIO and buffer IO race ============== 01:41:16 (1787377276) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.35975 s, 6.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144987: Sat Aug 22 01:43:56 2026 read: IOPS=11, BW=44.2KiB/s (45.2kB/s)(5992KiB/135604msec) clat (usec): min=36, max=757277, avg=43881.22, stdev=37579.63 lat (usec): min=36, max=757278, avg=43884.57, stdev=37578.60 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 701], 20.00th=[ 20055], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[145753], 99.50th=[179307], 99.90th=[371196], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 119, per=25.34%, avg=43.83, stdev=20.58, samples=266 iops : min= 1, max= 29, avg=10.33, stdev= 5.18, samples=266 write: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6296KiB/135604msec); 0 zone resets clat (usec): min=640, max=939135, avg=44024.18, stdev=50685.79 lat (usec): min=640, max=939136, avg=44027.92, stdev=50684.22 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1516], 20.00th=[ 4047], | 30.00th=[ 8979], 40.00th=[ 20317], 50.00th=[ 30802], 60.00th=[ 42730], | 70.00th=[ 58459], 80.00th=[ 74974], 90.00th=[105382], 95.00th=[129500], | 99.00th=[193987], 99.50th=[238027], 99.90th=[450888], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 5, max= 143, per=25.44%, avg=46.30, stdev=21.12, samples=265 iops : min= 1, max= 35, avg=10.94, stdev= 5.33, samples=265 lat (usec) : 50=0.46%, 100=4.00%, 250=0.26%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=6.51%, 4=3.48%, 10=6.12%, 20=8.89%, 50=35.48% lat (msec) : 100=25.94%, 250=8.17%, 500=0.23%, 1000=0.07% cpu : usr=0.07%, sys=4.55%, ctx=6263, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144988: Sat Aug 22 01:43:56 2026 read: IOPS=10, BW=43.3KiB/s (44.3kB/s)(5940KiB/137308msec) clat (usec): min=27, max=320676, avg=44445.15, stdev=31646.18 lat (usec): min=27, max=320677, avg=44446.72, stdev=31646.50 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 12125], 20.00th=[ 21103], | 30.00th=[ 26608], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[152044], 99.50th=[173016], 99.90th=[227541], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 119, per=25.06%, avg=43.35, stdev=18.51, samples=267 iops : min= 1, max= 29, avg=10.19, stdev= 4.64, samples=267 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6348KiB/137308msec); 0 zone resets clat (usec): min=925, max=921977, avg=44536.12, stdev=51983.55 lat (usec): min=926, max=921979, avg=44545.60, stdev=51979.59 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1663], 20.00th=[ 4621], | 30.00th=[ 9765], 40.00th=[ 21365], 50.00th=[ 32900], 60.00th=[ 44303], | 70.00th=[ 58983], 80.00th=[ 76022], 90.00th=[101188], 95.00th=[127402], | 99.00th=[193987], 99.50th=[225444], 99.90th=[792724], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 111, per=25.11%, avg=45.71, stdev=20.92, samples=270 iops : min= 1, max= 27, avg=10.79, stdev= 5.28, samples=270 lat (usec) : 50=0.52%, 100=3.29%, 250=0.29%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.99%, 4=3.61%, 10=6.25%, 20=8.53%, 50=35.55% lat (msec) : 100=27.93%, 250=7.58%, 500=0.10%, 1000=0.07% cpu : usr=0.09%, sys=4.62%, ctx=6433, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144989: Sat Aug 22 01:43:56 2026 read: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6028KiB/137646msec) clat (usec): min=27, max=246483, avg=42565.59, stdev=30100.50 lat (usec): min=27, max=246484, avg=42568.43, stdev=30099.73 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 63], 10.00th=[ 130], 20.00th=[ 19792], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[135267], 99.50th=[149947], 99.90th=[185598], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 117, per=25.42%, avg=43.97, stdev=21.27, samples=266 iops : min= 1, max= 29, avg=10.36, stdev= 5.37, samples=266 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6260KiB/137646msec); 0 zone resets clat (usec): min=832, max=953507, avg=46593.94, stdev=55734.91 lat (usec): min=832, max=953508, avg=46600.38, stdev=55733.77 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1434], 20.00th=[ 4080], | 30.00th=[ 9110], 40.00th=[ 20841], 50.00th=[ 33817], 60.00th=[ 45351], | 70.00th=[ 59507], 80.00th=[ 79168], 90.00th=[109577], 95.00th=[137364], | 99.00th=[217056], 99.50th=[265290], 99.90th=[557843], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 111, per=24.69%, avg=44.94, stdev=20.00, samples=270 iops : min= 1, max= 27, avg=10.60, stdev= 5.05, samples=270 lat (usec) : 50=0.78%, 100=3.91%, 250=0.46%, 500=0.10%, 1000=0.20% lat (msec) : 2=6.12%, 4=3.87%, 10=6.12%, 20=8.20%, 50=35.32% lat (msec) : 100=26.33%, 250=8.33%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.43%, ctx=6425, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144991: Sat Aug 22 01:43:56 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(6052KiB/138081msec) clat (usec): min=21, max=981116, avg=44403.70, stdev=41601.46 lat (usec): min=22, max=981117, avg=44406.69, stdev=41600.86 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 67], 10.00th=[ 8717], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[154141], 99.50th=[208667], 99.90th=[350225], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 140, per=25.26%, avg=43.70, stdev=18.99, samples=269 iops : min= 1, max= 35, avg=10.30, stdev= 4.79, samples=269 write: IOPS=11, BW=45.2KiB/s (46.2kB/s)(6236KiB/138081msec); 0 zone resets clat (usec): min=737, max=409140, avg=45133.36, stdev=44594.43 lat (usec): min=737, max=409143, avg=45137.94, stdev=44592.98 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1860], 20.00th=[ 5211], | 30.00th=[ 11207], 40.00th=[ 24773], 50.00th=[ 34341], 60.00th=[ 46924], | 70.00th=[ 60031], 80.00th=[ 74974], 90.00th=[103285], 95.00th=[129500], | 99.00th=[191890], 99.50th=[225444], 99.90th=[387974], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 110, per=24.62%, avg=44.80, stdev=20.67, samples=270 iops : min= 1, max= 27, avg=10.57, stdev= 5.20, samples=270 lat (usec) : 50=0.55%, 100=3.39%, 250=0.52%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=5.18%, 4=3.19%, 10=6.28%, 20=9.11%, 50=36.39% lat (msec) : 100=26.50%, 250=8.20%, 500=0.29%, 1000=0.03% cpu : usr=0.08%, sys=4.61%, ctx=6598, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.3KiB/s-44.2KiB/s (44.3kB/s-45.2kB/s), io=23.4MiB (24.6MB), run=135604-138081msec WRITE: bw=182KiB/s (186kB/s), 45.2KiB/s-46.4KiB/s (46.2kB/s-47.5kB/s), io=24.6MiB (25.7MB), run=135604-138081msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144992: Sat Aug 22 01:46:28 2026 read: IOPS=5, BW=20.7KiB/s (21.1kB/s)(5992KiB/290147msec) clat (msec): min=5, max=1017, avg=39.85, stdev=46.18 lat (msec): min=5, max=1017, avg=39.85, stdev=46.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 186], 99.50th=[ 239], 99.90th=[ 506], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 111, per=28.90%, avg=23.70, stdev=16.15, samples=488 iops : min= 1, max= 27, avg= 5.30, stdev= 4.07, samples=488 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6296KiB/290147msec); 0 zone resets clat (msec): min=34, max=861, avg=146.05, stdev=73.48 lat (msec): min=34, max=861, avg=146.05, stdev=73.48 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 87], | 30.00th=[ 102], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 197], 90.00th=[ 245], 95.00th=[ 288], | 99.00th=[ 384], 99.50th=[ 418], 99.90th=[ 542], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 56, per=24.96%, avg=21.46, stdev=10.31, samples=563 iops : min= 1, max= 14, avg= 4.73, stdev= 2.63, samples=563 lat (msec) : 10=2.96%, 20=14.39%, 50=20.67%, 100=22.49%, 250=34.64% lat (msec) : 500=4.69%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5183, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144993: Sat Aug 22 01:46:28 2026 read: IOPS=5, BW=20.5KiB/s (20.0kB/s)(5940KiB/289801msec) clat (msec): min=5, max=1014, avg=39.45, stdev=44.97 lat (msec): min=5, max=1014, avg=39.45, stdev=44.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 78], 95.00th=[ 107], | 99.00th=[ 190], 99.50th=[ 243], 99.90th=[ 451], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 95, per=28.56%, avg=23.42, stdev=16.09, samples=489 iops : min= 1, max= 23, avg= 5.23, stdev= 4.06, samples=489 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6348KiB/289801msec); 0 zone resets clat (msec): min=38, max=784, avg=145.36, stdev=73.24 lat (msec): min=38, max=784, avg=145.36, stdev=73.24 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 376], 99.50th=[ 409], 99.90th=[ 514], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 55, per=25.00%, avg=21.50, stdev=10.36, samples=567 iops : min= 1, max= 13, avg= 4.74, stdev= 2.64, samples=567 lat (msec) : 10=3.09%, 20=13.48%, 50=21.52%, 100=22.66%, 250=34.21% lat (msec) : 500=4.92%, 750=0.07%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5288, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144994: Sat Aug 22 01:46:28 2026 read: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6028KiB/288152msec) clat (msec): min=5, max=581, avg=41.52, stdev=41.70 lat (msec): min=5, max=581, avg=41.52, stdev=41.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 89], 95.00th=[ 121], | 99.00th=[ 186], 99.50th=[ 232], 99.90th=[ 430], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 111, per=28.47%, avg=23.35, stdev=16.19, samples=497 iops : min= 1, max= 27, avg= 5.20, stdev= 4.08, samples=497 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6260KiB/288152msec); 0 zone resets clat (msec): min=34, max=1183, avg=143.82, stdev=75.04 lat (msec): min=34, max=1183, avg=143.82, stdev=75.04 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 127], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 239], 95.00th=[ 288], | 99.00th=[ 388], 99.50th=[ 414], 99.90th=[ 542], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 56, per=25.14%, avg=21.62, stdev=10.57, samples=556 iops : min= 1, max= 14, avg= 4.77, stdev= 2.69, samples=556 lat (msec) : 10=2.70%, 20=14.13%, 50=20.05%, 100=23.96%, 250=34.60% lat (msec) : 500=4.46%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.09%, ctx=5253, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144995: Sat Aug 22 01:46:28 2026 read: IOPS=5, BW=21.0KiB/s (21.5kB/s)(6052KiB/287641msec) clat (msec): min=4, max=510, avg=39.92, stdev=42.34 lat (msec): min=4, max=510, avg=39.92, stdev=42.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 116], | 99.00th=[ 197], 99.50th=[ 247], 99.90th=[ 447], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 127, per=29.04%, avg=23.81, stdev=16.69, samples=490 iops : min= 1, max= 31, avg= 5.32, stdev= 4.21, samples=490 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6236KiB/287641msec); 0 zone resets clat (msec): min=29, max=1191, avg=145.45, stdev=76.28 lat (msec): min=29, max=1191, avg=145.46, stdev=76.28 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 114], 50.00th=[ 127], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 247], 95.00th=[ 292], | 99.00th=[ 372], 99.50th=[ 409], 99.90th=[ 684], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 55, per=24.96%, avg=21.47, stdev=10.41, samples=558 iops : min= 1, max= 13, avg= 4.73, stdev= 2.65, samples=558 lat (msec) : 10=3.06%, 20=14.71%, 50=20.74%, 100=22.49%, 250=34.05% lat (msec) : 500=4.85%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.06%, ctx=5108, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=82.8KiB/s (84.7kB/s), 20.5KiB/s-21.0KiB/s (20.0kB/s-21.5kB/s), io=23.4MiB (24.6MB), run=287641-290147msec WRITE: bw=86.6KiB/s (88.7kB/s), 21.7KiB/s-21.9KiB/s (22.2kB/s-22.4kB/s), io=24.6MiB (25.7MB), run=287641-290147msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145052: Sat Aug 22 01:47:16 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(5920KiB/35601msec) clat (usec): min=40, max=348378, avg=53095.55, stdev=48711.88 lat (usec): min=41, max=348380, avg=53097.37, stdev=48711.75 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 200], | 30.00th=[ 31589], 40.00th=[ 42206], 50.00th=[ 49021], 60.00th=[ 56886], | 70.00th=[ 68682], 80.00th=[ 79168], 90.00th=[104334], 95.00th=[129500], | 99.00th=[240124], 99.50th=[346031], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 288, per=25.23%, avg=163.72, stdev=59.71, samples=69 iops : min= 1, max= 18, avg= 9.48, stdev= 3.86, samples=69 write: IOPS=11, BW=179KiB/s (183kB/s)(6368KiB/35601msec); 0 zone resets clat (usec): min=1395, max=199936, avg=39525.35, stdev=42280.85 lat (usec): min=1397, max=199940, avg=39528.04, stdev=42280.90 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1860], 10.00th=[ 2606], 20.00th=[ 5932], | 30.00th=[ 9110], 40.00th=[ 12518], 50.00th=[ 20579], 60.00th=[ 34866], | 70.00th=[ 49546], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[123208], | 99.00th=[179307], 99.50th=[189793], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 30, max= 379, per=26.04%, avg=177.84, stdev=78.80, samples=69 iops : min= 1, max= 23, avg=10.38, stdev= 5.00, samples=69 lat (usec) : 50=0.65%, 100=7.29%, 250=2.08%, 500=0.52%, 750=0.13% lat (msec) : 2=3.39%, 4=4.56%, 10=10.16%, 20=8.07%, 50=24.48% lat (msec) : 100=27.08%, 250=11.20%, 500=0.39% cpu : usr=0.08%, sys=4.95%, ctx=1446, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145053: Sat Aug 22 01:47:16 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(5744KiB/35180msec) clat (usec): min=34, max=313750, avg=55827.10, stdev=46149.53 lat (usec): min=34, max=313751, avg=55829.70, stdev=46151.40 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 1565], | 30.00th=[ 32113], 40.00th=[ 40633], 50.00th=[ 49546], 60.00th=[ 60031], | 70.00th=[ 72877], 80.00th=[ 89654], 90.00th=[114820], 95.00th=[135267], | 99.00th=[229639], 99.50th=[233833], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 63, max= 314, per=25.21%, avg=163.59, stdev=55.14, samples=69 iops : min= 3, max= 19, avg= 9.46, stdev= 3.54, samples=69 write: IOPS=11, BW=186KiB/s (190kB/s)(6544KiB/35180msec); 0 zone resets clat (usec): min=1415, max=219405, avg=36812.41, stdev=39177.52 lat (usec): min=1417, max=219407, avg=36819.83, stdev=39175.71 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1827], 10.00th=[ 2540], 20.00th=[ 5669], | 30.00th=[ 8717], 40.00th=[ 12780], 50.00th=[ 21103], 60.00th=[ 34866], | 70.00th=[ 46924], 80.00th=[ 65274], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[158335], 99.50th=[166724], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 448, per=27.10%, avg=185.12, stdev=95.76, samples=69 iops : min= 1, max= 28, avg=10.83, stdev= 6.07, samples=69 lat (usec) : 50=0.91%, 100=6.77%, 250=0.91%, 500=0.13%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=3.65%, 4=3.91%, 10=10.81%, 20=9.11%, 50=25.26% lat (msec) : 100=26.17%, 250=11.72%, 500=0.13% cpu : usr=0.06%, sys=5.06%, ctx=1453, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145054: Sat Aug 22 01:47:16 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36877msec) clat (usec): min=38, max=379383, avg=49173.38, stdev=41569.44 lat (usec): min=38, max=379386, avg=49175.08, stdev=41569.61 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 326], | 30.00th=[ 28705], 40.00th=[ 36439], 50.00th=[ 45876], 60.00th=[ 55837], | 70.00th=[ 64750], 80.00th=[ 78119], 90.00th=[102237], 95.00th=[116917], | 99.00th=[154141], 99.50th=[196084], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 407, per=26.17%, avg=169.86, stdev=80.50, samples=72 iops : min= 1, max= 25, avg= 9.88, stdev= 5.13, samples=72 write: IOPS=10, BW=164KiB/s (167kB/s)(6032KiB/36877msec); 0 zone resets clat (usec): min=1428, max=409035, avg=46142.56, stdev=51889.00 lat (usec): min=1430, max=409038, avg=46145.66, stdev=51888.97 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1762], 10.00th=[ 2737], 20.00th=[ 5997], | 30.00th=[ 11469], 40.00th=[ 18220], 50.00th=[ 27657], 60.00th=[ 40633], | 70.00th=[ 54264], 80.00th=[ 77071], 90.00th=[121111], 95.00th=[154141], | 99.00th=[223347], 99.50th=[233833], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 61, max= 379, per=24.02%, avg=164.04, stdev=80.43, samples=71 iops : min= 3, max= 23, avg= 9.51, stdev= 5.11, samples=71 lat (usec) : 50=0.65%, 100=7.68%, 250=1.69%, 500=0.52%, 750=0.26% lat (msec) : 2=4.56%, 4=2.99%, 10=7.03%, 20=7.81%, 50=26.56% lat (msec) : 100=27.99%, 250=11.98%, 500=0.26% cpu : usr=0.08%, sys=4.53%, ctx=1461, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145055: Sat Aug 22 01:47:16 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36853msec) clat (usec): min=33, max=327271, avg=51356.55, stdev=44106.41 lat (usec): min=33, max=327273, avg=51358.76, stdev=44106.14 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 119], | 30.00th=[ 26608], 40.00th=[ 36439], 50.00th=[ 46400], 60.00th=[ 57410], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[107480], 95.00th=[127402], | 99.00th=[189793], 99.50th=[217056], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 378, per=25.34%, avg=164.46, stdev=68.37, samples=71 iops : min= 1, max= 23, avg= 9.52, stdev= 4.36, samples=71 write: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36853msec); 0 zone resets clat (usec): min=1459, max=488972, avg=44040.84, stdev=53070.73 lat (usec): min=1461, max=488975, avg=44059.93, stdev=53079.59 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1909], 10.00th=[ 2802], 20.00th=[ 5866], | 30.00th=[ 9372], 40.00th=[ 13566], 50.00th=[ 26346], 60.00th=[ 39060], | 70.00th=[ 53216], 80.00th=[ 74974], 90.00th=[113771], 95.00th=[141558], | 99.00th=[225444], 99.50th=[304088], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 31, max= 343, per=24.86%, avg=169.81, stdev=73.19, samples=72 iops : min= 1, max= 21, avg= 9.86, stdev= 4.63, samples=72 lat (usec) : 50=0.91%, 100=8.59%, 250=1.04%, 500=0.13%, 750=0.13% lat (msec) : 2=2.99%, 4=4.56%, 10=8.98%, 20=8.33%, 50=25.13% lat (msec) : 100=26.17%, 250=12.63%, 500=0.39% cpu : usr=0.08%, sys=4.74%, ctx=1472, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=650KiB/s (665kB/s), 163KiB/s-170KiB/s (167kB/s-174kB/s), io=23.4MiB (24.5MB), run=35180-36877msec WRITE: bw=683KiB/s (700kB/s), 164KiB/s-186KiB/s (167kB/s-190kB/s), io=24.6MiB (25.8MB), run=35180-36877msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145057: Sat Aug 22 01:48:06 2026 read: IOPS=4, BW=68.4KiB/s (70.1kB/s)(5920KiB/86508msec) clat (msec): min=6, max=428, avg=52.92, stdev=55.84 lat (msec): min=6, max=428, avg=52.92, stdev=55.84 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 66], 90.00th=[ 100], 95.00th=[ 174], | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 29, max= 256, per=29.60%, avg=81.71, stdev=51.58, samples=140 iops : min= 1, max= 16, avg= 4.41, stdev= 3.30, samples=140 write: IOPS=4, BW=73.6KiB/s (75.4kB/s)(6368KiB/86508msec); 0 zone resets clat (msec): min=51, max=861, avg=167.91, stdev=85.50 lat (msec): min=51, max=861, avg=167.91, stdev=85.50 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 82], 10.00th=[ 90], 20.00th=[ 104], | 30.00th=[ 120], 40.00th=[ 134], 50.00th=[ 144], 60.00th=[ 163], | 70.00th=[ 188], 80.00th=[ 220], 90.00th=[ 268], 95.00th=[ 326], | 99.00th=[ 477], 99.50th=[ 531], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 28, max= 159, per=26.08%, avg=75.90, stdev=32.91, samples=163 iops : min= 1, max= 9, avg= 4.01, stdev= 2.10, samples=163 lat (msec) : 10=0.65%, 20=8.85%, 50=23.44%, 100=18.88%, 250=40.89% lat (msec) : 500=7.03%, 750=0.13%, 1000=0.13% cpu : usr=0.04%, sys=1.20%, ctx=1413, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145058: Sat Aug 22 01:48:06 2026 read: IOPS=4, BW=66.7KiB/s (68.3kB/s)(5744KiB/86088msec) clat (msec): min=7, max=452, avg=50.70, stdev=47.92 lat (msec): min=7, max=452, avg=50.71, stdev=47.92 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 71], 90.00th=[ 102], 95.00th=[ 125], | 99.00th=[ 279], 99.50th=[ 292], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 28, max= 351, per=30.42%, avg=83.95, stdev=53.77, samples=135 iops : min= 1, max= 21, avg= 4.53, stdev= 3.37, samples=135 write: IOPS=4, BW=76.0KiB/s (77.8kB/s)(6544KiB/86088msec); 0 zone resets clat (msec): min=45, max=654, avg=165.85, stdev=83.19 lat (msec): min=45, max=654, avg=165.85, stdev=83.19 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 80], 10.00th=[ 92], 20.00th=[ 107], | 30.00th=[ 120], 40.00th=[ 132], 50.00th=[ 146], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 209], 90.00th=[ 275], 95.00th=[ 330], | 99.00th=[ 447], 99.50th=[ 550], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 28, max= 159, per=26.80%, avg=77.98, stdev=32.35, samples=165 iops : min= 1, max= 9, avg= 4.15, stdev= 2.07, samples=165 lat (msec) : 10=0.52%, 20=6.64%, 50=25.91%, 100=17.45%, 250=42.06% lat (msec) : 500=6.90%, 750=0.52% cpu : usr=0.03%, sys=0.98%, ctx=1271, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145059: Sat Aug 22 01:48:06 2026 read: IOPS=4, BW=74.7KiB/s (76.5kB/s)(6256KiB/83725msec) clat (msec): min=7, max=359, avg=47.80, stdev=46.72 lat (msec): min=7, max=359, avg=47.81, stdev=46.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 153], | 99.00th=[ 230], 99.50th=[ 279], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 28, max= 317, per=31.93%, avg=88.13, stdev=60.83, samples=140 iops : min= 1, max= 19, avg= 4.77, stdev= 3.85, samples=140 write: IOPS=4, BW=72.0KiB/s (73.8kB/s)(6032KiB/83725msec); 0 zone resets clat (msec): min=48, max=655, avg=172.39, stdev=84.96 lat (msec): min=48, max=655, avg=172.39, stdev=84.96 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 78], 10.00th=[ 93], 20.00th=[ 113], | 30.00th=[ 126], 40.00th=[ 138], 50.00th=[ 150], 60.00th=[ 165], | 70.00th=[ 188], 80.00th=[ 222], 90.00th=[ 292], 95.00th=[ 355], | 99.00th=[ 472], 99.50th=[ 506], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 29, max= 160, per=25.56%, avg=74.37, stdev=31.54, samples=159 iops : min= 1, max= 10, avg= 3.92, stdev= 2.05, samples=159 lat (msec) : 10=1.30%, 20=10.68%, 50=24.35%, 100=16.93%, 250=40.10% lat (msec) : 500=6.38%, 750=0.26% cpu : usr=0.04%, sys=1.13%, ctx=1426, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145060: Sat Aug 22 01:48:06 2026 read: IOPS=4, BW=69.0KiB/s (71.6kB/s)(6032KiB/86222msec) clat (msec): min=8, max=360, avg=53.97, stdev=55.36 lat (msec): min=8, max=360, avg=53.98, stdev=55.36 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 116], 95.00th=[ 182], | 99.00th=[ 305], 99.50th=[ 347], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 29, max= 254, per=30.23%, avg=83.43, stdev=55.23, samples=141 iops : min= 1, max= 15, avg= 4.50, stdev= 3.47, samples=141 write: IOPS=4, BW=72.6KiB/s (74.3kB/s)(6256KiB/86222msec); 0 zone resets clat (msec): min=56, max=567, avg=168.28, stdev=82.34 lat (msec): min=56, max=567, avg=168.28, stdev=82.34 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 83], 10.00th=[ 93], 20.00th=[ 107], | 30.00th=[ 118], 40.00th=[ 128], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 184], 80.00th=[ 218], 90.00th=[ 292], 95.00th=[ 351], | 99.00th=[ 456], 99.50th=[ 472], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 26, max= 160, per=26.10%, avg=75.96, stdev=33.23, samples=162 iops : min= 1, max= 10, avg= 4.02, stdev= 2.16, samples=162 lat (msec) : 10=0.52%, 20=9.11%, 50=24.35%, 100=17.19%, 250=40.62% lat (msec) : 500=8.07%, 750=0.13% cpu : usr=0.03%, sys=1.12%, ctx=1443, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=277KiB/s (284kB/s), 66.7KiB/s-74.7KiB/s (68.3kB/s-76.5kB/s), io=23.4MiB (24.5MB), run=83725-86508msec WRITE: bw=291KiB/s (298kB/s), 72.0KiB/s-76.0KiB/s (73.8kB/s-77.8kB/s), io=24.6MiB (25.8MB), run=83725-86508msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145084: Sat Aug 22 01:48:19 2026 read: IOPS=1, BW=1557KiB/s (1595kB/s)(7168KiB/4603msec) clat (msec): min=128, max=425, avg=249.34, stdev=106.83 lat (msec): min=128, max=425, avg=249.34, stdev=106.83 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 180], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 194], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 347], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2015, max= 3618, per=71.85%, avg=2351.60, stdev=708.04, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1112KiB/s (1139kB/s)(5120KiB/4603msec); 0 zone resets clat (msec): min=75, max=1910, avg=533.75, stdev=774.99 lat (msec): min=75, max=1910, avg=534.20, stdev=774.83 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 2015, max= 6119, per=74.02%, avg=3392.33, stdev=2361.40, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=9.32%, ctx=187, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145085: Sat Aug 22 01:48:19 2026 read: IOPS=0, BW=327KiB/s (335kB/s)(2048KiB/6256msec) clat (msec): min=341, max=2185, avg=1263.45, stdev=1304.10 lat (msec): min=341, max=2185, avg=1263.45, stdev=1304.11 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 2039, max= 2039, per=62.30%, avg=2039.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1637KiB/s (1676kB/s)(10.0MiB/6256msec); 0 zone resets clat (msec): min=88, max=753, avg=365.05, stdev=214.09 lat (msec): min=88, max=753, avg=365.15, stdev=214.10 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 148], | 30.00th=[ 279], 40.00th=[ 288], 50.00th=[ 300], 60.00th=[ 338], | 70.00th=[ 359], 80.00th=[ 393], 90.00th=[ 709], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2015, max= 6047, per=56.87%, avg=2606.43, stdev=1517.18, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (msec) : 100=8.33%, 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=8.39%, ctx=395, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145086: Sat Aug 22 01:48:19 2026 read: IOPS=1, BW=1039KiB/s (1064kB/s)(6144KiB/5914msec) clat (msec): min=5, max=260, avg=157.50, stdev=89.91 lat (msec): min=5, max=260, avg=157.50, stdev=89.91 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 201], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 2019, max= 4071, per=100.00%, avg=3373.67, stdev=1173.35, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1039KiB/s (1064kB/s)(6144KiB/5914msec); 0 zone resets clat (msec): min=156, max=2632, avg=809.54, stdev=911.81 lat (msec): min=156, max=2632, avg=809.62, stdev=911.82 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 542], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 2015, max= 2048, per=44.43%, avg=2036.00, stdev=12.69, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 10=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=6.98%, ctx=187, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145087: Sat Aug 22 01:48:19 2026 read: IOPS=0, BW=891KiB/s (913kB/s)(5120KiB/5744msec) clat (usec): min=505, max=533817, avg=110196.27, stdev=236874.61 lat (usec): min=507, max=533818, avg=110197.60, stdev=236874.68 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 2278], 60.00th=[ 2278], | 70.00th=[ 13698], 80.00th=[ 13698], 90.00th=[534774], 95.00th=[534774], | 99.00th=[534774], 99.50th=[534774], 99.90th=[534774], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 4047, max= 4079, per=100.00%, avg=4063.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1248KiB/s (1278kB/s)(7168KiB/5744msec); 0 zone resets clat (msec): min=136, max=2271, avg=689.08, stdev=751.84 lat (msec): min=136, max=2271, avg=689.16, stdev=751.85 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 146], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 447], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 969], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 2023, max= 2043, per=44.44%, avg=2036.60, stdev= 7.80, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 20=8.33%, 250=16.67%, 500=16.67%, 750=16.67% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.30%, ctx=99, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3274KiB/s (3352kB/s), 327KiB/s-1557KiB/s (335kB/s-1595kB/s), io=20.0MiB (20.0MB), run=4603-6256msec WRITE: bw=4583KiB/s (4693kB/s), 1039KiB/s-1637KiB/s (1064kB/s-1676kB/s), io=28.0MiB (29.4MB), run=4603-6256msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145080: Sat Aug 22 01:48:20 2026 read: IOPS=1, BW=1314KiB/s (1345kB/s)(7168KiB/5457msec) clat (msec): min=68, max=210, avg=124.57, stdev=53.01 lat (msec): min=68, max=210, avg=124.57, stdev=53.01 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 85], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 121], 60.00th=[ 123], | 70.00th=[ 123], 80.00th=[ 180], 90.00th=[ 211], 95.00th=[ 211], | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 1532, max= 4079, per=98.90%, avg=2913.50, stdev=1344.93, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=938KiB/s (961kB/s)(5120KiB/5457msec); 0 zone resets clat (msec): min=321, max=2405, avg=848.25, stdev=894.08 lat (msec): min=322, max=2405, avg=848.35, stdev=894.06 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1988, max= 4071, per=65.51%, avg=2702.33, stdev=1185.68, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.04%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145081: Sat Aug 22 01:48:20 2026 read: IOPS=0, BW=313KiB/s (320kB/s)(2048KiB/6545msec) clat (msec): min=108, max=2002, avg=1055.33, stdev=1338.83 lat (msec): min=108, max=2002, avg=1055.33, stdev=1338.83 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 2005], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 1988, max= 2003, per=67.74%, avg=1995.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1565KiB/s (1602kB/s)(10.0MiB/6545msec); 0 zone resets clat (msec): min=122, max=992, avg=403.18, stdev=270.17 lat (msec): min=122, max=992, avg=403.29, stdev=270.16 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 284], 50.00th=[ 368], 60.00th=[ 372], | 70.00th=[ 439], 80.00th=[ 542], 90.00th=[ 634], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1984, max= 4079, per=65.57%, avg=2704.67, stdev=1061.66, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.56%, ctx=117, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145082: Sat Aug 22 01:48:20 2026 read: IOPS=1, BW=1100KiB/s (1127kB/s)(6144KiB/5583msec) clat (msec): min=82, max=220, avg=137.87, stdev=48.30 lat (msec): min=82, max=220, avg=137.87, stdev=48.30 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 2035, max= 3976, per=100.00%, avg=3326.33, stdev=1118.33, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1100KiB/s (1127kB/s)(6144KiB/5583msec); 0 zone resets clat (msec): min=188, max=2370, avg=772.99, stdev=815.60 lat (msec): min=189, max=2371, avg=773.10, stdev=815.60 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 617], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1988, max= 4055, per=61.10%, avg=2520.25, stdev=1023.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.65%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145083: Sat Aug 22 01:48:20 2026 read: IOPS=0, BW=737KiB/s (754kB/s)(5120KiB/6950msec) clat (msec): min=77, max=1149, avg=469.86, stdev=406.50 lat (msec): min=77, max=1149, avg=469.86, stdev=406.50 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2027, max= 2048, per=69.12%, avg=2036.25, stdev= 9.29, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1031KiB/s (1056kB/s)(7168KiB/6950msec); 0 zone resets clat (msec): min=69, max=2457, avg=648.89, stdev=828.73 lat (msec): min=69, max=2457, avg=649.15, stdev=828.76 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 146], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 363], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 701], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 2003, max= 2048, per=49.16%, avg=2028.00, stdev=16.16, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.80%, ctx=59, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2947KiB/s (3017kB/s), 313KiB/s-1314KiB/s (320kB/s-1345kB/s), io=20.0MiB (20.0MB), run=5457-6950msec WRITE: bw=4125KiB/s (4224kB/s), 938KiB/s-1565KiB/s (961kB/s-1602kB/s), io=28.0MiB (29.4MB), run=5457-6950msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145093: Sat Aug 22 01:48:36 2026 read: IOPS=0, BW=1919KiB/s (1965kB/s)(12.0MiB/6402msec) clat (msec): min=923, max=4319, avg=2109.90, stdev=1915.60 lat (msec): min=923, max=4319, avg=2109.91, stdev=1915.60 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 7846, max= 8175, per=100.00%, avg=8010.50, stdev=232.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.83%, ctx=213, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145094: Sat Aug 22 01:48:36 2026 read: IOPS=0, BW=611KiB/s (626kB/s)(4096KiB/6701msec) clat (nsec): min=4333.2M, max=4333.2M, avg=4333176318.00, stdev= 0.00 lat (nsec): min=4333.2M, max=4333.2M, avg=4333178586.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4329], 5.00th=[ 4329], 10.00th=[ 4329], 20.00th=[ 4329], | 30.00th=[ 4329], 40.00th=[ 4329], 50.00th=[ 4329], 60.00th=[ 4329], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1223KiB/s (1252kB/s)(8192KiB/6701msec); 0 zone resets clat (msec): min=1006, max=1310, avg=1158.57, stdev=215.13 lat (msec): min=1006, max=1310, avg=1158.92, stdev=215.02 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.69%, ctx=668, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145095: Sat Aug 22 01:48:36 2026 write: IOPS=0, BW=2437KiB/s (2496kB/s)(12.0MiB/5042msec); 0 zone resets clat (msec): min=364, max=3940, avg=1648.82, stdev=1989.84 lat (msec): min=365, max=3942, avg=1649.41, stdev=1990.27 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 7846, max= 8031, per=100.00%, avg=7938.50, stdev=130.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.38%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145096: Sat Aug 22 01:48:36 2026 write: IOPS=0, BW=2003KiB/s (2051kB/s)(12.0MiB/6134msec); 0 zone resets clat (msec): min=957, max=4001, avg=2037.73, stdev=1703.30 lat (msec): min=962, max=4004, avg=2040.80, stdev=1703.47 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 7772, max= 8078, per=100.00%, avg=7925.00, stdev=216.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.91%, ctx=49, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2445KiB/s (2504kB/s), 611KiB/s-1919KiB/s (626kB/s-1965kB/s), io=16.0MiB (16.8MB), run=6402-6701msec WRITE: bw=4890KiB/s (5007kB/s), 1223KiB/s-2437KiB/s (1252kB/s-2496kB/s), io=32.0MiB (33.6MB), run=5042-6701msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145098: Sat Aug 22 01:48:37 2026 read: IOPS=0, BW=1880KiB/s (1925kB/s)(12.0MiB/6535msec) clat (msec): min=815, max=4408, avg=2175.75, stdev=1949.05 lat (msec): min=815, max=4408, avg=2175.75, stdev=1949.06 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.08%, sys=1.47%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145099: Sat Aug 22 01:48:37 2026 read: IOPS=0, BW=591KiB/s (605kB/s)(4096KiB/6933msec) clat (nsec): min=3992.5M, max=3992.5M, avg=3992515303.00, stdev= 0.00 lat (nsec): min=3992.5M, max=3992.5M, avg=3992518633.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3977], 5.00th=[ 3977], 10.00th=[ 3977], 20.00th=[ 3977], | 30.00th=[ 3977], 40.00th=[ 3977], 50.00th=[ 3977], 60.00th=[ 3977], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1182KiB/s (1210kB/s)(8192KiB/6933msec); 0 zone resets clat (msec): min=715, max=2218, avg=1466.78, stdev=1063.13 lat (msec): min=715, max=2220, avg=1467.88, stdev=1064.23 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.12%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145100: Sat Aug 22 01:48:37 2026 write: IOPS=0, BW=1790KiB/s (1833kB/s)(12.0MiB/6865msec); 0 zone resets clat (msec): min=359, max=6130, avg=2284.03, stdev=3331.47 lat (msec): min=359, max=6131, avg=2284.45, stdev=3331.52 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 6141], 80.00th=[ 6141], 90.00th=[ 6141], 95.00th=[ 6141], | 99.00th=[ 6141], 99.50th=[ 6141], 99.90th=[ 6141], 99.95th=[ 6141], | 99.99th=[ 6141] bw ( KiB/s): min= 7907, max= 8078, per=100.00%, avg=7992.50, stdev=120.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.06%, sys=1.75%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145101: Sat Aug 22 01:48:37 2026 write: IOPS=0, BW=1819KiB/s (1863kB/s)(12.0MiB/6754msec); 0 zone resets clat (msec): min=1270, max=4023, avg=2247.12, stdev=1540.80 lat (msec): min=1271, max=4023, avg=2248.84, stdev=1539.62 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 7515, max= 8031, per=100.00%, avg=7773.00, stdev=364.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.03%, sys=1.63%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2363KiB/s (2420kB/s), 591KiB/s-1880KiB/s (605kB/s-1925kB/s), io=16.0MiB (16.8MB), run=6535-6933msec WRITE: bw=4726KiB/s (4840kB/s), 1182KiB/s-1819KiB/s (1210kB/s-1863kB/s), io=32.0MiB (33.6MB), run=6754-6933msec