== sanity test 398b: DIO and buffer IO race ============== 03:57:30 (1786694250) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.03681 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145968: Fri Aug 14 04:00:59 2026 read: IOPS=7, BW=31.6KiB/s (32.4kB/s)(5992KiB/189345msec) clat (usec): min=34, max=409368, avg=45751.41, stdev=34867.01 lat (usec): min=34, max=409369, avg=45756.68, stdev=34865.31 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 74], 10.00th=[ 12911], 20.00th=[ 21627], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[173016], 99.50th=[206570], 99.90th=[283116], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 102, per=34.34%, avg=43.27, stdev=20.24, samples=269 iops : min= 1, max= 25, avg=10.15, stdev= 5.11, samples=269 write: IOPS=8, BW=33.3KiB/s (34.0kB/s)(6296KiB/189345msec); 0 zone resets clat (usec): min=1084, max=52335k, avg=76437.27, stdev=1318885.39 lat (usec): min=1085, max=52335k, avg=76441.02, stdev=1318885.38 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1532], 10.00th=[ 2245], | 20.00th=[ 5145], 30.00th=[ 9241], 40.00th=[ 19530], | 50.00th=[ 31589], 60.00th=[ 43254], 70.00th=[ 56886], | 80.00th=[ 74974], 90.00th=[ 100140], 95.00th=[ 131597], | 99.00th=[ 191890], 99.50th=[ 235930], 99.90th=[ 700449], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 127, per=34.37%, avg=45.37, stdev=21.83, samples=270 iops : min= 1, max= 31, avg=10.67, stdev= 5.49, samples=270 lat (usec) : 50=0.23%, 100=3.32%, 250=0.29%, 500=0.13%, 750=0.10% lat (msec) : 2=4.82%, 4=3.81%, 10=8.07%, 20=8.53%, 50=35.32% lat (msec) : 100=27.15%, 250=7.91%, 500=0.26%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.69%, ctx=6801, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145970: Fri Aug 14 04:00:59 2026 read: IOPS=7, BW=31.5KiB/s (32.3kB/s)(5940KiB/188529msec) clat (usec): min=32, max=262953, avg=45533.28, stdev=32583.83 lat (usec): min=33, max=262956, avg=45534.79, stdev=32583.86 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 74], 10.00th=[ 12518], 20.00th=[ 21627], | 30.00th=[ 26608], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[158335], 99.50th=[173016], 99.90th=[250610], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 5, max= 119, per=34.10%, avg=42.97, stdev=20.38, samples=269 iops : min= 1, max= 29, avg=10.07, stdev= 5.13, samples=269 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6348KiB/188529msec); 0 zone resets clat (usec): min=1031, max=52442k, avg=75879.02, stdev=1316161.84 lat (usec): min=1032, max=52442k, avg=75885.30, stdev=1316161.83 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1582], 10.00th=[ 2278], | 20.00th=[ 5211], 30.00th=[ 10159], 40.00th=[ 19530], | 50.00th=[ 31065], 60.00th=[ 42206], 70.00th=[ 56361], | 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[ 124257], | 99.00th=[ 189793], 99.50th=[ 242222], 99.90th=[ 742392], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 5, max= 143, per=34.97%, avg=46.16, stdev=23.76, samples=268 iops : min= 1, max= 35, avg=10.88, stdev= 6.00, samples=268 lat (usec) : 50=0.39%, 100=3.29%, 250=0.39%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.69%, 4=3.97%, 10=7.00%, 20=8.89%, 50=35.42% lat (msec) : 100=27.83%, 250=7.68%, 500=0.20%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.79%, ctx=6833, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145972: Fri Aug 14 04:00:59 2026 read: IOPS=8, BW=32.1KiB/s (32.9kB/s)(6028KiB/187710msec) clat (usec): min=35, max=836650, avg=44355.87, stdev=37237.40 lat (usec): min=35, max=836652, avg=44360.19, stdev=37238.56 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 12387], 20.00th=[ 21627], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[177210], 99.90th=[287310], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 5, max= 120, per=35.27%, avg=44.44, stdev=20.73, samples=263 iops : min= 1, max= 30, avg=10.44, stdev= 5.23, samples=263 write: IOPS=8, BW=33.3KiB/s (34.1kB/s)(6260KiB/187710msec); 0 zone resets clat (usec): min=954, max=52431k, avg=76913.51, stdev=1325025.95 lat (usec): min=955, max=52431k, avg=76919.62, stdev=1325025.97 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1598], 10.00th=[ 2409], | 20.00th=[ 5342], 30.00th=[ 10290], 40.00th=[ 20841], | 50.00th=[ 32375], 60.00th=[ 43254], 70.00th=[ 56886], | 80.00th=[ 73925], 90.00th=[ 100140], 95.00th=[ 131597], | 99.00th=[ 204473], 99.50th=[ 250610], 99.90th=[ 413139], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 14, max= 112, per=34.65%, avg=45.74, stdev=19.43, samples=265 iops : min= 3, max= 28, avg=10.78, stdev= 4.91, samples=265 lat (usec) : 50=0.36%, 100=3.29%, 250=0.55%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.23%, 4=3.87%, 10=7.10%, 20=9.38%, 50=36.88% lat (msec) : 100=26.82%, 250=7.06%, 500=0.26%, 1000=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.70%, ctx=6671, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145974: Fri Aug 14 04:00:59 2026 read: IOPS=7, BW=31.9KiB/s (32.7kB/s)(6052KiB/189438msec) clat (usec): min=36, max=362192, avg=45530.87, stdev=33334.34 lat (usec): min=36, max=362193, avg=45535.00, stdev=33333.08 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 69], 10.00th=[ 12125], 20.00th=[ 22414], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[152044], 99.50th=[181404], 99.90th=[270533], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 103, per=35.01%, avg=44.11, stdev=18.92, samples=267 iops : min= 1, max= 25, avg=10.36, stdev= 4.77, samples=267 write: IOPS=8, BW=32.9KiB/s (33.7kB/s)(6236KiB/189438msec); 0 zone resets clat (usec): min=895, max=52389k, avg=77025.70, stdev=1326607.12 lat (usec): min=896, max=52389k, avg=77031.65, stdev=1326606.96 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1582], 10.00th=[ 2409], | 20.00th=[ 5538], 30.00th=[ 10159], 40.00th=[ 18744], | 50.00th=[ 30016], 60.00th=[ 42730], 70.00th=[ 57410], | 80.00th=[ 72877], 90.00th=[ 104334], 95.00th=[ 133694], | 99.00th=[ 198181], 99.50th=[ 242222], 99.90th=[ 742392], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 119, per=33.86%, avg=44.70, stdev=20.47, samples=271 iops : min= 1, max= 29, avg=10.51, stdev= 5.16, samples=271 lat (usec) : 50=0.52%, 100=3.35%, 250=0.46%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=4.20%, 4=3.74%, 10=7.32%, 20=9.41%, 50=35.97% lat (msec) : 100=26.14%, 250=8.33%, 500=0.23%, 750=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=3.60%, ctx=6754, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=127KiB/s (130kB/s), 31.5KiB/s-32.1KiB/s (32.3kB/s-32.9kB/s), io=23.4MiB (24.6MB), run=187710-189438msec WRITE: bw=133KiB/s (136kB/s), 32.9KiB/s-33.7KiB/s (33.7kB/s-34.5kB/s), io=24.6MiB (25.7MB), run=187710-189438msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145969: Fri Aug 14 04:03:23 2026 read: IOPS=4, BW=17.0KiB/s (18.4kB/s)(5992KiB/333126msec) clat (msec): min=5, max=52480, avg=77.09, stdev=1355.54 lat (msec): min=5, max=52480, avg=77.09, stdev=1355.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 86], 95.00th=[ 114], | 99.00th=[ 215], 99.50th=[ 234], 99.90th=[ 877], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 87, per=32.90%, avg=23.69, stdev=16.43, samples=486 iops : min= 1, max= 21, avg= 5.27, stdev= 4.15, samples=486 write: IOPS=4, BW=18.9KiB/s (19.4kB/s)(6296KiB/333126msec); 0 zone resets clat (msec): min=39, max=560, avg=138.01, stdev=68.91 lat (msec): min=39, max=560, avg=138.01, stdev=68.91 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 180], 90.00th=[ 226], 95.00th=[ 268], | 99.00th=[ 372], 99.50th=[ 439], 99.90th=[ 550], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 55, per=29.66%, avg=22.25, stdev= 9.97, samples=542 iops : min= 1, max= 13, avg= 4.90, stdev= 2.53, samples=542 lat (msec) : 10=1.53%, 20=11.88%, 50=24.25%, 100=25.00%, 250=33.53% lat (msec) : 500=3.68%, 750=0.07%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=5554, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145971: Fri Aug 14 04:03:23 2026 read: IOPS=4, BW=17.8KiB/s (18.3kB/s)(5940KiB/333065msec) clat (msec): min=6, max=691, avg=41.99, stdev=40.46 lat (msec): min=6, max=691, avg=42.00, stdev=40.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 372], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 103, per=32.97%, avg=23.74, stdev=15.82, samples=481 iops : min= 1, max= 25, avg= 5.27, stdev= 3.98, samples=481 write: IOPS=4, BW=19.1KiB/s (19.5kB/s)(6348KiB/333065msec); 0 zone resets clat (msec): min=38, max=52639, avg=170.24, stdev=1319.69 lat (msec): min=38, max=52639, avg=170.24, stdev=1319.69 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 95], 40.00th=[ 108], 50.00th=[ 120], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 182], 90.00th=[ 228], 95.00th=[ 279], | 99.00th=[ 376], 99.50th=[ 430], 99.90th=[ 550], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 55, per=29.69%, avg=22.27, stdev=10.24, samples=547 iops : min= 1, max= 13, avg= 4.90, stdev= 2.60, samples=547 lat (msec) : 10=1.14%, 20=11.95%, 50=23.57%, 100=26.37%, 250=33.11% lat (msec) : 500=3.78%, 750=0.07%, >=2000=0.03% cpu : usr=0.04%, sys=1.23%, ctx=5590, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145973: Fri Aug 14 04:03:23 2026 read: IOPS=4, BW=18.1KiB/s (18.6kB/s)(6028KiB/332468msec) clat (msec): min=5, max=400, avg=43.46, stdev=38.91 lat (msec): min=5, max=400, avg=43.46, stdev=38.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 201], 99.50th=[ 215], 99.90th=[ 338], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 103, per=32.90%, avg=23.69, stdev=16.13, samples=490 iops : min= 1, max= 25, avg= 5.26, stdev= 4.05, samples=490 write: IOPS=4, BW=18.8KiB/s (19.3kB/s)(6260KiB/332468msec); 0 zone resets clat (msec): min=35, max=52698, avg=170.30, stdev=1330.63 lat (msec): min=35, max=52698, avg=170.31, stdev=1330.63 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 118], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 180], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 388], 99.50th=[ 485], 99.90th=[ 978], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 48, per=29.60%, avg=22.20, stdev=10.55, samples=541 iops : min= 1, max= 12, avg= 4.88, stdev= 2.67, samples=541 lat (msec) : 10=1.60%, 20=11.36%, 50=23.54%, 100=26.20%, 250=33.76% lat (msec) : 500=3.35%, 750=0.13%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5599, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145975: Fri Aug 14 04:03:23 2026 read: IOPS=4, BW=18.3KiB/s (18.7kB/s)(6052KiB/330712msec) clat (msec): min=5, max=367, avg=40.42, stdev=35.71 lat (msec): min=5, max=367, avg=40.42, stdev=35.71 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 109], | 99.00th=[ 194], 99.50th=[ 205], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 79, per=33.29%, avg=23.97, stdev=16.03, samples=486 iops : min= 1, max= 19, avg= 5.33, stdev= 4.03, samples=486 write: IOPS=4, BW=18.9KiB/s (19.3kB/s)(6236KiB/330712msec); 0 zone resets clat (msec): min=35, max=52473, avg=172.57, stdev=1327.21 lat (msec): min=35, max=52473, avg=172.57, stdev=1327.21 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 182], 90.00th=[ 224], 95.00th=[ 268], | 99.00th=[ 359], 99.50th=[ 430], 99.90th=[ 961], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 55, per=29.46%, avg=22.09, stdev= 9.76, samples=541 iops : min= 1, max= 13, avg= 4.86, stdev= 2.47, samples=541 lat (msec) : 10=1.40%, 20=11.85%, 50=24.93%, 100=23.54%, 250=34.67% lat (msec) : 500=3.52%, 750=0.03%, 1000=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=1.23%, ctx=5563, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=72.1KiB/s (73.8kB/s), 17.8KiB/s-18.3KiB/s (18.3kB/s-18.7kB/s), io=23.4MiB (24.6MB), run=330712-333126msec WRITE: bw=75.5KiB/s (77.3kB/s), 18.8KiB/s-19.1KiB/s (19.3kB/s-19.5kB/s), io=24.6MiB (25.7MB), run=330712-333126msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146054: Fri Aug 14 04:04:12 2026 read: IOPS=10, BW=162KiB/s (165kB/s)(5920KiB/36642msec) clat (usec): min=41, max=230197, avg=50219.46, stdev=39606.25 lat (usec): min=42, max=230198, avg=50221.21, stdev=39606.21 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 77], 20.00th=[ 20055], | 30.00th=[ 29230], 40.00th=[ 35914], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 66323], 80.00th=[ 78119], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[185598], 99.50th=[202376], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 31, max= 345, per=25.09%, avg=160.81, stdev=68.99, samples=72 iops : min= 1, max= 21, avg= 9.26, stdev= 4.34, samples=72 write: IOPS=10, BW=174KiB/s (178kB/s)(6368KiB/36642msec); 0 zone resets clat (usec): min=1487, max=311147, avg=44528.83, stdev=46437.50 lat (usec): min=1490, max=311150, avg=44531.64, stdev=46437.51 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2769], 10.00th=[ 4359], 20.00th=[ 8979], | 30.00th=[ 13566], 40.00th=[ 19006], 50.00th=[ 27657], 60.00th=[ 38536], | 70.00th=[ 53216], 80.00th=[ 79168], 90.00th=[110625], 95.00th=[133694], | 99.00th=[221250], 99.50th=[283116], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 28, max= 415, per=25.76%, avg=173.61, stdev=76.50, samples=72 iops : min= 1, max= 25, avg=10.07, stdev= 4.81, samples=72 lat (usec) : 50=0.78%, 100=6.77%, 250=0.52%, 500=0.26%, 750=0.26% lat (msec) : 2=1.17%, 4=3.65%, 10=7.03%, 20=10.81%, 50=30.86% lat (msec) : 100=26.56%, 250=11.07%, 500=0.26% cpu : usr=0.11%, sys=4.95%, ctx=1575, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146056: Fri Aug 14 04:04:12 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(5744KiB/35820msec) clat (usec): min=43, max=237765, avg=56089.51, stdev=38935.37 lat (usec): min=43, max=237766, avg=56094.87, stdev=38936.61 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 74], 10.00th=[ 93], 20.00th=[ 27657], | 30.00th=[ 36439], 40.00th=[ 46400], 50.00th=[ 52691], 60.00th=[ 59507], | 70.00th=[ 70779], 80.00th=[ 82314], 90.00th=[104334], 95.00th=[122160], | 99.00th=[200279], 99.50th=[233833], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 284, per=24.89%, avg=159.57, stdev=50.98, samples=70 iops : min= 1, max= 17, avg= 9.19, stdev= 3.20, samples=70 write: IOPS=11, BW=183KiB/s (187kB/s)(6544KiB/35820msec); 0 zone resets clat (usec): min=1533, max=249047, avg=38094.51, stdev=39879.52 lat (usec): min=1535, max=249049, avg=38104.46, stdev=39887.09 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2343], 10.00th=[ 4015], 20.00th=[ 6063], | 30.00th=[ 8848], 40.00th=[ 14222], 50.00th=[ 23200], 60.00th=[ 37487], | 70.00th=[ 47449], 80.00th=[ 64750], 90.00th=[ 94897], 95.00th=[116917], | 99.00th=[158335], 99.50th=[202376], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 447, per=27.11%, avg=182.70, stdev=94.26, samples=70 iops : min= 1, max= 27, avg=10.63, stdev= 5.94, samples=70 lat (usec) : 50=0.39%, 100=4.56%, 250=1.04%, 500=0.26% lat (msec) : 2=1.56%, 4=3.78%, 10=12.11%, 20=8.20%, 50=28.39% lat (msec) : 100=29.69%, 250=10.03% cpu : usr=0.07%, sys=5.23%, ctx=1557, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146057: Fri Aug 14 04:04:12 2026 read: IOPS=10, BW=167KiB/s (172kB/s)(6256KiB/37353msec) clat (usec): min=40, max=217912, avg=53294.10, stdev=40358.91 lat (usec): min=41, max=217914, avg=53305.61, stdev=40347.84 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 21365], | 30.00th=[ 33162], 40.00th=[ 43254], 50.00th=[ 49021], 60.00th=[ 55837], | 70.00th=[ 65274], 80.00th=[ 79168], 90.00th=[ 99091], 95.00th=[133694], | 99.00th=[179307], 99.50th=[187696], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 320, per=26.93%, avg=172.59, stdev=66.27, samples=71 iops : min= 1, max= 20, avg=10.00, stdev= 4.20, samples=71 write: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37353msec); 0 zone resets clat (usec): min=1689, max=246897, avg=42413.70, stdev=42045.81 lat (usec): min=1690, max=246902, avg=42426.92, stdev=42045.28 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2442], 10.00th=[ 4359], 20.00th=[ 8455], | 30.00th=[ 12387], 40.00th=[ 18482], 50.00th=[ 27657], 60.00th=[ 41157], | 70.00th=[ 53740], 80.00th=[ 76022], 90.00th=[100140], 95.00th=[126354], | 99.00th=[204473], 99.50th=[217056], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 352, per=23.89%, avg=160.99, stdev=69.89, samples=72 iops : min= 1, max= 22, avg= 9.26, stdev= 4.44, samples=72 lat (usec) : 50=0.52%, 100=5.99%, 250=1.17%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=0.78%, 4=3.91%, 10=7.68%, 20=9.51%, 50=28.65% lat (msec) : 100=30.99%, 250=10.03% cpu : usr=0.06%, sys=5.04%, ctx=1621, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146058: Fri Aug 14 04:04:12 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36780msec) clat (usec): min=42, max=266512, avg=53405.29, stdev=43385.15 lat (usec): min=42, max=266513, avg=53406.86, stdev=43385.15 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 71], 10.00th=[ 79], 20.00th=[ 22676], | 30.00th=[ 32113], 40.00th=[ 38536], 50.00th=[ 47973], 60.00th=[ 56361], | 70.00th=[ 67634], 80.00th=[ 82314], 90.00th=[104334], 95.00th=[127402], | 99.00th=[217056], 99.50th=[261096], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 28, max= 415, per=25.33%, avg=162.36, stdev=78.40, samples=72 iops : min= 1, max= 25, avg= 9.35, stdev= 4.93, samples=72 write: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36780msec); 0 zone resets clat (usec): min=1458, max=233669, avg=41550.68, stdev=42873.51 lat (usec): min=1462, max=233673, avg=41553.60, stdev=42873.37 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2278], 10.00th=[ 4686], 20.00th=[ 7832], | 30.00th=[ 11338], 40.00th=[ 17171], 50.00th=[ 25822], 60.00th=[ 37487], | 70.00th=[ 53740], 80.00th=[ 67634], 90.00th=[ 99091], 95.00th=[130548], | 99.00th=[196084], 99.50th=[214959], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 349, per=25.09%, avg=169.10, stdev=68.64, samples=72 iops : min= 1, max= 21, avg= 9.79, stdev= 4.30, samples=72 lat (usec) : 50=0.65%, 100=6.64%, 250=1.17%, 500=0.26% lat (msec) : 2=1.30%, 4=2.99%, 10=9.11%, 20=9.77%, 50=28.39% lat (msec) : 100=29.17%, 250=10.16%, 500=0.39% cpu : usr=0.08%, sys=5.16%, ctx=1666, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=641KiB/s (657kB/s), 160KiB/s-167KiB/s (164kB/s-172kB/s), io=23.4MiB (24.5MB), run=35820-37353msec WRITE: bw=675KiB/s (691kB/s), 161KiB/s-183KiB/s (165kB/s-187kB/s), io=24.6MiB (25.8MB), run=35820-37353msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146059: Fri Aug 14 04:04:49 2026 read: IOPS=5, BW=80.5KiB/s (82.4kB/s)(5920KiB/73533msec) clat (msec): min=7, max=410, avg=46.73, stdev=55.22 lat (msec): min=7, max=410, avg=46.74, stdev=55.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 104], 95.00th=[ 146], | 99.00th=[ 313], 99.50th=[ 380], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 30, max= 320, per=28.30%, avg=91.13, stdev=57.47, samples=127 iops : min= 1, max= 20, avg= 4.87, stdev= 3.64, samples=127 write: IOPS=5, BW=86.6KiB/s (88.7kB/s)(6368KiB/73533msec); 0 zone resets clat (msec): min=40, max=459, avg=140.93, stdev=73.13 lat (msec): min=40, max=459, avg=140.95, stdev=73.13 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 190], 90.00th=[ 245], 95.00th=[ 288], | 99.00th=[ 384], 99.50th=[ 456], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 30, max= 254, per=26.73%, avg=90.61, stdev=43.37, samples=138 iops : min= 1, max= 15, avg= 4.83, stdev= 2.79, samples=138 lat (msec) : 10=2.34%, 20=13.54%, 50=20.96%, 100=23.05%, 250=34.90% lat (msec) : 500=5.21% cpu : usr=0.05%, sys=1.39%, ctx=1338, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146060: Fri Aug 14 04:04:49 2026 read: IOPS=4, BW=77.3KiB/s (79.1kB/s)(5744KiB/74329msec) clat (msec): min=6, max=419, avg=48.34, stdev=56.82 lat (msec): min=6, max=419, avg=48.34, stdev=56.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 115], 95.00th=[ 153], | 99.00th=[ 317], 99.50th=[ 330], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 28, max= 318, per=29.41%, avg=94.69, stdev=61.34, samples=118 iops : min= 1, max= 19, avg= 5.10, stdev= 3.92, samples=118 write: IOPS=5, BW=88.0KiB/s (90.2kB/s)(6544KiB/74329msec); 0 zone resets clat (msec): min=39, max=534, avg=138.64, stdev=75.42 lat (msec): min=39, max=534, avg=138.65, stdev=75.42 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 106], 50.00th=[ 121], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 169], 90.00th=[ 234], 95.00th=[ 296], | 99.00th=[ 405], 99.50th=[ 477], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 28, max= 222, per=26.88%, avg=91.14, stdev=44.95, samples=140 iops : min= 1, max= 13, avg= 4.86, stdev= 2.87, samples=140 lat (msec) : 10=1.17%, 20=12.11%, 50=23.18%, 100=22.27%, 250=35.68% lat (msec) : 500=5.34%, 750=0.26% cpu : usr=0.06%, sys=1.35%, ctx=1394, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146061: Fri Aug 14 04:04:49 2026 read: IOPS=5, BW=86.1KiB/s (88.1kB/s)(6256KiB/72684msec) clat (msec): min=7, max=424, avg=43.73, stdev=50.51 lat (msec): min=7, max=424, avg=43.73, stdev=50.51 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 55], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 253], 99.50th=[ 330], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 320, per=29.94%, avg=96.40, stdev=73.33, samples=128 iops : min= 1, max= 20, avg= 5.19, stdev= 4.70, samples=128 write: IOPS=5, BW=82.0KiB/s (84.0kB/s)(6032KiB/72684msec); 0 zone resets clat (msec): min=41, max=392, avg=146.06, stdev=74.72 lat (msec): min=41, max=392, avg=146.07, stdev=74.72 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 112], 50.00th=[ 127], 60.00th=[ 146], | 70.00th=[ 161], 80.00th=[ 199], 90.00th=[ 266], 95.00th=[ 305], | 99.00th=[ 376], 99.50th=[ 388], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 190, per=25.42%, avg=86.19, stdev=41.61, samples=137 iops : min= 1, max= 11, avg= 4.55, stdev= 2.67, samples=137 lat (msec) : 10=1.82%, 20=16.54%, 50=21.74%, 100=21.22%, 250=32.55% lat (msec) : 500=6.12% cpu : usr=0.05%, sys=1.44%, ctx=1427, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146062: Fri Aug 14 04:04:49 2026 read: IOPS=5, BW=82.7KiB/s (84.7kB/s)(6032KiB/72929msec) clat (msec): min=6, max=356, avg=46.17, stdev=54.41 lat (msec): min=6, max=356, avg=46.17, stdev=54.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 112], 95.00th=[ 176], | 99.00th=[ 288], 99.50th=[ 351], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 350, per=29.30%, avg=94.34, stdev=63.92, samples=124 iops : min= 1, max= 21, avg= 5.06, stdev= 4.07, samples=124 write: IOPS=5, BW=85.8KiB/s (87.8kB/s)(6256KiB/72929msec); 0 zone resets clat (msec): min=37, max=421, avg=140.63, stdev=73.74 lat (msec): min=37, max=421, avg=140.64, stdev=73.74 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 120], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 197], 90.00th=[ 241], 95.00th=[ 296], | 99.00th=[ 372], 99.50th=[ 418], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 224, per=26.24%, avg=88.94, stdev=45.24, samples=137 iops : min= 1, max= 14, avg= 4.72, stdev= 2.92, samples=137 lat (msec) : 10=1.43%, 20=14.71%, 50=22.79%, 100=22.66%, 250=33.33% lat (msec) : 500=5.08% cpu : usr=0.05%, sys=1.52%, ctx=1381, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=322KiB/s (330kB/s), 77.3KiB/s-86.1KiB/s (79.1kB/s-88.1kB/s), io=23.4MiB (24.5MB), run=72684-74329msec WRITE: bw=339KiB/s (347kB/s), 82.0KiB/s-88.0KiB/s (84.0kB/s-90.2kB/s), io=24.6MiB (25.8MB), run=72684-74329msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146079: Fri Aug 14 04:05:08 2026 read: IOPS=1, BW=1931KiB/s (1977kB/s)(7168KiB/3713msec) clat (usec): min=560, max=818748, avg=265977.40, stdev=271571.14 lat (usec): min=560, max=818750, avg=265979.11, stdev=271571.20 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 24511], | 30.00th=[217056], 40.00th=[217056], 50.00th=[223347], 60.00th=[250610], | 70.00th=[250610], 80.00th=[325059], 90.00th=[817890], 95.00th=[817890], | 99.00th=[817890], 99.50th=[817890], 99.90th=[817890], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 1617, max= 4063, per=60.39%, avg=2351.40, stdev=973.14, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1379KiB/s (1412kB/s)(5120KiB/3713msec); 0 zone resets clat (msec): min=71, max=999, avg=320.48, stdev=382.39 lat (msec): min=71, max=999, avg=320.80, stdev=382.29 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 2019, max= 6095, per=62.09%, avg=3384.33, stdev=2347.53, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 1000=16.67% cpu : usr=0.00%, sys=10.96%, ctx=248, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146080: Fri Aug 14 04:05:08 2026 read: IOPS=0, BW=389KiB/s (399kB/s)(2048KiB/5259msec) clat (msec): min=7, max=2048, avg=1028.19, stdev=1443.35 lat (msec): min=7, max=2048, avg=1028.19, stdev=1443.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 8], | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 8], 60.00th=[ 2056], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 2023, max= 2031, per=52.05%, avg=2027.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1947KiB/s (1994kB/s)(10.0MiB/5259msec); 0 zone resets clat (msec): min=148, max=672, avg=303.05, stdev=158.69 lat (msec): min=148, max=672, avg=303.29, stdev=158.77 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 180], | 30.00th=[ 182], 40.00th=[ 186], 50.00th=[ 253], 60.00th=[ 305], | 70.00th=[ 309], 80.00th=[ 380], 90.00th=[ 422], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2019, max= 6144, per=59.39%, avg=3237.20, stdev=1828.07, samples=5 iops : min= 1, max= 6, avg= 2.40, stdev= 2.19, samples=5 lat (msec) : 10=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=12.04%, ctx=206, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146081: Fri Aug 14 04:05:08 2026 read: IOPS=2, BW=2324KiB/s (2380kB/s)(6144KiB/2644msec) clat (usec): min=562, max=361041, avg=118843.81, stdev=147735.32 lat (usec): min=564, max=361041, avg=118845.43, stdev=147734.93 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[ 971], 50.00th=[ 971], 60.00th=[139461], | 70.00th=[208667], 80.00th=[208667], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 4007, max= 4063, per=100.00%, avg=4035.00, stdev=39.60, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2324KiB/s (2380kB/s)(6144KiB/2644msec); 0 zone resets clat (msec): min=199, max=707, avg=316.22, stdev=195.19 lat (msec): min=199, max=707, avg=316.49, stdev=195.10 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 271], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2003, max= 2913, per=42.48%, avg=2315.67, stdev=517.50, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (usec) : 750=8.33%, 1000=16.67% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=14.00%, ctx=141, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146083: Fri Aug 14 04:05:08 2026 read: IOPS=1, BW=1504KiB/s (1540kB/s)(5120KiB/3405msec) clat (usec): min=770, max=209378, avg=72578.91, stdev=99272.01 lat (usec): min=772, max=209380, avg=72580.24, stdev=99271.89 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[ 766], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[ 3884], 60.00th=[ 3884], | 70.00th=[147850], 80.00th=[147850], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2105KiB/s (2156kB/s)(7168KiB/3405msec); 0 zone resets clat (msec): min=112, max=810, avg=393.02, stdev=264.25 lat (msec): min=112, max=810, avg=393.13, stdev=264.22 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 180], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 330], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 642], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1497, max= 4007, per=43.64%, avg=2378.75, stdev=1111.85, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=16.67% lat (msec) : 4=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.55%, ctx=118, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3894KiB/s (3988kB/s), 389KiB/s-2324KiB/s (399kB/s-2380kB/s), io=20.0MiB (20.0MB), run=2644-5259msec WRITE: bw=5452KiB/s (5583kB/s), 1379KiB/s-2324KiB/s (1412kB/s-2380kB/s), io=28.0MiB (29.4MB), run=2644-5259msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146084: Fri Aug 14 04:05:09 2026 read: IOPS=1, BW=1591KiB/s (1630kB/s)(7168KiB/4504msec) clat (msec): min=91, max=681, avg=240.42, stdev=219.03 lat (msec): min=91, max=681, avg=240.43, stdev=219.03 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 163], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 384], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2007, max= 4071, per=89.84%, avg=3043.00, stdev=1187.05, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1137KiB/s (1164kB/s)(5120KiB/4504msec); 0 zone resets clat (msec): min=103, max=884, avg=416.56, stdev=286.92 lat (msec): min=103, max=884, avg=417.58, stdev=286.55 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1865, max= 4063, per=69.88%, avg=3314.33, stdev=1255.39, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.57%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146085: Fri Aug 14 04:05:09 2026 read: IOPS=0, BW=339KiB/s (347kB/s)(2048KiB/6045msec) clat (msec): min=117, max=2188, avg=1153.14, stdev=1464.77 lat (msec): min=117, max=2188, avg=1153.14, stdev=1464.77 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1865, max= 2000, per=57.06%, avg=1932.50, stdev=95.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1694KiB/s (1735kB/s)(10.0MiB/6045msec); 0 zone resets clat (msec): min=199, max=739, avg=355.43, stdev=196.37 lat (msec): min=199, max=739, avg=356.34, stdev=195.94 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 213], | 30.00th=[ 234], 40.00th=[ 251], 50.00th=[ 268], 60.00th=[ 271], | 70.00th=[ 284], 80.00th=[ 418], 90.00th=[ 676], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 2035, max= 4063, per=76.74%, avg=3639.80, stdev=897.31, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.66%, ctx=99, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146086: Fri Aug 14 04:05:09 2026 read: IOPS=1, BW=1056KiB/s (1081kB/s)(6144KiB/5818msec) clat (msec): min=86, max=308, avg=158.61, stdev=80.95 lat (msec): min=86, max=308, avg=158.61, stdev=80.95 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 134], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 4015, max= 4055, per=100.00%, avg=4035.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1056KiB/s (1081kB/s)(6144KiB/5818msec); 0 zone resets clat (msec): min=129, max=2082, avg=725.09, stdev=728.94 lat (msec): min=129, max=2082, avg=725.64, stdev=728.91 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 709], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 1865, max= 2035, per=41.95%, avg=1989.50, stdev=83.06, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.05%, sys=2.92%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146087: Fri Aug 14 04:05:09 2026 read: IOPS=0, BW=907KiB/s (929kB/s)(5120KiB/5643msec) clat (msec): min=64, max=625, avg=236.97, stdev=223.92 lat (msec): min=64, max=625, avg=236.97, stdev=223.92 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2007, max= 4000, per=79.11%, avg=2679.33, stdev=1143.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1270KiB/s (1301kB/s)(7168KiB/5643msec); 0 zone resets clat (msec): min=177, max=1511, avg=562.27, stdev=477.41 lat (msec): min=177, max=1511, avg=562.38, stdev=477.41 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 222], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 435], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 860], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 2023, max= 4063, per=64.14%, avg=3042.00, stdev=1174.34, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.33%, ctx=111, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3388KiB/s (3469kB/s), 339KiB/s-1591KiB/s (347kB/s-1630kB/s), io=20.0MiB (20.0MB), run=4504-6045msec WRITE: bw=4743KiB/s (4857kB/s), 1056KiB/s-1694KiB/s (1081kB/s-1735kB/s), io=28.0MiB (29.4MB), run=4504-6045msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146095: Fri Aug 14 04:05:24 2026 read: IOPS=1, BW=4943KiB/s (5062kB/s)(12.0MiB/2486msec) clat (msec): min=667, max=1050, avg=809.33, stdev=210.08 lat (msec): min=667, max=1050, avg=809.33, stdev=210.09 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8000, max= 8143, per=100.00%, avg=8071.50, stdev=101.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.20%, sys=12.19%, ctx=325, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146096: Fri Aug 14 04:05:24 2026 read: IOPS=0, BW=1629KiB/s (1668kB/s)(4096KiB/2514msec) clat (nsec): min=840102k, max=840102k, avg=840102178.00, stdev= 0.00 lat (nsec): min=840105k, max=840105k, avg=840105107.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3259KiB/s (3337kB/s)(8192KiB/2514msec); 0 zone resets clat (msec): min=528, max=1068, avg=798.58, stdev=381.51 lat (msec): min=530, max=1068, avg=799.62, stdev=380.66 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8192, max= 8192, per=72.30%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.28%, sys=5.09%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146097: Fri Aug 14 04:05:24 2026 write: IOPS=1, BW=4249KiB/s (4351kB/s)(12.0MiB/2892msec); 0 zone resets clat (msec): min=758, max=1106, avg=905.37, stdev=180.39 lat (msec): min=759, max=1107, avg=905.86, stdev=180.37 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7937, max= 8192, per=71.18%, avg=8064.50, stdev=180.31, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.17%, sys=4.60%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146098: Fri Aug 14 04:05:24 2026 write: IOPS=1, BW=5461KiB/s (5592kB/s)(12.0MiB/2250msec); 0 zone resets clat (msec): min=437, max=1043, avg=724.41, stdev=304.33 lat (msec): min=438, max=1043, avg=724.86, stdev=304.05 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7262, max= 8143, per=67.98%, avg=7702.50, stdev=622.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.25%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6517KiB/s (6674kB/s), 1629KiB/s-4943KiB/s (1668kB/s-5062kB/s), io=16.0MiB (16.8MB), run=2486-2514msec WRITE: bw=11.1MiB/s (11.6MB/s), 3259KiB/s-5461KiB/s (3337kB/s-5592kB/s), io=32.0MiB (33.6MB), run=2250-2892msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146099: Fri Aug 14 04:05:25 2026 read: IOPS=0, BW=3876KiB/s (3969kB/s)(12.0MiB/3170msec) clat (msec): min=327, max=1384, avg=979.18, stdev=569.83 lat (msec): min=327, max=1384, avg=979.18, stdev=569.83 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.90%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146100: Fri Aug 14 04:05:25 2026 read: IOPS=0, BW=1320KiB/s (1352kB/s)(4096KiB/3102msec) clat (nsec): min=1180.0M, max=1180.0M, avg=1180963042.00, stdev= 0.00 lat (nsec): min=1180.0M, max=1180.0M, avg=1180965602.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2641KiB/s (2704kB/s)(8192KiB/3102msec); 0 zone resets clat (msec): min=511, max=1278, avg=895.17, stdev=542.50 lat (msec): min=512, max=1279, avg=895.59, stdev=542.39 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7984, max= 7984, per=98.45%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.03%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146101: Fri Aug 14 04:05:25 2026 write: IOPS=1, BW=4279KiB/s (4381kB/s)(12.0MiB/2872msec); 0 zone resets clat (msec): min=680, max=1111, avg=922.64, stdev=220.20 lat (msec): min=681, max=1111, avg=923.06, stdev=220.22 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8000, max= 8015, per=98.74%, avg=8007.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.14%, sys=2.96%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146102: Fri Aug 14 04:05:25 2026 write: IOPS=0, BW=3042KiB/s (3115kB/s)(12.0MiB/4040msec); 0 zone resets clat (msec): min=420, max=2829, avg=1291.03, stdev=1336.22 lat (msec): min=420, max=2829, avg=1291.36, stdev=1336.23 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.35%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5168KiB/s (5292kB/s), 1320KiB/s-3876KiB/s (1352kB/s-3969kB/s), io=16.0MiB (16.8MB), run=3102-3170msec WRITE: bw=8111KiB/s (8306kB/s), 2641KiB/s-4279KiB/s (2704kB/s-4381kB/s), io=32.0MiB (33.6MB), run=2872-4040msec