== sanity test 398b: DIO and buffer IO race ============== 12:51:30 (1787763090) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.26678 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158207: Wed Aug 26 12:54:58 2026 read: IOPS=8, BW=32.1KiB/s (32.9kB/s)(5992KiB/186753msec) clat (usec): min=32, max=471315, avg=44744.56, stdev=37915.35 lat (usec): min=32, max=471317, avg=44747.07, stdev=37915.15 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 955], 20.00th=[ 19006], | 30.00th=[ 24249], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 65274], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[185598], 99.50th=[223347], 99.90th=[320865], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 119, per=34.49%, avg=44.14, stdev=21.91, samples=264 iops : min= 1, max= 29, avg=10.39, stdev= 5.52, samples=264 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6296KiB/186753msec); 0 zone resets clat (usec): min=746, max=51181k, avg=75743.93, stdev=1290125.87 lat (usec): min=748, max=51181k, avg=75746.26, stdev=1290125.86 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1237], | 20.00th=[ 3032], 30.00th=[ 8094], 40.00th=[ 16909], | 50.00th=[ 29754], 60.00th=[ 41681], 70.00th=[ 55837], | 80.00th=[ 71828], 90.00th=[ 101188], 95.00th=[ 128451], | 99.00th=[ 233833], 99.50th=[ 270533], 99.90th=[ 1149240], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 136, per=34.61%, avg=46.38, stdev=22.23, samples=264 iops : min= 1, max= 34, avg=10.97, stdev= 5.63, samples=264 lat (usec) : 50=0.78%, 100=3.68%, 250=0.20%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=8.07%, 4=3.16%, 10=5.89%, 20=10.19%, 50=34.21% lat (msec) : 100=24.84%, 250=8.20%, 500=0.36%, 2000=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.41%, ctx=6216, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158210: Wed Aug 26 12:54:58 2026 read: IOPS=7, BW=31.9KiB/s (32.7kB/s)(5940KiB/186071msec) clat (usec): min=27, max=51175k, avg=77938.68, stdev=1327314.11 lat (usec): min=28, max=51175k, avg=77957.73, stdev=1327313.90 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 433], | 20.00th=[ 18744], 30.00th=[ 24773], 40.00th=[ 30540], | 50.00th=[ 36963], 60.00th=[ 43779], 70.00th=[ 53216], | 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[ 108528], | 99.00th=[ 164627], 99.50th=[ 196084], 99.90th=[ 425722], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 5, max= 124, per=34.11%, avg=43.66, stdev=22.63, samples=263 iops : min= 1, max= 31, avg=10.27, stdev= 5.72, samples=263 write: IOPS=8, BW=34.1KiB/s (34.9kB/s)(6348KiB/186071msec); 0 zone resets clat (usec): min=694, max=1205.0k, avg=43987.97, stdev=54340.47 lat (usec): min=695, max=1205.0k, avg=43994.79, stdev=54338.00 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1254], | 20.00th=[ 3982], 30.00th=[ 8225], 40.00th=[ 19006], | 50.00th=[ 30802], 60.00th=[ 42730], 70.00th=[ 54264], | 80.00th=[ 74974], 90.00th=[ 104334], 95.00th=[ 132645], | 99.00th=[ 204473], 99.50th=[ 231736], 99.90th=[ 283116], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 5, max= 126, per=34.48%, avg=46.20, stdev=21.40, samples=265 iops : min= 1, max= 31, avg=10.91, stdev= 5.40, samples=265 lat (usec) : 50=0.59%, 100=3.84%, 250=0.33%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.36% lat (msec) : 2=7.42%, 4=2.60%, 10=6.61%, 20=9.73%, 50=34.47% lat (msec) : 100=25.20%, 250=8.37%, 500=0.16%, 2000=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.58%, ctx=6257, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158212: Wed Aug 26 12:54:58 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(6028KiB/186726msec) clat (usec): min=34, max=1209.7k, avg=43849.93, stdev=46336.04 lat (usec): min=34, max=1209.7k, avg=43854.16, stdev=46336.93 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 92], | 20.00th=[ 17433], 30.00th=[ 23987], 40.00th=[ 29754], | 50.00th=[ 35390], 60.00th=[ 42206], 70.00th=[ 53216], | 80.00th=[ 64226], 90.00th=[ 85459], 95.00th=[ 106431], | 99.00th=[ 164627], 99.50th=[ 225444], 99.90th=[ 278922], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 143, per=34.76%, avg=44.49, stdev=23.32, samples=264 iops : min= 1, max= 35, avg=10.48, stdev= 5.88, samples=264 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6260KiB/186726msec); 0 zone resets clat (usec): min=694, max=50966k, avg=76776.58, stdev=1288127.59 lat (usec): min=695, max=50966k, avg=76778.54, stdev=1288127.57 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1270], | 20.00th=[ 3752], 30.00th=[ 8455], 40.00th=[ 19006], | 50.00th=[ 30802], 60.00th=[ 43254], 70.00th=[ 57934], | 80.00th=[ 77071], 90.00th=[ 104334], 95.00th=[ 137364], | 99.00th=[ 217056], 99.50th=[ 283116], 99.90th=[ 471860], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 159, per=34.31%, avg=45.97, stdev=21.26, samples=265 iops : min= 1, max= 39, avg=10.85, stdev= 5.36, samples=265 lat (usec) : 50=0.98%, 100=4.07%, 250=0.16%, 500=0.07%, 750=0.20% lat (usec) : 1000=0.20% lat (msec) : 2=7.42%, 4=3.03%, 10=6.18%, 20=9.96%, 50=33.79% lat (msec) : 100=24.90%, 250=8.53%, 500=0.46%, 2000=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.48%, ctx=6265, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158213: Wed Aug 26 12:54:58 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(6052KiB/187412msec) clat (usec): min=31, max=608974, avg=43122.76, stdev=38340.46 lat (usec): min=32, max=608976, avg=43124.30, stdev=38340.48 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 86], 20.00th=[ 17957], | 30.00th=[ 23200], 40.00th=[ 28705], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 81265], 95.00th=[105382], | 99.00th=[162530], 99.50th=[189793], 99.90th=[450888], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 174, per=35.19%, avg=45.05, stdev=23.89, samples=260 iops : min= 1, max= 43, avg=10.61, stdev= 6.01, samples=260 write: IOPS=8, BW=33.3KiB/s (34.1kB/s)(6236KiB/187412msec); 0 zone resets clat (usec): min=666, max=51073k, avg=78027.65, stdev=1293729.98 lat (usec): min=666, max=51073k, avg=78031.08, stdev=1293729.92 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1221], | 20.00th=[ 3228], 30.00th=[ 7177], 40.00th=[ 16712], | 50.00th=[ 29492], 60.00th=[ 42206], 70.00th=[ 56886], | 80.00th=[ 80217], 90.00th=[ 112722], 95.00th=[ 137364], | 99.00th=[ 223347], 99.50th=[ 304088], 99.90th=[ 1367344], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 213, per=34.11%, avg=45.70, stdev=24.36, samples=264 iops : min= 1, max= 53, avg=10.79, stdev= 6.16, samples=264 lat (usec) : 50=0.91%, 100=4.07%, 250=0.39%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.33% lat (msec) : 2=7.65%, 4=3.45%, 10=6.15%, 20=10.19%, 50=32.55% lat (msec) : 100=24.77%, 250=8.92%, 500=0.33%, 750=0.03%, 2000=0.03% lat (msec) : >=2000=0.03% cpu : usr=0.05%, sys=3.32%, ctx=6108, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (131kB/s), 31.9KiB/s-32.3KiB/s (32.7kB/s-33.1kB/s), io=23.4MiB (24.6MB), run=186071-187412msec WRITE: bw=134KiB/s (137kB/s), 33.3KiB/s-34.1KiB/s (34.1kB/s-34.9kB/s), io=24.6MiB (25.7MB), run=186071-187412msec fio: pid=158208, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=158208: Wed Aug 26 12:57:02 2026 read: IOPS=4, BW=19.2KiB/s (19.6kB/s)(5840KiB/304836msec) clat (msec): min=4, max=1241, avg=35.02, stdev=51.47 lat (msec): min=4, max=1241, avg=35.02, stdev=51.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 46], 90.00th=[ 78], 95.00th=[ 113], | 99.00th=[ 194], 99.50th=[ 275], 99.90th=[ 477], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 95, per=34.93%, avg=26.55, stdev=18.38, samples=425 iops : min= 1, max= 23, avg= 6.00, stdev= 4.65, samples=425 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6132KiB/304836msec); 0 zone resets clat (msec): min=35, max=51225, avg=165.18, stdev=1307.55 lat (msec): min=35, max=51225, avg=165.18, stdev=1307.55 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 121], | 70.00th=[ 140], 80.00th=[ 176], 90.00th=[ 243], 95.00th=[ 305], | 99.00th=[ 443], 99.50th=[ 493], 99.90th=[ 634], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 56, per=30.38%, avg=24.30, stdev=12.95, samples=486 iops : min= 1, max= 14, avg= 5.44, stdev= 3.30, samples=486 lat (msec) : 10=5.81%, 20=18.37%, 50=16.83%, 100=27.89%, 250=26.15% lat (msec) : 500=4.68%, 750=0.17%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=0.92%, ctx=5010, majf=0, minf=25 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1461,1533,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158209: Wed Aug 26 12:57:02 2026 read: IOPS=4, BW=19.1KiB/s (19.6kB/s)(5940KiB/310550msec) clat (msec): min=4, max=1158, avg=34.25, stdev=48.06 lat (msec): min=4, max=1158, avg=34.26, stdev=48.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 79], 95.00th=[ 107], | 99.00th=[ 201], 99.50th=[ 234], 99.90th=[ 418], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 102, per=35.03%, avg=26.62, stdev=18.81, samples=432 iops : min= 1, max= 25, avg= 6.03, stdev= 4.75, samples=432 write: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6348KiB/310550msec); 0 zone resets clat (msec): min=33, max=51193, avg=163.31, stdev=1284.43 lat (msec): min=33, max=51193, avg=163.31, stdev=1284.43 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 72], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 106], 60.00th=[ 121], | 70.00th=[ 140], 80.00th=[ 176], 90.00th=[ 243], 95.00th=[ 296], | 99.00th=[ 439], 99.50th=[ 481], 99.90th=[ 827], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 63, per=30.58%, avg=24.47, stdev=12.98, samples=501 iops : min= 1, max= 15, avg= 5.48, stdev= 3.30, samples=501 lat (msec) : 10=5.89%, 20=17.77%, 50=18.23%, 100=27.18%, 250=26.01% lat (msec) : 500=4.69%, 750=0.13%, 1000=0.03%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=0.91%, ctx=5285, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158211: Wed Aug 26 12:57:02 2026 read: IOPS=4, BW=19.4KiB/s (19.8kB/s)(6028KiB/311285msec) clat (msec): min=5, max=351, avg=34.65, stdev=36.22 lat (msec): min=5, max=351, avg=34.65, stdev=36.22 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 51], 90.00th=[ 79], 95.00th=[ 109], | 99.00th=[ 180], 99.50th=[ 218], 99.90th=[ 326], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 135, per=34.66%, avg=26.34, stdev=18.90, samples=442 iops : min= 1, max= 33, avg= 5.96, stdev= 4.77, samples=442 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6260KiB/311285msec); 0 zone resets clat (msec): min=36, max=51225, avg=165.25, stdev=1294.57 lat (msec): min=36, max=51225, avg=165.25, stdev=1294.57 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 73], | 30.00th=[ 83], 40.00th=[ 93], 50.00th=[ 105], 60.00th=[ 120], | 70.00th=[ 140], 80.00th=[ 178], 90.00th=[ 249], 95.00th=[ 309], | 99.00th=[ 422], 99.50th=[ 502], 99.90th=[ 1435], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 64, per=30.24%, avg=24.19, stdev=13.12, samples=498 iops : min= 1, max= 16, avg= 5.41, stdev= 3.35, samples=498 lat (msec) : 10=6.18%, 20=16.47%, 50=17.87%, 100=28.91%, 250=25.55% lat (msec) : 500=4.72%, 750=0.20%, 1000=0.03%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=0.93%, ctx=5152, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158214: Wed Aug 26 12:57:02 2026 read: IOPS=4, BW=19.5KiB/s (20.0kB/s)(6052KiB/309598msec) clat (msec): min=4, max=51158, avg=67.56, stdev=1314.96 lat (msec): min=4, max=51158, avg=67.57, stdev=1314.96 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 79], 95.00th=[ 108], | 99.00th=[ 213], 99.50th=[ 255], 99.90th=[ 477], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 112, per=35.80%, avg=27.21, stdev=18.86, samples=431 iops : min= 1, max= 28, avg= 6.17, stdev= 4.77, samples=431 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6236KiB/309598msec); 0 zone resets clat (msec): min=29, max=1376, avg=132.75, stdev=87.63 lat (msec): min=29, max=1376, avg=132.75, stdev=87.63 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 73], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 120], | 70.00th=[ 140], 80.00th=[ 176], 90.00th=[ 245], 95.00th=[ 309], | 99.00th=[ 456], 99.50th=[ 493], 99.90th=[ 550], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 71, per=30.18%, avg=24.14, stdev=12.97, samples=498 iops : min= 1, max= 17, avg= 5.40, stdev= 3.30, samples=498 lat (msec) : 10=6.67%, 20=17.87%, 50=17.12%, 100=27.54%, 250=25.72% lat (msec) : 500=4.85%, 750=0.16%, 2000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=0.91%, ctx=5258, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=76.6KiB/s (78.5kB/s), 19.1KiB/s-19.5KiB/s (19.6kB/s-20.0kB/s), io=23.3MiB (24.4MB), run=304836-311285msec WRITE: bw=80.2KiB/s (82.2kB/s), 20.1KiB/s-20.4KiB/s (20.6kB/s-20.9kB/s), io=24.4MiB (25.6MB), run=304836-311285msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158269: Wed Aug 26 12:57:36 2026 read: IOPS=15, BW=243KiB/s (249kB/s)(5920KiB/24315msec) clat (usec): min=32, max=151373, avg=31146.39, stdev=26684.59 lat (usec): min=32, max=151374, avg=31147.60, stdev=26684.58 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 15008], 40.00th=[ 23462], 50.00th=[ 29492], 60.00th=[ 35914], | 70.00th=[ 42730], 80.00th=[ 50594], 90.00th=[ 66323], 95.00th=[ 78119], | 99.00th=[107480], 99.50th=[128451], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 31, max= 477, per=24.79%, avg=244.19, stdev=97.81, samples=47 iops : min= 1, max= 29, avg=14.53, stdev= 6.14, samples=47 write: IOPS=16, BW=262KiB/s (268kB/s)(6368KiB/24315msec); 0 zone resets clat (usec): min=1262, max=185672, avg=31389.44, stdev=32766.29 lat (usec): min=1264, max=185675, avg=31391.55, stdev=32766.33 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1598], 10.00th=[ 1958], 20.00th=[ 4424], | 30.00th=[ 6587], 40.00th=[ 10814], 50.00th=[ 20055], 60.00th=[ 32375], | 70.00th=[ 40633], 80.00th=[ 56886], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[139461], 99.50th=[183501], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 42, max= 570, per=25.52%, avg=264.34, stdev=101.03, samples=47 iops : min= 2, max= 35, avg=15.81, stdev= 6.36, samples=47 lat (usec) : 50=1.95%, 100=9.11%, 250=0.91%, 500=0.26%, 750=0.13% lat (msec) : 2=5.99%, 4=4.17%, 10=11.07%, 20=9.11%, 50=35.03% lat (msec) : 100=19.01%, 250=3.26% cpu : usr=0.10%, sys=6.75%, ctx=1406, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158272: Wed Aug 26 12:57:36 2026 read: IOPS=15, BW=250KiB/s (256kB/s)(5744KiB/23000msec) clat (usec): min=28, max=162538, avg=30892.82, stdev=27466.59 lat (usec): min=28, max=162538, avg=30894.08, stdev=27466.67 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 11994], 40.00th=[ 20317], 50.00th=[ 28181], 60.00th=[ 36439], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 78119], | 99.00th=[105382], 99.50th=[143655], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 95, max= 411, per=25.45%, avg=250.71, stdev=87.14, samples=45 iops : min= 5, max= 25, avg=14.93, stdev= 5.47, samples=45 write: IOPS=17, BW=285KiB/s (291kB/s)(6544KiB/23000msec); 0 zone resets clat (usec): min=999, max=151093, avg=28828.35, stdev=29070.92 lat (usec): min=1000, max=151093, avg=28834.11, stdev=29072.12 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1663], 10.00th=[ 2147], 20.00th=[ 4293], | 30.00th=[ 6783], 40.00th=[ 11731], 50.00th=[ 17957], 60.00th=[ 27132], | 70.00th=[ 39584], 80.00th=[ 51643], 90.00th=[ 72877], 95.00th=[ 83362], | 99.00th=[116917], 99.50th=[137364], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 62, max= 500, per=27.40%, avg=283.91, stdev=96.39, samples=45 iops : min= 3, max= 31, avg=17.02, stdev= 6.08, samples=45 lat (usec) : 50=2.08%, 100=9.90%, 250=0.78%, 500=0.26%, 1000=0.26% lat (msec) : 2=4.82%, 4=4.95%, 10=9.51%, 20=13.15%, 50=32.94% lat (msec) : 100=18.88%, 250=2.47% cpu : usr=0.11%, sys=7.08%, ctx=1379, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158274: Wed Aug 26 12:57:36 2026 read: IOPS=17, BW=276KiB/s (282kB/s)(6256KiB/22696msec) clat (usec): min=36, max=130606, avg=29236.88, stdev=23136.56 lat (usec): min=36, max=130608, avg=29250.19, stdev=23140.72 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 60], 20.00th=[ 74], | 30.00th=[ 17171], 40.00th=[ 23462], 50.00th=[ 28705], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 48497], 90.00th=[ 58983], 95.00th=[ 67634], | 99.00th=[ 90702], 99.50th=[101188], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 94, max= 413, per=28.21%, avg=277.91, stdev=78.47, samples=44 iops : min= 5, max= 25, avg=16.66, stdev= 5.01, samples=44 write: IOPS=16, BW=266KiB/s (272kB/s)(6032KiB/22696msec); 0 zone resets clat (usec): min=1051, max=183455, avg=29075.89, stdev=30726.89 lat (usec): min=1052, max=183457, avg=29077.86, stdev=30726.84 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1713], 10.00th=[ 2180], 20.00th=[ 5211], | 30.00th=[ 7635], 40.00th=[ 10945], 50.00th=[ 19006], 60.00th=[ 25035], | 70.00th=[ 35914], 80.00th=[ 47449], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[130548], 99.50th=[166724], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 94, max= 572, per=25.33%, avg=262.41, stdev=104.93, samples=44 iops : min= 5, max= 35, avg=15.68, stdev= 6.56, samples=44 lat (usec) : 50=1.43%, 100=10.03%, 250=1.17%, 500=0.13%, 750=0.13% lat (msec) : 2=4.82%, 4=3.12%, 10=10.81%, 20=10.94%, 50=38.80% lat (msec) : 100=16.54%, 250=2.08% cpu : usr=0.11%, sys=6.60%, ctx=1360, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158275: Wed Aug 26 12:57:36 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6032KiB/23101msec) clat (usec): min=22, max=147034, avg=28868.31, stdev=27127.79 lat (usec): min=22, max=147035, avg=28889.67, stdev=27109.01 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 44], 10.00th=[ 57], 20.00th=[ 67], | 30.00th=[ 120], 40.00th=[ 20055], 50.00th=[ 26346], 60.00th=[ 32900], | 70.00th=[ 40633], 80.00th=[ 50594], 90.00th=[ 63701], 95.00th=[ 81265], | 99.00th=[105382], 99.50th=[143655], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 62, max= 633, per=27.18%, avg=267.68, stdev=102.35, samples=44 iops : min= 3, max= 39, avg=16.00, stdev= 6.49, samples=44 write: IOPS=16, BW=271KiB/s (277kB/s)(6256KiB/23101msec); 0 zone resets clat (usec): min=913, max=184471, avg=30294.09, stdev=33391.27 lat (usec): min=914, max=184474, avg=30295.95, stdev=33391.46 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1582], 10.00th=[ 1958], 20.00th=[ 4080], | 30.00th=[ 7046], 40.00th=[ 10290], 50.00th=[ 16712], 60.00th=[ 25297], | 70.00th=[ 41157], 80.00th=[ 54264], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[152044], 99.50th=[170918], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 43, max= 531, per=26.36%, avg=273.09, stdev=96.41, samples=45 iops : min= 2, max= 33, avg=16.36, stdev= 6.03, samples=45 lat (usec) : 50=3.39%, 100=10.55%, 250=1.43%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.52% lat (msec) : 2=4.95%, 4=4.82%, 10=10.03%, 20=11.33%, 50=30.08% lat (msec) : 100=19.66%, 250=2.86% cpu : usr=0.06%, sys=6.36%, ctx=1276, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=985KiB/s (1009kB/s), 243KiB/s-276KiB/s (249kB/s-282kB/s), io=23.4MiB (24.5MB), run=22696-24315msec WRITE: bw=1036KiB/s (1061kB/s), 262KiB/s-285KiB/s (268kB/s-291kB/s), io=24.6MiB (25.8MB), run=22696-24315msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158268: Wed Aug 26 12:58:12 2026 read: IOPS=6, BW=98.7KiB/s (101kB/s)(5920KiB/59998msec) clat (msec): min=5, max=296, avg=34.07, stdev=33.35 lat (msec): min=5, max=296, avg=34.07, stdev=33.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 71], 95.00th=[ 100], | 99.00th=[ 153], 99.50th=[ 255], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 384, per=27.49%, avg=108.32, stdev=64.77, samples=107 iops : min= 1, max= 24, avg= 6.04, stdev= 4.15, samples=107 write: IOPS=6, BW=106KiB/s (109kB/s)(6368KiB/59998msec); 0 zone resets clat (msec): min=37, max=369, avg=118.85, stdev=51.32 lat (msec): min=37, max=369, avg=118.85, stdev=51.32 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 122], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 188], 95.00th=[ 222], | 99.00th=[ 296], 99.50th=[ 321], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 192, per=25.70%, avg=106.65, stdev=41.80, samples=117 iops : min= 1, max= 12, avg= 5.92, stdev= 2.73, samples=117 lat (msec) : 10=2.60%, 20=16.41%, 50=21.74%, 100=27.34%, 250=30.08% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.39%, ctx=1297, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158270: Wed Aug 26 12:58:12 2026 read: IOPS=5, BW=94.7KiB/s (96.0kB/s)(5744KiB/60668msec) clat (msec): min=6, max=188, avg=32.41, stdev=27.31 lat (msec): min=6, max=188, avg=32.41, stdev=27.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 94], | 99.00th=[ 128], 99.50th=[ 142], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 21, max= 352, per=26.22%, avg=103.30, stdev=67.81, samples=108 iops : min= 1, max= 22, avg= 5.71, stdev= 4.35, samples=108 write: IOPS=6, BW=108KiB/s (110kB/s)(6544KiB/60668msec); 0 zone resets clat (msec): min=28, max=347, avg=118.96, stdev=51.65 lat (msec): min=28, max=347, avg=118.96, stdev=51.65 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 65], 20.00th=[ 80], | 30.00th=[ 88], 40.00th=[ 97], 50.00th=[ 107], 60.00th=[ 120], | 70.00th=[ 140], 80.00th=[ 157], 90.00th=[ 190], 95.00th=[ 220], | 99.00th=[ 284], 99.50th=[ 288], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 224, per=25.72%, avg=106.75, stdev=44.52, samples=119 iops : min= 1, max= 14, avg= 5.92, stdev= 2.89, samples=119 lat (msec) : 10=3.52%, 20=16.80%, 50=20.31%, 100=27.08%, 250=30.86% lat (msec) : 500=1.43% cpu : usr=0.05%, sys=1.40%, ctx=1334, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158271: Wed Aug 26 12:58:12 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(6256KiB/58630msec) clat (msec): min=6, max=298, avg=32.35, stdev=30.91 lat (msec): min=6, max=298, avg=32.36, stdev=30.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 70], 95.00th=[ 89], | 99.00th=[ 171], 99.50th=[ 207], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 343, per=28.73%, avg=113.21, stdev=77.49, samples=109 iops : min= 1, max= 21, avg= 6.33, stdev= 4.97, samples=109 write: IOPS=6, BW=103KiB/s (105kB/s)(6032KiB/58630msec); 0 zone resets clat (msec): min=39, max=377, avg=121.05, stdev=52.52 lat (msec): min=39, max=377, avg=121.05, stdev=52.52 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 88], 40.00th=[ 97], 50.00th=[ 108], 60.00th=[ 122], | 70.00th=[ 138], 80.00th=[ 159], 90.00th=[ 197], 95.00th=[ 218], | 99.00th=[ 309], 99.50th=[ 351], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 21, max= 224, per=24.64%, avg=102.27, stdev=41.75, samples=115 iops : min= 1, max= 14, avg= 5.64, stdev= 2.73, samples=115 lat (msec) : 10=2.60%, 20=19.27%, 50=20.83%, 100=27.47%, 250=28.26% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.42%, ctx=1375, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158273: Wed Aug 26 12:58:12 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(6032KiB/59473msec) clat (msec): min=7, max=193, avg=31.56, stdev=27.28 lat (msec): min=7, max=193, avg=31.56, stdev=27.28 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 61], 95.00th=[ 89], | 99.00th=[ 159], 99.50th=[ 171], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 31, max= 318, per=27.45%, avg=108.17, stdev=65.49, samples=109 iops : min= 1, max= 19, avg= 6.03, stdev= 4.17, samples=109 write: IOPS=6, BW=105KiB/s (108kB/s)(6256KiB/59473msec); 0 zone resets clat (msec): min=34, max=317, avg=120.78, stdev=49.57 lat (msec): min=34, max=317, avg=120.78, stdev=49.57 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 192], 95.00th=[ 218], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 224, per=25.52%, avg=105.91, stdev=39.45, samples=116 iops : min= 1, max= 14, avg= 5.86, stdev= 2.60, samples=116 lat (msec) : 10=2.47%, 20=17.58%, 50=22.79%, 100=24.48%, 250=31.90% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.35%, ctx=1258, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=395KiB/s (404kB/s), 94.7KiB/s-107KiB/s (96.0kB/s-109kB/s), io=23.4MiB (24.5MB), run=58630-60668msec WRITE: bw=415KiB/s (425kB/s), 103KiB/s-108KiB/s (105kB/s-110kB/s), io=24.6MiB (25.8MB), run=58630-60668msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158293: Wed Aug 26 12:58:27 2026 read: IOPS=2, BW=2405KiB/s (2462kB/s)(7168KiB/2981msec) clat (usec): min=571, max=446143, avg=196076.58, stdev=136903.47 lat (usec): min=573, max=446145, avg=196078.33, stdev=136903.49 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[119014], | 30.00th=[141558], 40.00th=[141558], 50.00th=[198181], 60.00th=[227541], | 70.00th=[227541], 80.00th=[240124], 90.00th=[446694], 95.00th=[446694], | 99.00th=[446694], 99.50th=[446694], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 2015, max= 2900, per=60.90%, avg=2242.25, stdev=438.59, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1718KiB/s (1759kB/s)(5120KiB/2981msec); 0 zone resets clat (msec): min=197, max=379, avg=265.56, stdev=79.83 lat (msec): min=197, max=379, avg=265.65, stdev=79.82 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2015, max= 4000, per=52.05%, avg=2683.33, stdev=1140.31, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=13.56%, ctx=211, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158294: Wed Aug 26 12:58:27 2026 read: IOPS=0, BW=399KiB/s (409kB/s)(2048KiB/5132msec) clat (msec): min=219, max=280, avg=249.65, stdev=43.06 lat (msec): min=219, max=280, avg=249.65, stdev=43.06 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1458, max= 1957, per=46.37%, avg=1707.50, stdev=352.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1995KiB/s (2043kB/s)(10.0MiB/5132msec); 0 zone resets clat (msec): min=238, max=742, avg=449.67, stdev=162.81 lat (msec): min=238, max=742, avg=449.84, stdev=162.88 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 292], | 30.00th=[ 338], 40.00th=[ 355], 50.00th=[ 397], 60.00th=[ 405], | 70.00th=[ 502], 80.00th=[ 600], 90.00th=[ 634], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1969, max= 4039, per=44.66%, avg=2302.29, stdev=766.18, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=16.67%, 500=50.00%, 750=33.33% cpu : usr=0.02%, sys=9.41%, ctx=157, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158295: Wed Aug 26 12:58:27 2026 read: IOPS=1, BW=1499KiB/s (1535kB/s)(6144KiB/4099msec) clat (usec): min=510, max=482312, avg=154635.09, stdev=191071.36 lat (usec): min=512, max=482313, avg=154636.65, stdev=191071.13 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 12780], 50.00th=[ 12780], 60.00th=[208667], | 70.00th=[223347], 80.00th=[223347], 90.00th=[480248], 95.00th=[480248], | 99.00th=[480248], 99.50th=[480248], 99.90th=[480248], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 4031, max= 5873, per=100.00%, avg=4952.00, stdev=1302.49, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1499KiB/s (1535kB/s)(6144KiB/4099msec); 0 zone resets clat (msec): min=182, max=1180, avg=519.34, stdev=371.34 lat (msec): min=182, max=1180, avg=519.42, stdev=371.35 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 443], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1957, max= 2820, per=42.64%, avg=2198.00, stdev=415.39, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 20=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.00%, ctx=114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158296: Wed Aug 26 12:58:27 2026 read: IOPS=0, BW=921KiB/s (943kB/s)(5120KiB/5561msec) clat (usec): min=696, max=354773, avg=163964.54, stdev=161048.26 lat (usec): min=697, max=354774, avg=163965.94, stdev=161048.20 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 1958], 40.00th=[ 1958], 50.00th=[179307], 60.00th=[179307], | 70.00th=[283116], 80.00th=[283116], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 4039, max= 4063, per=100.00%, avg=4051.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1289KiB/s (1320kB/s)(7168KiB/5561msec); 0 zone resets clat (msec): min=129, max=1433, avg=649.31, stdev=538.83 lat (msec): min=129, max=1434, avg=649.42, stdev=538.82 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 150], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 531], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 1267], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 1969, max= 2031, per=39.00%, avg=2010.60, stdev=24.02, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=6.04%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3683KiB/s (3771kB/s), 399KiB/s-2405KiB/s (409kB/s-2462kB/s), io=20.0MiB (20.0MB), run=2981-5561msec WRITE: bw=5156KiB/s (5280kB/s), 1289KiB/s-1995KiB/s (1320kB/s-2043kB/s), io=28.0MiB (29.4MB), run=2981-5561msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158297: Wed Aug 26 12:58:27 2026 read: IOPS=1, BW=1956KiB/s (2003kB/s)(7168KiB/3665msec) clat (msec): min=101, max=492, avg=184.63, stdev=138.09 lat (msec): min=101, max=492, avg=184.63, stdev=138.09 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 111], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 150], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 163], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2000, max= 3052, per=62.09%, avg=2217.80, stdev=466.45, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1397KiB/s (1431kB/s)(5120KiB/3665msec); 0 zone resets clat (msec): min=280, max=632, avg=419.21, stdev=156.62 lat (msec): min=280, max=632, avg=419.35, stdev=156.57 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2027, max= 4015, per=53.81%, avg=2691.00, stdev=1146.62, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=4.64%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158298: Wed Aug 26 12:58:27 2026 read: IOPS=0, BW=357KiB/s (366kB/s)(2048KiB/5733msec) clat (msec): min=119, max=187, avg=153.79, stdev=47.93 lat (msec): min=119, max=187, avg=153.80, stdev=47.93 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 121], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 1462, max= 2023, per=48.78%, avg=1742.50, stdev=396.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1786KiB/s (1829kB/s)(10.0MiB/5733msec); 0 zone resets clat (msec): min=142, max=1386, avg=522.38, stdev=364.43 lat (msec): min=142, max=1386, avg=522.50, stdev=364.40 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 245], | 30.00th=[ 288], 40.00th=[ 334], 50.00th=[ 347], 60.00th=[ 506], | 70.00th=[ 518], 80.00th=[ 642], 90.00th=[ 818], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 2000, max= 4047, per=46.11%, avg=2306.00, stdev=767.81, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.11%, ctx=134, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158299: Wed Aug 26 12:58:27 2026 read: IOPS=1, BW=1197KiB/s (1226kB/s)(6144KiB/5133msec) clat (msec): min=134, max=690, avg=240.06, stdev=221.19 lat (msec): min=134, max=690, avg=240.06, stdev=221.19 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 157], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2027, max= 4063, per=94.60%, avg=3379.00, stdev=1170.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1197KiB/s (1226kB/s)(6144KiB/5133msec); 0 zone resets clat (msec): min=328, max=1408, avg=574.58, stdev=413.44 lat (msec): min=328, max=1408, avg=574.68, stdev=413.45 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 447], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1456, max= 2031, per=38.09%, avg=1904.80, stdev=251.18, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=2.81%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158300: Wed Aug 26 12:58:27 2026 read: IOPS=0, BW=958KiB/s (981kB/s)(5120KiB/5346msec) clat (msec): min=97, max=370, avg=201.25, stdev=116.14 lat (msec): min=97, max=370, avg=201.25, stdev=116.14 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2007, max= 3984, per=74.79%, avg=2671.33, stdev=1136.83, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1341KiB/s (1373kB/s)(7168KiB/5346msec); 0 zone resets clat (msec): min=205, max=1442, avg=608.76, stdev=450.79 lat (msec): min=205, max=1442, avg=608.85, stdev=450.79 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 234], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 460], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 835], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1400, max= 4063, per=54.10%, avg=2705.60, stdev=1243.79, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.06%, sys=2.10%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3572KiB/s (3658kB/s), 357KiB/s-1956KiB/s (366kB/s-2003kB/s), io=20.0MiB (20.0MB), run=3665-5733msec WRITE: bw=5001KiB/s (5121kB/s), 1197KiB/s-1786KiB/s (1226kB/s-1829kB/s), io=28.0MiB (29.4MB), run=3665-5733msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158306: Wed Aug 26 12:58:44 2026 read: IOPS=1, BW=4306KiB/s (4409kB/s)(12.0MiB/2854msec) clat (msec): min=824, max=979, avg=886.91, stdev=81.99 lat (msec): min=824, max=979, avg=886.91, stdev=81.99 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8000, max= 8126, per=100.00%, avg=8063.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.81%, ctx=217, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158307: Wed Aug 26 12:58:44 2026 read: IOPS=0, BW=1338KiB/s (1370kB/s)(4096KiB/3062msec) clat (nsec): min=819159k, max=819159k, avg=819158919.00, stdev= 0.00 lat (nsec): min=819163k, max=819163k, avg=819163068.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2675KiB/s (2740kB/s)(8192KiB/3062msec); 0 zone resets clat (msec): min=388, max=1800, avg=1094.22, stdev=998.19 lat (msec): min=388, max=1800, avg=1094.64, stdev=998.25 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 1804], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8078, max= 8078, per=75.54%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.36%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158308: Wed Aug 26 12:58:44 2026 write: IOPS=0, BW=4010KiB/s (4107kB/s)(12.0MiB/3064msec); 0 zone resets clat (msec): min=563, max=1351, avg=1018.14, stdev=408.06 lat (msec): min=563, max=1352, avg=1021.04, stdev=409.30 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7907, max= 8078, per=74.74%, avg=7992.50, stdev=120.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.32%, ctx=78, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158309: Wed Aug 26 12:58:44 2026 write: IOPS=1, BW=4221KiB/s (4323kB/s)(12.0MiB/2911msec); 0 zone resets clat (msec): min=319, max=2069, avg=906.19, stdev=1007.55 lat (msec): min=320, max=2070, avg=907.01, stdev=1007.35 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 7543, max= 8000, per=72.67%, avg=7771.50, stdev=323.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.02%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5351KiB/s (5479kB/s), 1338KiB/s-4306KiB/s (1370kB/s-4409kB/s), io=16.0MiB (16.8MB), run=2854-3062msec WRITE: bw=10.4MiB/s (10.0MB/s), 2675KiB/s-4221KiB/s (2740kB/s-4323kB/s), io=32.0MiB (33.6MB), run=2911-3064msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158311: Wed Aug 26 12:58:45 2026 read: IOPS=0, BW=3363KiB/s (3444kB/s)(12.0MiB/3654msec) clat (msec): min=318, max=1883, avg=1217.35, stdev=808.33 lat (msec): min=318, max=1883, avg=1217.35, stdev=808.33 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.85%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158312: Wed Aug 26 12:58:45 2026 read: IOPS=0, BW=1169KiB/s (1197kB/s)(4096KiB/3503msec) clat (nsec): min=1582.6M, max=1582.6M, avg=1582643051.00, stdev= 0.00 lat (nsec): min=1582.6M, max=1582.6M, avg=1582646588.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1586], 5.00th=[ 1586], 10.00th=[ 1586], 20.00th=[ 1586], | 30.00th=[ 1586], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2339KiB/s (2395kB/s)(8192KiB/3503msec); 0 zone resets clat (msec): min=471, max=1445, avg=958.26, stdev=688.36 lat (msec): min=471, max=1445, avg=958.74, stdev=688.42 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8175, max= 8175, per=87.89%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.94%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158313: Wed Aug 26 12:58:45 2026 write: IOPS=0, BW=3488KiB/s (3572kB/s)(12.0MiB/3523msec); 0 zone resets clat (msec): min=369, max=1894, avg=1172.46, stdev=765.75 lat (msec): min=370, max=1894, avg=1173.05, stdev=765.62 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8015, max= 8015, per=86.17%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.47%, ctx=28, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158314: Wed Aug 26 12:58:45 2026 write: IOPS=1, BW=4455KiB/s (4562kB/s)(12.0MiB/2758msec); 0 zone resets clat (msec): min=524, max=1115, avg=918.02, stdev=340.42 lat (msec): min=526, max=1115, avg=918.98, stdev=339.76 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7314, max= 8143, per=83.09%, avg=7728.50, stdev=586.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.11%, sys=6.31%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4484KiB/s (4591kB/s), 1169KiB/s-3363KiB/s (1197kB/s-3444kB/s), io=16.0MiB (16.8MB), run=3503-3654msec WRITE: bw=9301KiB/s (9524kB/s), 2339KiB/s-4455KiB/s (2395kB/s-4562kB/s), io=32.0MiB (33.6MB), run=2758-3523msec