== sanity test 398b: DIO and buffer IO race ============== 10:47:42 (1782485262) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.51568 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181916: Fri Jun 26 10:49:36 2026 read: IOPS=15, BW=61.8KiB/s (63.3kB/s)(5992KiB/96879msec) clat (usec): min=38, max=862075, avg=36381.98, stdev=31286.11 lat (usec): min=40, max=862077, avg=36384.49, stdev=31285.71 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10290], 10.00th=[ 13566], 20.00th=[ 18482], | 30.00th=[ 22414], 40.00th=[ 26346], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 42206], 80.00th=[ 50594], 90.00th=[ 63177], 95.00th=[ 78119], | 99.00th=[110625], 99.50th=[147850], 99.90th=[252707], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 119, per=25.30%, avg=61.72, stdev=21.50, samples=191 iops : min= 1, max= 29, avg=14.81, stdev= 5.38, samples=191 write: IOPS=16, BW=64.0KiB/s (66.5kB/s)(6296KiB/96879msec); 0 zone resets clat (usec): min=767, max=160884, avg=26658.37, stdev=27382.75 lat (usec): min=768, max=160887, avg=26660.21, stdev=27383.49 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1500], 20.00th=[ 2966], | 30.00th=[ 6325], 40.00th=[ 12387], 50.00th=[ 19792], 60.00th=[ 25560], | 70.00th=[ 33162], 80.00th=[ 45351], 90.00th=[ 63701], 95.00th=[ 83362], | 99.00th=[123208], 99.50th=[133694], 99.90th=[156238], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 7, max= 190, per=25.44%, avg=65.13, stdev=25.49, samples=190 iops : min= 1, max= 47, avg=15.66, stdev= 6.40, samples=190 lat (usec) : 50=0.29%, 100=1.24%, 250=0.07%, 500=0.07%, 1000=0.20% lat (msec) : 2=7.58%, 4=4.10%, 10=7.88%, 20=16.05%, 50=43.98% lat (msec) : 100=16.47%, 250=2.02%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.65%, ctx=6587, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181919: Fri Jun 26 10:49:36 2026 read: IOPS=15, BW=60.9KiB/s (62.3kB/s)(5940KiB/97590msec) clat (usec): min=38, max=263004, avg=36537.89, stdev=23006.38 lat (usec): min=39, max=263006, avg=36540.49, stdev=23005.17 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10814], 10.00th=[ 15008], 20.00th=[ 19268], | 30.00th=[ 23462], 40.00th=[ 27132], 50.00th=[ 32113], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 51119], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[111674], 99.50th=[124257], 99.90th=[179307], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 127, per=24.99%, avg=60.97, stdev=21.91, samples=191 iops : min= 1, max= 31, avg=14.62, stdev= 5.51, samples=191 write: IOPS=16, BW=65.0KiB/s (66.6kB/s)(6348KiB/97590msec); 0 zone resets clat (usec): min=935, max=840885, avg=27026.08, stdev=33510.64 lat (usec): min=937, max=840885, avg=27029.49, stdev=33510.44 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1319], 10.00th=[ 1532], 20.00th=[ 3163], | 30.00th=[ 6325], 40.00th=[ 13698], 50.00th=[ 19792], 60.00th=[ 25822], | 70.00th=[ 34866], 80.00th=[ 44827], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[125305], 99.50th=[135267], 99.90th=[202376], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 15, max= 184, per=25.38%, avg=64.96, stdev=25.55, samples=191 iops : min= 3, max= 46, avg=15.63, stdev= 6.44, samples=191 lat (usec) : 50=0.10%, 100=1.60%, 250=0.10%, 750=0.03%, 1000=0.10% lat (msec) : 2=7.03%, 4=5.18%, 10=6.45%, 20=16.11%, 50=44.01% lat (msec) : 100=17.45%, 250=1.79%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=6.62%, ctx=6582, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181921: Fri Jun 26 10:49:36 2026 read: IOPS=15, BW=62.3KiB/s (63.8kB/s)(6028KiB/96736msec) clat (usec): min=39, max=189369, avg=34574.27, stdev=22050.88 lat (usec): min=39, max=189370, avg=34586.05, stdev=22060.74 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9765], 10.00th=[ 14353], 20.00th=[ 18220], | 30.00th=[ 21103], 40.00th=[ 25035], 50.00th=[ 30016], 60.00th=[ 34866], | 70.00th=[ 41157], 80.00th=[ 48497], 90.00th=[ 62653], 95.00th=[ 77071], | 99.00th=[106431], 99.50th=[123208], 99.90th=[158335], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 15, max= 116, per=25.45%, avg=62.09, stdev=21.80, samples=190 iops : min= 3, max= 29, avg=14.91, stdev= 5.49, samples=190 write: IOPS=16, BW=64.7KiB/s (66.3kB/s)(6260KiB/96736msec); 0 zone resets clat (usec): min=867, max=840967, avg=28243.18, stdev=34316.68 lat (usec): min=868, max=840969, avg=28245.12, stdev=34316.80 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 1614], 20.00th=[ 3228], | 30.00th=[ 7111], 40.00th=[ 14615], 50.00th=[ 21627], 60.00th=[ 27657], | 70.00th=[ 35390], 80.00th=[ 46924], 90.00th=[ 62653], 95.00th=[ 80217], | 99.00th=[127402], 99.50th=[147850], 99.90th=[217056], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 135, per=25.12%, avg=64.30, stdev=24.98, samples=190 iops : min= 1, max= 33, avg=15.46, stdev= 6.28, samples=190 lat (usec) : 50=0.26%, 100=1.82%, 250=0.13%, 1000=0.07% lat (msec) : 2=6.48%, 4=4.88%, 10=6.32%, 20=17.15%, 50=44.76% lat (msec) : 100=16.11%, 250=1.99%, 1000=0.03% cpu : usr=0.09%, sys=6.67%, ctx=6668, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181922: Fri Jun 26 10:49:36 2026 read: IOPS=15, BW=61.7KiB/s (63.1kB/s)(6052KiB/98150msec) clat (usec): min=36, max=158444, avg=35100.08, stdev=22091.27 lat (usec): min=36, max=158446, avg=35107.50, stdev=22092.93 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8160], 10.00th=[ 13566], 20.00th=[ 18220], | 30.00th=[ 22152], 40.00th=[ 26608], 50.00th=[ 30802], 60.00th=[ 35914], | 70.00th=[ 42730], 80.00th=[ 49546], 90.00th=[ 61080], 95.00th=[ 78119], | 99.00th=[113771], 99.50th=[126354], 99.90th=[156238], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 23, max= 119, per=25.31%, avg=61.74, stdev=21.42, samples=192 iops : min= 5, max= 29, avg=14.82, stdev= 5.39, samples=192 write: IOPS=15, BW=63.5KiB/s (65.1kB/s)(6236KiB/98150msec); 0 zone resets clat (usec): min=888, max=863884, avg=28619.75, stdev=34827.56 lat (usec): min=889, max=863886, avg=28625.20, stdev=34828.67 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1565], 20.00th=[ 3523], | 30.00th=[ 7111], 40.00th=[ 13960], 50.00th=[ 20579], 60.00th=[ 27657], | 70.00th=[ 35914], 80.00th=[ 49021], 90.00th=[ 68682], 95.00th=[ 81265], | 99.00th=[113771], 99.50th=[137364], 99.90th=[185598], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 152, per=24.68%, avg=63.18, stdev=26.01, samples=193 iops : min= 1, max= 38, avg=15.18, stdev= 6.58, samples=193 lat (usec) : 50=0.20%, 100=1.92%, 250=0.13%, 750=0.03%, 1000=0.07% lat (msec) : 2=7.00%, 4=3.81%, 10=7.88%, 20=15.85%, 50=43.98% lat (msec) : 100=16.99%, 250=2.12%, 1000=0.03% cpu : usr=0.08%, sys=6.60%, ctx=6692, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=245KiB/s (251kB/s), 60.9KiB/s-62.3KiB/s (62.3kB/s-63.8kB/s), io=23.4MiB (24.6MB), run=96736-98150msec WRITE: bw=256KiB/s (262kB/s), 63.5KiB/s-65.0KiB/s (65.1kB/s-66.6kB/s), io=24.6MiB (25.7MB), run=96736-98150msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181915: Fri Jun 26 10:50:03 2026 read: IOPS=12, BW=48.0KiB/s (49.2kB/s)(5992KiB/124815msec) clat (msec): min=4, max=871, avg=32.73, stdev=35.93 lat (msec): min=4, max=871, avg=32.74, stdev=35.93 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 72], 95.00th=[ 93], | 99.00th=[ 148], 99.50th=[ 167], 99.90th=[ 211], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 166, per=25.35%, avg=48.43, stdev=32.32, samples=242 iops : min= 1, max= 41, avg=11.47, stdev= 8.13, samples=242 write: IOPS=12, BW=50.4KiB/s (51.7kB/s)(6296KiB/124815msec); 0 zone resets clat (msec): min=8, max=291, avg=47.89, stdev=33.98 lat (msec): min=8, max=291, avg=47.90, stdev=33.98 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 71], 90.00th=[ 93], 95.00th=[ 117], | 99.00th=[ 161], 99.50th=[ 199], 99.90th=[ 262], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 151, per=25.13%, avg=50.26, stdev=31.47, samples=245 iops : min= 1, max= 37, avg=11.92, stdev= 7.90, samples=245 lat (msec) : 10=5.31%, 20=24.25%, 50=43.62%, 100=20.93%, 250=5.79% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=2.77%, ctx=4998, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181917: Fri Jun 26 10:50:03 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5940KiB/125698msec) clat (msec): min=4, max=899, avg=32.80, stdev=37.82 lat (msec): min=4, max=899, avg=32.81, stdev=37.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 97], | 99.00th=[ 153], 99.50th=[ 180], 99.90th=[ 230], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 151, per=25.03%, avg=47.81, stdev=34.06, samples=243 iops : min= 1, max= 37, avg=11.30, stdev= 8.54, samples=243 write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6348KiB/125698msec); 0 zone resets clat (msec): min=8, max=287, avg=48.26, stdev=34.63 lat (msec): min=8, max=287, avg=48.26, stdev=34.63 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 74], 90.00th=[ 93], 95.00th=[ 114], | 99.00th=[ 182], 99.50th=[ 205], 99.90th=[ 275], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 151, per=25.19%, avg=50.37, stdev=32.33, samples=247 iops : min= 1, max= 37, avg=11.95, stdev= 8.10, samples=247 lat (msec) : 10=5.66%, 20=25.59%, 50=41.37%, 100=21.09%, 250=6.18% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=2.61%, ctx=5058, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181918: Fri Jun 26 10:50:03 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(6028KiB/125645msec) clat (msec): min=5, max=222, avg=32.85, stdev=30.18 lat (msec): min=5, max=222, avg=32.86, stdev=30.18 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 73], 95.00th=[ 96], | 99.00th=[ 146], 99.50th=[ 184], 99.90th=[ 207], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 7, max= 151, per=25.24%, avg=48.20, stdev=31.49, samples=245 iops : min= 1, max= 37, avg=11.41, stdev= 7.89, samples=245 write: IOPS=12, BW=49.8KiB/s (51.0kB/s)(6260KiB/125645msec); 0 zone resets clat (msec): min=8, max=907, avg=48.40, stdev=40.92 lat (msec): min=8, max=907, avg=48.40, stdev=40.92 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 72], 90.00th=[ 95], 95.00th=[ 116], | 99.00th=[ 169], 99.50th=[ 188], 99.90th=[ 284], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 166, per=24.82%, avg=49.64, stdev=32.86, samples=247 iops : min= 1, max= 41, avg=11.77, stdev= 8.26, samples=247 lat (msec) : 10=6.12%, 20=24.09%, 50=43.03%, 100=20.12%, 250=6.51% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.06%, sys=2.67%, ctx=4981, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181920: Fri Jun 26 10:50:03 2026 read: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6052KiB/125567msec) clat (msec): min=4, max=231, avg=33.07, stdev=31.44 lat (msec): min=4, max=231, avg=33.07, stdev=31.44 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 100], | 99.00th=[ 155], 99.50th=[ 188], 99.90th=[ 211], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7, max= 175, per=25.42%, avg=48.55, stdev=33.37, samples=242 iops : min= 1, max= 43, avg=11.50, stdev= 8.36, samples=242 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6236KiB/125567msec); 0 zone resets clat (msec): min=7, max=929, avg=48.19, stdev=39.55 lat (msec): min=7, max=929, avg=48.19, stdev=39.55 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 72], 90.00th=[ 93], 95.00th=[ 113], | 99.00th=[ 155], 99.50th=[ 171], 99.90th=[ 271], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 143, per=24.65%, avg=49.30, stdev=31.41, samples=246 iops : min= 1, max= 35, avg=11.68, stdev= 7.87, samples=246 lat (msec) : 10=6.38%, 20=24.58%, 50=41.47%, 100=21.22%, 250=6.25% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=2.69%, ctx=5028, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=191KiB/s (196kB/s), 47.3KiB/s-48.2KiB/s (48.4kB/s-49.4kB/s), io=23.4MiB (24.6MB), run=124815-125698msec WRITE: bw=200KiB/s (205kB/s), 49.7KiB/s-50.5KiB/s (50.9kB/s-51.7kB/s), io=24.6MiB (25.7MB), run=124815-125698msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181957: Fri Jun 26 10:50:37 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(5920KiB/24436msec) clat (usec): min=32, max=141672, avg=34748.80, stdev=23337.28 lat (usec): min=33, max=141673, avg=34750.03, stdev=23337.22 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 73], 20.00th=[ 18220], | 30.00th=[ 24249], 40.00th=[ 28705], 50.00th=[ 32375], 60.00th=[ 35914], | 70.00th=[ 41681], 80.00th=[ 50594], 90.00th=[ 62129], 95.00th=[ 80217], | 99.00th=[112722], 99.50th=[135267], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 96, max= 473, per=24.93%, avg=240.04, stdev=76.56, samples=48 iops : min= 6, max= 29, avg=14.21, stdev= 4.80, samples=48 write: IOPS=16, BW=261KiB/s (267kB/s)(6368KiB/24436msec); 0 zone resets clat (usec): min=1283, max=129510, avg=28183.73, stdev=26354.05 lat (usec): min=1285, max=129513, avg=28186.55, stdev=26354.50 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1926], 10.00th=[ 2540], 20.00th=[ 4490], | 30.00th=[ 7963], 40.00th=[ 14222], 50.00th=[ 21627], 60.00th=[ 28967], | 70.00th=[ 35914], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[117965], 99.50th=[128451], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 32, max= 474, per=25.65%, avg=260.04, stdev=95.85, samples=48 iops : min= 2, max= 29, avg=15.46, stdev= 6.03, samples=48 lat (usec) : 50=0.65%, 100=5.08%, 500=0.26% lat (msec) : 2=3.39%, 4=6.25%, 10=8.85%, 20=10.94%, 50=45.18% lat (msec) : 100=17.97%, 250=1.43% cpu : usr=0.08%, sys=7.78%, ctx=1717, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181958: Fri Jun 26 10:50:37 2026 read: IOPS=14, BW=234KiB/s (240kB/s)(5744KiB/24506msec) clat (usec): min=41, max=143248, avg=34842.74, stdev=20794.43 lat (usec): min=41, max=143249, avg=34843.95, stdev=20794.47 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 10290], 20.00th=[ 19006], | 30.00th=[ 23987], 40.00th=[ 27919], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 44827], 80.00th=[ 50070], 90.00th=[ 58983], 95.00th=[ 74974], | 99.00th=[ 92799], 99.50th=[103285], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 31, max= 352, per=24.32%, avg=234.19, stdev=65.50, samples=48 iops : min= 1, max= 22, avg=13.81, stdev= 4.16, samples=48 write: IOPS=16, BW=267KiB/s (273kB/s)(6544KiB/24506msec); 0 zone resets clat (usec): min=1265, max=140204, avg=28651.29, stdev=26535.09 lat (usec): min=1267, max=140205, avg=28656.65, stdev=26541.89 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1942], 10.00th=[ 2278], 20.00th=[ 5145], | 30.00th=[ 7308], 40.00th=[ 13698], 50.00th=[ 20317], 60.00th=[ 28705], | 70.00th=[ 40109], 80.00th=[ 52167], 90.00th=[ 65799], 95.00th=[ 80217], | 99.00th=[113771], 99.50th=[114820], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 124, max= 573, per=26.29%, avg=266.54, stdev=89.85, samples=48 iops : min= 7, max= 35, avg=15.85, stdev= 5.68, samples=48 lat (usec) : 50=0.39%, 100=3.26%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.12%, 4=5.21%, 10=9.90%, 20=14.19%, 50=41.93% lat (msec) : 100=20.31%, 250=1.04% cpu : usr=0.09%, sys=7.66%, ctx=1755, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181961: Fri Jun 26 10:50:37 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(6256KiB/24849msec) clat (usec): min=35, max=135609, avg=36510.94, stdev=24431.70 lat (usec): min=35, max=135611, avg=36512.18, stdev=24431.70 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 1270], 20.00th=[ 18482], | 30.00th=[ 22676], 40.00th=[ 26870], 50.00th=[ 32637], 60.00th=[ 37487], | 70.00th=[ 46400], 80.00th=[ 55313], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[116917], 99.50th=[127402], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 126, max= 411, per=26.23%, avg=252.63, stdev=74.07, samples=49 iops : min= 7, max= 25, avg=14.98, stdev= 4.67, samples=49 write: IOPS=15, BW=243KiB/s (249kB/s)(6032KiB/24849msec); 0 zone resets clat (usec): min=1102, max=137452, avg=27860.61, stdev=23987.14 lat (usec): min=1103, max=137454, avg=27862.73, stdev=23987.18 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 1991], 10.00th=[ 3195], 20.00th=[ 5669], | 30.00th=[ 9110], 40.00th=[ 15533], 50.00th=[ 23200], 60.00th=[ 29230], | 70.00th=[ 35914], 80.00th=[ 46400], 90.00th=[ 62653], 95.00th=[ 74974], | 99.00th=[102237], 99.50th=[116917], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 63, max= 410, per=23.78%, avg=241.08, stdev=80.81, samples=49 iops : min= 3, max= 25, avg=14.24, stdev= 5.10, samples=49 lat (usec) : 50=0.39%, 100=4.56%, 250=0.13% lat (msec) : 2=2.73%, 4=3.78%, 10=8.85%, 20=14.84%, 50=43.75% lat (msec) : 100=19.40%, 250=1.56% cpu : usr=0.10%, sys=7.55%, ctx=1754, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181963: Fri Jun 26 10:50:37 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(6032KiB/23508msec) clat (usec): min=38, max=109870, avg=34007.32, stdev=21658.62 lat (usec): min=39, max=109872, avg=34008.64, stdev=21658.66 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 77], 20.00th=[ 17695], | 30.00th=[ 22938], 40.00th=[ 27395], 50.00th=[ 31065], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 51643], 90.00th=[ 60556], 95.00th=[ 72877], | 99.00th=[ 93848], 99.50th=[ 96994], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 63, max= 504, per=26.65%, avg=256.65, stdev=87.41, samples=46 iops : min= 3, max= 31, avg=15.26, stdev= 5.55, samples=46 write: IOPS=16, BW=266KiB/s (273kB/s)(6256KiB/23508msec); 0 zone resets clat (usec): min=1604, max=173749, avg=26899.46, stdev=26215.05 lat (usec): min=1607, max=173752, avg=26903.25, stdev=26214.11 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2507], 10.00th=[ 3523], 20.00th=[ 5669], | 30.00th=[ 8717], 40.00th=[ 13173], 50.00th=[ 19792], 60.00th=[ 25560], | 70.00th=[ 32900], 80.00th=[ 42206], 90.00th=[ 62653], 95.00th=[ 80217], | 99.00th=[110625], 99.50th=[143655], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 63, max= 477, per=26.31%, avg=266.76, stdev=94.43, samples=46 iops : min= 3, max= 29, avg=15.89, stdev= 5.93, samples=46 lat (usec) : 50=0.39%, 100=4.95%, 250=0.52%, 750=0.13% lat (msec) : 2=1.30%, 4=5.08%, 10=11.59%, 20=13.93%, 50=42.45% lat (msec) : 100=18.36%, 250=1.30% cpu : usr=0.07%, sys=7.68%, ctx=1698, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=964KiB/s (987kB/s), 234KiB/s-257KiB/s (240kB/s-263kB/s), io=23.4MiB (24.5MB), run=23508-24849msec WRITE: bw=1014KiB/s (1038kB/s), 243KiB/s-267KiB/s (249kB/s-273kB/s), io=24.6MiB (25.8MB), run=23508-24849msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181959: Fri Jun 26 10:50:46 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(5920KiB/33639msec) clat (msec): min=5, max=204, avg=34.51, stdev=29.50 lat (msec): min=5, max=204, avg=34.51, stdev=29.50 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 71], 95.00th=[ 101], | 99.00th=[ 133], 99.50th=[ 165], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 30, max= 576, per=24.66%, avg=175.56, stdev=114.30, samples=66 iops : min= 1, max= 36, avg=10.21, stdev= 7.27, samples=66 write: IOPS=11, BW=189KiB/s (194kB/s)(6368KiB/33639msec); 0 zone resets clat (msec): min=11, max=201, avg=52.21, stdev=34.97 lat (msec): min=11, max=201, avg=52.22, stdev=34.97 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 78], 90.00th=[ 104], 95.00th=[ 131], | 99.00th=[ 174], 99.50th=[ 180], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 510, per=25.22%, avg=188.92, stdev=113.12, samples=66 iops : min= 1, max= 31, avg=11.05, stdev= 7.14, samples=66 lat (msec) : 10=4.17%, 20=20.18%, 50=44.14%, 100=23.31%, 250=8.20% cpu : usr=0.10%, sys=2.50%, ctx=1260, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181960: Fri Jun 26 10:50:46 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(5744KiB/33455msec) clat (msec): min=8, max=159, avg=34.55, stdev=28.23 lat (msec): min=8, max=159, avg=34.55, stdev=28.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 70], 95.00th=[ 100], | 99.00th=[ 146], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 31, max= 501, per=24.38%, avg=173.59, stdev=109.31, samples=64 iops : min= 1, max= 31, avg=10.08, stdev= 6.92, samples=64 write: IOPS=12, BW=196KiB/s (200kB/s)(6544KiB/33455msec); 0 zone resets clat (msec): min=12, max=210, avg=50.93, stdev=31.66 lat (msec): min=12, max=210, avg=50.94, stdev=31.66 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 79], 90.00th=[ 95], 95.00th=[ 113], | 99.00th=[ 142], 99.50th=[ 148], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 479, per=25.70%, avg=192.51, stdev=109.02, samples=65 iops : min= 1, max= 29, avg=11.26, stdev= 6.88, samples=65 lat (msec) : 10=1.56%, 20=22.79%, 50=44.14%, 100=24.74%, 250=6.77% cpu : usr=0.07%, sys=2.64%, ctx=1226, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181962: Fri Jun 26 10:50:46 2026 read: IOPS=11, BW=188KiB/s (193kB/s)(6256KiB/33223msec) clat (msec): min=5, max=154, avg=34.41, stdev=28.87 lat (msec): min=5, max=154, avg=34.41, stdev=28.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 75], 95.00th=[ 106], | 99.00th=[ 133], 99.50th=[ 148], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 31, max= 608, per=26.62%, avg=189.52, stdev=129.18, samples=65 iops : min= 1, max= 38, avg=11.08, stdev= 8.19, samples=65 write: IOPS=11, BW=182KiB/s (186kB/s)(6032KiB/33223msec); 0 zone resets clat (msec): min=11, max=203, avg=51.58, stdev=32.40 lat (msec): min=11, max=203, avg=51.58, stdev=32.40 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 75], 90.00th=[ 100], 95.00th=[ 124], | 99.00th=[ 161], 99.50th=[ 167], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 63, max= 509, per=23.95%, avg=179.42, stdev=101.67, samples=65 iops : min= 3, max= 31, avg=10.45, stdev= 6.39, samples=65 lat (msec) : 10=3.12%, 20=23.18%, 50=43.75%, 100=22.53%, 250=7.42% cpu : usr=0.08%, sys=2.61%, ctx=1262, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181964: Fri Jun 26 10:50:46 2026 read: IOPS=11, BW=182KiB/s (187kB/s)(6032KiB/33057msec) clat (msec): min=6, max=197, avg=36.13, stdev=31.19 lat (msec): min=6, max=197, avg=36.13, stdev=31.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 31], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 86], 95.00th=[ 103], | 99.00th=[ 140], 99.50th=[ 180], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 540, per=25.62%, avg=182.40, stdev=117.25, samples=65 iops : min= 1, max= 33, avg=10.63, stdev= 7.39, samples=65 write: IOPS=11, BW=189KiB/s (194kB/s)(6256KiB/33057msec); 0 zone resets clat (msec): min=11, max=184, avg=49.22, stdev=32.55 lat (msec): min=11, max=184, avg=49.23, stdev=32.55 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 74], 90.00th=[ 100], 95.00th=[ 122], | 99.00th=[ 150], 99.50th=[ 155], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 606, per=25.33%, avg=189.72, stdev=115.12, samples=65 iops : min= 1, max= 37, avg=11.09, stdev= 7.27, samples=65 lat (msec) : 10=4.56%, 20=20.31%, 50=46.88%, 100=20.70%, 250=7.55% cpu : usr=0.07%, sys=2.65%, ctx=1227, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=712KiB/s (729kB/s), 172KiB/s-188KiB/s (176kB/s-193kB/s), io=23.4MiB (24.5MB), run=33057-33639msec WRITE: bw=749KiB/s (767kB/s), 182KiB/s-196KiB/s (186kB/s-200kB/s), io=24.6MiB (25.8MB), run=33057-33639msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181974: Fri Jun 26 10:50:59 2026 read: IOPS=1, BW=1367KiB/s (1400kB/s)(7168KiB/5244msec) clat (msec): min=74, max=520, avg=156.20, stdev=161.04 lat (msec): min=74, max=520, avg=156.20, stdev=161.04 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 102], 60.00th=[ 106], | 70.00th=[ 106], 80.00th=[ 116], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1950, max= 7231, per=100.00%, avg=4590.50, stdev=3734.23, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=0, BW=976KiB/s (1000kB/s)(5120KiB/5244msec); 0 zone resets clat (msec): min=86, max=2733, avg=814.08, stdev=1084.48 lat (msec): min=86, max=2733, avg=814.20, stdev=1084.46 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1446, max= 4023, per=49.97%, avg=2501.33, stdev=1350.31, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.04%, sys=4.54%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181975: Fri Jun 26 10:50:59 2026 read: IOPS=0, BW=358KiB/s (366kB/s)(2048KiB/5727msec) clat (msec): min=72, max=403, avg=238.07, stdev=233.45 lat (msec): min=72, max=403, avg=238.07, stdev=233.45 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 73], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1424, max= 2035, per=48.36%, avg=1729.50, stdev=432.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1788KiB/s (1831kB/s)(10.0MiB/5727msec); 0 zone resets clat (msec): min=75, max=2752, avg=512.20, stdev=813.82 lat (msec): min=75, max=2752, avg=512.31, stdev=813.81 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 108], | 30.00th=[ 109], 40.00th=[ 157], 50.00th=[ 211], 60.00th=[ 215], | 70.00th=[ 222], 80.00th=[ 600], 90.00th=[ 676], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1950, max= 5696, per=58.39%, avg=2923.00, stdev=1849.01, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=4.79%, ctx=83, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181976: Fri Jun 26 10:50:59 2026 read: IOPS=1, BW=1120KiB/s (1147kB/s)(6144KiB/5487msec) clat (msec): min=106, max=632, avg=295.38, stdev=195.06 lat (msec): min=106, max=632, avg=295.38, stdev=195.06 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 279], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1454, max= 4071, per=66.54%, avg=2379.50, stdev=1156.92, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1120KiB/s (1147kB/s)(6144KiB/5487msec); 0 zone resets clat (msec): min=82, max=2540, avg=596.72, stdev=971.30 lat (msec): min=82, max=2540, avg=596.82, stdev=971.32 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 132], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2011, max= 4363, per=55.99%, avg=2803.00, stdev=1351.05, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.99%, ctx=95, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181977: Fri Jun 26 10:50:59 2026 read: IOPS=0, BW=932KiB/s (955kB/s)(5120KiB/5492msec) clat (msec): min=86, max=2800, avg=738.21, stdev=1159.10 lat (msec): min=86, max=2800, avg=738.21, stdev=1159.10 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1428, max= 2043, per=52.55%, avg=1879.25, stdev=301.14, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1305KiB/s (1336kB/s)(7168KiB/5492msec); 0 zone resets clat (msec): min=77, max=967, avg=254.03, stdev=316.56 lat (msec): min=77, max=969, avg=254.39, stdev=317.27 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 114], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 150], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 192], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2035, max= 5712, per=65.16%, avg=3262.00, stdev=2121.76, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.66%, ctx=83, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3576KiB/s (3662kB/s), 358KiB/s-1367KiB/s (366kB/s-1400kB/s), io=20.0MiB (20.0MB), run=5244-5727msec WRITE: bw=5006KiB/s (5127kB/s), 976KiB/s-1788KiB/s (1000kB/s-1831kB/s), io=28.0MiB (29.4MB), run=5244-5727msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181979: Fri Jun 26 10:50:59 2026 read: IOPS=1, BW=1697KiB/s (1737kB/s)(7168KiB/4225msec) clat (usec): min=737, max=2303.4k, avg=450142.84, stdev=821847.90 lat (usec): min=739, max=2303.4k, avg=450144.14, stdev=821847.92 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], | 20.00th=[ 76022], 30.00th=[ 139461], 40.00th=[ 139461], | 50.00th=[ 152044], 60.00th=[ 208667], 70.00th=[ 208667], | 80.00th=[ 270533], 90.00th=[2298479], 95.00th=[2298479], | 99.00th=[2298479], 99.50th=[2298479], 99.90th=[2298479], | 99.95th=[2298479], 99.99th=[2298479] bw ( KiB/s): min= 1372, max= 4096, per=84.95%, avg=3188.00, stdev=1572.70, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1212KiB/s (1241kB/s)(5120KiB/4225msec); 0 zone resets clat (msec): min=154, max=243, avg=211.42, stdev=34.49 lat (msec): min=154, max=243, avg=211.99, stdev=34.71 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 2048, max= 3946, per=57.03%, avg=2997.00, stdev=1342.09, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=15.98%, ctx=649, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181980: Fri Jun 26 10:50:59 2026 read: IOPS=0, BW=375KiB/s (384kB/s)(2048KiB/5456msec) clat (msec): min=208, max=242, avg=225.46, stdev=24.46 lat (msec): min=208, max=242, avg=225.46, stdev=24.46 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1381, max= 1946, per=44.32%, avg=1663.50, stdev=399.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1877KiB/s (1922kB/s)(10.0MiB/5456msec); 0 zone resets clat (msec): min=114, max=2609, avg=500.21, stdev=766.89 lat (msec): min=114, max=2609, avg=500.34, stdev=766.88 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 136], | 30.00th=[ 159], 40.00th=[ 171], 50.00th=[ 176], 60.00th=[ 184], | 70.00th=[ 190], 80.00th=[ 625], 90.00th=[ 634], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1996, max= 6144, per=68.61%, avg=3605.40, stdev=1707.25, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 1.87, samples=5 lat (msec) : 250=75.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=13.46%, ctx=268, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181981: Fri Jun 26 10:50:59 2026 read: IOPS=1, BW=1168KiB/s (1196kB/s)(6144KiB/5261msec) clat (usec): min=902, max=192589, avg=85051.16, stdev=74620.90 lat (usec): min=904, max=192590, avg=85052.46, stdev=74620.83 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 906], 10.00th=[ 906], 20.00th=[ 2606], | 30.00th=[ 2606], 40.00th=[ 87557], 50.00th=[ 87557], 60.00th=[ 93848], | 70.00th=[133694], 80.00th=[133694], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 1996, max= 3946, per=87.35%, avg=3278.33, stdev=1110.85, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1168KiB/s (1196kB/s)(6144KiB/5261msec); 0 zone resets clat (msec): min=156, max=3190, avg=790.94, stdev=1192.95 lat (msec): min=156, max=3190, avg=791.07, stdev=1192.94 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 347], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1946, max= 2868, per=41.78%, avg=2195.75, stdev=448.63, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 100=16.67%, 250=41.67%, 500=8.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=9.70%, ctx=184, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181982: Fri Jun 26 10:50:59 2026 read: IOPS=0, BW=1006KiB/s (1030kB/s)(5120KiB/5088msec) clat (usec): min=491, max=171736, avg=35036.60, stdev=76419.37 lat (usec): min=491, max=171736, avg=35037.55, stdev=76419.05 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 619], 60.00th=[ 619], | 70.00th=[ 1762], 80.00th=[ 1762], 90.00th=[170918], 95.00th=[170918], | 99.00th=[170918], 99.50th=[170918], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 1946, max= 5988, per=100.00%, avg=3967.00, stdev=2858.13, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1409KiB/s (1443kB/s)(7168KiB/5088msec); 0 zone resets clat (msec): min=154, max=2980, avg=701.50, stdev=1025.34 lat (msec): min=154, max=2980, avg=701.64, stdev=1025.34 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 178], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 288], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 743], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1471, max= 3946, per=44.52%, avg=2339.75, stdev=1096.66, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=10.63%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3754KiB/s (3844kB/s), 375KiB/s-1697KiB/s (384kB/s-1737kB/s), io=20.0MiB (20.0MB), run=4225-5456msec WRITE: bw=5255KiB/s (5381kB/s), 1168KiB/s-1877KiB/s (1196kB/s-1922kB/s), io=28.0MiB (29.4MB), run=4225-5456msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181989: Fri Jun 26 10:51:09 2026 read: IOPS=1, BW=5663KiB/s (5799kB/s)(12.0MiB/2170msec) clat (msec): min=601, max=622, avg=610.48, stdev=10.40 lat (msec): min=601, max=622, avg=610.48, stdev=10.40 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=18.40%, ctx=385, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181991: Fri Jun 26 10:51:09 2026 read: IOPS=0, BW=2437KiB/s (2495kB/s)(4096KiB/1681msec) clat (nsec): min=659243k, max=659243k, avg=659242811.00, stdev= 0.00 lat (nsec): min=659247k, max=659247k, avg=659247264.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4873KiB/s (4990kB/s)(8192KiB/1681msec); 0 zone resets clat (msec): min=194, max=484, avg=339.29, stdev=205.09 lat (msec): min=195, max=484, avg=340.34, stdev=204.22 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 8110, max= 8110, per=67.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=15.18%, ctx=125, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181992: Fri Jun 26 10:51:09 2026 write: IOPS=1, BW=4539KiB/s (4648kB/s)(12.0MiB/2707msec); 0 zone resets clat (msec): min=596, max=1062, avg=805.72, stdev=236.63 lat (msec): min=596, max=1062, avg=807.35, stdev=236.24 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8143, max= 8159, per=67.34%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.17%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181994: Fri Jun 26 10:51:09 2026 write: IOPS=1, BW=4648KiB/s (4759kB/s)(12.0MiB/2644msec); 0 zone resets clat (msec): min=189, max=1686, avg=783.69, stdev=795.19 lat (msec): min=189, max=1687, avg=784.11, stdev=795.22 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.21%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7550KiB/s (7731kB/s), 2437KiB/s-5663KiB/s (2495kB/s-5799kB/s), io=16.0MiB (16.8MB), run=1681-2170msec WRITE: bw=11.8MiB/s (12.4MB/s), 4539KiB/s-4873KiB/s (4648kB/s-4990kB/s), io=32.0MiB (33.6MB), run=1681-2707msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181990: Fri Jun 26 10:51:10 2026 read: IOPS=1, BW=4143KiB/s (4242kB/s)(12.0MiB/2966msec) clat (msec): min=572, max=1489, avg=886.78, stdev=522.38 lat (msec): min=572, max=1489, avg=886.79, stdev=522.38 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.41%, ctx=65, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181993: Fri Jun 26 10:51:10 2026 read: IOPS=0, BW=1536KiB/s (1573kB/s)(4096KiB/2666msec) clat (nsec): min=1790.3M, max=1790.3M, avg=1790266133.00, stdev= 0.00 lat (nsec): min=1790.3M, max=1790.3M, avg=1790267686.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1787], 5.00th=[ 1787], 10.00th=[ 1787], 20.00th=[ 1787], | 30.00th=[ 1787], 40.00th=[ 1787], 50.00th=[ 1787], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3073KiB/s (3147kB/s)(8192KiB/2666msec); 0 zone resets clat (msec): min=271, max=330, avg=301.12, stdev=42.03 lat (msec): min=271, max=331, avg=301.49, stdev=41.83 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.27%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181995: Fri Jun 26 10:51:10 2026 write: IOPS=0, BW=3878KiB/s (3971kB/s)(12.0MiB/3169msec); 0 zone resets clat (msec): min=171, max=2499, avg=951.66, stdev=1340.36 lat (msec): min=171, max=2499, avg=952.08, stdev=1340.35 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.03%, sys=6.69%, ctx=90, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181996: Fri Jun 26 10:51:10 2026 write: IOPS=1, BW=5103KiB/s (5225kB/s)(12.0MiB/2408msec); 0 zone resets clat (msec): min=189, max=1615, avg=706.24, stdev=789.86 lat (msec): min=189, max=1616, avg=706.70, stdev=790.06 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 5801, max= 8143, per=67.43%, avg=6972.00, stdev=1656.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.31%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5524KiB/s (5657kB/s), 1536KiB/s-4143KiB/s (1573kB/s-4242kB/s), io=16.0MiB (16.8MB), run=2666-2966msec WRITE: bw=10.1MiB/s (10.6MB/s), 3073KiB/s-5103KiB/s (3147kB/s-5225kB/s), io=32.0MiB (33.6MB), run=2408-3169msec