== sanity test 398b: DIO and buffer IO race ============== 12:55:45 (1789318545) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.18105 s, 15.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155178: Sun Sep 13 12:56:43 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(5992KiB/48025msec) clat (usec): min=33, max=734311, avg=16431.67, stdev=21218.40 lat (usec): min=34, max=734312, avg=16436.70, stdev=21224.92 clat percentiles (usec): | 1.00th=[ 83], 5.00th=[ 3195], 10.00th=[ 6521], 20.00th=[ 8455], | 30.00th=[ 10421], 40.00th=[ 12256], 50.00th=[ 14091], 60.00th=[ 16057], | 70.00th=[ 18482], 80.00th=[ 22152], 90.00th=[ 27919], 95.00th=[ 33817], | 99.00th=[ 54264], 99.50th=[ 62129], 99.90th=[ 96994], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 12, max= 231, per=25.26%, avg=124.52, stdev=42.66, samples=95 iops : min= 3, max= 57, avg=30.79, stdev=10.73, samples=95 write: IOPS=32, BW=131KiB/s (134kB/s)(6296KiB/48025msec); 0 zone resets clat (usec): min=622, max=108691, avg=14761.95, stdev=12856.65 lat (usec): min=622, max=108692, avg=14762.74, stdev=12856.70 clat percentiles (usec): | 1.00th=[ 914], 5.00th=[ 2212], 10.00th=[ 2737], 20.00th=[ 3818], | 30.00th=[ 6063], 40.00th=[ 8848], 50.00th=[ 11469], 60.00th=[ 14877], | 70.00th=[ 18220], 80.00th=[ 22676], 90.00th=[ 30802], 95.00th=[ 39584], | 99.00th=[ 59507], 99.50th=[ 66323], 99.90th=[ 99091], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 55, max= 224, per=25.65%, avg=132.35, stdev=42.67, samples=94 iops : min= 13, max= 56, avg=32.74, stdev=10.67, samples=94 lat (usec) : 50=0.16%, 100=0.85%, 250=1.17%, 500=0.13%, 750=0.33% lat (usec) : 1000=0.39% lat (msec) : 2=1.33%, 4=8.79%, 10=23.21%, 20=38.18%, 50=23.70% lat (msec) : 100=1.69%, 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=28.33%, ctx=8647, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155179: Sun Sep 13 12:56:43 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(5940KiB/47202msec) clat (usec): min=37, max=100738, avg=16267.99, stdev=10706.17 lat (usec): min=37, max=100738, avg=16268.57, stdev=10706.25 clat percentiles (usec): | 1.00th=[ 86], 5.00th=[ 709], 10.00th=[ 6849], 20.00th=[ 8455], | 30.00th=[ 10028], 40.00th=[ 11863], 50.00th=[ 13829], 60.00th=[ 16188], | 70.00th=[ 19006], 80.00th=[ 22676], 90.00th=[ 29230], 95.00th=[ 35914], | 99.00th=[ 55837], 99.50th=[ 61604], 99.90th=[ 87557], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 6, max= 224, per=25.63%, avg=126.35, stdev=44.83, samples=93 iops : min= 1, max= 56, avg=31.25, stdev=11.31, samples=93 write: IOPS=33, BW=134KiB/s (138kB/s)(6348KiB/47202msec); 0 zone resets clat (usec): min=617, max=722322, avg=14410.29, stdev=21154.75 lat (usec): min=617, max=722322, avg=14411.58, stdev=21154.70 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 2008], 10.00th=[ 2573], 20.00th=[ 3884], | 30.00th=[ 5735], 40.00th=[ 8717], 50.00th=[ 11076], 60.00th=[ 14353], | 70.00th=[ 18220], 80.00th=[ 22414], 90.00th=[ 28967], 95.00th=[ 35390], | 99.00th=[ 52691], 99.50th=[ 59507], 99.90th=[111674], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 6, max= 240, per=26.10%, avg=134.69, stdev=41.40, samples=93 iops : min= 1, max= 60, avg=33.33, stdev=10.40, samples=93 lat (usec) : 50=0.07%, 100=0.85%, 250=1.30%, 500=0.20%, 750=0.26% lat (usec) : 1000=0.46% lat (msec) : 2=1.92%, 4=8.04%, 10=24.48%, 20=36.78%, 50=24.32% lat (msec) : 100=1.24%, 250=0.07%, 750=0.03% cpu : usr=0.12%, sys=28.55%, ctx=8527, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155180: Sun Sep 13 12:56:43 2026 read: IOPS=30, BW=124KiB/s (127kB/s)(6028KiB/48670msec) clat (usec): min=30, max=100084, avg=16467.89, stdev=10959.07 lat (usec): min=30, max=100085, avg=16468.66, stdev=10959.08 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 1713], 10.00th=[ 6521], 20.00th=[ 8356], | 30.00th=[ 10028], 40.00th=[ 12256], 50.00th=[ 14484], 60.00th=[ 16712], | 70.00th=[ 19268], 80.00th=[ 22938], 90.00th=[ 29754], 95.00th=[ 35914], | 99.00th=[ 55837], 99.50th=[ 66323], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 32, max= 224, per=25.06%, avg=123.53, stdev=45.63, samples=95 iops : min= 8, max= 56, avg=30.54, stdev=11.45, samples=95 write: IOPS=32, BW=129KiB/s (132kB/s)(6260KiB/48670msec); 0 zone resets clat (usec): min=584, max=756639, avg=15129.73, stdev=22558.56 lat (usec): min=585, max=756640, avg=15130.77, stdev=22558.54 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 2114], 10.00th=[ 2671], 20.00th=[ 3982], | 30.00th=[ 5932], 40.00th=[ 9110], 50.00th=[ 11731], 60.00th=[ 14877], | 70.00th=[ 18744], 80.00th=[ 23200], 90.00th=[ 30016], 95.00th=[ 36963], | 99.00th=[ 58983], 99.50th=[ 80217], 99.90th=[106431], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 32, max= 239, per=24.82%, avg=128.06, stdev=39.30, samples=95 iops : min= 8, max= 59, avg=31.67, stdev= 9.84, samples=95 lat (usec) : 50=0.20%, 100=0.94%, 250=1.24%, 500=0.07%, 750=0.42% lat (usec) : 1000=0.42% lat (msec) : 2=1.46%, 4=8.30%, 10=23.86%, 20=36.17%, 50=25.29% lat (msec) : 100=1.50%, 250=0.10%, 1000=0.03% cpu : usr=0.14%, sys=28.25%, ctx=8726, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155181: Sun Sep 13 12:56:43 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(6052KiB/48261msec) clat (usec): min=31, max=116476, avg=16423.45, stdev=10613.92 lat (usec): min=32, max=116477, avg=16424.10, stdev=10613.96 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 3818], 10.00th=[ 6783], 20.00th=[ 8455], | 30.00th=[ 10290], 40.00th=[ 12649], 50.00th=[ 14353], 60.00th=[ 16581], | 70.00th=[ 19268], 80.00th=[ 23200], 90.00th=[ 28967], 95.00th=[ 34866], | 99.00th=[ 49546], 99.50th=[ 60031], 99.90th=[107480], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 40, max= 224, per=25.74%, avg=126.89, stdev=39.91, samples=95 iops : min= 10, max= 56, avg=31.38, stdev=10.03, samples=95 write: IOPS=32, BW=129KiB/s (132kB/s)(6236KiB/48261msec); 0 zone resets clat (usec): min=593, max=758904, avg=14908.07, stdev=22520.02 lat (usec): min=593, max=758905, avg=14910.97, stdev=22519.65 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2180], 10.00th=[ 2737], 20.00th=[ 3949], | 30.00th=[ 5932], 40.00th=[ 9110], 50.00th=[ 11600], 60.00th=[ 14484], | 70.00th=[ 17957], 80.00th=[ 22414], 90.00th=[ 30278], 95.00th=[ 37487], | 99.00th=[ 54264], 99.50th=[ 64226], 99.90th=[152044], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 56, max= 239, per=25.33%, avg=130.69, stdev=41.68, samples=95 iops : min= 14, max= 59, avg=32.33, stdev=10.47, samples=95 lat (usec) : 50=0.10%, 100=0.81%, 250=1.40%, 500=0.03%, 750=0.20% lat (usec) : 1000=0.33% lat (msec) : 2=1.63%, 4=8.24%, 10=23.50%, 20=37.04%, 50=25.36% lat (msec) : 100=1.20%, 250=0.13%, 1000=0.03% cpu : usr=0.09%, sys=28.21%, ctx=8676, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=493KiB/s (505kB/s), 124KiB/s-126KiB/s (127kB/s-129kB/s), io=23.4MiB (24.6MB), run=47202-48670msec WRITE: bw=517KiB/s (529kB/s), 129KiB/s-134KiB/s (132kB/s-138kB/s), io=24.6MiB (25.7MB), run=47202-48670msec fio: pid=155174, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=155173: Sun Sep 13 12:57:02 2026 read: IOPS=22, BW=88.0KiB/s (90.1kB/s)(5992KiB/68065msec) clat (usec): min=1994, max=741393, avg=14499.12, stdev=23137.50 lat (usec): min=1995, max=741394, avg=14499.83, stdev=23137.49 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 30], 95.00th=[ 40], | 99.00th=[ 78], 99.50th=[ 90], 99.90th=[ 104], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 15, max= 216, per=27.53%, avg=88.09, stdev=49.56, samples=134 iops : min= 3, max= 54, avg=21.73, stdev=12.54, samples=134 write: IOPS=23, BW=92.5KiB/s (94.7kB/s)(6296KiB/68065msec); 0 zone resets clat (msec): min=9, max=141, avg=29.31, stdev=17.18 lat (msec): min=9, max=141, avg=29.31, stdev=17.18 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 63], | 99.00th=[ 92], 99.50th=[ 103], 99.90th=[ 138], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 16, max= 200, per=27.58%, avg=92.39, stdev=49.56, samples=134 iops : min= 4, max= 50, avg=22.81, stdev=12.58, samples=134 lat (msec) : 2=0.03%, 4=5.53%, 10=20.54%, 20=32.49%, 50=34.11% lat (msec) : 100=6.90%, 250=0.36%, 750=0.03% cpu : usr=0.11%, sys=9.70%, ctx=5965, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=155174: Sun Sep 13 12:57:02 2026 read: IOPS=17, BW=68.6KiB/s (70.2kB/s)(3732KiB/54441msec) clat (msec): min=2, max=734, avg=19.08, stdev=28.25 lat (msec): min=2, max=734, avg=19.08, stdev=28.25 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 87], 99.50th=[ 97], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8, max= 192, per=21.46%, avg=68.68, stdev=33.49, samples=107 iops : min= 2, max= 48, avg=16.81, stdev= 8.48, samples=107 write: IOPS=18, BW=74.5KiB/s (76.3kB/s)(4056KiB/54441msec); 0 zone resets clat (msec): min=12, max=138, avg=35.93, stdev=17.77 lat (msec): min=12, max=138, avg=35.93, stdev=17.77 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 36], | 70.00th=[ 41], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 70], | 99.00th=[ 103], 99.50th=[ 114], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 23, max= 192, per=22.35%, avg=74.89, stdev=35.33, samples=107 iops : min= 5, max= 48, avg=18.36, stdev= 8.98, samples=107 lat (msec) : 4=2.82%, 10=13.86%, 20=24.38%, 50=48.46%, 100=9.70% lat (msec) : 250=0.67%, 750=0.05% cpu : usr=0.08%, sys=9.51%, ctx=3332, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=934,1014,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155175: Sun Sep 13 12:57:02 2026 read: IOPS=22, BW=88.0KiB/s (91.1kB/s)(6028KiB/67734msec) clat (msec): min=2, max=174, avg=14.00, stdev=13.23 lat (msec): min=2, max=174, avg=14.01, stdev=13.23 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 42], | 99.00th=[ 63], 99.50th=[ 73], 99.90th=[ 96], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 15, max= 224, per=27.92%, avg=89.35, stdev=52.45, samples=133 iops : min= 3, max= 56, avg=22.05, stdev=13.28, samples=133 write: IOPS=23, BW=92.4KiB/s (94.6kB/s)(6260KiB/67734msec); 0 zone resets clat (msec): min=10, max=748, avg=29.66, stdev=24.53 lat (msec): min=10, max=748, avg=29.66, stdev=24.53 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 60], | 99.00th=[ 89], 99.50th=[ 109], 99.90th=[ 142], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 24, max= 208, per=27.62%, avg=92.53, stdev=49.62, samples=133 iops : min= 6, max= 52, avg=22.84, stdev=12.57, samples=133 lat (msec) : 4=5.92%, 10=20.21%, 20=32.49%, 50=34.67%, 100=6.32% lat (msec) : 250=0.36%, 750=0.03% cpu : usr=0.13%, sys=9.82%, ctx=5931, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155176: Sun Sep 13 12:57:02 2026 read: IOPS=22, BW=89.4KiB/s (91.5kB/s)(6052KiB/67722msec) clat (msec): min=2, max=103, avg=14.24, stdev=14.11 lat (msec): min=2, max=103, avg=14.24, stdev=14.11 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 41], | 99.00th=[ 77], 99.50th=[ 90], 99.90th=[ 101], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 8, max= 248, per=27.92%, avg=89.34, stdev=54.13, samples=133 iops : min= 2, max= 62, avg=22.05, stdev=13.67, samples=133 write: IOPS=23, BW=92.1KiB/s (94.3kB/s)(6236KiB/67722msec); 0 zone resets clat (msec): min=11, max=749, avg=29.49, stdev=24.56 lat (msec): min=11, max=749, avg=29.49, stdev=24.56 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 59], | 99.00th=[ 86], 99.50th=[ 110], 99.90th=[ 142], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 31, max= 192, per=27.53%, avg=92.23, stdev=49.38, samples=133 iops : min= 7, max= 48, avg=22.77, stdev=12.52, samples=133 lat (msec) : 4=6.64%, 10=20.12%, 20=31.87%, 50=34.54%, 100=6.41% lat (msec) : 250=0.39%, 750=0.03% cpu : usr=0.10%, sys=9.63%, ctx=5887, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=320KiB/s (328kB/s), 68.6KiB/s-89.4KiB/s (70.2kB/s-91.5kB/s), io=21.3MiB (22.3MB), run=54441-68065msec WRITE: bw=336KiB/s (344kB/s), 74.5KiB/s-92.5KiB/s (76.3kB/s-94.7kB/s), io=22.3MiB (23.4MB), run=54441-68065msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155215: Sun Sep 13 12:57:23 2026 read: IOPS=23, BW=374KiB/s (383kB/s)(5920KiB/15808msec) clat (usec): min=50, max=78214, avg=20800.12, stdev=12265.94 lat (usec): min=51, max=78215, avg=20801.09, stdev=12265.96 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 123], 10.00th=[ 223], 20.00th=[11994], | 30.00th=[15270], 40.00th=[18220], 50.00th=[20841], 60.00th=[22938], | 70.00th=[25035], 80.00th=[29230], 90.00th=[35914], 95.00th=[41681], | 99.00th=[55837], 99.50th=[64226], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 160, max= 576, per=24.43%, avg=368.35, stdev=105.20, samples=31 iops : min= 10, max= 36, avg=22.48, stdev= 6.56, samples=31 write: IOPS=25, BW=403KiB/s (413kB/s)(6368KiB/15808msec); 0 zone resets clat (usec): min=2584, max=77248, avg=20347.53, stdev=13310.41 lat (usec): min=2585, max=77249, avg=20349.02, stdev=13310.41 clat percentiles (usec): | 1.00th=[ 3392], 5.00th=[ 4948], 10.00th=[ 5800], 20.00th=[ 8455], | 30.00th=[10814], 40.00th=[14877], 50.00th=[17957], 60.00th=[20841], | 70.00th=[25822], 80.00th=[31589], 90.00th=[39060], 95.00th=[44827], | 99.00th=[61604], 99.50th=[70779], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 160, max= 640, per=25.32%, avg=401.58, stdev=114.64, samples=31 iops : min= 10, max= 40, avg=24.55, stdev= 7.19, samples=31 lat (usec) : 100=1.30%, 250=3.65%, 500=0.26%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.26%, 4=1.43%, 10=14.71%, 20=30.47%, 50=45.05% lat (msec) : 100=2.60% cpu : usr=0.13%, sys=31.83%, ctx=2810, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155216: Sun Sep 13 12:57:23 2026 read: IOPS=22, BW=362KiB/s (370kB/s)(5744KiB/15882msec) clat (usec): min=59, max=134485, avg=21332.39, stdev=13570.70 lat (usec): min=60, max=134486, avg=21333.16, stdev=13570.72 clat percentiles (usec): | 1.00th=[ 84], 5.00th=[ 169], 10.00th=[ 4686], 20.00th=[ 11994], | 30.00th=[ 14484], 40.00th=[ 17695], 50.00th=[ 20841], 60.00th=[ 22938], | 70.00th=[ 26346], 80.00th=[ 30016], 90.00th=[ 35390], 95.00th=[ 42206], | 99.00th=[ 66847], 99.50th=[ 74974], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 192, max= 608, per=23.83%, avg=359.39, stdev=107.76, samples=31 iops : min= 12, max= 38, avg=21.90, stdev= 6.85, samples=31 write: IOPS=25, BW=412KiB/s (422kB/s)(6544KiB/15882msec); 0 zone resets clat (usec): min=1318, max=74225, avg=20047.80, stdev=13462.18 lat (usec): min=1319, max=74226, avg=20049.49, stdev=13462.37 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 4490], 10.00th=[ 5800], 20.00th=[ 7177], | 30.00th=[ 9765], 40.00th=[14091], 50.00th=[17957], 60.00th=[21103], | 70.00th=[25035], 80.00th=[31327], 90.00th=[38536], 95.00th=[44827], | 99.00th=[63701], 99.50th=[67634], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 224, max= 608, per=25.48%, avg=404.06, stdev=101.63, samples=31 iops : min= 14, max= 38, avg=24.71, stdev= 6.43, samples=31 lat (usec) : 100=1.04%, 250=2.86%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=1.30%, 10=17.06%, 20=29.17%, 50=44.79% lat (msec) : 100=2.60%, 250=0.13% cpu : usr=0.08%, sys=32.14%, ctx=2730, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155217: Sun Sep 13 12:57:23 2026 read: IOPS=25, BW=407KiB/s (416kB/s)(6256KiB/15381msec) clat (usec): min=32, max=102578, avg=20732.32, stdev=12576.29 lat (usec): min=33, max=102579, avg=20733.14, stdev=12576.34 clat percentiles (usec): | 1.00th=[ 74], 5.00th=[ 143], 10.00th=[ 233], 20.00th=[ 11863], | 30.00th=[ 15139], 40.00th=[ 17695], 50.00th=[ 19792], 60.00th=[ 22938], | 70.00th=[ 25822], 80.00th=[ 29230], 90.00th=[ 35390], 95.00th=[ 41157], | 99.00th=[ 54264], 99.50th=[ 76022], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 223, max= 672, per=27.08%, avg=408.37, stdev=115.76, samples=30 iops : min= 13, max= 42, avg=25.00, stdev= 7.31, samples=30 write: IOPS=24, BW=392KiB/s (402kB/s)(6032KiB/15381msec); 0 zone resets clat (usec): min=955, max=78148, avg=19247.72, stdev=12882.32 lat (usec): min=956, max=78150, avg=19249.28, stdev=12882.40 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 4555], 10.00th=[ 5866], 20.00th=[ 8291], | 30.00th=[10290], 40.00th=[13698], 50.00th=[16188], 60.00th=[19530], | 70.00th=[23725], 80.00th=[28967], 90.00th=[37487], 95.00th=[42206], | 99.00th=[56361], 99.50th=[77071], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 190, max= 603, per=24.41%, avg=387.07, stdev=115.01, samples=30 iops : min= 11, max= 37, avg=23.67, stdev= 7.16, samples=30 lat (usec) : 50=0.13%, 100=0.78%, 250=4.43%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=0.26%, 4=1.17%, 10=14.06%, 20=34.24%, 50=42.06% lat (msec) : 100=2.08%, 250=0.13% cpu : usr=0.10%, sys=32.37%, ctx=2837, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155218: Sun Sep 13 12:57:23 2026 read: IOPS=23, BW=383KiB/s (392kB/s)(6032KiB/15748msec) clat (usec): min=49, max=132432, avg=21754.73, stdev=15327.06 lat (usec): min=49, max=132432, avg=21755.48, stdev=15327.12 clat percentiles (usec): | 1.00th=[ 78], 5.00th=[ 117], 10.00th=[ 184], 20.00th=[ 10945], | 30.00th=[ 14222], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 23462], | 70.00th=[ 27657], 80.00th=[ 32113], 90.00th=[ 38536], 95.00th=[ 44303], | 99.00th=[ 66323], 99.50th=[105382], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 127, max= 768, per=25.06%, avg=377.87, stdev=141.18, samples=31 iops : min= 7, max= 48, avg=23.06, stdev= 8.98, samples=31 write: IOPS=24, BW=397KiB/s (407kB/s)(6256KiB/15748msec); 0 zone resets clat (usec): min=1139, max=79639, avg=19270.81, stdev=14129.33 lat (usec): min=1140, max=79641, avg=19272.16, stdev=14129.47 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 3720], 10.00th=[ 4686], 20.00th=[ 7308], | 30.00th=[ 9503], 40.00th=[12518], 50.00th=[15795], 60.00th=[19792], | 70.00th=[23725], 80.00th=[30016], 90.00th=[38011], 95.00th=[45876], | 99.00th=[69731], 99.50th=[78119], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 128, max= 768, per=24.71%, avg=391.97, stdev=148.53, samples=31 iops : min= 8, max= 48, avg=23.94, stdev= 9.32, samples=31 lat (usec) : 50=0.13%, 100=1.30%, 250=4.56%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.39%, 4=2.86%, 10=15.89%, 20=28.91%, 50=42.19% lat (msec) : 100=2.99%, 250=0.26% cpu : usr=0.08%, sys=31.21%, ctx=2810, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1508KiB/s (1544kB/s), 362KiB/s-407KiB/s (370kB/s-416kB/s), io=23.4MiB (24.5MB), run=15381-15882msec WRITE: bw=1587KiB/s (1625kB/s), 392KiB/s-412KiB/s (402kB/s-422kB/s), io=24.6MiB (25.8MB), run=15381-15882msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155209: Sun Sep 13 12:57:28 2026 read: IOPS=18, BW=290KiB/s (297kB/s)(5920KiB/20395msec) clat (usec): min=2943, max=99610, avg=17967.99, stdev=16917.59 lat (usec): min=2944, max=99611, avg=17968.75, stdev=16917.56 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 3621], 10.00th=[ 4047], 20.00th=[ 4883], | 30.00th=[ 6325], 40.00th=[ 9241], 50.00th=[12649], 60.00th=[15795], | 70.00th=[20841], 80.00th=[27657], 90.00th=[38011], 95.00th=[57410], | 99.00th=[82314], 99.50th=[90702], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 32, max= 832, per=24.20%, avg=284.12, stdev=166.69, samples=40 iops : min= 2, max= 52, avg=17.30, stdev=10.66, samples=40 write: IOPS=19, BW=312KiB/s (320kB/s)(6368KiB/20395msec); 0 zone resets clat (msec): min=12, max=132, avg=34.44, stdev=18.52 lat (msec): min=12, max=132, avg=34.44, stdev=18.52 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 71], | 99.00th=[ 105], 99.50th=[ 131], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 64, max= 704, per=25.04%, avg=309.30, stdev=163.80, samples=40 iops : min= 4, max= 44, avg=18.88, stdev=10.45, samples=40 lat (msec) : 4=4.43%, 10=15.76%, 20=23.70%, 50=43.88%, 100=11.59% lat (msec) : 250=0.65% cpu : usr=0.06%, sys=11.36%, ctx=1655, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155210: Sun Sep 13 12:57:28 2026 read: IOPS=17, BW=282KiB/s (289kB/s)(5744KiB/20348msec) clat (msec): min=2, max=166, avg=17.87, stdev=18.79 lat (msec): min=2, max=166, avg=17.87, stdev=18.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 56], | 99.00th=[ 90], 99.50th=[ 124], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 63, max= 768, per=23.83%, avg=279.78, stdev=164.58, samples=40 iops : min= 3, max= 48, avg=17.03, stdev=10.51, samples=40 write: IOPS=20, BW=322KiB/s (329kB/s)(6544KiB/20348msec); 0 zone resets clat (msec): min=12, max=129, avg=33.97, stdev=18.77 lat (msec): min=12, max=129, avg=33.97, stdev=18.77 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 62], 95.00th=[ 73], | 99.00th=[ 91], 99.50th=[ 112], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 127, max= 800, per=25.76%, avg=318.17, stdev=170.45, samples=40 iops : min= 7, max= 50, avg=19.42, stdev=10.88, samples=40 lat (msec) : 4=4.69%, 10=15.49%, 20=25.26%, 50=43.88%, 100=10.03% lat (msec) : 250=0.65% cpu : usr=0.10%, sys=11.72%, ctx=1670, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155211: Sun Sep 13 12:57:28 2026 read: IOPS=19, BW=310KiB/s (317kB/s)(6256KiB/20198msec) clat (msec): min=2, max=143, avg=18.61, stdev=18.42 lat (msec): min=2, max=143, avg=18.62, stdev=18.42 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 41], 95.00th=[ 60], | 99.00th=[ 90], 99.50th=[ 102], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 95, max= 928, per=26.49%, avg=310.98, stdev=191.00, samples=40 iops : min= 5, max= 58, avg=18.98, stdev=12.13, samples=40 write: IOPS=18, BW=299KiB/s (306kB/s)(6032KiB/20198msec); 0 zone resets clat (msec): min=12, max=112, avg=34.17, stdev=18.00 lat (msec): min=12, max=112, avg=34.17, stdev=18.00 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 48], 90.00th=[ 59], 95.00th=[ 71], | 99.00th=[ 96], 99.50th=[ 111], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 127, max= 672, per=24.11%, avg=297.77, stdev=157.47, samples=40 iops : min= 7, max= 42, avg=18.15, stdev=10.07, samples=40 lat (msec) : 4=4.30%, 10=16.80%, 20=22.79%, 50=43.62%, 100=11.85% lat (msec) : 250=0.65% cpu : usr=0.11%, sys=11.66%, ctx=1629, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155212: Sun Sep 13 12:57:28 2026 read: IOPS=18, BW=296KiB/s (303kB/s)(6032KiB/20394msec) clat (msec): min=2, max=170, avg=18.48, stdev=18.85 lat (msec): min=2, max=170, avg=18.48, stdev=18.85 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 54], | 99.00th=[ 91], 99.50th=[ 95], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 96, max= 800, per=24.76%, avg=290.62, stdev=166.78, samples=40 iops : min= 6, max= 50, avg=17.70, stdev=10.58, samples=40 write: IOPS=19, BW=307KiB/s (314kB/s)(6256KiB/20394msec); 0 zone resets clat (msec): min=13, max=109, avg=34.28, stdev=17.39 lat (msec): min=13, max=109, avg=34.28, stdev=17.39 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 62], 95.00th=[ 70], | 99.00th=[ 96], 99.50th=[ 101], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 126, max= 640, per=24.50%, avg=302.52, stdev=154.59, samples=40 iops : min= 7, max= 40, avg=18.45, stdev= 9.91, samples=40 lat (msec) : 4=3.65%, 10=17.19%, 20=22.14%, 50=45.57%, 100=11.07% lat (msec) : 250=0.39% cpu : usr=0.10%, sys=11.35%, ctx=1581, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1174KiB/s (1203kB/s), 282KiB/s-310KiB/s (289kB/s-317kB/s), io=23.4MiB (24.5MB), run=20198-20395msec WRITE: bw=1236KiB/s (1265kB/s), 299KiB/s-322KiB/s (306kB/s-329kB/s), io=24.6MiB (25.8MB), run=20198-20395msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155227: Sun Sep 13 12:57:35 2026 read: IOPS=3, BW=3466KiB/s (3549kB/s)(7168KiB/2068msec) clat (usec): min=451, max=203814, avg=103604.63, stdev=84069.93 lat (usec): min=452, max=203815, avg=103605.59, stdev=84070.06 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 474], | 30.00th=[ 76022], 40.00th=[ 76022], 50.00th=[101188], 60.00th=[147850], | 70.00th=[147850], 80.00th=[196084], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 4087, max= 5233, per=64.13%, avg=4660.00, stdev=810.34, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2476KiB/s (2535kB/s)(5120KiB/2068msec); 0 zone resets clat (msec): min=135, max=429, avg=262.75, stdev=107.63 lat (msec): min=135, max=430, avg=262.81, stdev=107.63 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1744, max= 2000, per=18.40%, avg=1872.00, stdev=181.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (usec) : 500=16.67% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67% cpu : usr=0.05%, sys=45.48%, ctx=911, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155228: Sun Sep 13 12:57:35 2026 read: IOPS=0, BW=727KiB/s (744kB/s)(2048KiB/2818msec) clat (usec): min=451, max=81238, avg=40845.27, stdev=57125.22 lat (usec): min=452, max=81240, avg=40846.74, stdev=57125.86 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 453], 40.00th=[ 453], 50.00th=[ 453], 60.00th=[81265], | 70.00th=[81265], 80.00th=[81265], 90.00th=[81265], 95.00th=[81265], | 99.00th=[81265], 99.50th=[81265], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 1744, max= 2003, per=25.78%, avg=1873.50, stdev=183.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3634KiB/s (3721kB/s)(10.0MiB/2818msec); 0 zone resets clat (msec): min=102, max=620, avg=272.13, stdev=161.15 lat (msec): min=102, max=620, avg=272.19, stdev=161.15 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 106], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 241], 60.00th=[ 279], | 70.00th=[ 309], 80.00th=[ 359], 90.00th=[ 405], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1744, max= 6144, per=35.35%, avg=3596.40, stdev=1794.40, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.05, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=41.75%, ctx=215, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155229: Sun Sep 13 12:57:35 2026 read: IOPS=2, BW=3004KiB/s (3077kB/s)(6144KiB/2045msec) clat (usec): min=309, max=283543, avg=85479.15, stdev=113441.47 lat (usec): min=310, max=283545, avg=85479.97, stdev=113441.68 clat percentiles (usec): | 1.00th=[ 310], 5.00th=[ 310], 10.00th=[ 310], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 791], 50.00th=[ 791], 60.00th=[ 83362], | 70.00th=[143655], 80.00th=[143655], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 4000, max= 4087, per=55.64%, avg=4043.50, stdev=61.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3004KiB/s (3077kB/s)(6144KiB/2045msec); 0 zone resets clat (msec): min=159, max=442, avg=250.76, stdev=107.00 lat (msec): min=159, max=442, avg=250.82, stdev=107.02 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 253], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2043, max= 4000, per=31.25%, avg=3179.00, stdev=1015.82, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=44.72%, ctx=302, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155230: Sun Sep 13 12:57:35 2026 read: IOPS=2, BW=2516KiB/s (2576kB/s)(5120KiB/2035msec) clat (usec): min=377, max=130869, avg=26572.22, stdev=58304.28 lat (usec): min=377, max=130870, avg=26572.98, stdev=58304.43 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 379], 10.00th=[ 379], 20.00th=[ 379], | 30.00th=[ 420], 40.00th=[ 420], 50.00th=[ 433], 60.00th=[ 433], | 70.00th=[ 758], 80.00th=[ 758], 90.00th=[130548], 95.00th=[130548], | 99.00th=[130548], 99.50th=[130548], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3522KiB/s (3607kB/s)(7168KiB/2035msec); 0 zone resets clat (msec): min=115, max=416, avg=268.92, stdev=102.37 lat (msec): min=115, max=417, avg=268.98, stdev=102.36 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 211], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 241], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 380], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1777, max= 4087, per=25.77%, avg=2621.33, stdev=1274.19, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=25.00%, 1000=8.33% lat (msec) : 250=41.67%, 500=25.00% cpu : usr=0.00%, sys=43.76%, ctx=172, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7268KiB/s (7442kB/s), 727KiB/s-3466KiB/s (744kB/s-3549kB/s), io=20.0MiB (20.0MB), run=2035-2818msec WRITE: bw=9.94MiB/s (10.4MB/s), 2476KiB/s-3634KiB/s (2535kB/s-3721kB/s), io=28.0MiB (29.4MB), run=2035-2818msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155233: Sun Sep 13 12:57:35 2026 read: IOPS=3, BW=3137KiB/s (3212kB/s)(7168KiB/2285msec) clat (msec): min=71, max=457, avg=170.89, stdev=140.50 lat (msec): min=71, max=457, avg=170.89, stdev=140.50 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 80], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 112], 60.00th=[ 116], | 70.00th=[ 116], 80.00th=[ 255], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1969, max= 4096, per=40.87%, avg=3337.00, stdev=1187.09, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2241KiB/s (2294kB/s)(5120KiB/2285msec); 0 zone resets clat (msec): min=97, max=414, avg=174.04, stdev=134.84 lat (msec): min=97, max=414, avg=174.10, stdev=134.84 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 115], 60.00th=[ 115], | 70.00th=[ 133], 80.00th=[ 133], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2048, max= 6071, per=35.51%, avg=4059.50, stdev=2844.69, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 100=25.00%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=17.91%, ctx=105, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155234: Sun Sep 13 12:57:35 2026 read: IOPS=0, BW=817KiB/s (836kB/s)(2048KiB/2508msec) clat (msec): min=62, max=212, avg=137.11, stdev=105.99 lat (msec): min=62, max=212, avg=137.11, stdev=106.00 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 63], 50.00th=[ 63], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 213], 95.00th=[ 213], | 99.00th=[ 213], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 1965, max= 2023, per=24.42%, avg=1994.00, stdev=41.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=4083KiB/s (4181kB/s)(10.0MiB/2508msec); 0 zone resets clat (msec): min=86, max=397, avg=208.46, stdev=112.26 lat (msec): min=86, max=397, avg=208.54, stdev=112.25 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 129], 50.00th=[ 159], 60.00th=[ 243], | 70.00th=[ 245], 80.00th=[ 264], 90.00th=[ 368], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1965, max= 4096, per=30.73%, avg=3513.50, stdev=1034.22, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (msec) : 100=33.33%, 250=41.67%, 500=25.00% cpu : usr=0.04%, sys=22.14%, ctx=178, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155235: Sun Sep 13 12:57:35 2026 read: IOPS=2, BW=2847KiB/s (2915kB/s)(6144KiB/2158msec) clat (msec): min=40, max=347, avg=131.21, stdev=109.43 lat (msec): min=40, max=347, avg=131.22, stdev=109.43 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 91], 50.00th=[ 91], 60.00th=[ 96], | 70.00th=[ 124], 80.00th=[ 124], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 2003, max= 4023, per=36.90%, avg=3013.00, stdev=1428.36, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2847KiB/s (2915kB/s)(6144KiB/2158msec); 0 zone resets clat (msec): min=67, max=459, avg=206.46, stdev=144.27 lat (msec): min=67, max=459, avg=206.53, stdev=144.28 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 213], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2003, max= 2778, per=19.80%, avg=2264.00, stdev=445.16, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=33.33%, 500=25.00% cpu : usr=0.00%, sys=15.07%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155236: Sun Sep 13 12:57:35 2026 read: IOPS=2, BW=2075KiB/s (2124kB/s)(5120KiB/2468msec) clat (msec): min=34, max=369, avg=116.23, stdev=142.14 lat (msec): min=34, max=369, avg=116.23, stdev=142.14 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 35], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 63], 60.00th=[ 63], | 70.00th=[ 65], 80.00th=[ 65], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2003, max= 6071, per=49.44%, avg=4037.00, stdev=2876.51, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2904KiB/s (2974kB/s)(7168KiB/2468msec); 0 zone resets clat (msec): min=81, max=518, avg=250.38, stdev=159.44 lat (msec): min=81, max=518, avg=250.44, stdev=159.44 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 113], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 230], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 363], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1370, max= 4023, per=20.60%, avg=2354.75, stdev=1152.76, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.08%, sys=16.70%, ctx=171, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8166KiB/s (8362kB/s), 817KiB/s-3137KiB/s (836kB/s-3212kB/s), io=20.0MiB (20.0MB), run=2158-2508msec WRITE: bw=11.2MiB/s (11.7MB/s), 2241KiB/s-4083KiB/s (2294kB/s-4181kB/s), io=28.0MiB (29.4MB), run=2158-2508msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=155246: Sun Sep 13 12:57:43 2026 read: IOPS=2, BW=8331KiB/s (8531kB/s)(12.0MiB/1475msec) clat (msec): min=418, max=548, avg=491.40, stdev=66.05 lat (msec): min=418, max=548, avg=491.40, stdev=66.05 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 6140, max= 8192, per=82.59%, avg=7166.00, stdev=1450.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=53.87%, ctx=2742, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155247: Sun Sep 13 12:57:43 2026 read: IOPS=0, BW=2169KiB/s (2222kB/s)(4096KiB/1888msec) clat (nsec): min=455692k, max=455692k, avg=455691689.00, stdev= 0.00 lat (nsec): min=455693k, max=455693k, avg=455693164.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 5910, max= 5910, per=68.11%, avg=5910.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4339KiB/s (4443kB/s)(8192KiB/1888msec); 0 zone resets clat (msec): min=501, max=929, avg=715.39, stdev=302.47 lat (msec): min=501, max=929, avg=715.68, stdev=302.52 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8192, max= 8192, per=47.20%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=18.23%, ctx=909, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155248: Sun Sep 13 12:57:43 2026 write: IOPS=1, BW=6578KiB/s (6736kB/s)(12.0MiB/1868msec); 0 zone resets clat (msec): min=154, max=1045, avg=622.01, stdev=446.96 lat (msec): min=155, max=1045, avg=622.33, stdev=446.96 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8192, max= 8192, per=47.20%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=20.19%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155249: Sun Sep 13 12:57:43 2026 write: IOPS=1, BW=7165KiB/s (7337kB/s)(12.0MiB/1715msec); 0 zone resets clat (msec): min=369, max=775, avg=570.98, stdev=203.26 lat (msec): min=369, max=775, avg=571.25, stdev=203.22 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8192, max= 8192, per=47.20%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.06%, sys=19.78%, ctx=92, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8678KiB/s (8886kB/s), 2169KiB/s-8331KiB/s (2222kB/s-8531kB/s), io=16.0MiB (16.8MB), run=1475-1888msec WRITE: bw=16.9MiB/s (17.8MB/s), 4339KiB/s-7165KiB/s (4443kB/s-7337kB/s), io=32.0MiB (33.6MB), run=1715-1888msec rand-rw: (groupid=0, jobs=1): err= 0: pid=155241: Sun Sep 13 12:57:43 2026 read: IOPS=6, BW=26.0MiB/s (27.3MB/s)(12.0MiB/461msec) clat (msec): min=114, max=205, avg=148.99, stdev=49.52 lat (msec): min=114, max=205, avg=149.00, stdev=49.52 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 128], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] lat (msec) : 250=100.00% cpu : usr=0.00%, sys=53.04%, ctx=63, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155242: Sun Sep 13 12:57:43 2026 read: IOPS=0, BW=2915KiB/s (2985kB/s)(4096KiB/1405msec) clat (nsec): min=262188k, max=262188k, avg=262187861.00, stdev= 0.00 lat (nsec): min=262189k, max=262189k, avg=262188704.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 7474, max= 7474, per=64.09%, avg=7474.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5831KiB/s (5971kB/s)(8192KiB/1405msec); 0 zone resets clat (msec): min=516, max=599, avg=558.08, stdev=58.94 lat (msec): min=516, max=600, avg=558.36, stdev=58.92 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8192, max= 8192, per=52.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=22.58%, ctx=164, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155243: Sun Sep 13 12:57:43 2026 write: IOPS=1, BW=5888KiB/s (6029kB/s)(12.0MiB/2087msec); 0 zone resets clat (msec): min=312, max=1205, avg=686.14, stdev=463.98 lat (msec): min=312, max=1205, avg=686.40, stdev=463.88 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.68%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=155244: Sun Sep 13 12:57:43 2026 write: IOPS=2, BW=11.7MiB/s (12.2MB/s)(12.0MiB/1030msec); 0 zone resets clat (msec): min=144, max=577, avg=340.51, stdev=219.24 lat (msec): min=144, max=577, avg=340.76, stdev=219.22 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min=15485, max=15485, per=98.62%, avg=15485.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.19%, sys=23.13%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.4MiB/s (11.9MB/s), 2915KiB/s-26.0MiB/s (2985kB/s-27.3MB/s), io=16.0MiB (16.8MB), run=461-1405msec WRITE: bw=15.3MiB/s (16.1MB/s), 5831KiB/s-11.7MiB/s (5971kB/s-12.2MB/s), io=32.0MiB (33.6MB), run=1030-2087msec