== sanity test 398b: DIO and buffer IO race ============== 22:55:40 (1772423740) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.71169 s, 18.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181761: Sun Mar 1 22:56:37 2026 read: IOPS=31, BW=124KiB/s (127kB/s)(5992KiB/48217msec) clat (usec): min=186, max=684971, avg=17723.04, stdev=19183.90 lat (usec): min=187, max=684972, avg=17723.73, stdev=19183.91 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 7635], 10.00th=[ 8717], 20.00th=[ 10421], | 30.00th=[ 11731], 40.00th=[ 13829], 50.00th=[ 15926], 60.00th=[ 18220], | 70.00th=[ 20317], 80.00th=[ 23200], 90.00th=[ 28181], 95.00th=[ 32375], | 99.00th=[ 49021], 99.50th=[ 53740], 99.90th=[ 65799], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 6, max= 192, per=25.09%, avg=123.94, stdev=29.63, samples=95 iops : min= 1, max= 48, avg=30.61, stdev= 7.47, samples=95 write: IOPS=32, BW=131KiB/s (134kB/s)(6296KiB/48217msec); 0 zone resets clat (usec): min=719, max=89710, avg=13691.90, stdev=10442.35 lat (usec): min=720, max=89711, avg=13692.76, stdev=10442.33 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2573], 10.00th=[ 3064], 20.00th=[ 3982], | 30.00th=[ 6587], 40.00th=[ 9503], 50.00th=[11469], 60.00th=[13829], | 70.00th=[17171], 80.00th=[21365], 90.00th=[27919], 95.00th=[32900], | 99.00th=[45351], 99.50th=[50594], 99.90th=[81265], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 47, max= 215, per=25.35%, avg=131.04, stdev=30.68, samples=94 iops : min= 11, max= 53, avg=32.39, stdev= 7.77, samples=94 lat (usec) : 250=0.10%, 500=0.20%, 750=0.42%, 1000=0.42% lat (msec) : 2=0.94%, 4=9.05%, 10=18.88%, 20=43.13%, 50=26.17% lat (msec) : 100=0.65%, 750=0.03% cpu : usr=0.09%, sys=24.80%, ctx=9636, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181762: Sun Mar 1 22:56:37 2026 read: IOPS=30, BW=122KiB/s (125kB/s)(5940KiB/48581msec) clat (usec): min=183, max=690779, avg=17716.42, stdev=19525.46 lat (usec): min=184, max=690780, avg=17717.03, stdev=19525.48 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 7504], 10.00th=[ 8848], 20.00th=[ 10421], | 30.00th=[ 11863], 40.00th=[ 13435], 50.00th=[ 15795], 60.00th=[ 17957], | 70.00th=[ 20317], 80.00th=[ 22938], 90.00th=[ 27657], 95.00th=[ 33162], | 99.00th=[ 47449], 99.50th=[ 51643], 99.90th=[ 94897], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 40, max= 184, per=24.92%, avg=123.09, stdev=28.13, samples=95 iops : min= 10, max= 46, avg=30.40, stdev= 7.09, samples=95 write: IOPS=32, BW=131KiB/s (134kB/s)(6348KiB/48581msec); 0 zone resets clat (usec): min=813, max=72168, avg=13960.24, stdev=10145.25 lat (usec): min=813, max=72169, avg=13960.99, stdev=10145.29 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2638], 10.00th=[ 3130], 20.00th=[ 4015], | 30.00th=[ 6783], 40.00th=[ 9896], 50.00th=[11994], 60.00th=[14484], | 70.00th=[17957], 80.00th=[21890], 90.00th=[27919], 95.00th=[32900], | 99.00th=[44827], 99.50th=[49546], 99.90th=[66847], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 71, max= 215, per=25.34%, avg=131.01, stdev=30.02, samples=95 iops : min= 17, max= 53, avg=32.38, stdev= 7.52, samples=95 lat (usec) : 250=0.07%, 500=0.29%, 750=0.55%, 1000=0.20% lat (msec) : 2=0.94%, 4=9.24%, 10=17.87%, 20=42.84%, 50=27.47% lat (msec) : 100=0.49%, 750=0.03% cpu : usr=0.10%, sys=24.65%, ctx=9677, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181763: Sun Mar 1 22:56:37 2026 read: IOPS=31, BW=125KiB/s (128kB/s)(6028KiB/48193msec) clat (usec): min=201, max=80491, avg=16866.50, stdev=8436.20 lat (usec): min=202, max=80492, avg=16868.73, stdev=8435.83 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 7046], 10.00th=[ 8586], 20.00th=[10421], | 30.00th=[11994], 40.00th=[13566], 50.00th=[15401], 60.00th=[17433], | 70.00th=[20055], 80.00th=[22676], 90.00th=[26608], 95.00th=[31851], | 99.00th=[43779], 99.50th=[50070], 99.90th=[71828], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 39, max= 184, per=25.55%, avg=126.20, stdev=28.99, samples=94 iops : min= 9, max= 46, avg=31.18, stdev= 7.34, samples=94 write: IOPS=32, BW=130KiB/s (133kB/s)(6260KiB/48193msec); 0 zone resets clat (usec): min=721, max=696531, avg=14481.91, stdev=20183.03 lat (usec): min=721, max=696533, avg=14483.08, stdev=20182.91 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2573], 10.00th=[ 3097], 20.00th=[ 3916], | 30.00th=[ 6521], 40.00th=[ 9765], 50.00th=[ 11994], 60.00th=[ 14484], | 70.00th=[ 17957], 80.00th=[ 22414], 90.00th=[ 28705], 95.00th=[ 34341], | 99.00th=[ 45876], 99.50th=[ 56361], 99.90th=[ 71828], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 63, max= 200, per=25.26%, avg=130.62, stdev=34.69, samples=94 iops : min= 15, max= 50, avg=32.29, stdev= 8.72, samples=94 lat (usec) : 250=0.03%, 500=0.26%, 750=0.81%, 1000=0.23% lat (msec) : 2=0.94%, 4=9.47%, 10=17.87%, 20=43.23%, 50=26.50% lat (msec) : 100=0.62%, 750=0.03% cpu : usr=0.07%, sys=24.74%, ctx=9727, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181764: Sun Mar 1 22:56:37 2026 read: IOPS=31, BW=126KiB/s (129kB/s)(6052KiB/48005msec) clat (usec): min=182, max=80287, avg=17191.46, stdev=8460.18 lat (usec): min=183, max=80287, avg=17192.10, stdev=8460.27 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 7504], 10.00th=[ 8848], 20.00th=[10683], | 30.00th=[12125], 40.00th=[13829], 50.00th=[16057], 60.00th=[18220], | 70.00th=[20317], 80.00th=[22676], 90.00th=[27132], 95.00th=[31065], | 99.00th=[43779], 99.50th=[52167], 99.90th=[77071], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 72, max= 192, per=25.75%, avg=127.22, stdev=26.35, samples=94 iops : min= 18, max= 48, avg=31.44, stdev= 6.61, samples=94 write: IOPS=32, BW=130KiB/s (133kB/s)(6236KiB/48005msec); 0 zone resets clat (usec): min=769, max=698884, avg=14040.18, stdev=20097.43 lat (usec): min=769, max=698885, avg=14041.01, stdev=20097.46 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2671], 10.00th=[ 3130], 20.00th=[ 3916], | 30.00th=[ 6783], 40.00th=[ 9503], 50.00th=[ 11600], 60.00th=[ 13960], | 70.00th=[ 17433], 80.00th=[ 21103], 90.00th=[ 27132], 95.00th=[ 32637], | 99.00th=[ 45876], 99.50th=[ 52167], 99.90th=[ 96994], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 64, max= 223, per=25.37%, avg=131.14, stdev=32.77, samples=94 iops : min= 16, max= 55, avg=32.41, stdev= 8.26, samples=94 lat (usec) : 250=0.03%, 500=0.36%, 750=0.75%, 1000=0.20% lat (msec) : 2=1.07%, 4=9.57%, 10=17.25%, 20=44.24%, 50=25.98% lat (msec) : 100=0.52%, 750=0.03% cpu : usr=0.11%, sys=24.77%, ctx=9690, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=494KiB/s (506kB/s), 122KiB/s-126KiB/s (125kB/s-129kB/s), io=23.4MiB (24.6MB), run=48005-48581msec WRITE: bw=517KiB/s (530kB/s), 130KiB/s-131KiB/s (133kB/s-134kB/s), io=24.6MiB (25.7MB), run=48005-48581msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181756: Sun Mar 1 22:56:44 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(5992KiB/55035msec) clat (msec): min=2, max=689, avg=15.67, stdev=20.83 lat (msec): min=2, max=689, avg=15.67, stdev=20.83 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 32], 95.00th=[ 39], | 99.00th=[ 57], 99.50th=[ 64], 99.90th=[ 82], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 31, max= 352, per=25.20%, avg=109.37, stdev=72.65, samples=108 iops : min= 7, max= 88, avg=26.98, stdev=18.30, samples=108 write: IOPS=28, BW=114KiB/s (117kB/s)(6296KiB/55035msec); 0 zone resets clat (msec): min=4, max=155, avg=19.93, stdev=13.81 lat (msec): min=4, max=155, avg=19.94, stdev=13.81 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 66], 99.50th=[ 74], 99.90th=[ 85], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 32, max= 376, per=25.30%, avg=114.84, stdev=73.25, samples=108 iops : min= 8, max= 94, avg=28.35, stdev=18.43, samples=108 lat (msec) : 4=0.88%, 10=33.85%, 20=32.65%, 50=29.92%, 100=2.64% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=13.83%, ctx=6540, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181757: Sun Mar 1 22:56:44 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(5940KiB/55265msec) clat (msec): min=2, max=692, avg=15.99, stdev=21.26 lat (msec): min=2, max=692, avg=15.99, stdev=21.26 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 33], 95.00th=[ 41], | 99.00th=[ 58], 99.50th=[ 69], 99.90th=[ 79], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 15, max= 368, per=24.98%, avg=108.42, stdev=74.77, samples=109 iops : min= 3, max= 92, avg=26.75, stdev=18.83, samples=109 write: IOPS=28, BW=115KiB/s (118kB/s)(6348KiB/55265msec); 0 zone resets clat (msec): min=3, max=156, avg=19.74, stdev=13.89 lat (msec): min=3, max=156, avg=19.74, stdev=13.90 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 38], 95.00th=[ 45], | 99.00th=[ 69], 99.50th=[ 77], 99.90th=[ 90], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 32, max= 360, per=25.52%, avg=115.85, stdev=75.10, samples=109 iops : min= 8, max= 90, avg=28.61, stdev=18.90, samples=109 lat (msec) : 4=0.98%, 10=34.34%, 20=31.32%, 50=30.92%, 100=2.38% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=13.72%, ctx=6322, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181758: Sun Mar 1 22:56:44 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6028KiB/55149msec) clat (usec): min=2822, max=97579, avg=15235.10, stdev=11711.87 lat (usec): min=2823, max=97580, avg=15235.78, stdev=11711.94 clat percentiles (usec): | 1.00th=[ 3687], 5.00th=[ 4621], 10.00th=[ 5014], 20.00th=[ 5800], | 30.00th=[ 7635], 40.00th=[ 9896], 50.00th=[11731], 60.00th=[13960], | 70.00th=[16909], 80.00th=[21890], 90.00th=[32113], 95.00th=[39060], | 99.00th=[57410], 99.50th=[66323], 99.90th=[84411], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 31, max= 368, per=25.25%, avg=109.57, stdev=74.09, samples=108 iops : min= 7, max= 92, avg=27.04, stdev=18.65, samples=108 write: IOPS=28, BW=114KiB/s (116kB/s)(6260KiB/55149msec); 0 zone resets clat (msec): min=4, max=686, avg=20.45, stdev=21.69 lat (msec): min=4, max=686, avg=20.45, stdev=21.69 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 65], 99.50th=[ 74], 99.90th=[ 121], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 40, max= 344, per=24.99%, avg=113.44, stdev=70.58, samples=108 iops : min= 10, max= 86, avg=28.00, stdev=17.79, samples=108 lat (msec) : 4=0.62%, 10=34.60%, 20=31.77%, 50=30.21%, 100=2.73% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=13.78%, ctx=6417, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181759: Sun Mar 1 22:56:44 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6052KiB/55297msec) clat (usec): min=2673, max=71989, avg=15159.07, stdev=11419.19 lat (usec): min=2674, max=71989, avg=15159.73, stdev=11419.24 clat percentiles (usec): | 1.00th=[ 3589], 5.00th=[ 4490], 10.00th=[ 5014], 20.00th=[ 5735], | 30.00th=[ 7242], 40.00th=[ 9634], 50.00th=[11600], 60.00th=[13960], | 70.00th=[17171], 80.00th=[22938], 90.00th=[31589], 95.00th=[39060], | 99.00th=[55313], 99.50th=[60031], 99.90th=[67634], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 23, max= 344, per=25.41%, avg=110.27, stdev=73.16, samples=109 iops : min= 5, max= 86, avg=27.21, stdev=18.41, samples=109 write: IOPS=28, BW=113KiB/s (115kB/s)(6236KiB/55297msec); 0 zone resets clat (msec): min=4, max=692, avg=20.64, stdev=22.34 lat (msec): min=4, max=692, avg=20.64, stdev=22.34 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 40], 95.00th=[ 48], | 99.00th=[ 69], 99.50th=[ 83], 99.90th=[ 144], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 48, max= 344, per=25.00%, avg=113.50, stdev=72.78, samples=109 iops : min= 12, max= 86, avg=28.02, stdev=18.34, samples=109 lat (msec) : 4=1.17%, 10=34.67%, 20=31.35%, 50=29.88%, 100=2.80% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=13.72%, ctx=6447, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=434KiB/s (445kB/s), 107KiB/s-109KiB/s (110kB/s-112kB/s), io=23.4MiB (24.6MB), run=55035-55297msec WRITE: bw=455KiB/s (466kB/s), 113KiB/s-115KiB/s (115kB/s-118kB/s), io=24.6MiB (25.7MB), run=55035-55297msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181787: Sun Mar 1 22:57:03 2026 read: IOPS=28, BW=458KiB/s (469kB/s)(5920KiB/12926msec) clat (usec): min=406, max=57312, avg=17706.32, stdev=8860.20 lat (usec): min=424, max=57312, avg=17706.91, stdev=8860.11 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 783], 10.00th=[ 8717], 20.00th=[11076], | 30.00th=[13173], 40.00th=[15008], 50.00th=[16712], 60.00th=[18482], | 70.00th=[20579], 80.00th=[24249], 90.00th=[29230], 95.00th=[33424], | 99.00th=[45876], 99.50th=[55313], 99.90th=[57410], 99.95th=[57410], | 99.99th=[57410] bw ( KiB/s): min= 288, max= 670, per=25.08%, avg=454.36, stdev=96.50, samples=25 iops : min= 18, max= 41, avg=27.76, stdev= 6.00, samples=25 write: IOPS=30, BW=493KiB/s (504kB/s)(6368KiB/12926msec); 0 zone resets clat (usec): min=1313, max=59439, avg=15792.99, stdev=9798.57 lat (usec): min=1314, max=59440, avg=15793.97, stdev=9798.60 clat percentiles (usec): | 1.00th=[ 3195], 5.00th=[ 4293], 10.00th=[ 4621], 20.00th=[ 6259], | 30.00th=[ 8979], 40.00th=[11338], 50.00th=[13566], 60.00th=[16581], | 70.00th=[20579], 80.00th=[24511], 90.00th=[29230], 95.00th=[34866], | 99.00th=[43779], 99.50th=[46924], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 159, max= 640, per=25.87%, avg=493.36, stdev=107.21, samples=25 iops : min= 9, max= 40, avg=30.20, stdev= 6.75, samples=25 lat (usec) : 500=0.65%, 750=1.69%, 1000=0.13% lat (msec) : 2=0.52%, 4=1.69%, 10=19.66%, 20=43.75%, 50=31.51% lat (msec) : 100=0.39% cpu : usr=0.02%, sys=27.79%, ctx=2822, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181788: Sun Mar 1 22:57:03 2026 read: IOPS=27, BW=444KiB/s (455kB/s)(5744KiB/12936msec) clat (usec): min=289, max=57895, avg=18240.89, stdev=8108.47 lat (usec): min=290, max=57896, avg=18241.44, stdev=8108.45 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 8455], 10.00th=[ 9896], 20.00th=[11863], | 30.00th=[13566], 40.00th=[15270], 50.00th=[17171], 60.00th=[19006], | 70.00th=[21627], 80.00th=[23987], 90.00th=[27657], 95.00th=[30540], | 99.00th=[48497], 99.50th=[51643], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 286, max= 636, per=24.62%, avg=446.20, stdev=93.74, samples=25 iops : min= 17, max= 39, avg=27.24, stdev= 5.80, samples=25 write: IOPS=31, BW=506KiB/s (518kB/s)(6544KiB/12936msec); 0 zone resets clat (usec): min=1285, max=52410, avg=15560.35, stdev=9855.66 lat (usec): min=1285, max=52411, avg=15561.84, stdev=9855.86 clat percentiles (usec): | 1.00th=[ 2802], 5.00th=[ 4228], 10.00th=[ 5014], 20.00th=[ 7242], | 30.00th=[ 9503], 40.00th=[11338], 50.00th=[13042], 60.00th=[15139], | 70.00th=[17957], 80.00th=[22938], 90.00th=[29754], 95.00th=[35914], | 99.00th=[45876], 99.50th=[47449], 99.90th=[52167], 99.95th=[52167], | 99.99th=[52167] bw ( KiB/s): min= 351, max= 670, per=26.45%, avg=504.40, stdev=87.32, samples=25 iops : min= 21, max= 41, avg=30.88, stdev= 5.43, samples=25 lat (usec) : 500=0.39%, 750=0.91%, 1000=0.13% lat (msec) : 2=0.39%, 4=1.82%, 10=18.49%, 20=46.74%, 50=30.60% lat (msec) : 100=0.52% cpu : usr=0.09%, sys=28.08%, ctx=3146, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181789: Sun Mar 1 22:57:03 2026 read: IOPS=29, BW=473KiB/s (485kB/s)(6256KiB/13214msec) clat (usec): min=338, max=50357, avg=17917.53, stdev=7999.86 lat (usec): min=338, max=50358, avg=17918.13, stdev=7999.88 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 7635], 10.00th=[ 9634], 20.00th=[11731], | 30.00th=[13566], 40.00th=[15139], 50.00th=[16712], 60.00th=[19268], | 70.00th=[21103], 80.00th=[23725], 90.00th=[27919], 95.00th=[32375], | 99.00th=[42206], 99.50th=[43779], 99.90th=[50594], 99.95th=[50594], | 99.99th=[50594] bw ( KiB/s): min= 318, max= 669, per=26.24%, avg=475.42, stdev=84.83, samples=26 iops : min= 19, max= 41, avg=29.12, stdev= 5.21, samples=26 write: IOPS=28, BW=456KiB/s (467kB/s)(6032KiB/13214msec); 0 zone resets clat (usec): min=1045, max=51743, avg=16284.32, stdev=9798.84 lat (usec): min=1046, max=51744, avg=16285.32, stdev=9798.80 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 4080], 10.00th=[ 4948], 20.00th=[ 7046], | 30.00th=[ 9634], 40.00th=[12387], 50.00th=[14746], 60.00th=[16909], | 70.00th=[20579], 80.00th=[23725], 90.00th=[29230], 95.00th=[34866], | 99.00th=[42730], 99.50th=[47973], 99.90th=[51643], 99.95th=[51643], | 99.99th=[51643] bw ( KiB/s): min= 223, max= 736, per=23.80%, avg=453.81, stdev=122.20, samples=26 iops : min= 13, max= 46, avg=27.73, stdev= 7.83, samples=26 lat (usec) : 500=0.65%, 750=1.30% lat (msec) : 2=0.65%, 4=1.69%, 10=16.80%, 20=44.40%, 50=34.24% lat (msec) : 100=0.26% cpu : usr=0.05%, sys=27.08%, ctx=2956, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181790: Sun Mar 1 22:57:03 2026 read: IOPS=29, BW=466KiB/s (477kB/s)(6032KiB/12954msec) clat (usec): min=293, max=58343, avg=17816.98, stdev=8498.27 lat (usec): min=293, max=58343, avg=17817.56, stdev=8498.28 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 660], 10.00th=[ 9372], 20.00th=[11863], | 30.00th=[13566], 40.00th=[15139], 50.00th=[17433], 60.00th=[19268], | 70.00th=[21103], 80.00th=[23462], 90.00th=[27395], 95.00th=[32113], | 99.00th=[46400], 99.50th=[56886], 99.90th=[58459], 99.95th=[58459], | 99.99th=[58459] bw ( KiB/s): min= 223, max= 640, per=25.53%, avg=462.52, stdev=89.36, samples=25 iops : min= 13, max= 40, avg=28.28, stdev= 5.68, samples=25 write: IOPS=30, BW=483KiB/s (495kB/s)(6256KiB/12954msec); 0 zone resets clat (usec): min=1168, max=55310, avg=15739.26, stdev=9918.74 lat (usec): min=1169, max=55311, avg=15746.24, stdev=9918.50 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 4424], 10.00th=[ 4948], 20.00th=[ 6390], | 30.00th=[ 9372], 40.00th=[11207], 50.00th=[13173], 60.00th=[16188], | 70.00th=[20317], 80.00th=[23200], 90.00th=[28967], 95.00th=[34866], | 99.00th=[51643], 99.50th=[54264], 99.90th=[55313], 99.95th=[55313], | 99.99th=[55313] bw ( KiB/s): min= 319, max= 667, per=25.29%, avg=482.20, stdev=96.17, samples=25 iops : min= 19, max= 41, avg=29.48, stdev= 6.03, samples=25 lat (usec) : 500=0.91%, 750=1.56%, 1000=0.13% lat (msec) : 2=0.13%, 4=1.69%, 10=18.36%, 20=44.14%, 50=32.29% lat (msec) : 100=0.78% cpu : usr=0.09%, sys=27.93%, ctx=2967, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1813KiB/s (1856kB/s), 444KiB/s-473KiB/s (455kB/s-485kB/s), io=23.4MiB (24.5MB), run=12926-13214msec WRITE: bw=1907KiB/s (1953kB/s), 456KiB/s-506KiB/s (467kB/s-518kB/s), io=24.6MiB (25.8MB), run=12926-13214msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181782: Sun Mar 1 22:57:04 2026 read: IOPS=24, BW=400KiB/s (409kB/s)(5920KiB/14813msec) clat (usec): min=3660, max=57321, avg=17860.28, stdev=11080.52 lat (usec): min=3661, max=57322, avg=17860.84, stdev=11080.50 clat percentiles (usec): | 1.00th=[ 4621], 5.00th=[ 6194], 10.00th=[ 7177], 20.00th=[ 9110], | 30.00th=[10683], 40.00th=[12256], 50.00th=[13960], 60.00th=[16057], | 70.00th=[20579], 80.00th=[26608], 90.00th=[35390], 95.00th=[41157], | 99.00th=[51119], 99.50th=[51643], 99.90th=[57410], 99.95th=[57410], | 99.99th=[57410] bw ( KiB/s): min= 192, max= 928, per=24.65%, avg=392.90, stdev=172.45, samples=29 iops : min= 12, max= 58, avg=24.14, stdev=10.86, samples=29 write: IOPS=26, BW=430KiB/s (440kB/s)(6368KiB/14813msec); 0 zone resets clat (usec): min=4477, max=77339, avg=20498.69, stdev=11276.62 lat (usec): min=4478, max=77340, avg=20500.03, stdev=11276.83 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 7308], 10.00th=[ 8225], 20.00th=[10421], | 30.00th=[12649], 40.00th=[15270], 50.00th=[17957], 60.00th=[21365], | 70.00th=[25035], 80.00th=[29492], 90.00th=[35390], 95.00th=[41157], | 99.00th=[54789], 99.50th=[65799], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 191, max= 1056, per=25.47%, avg=427.31, stdev=178.96, samples=29 iops : min= 11, max= 66, avg=26.28, stdev=11.36, samples=29 lat (msec) : 4=0.26%, 10=21.48%, 20=39.97%, 50=36.85%, 100=1.43% cpu : usr=0.11%, sys=14.44%, ctx=1759, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181783: Sun Mar 1 22:57:04 2026 read: IOPS=23, BW=383KiB/s (392kB/s)(5744KiB/14986msec) clat (usec): min=3452, max=69981, avg=17909.55, stdev=11803.33 lat (usec): min=3452, max=69981, avg=17910.07, stdev=11803.33 clat percentiles (usec): | 1.00th=[ 3949], 5.00th=[ 5342], 10.00th=[ 6915], 20.00th=[ 8717], | 30.00th=[10290], 40.00th=[11863], 50.00th=[13960], 60.00th=[16450], | 70.00th=[20841], 80.00th=[27132], 90.00th=[35914], 95.00th=[39584], | 99.00th=[58983], 99.50th=[62129], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 223, max= 768, per=23.63%, avg=376.69, stdev=142.44, samples=29 iops : min= 13, max= 48, avg=23.10, stdev= 9.04, samples=29 write: IOPS=27, BW=437KiB/s (447kB/s)(6544KiB/14986msec); 0 zone resets clat (usec): min=4946, max=67958, avg=20880.32, stdev=12356.59 lat (usec): min=4947, max=67958, avg=20881.55, stdev=12356.95 clat percentiles (usec): | 1.00th=[ 5735], 5.00th=[ 6980], 10.00th=[ 8160], 20.00th=[10159], | 30.00th=[12518], 40.00th=[14353], 50.00th=[17171], 60.00th=[21627], | 70.00th=[25560], 80.00th=[30540], 90.00th=[38536], 95.00th=[44827], | 99.00th=[61604], 99.50th=[62129], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 223, max= 1120, per=25.06%, avg=420.45, stdev=189.47, samples=29 iops : min= 13, max= 70, avg=25.86, stdev=11.98, samples=29 lat (msec) : 4=0.52%, 10=22.27%, 20=39.45%, 50=35.42%, 100=2.34% cpu : usr=0.11%, sys=14.03%, ctx=1771, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181784: Sun Mar 1 22:57:04 2026 read: IOPS=26, BW=417KiB/s (427kB/s)(6256KiB/15017msec) clat (usec): min=3560, max=59994, avg=17595.30, stdev=11167.08 lat (usec): min=3561, max=59995, avg=17595.85, stdev=11167.08 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5866], 10.00th=[ 7242], 20.00th=[ 8586], | 30.00th=[10421], 40.00th=[11863], 50.00th=[13698], 60.00th=[15926], | 70.00th=[20317], 80.00th=[27132], 90.00th=[33817], 95.00th=[40633], | 99.00th=[53216], 99.50th=[58459], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 223, max= 960, per=25.77%, avg=410.83, stdev=192.43, samples=29 iops : min= 13, max= 60, avg=25.24, stdev=12.17, samples=29 write: IOPS=25, BW=402KiB/s (411kB/s)(6032KiB/15017msec); 0 zone resets clat (usec): min=4886, max=71083, avg=21501.71, stdev=12678.74 lat (usec): min=4887, max=71085, avg=21502.86, stdev=12678.79 clat percentiles (usec): | 1.00th=[ 5276], 5.00th=[ 7111], 10.00th=[ 8094], 20.00th=[10683], | 30.00th=[12911], 40.00th=[15139], 50.00th=[17695], 60.00th=[22152], | 70.00th=[26084], 80.00th=[31589], 90.00th=[39060], 95.00th=[45351], | 99.00th=[62653], 99.50th=[69731], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 192, max= 832, per=22.83%, avg=383.03, stdev=134.59, samples=29 iops : min= 12, max= 52, avg=23.52, stdev= 8.50, samples=29 lat (msec) : 4=0.26%, 10=21.22%, 20=40.62%, 50=35.55%, 100=2.34% cpu : usr=0.06%, sys=14.16%, ctx=1734, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181785: Sun Mar 1 22:57:04 2026 read: IOPS=25, BW=404KiB/s (414kB/s)(6032KiB/14917msec) clat (usec): min=3994, max=65004, avg=17227.80, stdev=11264.01 lat (usec): min=3995, max=65005, avg=17228.36, stdev=11264.02 clat percentiles (usec): | 1.00th=[ 4178], 5.00th=[ 5407], 10.00th=[ 6325], 20.00th=[ 8455], | 30.00th=[10290], 40.00th=[11600], 50.00th=[13304], 60.00th=[16319], | 70.00th=[20317], 80.00th=[24511], 90.00th=[33817], 95.00th=[40633], | 99.00th=[57410], 99.50th=[62653], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 191, max= 1024, per=24.72%, avg=394.03, stdev=175.53, samples=29 iops : min= 11, max= 64, avg=24.21, stdev=11.00, samples=29 write: IOPS=26, BW=419KiB/s (429kB/s)(6256KiB/14917msec); 0 zone resets clat (usec): min=6007, max=69927, avg=21442.54, stdev=12463.03 lat (usec): min=6008, max=69927, avg=21443.77, stdev=12463.08 clat percentiles (usec): | 1.00th=[ 6194], 5.00th=[ 7832], 10.00th=[ 8848], 20.00th=[11076], | 30.00th=[12911], 40.00th=[14877], 50.00th=[18220], 60.00th=[21627], | 70.00th=[25822], 80.00th=[30016], 90.00th=[37487], 95.00th=[45876], | 99.00th=[65799], 99.50th=[67634], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 191, max= 736, per=24.58%, avg=412.38, stdev=132.43, samples=29 iops : min= 11, max= 46, avg=25.34, stdev= 8.44, samples=29 lat (msec) : 4=0.13%, 10=21.35%, 20=40.36%, 50=35.29%, 100=2.86% cpu : usr=0.10%, sys=14.56%, ctx=1849, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1595KiB/s (1633kB/s), 383KiB/s-417KiB/s (392kB/s-427kB/s), io=23.4MiB (24.5MB), run=14813-15017msec WRITE: bw=1678KiB/s (1718kB/s), 402KiB/s-437KiB/s (411kB/s-447kB/s), io=24.6MiB (25.8MB), run=14813-15017msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181797: Sun Mar 1 22:57:13 2026 read: IOPS=2, BW=2633KiB/s (2697kB/s)(7168KiB/2722msec) clat (usec): min=854, max=189905, avg=103900.55, stdev=60569.55 lat (usec): min=855, max=189906, avg=103901.65, stdev=60569.52 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[ 71828], | 30.00th=[ 91751], 40.00th=[ 91751], 50.00th=[ 93848], 60.00th=[132645], | 70.00th=[132645], 80.00th=[147850], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 2007, max= 5120, per=46.24%, avg=2805.75, stdev=1542.95, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=1, BW=1881KiB/s (1926kB/s)(5120KiB/2722msec); 0 zone resets clat (msec): min=145, max=673, avg=397.03, stdev=240.67 lat (msec): min=145, max=673, avg=397.09, stdev=240.67 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2007, max= 2048, per=23.99%, avg=2037.75, stdev=20.50, samples=4 iops : min= 1, max= 2, avg= 1.75, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=40.54%, ctx=1230, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181798: Sun Mar 1 22:57:13 2026 read: IOPS=0, BW=607KiB/s (621kB/s)(2048KiB/3375msec) clat (msec): min=199, max=730, avg=464.68, stdev=375.45 lat (msec): min=199, max=730, avg=464.68, stdev=375.45 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2048, max= 2048, per=33.75%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3034KiB/s (3107kB/s)(10.0MiB/3375msec); 0 zone resets clat (msec): min=122, max=539, avg=241.83, stdev=140.73 lat (msec): min=123, max=539, avg=241.89, stdev=140.72 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 126], | 30.00th=[ 140], 40.00th=[ 169], 50.00th=[ 178], 60.00th=[ 184], | 70.00th=[ 228], 80.00th=[ 313], 90.00th=[ 422], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2007, max= 6144, per=38.48%, avg=3268.60, stdev=1838.74, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 2.00, samples=5 lat (msec) : 250=66.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=44.64%, ctx=702, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181799: Sun Mar 1 22:57:13 2026 read: IOPS=2, BW=2812KiB/s (2879kB/s)(6144KiB/2185msec) clat (usec): min=894, max=257874, avg=90875.56, stdev=109433.83 lat (usec): min=896, max=257875, avg=90876.57, stdev=109433.60 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 914], | 30.00th=[ 914], 40.00th=[ 6915], 50.00th=[ 6915], 60.00th=[ 93848], | 70.00th=[183501], 80.00th=[183501], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 4015, max= 6144, per=83.71%, avg=5079.50, stdev=1505.43, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2812KiB/s (2879kB/s)(6144KiB/2185msec); 0 zone resets clat (msec): min=130, max=897, avg=268.02, stdev=308.51 lat (msec): min=130, max=897, avg=268.08, stdev=308.52 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 146], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2007, max= 4096, per=40.02%, avg=3399.67, stdev=1206.08, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 lat (usec) : 1000=16.67% lat (msec) : 10=8.33%, 100=8.33%, 250=50.00%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=42.26%, ctx=432, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181800: Sun Mar 1 22:57:13 2026 read: IOPS=1, BW=1962KiB/s (2010kB/s)(5120KiB/2609msec) clat (usec): min=1040, max=197114, avg=94398.63, stdev=88712.13 lat (usec): min=1042, max=197115, avg=94399.75, stdev=88712.15 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 2704], 40.00th=[ 2704], 50.00th=[121111], 60.00th=[121111], | 70.00th=[149947], 80.00th=[149947], 90.00th=[196084], 95.00th=[196084], | 99.00th=[196084], 99.50th=[196084], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2747KiB/s (2813kB/s)(7168KiB/2609msec); 0 zone resets clat (msec): min=107, max=914, avg=295.23, stdev=281.70 lat (msec): min=107, max=915, avg=295.29, stdev=281.70 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 155], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 194], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 330], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 2048, max= 4015, per=31.83%, avg=2703.67, stdev=1135.65, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 2=8.33%, 4=8.33%, 250=66.67%, 500=8.33%, 1000=8.33% cpu : usr=0.08%, sys=40.11%, ctx=372, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6068KiB/s (6214kB/s), 607KiB/s-2812KiB/s (621kB/s-2879kB/s), io=20.0MiB (20.0MB), run=2185-3375msec WRITE: bw=8495KiB/s (8699kB/s), 1881KiB/s-3034KiB/s (1926kB/s-3107kB/s), io=28.0MiB (29.4MB), run=2185-3375msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181802: Sun Mar 1 22:57:13 2026 read: IOPS=2, BW=2221KiB/s (2274kB/s)(7168KiB/3228msec) clat (msec): min=49, max=310, avg=109.15, stdev=90.16 lat (msec): min=49, max=310, avg=109.15, stdev=90.16 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 66], | 30.00th=[ 71], 40.00th=[ 71], 50.00th=[ 79], 60.00th=[ 91], | 70.00th=[ 91], 80.00th=[ 99], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1973, max= 5111, per=46.76%, avg=2779.00, stdev=1555.02, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1586KiB/s (1624kB/s)(5120KiB/3228msec); 0 zone resets clat (msec): min=129, max=1016, avg=487.94, stdev=347.24 lat (msec): min=129, max=1016, avg=488.01, stdev=347.24 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1984, max= 3946, per=30.13%, avg=2506.50, stdev=960.14, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=8.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=12.98%, ctx=244, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181803: Sun Mar 1 22:57:13 2026 read: IOPS=0, BW=599KiB/s (614kB/s)(2048KiB/3417msec) clat (msec): min=66, max=643, avg=354.97, stdev=407.53 lat (msec): min=66, max=643, avg=354.97, stdev=407.53 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 67], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1910, max= 1973, per=32.67%, avg=1941.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2997KiB/s (3069kB/s)(10.0MiB/3417msec); 0 zone resets clat (msec): min=28, max=612, avg=261.44, stdev=216.74 lat (msec): min=28, max=613, avg=261.51, stdev=216.73 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 29], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 59], 40.00th=[ 129], 50.00th=[ 230], 60.00th=[ 232], | 70.00th=[ 253], 80.00th=[ 477], 90.00th=[ 558], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1984, max= 4096, per=36.28%, avg=3018.50, stdev=1159.50, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 50=16.67%, 100=16.67%, 250=25.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=16.63%, ctx=145, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181804: Sun Mar 1 22:57:13 2026 read: IOPS=1, BW=1928KiB/s (1975kB/s)(6144KiB/3186msec) clat (msec): min=44, max=364, avg=164.95, stdev=132.47 lat (msec): min=44, max=364, avg=164.95, stdev=132.47 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 136], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2048, max= 5919, per=56.17%, avg=3338.33, stdev=2234.92, samples=3 iops : min= 2, max= 5, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1928KiB/s (1975kB/s)(6144KiB/3186msec); 0 zone resets clat (msec): min=95, max=1176, avg=350.49, stdev=420.65 lat (msec): min=95, max=1176, avg=350.56, stdev=420.67 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 180], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1984, max= 4096, per=36.28%, avg=3018.50, stdev=1159.50, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=16.04%, ctx=130, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181805: Sun Mar 1 22:57:13 2026 read: IOPS=1, BW=1486KiB/s (1521kB/s)(5120KiB/3446msec) clat (msec): min=15, max=282, avg=154.24, stdev=109.16 lat (msec): min=15, max=282, avg=154.24, stdev=109.15 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 16], 10.00th=[ 16], 20.00th=[ 16], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 2048, max= 5919, per=67.03%, avg=3983.50, stdev=2737.21, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2080KiB/s (2130kB/s)(7168KiB/3446msec); 0 zone resets clat (msec): min=47, max=1170, avg=369.11, stdev=389.08 lat (msec): min=47, max=1170, avg=369.18, stdev=389.10 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 71], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 262], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 477], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1984, max= 4096, per=32.56%, avg=2709.33, stdev=1201.31, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 20=8.33%, 50=8.33%, 100=16.67%, 250=25.00%, 500=33.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=13.93%, ctx=164, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5943KiB/s (6086kB/s), 599KiB/s-2221KiB/s (614kB/s-2274kB/s), io=20.0MiB (20.0MB), run=3186-3446msec WRITE: bw=8320KiB/s (8520kB/s), 1586KiB/s-2997KiB/s (1624kB/s-3069kB/s), io=28.0MiB (29.4MB), run=3186-3446msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181811: Sun Mar 1 22:57:21 2026 read: IOPS=2, BW=10.1MiB/s (10.6MB/s)(12.0MiB/1184msec) clat (msec): min=370, max=402, avg=382.74, stdev=17.27 lat (msec): min=370, max=402, avg=382.74, stdev=17.27 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7236, max= 8192, per=66.01%, avg=7714.00, stdev=675.99, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=52.58%, ctx=2809, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181812: Sun Mar 1 22:57:21 2026 read: IOPS=0, BW=2922KiB/s (2992kB/s)(4096KiB/1402msec) clat (nsec): min=366911k, max=366911k, avg=366911048.00, stdev= 0.00 lat (nsec): min=366912k, max=366912k, avg=366912053.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7249, max= 7249, per=62.03%, avg=7249.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5843KiB/s (5983kB/s)(8192KiB/1402msec); 0 zone resets clat (msec): min=316, max=679, avg=498.41, stdev=256.56 lat (msec): min=317, max=680, avg=498.67, stdev=256.63 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8192, max= 8192, per=44.03%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=21.91%, ctx=903, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181813: Sun Mar 1 22:57:21 2026 write: IOPS=1, BW=6978KiB/s (7145kB/s)(12.0MiB/1761msec); 0 zone resets clat (msec): min=128, max=1221, avg=573.59, stdev=573.90 lat (msec): min=128, max=1223, avg=574.63, stdev=575.18 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8143, max= 8143, per=43.76%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=16.14%, ctx=182, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181814: Sun Mar 1 22:57:21 2026 write: IOPS=2, BW=8885KiB/s (9098kB/s)(12.0MiB/1383msec); 0 zone resets clat (msec): min=209, max=918, avg=456.52, stdev=400.74 lat (msec): min=209, max=919, avg=456.87, stdev=400.69 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min=15255, max=15255, per=81.99%, avg=15255.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.07%, sys=18.67%, ctx=169, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.4MiB/s (11.0MB/s), 2922KiB/s-10.1MiB/s (2992kB/s-10.6MB/s), io=16.0MiB (16.8MB), run=1184-1402msec WRITE: bw=18.2MiB/s (19.1MB/s), 5843KiB/s-8885KiB/s (5983kB/s-9098kB/s), io=32.0MiB (33.6MB), run=1383-1761msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181815: Sun Mar 1 22:57:21 2026 read: IOPS=2, BW=10.5MiB/s (11.0MB/s)(12.0MiB/1143msec) clat (msec): min=348, max=380, avg=366.54, stdev=16.37 lat (msec): min=348, max=380, avg=366.54, stdev=16.37 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7846, max= 8192, per=81.35%, avg=8019.00, stdev=244.66, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=22.24%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181816: Sun Mar 1 22:57:21 2026 read: IOPS=0, BW=2465KiB/s (2524kB/s)(4096KiB/1662msec) clat (nsec): min=892626k, max=892626k, avg=892626102.00, stdev= 0.00 lat (nsec): min=892627k, max=892627k, avg=892626837.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=83.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4929KiB/s (5047kB/s)(8192KiB/1662msec); 0 zone resets clat (msec): min=319, max=392, avg=356.22, stdev=51.70 lat (msec): min=319, max=393, avg=356.51, stdev=51.68 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 8175, max= 8175, per=41.46%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.06%, sys=14.21%, ctx=41, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181817: Sun Mar 1 22:57:21 2026 write: IOPS=1, BW=7738KiB/s (7924kB/s)(12.0MiB/1588msec); 0 zone resets clat (msec): min=134, max=771, avg=512.72, stdev=334.69 lat (msec): min=135, max=772, avg=513.00, stdev=334.71 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8175, max= 8192, per=41.51%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=17.96%, ctx=105, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181818: Sun Mar 1 22:57:21 2026 write: IOPS=2, BW=8354KiB/s (8554kB/s)(12.0MiB/1471msec); 0 zone resets clat (msec): min=289, max=740, avg=485.52, stdev=231.32 lat (msec): min=289, max=740, avg=485.77, stdev=231.32 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7627, max= 7627, per=38.68%, avg=7627.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=18.64%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9858KiB/s (10.1MB/s), 2465KiB/s-10.5MiB/s (2524kB/s-11.0MB/s), io=16.0MiB (16.8MB), run=1143-1662msec WRITE: bw=19.3MiB/s (20.2MB/s), 4929KiB/s-8354KiB/s (5047kB/s-8554kB/s), io=32.0MiB (33.6MB), run=1471-1662msec