== sanity test 398b: DIO and buffer IO race ============== 14:51:44 (1781031104) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.84714 s, 17.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184120: Tue Jun 9 14:52:48 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(5992KiB/55318msec) clat (usec): min=34, max=717147, avg=20071.00, stdev=20912.39 lat (usec): min=35, max=717148, avg=20076.74, stdev=20910.66 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 7242], 10.00th=[ 8979], 20.00th=[ 11076], | 30.00th=[ 13173], 40.00th=[ 15795], 50.00th=[ 17695], 60.00th=[ 20055], | 70.00th=[ 22676], 80.00th=[ 26346], 90.00th=[ 32900], 95.00th=[ 39584], | 99.00th=[ 56361], 99.50th=[ 61080], 99.90th=[ 87557], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 24, max= 184, per=24.93%, avg=108.18, stdev=34.36, samples=110 iops : min= 6, max= 46, avg=26.61, stdev= 8.61, samples=110 write: IOPS=28, BW=114KiB/s (117kB/s)(6296KiB/55318msec); 0 zone resets clat (usec): min=718, max=102095, avg=15896.98, stdev=11829.31 lat (usec): min=718, max=102096, avg=15897.82, stdev=11829.40 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2769], 10.00th=[ 3425], 20.00th=[ 5538], | 30.00th=[ 8356], 40.00th=[ 10814], 50.00th=[ 13304], 60.00th=[ 16188], | 70.00th=[ 19530], 80.00th=[ 24249], 90.00th=[ 32113], 95.00th=[ 39060], | 99.00th=[ 56886], 99.50th=[ 58459], 99.90th=[ 69731], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 39, max= 192, per=25.01%, avg=113.53, stdev=36.49, samples=110 iops : min= 9, max= 48, avg=27.95, stdev= 9.18, samples=110 lat (usec) : 50=0.03%, 100=0.29%, 250=0.59%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.26% lat (msec) : 2=0.85%, 4=5.79%, 10=17.74%, 20=40.07%, 50=32.49% lat (msec) : 100=1.63%, 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=26.42%, ctx=10159, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184121: Tue Jun 9 14:52:48 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(5940KiB/55077msec) clat (usec): min=42, max=679614, avg=19754.75, stdev=19989.78 lat (usec): min=43, max=679614, avg=19755.40, stdev=19989.81 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 7439], 10.00th=[ 8848], 20.00th=[ 11076], | 30.00th=[ 13304], 40.00th=[ 15270], 50.00th=[ 17433], 60.00th=[ 19792], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32637], 95.00th=[ 39060], | 99.00th=[ 53740], 99.50th=[ 58459], 99.90th=[ 73925], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 20, max= 184, per=24.83%, avg=107.78, stdev=33.81, samples=109 iops : min= 5, max= 46, avg=26.50, stdev= 8.51, samples=109 write: IOPS=28, BW=115KiB/s (118kB/s)(6348KiB/55077msec); 0 zone resets clat (usec): min=736, max=77891, avg=16090.28, stdev=12070.63 lat (usec): min=736, max=77891, avg=16091.11, stdev=12070.70 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 2999], 10.00th=[ 3458], 20.00th=[ 5145], | 30.00th=[ 8094], 40.00th=[10683], 50.00th=[13042], 60.00th=[16188], | 70.00th=[20055], 80.00th=[25297], 90.00th=[33162], 95.00th=[40109], | 99.00th=[53740], 99.50th=[60031], 99.90th=[76022], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 40, max= 215, per=25.32%, avg=114.94, stdev=37.94, samples=109 iops : min= 10, max= 53, avg=28.29, stdev= 9.49, samples=109 lat (usec) : 50=0.03%, 100=0.26%, 250=0.68%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=0.33%, 4=7.06%, 10=17.51%, 20=39.55%, 50=32.81% lat (msec) : 100=1.50%, 750=0.03% cpu : usr=0.11%, sys=26.52%, ctx=9968, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184122: Tue Jun 9 14:52:48 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(6028KiB/54308msec) clat (usec): min=46, max=93949, avg=19478.91, stdev=10453.64 lat (usec): min=47, max=93949, avg=19479.66, stdev=10453.68 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 7898], 10.00th=[ 9372], 20.00th=[11076], | 30.00th=[13304], 40.00th=[15270], 50.00th=[17433], 60.00th=[19530], | 70.00th=[22414], 80.00th=[26346], 90.00th=[32637], 95.00th=[39060], | 99.00th=[55313], 99.50th=[61604], 99.90th=[79168], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 46, max= 184, per=25.53%, avg=110.81, stdev=32.96, samples=108 iops : min= 11, max= 46, avg=27.26, stdev= 8.24, samples=108 write: IOPS=28, BW=115KiB/s (118kB/s)(6260KiB/54308msec); 0 zone resets clat (usec): min=663, max=658885, avg=15816.73, stdev=19813.02 lat (usec): min=664, max=658885, avg=15817.65, stdev=19813.04 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2835], 10.00th=[ 3392], 20.00th=[ 5145], | 30.00th=[ 7898], 40.00th=[ 10290], 50.00th=[ 12518], 60.00th=[ 15533], | 70.00th=[ 19530], 80.00th=[ 24249], 90.00th=[ 31327], 95.00th=[ 36963], | 99.00th=[ 48497], 99.50th=[ 55837], 99.90th=[ 94897], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 23, max= 232, per=25.35%, avg=115.09, stdev=41.26, samples=108 iops : min= 5, max= 58, avg=28.33, stdev=10.36, samples=108 lat (usec) : 50=0.03%, 100=0.07%, 250=0.65%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=0.78%, 4=6.41%, 10=18.03%, 20=40.20%, 50=32.19% lat (msec) : 100=1.24%, 750=0.03% cpu : usr=0.09%, sys=26.57%, ctx=10017, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184123: Tue Jun 9 14:52:48 2026 read: IOPS=27, BW=110KiB/s (113kB/s)(6052KiB/54896msec) clat (usec): min=32, max=677685, avg=19793.36, stdev=19807.62 lat (usec): min=33, max=677685, avg=19794.04, stdev=19807.65 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 7242], 10.00th=[ 8848], 20.00th=[ 11469], | 30.00th=[ 13304], 40.00th=[ 15401], 50.00th=[ 17433], 60.00th=[ 19530], | 70.00th=[ 22676], 80.00th=[ 26608], 90.00th=[ 32375], 95.00th=[ 38536], | 99.00th=[ 55313], 99.50th=[ 60556], 99.90th=[ 84411], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 40, max= 191, per=25.35%, avg=110.02, stdev=33.68, samples=109 iops : min= 10, max= 47, avg=27.06, stdev= 8.45, samples=109 write: IOPS=28, BW=114KiB/s (116kB/s)(6236KiB/54896msec); 0 zone resets clat (usec): min=778, max=87279, avg=15872.81, stdev=12151.92 lat (usec): min=779, max=87279, avg=15873.62, stdev=12151.93 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 2966], 10.00th=[ 3458], 20.00th=[ 5211], | 30.00th=[ 7635], 40.00th=[10683], 50.00th=[13304], 60.00th=[16319], | 70.00th=[19792], 80.00th=[23725], 90.00th=[31327], 95.00th=[40109], | 99.00th=[60031], 99.50th=[63177], 99.90th=[79168], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 47, max= 224, per=24.94%, avg=113.23, stdev=38.87, samples=109 iops : min= 11, max= 56, avg=27.86, stdev= 9.75, samples=109 lat (usec) : 50=0.03%, 100=0.26%, 250=0.94%, 500=0.10%, 1000=0.20% lat (msec) : 2=0.55%, 4=6.58%, 10=17.02%, 20=40.49%, 50=31.93% lat (msec) : 100=1.86%, 750=0.03% cpu : usr=0.09%, sys=26.35%, ctx=10158, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=434KiB/s (444kB/s), 108KiB/s-111KiB/s (110kB/s-114kB/s), io=23.4MiB (24.6MB), run=54308-55318msec WRITE: bw=454KiB/s (465kB/s), 114KiB/s-115KiB/s (116kB/s-118kB/s), io=24.6MiB (25.7MB), run=54308-55318msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184125: Tue Jun 9 14:52:55 2026 read: IOPS=23, BW=95.0KiB/s (98.3kB/s)(5992KiB/62441msec) clat (msec): min=2, max=739, avg=18.50, stdev=23.18 lat (msec): min=2, max=739, avg=18.50, stdev=23.18 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 45], | 99.00th=[ 67], 99.50th=[ 78], 99.90th=[ 122], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 31, max= 328, per=25.02%, avg=96.08, stdev=62.59, samples=123 iops : min= 7, max= 82, avg=23.67, stdev=15.73, samples=123 write: IOPS=25, BW=101KiB/s (103kB/s)(6296KiB/62441msec); 0 zone resets clat (msec): min=5, max=124, avg=22.03, stdev=14.65 lat (msec): min=5, max=124, avg=22.03, stdev=14.65 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 50], | 99.00th=[ 72], 99.50th=[ 77], 99.90th=[ 115], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 24, max= 368, per=25.10%, avg=100.91, stdev=64.98, samples=123 iops : min= 6, max= 92, avg=24.88, stdev=16.32, samples=123 lat (msec) : 4=0.29%, 10=29.30%, 20=31.22%, 50=35.12%, 100=3.91% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.08%, sys=15.13%, ctx=6883, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184126: Tue Jun 9 14:52:55 2026 read: IOPS=23, BW=95.1KiB/s (97.4kB/s)(5940KiB/62470msec) clat (msec): min=2, max=670, avg=18.19, stdev=21.66 lat (msec): min=2, max=670, avg=18.19, stdev=21.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 36], 95.00th=[ 47], | 99.00th=[ 65], 99.50th=[ 72], 99.90th=[ 99], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 16, max= 367, per=24.79%, avg=95.20, stdev=66.78, samples=123 iops : min= 4, max= 91, avg=23.45, stdev=16.75, samples=123 write: IOPS=25, BW=102KiB/s (104kB/s)(6348KiB/62470msec); 0 zone resets clat (msec): min=5, max=113, avg=22.31, stdev=15.66 lat (msec): min=5, max=113, avg=22.31, stdev=15.66 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 79], 99.50th=[ 91], 99.90th=[ 107], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 31, max= 336, per=25.21%, avg=101.36, stdev=64.46, samples=123 iops : min= 7, max= 84, avg=24.99, stdev=16.21, samples=123 lat (msec) : 4=0.59%, 10=29.62%, 20=31.25%, 50=33.85%, 100=4.56% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.07%, sys=15.12%, ctx=6685, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184127: Tue Jun 9 14:52:55 2026 read: IOPS=24, BW=96.7KiB/s (98.0kB/s)(6028KiB/62356msec) clat (usec): min=3297, max=97458, avg=17413.96, stdev=13011.08 lat (usec): min=3297, max=97460, avg=17414.63, stdev=13011.08 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 5014], 10.00th=[ 5669], 20.00th=[ 6783], | 30.00th=[ 8848], 40.00th=[11076], 50.00th=[13173], 60.00th=[16057], | 70.00th=[19792], 80.00th=[26608], 90.00th=[35914], 95.00th=[42730], | 99.00th=[59507], 99.50th=[71828], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 7, max= 368, per=25.26%, avg=97.01, stdev=67.50, samples=123 iops : min= 1, max= 92, avg=23.90, stdev=16.93, samples=123 write: IOPS=25, BW=100KiB/s (103kB/s)(6260KiB/62356msec); 0 zone resets clat (msec): min=5, max=685, avg=23.05, stdev=23.16 lat (msec): min=5, max=685, avg=23.05, stdev=23.16 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 82], 99.50th=[ 94], 99.90th=[ 131], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 16, max= 336, per=25.02%, avg=100.59, stdev=62.58, samples=123 iops : min= 4, max= 84, avg=24.80, stdev=15.73, samples=123 lat (msec) : 4=0.46%, 10=29.36%, 20=32.23%, 50=33.66%, 100=4.13% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.08%, sys=15.22%, ctx=6786, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184128: Tue Jun 9 14:52:55 2026 read: IOPS=24, BW=96.8KiB/s (99.2kB/s)(6052KiB/62497msec) clat (usec): min=2527, max=95420, avg=18194.08, stdev=14014.58 lat (usec): min=2527, max=95421, avg=18194.67, stdev=14014.60 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 5145], 10.00th=[ 5669], 20.00th=[ 6980], | 30.00th=[ 8979], 40.00th=[11207], 50.00th=[13566], 60.00th=[16450], | 70.00th=[21103], 80.00th=[27657], 90.00th=[36963], 95.00th=[46924], | 99.00th=[66323], 99.50th=[76022], 99.90th=[87557], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 24, max= 328, per=25.14%, avg=96.55, stdev=62.35, samples=123 iops : min= 6, max= 82, avg=23.79, stdev=15.67, samples=123 write: IOPS=24, BW=99.8KiB/s (102kB/s)(6236KiB/62497msec); 0 zone resets clat (msec): min=4, max=680, avg=22.40, stdev=22.33 lat (msec): min=4, max=680, avg=22.40, stdev=22.33 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 70], 99.50th=[ 84], 99.90th=[ 109], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 31, max= 344, per=24.78%, avg=99.61, stdev=63.88, samples=123 iops : min= 7, max= 86, avg=24.55, stdev=16.03, samples=123 lat (msec) : 4=0.46%, 10=29.39%, 20=31.22%, 50=34.21%, 100=4.65% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=15.07%, ctx=6916, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=384KiB/s (393kB/s), 95.1KiB/s-96.8KiB/s (97.4kB/s-99.2kB/s), io=23.4MiB (24.6MB), run=62356-62497msec WRITE: bw=402KiB/s (412kB/s), 99.8KiB/s-102KiB/s (102kB/s-104kB/s), io=24.6MiB (25.7MB), run=62356-62497msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184160: Tue Jun 9 14:53:16 2026 read: IOPS=25, BW=404KiB/s (414kB/s)(5920KiB/14660msec) clat (usec): min=74, max=56755, avg=20169.82, stdev=9436.06 lat (usec): min=75, max=56756, avg=20170.40, stdev=9436.07 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 169], 10.00th=[11207], 20.00th=[13042], | 30.00th=[15139], 40.00th=[17171], 50.00th=[19268], 60.00th=[21627], | 70.00th=[24249], 80.00th=[26608], 90.00th=[31327], 95.00th=[38536], | 99.00th=[49546], 99.50th=[51119], 99.90th=[56886], 99.95th=[56886], | 99.99th=[56886] bw ( KiB/s): min= 223, max= 574, per=24.91%, avg=403.07, stdev=91.24, samples=29 iops : min= 13, max= 35, avg=24.59, stdev= 5.62, samples=29 write: IOPS=27, BW=434KiB/s (445kB/s)(6368KiB/14660msec); 0 zone resets clat (usec): min=2082, max=60892, avg=17739.98, stdev=10623.45 lat (usec): min=2084, max=60893, avg=17740.98, stdev=10623.44 clat percentiles (usec): | 1.00th=[ 3064], 5.00th=[ 4817], 10.00th=[ 5735], 20.00th=[ 7767], | 30.00th=[11338], 40.00th=[13173], 50.00th=[15664], 60.00th=[17957], | 70.00th=[21365], 80.00th=[26346], 90.00th=[33424], 95.00th=[37487], | 99.00th=[52691], 99.50th=[55837], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 223, max= 606, per=25.57%, avg=435.45, stdev=100.93, samples=29 iops : min= 13, max= 37, avg=26.62, stdev= 6.38, samples=29 lat (usec) : 100=0.13%, 250=2.47% lat (msec) : 4=1.04%, 10=13.67%, 20=42.45%, 50=39.32%, 100=0.91% cpu : usr=0.03%, sys=28.30%, ctx=3023, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184161: Tue Jun 9 14:53:16 2026 read: IOPS=24, BW=389KiB/s (398kB/s)(5744KiB/14769msec) clat (usec): min=38, max=64849, avg=20709.89, stdev=9619.36 lat (usec): min=38, max=64850, avg=20710.51, stdev=9619.35 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 9372], 10.00th=[11207], 20.00th=[13566], | 30.00th=[15139], 40.00th=[17171], 50.00th=[19792], 60.00th=[22152], | 70.00th=[24249], 80.00th=[27395], 90.00th=[32113], 95.00th=[37487], | 99.00th=[51643], 99.50th=[53740], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 191, max= 544, per=24.03%, avg=388.86, stdev=82.53, samples=29 iops : min= 11, max= 34, avg=23.69, stdev= 5.27, samples=29 write: IOPS=27, BW=443KiB/s (454kB/s)(6544KiB/14769msec); 0 zone resets clat (usec): min=2290, max=65624, avg=17826.36, stdev=11133.69 lat (usec): min=2291, max=65624, avg=17827.45, stdev=11133.70 clat percentiles (usec): | 1.00th=[ 2999], 5.00th=[ 4621], 10.00th=[ 5276], 20.00th=[ 7504], | 30.00th=[10552], 40.00th=[12780], 50.00th=[15533], 60.00th=[18220], | 70.00th=[22152], 80.00th=[27132], 90.00th=[33424], 95.00th=[39060], | 99.00th=[47973], 99.50th=[50594], 99.90th=[65799], 99.95th=[65799], | 99.99th=[65799] bw ( KiB/s): min= 256, max= 640, per=25.93%, avg=441.59, stdev=99.60, samples=29 iops : min= 16, max= 40, avg=27.00, stdev= 6.23, samples=29 lat (usec) : 50=0.13%, 100=0.13%, 250=1.56% lat (msec) : 4=1.43%, 10=14.19%, 20=40.76%, 50=40.76%, 100=1.04% cpu : usr=0.07%, sys=28.10%, ctx=3089, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184162: Tue Jun 9 14:53:16 2026 read: IOPS=26, BW=423KiB/s (433kB/s)(6256KiB/14795msec) clat (usec): min=43, max=48310, avg=19983.24, stdev=9021.80 lat (usec): min=44, max=48311, avg=19983.91, stdev=9021.80 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 186], 10.00th=[10814], 20.00th=[13566], | 30.00th=[15270], 40.00th=[17171], 50.00th=[19268], 60.00th=[21365], | 70.00th=[23725], 80.00th=[27132], 90.00th=[31851], 95.00th=[35914], | 99.00th=[45351], 99.50th=[46400], 99.90th=[48497], 99.95th=[48497], | 99.99th=[48497] bw ( KiB/s): min= 286, max= 702, per=26.15%, avg=423.17, stdev=88.33, samples=29 iops : min= 17, max= 43, avg=25.86, stdev= 5.58, samples=29 write: IOPS=25, BW=408KiB/s (417kB/s)(6032KiB/14795msec); 0 zone resets clat (usec): min=2947, max=54412, avg=18360.60, stdev=10336.33 lat (usec): min=2948, max=54413, avg=18361.70, stdev=10336.34 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5342], 10.00th=[ 5866], 20.00th=[ 7832], | 30.00th=[11863], 40.00th=[14222], 50.00th=[16319], 60.00th=[19530], | 70.00th=[22676], 80.00th=[27132], 90.00th=[34341], 95.00th=[37487], | 99.00th=[46924], 99.50th=[49021], 99.90th=[54264], 99.95th=[54264], | 99.99th=[54264] bw ( KiB/s): min= 224, max= 541, per=23.61%, avg=402.07, stdev=89.60, samples=29 iops : min= 14, max= 33, avg=24.55, stdev= 5.57, samples=29 lat (usec) : 50=0.13%, 100=0.26%, 250=2.21%, 500=0.13%, 1000=0.13% lat (msec) : 4=0.39%, 10=12.63%, 20=41.80%, 50=42.19%, 100=0.13% cpu : usr=0.05%, sys=28.16%, ctx=3154, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184163: Tue Jun 9 14:53:16 2026 read: IOPS=26, BW=418KiB/s (428kB/s)(6032KiB/14424msec) clat (usec): min=84, max=58847, avg=19589.14, stdev=10239.64 lat (usec): min=84, max=58848, avg=19589.77, stdev=10239.61 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 123], 10.00th=[ 9634], 20.00th=[11863], | 30.00th=[14353], 40.00th=[17171], 50.00th=[19792], 60.00th=[21890], | 70.00th=[24249], 80.00th=[26870], 90.00th=[31327], 95.00th=[36963], | 99.00th=[50594], 99.50th=[56361], 99.90th=[58983], 99.95th=[58983], | 99.99th=[58983] bw ( KiB/s): min= 223, max= 606, per=25.60%, avg=414.14, stdev=84.08, samples=28 iops : min= 13, max= 37, avg=25.29, stdev= 5.23, samples=28 write: IOPS=27, BW=434KiB/s (444kB/s)(6256KiB/14424msec); 0 zone resets clat (usec): min=1565, max=55791, avg=17736.19, stdev=11064.29 lat (usec): min=1565, max=55792, avg=17737.41, stdev=11064.24 clat percentiles (usec): | 1.00th=[ 2057], 5.00th=[ 4883], 10.00th=[ 5538], 20.00th=[ 7111], | 30.00th=[ 9765], 40.00th=[12649], 50.00th=[15401], 60.00th=[18482], | 70.00th=[22414], 80.00th=[27132], 90.00th=[33162], 95.00th=[39584], | 99.00th=[47449], 99.50th=[49021], 99.90th=[55837], 99.95th=[55837], | 99.99th=[55837] bw ( KiB/s): min= 318, max= 608, per=25.39%, avg=432.32, stdev=91.80, samples=28 iops : min= 19, max= 38, avg=26.43, stdev= 5.89, samples=28 lat (usec) : 100=0.39%, 250=3.91%, 500=0.13% lat (msec) : 2=0.39%, 4=0.39%, 10=15.76%, 20=36.07%, 50=42.32% lat (msec) : 100=0.65% cpu : usr=0.10%, sys=28.16%, ctx=3082, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1619KiB/s (1658kB/s), 389KiB/s-423KiB/s (398kB/s-433kB/s), io=23.4MiB (24.5MB), run=14424-14795msec WRITE: bw=1703KiB/s (1744kB/s), 408KiB/s-443KiB/s (417kB/s-454kB/s), io=24.6MiB (25.8MB), run=14424-14795msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184156: Tue Jun 9 14:53:18 2026 read: IOPS=22, BW=361KiB/s (369kB/s)(5920KiB/16408msec) clat (usec): min=3021, max=73519, avg=19395.60, stdev=12629.59 lat (usec): min=3022, max=73520, avg=19396.45, stdev=12629.44 clat percentiles (usec): | 1.00th=[ 4178], 5.00th=[ 5997], 10.00th=[ 7242], 20.00th=[ 8717], | 30.00th=[11600], 40.00th=[13304], 50.00th=[15795], 60.00th=[18220], | 70.00th=[22152], 80.00th=[27919], 90.00th=[36439], 95.00th=[45351], | 99.00th=[60031], 99.50th=[66323], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 191, max= 864, per=23.75%, avg=346.53, stdev=144.96, samples=32 iops : min= 11, max= 54, avg=21.16, stdev= 9.11, samples=32 write: IOPS=24, BW=388KiB/s (397kB/s)(6368KiB/16408msec); 0 zone resets clat (usec): min=4871, max=80321, avg=22973.35, stdev=13444.10 lat (usec): min=4871, max=80323, avg=22975.06, stdev=13443.74 clat percentiles (usec): | 1.00th=[ 6390], 5.00th=[ 8586], 10.00th=[ 9634], 20.00th=[11338], | 30.00th=[13304], 40.00th=[15270], 50.00th=[19006], 60.00th=[23987], | 70.00th=[27657], 80.00th=[33817], 90.00th=[44303], 95.00th=[50594], | 99.00th=[59507], 99.50th=[66323], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 159, max= 960, per=24.55%, avg=376.78, stdev=159.12, samples=32 iops : min= 9, max= 60, avg=23.03, stdev=10.03, samples=32 lat (msec) : 4=0.26%, 10=17.71%, 20=41.02%, 50=36.59%, 100=4.43% cpu : usr=0.07%, sys=15.02%, ctx=1846, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184157: Tue Jun 9 14:53:18 2026 read: IOPS=21, BW=350KiB/s (359kB/s)(5744KiB/16391msec) clat (usec): min=4140, max=59836, avg=18862.56, stdev=11358.97 lat (usec): min=4140, max=59837, avg=18863.18, stdev=11358.97 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 6325], 10.00th=[ 7701], 20.00th=[ 9634], | 30.00th=[11469], 40.00th=[13435], 50.00th=[15270], 60.00th=[18220], | 70.00th=[21890], 80.00th=[28181], 90.00th=[34866], 95.00th=[43254], | 99.00th=[53740], 99.50th=[59507], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 128, max= 798, per=23.50%, avg=342.81, stdev=138.48, samples=32 iops : min= 8, max= 49, avg=20.91, stdev= 8.70, samples=32 write: IOPS=24, BW=399KiB/s (409kB/s)(6544KiB/16391msec); 0 zone resets clat (usec): min=5042, max=94323, avg=23382.01, stdev=13884.78 lat (usec): min=5043, max=94323, avg=23383.45, stdev=13884.67 clat percentiles (usec): | 1.00th=[ 6259], 5.00th=[ 7767], 10.00th=[ 8455], 20.00th=[11338], | 30.00th=[13435], 40.00th=[16319], 50.00th=[19792], 60.00th=[23987], | 70.00th=[29492], 80.00th=[34341], 90.00th=[42730], 95.00th=[50070], | 99.00th=[61604], 99.50th=[67634], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 94, max= 1120, per=25.23%, avg=387.31, stdev=196.38, samples=32 iops : min= 5, max= 70, avg=23.69, stdev=12.33, samples=32 lat (msec) : 10=18.23%, 20=39.32%, 50=38.67%, 100=3.78% cpu : usr=0.07%, sys=14.87%, ctx=1859, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184158: Tue Jun 9 14:53:18 2026 read: IOPS=23, BW=383KiB/s (393kB/s)(6256KiB/16320msec) clat (usec): min=4687, max=72085, avg=18520.55, stdev=12009.87 lat (usec): min=4688, max=72086, avg=18522.53, stdev=12008.91 clat percentiles (usec): | 1.00th=[ 5473], 5.00th=[ 6194], 10.00th=[ 7570], 20.00th=[ 9110], | 30.00th=[11076], 40.00th=[12911], 50.00th=[14615], 60.00th=[16909], | 70.00th=[19792], 80.00th=[26084], 90.00th=[36439], 95.00th=[45351], | 99.00th=[60031], 99.50th=[61604], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 190, max= 1184, per=26.03%, avg=379.81, stdev=214.25, samples=32 iops : min= 11, max= 74, avg=23.22, stdev=13.43, samples=32 write: IOPS=23, BW=370KiB/s (378kB/s)(6032KiB/16320msec); 0 zone resets clat (usec): min=6207, max=97909, avg=23943.39, stdev=14120.87 lat (usec): min=6209, max=97911, avg=23944.89, stdev=14120.74 clat percentiles (usec): | 1.00th=[ 6849], 5.00th=[ 8291], 10.00th=[ 9110], 20.00th=[11600], | 30.00th=[13960], 40.00th=[16712], 50.00th=[20055], 60.00th=[25560], | 70.00th=[29230], 80.00th=[33817], 90.00th=[43254], 95.00th=[53740], | 99.00th=[66847], 99.50th=[74974], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 190, max= 800, per=23.44%, avg=359.81, stdev=142.65, samples=32 iops : min= 11, max= 50, avg=21.97, stdev= 9.01, samples=32 lat (msec) : 10=19.66%, 20=40.76%, 50=35.29%, 100=4.30% cpu : usr=0.12%, sys=14.77%, ctx=1855, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184159: Tue Jun 9 14:53:18 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(6032KiB/16219msec) clat (usec): min=4932, max=60469, avg=18655.82, stdev=11839.42 lat (usec): min=4933, max=60470, avg=18656.45, stdev=11839.43 clat percentiles (usec): | 1.00th=[ 5669], 5.00th=[ 6587], 10.00th=[ 7373], 20.00th=[ 9372], | 30.00th=[11207], 40.00th=[12649], 50.00th=[14353], 60.00th=[17171], | 70.00th=[21627], 80.00th=[25822], 90.00th=[37487], 95.00th=[44303], | 99.00th=[53740], 99.50th=[60031], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 191, max= 896, per=25.27%, avg=368.69, stdev=181.89, samples=32 iops : min= 11, max= 56, avg=22.53, stdev=11.40, samples=32 write: IOPS=24, BW=386KiB/s (395kB/s)(6256KiB/16219msec); 0 zone resets clat (usec): min=6162, max=81163, avg=23431.66, stdev=13373.46 lat (usec): min=6162, max=81164, avg=23433.05, stdev=13373.50 clat percentiles (usec): | 1.00th=[ 7308], 5.00th=[ 8455], 10.00th=[ 9634], 20.00th=[11863], | 30.00th=[13960], 40.00th=[16581], 50.00th=[19792], 60.00th=[23462], | 70.00th=[28967], 80.00th=[33162], 90.00th=[43254], 95.00th=[47973], | 99.00th=[67634], 99.50th=[76022], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 160, max= 896, per=25.05%, avg=384.50, stdev=158.35, samples=32 iops : min= 10, max= 56, avg=23.53, stdev= 9.91, samples=32 lat (msec) : 10=16.93%, 20=41.80%, 50=37.89%, 100=3.39% cpu : usr=0.06%, sys=15.13%, ctx=1822, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1460KiB/s (1495kB/s), 350KiB/s-383KiB/s (359kB/s-393kB/s), io=23.4MiB (24.5MB), run=16219-16408msec WRITE: bw=1536KiB/s (1573kB/s), 370KiB/s-399KiB/s (378kB/s-409kB/s), io=24.6MiB (25.8MB), run=16219-16408msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184175: Tue Jun 9 14:53:28 2026 read: IOPS=3, BW=3257KiB/s (3335kB/s)(7168KiB/2201msec) clat (usec): min=503, max=201645, avg=135378.59, stdev=69703.15 lat (usec): min=504, max=201646, avg=135379.60, stdev=69703.17 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[109577], | 30.00th=[121111], 40.00th=[121111], 50.00th=[137364], 60.00th=[185598], | 70.00th=[185598], 80.00th=[189793], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 2048, max= 4471, per=62.61%, avg=3530.00, stdev=1298.94, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2326KiB/s (2382kB/s)(5120KiB/2201msec); 0 zone resets clat (msec): min=167, max=439, avg=250.27, stdev=108.62 lat (msec): min=167, max=439, avg=250.33, stdev=108.61 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1490, max= 2048, per=24.14%, avg=1905.25, stdev=276.90, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=83.33%, 500=8.33% cpu : usr=0.00%, sys=57.64%, ctx=1276, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184176: Tue Jun 9 14:53:28 2026 read: IOPS=0, BW=564KiB/s (577kB/s)(2048KiB/3632msec) clat (msec): min=156, max=306, avg=231.49, stdev=106.37 lat (msec): min=156, max=306, avg=231.49, stdev=106.37 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1408, max= 2048, per=30.65%, avg=1728.00, stdev=452.55, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2819KiB/s (2887kB/s)(10.0MiB/3632msec); 0 zone resets clat (msec): min=38, max=1005, avg=316.68, stdev=287.72 lat (msec): min=38, max=1005, avg=316.76, stdev=287.71 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 134], | 30.00th=[ 148], 40.00th=[ 182], 50.00th=[ 205], 60.00th=[ 211], | 70.00th=[ 215], 80.00th=[ 506], 90.00th=[ 527], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1408, max= 6144, per=43.28%, avg=3416.50, stdev=2146.38, samples=4 iops : min= 1, max= 6, avg= 2.75, stdev= 2.36, samples=4 lat (msec) : 50=8.33%, 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.08%, sys=43.32%, ctx=287, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184177: Tue Jun 9 14:53:28 2026 read: IOPS=2, BW=2725KiB/s (2790kB/s)(6144KiB/2255msec) clat (usec): min=554, max=182677, avg=77076.72, stdev=77535.31 lat (usec): min=555, max=182677, avg=77077.62, stdev=77534.98 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 38011], 50.00th=[ 38011], 60.00th=[ 89654], | 70.00th=[152044], 80.00th=[152044], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 2035, max= 4096, per=60.46%, avg=3409.00, stdev=1189.92, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2725KiB/s (2790kB/s)(6144KiB/2255msec); 0 zone resets clat (msec): min=144, max=864, avg=298.50, stdev=279.27 lat (msec): min=144, max=864, avg=298.55, stdev=279.28 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2035, max= 4096, per=34.92%, avg=2756.75, stdev=970.42, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 100=8.33%, 250=58.33%, 1000=8.33% cpu : usr=0.00%, sys=48.45%, ctx=453, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184178: Tue Jun 9 14:53:28 2026 read: IOPS=1, BW=1610KiB/s (1649kB/s)(5120KiB/3180msec) clat (usec): min=518, max=775564, avg=294613.01, stdev=403489.75 lat (usec): min=519, max=775564, avg=294614.06, stdev=403489.20 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 519], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[ 938], 60.00th=[ 938], | 70.00th=[692061], 80.00th=[692061], 90.00th=[775947], 95.00th=[775947], | 99.00th=[775947], 99.50th=[775947], 99.90th=[775947], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 4096, max= 4096, per=72.65%, avg=4096.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2254KiB/s (2308kB/s)(7168KiB/3180msec); 0 zone resets clat (msec): min=81, max=464, avg=243.49, stdev=140.64 lat (msec): min=81, max=464, avg=243.56, stdev=140.63 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 113], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 218], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 388], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2035, max= 2793, per=29.03%, avg=2292.00, stdev=433.93, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=35.51%, ctx=585, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5639KiB/s (5774kB/s), 564KiB/s-3257KiB/s (577kB/s-3335kB/s), io=20.0MiB (20.0MB), run=2201-3632msec WRITE: bw=7894KiB/s (8084kB/s), 2254KiB/s-2819KiB/s (2308kB/s-2887kB/s), io=28.0MiB (29.4MB), run=2201-3632msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184170: Tue Jun 9 14:53:28 2026 read: IOPS=2, BW=2968KiB/s (3039kB/s)(7168KiB/2415msec) clat (msec): min=52, max=688, avg=195.23, stdev=227.12 lat (msec): min=52, max=688, avg=195.23, stdev=227.12 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 54], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 131], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 234], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1924, max= 8677, per=100.00%, avg=5300.50, stdev=4775.09, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 write: IOPS=2, BW=2120KiB/s (2171kB/s)(5120KiB/2415msec); 0 zone resets clat (msec): min=56, max=365, avg=206.78, stdev=126.26 lat (msec): min=56, max=365, avg=206.84, stdev=126.26 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1735, max= 3849, per=32.64%, avg=2420.00, stdev=964.03, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=33.33%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=21.00%, ctx=155, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184171: Tue Jun 9 14:53:28 2026 read: IOPS=0, BW=530KiB/s (542kB/s)(2048KiB/3867msec) clat (msec): min=77, max=1020, avg=549.10, stdev=666.81 lat (msec): min=77, max=1020, avg=549.10, stdev=666.81 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1715, max= 2039, per=35.44%, avg=1877.00, stdev=229.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2648KiB/s (2712kB/s)(10.0MiB/3867msec); 0 zone resets clat (msec): min=67, max=977, avg=275.53, stdev=283.12 lat (msec): min=67, max=977, avg=275.61, stdev=283.12 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 71], | 30.00th=[ 90], 40.00th=[ 93], 50.00th=[ 201], 60.00th=[ 207], | 70.00th=[ 222], 80.00th=[ 309], 90.00th=[ 523], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1924, max= 6144, per=51.46%, avg=3815.25, stdev=2151.85, samples=4 iops : min= 1, max= 6, avg= 3.50, stdev= 2.38, samples=4 lat (msec) : 100=41.67%, 250=25.00%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=19.14%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184172: Tue Jun 9 14:53:28 2026 read: IOPS=2, BW=2743KiB/s (2809kB/s)(6144KiB/2240msec) clat (msec): min=90, max=342, avg=202.78, stdev=106.49 lat (msec): min=90, max=342, avg=202.78, stdev=106.49 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 271], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1715, max= 3849, per=45.60%, avg=2415.00, stdev=968.80, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=2, BW=2743KiB/s (2809kB/s)(6144KiB/2240msec); 0 zone resets clat (msec): min=57, max=442, avg=167.11, stdev=141.87 lat (msec): min=57, max=442, avg=167.18, stdev=141.87 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 142], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1924, max= 5145, per=37.65%, avg=2791.25, stdev=1570.26, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.73, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=33.33% cpu : usr=0.00%, sys=20.01%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184173: Tue Jun 9 14:53:28 2026 read: IOPS=2, BW=2335KiB/s (2391kB/s)(5120KiB/2193msec) clat (msec): min=96, max=268, avg=137.11, stdev=73.69 lat (msec): min=96, max=268, avg=137.11, stdev=73.69 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 108], 60.00th=[ 108], | 70.00th=[ 112], 80.00th=[ 112], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7699, max= 7699, per=100.00%, avg=7699.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3269KiB/s (3347kB/s)(7168KiB/2193msec); 0 zone resets clat (msec): min=57, max=394, avg=213.33, stdev=150.92 lat (msec): min=57, max=394, avg=213.40, stdev=150.93 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 126], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 372], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2048, max= 6144, per=60.20%, avg=4463.00, stdev=2144.38, samples=3 iops : min= 2, max= 6, avg= 4.33, stdev= 2.08, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=17.88%, ctx=200, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5296KiB/s (5423kB/s), 530KiB/s-2968KiB/s (542kB/s-3039kB/s), io=20.0MiB (20.0MB), run=2193-3867msec WRITE: bw=7415KiB/s (7592kB/s), 2120KiB/s-3269KiB/s (2171kB/s-3347kB/s), io=28.0MiB (29.4MB), run=2193-3867msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184189: Tue Jun 9 14:53:38 2026 read: IOPS=1, BW=5129KiB/s (5252kB/s)(12.0MiB/2396msec) clat (msec): min=588, max=907, avg=707.47, stdev=174.38 lat (msec): min=588, max=907, avg=707.48, stdev=174.38 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=19.37%, ctx=99, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184190: Tue Jun 9 14:53:38 2026 read: IOPS=0, BW=1290KiB/s (1321kB/s)(4096KiB/3175msec) clat (nsec): min=2178.5M, max=2178.5M, avg=2178519794.00, stdev= 0.00 lat (nsec): min=2178.5M, max=2178.5M, avg=2178520571.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2165], 5.00th=[ 2165], 10.00th=[ 2165], 20.00th=[ 2165], | 30.00th=[ 2165], 40.00th=[ 2165], 50.00th=[ 2165], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2580KiB/s (2642kB/s)(8192KiB/3175msec); 0 zone resets clat (msec): min=329, max=417, avg=373.72, stdev=61.96 lat (msec): min=330, max=417, avg=373.95, stdev=61.87 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=12.54%, ctx=102, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184191: Tue Jun 9 14:53:38 2026 write: IOPS=0, BW=3978KiB/s (4073kB/s)(12.0MiB/3089msec); 0 zone resets clat (msec): min=319, max=1537, avg=924.12, stdev=608.83 lat (msec): min=320, max=1537, avg=924.44, stdev=608.79 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8031, max= 8192, per=78.60%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=19.56%, ctx=105, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184192: Tue Jun 9 14:53:38 2026 write: IOPS=0, BW=4065KiB/s (4162kB/s)(12.0MiB/3023msec); 0 zone resets clat (msec): min=498, max=1710, avg=920.19, stdev=685.31 lat (msec): min=498, max=1711, avg=920.54, stdev=685.31 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8031, max= 8192, per=78.60%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.90%, ctx=184, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5160KiB/s (5284kB/s), 1290KiB/s-5129KiB/s (1321kB/s-5252kB/s), io=16.0MiB (16.8MB), run=2396-3175msec WRITE: bw=10.1MiB/s (10.6MB/s), 2580KiB/s-4065KiB/s (2642kB/s-4162kB/s), io=32.0MiB (33.6MB), run=3023-3175msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184184: Tue Jun 9 14:53:38 2026 read: IOPS=1, BW=5048KiB/s (5170kB/s)(12.0MiB/2434msec) clat (msec): min=621, max=721, avg=685.85, stdev=55.53 lat (msec): min=621, max=721, avg=685.85, stdev=55.53 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.08%, sys=55.94%, ctx=2566, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184186: Tue Jun 9 14:53:38 2026 read: IOPS=0, BW=1586KiB/s (1624kB/s)(4096KiB/2582msec) clat (nsec): min=723039k, max=723039k, avg=723039176.00, stdev= 0.00 lat (nsec): min=723042k, max=723042k, avg=723041503.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3173KiB/s (3249kB/s)(8192KiB/2582msec); 0 zone resets clat (msec): min=583, max=910, avg=746.97, stdev=231.39 lat (msec): min=583, max=910, avg=747.31, stdev=231.48 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8192, max= 8192, per=83.06%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.04%, sys=22.86%, ctx=731, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184187: Tue Jun 9 14:53:38 2026 write: IOPS=0, BW=3699KiB/s (3788kB/s)(12.0MiB/3322msec); 0 zone resets clat (msec): min=194, max=1920, avg=980.39, stdev=873.18 lat (msec): min=194, max=1920, avg=980.76, stdev=873.21 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8047, max= 8110, per=81.91%, avg=8078.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=18.19%, ctx=116, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184188: Tue Jun 9 14:53:38 2026 write: IOPS=1, BW=4280KiB/s (4383kB/s)(12.0MiB/2871msec); 0 zone resets clat (msec): min=254, max=1831, avg=833.64, stdev=867.84 lat (msec): min=254, max=1831, avg=833.89, stdev=867.90 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 5468, max= 8159, per=69.08%, avg=6813.50, stdev=1902.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=18.22%, ctx=314, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6345KiB/s (6498kB/s), 1586KiB/s-5048KiB/s (1624kB/s-5170kB/s), io=16.0MiB (16.8MB), run=2434-2582msec WRITE: bw=9864KiB/s (10.1MB/s), 3173KiB/s-4280KiB/s (3249kB/s-4383kB/s), io=32.0MiB (33.6MB), run=2582-3322msec