== sanity test 398b: DIO and buffer IO race ============== 22:33:38 (1788921218) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.58221 s, 14.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182782: Tue Sep 8 22:34:58 2026 read: IOPS=22, BW=89.3KiB/s (91.5kB/s)(5992KiB/67090msec) clat (usec): min=44, max=334784, avg=24258.93, stdev=15663.46 lat (usec): min=45, max=334786, avg=24260.40, stdev=15663.37 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 8455], 10.00th=[ 10290], 20.00th=[ 13173], | 30.00th=[ 16057], 40.00th=[ 18744], 50.00th=[ 22152], 60.00th=[ 25035], | 70.00th=[ 28967], 80.00th=[ 33424], 90.00th=[ 41157], 95.00th=[ 47973], | 99.00th=[ 70779], 99.50th=[ 79168], 99.90th=[ 92799], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 32, max= 152, per=24.96%, avg=88.85, stdev=24.84, samples=133 iops : min= 8, max= 38, avg=21.69, stdev= 6.21, samples=133 write: IOPS=23, BW=93.8KiB/s (96.1kB/s)(6296KiB/67090msec); 0 zone resets clat (usec): min=661, max=124116, avg=19473.58, stdev=17677.93 lat (usec): min=662, max=124117, avg=19475.20, stdev=17677.66 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1745], 10.00th=[ 2343], 20.00th=[ 3556], | 30.00th=[ 5538], 40.00th=[ 11338], 50.00th=[ 15139], 60.00th=[ 19006], | 70.00th=[ 25297], 80.00th=[ 32637], 90.00th=[ 44827], 95.00th=[ 53740], | 99.00th=[ 73925], 99.50th=[ 86508], 99.90th=[114820], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 25, max= 192, per=25.05%, avg=93.42, stdev=28.63, samples=133 iops : min= 6, max= 48, avg=22.83, stdev= 7.21, samples=133 lat (usec) : 50=0.07%, 100=1.14%, 250=0.59%, 500=0.03%, 750=0.13% lat (msec) : 2=3.45%, 4=8.40%, 10=9.41%, 20=29.75%, 50=41.70% lat (msec) : 100=5.18%, 250=0.13%, 500=0.03% cpu : usr=0.13%, sys=14.05%, ctx=7699, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182783: Tue Sep 8 22:34:58 2026 read: IOPS=22, BW=88.6KiB/s (90.7kB/s)(5940KiB/67070msec) clat (usec): min=40, max=203784, avg=23987.06, stdev=15200.50 lat (usec): min=42, max=203787, avg=23988.66, stdev=15200.57 clat percentiles (usec): | 1.00th=[ 66], 5.00th=[ 7767], 10.00th=[ 10421], 20.00th=[ 13173], | 30.00th=[ 15533], 40.00th=[ 18220], 50.00th=[ 20841], 60.00th=[ 24773], | 70.00th=[ 28705], 80.00th=[ 33162], 90.00th=[ 39584], 95.00th=[ 48497], | 99.00th=[ 74974], 99.50th=[ 95945], 99.90th=[135267], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 12, max= 152, per=24.73%, avg=88.03, stdev=24.50, samples=133 iops : min= 3, max= 38, avg=21.49, stdev= 6.18, samples=133 write: IOPS=23, BW=94.6KiB/s (96.9kB/s)(6348KiB/67070msec); 0 zone resets clat (usec): min=821, max=150117, avg=19739.65, stdev=17656.79 lat (usec): min=869, max=150118, avg=19741.03, stdev=17656.74 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1795], 10.00th=[ 2278], 20.00th=[ 3523], | 30.00th=[ 6325], 40.00th=[ 11863], 50.00th=[ 15795], 60.00th=[ 19792], | 70.00th=[ 25297], 80.00th=[ 32900], 90.00th=[ 44303], 95.00th=[ 55313], | 99.00th=[ 77071], 99.50th=[ 85459], 99.90th=[105382], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 39, max= 176, per=25.16%, avg=93.83, stdev=26.48, samples=133 iops : min= 9, max= 44, avg=22.94, stdev= 6.64, samples=133 lat (usec) : 50=0.20%, 100=0.81%, 250=0.62%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=3.81%, 4=8.11%, 10=9.28%, 20=30.86%, 50=40.17% lat (msec) : 100=5.57%, 250=0.29% cpu : usr=0.11%, sys=14.06%, ctx=7638, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182784: Tue Sep 8 22:34:58 2026 read: IOPS=22, BW=89.5KiB/s (91.6kB/s)(6028KiB/67384msec) clat (usec): min=41, max=108048, avg=24134.83, stdev=13984.97 lat (usec): min=42, max=108049, avg=24136.18, stdev=13985.11 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 7963], 10.00th=[ 10421], 20.00th=[ 12911], | 30.00th=[ 15926], 40.00th=[ 18744], 50.00th=[ 21627], 60.00th=[ 25297], | 70.00th=[ 28705], 80.00th=[ 33817], 90.00th=[ 41157], 95.00th=[ 49546], | 99.00th=[ 68682], 99.50th=[ 86508], 99.90th=[101188], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 25, max= 152, per=24.97%, avg=88.91, stdev=24.62, samples=133 iops : min= 6, max= 38, avg=21.71, stdev= 6.20, samples=133 write: IOPS=23, BW=92.9KiB/s (95.1kB/s)(6260KiB/67384msec); 0 zone resets clat (usec): min=818, max=242774, avg=19762.40, stdev=18561.92 lat (usec): min=819, max=242776, avg=19766.13, stdev=18561.93 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1614], 10.00th=[ 2180], 20.00th=[ 3392], | 30.00th=[ 5145], 40.00th=[ 11076], 50.00th=[ 15664], 60.00th=[ 20579], | 70.00th=[ 26084], 80.00th=[ 33817], 90.00th=[ 43254], 95.00th=[ 52691], | 99.00th=[ 78119], 99.50th=[ 87557], 99.90th=[121111], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 23, max= 160, per=24.71%, avg=92.17, stdev=27.48, samples=133 iops : min= 5, max= 40, avg=22.52, stdev= 6.91, samples=133 lat (usec) : 50=0.07%, 100=1.17%, 250=0.59%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=4.20%, 4=7.71%, 10=9.51%, 20=27.70%, 50=43.59% lat (msec) : 100=4.92%, 250=0.20% cpu : usr=0.13%, sys=13.98%, ctx=7678, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182785: Tue Sep 8 22:34:58 2026 read: IOPS=23, BW=92.2KiB/s (94.5kB/s)(6052KiB/65608msec) clat (usec): min=32, max=170802, avg=23709.90, stdev=14930.98 lat (usec): min=33, max=170803, avg=23712.77, stdev=14930.79 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 7373], 10.00th=[ 10028], 20.00th=[ 13042], | 30.00th=[ 15401], 40.00th=[ 18220], 50.00th=[ 20841], 60.00th=[ 24249], | 70.00th=[ 27395], 80.00th=[ 32637], 90.00th=[ 40109], 95.00th=[ 49021], | 99.00th=[ 79168], 99.50th=[ 94897], 99.90th=[126354], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 25, max= 159, per=25.76%, avg=91.70, stdev=24.87, samples=130 iops : min= 6, max= 39, avg=22.40, stdev= 6.26, samples=130 write: IOPS=23, BW=95.0KiB/s (97.3kB/s)(6236KiB/65608msec); 0 zone resets clat (usec): min=901, max=215475, avg=19011.18, stdev=17121.60 lat (usec): min=903, max=215479, avg=19014.35, stdev=17122.93 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1713], 10.00th=[ 2311], 20.00th=[ 3523], | 30.00th=[ 5866], 40.00th=[ 11469], 50.00th=[ 15533], 60.00th=[ 19268], | 70.00th=[ 24511], 80.00th=[ 31589], 90.00th=[ 42206], 95.00th=[ 52167], | 99.00th=[ 69731], 99.50th=[ 76022], 99.90th=[110625], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 39, max= 181, per=25.32%, avg=94.43, stdev=27.58, samples=130 iops : min= 9, max= 45, avg=23.08, stdev= 6.96, samples=130 lat (usec) : 50=0.16%, 100=1.11%, 250=0.62%, 500=0.07%, 1000=0.07% lat (msec) : 2=3.71%, 4=7.91%, 10=9.93%, 20=30.40%, 50=40.82% lat (msec) : 100=4.95%, 250=0.26% cpu : usr=0.11%, sys=14.30%, ctx=7515, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=356KiB/s (365kB/s), 88.6KiB/s-92.2KiB/s (90.7kB/s-94.5kB/s), io=23.4MiB (24.6MB), run=65608-67384msec WRITE: bw=373KiB/s (382kB/s), 92.9KiB/s-95.0KiB/s (95.1kB/s-97.3kB/s), io=24.6MiB (25.7MB), run=65608-67384msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182777: Tue Sep 8 22:35:16 2026 read: IOPS=17, BW=69.1KiB/s (70.7kB/s)(5992KiB/86774msec) clat (msec): min=4, max=768, avg=23.29, stdev=26.91 lat (msec): min=4, max=768, avg=23.29, stdev=26.91 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 34], 90.00th=[ 51], 95.00th=[ 65], | 99.00th=[ 89], 99.50th=[ 104], 99.90th=[ 127], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8, max= 208, per=24.94%, avg=68.85, stdev=42.90, samples=171 iops : min= 2, max= 52, avg=16.69, stdev=10.77, samples=171 write: IOPS=18, BW=72.6KiB/s (74.3kB/s)(6296KiB/86774msec); 0 zone resets clat (msec): min=7, max=191, avg=32.80, stdev=22.31 lat (msec): min=7, max=191, avg=32.80, stdev=22.31 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 63], 95.00th=[ 77], | 99.00th=[ 116], 99.50th=[ 138], 99.90th=[ 150], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 15, max= 216, per=25.18%, avg=72.77, stdev=40.90, samples=170 iops : min= 3, max= 54, avg=17.67, stdev=10.27, samples=170 lat (msec) : 10=11.85%, 20=37.34%, 50=36.56%, 100=13.12%, 250=1.11% lat (msec) : 1000=0.03% cpu : usr=0.12%, sys=5.30%, ctx=5010, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182778: Tue Sep 8 22:35:16 2026 read: IOPS=17, BW=68.4KiB/s (70.0kB/s)(5940KiB/86876msec) clat (msec): min=4, max=641, avg=23.16, stdev=25.06 lat (msec): min=4, max=641, avg=23.16, stdev=25.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 53], 95.00th=[ 65], | 99.00th=[ 96], 99.50th=[ 109], 99.90th=[ 126], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8, max= 224, per=24.82%, avg=68.51, stdev=44.46, samples=170 iops : min= 2, max= 56, avg=16.61, stdev=11.17, samples=170 write: IOPS=18, BW=73.1KiB/s (74.8kB/s)(6348KiB/86876msec); 0 zone resets clat (msec): min=7, max=167, avg=32.91, stdev=21.72 lat (msec): min=8, max=167, avg=32.91, stdev=21.72 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 62], 95.00th=[ 75], | 99.00th=[ 110], 99.50th=[ 129], 99.90th=[ 150], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 15, max= 200, per=25.08%, avg=72.49, stdev=40.51, samples=171 iops : min= 3, max= 50, avg=17.60, stdev=10.16, samples=171 lat (msec) : 10=13.25%, 20=35.19%, 50=37.17%, 100=13.05%, 250=1.30% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=5.28%, ctx=5039, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182779: Tue Sep 8 22:35:16 2026 read: IOPS=17, BW=69.6KiB/s (71.3kB/s)(6028KiB/86573msec) clat (msec): min=4, max=129, avg=22.83, stdev=18.44 lat (msec): min=4, max=129, avg=22.83, stdev=18.44 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 50], 95.00th=[ 62], | 99.00th=[ 89], 99.50th=[ 97], 99.90th=[ 108], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 15, max= 256, per=25.20%, avg=69.55, stdev=43.11, samples=171 iops : min= 3, max= 64, avg=16.87, stdev=10.81, samples=171 write: IOPS=18, BW=72.3KiB/s (74.0kB/s)(6260KiB/86573msec); 0 zone resets clat (msec): min=8, max=666, avg=33.16, stdev=27.10 lat (msec): min=8, max=666, avg=33.17, stdev=27.10 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 49], 90.00th=[ 62], 95.00th=[ 77], | 99.00th=[ 109], 99.50th=[ 144], 99.90th=[ 190], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 23, max= 200, per=25.00%, avg=72.26, stdev=42.01, samples=171 iops : min= 5, max= 50, avg=17.54, stdev=10.55, samples=171 lat (msec) : 10=12.73%, 20=35.29%, 50=37.79%, 100=13.41%, 250=0.75% lat (msec) : 750=0.03% cpu : usr=0.09%, sys=5.44%, ctx=5047, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182780: Tue Sep 8 22:35:16 2026 read: IOPS=17, BW=70.3KiB/s (71.0kB/s)(6052KiB/86101msec) clat (msec): min=3, max=123, avg=22.80, stdev=18.67 lat (msec): min=3, max=123, avg=22.80, stdev=18.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 50], 95.00th=[ 64], | 99.00th=[ 91], 99.50th=[ 103], 99.90th=[ 121], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 7, max= 232, per=25.62%, avg=70.72, stdev=42.41, samples=169 iops : min= 1, max= 58, avg=17.15, stdev=10.64, samples=169 write: IOPS=18, BW=72.4KiB/s (74.2kB/s)(6236KiB/86101msec); 0 zone resets clat (msec): min=8, max=661, avg=32.93, stdev=26.11 lat (msec): min=8, max=661, avg=32.94, stdev=26.11 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 62], 95.00th=[ 73], | 99.00th=[ 107], 99.50th=[ 118], 99.90th=[ 165], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 23, max= 207, per=25.04%, avg=72.36, stdev=40.44, samples=170 iops : min= 5, max= 51, avg=17.57, stdev=10.15, samples=170 lat (msec) : 4=0.03%, 10=13.09%, 20=34.93%, 50=37.83%, 100=13.18% lat (msec) : 250=0.91%, 750=0.03% cpu : usr=0.11%, sys=5.39%, ctx=5086, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=276KiB/s (283kB/s), 68.4KiB/s-70.3KiB/s (70.0kB/s-71.0kB/s), io=23.4MiB (24.6MB), run=86101-86876msec WRITE: bw=289KiB/s (296kB/s), 72.3KiB/s-73.1KiB/s (74.0kB/s-74.8kB/s), io=24.6MiB (25.7MB), run=86101-86876msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182810: Tue Sep 8 22:35:42 2026 read: IOPS=19, BW=312KiB/s (320kB/s)(5920KiB/18956msec) clat (usec): min=41, max=136782, avg=26706.52, stdev=17196.91 lat (usec): min=43, max=136783, avg=26711.79, stdev=17202.12 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 157], 10.00th=[ 11469], 20.00th=[ 14877], | 30.00th=[ 17433], 40.00th=[ 21103], 50.00th=[ 23725], 60.00th=[ 26870], | 70.00th=[ 30802], 80.00th=[ 35914], 90.00th=[ 46400], 95.00th=[ 53740], | 99.00th=[ 95945], 99.50th=[113771], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 128, max= 510, per=24.24%, avg=306.19, stdev=91.52, samples=37 iops : min= 8, max= 31, avg=18.49, stdev= 5.65, samples=37 write: IOPS=20, BW=336KiB/s (344kB/s)(6368KiB/18956msec); 0 zone resets clat (usec): min=1175, max=116659, avg=22688.17, stdev=18118.02 lat (usec): min=1177, max=116662, avg=22698.86, stdev=18109.83 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 3163], 10.00th=[ 4047], 20.00th=[ 5932], | 30.00th=[ 9634], 40.00th=[ 15008], 50.00th=[ 18482], 60.00th=[ 21890], | 70.00th=[ 29754], 80.00th=[ 38011], 90.00th=[ 47973], 95.00th=[ 59507], | 99.00th=[ 76022], 99.50th=[ 86508], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 63, max= 606, per=25.01%, avg=332.32, stdev=112.24, samples=37 iops : min= 3, max= 37, avg=20.11, stdev= 7.08, samples=37 lat (usec) : 50=0.13%, 100=1.17%, 250=1.43% lat (msec) : 2=1.04%, 4=4.04%, 10=11.85%, 20=26.30%, 50=46.22% lat (msec) : 100=7.42%, 250=0.39% cpu : usr=0.13%, sys=15.30%, ctx=2258, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182811: Tue Sep 8 22:35:42 2026 read: IOPS=19, BW=318KiB/s (325kB/s)(5744KiB/18079msec) clat (usec): min=54, max=95909, avg=25025.52, stdev=14272.81 lat (usec): min=55, max=95911, avg=25026.85, stdev=14272.61 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 124], 10.00th=[10683], 20.00th=[14353], | 30.00th=[17433], 40.00th=[19792], 50.00th=[22414], 60.00th=[26346], | 70.00th=[30016], 80.00th=[36439], 90.00th=[44303], 95.00th=[50594], | 99.00th=[64750], 99.50th=[86508], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 56, max= 544, per=25.08%, avg=316.80, stdev=105.24, samples=35 iops : min= 3, max= 34, avg=19.14, stdev= 6.68, samples=35 write: IOPS=22, BW=362KiB/s (371kB/s)(6544KiB/18079msec); 0 zone resets clat (usec): min=1200, max=108128, avg=21791.77, stdev=17803.93 lat (usec): min=1202, max=108131, avg=21796.17, stdev=17807.60 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2802], 10.00th=[ 3851], 20.00th=[ 5735], | 30.00th=[ 9503], 40.00th=[ 14222], 50.00th=[ 17171], 60.00th=[ 21365], | 70.00th=[ 27657], 80.00th=[ 35390], 90.00th=[ 45351], 95.00th=[ 53740], | 99.00th=[ 81265], 99.50th=[ 89654], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 191, max= 574, per=26.72%, avg=355.09, stdev=100.10, samples=35 iops : min= 11, max= 35, avg=21.54, stdev= 6.26, samples=35 lat (usec) : 100=1.17%, 250=1.69%, 500=0.26% lat (msec) : 2=0.65%, 4=5.34%, 10=11.98%, 20=28.26%, 50=44.40% lat (msec) : 100=5.99%, 250=0.26% cpu : usr=0.12%, sys=16.27%, ctx=2128, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182812: Tue Sep 8 22:35:42 2026 read: IOPS=21, BW=344KiB/s (352kB/s)(6256KiB/18186msec) clat (usec): min=52, max=110171, avg=25475.94, stdev=15610.06 lat (usec): min=53, max=110172, avg=25477.05, stdev=15610.10 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 113], 10.00th=[ 11207], 20.00th=[ 14615], | 30.00th=[ 17957], 40.00th=[ 20317], 50.00th=[ 23462], 60.00th=[ 26084], | 70.00th=[ 29492], 80.00th=[ 34341], 90.00th=[ 44303], 95.00th=[ 55313], | 99.00th=[ 83362], 99.50th=[ 89654], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 159, max= 510, per=27.34%, avg=345.33, stdev=86.36, samples=36 iops : min= 9, max= 31, avg=20.94, stdev= 5.31, samples=36 write: IOPS=20, BW=332KiB/s (340kB/s)(6032KiB/18186msec); 0 zone resets clat (usec): min=1371, max=97583, avg=21403.74, stdev=17322.10 lat (usec): min=1374, max=97585, avg=21405.95, stdev=17321.98 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2737], 10.00th=[ 3654], 20.00th=[ 5932], | 30.00th=[10290], 40.00th=[13566], 50.00th=[16712], 60.00th=[20841], | 70.00th=[26346], 80.00th=[35390], 90.00th=[45351], 95.00th=[54264], | 99.00th=[81265], 99.50th=[94897], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 159, max= 512, per=24.77%, avg=329.25, stdev=102.89, samples=36 iops : min= 9, max= 32, avg=19.92, stdev= 6.49, samples=36 lat (usec) : 100=1.95%, 250=1.43%, 500=0.13% lat (msec) : 2=0.78%, 4=5.21%, 10=9.64%, 20=28.65%, 50=45.57% lat (msec) : 100=6.51%, 250=0.13% cpu : usr=0.10%, sys=15.64%, ctx=2155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182813: Tue Sep 8 22:35:42 2026 read: IOPS=20, BW=335KiB/s (343kB/s)(6032KiB/18031msec) clat (usec): min=43, max=125650, avg=25767.33, stdev=16893.07 lat (usec): min=44, max=125652, avg=25768.37, stdev=16893.09 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 129], 10.00th=[ 10421], 20.00th=[ 14091], | 30.00th=[ 17171], 40.00th=[ 19530], 50.00th=[ 22676], 60.00th=[ 26870], | 70.00th=[ 31065], 80.00th=[ 35914], 90.00th=[ 43254], 95.00th=[ 53216], | 99.00th=[ 87557], 99.50th=[111674], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 190, max= 479, per=26.16%, avg=330.37, stdev=75.93, samples=35 iops : min= 11, max= 29, avg=20.00, stdev= 4.71, samples=35 write: IOPS=21, BW=347KiB/s (355kB/s)(6256KiB/18031msec); 0 zone resets clat (usec): min=1533, max=107700, avg=20896.60, stdev=17872.97 lat (usec): min=1535, max=107701, avg=20898.83, stdev=17872.69 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2573], 10.00th=[ 3425], 20.00th=[ 4817], | 30.00th=[ 7439], 40.00th=[ 13042], 50.00th=[ 16188], 60.00th=[ 20317], | 70.00th=[ 27132], 80.00th=[ 33817], 90.00th=[ 46400], 95.00th=[ 58459], | 99.00th=[ 71828], 99.50th=[ 88605], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 191, max= 638, per=26.01%, avg=345.71, stdev=93.21, samples=35 iops : min= 11, max= 39, avg=20.94, stdev= 5.84, samples=35 lat (usec) : 50=0.26%, 100=1.56%, 250=1.69%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.04%, 4=5.60%, 10=12.37%, 20=27.21%, 50=41.93% lat (msec) : 100=7.55%, 250=0.39% cpu : usr=0.09%, sys=15.43%, ctx=2001, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1264KiB/s (1294kB/s), 312KiB/s-344KiB/s (320kB/s-352kB/s), io=23.4MiB (24.5MB), run=18031-18956msec WRITE: bw=1329KiB/s (1361kB/s), 332KiB/s-362KiB/s (340kB/s-371kB/s), io=24.6MiB (25.8MB), run=18031-18956msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182814: Tue Sep 8 22:35:47 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(5920KiB/23789msec) clat (usec): min=5811, max=98315, avg=23383.61, stdev=16856.78 lat (usec): min=5811, max=98333, avg=23384.79, stdev=16856.97 clat percentiles (usec): | 1.00th=[ 6587], 5.00th=[ 8586], 10.00th=[ 9896], 20.00th=[11469], | 30.00th=[13173], 40.00th=[15533], 50.00th=[17957], 60.00th=[20579], | 70.00th=[24773], 80.00th=[32637], 90.00th=[43779], 95.00th=[60031], | 99.00th=[92799], 99.50th=[96994], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 95, max= 606, per=24.60%, avg=246.53, stdev=123.91, samples=47 iops : min= 5, max= 37, avg=14.81, stdev= 7.77, samples=47 write: IOPS=16, BW=268KiB/s (274kB/s)(6368KiB/23789msec); 0 zone resets clat (msec): min=12, max=156, avg=37.59, stdev=22.41 lat (msec): min=12, max=156, avg=37.60, stdev=22.41 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 70], 95.00th=[ 81], | 99.00th=[ 121], 99.50th=[ 144], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 64, max= 606, per=25.25%, avg=266.34, stdev=109.50, samples=47 iops : min= 4, max= 37, avg=16.04, stdev= 6.85, samples=47 lat (msec) : 10=5.08%, 20=31.64%, 50=48.44%, 100=13.54%, 250=1.30% cpu : usr=0.15%, sys=5.33%, ctx=1275, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182815: Tue Sep 8 22:35:47 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(5744KiB/23716msec) clat (msec): min=6, max=132, avg=23.73, stdev=18.74 lat (msec): min=6, max=132, avg=23.73, stdev=18.74 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 49], 95.00th=[ 67], | 99.00th=[ 96], 99.50th=[ 109], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 32, max= 670, per=24.07%, avg=241.15, stdev=124.59, samples=47 iops : min= 2, max= 41, avg=14.47, stdev= 7.69, samples=47 write: IOPS=17, BW=276KiB/s (283kB/s)(6544KiB/23716msec); 0 zone resets clat (msec): min=11, max=185, avg=36.97, stdev=21.96 lat (msec): min=11, max=185, avg=36.97, stdev=21.96 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 67], 95.00th=[ 79], | 99.00th=[ 108], 99.50th=[ 144], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 63, max= 574, per=26.09%, avg=275.28, stdev=122.24, samples=47 iops : min= 3, max= 35, avg=16.60, stdev= 7.63, samples=47 lat (msec) : 10=5.73%, 20=30.73%, 50=48.31%, 100=14.19%, 250=1.04% cpu : usr=0.11%, sys=5.30%, ctx=1274, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182816: Tue Sep 8 22:35:47 2026 read: IOPS=16, BW=262KiB/s (268kB/s)(6256KiB/23883msec) clat (msec): min=5, max=130, avg=25.48, stdev=19.80 lat (msec): min=5, max=130, avg=25.48, stdev=19.80 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 37], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 93], 99.50th=[ 97], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 63, max= 637, per=26.03%, avg=260.79, stdev=147.52, samples=47 iops : min= 3, max= 39, avg=15.70, stdev= 9.24, samples=47 write: IOPS=15, BW=253KiB/s (259kB/s)(6032KiB/23883msec); 0 zone resets clat (msec): min=10, max=132, avg=36.39, stdev=22.07 lat (msec): min=10, max=132, avg=36.39, stdev=22.07 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 68], 95.00th=[ 86], | 99.00th=[ 114], 99.50th=[ 125], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 95, max= 670, per=23.42%, avg=247.13, stdev=117.90, samples=47 iops : min= 5, max= 41, avg=14.85, stdev= 7.33, samples=47 lat (msec) : 10=5.08%, 20=36.07%, 50=40.49%, 100=16.93%, 250=1.43% cpu : usr=0.09%, sys=5.22%, ctx=1284, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182817: Tue Sep 8 22:35:47 2026 read: IOPS=15, BW=254KiB/s (260kB/s)(6032KiB/23765msec) clat (msec): min=5, max=118, avg=24.77, stdev=19.56 lat (msec): min=5, max=118, avg=24.78, stdev=19.56 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 37], 90.00th=[ 53], 95.00th=[ 70], | 99.00th=[ 95], 99.50th=[ 105], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 96, max= 670, per=25.07%, avg=251.21, stdev=137.70, samples=47 iops : min= 6, max= 41, avg=15.11, stdev= 8.51, samples=47 write: IOPS=16, BW=263KiB/s (270kB/s)(6256KiB/23765msec); 0 zone resets clat (msec): min=11, max=174, avg=36.49, stdev=20.09 lat (msec): min=11, max=174, avg=36.49, stdev=20.09 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 62], 95.00th=[ 77], | 99.00th=[ 93], 99.50th=[ 107], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 127, max= 608, per=24.97%, avg=263.43, stdev=123.52, samples=47 iops : min= 7, max= 38, avg=15.85, stdev= 7.75, samples=47 lat (msec) : 10=6.25%, 20=32.55%, 50=43.49%, 100=16.93%, 250=0.78% cpu : usr=0.07%, sys=5.35%, ctx=1266, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1003KiB/s (1027kB/s), 242KiB/s-262KiB/s (248kB/s-268kB/s), io=23.4MiB (24.5MB), run=23716-23883msec WRITE: bw=1055KiB/s (1080kB/s), 253KiB/s-276KiB/s (259kB/s-283kB/s), io=24.6MiB (25.8MB), run=23716-23883msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182826: Tue Sep 8 22:35:57 2026 read: IOPS=2, BW=3023KiB/s (3096kB/s)(7168KiB/2371msec) clat (usec): min=678, max=401552, avg=174232.37, stdev=128355.24 lat (usec): min=679, max=401554, avg=174233.96, stdev=128355.18 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 98042], | 30.00th=[105382], 40.00th=[105382], 50.00th=[160433], 60.00th=[208667], | 70.00th=[208667], 80.00th=[244319], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 2000, max= 4087, per=63.55%, avg=3250.00, stdev=1103.10, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2159KiB/s (2211kB/s)(5120KiB/2371msec); 0 zone resets clat (msec): min=92, max=341, avg=222.13, stdev=112.74 lat (msec): min=92, max=341, avg=222.22, stdev=112.74 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 176], 60.00th=[ 176], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 2000, max= 3605, per=35.61%, avg=2549.33, stdev=914.49, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=45.86%, ctx=493, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182827: Tue Sep 8 22:35:57 2026 read: IOPS=0, BW=511KiB/s (524kB/s)(2048KiB/4004msec) clat (msec): min=223, max=551, avg=387.67, stdev=231.72 lat (msec): min=223, max=551, avg=387.68, stdev=231.73 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2000, max= 2048, per=39.58%, avg=2024.00, stdev=33.94, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2557KiB/s (2619kB/s)(10.0MiB/4004msec); 0 zone resets clat (msec): min=87, max=880, avg=319.58, stdev=257.38 lat (msec): min=87, max=880, avg=319.68, stdev=257.42 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 97], | 30.00th=[ 114], 40.00th=[ 174], 50.00th=[ 186], 60.00th=[ 284], | 70.00th=[ 363], 80.00th=[ 397], 90.00th=[ 617], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1802, max= 4096, per=38.54%, avg=2759.40, stdev=1117.54, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=34.12%, ctx=274, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182828: Tue Sep 8 22:35:57 2026 read: IOPS=1, BW=1869KiB/s (1913kB/s)(6144KiB/3288msec) clat (usec): min=643, max=500566, avg=186032.75, stdev=183819.07 lat (usec): min=646, max=500567, avg=186034.07, stdev=183818.58 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 742], | 30.00th=[ 742], 40.00th=[191890], 50.00th=[191890], 60.00th=[208667], | 70.00th=[212861], 80.00th=[212861], 90.00th=[501220], 95.00th=[501220], | 99.00th=[501220], 99.50th=[501220], 99.90th=[501220], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 1802, max= 4096, per=65.08%, avg=3328.33, stdev=1321.85, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1869KiB/s (1913kB/s)(6144KiB/3288msec); 0 zone resets clat (msec): min=168, max=610, avg=358.77, stdev=156.87 lat (msec): min=168, max=610, avg=358.86, stdev=156.87 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 376], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1802, max= 3650, per=31.92%, avg=2285.60, stdev=768.34, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=36.81%, ctx=333, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182829: Tue Sep 8 22:35:57 2026 read: IOPS=1, BW=1689KiB/s (1730kB/s)(5120KiB/3031msec) clat (usec): min=491, max=184763, avg=53651.52, stdev=81243.55 lat (usec): min=492, max=184764, avg=53652.26, stdev=81243.56 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 494], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 832], 60.00th=[ 832], | 70.00th=[ 81265], 80.00th=[ 81265], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2365KiB/s (2422kB/s)(7168KiB/3031msec); 0 zone resets clat (msec): min=114, max=548, avg=389.98, stdev=177.70 lat (msec): min=115, max=548, avg=390.05, stdev=177.69 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 174], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 422], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1802, max= 4087, per=36.73%, avg=2629.67, stdev=1265.96, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=36.01%, ctx=299, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5115KiB/s (5238kB/s), 511KiB/s-3023KiB/s (524kB/s-3096kB/s), io=20.0MiB (20.0MB), run=2371-4004msec WRITE: bw=7161KiB/s (7333kB/s), 1869KiB/s-2557KiB/s (1913kB/s-2619kB/s), io=28.0MiB (29.4MB), run=2371-4004msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182831: Tue Sep 8 22:35:57 2026 read: IOPS=2, BW=2060KiB/s (2109kB/s)(7168KiB/3480msec) clat (msec): min=68, max=477, avg=189.86, stdev=144.44 lat (msec): min=68, max=477, avg=189.86, stdev=144.44 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 89], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 136], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 279], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1992, max= 3683, per=48.22%, avg=2428.25, stdev=836.65, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1471KiB/s (1507kB/s)(5120KiB/3480msec); 0 zone resets clat (msec): min=99, max=693, avg=414.76, stdev=230.89 lat (msec): min=100, max=693, avg=414.94, stdev=230.76 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1992, max= 2039, per=28.60%, avg=2016.67, stdev=23.59, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=13.60%, ctx=224, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182832: Tue Sep 8 22:35:57 2026 read: IOPS=0, BW=504KiB/s (516kB/s)(2048KiB/4066msec) clat (msec): min=83, max=494, avg=289.02, stdev=290.97 lat (msec): min=83, max=494, avg=289.02, stdev=290.97 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1992, max= 2048, per=40.11%, avg=2020.00, stdev=39.60, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2518KiB/s (2579kB/s)(10.0MiB/4066msec); 0 zone resets clat (msec): min=86, max=1097, avg=341.56, stdev=341.71 lat (msec): min=87, max=1097, avg=341.65, stdev=341.71 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 103], | 30.00th=[ 105], 40.00th=[ 114], 50.00th=[ 144], 60.00th=[ 201], | 70.00th=[ 288], 80.00th=[ 575], 90.00th=[ 709], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 2007, max= 4096, per=43.19%, avg=3045.25, stdev=1180.69, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=15.65%, ctx=309, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182833: Tue Sep 8 22:35:57 2026 read: IOPS=1, BW=1683KiB/s (1724kB/s)(6144KiB/3650msec) clat (msec): min=75, max=403, avg=258.67, stdev=156.42 lat (msec): min=75, max=403, avg=258.67, stdev=156.42 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 384], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2007, max= 4096, per=50.44%, avg=2540.25, stdev=1037.25, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1683KiB/s (1724kB/s)(6144KiB/3650msec); 0 zone resets clat (msec): min=100, max=891, avg=344.36, stdev=297.70 lat (msec): min=100, max=892, avg=344.46, stdev=297.67 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 209], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1992, max= 2048, per=28.62%, avg=2018.00, stdev=22.75, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=15.21%, ctx=159, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182834: Tue Sep 8 22:35:57 2026 read: IOPS=1, BW=1310KiB/s (1342kB/s)(5120KiB/3908msec) clat (msec): min=56, max=102, avg=78.94, stdev=17.27 lat (msec): min=56, max=102, avg=78.94, stdev=17.27 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 82], 60.00th=[ 82], | 70.00th=[ 85], 80.00th=[ 85], 90.00th=[ 103], 95.00th=[ 103], | 99.00th=[ 103], 99.50th=[ 103], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1834KiB/s (1878kB/s)(7168KiB/3908msec); 0 zone resets clat (msec): min=116, max=1088, avg=492.82, stdev=357.64 lat (msec): min=116, max=1088, avg=493.07, stdev=357.50 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 118], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 609], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 651], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1992, max= 2048, per=28.66%, avg=2021.00, stdev=22.88, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=33.33%, 250=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=13.57%, ctx=179, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5037KiB/s (5158kB/s), 504KiB/s-2060KiB/s (516kB/s-2109kB/s), io=20.0MiB (20.0MB), run=3480-4066msec WRITE: bw=7052KiB/s (7221kB/s), 1471KiB/s-2518KiB/s (1507kB/s-2579kB/s), io=28.0MiB (29.4MB), run=3480-4066msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182841: Tue Sep 8 22:36:06 2026 read: IOPS=1, BW=5373KiB/s (5502kB/s)(12.0MiB/2287msec) clat (msec): min=211, max=1215, avg=752.12, stdev=506.54 lat (msec): min=211, max=1215, avg=752.12, stdev=506.54 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.49%, ctx=82, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182842: Tue Sep 8 22:36:06 2026 read: IOPS=0, BW=1616KiB/s (1655kB/s)(4096KiB/2534msec) clat (nsec): min=855208k, max=855208k, avg=855208203.00, stdev= 0.00 lat (nsec): min=855211k, max=855211k, avg=855210589.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3233KiB/s (3310kB/s)(8192KiB/2534msec); 0 zone resets clat (msec): min=146, max=1479, avg=813.02, stdev=942.14 lat (msec): min=147, max=1479, avg=813.35, stdev=942.17 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=10.50%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182843: Tue Sep 8 22:36:06 2026 write: IOPS=2, BW=9958KiB/s (10.2MB/s)(12.0MiB/1234msec); 0 zone resets clat (msec): min=193, max=585, avg=392.02, stdev=195.95 lat (msec): min=194, max=586, avg=392.45, stdev=195.98 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min=10966, max=10966, per=84.80%, avg=10966.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.08%, sys=21.57%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182844: Tue Sep 8 22:36:06 2026 write: IOPS=1, BW=6289KiB/s (6440kB/s)(12.0MiB/1954msec); 0 zone resets clat (msec): min=194, max=949, avg=641.24, stdev=396.07 lat (msec): min=194, max=949, avg=641.72, stdev=396.18 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 6168, max= 8175, per=55.46%, avg=7171.50, stdev=1419.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.05%, sys=13.62%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6466KiB/s (6621kB/s), 1616KiB/s-5373KiB/s (1655kB/s-5502kB/s), io=16.0MiB (16.8MB), run=2287-2534msec WRITE: bw=12.6MiB/s (13.2MB/s), 3233KiB/s-9958KiB/s (3310kB/s-10.2MB/s), io=32.0MiB (33.6MB), run=1234-2534msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182845: Tue Sep 8 22:36:06 2026 read: IOPS=1, BW=6327KiB/s (6479kB/s)(12.0MiB/1942msec) clat (msec): min=585, max=643, avg=620.36, stdev=31.18 lat (msec): min=585, max=643, avg=620.37, stdev=31.18 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 5626, max= 8078, per=93.94%, avg=6852.00, stdev=1733.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=43.69%, ctx=925, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182846: Tue Sep 8 22:36:06 2026 read: IOPS=0, BW=1824KiB/s (1867kB/s)(4096KiB/2246msec) clat (nsec): min=509058k, max=509058k, avg=509057841.00, stdev= 0.00 lat (nsec): min=509061k, max=509061k, avg=509060959.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 6206, max= 6206, per=85.08%, avg=6206.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3647KiB/s (3735kB/s)(8192KiB/2246msec); 0 zone resets clat (msec): min=465, max=1120, avg=793.12, stdev=462.80 lat (msec): min=466, max=1120, avg=793.57, stdev=462.87 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8159, max= 8159, per=60.81%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.24%, ctx=351, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182847: Tue Sep 8 22:36:06 2026 write: IOPS=1, BW=5032KiB/s (5153kB/s)(12.0MiB/2442msec); 0 zone resets clat (msec): min=253, max=1273, avg=742.17, stdev=511.32 lat (msec): min=253, max=1273, avg=742.47, stdev=511.31 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8078, max= 8159, per=60.50%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.32%, ctx=78, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182848: Tue Sep 8 22:36:06 2026 write: IOPS=1, BW=5637KiB/s (5772kB/s)(12.0MiB/2180msec); 0 zone resets clat (msec): min=372, max=1205, avg=659.98, stdev=472.75 lat (msec): min=372, max=1205, avg=660.23, stdev=472.69 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 5851, max= 5851, per=43.61%, avg=5851.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.26%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7295KiB/s (7470kB/s), 1824KiB/s-6327KiB/s (1867kB/s-6479kB/s), io=16.0MiB (16.8MB), run=1942-2246msec WRITE: bw=13.1MiB/s (13.7MB/s), 3647KiB/s-5637KiB/s (3735kB/s-5772kB/s), io=32.0MiB (33.6MB), run=2180-2442msec