== sanity test 398b: DIO and buffer IO race ============== 12:27:21 (1790785641) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.07896 s, 9.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180175: Wed Sep 30 12:29:46 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5992KiB/126730msec) clat (usec): min=35, max=378292, avg=47153.05, stdev=33286.62 lat (usec): min=35, max=378292, avg=47154.81, stdev=33287.35 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11600], 10.00th=[ 16188], 20.00th=[ 22414], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 55837], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[162530], 99.50th=[189793], 99.90th=[252707], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 103, per=25.01%, avg=46.76, stdev=19.19, samples=250 iops : min= 1, max= 25, avg=11.03, stdev= 4.83, samples=250 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6296KiB/126730msec); 0 zone resets clat (usec): min=943, max=522163, avg=35466.49, stdev=38886.74 lat (usec): min=944, max=522164, avg=35480.78, stdev=38889.61 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1516], 20.00th=[ 3359], | 30.00th=[ 7111], 40.00th=[ 15926], 50.00th=[ 25297], 60.00th=[ 34341], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[109577], | 99.00th=[173016], 99.50th=[198181], 99.90th=[244319], 99.95th=[522191], | 99.99th=[522191] bw ( KiB/s): min= 7, max= 178, per=25.40%, avg=49.53, stdev=24.32, samples=248 iops : min= 1, max= 44, avg=11.72, stdev= 6.12, samples=248 lat (usec) : 50=0.23%, 100=1.24%, 250=0.23%, 750=0.03%, 1000=0.16% lat (msec) : 2=6.54%, 4=4.46%, 10=6.61%, 20=10.77%, 50=38.18% lat (msec) : 100=25.39%, 250=6.05%, 500=0.07%, 750=0.03% cpu : usr=0.06%, sys=4.58%, ctx=6493, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180176: Wed Sep 30 12:29:46 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5940KiB/125629msec) clat (usec): min=43, max=223968, avg=45501.00, stdev=30138.62 lat (usec): min=44, max=223969, avg=45503.43, stdev=30139.31 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12518], 10.00th=[ 16909], 20.00th=[ 22414], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[156238], 99.50th=[177210], 99.90th=[217056], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 6, max= 110, per=25.22%, avg=47.16, stdev=19.58, samples=246 iops : min= 1, max= 27, avg=11.13, stdev= 4.93, samples=246 write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6348KiB/125629msec); 0 zone resets clat (usec): min=917, max=538217, avg=36408.93, stdev=40831.21 lat (usec): min=919, max=538218, avg=36420.13, stdev=40878.40 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1500], 20.00th=[ 3654], | 30.00th=[ 7177], 40.00th=[ 15926], 50.00th=[ 25297], 60.00th=[ 35390], | 70.00th=[ 46924], 80.00th=[ 61604], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[177210], 99.50th=[191890], 99.90th=[299893], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 6, max= 173, per=25.76%, avg=50.23, stdev=23.56, samples=247 iops : min= 1, max= 43, avg=11.90, stdev= 5.93, samples=247 lat (usec) : 50=0.16%, 100=1.04%, 250=0.10%, 750=0.03%, 1000=0.16% lat (msec) : 2=6.45%, 4=4.36%, 10=7.23%, 20=10.58%, 50=39.55% lat (msec) : 100=24.02%, 250=6.22%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=4.63%, ctx=6517, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180177: Wed Sep 30 12:29:46 2026 read: IOPS=12, BW=48.1KiB/s (49.3kB/s)(6028KiB/125263msec) clat (usec): min=33, max=273640, avg=46502.53, stdev=31613.51 lat (usec): min=34, max=273640, avg=46505.71, stdev=31611.87 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10814], 10.00th=[ 16712], 20.00th=[ 22676], | 30.00th=[ 28181], 40.00th=[ 33424], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[156238], 99.50th=[200279], 99.90th=[227541], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 112, per=25.67%, avg=48.00, stdev=19.56, samples=245 iops : min= 1, max= 28, avg=11.34, stdev= 4.92, samples=245 write: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6260KiB/125263msec); 0 zone resets clat (usec): min=917, max=532596, avg=35030.47, stdev=39197.47 lat (usec): min=917, max=532599, avg=35039.25, stdev=39195.38 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1582], 20.00th=[ 3523], | 30.00th=[ 6718], 40.00th=[ 15533], 50.00th=[ 24511], 60.00th=[ 31851], | 70.00th=[ 44827], 80.00th=[ 61604], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[168821], 99.50th=[187696], 99.90th=[316670], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 7, max= 136, per=25.45%, avg=49.62, stdev=22.93, samples=246 iops : min= 1, max= 34, avg=11.74, stdev= 5.77, samples=246 lat (usec) : 50=0.26%, 100=1.69%, 250=0.03%, 1000=0.13% lat (msec) : 2=6.58%, 4=4.65%, 10=6.87%, 20=9.86%, 50=38.90% lat (msec) : 100=25.49%, 250=5.40%, 500=0.10%, 750=0.03% cpu : usr=0.06%, sys=4.56%, ctx=6485, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180178: Wed Sep 30 12:29:46 2026 read: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6052KiB/128272msec) clat (usec): min=34, max=299326, avg=45906.12, stdev=31942.33 lat (usec): min=34, max=299328, avg=45911.36, stdev=31943.00 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9765], 10.00th=[ 16319], 20.00th=[ 21890], | 30.00th=[ 27395], 40.00th=[ 32637], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[158335], 99.50th=[185598], 99.90th=[283116], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 118, per=25.12%, avg=46.98, stdev=18.31, samples=251 iops : min= 1, max= 29, avg=11.08, stdev= 4.61, samples=251 write: IOPS=12, BW=48.6KiB/s (49.8kB/s)(6236KiB/128272msec); 0 zone resets clat (usec): min=886, max=613973, avg=37540.62, stdev=41926.87 lat (usec): min=887, max=613974, avg=37545.09, stdev=41926.59 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1205], 10.00th=[ 1647], 20.00th=[ 3720], | 30.00th=[ 8029], 40.00th=[ 17957], 50.00th=[ 26346], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 63177], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[185598], 99.50th=[200279], 99.90th=[299893], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 142, per=24.70%, avg=48.17, stdev=20.49, samples=252 iops : min= 1, max= 35, avg=11.38, stdev= 5.16, samples=252 lat (usec) : 50=0.33%, 100=1.73%, 250=0.10%, 1000=0.20% lat (msec) : 2=5.99%, 4=4.49%, 10=6.02%, 20=10.32%, 50=39.58% lat (msec) : 100=24.90%, 250=6.09%, 500=0.23%, 750=0.03% cpu : usr=0.07%, sys=4.50%, ctx=6524, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=187KiB/s (192kB/s), 47.2KiB/s-48.1KiB/s (48.3kB/s-49.3kB/s), io=23.4MiB (24.6MB), run=125263-128272msec WRITE: bw=196KiB/s (201kB/s), 48.6KiB/s-50.5KiB/s (49.8kB/s-51.7kB/s), io=24.6MiB (25.7MB), run=125263-128272msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180170: Wed Sep 30 12:30:19 2026 read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(5992KiB/160295msec) clat (msec): min=4, max=787, avg=41.30, stdev=43.71 lat (msec): min=4, max=787, avg=41.30, stdev=43.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 60], 90.00th=[ 93], 95.00th=[ 123], | 99.00th=[ 197], 99.50th=[ 224], 99.90th=[ 334], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 151, per=25.27%, avg=37.65, stdev=27.97, samples=308 iops : min= 1, max= 37, avg= 8.73, stdev= 7.04, samples=308 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6296KiB/160295msec); 0 zone resets clat (msec): min=9, max=338, avg=62.32, stdev=48.12 lat (msec): min=9, max=338, avg=62.32, stdev=48.12 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 93], 90.00th=[ 123], 95.00th=[ 163], | 99.00th=[ 243], 99.50th=[ 264], 99.90th=[ 309], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 144, per=24.99%, avg=38.99, stdev=27.50, samples=313 iops : min= 1, max= 36, avg= 9.07, stdev= 6.93, samples=313 lat (msec) : 10=3.94%, 20=17.97%, 50=42.22%, 100=22.95%, 250=12.37% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.04%, sys=1.75%, ctx=4687, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180171: Wed Sep 30 12:30:19 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(5940KiB/160862msec) clat (msec): min=4, max=578, avg=42.10, stdev=43.91 lat (msec): min=4, max=578, avg=42.10, stdev=43.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 136], | 99.00th=[ 209], 99.50th=[ 234], 99.90th=[ 351], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 151, per=25.38%, avg=37.82, stdev=28.57, samples=306 iops : min= 1, max= 37, avg= 8.78, stdev= 7.19, samples=306 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6348KiB/160862msec); 0 zone resets clat (msec): min=9, max=317, avg=61.75, stdev=46.47 lat (msec): min=9, max=317, avg=61.76, stdev=46.47 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 127], 95.00th=[ 150], | 99.00th=[ 228], 99.50th=[ 266], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 135, per=25.26%, avg=39.40, stdev=26.74, samples=314 iops : min= 1, max= 33, avg= 9.18, stdev= 6.75, samples=314 lat (msec) : 10=3.19%, 20=17.90%, 50=43.26%, 100=22.30%, 250=12.79% lat (msec) : 500=0.52%, 750=0.03% cpu : usr=0.05%, sys=1.70%, ctx=4776, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180172: Wed Sep 30 12:30:19 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6028KiB/160929msec) clat (msec): min=4, max=336, avg=41.46, stdev=40.68 lat (msec): min=4, max=336, avg=41.47, stdev=40.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 125], | 99.00th=[ 199], 99.50th=[ 228], 99.90th=[ 321], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 167, per=25.56%, avg=38.09, stdev=28.59, samples=308 iops : min= 1, max= 41, avg= 8.85, stdev= 7.19, samples=308 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6260KiB/160929msec); 0 zone resets clat (msec): min=10, max=590, avg=62.69, stdev=51.63 lat (msec): min=10, max=590, avg=62.69, stdev=51.63 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 74], 80.00th=[ 94], 90.00th=[ 128], 95.00th=[ 165], | 99.00th=[ 251], 99.50th=[ 313], 99.90th=[ 405], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 159, per=24.95%, avg=38.92, stdev=27.83, samples=313 iops : min= 1, max= 39, avg= 9.05, stdev= 7.01, samples=313 lat (msec) : 10=4.07%, 20=18.10%, 50=42.97%, 100=21.45%, 250=12.73% lat (msec) : 500=0.65%, 750=0.03% cpu : usr=0.05%, sys=1.73%, ctx=4791, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180173: Wed Sep 30 12:30:19 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6052KiB/160932msec) clat (msec): min=5, max=362, avg=41.97, stdev=41.96 lat (msec): min=5, max=362, avg=41.97, stdev=41.96 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 101], 95.00th=[ 132], | 99.00th=[ 199], 99.50th=[ 243], 99.90th=[ 321], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 167, per=26.22%, avg=39.07, stdev=28.60, samples=302 iops : min= 1, max= 41, avg= 9.08, stdev= 7.19, samples=302 write: IOPS=9, BW=38.7KiB/s (39.7kB/s)(6236KiB/160932msec); 0 zone resets clat (msec): min=9, max=593, avg=62.27, stdev=50.32 lat (msec): min=9, max=593, avg=62.27, stdev=50.32 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 56], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 128], 95.00th=[ 161], | 99.00th=[ 226], 99.50th=[ 266], 99.90th=[ 401], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 127, per=24.78%, avg=38.66, stdev=27.00, samples=314 iops : min= 1, max= 31, avg= 8.98, stdev= 6.80, samples=314 lat (msec) : 10=3.74%, 20=18.23%, 50=43.29%, 100=20.41%, 250=13.74% lat (msec) : 500=0.55%, 750=0.03% cpu : usr=0.05%, sys=1.65%, ctx=4791, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 36.9KiB/s-37.6KiB/s (37.8kB/s-38.5kB/s), io=23.4MiB (24.6MB), run=160295-160932msec WRITE: bw=156KiB/s (160kB/s), 38.7KiB/s-39.5KiB/s (39.7kB/s-40.4kB/s), io=24.6MiB (25.7MB), run=160295-160932msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180227: Wed Sep 30 12:30:58 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5920KiB/30375msec) clat (usec): min=44, max=187744, avg=43133.44, stdev=31474.52 lat (usec): min=44, max=187745, avg=43139.04, stdev=31477.15 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 7898], 20.00th=[ 21890], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[170918], 99.50th=[170918], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 61, max= 380, per=25.22%, avg=190.93, stdev=71.88, samples=59 iops : min= 3, max= 23, avg=11.20, stdev= 4.59, samples=59 write: IOPS=13, BW=210KiB/s (215kB/s)(6368KiB/30375msec); 0 zone resets clat (usec): min=1452, max=156619, avg=35931.12, stdev=34450.36 lat (usec): min=1453, max=156621, avg=35936.09, stdev=34454.97 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1909], 10.00th=[ 2802], 20.00th=[ 5145], | 30.00th=[ 9634], 40.00th=[ 18482], 50.00th=[ 26084], 60.00th=[ 33817], | 70.00th=[ 46924], 80.00th=[ 61604], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[147850], 99.50th=[152044], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 31, max= 471, per=26.02%, avg=207.14, stdev=91.45, samples=59 iops : min= 1, max= 29, avg=12.22, stdev= 5.74, samples=59 lat (usec) : 50=0.39%, 100=3.65%, 250=0.26%, 500=0.26% lat (msec) : 2=3.12%, 4=4.69%, 10=8.20%, 20=8.98%, 50=39.58% lat (msec) : 100=25.26%, 250=5.60% cpu : usr=0.05%, sys=4.93%, ctx=1683, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180228: Wed Sep 30 12:30:58 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(5744KiB/30883msec) clat (usec): min=40, max=207221, avg=45713.99, stdev=29231.74 lat (usec): min=40, max=207222, avg=45715.11, stdev=29231.81 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 15533], 20.00th=[ 23462], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 48497], | 70.00th=[ 56361], 80.00th=[ 64226], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[128451], 99.50th=[191890], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 347, per=24.35%, avg=184.30, stdev=68.87, samples=60 iops : min= 1, max= 21, avg=10.78, stdev= 4.32, samples=60 write: IOPS=13, BW=212KiB/s (217kB/s)(6544KiB/30883msec); 0 zone resets clat (usec): min=1652, max=233718, avg=34885.83, stdev=33603.12 lat (usec): min=1654, max=233719, avg=34887.90, stdev=33603.07 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2409], 10.00th=[ 3949], 20.00th=[ 6521], | 30.00th=[ 10945], 40.00th=[ 17957], 50.00th=[ 23725], 60.00th=[ 32900], | 70.00th=[ 45351], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[107480], | 99.00th=[139461], 99.50th=[158335], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 63, max= 411, per=26.16%, avg=208.20, stdev=84.04, samples=60 iops : min= 3, max= 25, avg=12.30, stdev= 5.28, samples=60 lat (usec) : 50=0.26%, 100=2.73%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.08%, 4=4.04%, 10=8.98%, 20=10.94%, 50=38.15% lat (msec) : 100=26.82%, 250=5.47% cpu : usr=0.06%, sys=5.15%, ctx=1694, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180229: Wed Sep 30 12:30:58 2026 read: IOPS=12, BW=198KiB/s (202kB/s)(6256KiB/31639msec) clat (usec): min=48, max=198519, avg=44431.58, stdev=29976.84 lat (usec): min=48, max=198520, avg=44432.72, stdev=29976.73 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 1205], 20.00th=[ 23200], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 41681], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[156238], 99.50th=[170918], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 55, max= 411, per=26.26%, avg=198.82, stdev=79.90, samples=62 iops : min= 3, max= 25, avg=11.69, stdev= 4.96, samples=62 write: IOPS=11, BW=191KiB/s (195kB/s)(6032KiB/31639msec); 0 zone resets clat (usec): min=1480, max=211967, avg=37423.84, stdev=38043.83 lat (usec): min=1482, max=211969, avg=37427.83, stdev=38042.34 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1991], 10.00th=[ 3064], 20.00th=[ 5145], | 30.00th=[ 9503], 40.00th=[ 17171], 50.00th=[ 23462], 60.00th=[ 34866], | 70.00th=[ 47973], 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[112722], | 99.00th=[152044], 99.50th=[191890], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 63, max= 447, per=24.14%, avg=192.11, stdev=83.68, samples=61 iops : min= 3, max= 27, avg=11.26, stdev= 5.27, samples=61 lat (usec) : 50=0.39%, 100=4.30%, 250=0.13%, 500=0.13% lat (msec) : 2=2.73%, 4=5.34%, 10=7.16%, 20=9.51%, 50=38.67% lat (msec) : 100=25.00%, 250=6.64% cpu : usr=0.05%, sys=5.02%, ctx=1732, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180230: Wed Sep 30 12:30:58 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29809msec) clat (usec): min=38, max=175669, avg=45142.28, stdev=29287.84 lat (usec): min=39, max=175671, avg=45143.74, stdev=29287.70 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 56], 10.00th=[ 619], 20.00th=[ 22938], | 30.00th=[ 30016], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[132645], 99.50th=[158335], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 56, max= 319, per=26.61%, avg=201.45, stdev=69.64, samples=58 iops : min= 3, max= 19, avg=11.88, stdev= 4.35, samples=58 write: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29809msec); 0 zone resets clat (usec): min=1323, max=249081, avg=32196.82, stdev=35223.03 lat (usec): min=1324, max=249083, avg=32199.37, stdev=35222.57 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2409], 10.00th=[ 3556], 20.00th=[ 5473], | 30.00th=[ 8029], 40.00th=[ 11731], 50.00th=[ 19530], 60.00th=[ 29754], | 70.00th=[ 40109], 80.00th=[ 53740], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[166724], 99.50th=[214959], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 63, max= 448, per=26.37%, avg=209.91, stdev=91.38, samples=58 iops : min= 3, max= 28, avg=12.43, stdev= 5.78, samples=58 lat (usec) : 50=0.39%, 100=4.04%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=1.95%, 4=5.21%, 10=10.81%, 20=10.29%, 50=36.85% lat (msec) : 100=24.48%, 250=5.47% cpu : usr=0.07%, sys=5.17%, ctx=1705, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=757KiB/s (775kB/s), 186KiB/s-202KiB/s (190kB/s-207kB/s), io=23.4MiB (24.5MB), run=29809-31639msec WRITE: bw=796KiB/s (816kB/s), 191KiB/s-212KiB/s (195kB/s-217kB/s), io=24.6MiB (25.8MB), run=29809-31639msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180222: Wed Sep 30 12:31:08 2026 read: IOPS=8, BW=142KiB/s (146kB/s)(5920KiB/41560msec) clat (msec): min=5, max=278, avg=43.38, stdev=40.18 lat (msec): min=5, max=278, avg=43.39, stdev=40.18 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 103], 95.00th=[ 131], | 99.00th=[ 178], 99.50th=[ 209], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 509, per=24.85%, avg=143.16, stdev=98.27, samples=81 iops : min= 1, max= 31, avg= 8.11, stdev= 6.20, samples=81 write: IOPS=9, BW=153KiB/s (157kB/s)(6368KiB/41560msec); 0 zone resets clat (msec): min=15, max=270, avg=63.86, stdev=44.80 lat (msec): min=15, max=270, avg=63.86, stdev=44.80 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 60], | 70.00th=[ 75], 80.00th=[ 100], 90.00th=[ 133], 95.00th=[ 155], | 99.00th=[ 226], 99.50th=[ 266], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 447, per=25.43%, avg=154.14, stdev=97.99, samples=81 iops : min= 1, max= 27, avg= 8.80, stdev= 6.20, samples=81 lat (msec) : 10=2.47%, 20=14.97%, 50=45.96%, 100=21.22%, 250=14.97% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.66%, ctx=1199, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180223: Wed Sep 30 12:31:08 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(5744KiB/41322msec) clat (msec): min=5, max=232, avg=42.40, stdev=38.05 lat (msec): min=5, max=232, avg=42.40, stdev=38.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 64], 90.00th=[ 99], 95.00th=[ 134], | 99.00th=[ 174], 99.50th=[ 197], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 478, per=25.10%, avg=144.60, stdev=100.61, samples=77 iops : min= 1, max= 29, avg= 8.21, stdev= 6.34, samples=77 write: IOPS=9, BW=158KiB/s (162kB/s)(6544KiB/41322msec); 0 zone resets clat (msec): min=15, max=312, avg=63.63, stdev=46.77 lat (msec): min=15, max=312, avg=63.63, stdev=46.77 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 58], | 70.00th=[ 78], 80.00th=[ 95], 90.00th=[ 132], 95.00th=[ 159], | 99.00th=[ 207], 99.50th=[ 255], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 406, per=25.52%, avg=154.67, stdev=93.71, samples=81 iops : min= 1, max= 25, avg= 8.85, stdev= 5.96, samples=81 lat (msec) : 10=1.30%, 20=15.23%, 50=48.44%, 100=20.96%, 250=13.67% lat (msec) : 500=0.39% cpu : usr=0.03%, sys=1.64%, ctx=1223, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180224: Wed Sep 30 12:31:08 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(6256KiB/41121msec) clat (msec): min=6, max=307, avg=42.07, stdev=39.82 lat (msec): min=6, max=307, avg=42.07, stdev=39.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 92], 95.00th=[ 118], | 99.00th=[ 186], 99.50th=[ 279], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 474, per=26.40%, avg=152.09, stdev=110.73, samples=81 iops : min= 1, max= 29, avg= 8.68, stdev= 7.02, samples=81 write: IOPS=9, BW=147KiB/s (150kB/s)(6032KiB/41121msec); 0 zone resets clat (msec): min=13, max=325, avg=65.17, stdev=48.05 lat (msec): min=13, max=325, avg=65.21, stdev=48.06 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 72], 80.00th=[ 95], 90.00th=[ 136], 95.00th=[ 171], | 99.00th=[ 222], 99.50th=[ 271], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 412, per=24.16%, avg=146.41, stdev=88.02, samples=80 iops : min= 1, max= 25, avg= 8.32, stdev= 5.56, samples=80 lat (msec) : 10=1.95%, 20=14.97%, 50=47.40%, 100=22.92%, 250=12.11% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.66%, ctx=1171, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180225: Wed Sep 30 12:31:08 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(6032KiB/40237msec) clat (msec): min=6, max=302, avg=42.41, stdev=37.68 lat (msec): min=6, max=302, avg=42.41, stdev=37.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 100], 95.00th=[ 124], | 99.00th=[ 169], 99.50th=[ 190], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 479, per=25.59%, avg=147.42, stdev=94.23, samples=79 iops : min= 1, max= 29, avg= 8.39, stdev= 5.96, samples=79 write: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40237msec); 0 zone resets clat (msec): min=12, max=321, avg=61.91, stdev=45.17 lat (msec): min=12, max=321, avg=61.91, stdev=45.17 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 89], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 249], 99.50th=[ 292], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 507, per=25.25%, avg=153.04, stdev=96.12, samples=79 iops : min= 1, max= 31, avg= 8.75, stdev= 6.09, samples=79 lat (msec) : 10=2.47%, 20=14.58%, 50=47.92%, 100=22.40%, 250=12.11% lat (msec) : 500=0.52% cpu : usr=0.03%, sys=1.74%, ctx=1115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=576KiB/s (590kB/s), 139KiB/s-152KiB/s (142kB/s-156kB/s), io=23.4MiB (24.5MB), run=40237-41560msec WRITE: bw=606KiB/s (621kB/s), 147KiB/s-158KiB/s (150kB/s-162kB/s), io=24.6MiB (25.8MB), run=40237-41560msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180247: Wed Sep 30 12:31:22 2026 read: IOPS=1, BW=1865KiB/s (1909kB/s)(7168KiB/3844msec) clat (usec): min=873, max=1227.4k, avg=315186.70, stdev=413524.32 lat (usec): min=874, max=1227.4k, avg=315188.06, stdev=413524.11 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 873], 10.00th=[ 873], | 20.00th=[ 83362], 30.00th=[ 168821], 40.00th=[ 168821], | 50.00th=[ 191890], 60.00th=[ 256902], 70.00th=[ 256902], | 80.00th=[ 274727], 90.00th=[1233126], 95.00th=[1233126], | 99.00th=[1233126], 99.50th=[1233126], 99.90th=[1233126], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 1973, max= 4031, per=83.57%, avg=3289.33, stdev=1143.03, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1332KiB/s (1364kB/s)(5120KiB/3844msec); 0 zone resets clat (msec): min=185, max=496, avg=291.74, stdev=119.64 lat (msec): min=185, max=497, avg=291.91, stdev=119.63 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1932, max= 4096, per=48.82%, avg=2690.33, stdev=1218.61, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=17.93%, ctx=461, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180248: Wed Sep 30 12:31:22 2026 read: IOPS=0, BW=394KiB/s (403kB/s)(2048KiB/5202msec) clat (msec): min=147, max=188, avg=168.33, stdev=28.82 lat (msec): min=147, max=188, avg=168.33, stdev=28.82 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 1935, max= 2039, per=50.48%, avg=1987.00, stdev=73.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1968KiB/s (2016kB/s)(10.0MiB/5202msec); 0 zone resets clat (msec): min=122, max=1529, avg=477.99, stdev=496.12 lat (msec): min=122, max=1529, avg=478.08, stdev=496.11 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 128], | 30.00th=[ 169], 40.00th=[ 188], 50.00th=[ 209], 60.00th=[ 271], | 70.00th=[ 447], 80.00th=[ 489], 90.00th=[ 1234], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 1932, max= 4096, per=55.13%, avg=3038.17, stdev=1129.82, samples=6 iops : min= 1, max= 4, avg= 2.33, stdev= 1.21, samples=6 lat (msec) : 250=58.33%, 500=25.00%, 2000=16.67% cpu : usr=0.00%, sys=13.65%, ctx=137, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180249: Wed Sep 30 12:31:22 2026 read: IOPS=1, BW=1605KiB/s (1644kB/s)(6144KiB/3828msec) clat (usec): min=490, max=300811, avg=138236.92, stdev=118668.20 lat (usec): min=491, max=300812, avg=138238.19, stdev=118668.18 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 2540], | 30.00th=[ 2540], 40.00th=[143655], 50.00th=[143655], 60.00th=[168821], | 70.00th=[212861], 80.00th=[212861], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 3864, max= 4096, per=100.00%, avg=3980.00, stdev=164.05, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1605KiB/s (1644kB/s)(6144KiB/3828msec); 0 zone resets clat (msec): min=98, max=1478, avg=472.26, stdev=513.39 lat (msec): min=98, max=1478, avg=472.33, stdev=513.39 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 292], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 1932, max= 2043, per=36.23%, avg=1996.60, stdev=52.41, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=15.29%, ctx=223, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180250: Wed Sep 30 12:31:22 2026 read: IOPS=0, BW=1014KiB/s (1038kB/s)(5120KiB/5050msec) clat (usec): min=481, max=393424, avg=124112.69, stdev=179220.95 lat (usec): min=482, max=393424, avg=124113.76, stdev=179220.66 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 482], | 30.00th=[ 486], 40.00th=[ 486], 50.00th=[ 971], 60.00th=[ 971], | 70.00th=[225444], 80.00th=[225444], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 4079, max= 4096, per=100.00%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1419KiB/s (1453kB/s)(7168KiB/5050msec); 0 zone resets clat (msec): min=131, max=1415, avg=591.84, stdev=558.13 lat (msec): min=131, max=1415, avg=591.91, stdev=558.13 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 188], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 317], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 1368], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1858, max= 2043, per=36.09%, avg=1988.75, stdev=88.04, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 250=25.00%, 500=33.33%, 2000=16.67% cpu : usr=0.02%, sys=13.05%, ctx=145, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3937KiB/s (4031kB/s), 394KiB/s-1865KiB/s (403kB/s-1909kB/s), io=20.0MiB (20.0MB), run=3828-5202msec WRITE: bw=5512KiB/s (5644kB/s), 1332KiB/s-1968KiB/s (1364kB/s-2016kB/s), io=28.0MiB (29.4MB), run=3828-5202msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180242: Wed Sep 30 12:31:22 2026 read: IOPS=1, BW=1975KiB/s (2022kB/s)(7168KiB/3630msec) clat (msec): min=75, max=405, avg=137.80, stdev=118.59 lat (msec): min=75, max=405, avg=137.80, stdev=118.59 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 99], 60.00th=[ 100], | 70.00th=[ 100], 80.00th=[ 107], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1753, max= 7091, per=100.00%, avg=4422.00, stdev=3774.54, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1410KiB/s (1444kB/s)(5120KiB/3630msec); 0 zone resets clat (msec): min=74, max=1308, avg=527.12, stdev=513.16 lat (msec): min=74, max=1308, avg=527.21, stdev=513.15 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1418, max= 2023, per=33.65%, avg=1751.50, stdev=250.73, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=50.00%, 250=16.67%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.68%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180243: Wed Sep 30 12:31:22 2026 read: IOPS=0, BW=450KiB/s (461kB/s)(2048KiB/4548msec) clat (usec): min=70136, max=90248, avg=80192.32, stdev=14221.05 lat (usec): min=70137, max=90249, avg=80193.79, stdev=14221.52 clat percentiles (usec): | 1.00th=[69731], 5.00th=[69731], 10.00th=[69731], 20.00th=[69731], | 30.00th=[69731], 40.00th=[69731], 50.00th=[69731], 60.00th=[90702], | 70.00th=[90702], 80.00th=[90702], 90.00th=[90702], 95.00th=[90702], | 99.00th=[90702], 99.50th=[90702], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 1400, max= 1753, per=42.40%, avg=1576.50, stdev=249.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2252KiB/s (2306kB/s)(10.0MiB/4548msec); 0 zone resets clat (msec): min=100, max=1420, avg=429.57, stdev=401.43 lat (msec): min=100, max=1421, avg=429.66, stdev=401.42 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 199], | 30.00th=[ 201], 40.00th=[ 209], 50.00th=[ 241], 60.00th=[ 309], | 70.00th=[ 321], 80.00th=[ 493], 90.00th=[ 802], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1812, max= 4096, per=52.11%, avg=2712.17, stdev=927.02, samples=6 iops : min= 1, max= 4, avg= 2.00, stdev= 1.26, samples=6 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=7.59%, ctx=142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180244: Wed Sep 30 12:31:22 2026 read: IOPS=1, BW=1235KiB/s (1264kB/s)(6144KiB/4976msec) clat (msec): min=69, max=549, avg=251.21, stdev=187.32 lat (msec): min=69, max=549, avg=251.21, stdev=187.32 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 255], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2039, max= 4096, per=86.44%, avg=3213.67, stdev=1059.20, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1235KiB/s (1264kB/s)(6144KiB/4976msec); 0 zone resets clat (msec): min=69, max=2330, avg=541.22, stdev=883.29 lat (msec): min=70, max=2330, avg=541.37, stdev=883.27 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 234], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2023, max= 4079, per=52.78%, avg=2747.25, stdev=968.91, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.82%, ctx=74, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180246: Wed Sep 30 12:31:22 2026 read: IOPS=0, BW=930KiB/s (952kB/s)(5120KiB/5508msec) clat (msec): min=62, max=111, avg=75.05, stdev=20.46 lat (msec): min=62, max=111, avg=75.05, stdev=20.46 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 67], 60.00th=[ 67], | 70.00th=[ 72], 80.00th=[ 72], 90.00th=[ 112], 95.00th=[ 112], | 99.00th=[ 112], 99.50th=[ 112], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1301KiB/s (1333kB/s)(7168KiB/5508msec); 0 zone resets clat (msec): min=215, max=2281, avg=715.61, stdev=790.36 lat (msec): min=215, max=2281, avg=715.97, stdev=790.60 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 224], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 347], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 1301], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1402, max= 4096, per=55.75%, avg=2902.00, stdev=1396.72, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.96%, ctx=144, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3718KiB/s (3807kB/s), 450KiB/s-1975KiB/s (461kB/s-2022kB/s), io=20.0MiB (20.0MB), run=3630-5508msec WRITE: bw=5206KiB/s (5330kB/s), 1235KiB/s-2252KiB/s (1264kB/s-2306kB/s), io=28.0MiB (29.4MB), run=3630-5508msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180257: Wed Sep 30 12:31:36 2026 read: IOPS=1, BW=4743KiB/s (4856kB/s)(12.0MiB/2591msec) clat (msec): min=750, max=984, avg=845.27, stdev=122.95 lat (msec): min=750, max=984, avg=845.27, stdev=122.95 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=3.40%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180259: Wed Sep 30 12:31:36 2026 read: IOPS=0, BW=1436KiB/s (1471kB/s)(4096KiB/2852msec) clat (nsec): min=199878k, max=199878k, avg=199877539.00, stdev= 0.00 lat (nsec): min=199880k, max=199880k, avg=199879747.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 6291, max= 6291, per=100.00%, avg=6291.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2872KiB/s (2941kB/s)(8192KiB/2852msec); 0 zone resets clat (msec): min=1241, max=1283, avg=1262.48, stdev=29.20 lat (msec): min=1242, max=1286, avg=1264.32, stdev=31.34 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8126, max= 8126, per=80.18%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.02%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180261: Wed Sep 30 12:31:36 2026 write: IOPS=0, BW=3801KiB/s (3892kB/s)(12.0MiB/3233msec); 0 zone resets clat (msec): min=228, max=2020, avg=1049.18, stdev=905.64 lat (msec): min=229, max=2021, avg=1049.57, stdev=905.73 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8015, max= 8192, per=79.96%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.68%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180263: Wed Sep 30 12:31:36 2026 write: IOPS=1, BW=5222KiB/s (5348kB/s)(12.0MiB/2353msec); 0 zone resets clat (msec): min=581, max=977, avg=758.49, stdev=201.25 lat (msec): min=582, max=977, avg=759.13, stdev=200.89 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8126, max= 8159, per=80.34%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.93%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5745KiB/s (5883kB/s), 1436KiB/s-4743KiB/s (1471kB/s-4856kB/s), io=16.0MiB (16.8MB), run=2591-2852msec WRITE: bw=9.90MiB/s (10.4MB/s), 2872KiB/s-5222KiB/s (2941kB/s-5348kB/s), io=32.0MiB (33.6MB), run=2353-3233msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180258: Wed Sep 30 12:31:36 2026 read: IOPS=1, BW=5523KiB/s (5655kB/s)(12.0MiB/2225msec) clat (msec): min=653, max=793, avg=722.15, stdev=70.18 lat (msec): min=654, max=793, avg=722.56, stdev=69.57 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.66%, ctx=335, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180260: Wed Sep 30 12:31:36 2026 read: IOPS=0, BW=1322KiB/s (1353kB/s)(4096KiB/3099msec) clat (nsec): min=482909k, max=482909k, avg=482909001.00, stdev= 0.00 lat (nsec): min=482911k, max=482911k, avg=482911155.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2643KiB/s (2707kB/s)(8192KiB/3099msec); 0 zone resets clat (msec): min=734, max=1655, avg=1194.94, stdev=651.46 lat (msec): min=734, max=1655, avg=1195.31, stdev=651.37 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 1653], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8126, max= 8126, per=76.86%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.97%, ctx=143, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180262: Wed Sep 30 12:31:36 2026 write: IOPS=1, BW=4544KiB/s (4653kB/s)(12.0MiB/2704msec); 0 zone resets clat (msec): min=239, max=1239, avg=851.48, stdev=536.07 lat (msec): min=240, max=1240, avg=852.00, stdev=535.92 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8126, max= 8175, per=77.09%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.03%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180264: Wed Sep 30 12:31:36 2026 write: IOPS=1, BW=5020KiB/s (5140kB/s)(12.0MiB/2448msec); 0 zone resets clat (msec): min=473, max=942, avg=767.00, stdev=255.90 lat (msec): min=474, max=942, avg=767.68, stdev=255.42 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8031, max= 8143, per=76.49%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.99%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5287KiB/s (5414kB/s), 1322KiB/s-5523KiB/s (1353kB/s-5655kB/s), io=16.0MiB (16.8MB), run=2225-3099msec WRITE: bw=10.3MiB/s (10.8MB/s), 2643KiB/s-5020KiB/s (2707kB/s-5140kB/s), io=32.0MiB (33.6MB), run=2448-3099msec