== sanity test 398b: DIO and buffer IO race ============== 07:28:15 (1787830095) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.95695 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150541: Thu Aug 27 07:30:48 2026 read: IOPS=11, BW=44.9KiB/s (46.0kB/s)(5992KiB/133344msec) clat (usec): min=42, max=816536, avg=49447.33, stdev=40889.90 lat (usec): min=43, max=816537, avg=49451.36, stdev=40891.29 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 15926], 20.00th=[ 22414], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 49546], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[183501], 99.50th=[238027], 99.90th=[362808], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 134, per=24.64%, avg=44.35, stdev=18.86, samples=263 iops : min= 1, max= 33, avg=10.43, stdev= 4.75, samples=263 write: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6296KiB/133344msec); 0 zone resets clat (usec): min=852, max=448326, avg=37388.65, stdev=41917.50 lat (usec): min=853, max=448328, avg=37391.79, stdev=41917.31 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1287], 20.00th=[ 3228], | 30.00th=[ 6718], 40.00th=[ 15008], 50.00th=[ 25822], 60.00th=[ 36439], | 70.00th=[ 47449], 80.00th=[ 62653], 90.00th=[ 89654], 95.00th=[119014], | 99.00th=[181404], 99.50th=[214959], 99.90th=[287310], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 119, per=24.90%, avg=46.82, stdev=22.50, samples=262 iops : min= 1, max= 29, avg=11.05, stdev= 5.65, samples=262 lat (usec) : 50=0.68%, 100=1.92%, 250=0.13%, 1000=0.20% lat (msec) : 2=7.29%, 4=4.13%, 10=7.00%, 20=8.37%, 50=36.46% lat (msec) : 100=26.63%, 250=6.84%, 500=0.33%, 1000=0.03% cpu : usr=0.07%, sys=4.80%, ctx=6169, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150542: Thu Aug 27 07:30:48 2026 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(5940KiB/133213msec) clat (usec): min=43, max=384620, avg=48506.91, stdev=35002.15 lat (usec): min=43, max=384621, avg=48508.49, stdev=35001.69 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 87], 10.00th=[ 15926], 20.00th=[ 22938], | 30.00th=[ 29230], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 47973], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[177210], 99.50th=[208667], 99.90th=[299893], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 5, max= 95, per=24.45%, avg=44.01, stdev=17.93, samples=262 iops : min= 1, max= 23, avg=10.35, stdev= 4.53, samples=262 write: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6348KiB/133213msec); 0 zone resets clat (usec): min=833, max=809239, avg=38273.59, stdev=45603.11 lat (usec): min=833, max=813501, avg=38278.02, stdev=45648.69 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1336], 20.00th=[ 3458], | 30.00th=[ 6849], 40.00th=[ 15008], 50.00th=[ 25560], 60.00th=[ 35914], | 70.00th=[ 49546], 80.00th=[ 65799], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[183501], 99.50th=[208667], 99.90th=[387974], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 151, per=25.01%, avg=47.02, stdev=23.99, samples=262 iops : min= 1, max= 37, avg=11.10, stdev= 6.02, samples=262 lat (usec) : 50=0.49%, 100=2.02%, 250=0.10%, 500=0.03%, 1000=0.13% lat (msec) : 2=7.03%, 4=4.26%, 10=7.03%, 20=8.72%, 50=36.23% lat (msec) : 100=26.20%, 250=7.58%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=4.66%, ctx=6061, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150543: Thu Aug 27 07:30:48 2026 read: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6028KiB/131068msec) clat (usec): min=33, max=388675, avg=47050.10, stdev=31980.24 lat (usec): min=33, max=388677, avg=47051.89, stdev=31979.80 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 445], 10.00th=[ 15270], 20.00th=[ 22414], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[102237], | 99.00th=[141558], 99.50th=[164627], 99.90th=[304088], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 127, per=25.54%, avg=45.96, stdev=20.01, samples=255 iops : min= 1, max= 31, avg=10.84, stdev= 5.03, samples=255 write: IOPS=11, BW=47.8KiB/s (48.9kB/s)(6260KiB/131068msec); 0 zone resets clat (usec): min=959, max=922921, avg=38149.55, stdev=48587.66 lat (usec): min=960, max=922922, avg=38153.40, stdev=48587.38 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3064], | 30.00th=[ 6325], 40.00th=[ 13829], 50.00th=[ 25560], 60.00th=[ 35914], | 70.00th=[ 47449], 80.00th=[ 63177], 90.00th=[ 90702], 95.00th=[120062], | 99.00th=[196084], 99.50th=[235930], 99.90th=[442500], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 110, per=25.26%, avg=47.48, stdev=20.20, samples=256 iops : min= 1, max= 27, avg=11.22, stdev= 5.09, samples=256 lat (usec) : 50=0.55%, 100=1.73%, 250=0.10%, 500=0.13%, 1000=0.07% lat (msec) : 2=7.16%, 4=4.95%, 10=6.54%, 20=9.83%, 50=35.38% lat (msec) : 100=26.69%, 250=6.61%, 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=4.71%, ctx=6013, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150544: Thu Aug 27 07:30:48 2026 read: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6052KiB/130669msec) clat (usec): min=31, max=868851, avg=46589.55, stdev=36815.51 lat (usec): min=32, max=868853, avg=46591.45, stdev=36815.70 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 153], 10.00th=[ 15795], 20.00th=[ 23200], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[101188], | 99.00th=[141558], 99.50th=[164627], 99.90th=[304088], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 119, per=25.60%, avg=46.08, stdev=19.32, samples=255 iops : min= 1, max= 29, avg=10.87, stdev= 4.87, samples=255 write: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6236KiB/130669msec); 0 zone resets clat (usec): min=866, max=409781, avg=38305.93, stdev=43854.90 lat (usec): min=868, max=409783, avg=38313.68, stdev=43850.81 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1123], 10.00th=[ 1254], 20.00th=[ 2737], | 30.00th=[ 5932], 40.00th=[ 12256], 50.00th=[ 23725], 60.00th=[ 35914], | 70.00th=[ 50070], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[123208], | 99.00th=[181404], 99.50th=[214959], 99.90th=[333448], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 109, per=25.26%, avg=47.48, stdev=20.77, samples=255 iops : min= 1, max= 27, avg=11.22, stdev= 5.25, samples=255 lat (usec) : 50=0.75%, 100=1.60%, 250=0.26%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=8.07%, 4=4.39%, 10=6.90%, 20=8.72%, 50=35.87% lat (msec) : 100=26.01%, 250=6.97%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.82%, ctx=6109, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=180KiB/s (184kB/s), 44.6KiB/s-46.3KiB/s (45.7kB/s-47.4kB/s), io=23.4MiB (24.6MB), run=130669-133344msec WRITE: bw=189KiB/s (193kB/s), 47.2KiB/s-47.8KiB/s (48.3kB/s-48.9kB/s), io=24.6MiB (25.7MB), run=130669-133344msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150545: Thu Aug 27 07:31:28 2026 read: IOPS=8, BW=34.6KiB/s (35.4kB/s)(5992KiB/173200msec) clat (msec): min=5, max=835, avg=46.05, stdev=53.30 lat (msec): min=5, max=835, avg=46.06, stdev=53.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 105], 95.00th=[ 138], | 99.00th=[ 257], 99.50th=[ 313], 99.90th=[ 493], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 151, per=26.03%, avg=35.65, stdev=27.49, samples=327 iops : min= 1, max= 37, avg= 8.24, stdev= 6.92, samples=327 write: IOPS=9, BW=36.4KiB/s (37.2kB/s)(6296KiB/173200msec); 0 zone resets clat (msec): min=10, max=470, avg=66.00, stdev=52.93 lat (msec): min=10, max=470, avg=66.00, stdev=52.93 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 60], | 70.00th=[ 79], 80.00th=[ 101], 90.00th=[ 136], 95.00th=[ 169], | 99.00th=[ 257], 99.50th=[ 300], 99.90th=[ 443], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 135, per=25.21%, avg=36.30, stdev=26.82, samples=337 iops : min= 1, max= 33, avg= 8.40, stdev= 6.74, samples=337 lat (msec) : 10=3.26%, 20=16.44%, 50=42.90%, 100=21.81%, 250=14.55% lat (msec) : 500=1.01%, 1000=0.03% cpu : usr=0.05%, sys=1.60%, ctx=4897, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150546: Thu Aug 27 07:31:28 2026 read: IOPS=8, BW=34.1KiB/s (34.0kB/s)(5940KiB/173994msec) clat (msec): min=5, max=847, avg=45.44, stdev=50.62 lat (msec): min=5, max=847, avg=45.44, stdev=50.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 67], 90.00th=[ 104], 95.00th=[ 142], | 99.00th=[ 222], 99.50th=[ 262], 99.90th=[ 542], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 136, per=26.10%, avg=35.76, stdev=27.52, samples=322 iops : min= 1, max= 34, avg= 8.27, stdev= 6.93, samples=322 write: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6348KiB/173994msec); 0 zone resets clat (msec): min=10, max=505, avg=66.89, stdev=54.21 lat (msec): min=10, max=505, avg=66.89, stdev=54.21 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 47], 60.00th=[ 62], | 70.00th=[ 80], 80.00th=[ 104], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 259], 99.50th=[ 271], 99.90th=[ 472], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 134, per=25.33%, avg=36.47, stdev=27.04, samples=337 iops : min= 1, max= 33, avg= 8.44, stdev= 6.80, samples=337 lat (msec) : 10=2.96%, 20=17.77%, 50=41.02%, 100=22.14%, 250=15.27% lat (msec) : 500=0.75%, 750=0.07%, 1000=0.03% cpu : usr=0.06%, sys=1.58%, ctx=4988, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150547: Thu Aug 27 07:31:28 2026 read: IOPS=8, BW=34.6KiB/s (35.5kB/s)(6028KiB/174013msec) clat (msec): min=5, max=539, avg=45.89, stdev=47.37 lat (msec): min=5, max=539, avg=45.89, stdev=47.37 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 69], 90.00th=[ 102], 95.00th=[ 138], | 99.00th=[ 220], 99.50th=[ 275], 99.90th=[ 485], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 143, per=25.76%, avg=35.30, stdev=26.24, samples=331 iops : min= 1, max= 35, avg= 8.15, stdev= 6.59, samples=331 write: IOPS=8, BW=35.0KiB/s (36.8kB/s)(6260KiB/174013msec); 0 zone resets clat (msec): min=10, max=906, avg=66.79, stdev=57.01 lat (msec): min=10, max=906, avg=66.79, stdev=57.01 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 80], 80.00th=[ 105], 90.00th=[ 136], 95.00th=[ 171], | 99.00th=[ 253], 99.50th=[ 279], 99.90th=[ 542], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 127, per=25.13%, avg=36.19, stdev=26.93, samples=335 iops : min= 1, max= 31, avg= 8.38, stdev= 6.78, samples=335 lat (msec) : 10=2.93%, 20=16.08%, 50=43.39%, 100=21.84%, 250=14.84% lat (msec) : 500=0.81%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.58%, ctx=4838, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150548: Thu Aug 27 07:31:28 2026 read: IOPS=8, BW=34.8KiB/s (35.7kB/s)(6052KiB/173816msec) clat (msec): min=4, max=478, avg=44.79, stdev=47.28 lat (msec): min=4, max=478, avg=44.80, stdev=47.28 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 66], 90.00th=[ 106], 95.00th=[ 142], | 99.00th=[ 222], 99.50th=[ 268], 99.90th=[ 388], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 167, per=26.10%, avg=35.75, stdev=28.62, samples=329 iops : min= 1, max= 41, avg= 8.27, stdev= 7.19, samples=329 write: IOPS=8, BW=35.9KiB/s (36.7kB/s)(6236KiB/173816msec); 0 zone resets clat (msec): min=9, max=893, avg=67.82, stdev=58.50 lat (msec): min=9, max=893, avg=67.82, stdev=58.50 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 61], | 70.00th=[ 78], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 174], | 99.00th=[ 266], 99.50th=[ 326], 99.90th=[ 506], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 127, per=25.19%, avg=36.27, stdev=26.23, samples=334 iops : min= 1, max= 31, avg= 8.40, stdev= 6.60, samples=334 lat (msec) : 10=3.48%, 20=17.25%, 50=42.12%, 100=21.00%, 250=15.17% lat (msec) : 500=0.91%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.58%, ctx=4831, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=138KiB/s (141kB/s), 34.1KiB/s-34.8KiB/s (34.0kB/s-35.7kB/s), io=23.4MiB (24.6MB), run=173200-174013msec WRITE: bw=144KiB/s (148kB/s), 35.9KiB/s-36.5KiB/s (36.7kB/s-37.4kB/s), io=24.6MiB (25.7MB), run=173200-174013msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150597: Thu Aug 27 07:32:13 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(5920KiB/33718msec) clat (usec): min=40, max=177633, avg=48288.61, stdev=32740.70 lat (usec): min=40, max=177633, avg=48301.08, stdev=32751.56 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 832], 20.00th=[ 22414], | 30.00th=[ 28705], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 91751], 95.00th=[111674], | 99.00th=[156238], 99.50th=[175113], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 62, max= 380, per=24.36%, avg=172.44, stdev=68.07, samples=66 iops : min= 3, max= 23, avg= 9.98, stdev= 4.30, samples=66 write: IOPS=11, BW=189KiB/s (193kB/s)(6368KiB/33718msec); 0 zone resets clat (usec): min=1419, max=204721, avg=39659.50, stdev=36801.72 lat (usec): min=1421, max=204723, avg=39670.68, stdev=36820.28 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2180], 10.00th=[ 3654], 20.00th=[ 6521], | 30.00th=[ 11469], 40.00th=[ 20055], 50.00th=[ 29492], 60.00th=[ 38536], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[112722], | 99.00th=[143655], 99.50th=[154141], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 506, per=25.15%, avg=187.39, stdev=78.58, samples=66 iops : min= 1, max= 31, avg=10.92, stdev= 4.94, samples=66 lat (usec) : 50=0.52%, 100=3.39%, 250=0.26%, 500=0.52%, 1000=0.13% lat (msec) : 2=2.08%, 4=3.78%, 10=8.20%, 20=8.98%, 50=36.20% lat (msec) : 100=28.26%, 250=7.68% cpu : usr=0.06%, sys=5.63%, ctx=1738, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150598: Thu Aug 27 07:32:13 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5744KiB/33746msec) clat (usec): min=51, max=226216, avg=49517.60, stdev=31979.04 lat (usec): min=52, max=226217, avg=49521.05, stdev=31976.97 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 101], 10.00th=[ 17957], 20.00th=[ 23987], | 30.00th=[ 31065], 40.00th=[ 39060], 50.00th=[ 44827], 60.00th=[ 51643], | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 85459], 95.00th=[109577], | 99.00th=[154141], 99.50th=[200279], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 62, max= 349, per=23.76%, avg=168.23, stdev=61.73, samples=66 iops : min= 3, max= 21, avg= 9.73, stdev= 3.88, samples=66 write: IOPS=12, BW=194KiB/s (199kB/s)(6544KiB/33746msec); 0 zone resets clat (usec): min=1596, max=238830, avg=38891.64, stdev=38198.91 lat (usec): min=1597, max=239077, avg=38894.31, stdev=38201.99 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2573], 10.00th=[ 4113], 20.00th=[ 7767], | 30.00th=[ 13173], 40.00th=[ 20579], 50.00th=[ 28705], 60.00th=[ 36439], | 70.00th=[ 46924], 80.00th=[ 61080], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[185598], 99.50th=[204473], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 30, max= 475, per=25.56%, avg=190.41, stdev=85.91, samples=66 iops : min= 1, max= 29, avg=11.11, stdev= 5.42, samples=66 lat (usec) : 100=2.21%, 250=0.39% lat (msec) : 2=1.95%, 4=2.99%, 10=8.46%, 20=10.55%, 50=39.19% lat (msec) : 100=27.08%, 250=7.16% cpu : usr=0.08%, sys=5.74%, ctx=1770, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150599: Thu Aug 27 07:32:13 2026 read: IOPS=11, BW=185KiB/s (190kB/s)(6256KiB/33793msec) clat (usec): min=49, max=241199, avg=48046.57, stdev=32390.75 lat (usec): min=50, max=241200, avg=48047.88, stdev=32390.69 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 14222], 20.00th=[ 24511], | 30.00th=[ 30540], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[158335], 99.50th=[181404], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 381, per=26.00%, avg=184.11, stdev=68.86, samples=66 iops : min= 1, max= 23, avg=10.73, stdev= 4.33, samples=66 write: IOPS=11, BW=178KiB/s (183kB/s)(6032KiB/33793msec); 0 zone resets clat (usec): min=1552, max=192120, avg=39528.44, stdev=38701.87 lat (usec): min=1554, max=192122, avg=39533.60, stdev=38702.58 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1893], 10.00th=[ 3392], 20.00th=[ 6652], | 30.00th=[ 12125], 40.00th=[ 18220], 50.00th=[ 28705], 60.00th=[ 38536], | 70.00th=[ 51119], 80.00th=[ 64750], 90.00th=[ 94897], 95.00th=[119014], | 99.00th=[168821], 99.50th=[189793], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 475, per=23.42%, avg=174.47, stdev=80.08, samples=66 iops : min= 1, max= 29, avg=10.12, stdev= 5.08, samples=66 lat (usec) : 50=0.13%, 100=2.86%, 250=0.65%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.73%, 4=3.39%, 10=8.07%, 20=8.72%, 50=38.41% lat (msec) : 100=27.86%, 250=6.90% cpu : usr=0.08%, sys=5.32%, ctx=1740, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150600: Thu Aug 27 07:32:13 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6032KiB/32654msec) clat (usec): min=52, max=179621, avg=47447.89, stdev=31373.08 lat (usec): min=53, max=179622, avg=47448.94, stdev=31373.12 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 71], 10.00th=[ 1532], 20.00th=[ 24511], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 47449], | 70.00th=[ 56886], 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[143655], 99.50th=[164627], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 381, per=26.27%, avg=186.02, stdev=69.97, samples=63 iops : min= 1, max= 23, avg=10.84, stdev= 4.36, samples=63 write: IOPS=11, BW=192KiB/s (196kB/s)(6256KiB/32654msec); 0 zone resets clat (usec): min=1361, max=271848, avg=37642.42, stdev=40356.50 lat (usec): min=1362, max=271850, avg=37644.66, stdev=40356.44 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1778], 10.00th=[ 2769], 20.00th=[ 5800], | 30.00th=[ 8291], 40.00th=[ 14353], 50.00th=[ 24511], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 64750], 90.00th=[ 92799], 95.00th=[121111], | 99.00th=[166724], 99.50th=[202376], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 572, per=25.71%, avg=191.56, stdev=96.41, samples=64 iops : min= 3, max= 35, avg=11.19, stdev= 6.06, samples=64 lat (usec) : 100=4.17%, 250=0.26%, 500=0.26% lat (msec) : 2=3.91%, 4=4.56%, 10=8.85%, 20=8.46%, 50=36.72% lat (msec) : 100=25.39%, 250=7.29%, 500=0.13% cpu : usr=0.07%, sys=5.63%, ctx=1729, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=709KiB/s (726kB/s), 170KiB/s-185KiB/s (174kB/s-190kB/s), io=23.4MiB (24.5MB), run=32654-33793msec WRITE: bw=746KiB/s (764kB/s), 178KiB/s-194KiB/s (183kB/s-199kB/s), io=24.6MiB (25.8MB), run=32654-33793msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150591: Thu Aug 27 07:32:24 2026 read: IOPS=8, BW=129KiB/s (133kB/s)(5920KiB/45736msec) clat (msec): min=6, max=295, avg=46.76, stdev=40.53 lat (msec): min=6, max=295, avg=46.76, stdev=40.53 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 105], 95.00th=[ 128], | 99.00th=[ 199], 99.50th=[ 239], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 408, per=25.02%, avg=130.86, stdev=82.32, samples=88 iops : min= 1, max= 25, avg= 7.42, stdev= 5.23, samples=88 write: IOPS=8, BW=139KiB/s (143kB/s)(6368KiB/45736msec); 0 zone resets clat (msec): min=16, max=316, avg=71.33, stdev=47.28 lat (msec): min=16, max=316, avg=71.33, stdev=47.28 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 105], 90.00th=[ 136], 95.00th=[ 163], | 99.00th=[ 243], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 384, per=25.15%, avg=138.33, stdev=77.78, samples=90 iops : min= 1, max= 24, avg= 7.88, stdev= 4.96, samples=90 lat (msec) : 10=1.30%, 20=9.24%, 50=46.35%, 100=25.78%, 250=16.93% lat (msec) : 500=0.39% cpu : usr=0.03%, sys=1.67%, ctx=1146, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150592: Thu Aug 27 07:32:24 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(5744KiB/45781msec) clat (msec): min=6, max=284, avg=46.82, stdev=40.92 lat (msec): min=6, max=284, avg=46.82, stdev=40.92 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 241], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 411, per=24.96%, avg=130.52, stdev=86.17, samples=86 iops : min= 1, max= 25, avg= 7.40, stdev= 5.46, samples=86 write: IOPS=8, BW=143KiB/s (146kB/s)(6544KiB/45781msec); 0 zone resets clat (msec): min=17, max=297, avg=70.43, stdev=47.50 lat (msec): min=17, max=297, avg=70.44, stdev=47.50 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 63], | 70.00th=[ 84], 80.00th=[ 105], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 213], 99.50th=[ 232], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 408, per=25.78%, avg=141.79, stdev=83.19, samples=90 iops : min= 1, max= 25, avg= 8.10, stdev= 5.30, samples=90 lat (msec) : 10=1.43%, 20=9.11%, 50=47.66%, 100=24.22%, 250=17.19% lat (msec) : 500=0.39% cpu : usr=0.03%, sys=1.76%, ctx=1171, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150593: Thu Aug 27 07:32:24 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45285msec) clat (msec): min=7, max=276, avg=48.77, stdev=41.87 lat (msec): min=7, max=276, avg=48.78, stdev=41.87 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 77], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 186], 99.50th=[ 207], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 510, per=26.73%, avg=139.77, stdev=101.42, samples=88 iops : min= 1, max= 31, avg= 7.98, stdev= 6.40, samples=88 write: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45285msec); 0 zone resets clat (msec): min=14, max=262, avg=69.16, stdev=43.79 lat (msec): min=14, max=262, avg=69.16, stdev=43.79 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 104], 90.00th=[ 130], 95.00th=[ 159], | 99.00th=[ 218], 99.50th=[ 243], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 352, per=23.74%, avg=130.58, stdev=72.00, samples=89 iops : min= 1, max= 22, avg= 7.40, stdev= 4.58, samples=89 lat (msec) : 10=1.17%, 20=10.55%, 50=46.48%, 100=24.48%, 250=17.06% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.70%, ctx=1145, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150594: Thu Aug 27 07:32:24 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(6032KiB/44995msec) clat (msec): min=5, max=256, avg=45.93, stdev=36.71 lat (msec): min=5, max=256, avg=45.93, stdev=36.71 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 103], 95.00th=[ 125], | 99.00th=[ 174], 99.50th=[ 228], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 384, per=26.13%, avg=136.66, stdev=84.05, samples=87 iops : min= 1, max= 24, avg= 7.78, stdev= 5.36, samples=87 write: IOPS=8, BW=139KiB/s (142kB/s)(6256KiB/44995msec); 0 zone resets clat (msec): min=12, max=318, avg=70.48, stdev=46.35 lat (msec): min=12, max=318, avg=70.48, stdev=46.35 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 70], | 70.00th=[ 83], 80.00th=[ 102], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 234], 99.50th=[ 275], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 411, per=25.23%, avg=138.76, stdev=74.49, samples=89 iops : min= 1, max= 25, avg= 7.91, stdev= 4.74, samples=89 lat (msec) : 10=0.65%, 20=11.33%, 50=44.92%, 100=27.47%, 250=15.23% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.76%, ctx=1211, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=523KiB/s (536kB/s), 125KiB/s-138KiB/s (128kB/s-141kB/s), io=23.4MiB (24.5MB), run=44995-45781msec WRITE: bw=550KiB/s (564kB/s), 133KiB/s-143KiB/s (136kB/s-146kB/s), io=24.6MiB (25.8MB), run=44995-45781msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150611: Thu Aug 27 07:32:37 2026 read: IOPS=2, BW=2338KiB/s (2394kB/s)(7168KiB/3066msec) clat (msec): min=135, max=335, avg=229.22, stdev=70.06 lat (msec): min=135, max=335, avg=229.22, stdev=70.06 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 159], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 236], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 275], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1950, max= 4243, per=53.36%, avg=2567.75, stdev=1117.63, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1670KiB/s (1710kB/s)(5120KiB/3066msec); 0 zone resets clat (msec): min=131, max=473, avg=287.09, stdev=142.80 lat (msec): min=131, max=473, avg=287.15, stdev=142.79 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2035, max= 6071, per=60.17%, avg=4053.00, stdev=2853.88, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 250=50.00%, 500=50.00% cpu : usr=0.00%, sys=14.09%, ctx=193, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150612: Thu Aug 27 07:32:37 2026 read: IOPS=0, BW=481KiB/s (493kB/s)(2048KiB/4256msec) clat (msec): min=80, max=694, avg=387.73, stdev=434.39 lat (msec): min=80, max=694, avg=387.73, stdev=434.39 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 81], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1899, max= 2035, per=40.88%, avg=1967.00, stdev=96.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2406KiB/s (2464kB/s)(10.0MiB/4256msec); 0 zone resets clat (msec): min=48, max=1178, avg=335.91, stdev=318.62 lat (msec): min=49, max=1178, avg=335.99, stdev=318.62 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 83], | 30.00th=[ 165], 40.00th=[ 211], 50.00th=[ 296], 60.00th=[ 300], | 70.00th=[ 305], 80.00th=[ 347], 90.00th=[ 426], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1899, max= 4087, per=41.67%, avg=2807.20, stdev=1126.69, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=41.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=15.16%, ctx=148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150613: Thu Aug 27 07:32:37 2026 read: IOPS=1, BW=1878KiB/s (1923kB/s)(6144KiB/3272msec) clat (usec): min=504, max=278480, avg=112769.55, stdev=124277.20 lat (usec): min=506, max=278481, avg=112770.76, stdev=124277.20 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 3884], | 30.00th=[ 3884], 40.00th=[ 4359], 50.00th=[ 4359], 60.00th=[187696], | 70.00th=[202376], 80.00th=[202376], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 3900, max= 4087, per=82.99%, avg=3993.50, stdev=132.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1878KiB/s (1923kB/s)(6144KiB/3272msec); 0 zone resets clat (msec): min=176, max=660, avg=415.01, stdev=218.19 lat (msec): min=176, max=660, avg=415.07, stdev=218.19 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 518], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1950, max= 2900, per=34.07%, avg=2295.00, stdev=525.67, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=8.33%, 250=33.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=11.71%, ctx=118, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150614: Thu Aug 27 07:32:37 2026 read: IOPS=1, BW=1749KiB/s (1791kB/s)(5120KiB/2928msec) clat (usec): min=465, max=349650, avg=70903.68, stdev=155826.02 lat (usec): min=466, max=349652, avg=70904.67, stdev=155826.11 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 465], | 30.00th=[ 857], 40.00th=[ 857], 50.00th=[ 1221], 60.00th=[ 1221], | 70.00th=[ 2311], 80.00th=[ 2311], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2448KiB/s (2507kB/s)(7168KiB/2928msec); 0 zone resets clat (msec): min=208, max=606, avg=360.55, stdev=169.97 lat (msec): min=209, max=606, avg=360.64, stdev=169.94 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 226], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 257], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 558], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1475, max= 4071, per=42.64%, avg=2872.25, stdev=1308.08, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=13.19%, ctx=125, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4812KiB/s (4928kB/s), 481KiB/s-2338KiB/s (493kB/s-2394kB/s), io=20.0MiB (20.0MB), run=2928-4256msec WRITE: bw=6737KiB/s (6899kB/s), 1670KiB/s-2448KiB/s (1710kB/s-2507kB/s), io=28.0MiB (29.4MB), run=2928-4256msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150616: Thu Aug 27 07:32:37 2026 read: IOPS=1, BW=1790KiB/s (1833kB/s)(7168KiB/4005msec) clat (msec): min=67, max=1469, avg=387.60, stdev=514.63 lat (msec): min=67, max=1469, avg=387.61, stdev=514.63 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 197], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 625], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1659, max= 3716, per=49.46%, avg=2342.75, stdev=929.95, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1278KiB/s (1309kB/s)(5120KiB/4005msec); 0 zone resets clat (msec): min=96, max=412, avg=248.60, stdev=112.65 lat (msec): min=96, max=412, avg=249.10, stdev=112.53 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1858, max= 4071, per=44.70%, avg=2964.50, stdev=1564.83, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.37%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150617: Thu Aug 27 07:32:37 2026 read: IOPS=0, BW=474KiB/s (485kB/s)(2048KiB/4323msec) clat (msec): min=180, max=535, avg=358.24, stdev=250.75 lat (msec): min=180, max=535, avg=358.24, stdev=250.75 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1416, max= 2048, per=36.56%, avg=1732.00, stdev=446.89, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2369KiB/s (2426kB/s)(10.0MiB/4323msec); 0 zone resets clat (msec): min=83, max=1128, avg=358.29, stdev=354.08 lat (msec): min=83, max=1128, avg=358.57, stdev=353.94 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 99], | 30.00th=[ 128], 40.00th=[ 134], 50.00th=[ 140], 60.00th=[ 232], | 70.00th=[ 268], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1729, max= 6083, per=51.55%, avg=3419.00, stdev=2092.62, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 2.06, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=5.71%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150618: Thu Aug 27 07:32:37 2026 read: IOPS=1, BW=1499KiB/s (1535kB/s)(6144KiB/4098msec) clat (msec): min=82, max=644, avg=204.06, stdev=216.82 lat (msec): min=82, max=644, avg=204.06, stdev=216.82 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1768, max= 4096, per=52.45%, avg=2484.75, stdev=1081.69, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1499KiB/s (1535kB/s)(6144KiB/4098msec); 0 zone resets clat (msec): min=131, max=1490, avg=475.56, stdev=503.46 lat (msec): min=131, max=1490, avg=475.82, stdev=503.39 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 300], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 1768, max= 2860, per=32.81%, avg=2175.75, stdev=473.60, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.13%, ctx=124, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150619: Thu Aug 27 07:32:37 2026 read: IOPS=1, BW=1203KiB/s (1232kB/s)(5120KiB/4256msec) clat (msec): min=96, max=413, avg=234.13, stdev=141.58 lat (msec): min=96, max=413, avg=234.13, stdev=141.58 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2027, max= 4096, per=57.50%, avg=2723.67, stdev=1188.52, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1684KiB/s (1725kB/s)(7168KiB/4256msec); 0 zone resets clat (msec): min=133, max=1193, avg=439.66, stdev=372.54 lat (msec): min=133, max=1193, avg=439.99, stdev=372.60 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 134], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 342], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 542], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1484, max= 2048, per=27.37%, avg=1815.40, stdev=238.61, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.25%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4737KiB/s (4851kB/s), 474KiB/s-1790KiB/s (485kB/s-1833kB/s), io=20.0MiB (20.0MB), run=4005-4323msec WRITE: bw=6632KiB/s (6792kB/s), 1278KiB/s-2369KiB/s (1309kB/s-2426kB/s), io=28.0MiB (29.4MB), run=4005-4323msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150625: Thu Aug 27 07:32:50 2026 read: IOPS=2, BW=10.1MiB/s (10.6MB/s)(12.0MiB/1183msec) clat (msec): min=285, max=463, avg=366.20, stdev=90.06 lat (msec): min=285, max=463, avg=366.20, stdev=90.06 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7420, max= 8143, per=56.19%, avg=7781.50, stdev=511.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=9.98%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150626: Thu Aug 27 07:32:50 2026 read: IOPS=0, BW=3534KiB/s (3619kB/s)(4096KiB/1159msec) clat (nsec): min=120555k, max=120555k, avg=120554630.00, stdev= 0.00 lat (nsec): min=120557k, max=120557k, avg=120556942.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 121], 60.00th=[ 121], | 70.00th=[ 121], 80.00th=[ 121], 90.00th=[ 121], 95.00th=[ 121], | 99.00th=[ 121], 99.50th=[ 121], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 7013, max= 7013, per=50.64%, avg=7013.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=7068KiB/s (7238kB/s)(8192KiB/1159msec); 0 zone resets clat (msec): min=423, max=564, avg=494.25, stdev=99.48 lat (msec): min=424, max=564, avg=494.62, stdev=99.43 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 8143, max= 8143, per=49.85%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=11.05%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150627: Thu Aug 27 07:32:50 2026 write: IOPS=1, BW=6126KiB/s (6273kB/s)(12.0MiB/2006msec); 0 zone resets clat (msec): min=456, max=782, avg=632.81, stdev=164.60 lat (msec): min=457, max=782, avg=633.27, stdev=164.43 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8110, max= 8143, per=49.75%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.14%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150628: Thu Aug 27 07:32:50 2026 write: IOPS=2, BW=11.5MiB/s (12.0MB/s)(12.0MiB/1045msec); 0 zone resets clat (msec): min=294, max=385, avg=327.53, stdev=50.46 lat (msec): min=295, max=385, avg=327.94, stdev=50.36 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7699, max= 8143, per=48.49%, avg=7921.00, stdev=313.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=12.45%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=13.5MiB/s (14.2MB/s), 3534KiB/s-10.1MiB/s (3619kB/s-10.6MB/s), io=16.0MiB (16.8MB), run=1159-1183msec WRITE: bw=15.0MiB/s (16.7MB/s), 6126KiB/s-11.5MiB/s (6273kB/s-12.0MB/s), io=32.0MiB (33.6MB), run=1045-2006msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150630: Thu Aug 27 07:32:52 2026 read: IOPS=1, BW=5260KiB/s (5387kB/s)(12.0MiB/2336msec) clat (msec): min=691, max=882, avg=778.29, stdev=96.84 lat (msec): min=691, max=882, avg=778.29, stdev=96.84 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.82%, ctx=439, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150631: Thu Aug 27 07:32:52 2026 read: IOPS=0, BW=1555KiB/s (1592kB/s)(4096KiB/2634msec) clat (nsec): min=753160k, max=753160k, avg=753160046.00, stdev= 0.00 lat (nsec): min=753162k, max=753162k, avg=753162123.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3110KiB/s (3185kB/s)(8192KiB/2634msec); 0 zone resets clat (msec): min=516, max=1358, avg=937.50, stdev=595.09 lat (msec): min=519, max=1358, avg=938.89, stdev=593.52 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8126, max= 8126, per=65.32%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.51%, ctx=129, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150632: Thu Aug 27 07:32:52 2026 write: IOPS=1, BW=4706KiB/s (4819kB/s)(12.0MiB/2611msec); 0 zone resets clat (msec): min=355, max=1297, avg=864.36, stdev=475.99 lat (msec): min=355, max=1298, avg=864.72, stdev=475.97 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8094, max= 8143, per=65.26%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.05%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150634: Thu Aug 27 07:32:52 2026 write: IOPS=1, BW=5894KiB/s (6035kB/s)(12.0MiB/2085msec); 0 zone resets clat (msec): min=382, max=907, avg=693.35, stdev=275.70 lat (msec): min=382, max=908, avg=694.10, stdev=275.83 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8094, max= 8094, per=65.06%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=7.44%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6220KiB/s (6369kB/s), 1555KiB/s-5260KiB/s (1592kB/s-5387kB/s), io=16.0MiB (16.8MB), run=2336-2634msec WRITE: bw=12.1MiB/s (12.7MB/s), 3110KiB/s-5894KiB/s (3185kB/s-6035kB/s), io=32.0MiB (33.6MB), run=2085-2634msec