== sanity test 398b: DIO and buffer IO race ============== 16:25:13 (1788467113) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.04667 s, 12.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145336: Thu Sep 3 16:26:43 2026 read: IOPS=19, BW=77.7KiB/s (79.6kB/s)(5992KiB/77110msec) clat (usec): min=31, max=778268, avg=25381.54, stdev=27347.72 lat (usec): min=32, max=778270, avg=25383.96, stdev=27347.48 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 70], 10.00th=[ 7046], 20.00th=[ 12518], | 30.00th=[ 15139], 40.00th=[ 17695], 50.00th=[ 20841], 60.00th=[ 24773], | 70.00th=[ 30016], 80.00th=[ 36963], 90.00th=[ 46924], 95.00th=[ 55837], | 99.00th=[ 79168], 99.50th=[102237], 99.90th=[295699], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 15, max= 183, per=25.15%, avg=77.71, stdev=26.09, samples=151 iops : min= 3, max= 45, avg=18.83, stdev= 6.59, samples=151 write: IOPS=20, BW=81.6KiB/s (83.6kB/s)(6296KiB/77110msec); 0 zone resets clat (usec): min=881, max=156231, avg=24667.17, stdev=22949.98 lat (usec): min=883, max=156232, avg=24668.76, stdev=22949.93 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1385], 10.00th=[ 1958], 20.00th=[ 3195], | 30.00th=[ 5866], 40.00th=[ 13435], 50.00th=[ 20317], 60.00th=[ 26346], | 70.00th=[ 33424], 80.00th=[ 42730], 90.00th=[ 54264], 95.00th=[ 67634], | 99.00th=[ 99091], 99.50th=[109577], 99.90th=[141558], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 15, max= 155, per=25.23%, avg=81.74, stdev=25.36, samples=151 iops : min= 3, max= 38, avg=19.83, stdev= 6.34, samples=151 lat (usec) : 50=0.49%, 100=3.19%, 250=0.59%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.44%, 4=7.03%, 10=7.98%, 20=23.50%, 50=40.89% lat (msec) : 100=9.86%, 250=0.68%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=9.28%, ctx=7034, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145337: Thu Sep 3 16:26:43 2026 read: IOPS=19, BW=77.3KiB/s (79.1kB/s)(5940KiB/76889msec) clat (usec): min=30, max=158740, avg=24492.04, stdev=17716.18 lat (usec): min=30, max=158741, avg=24494.60, stdev=17715.55 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 7635], 20.00th=[ 12518], | 30.00th=[ 15270], 40.00th=[ 17695], 50.00th=[ 20579], 60.00th=[ 23987], | 70.00th=[ 28705], 80.00th=[ 35914], 90.00th=[ 45876], 95.00th=[ 55837], | 99.00th=[ 83362], 99.50th=[ 95945], 99.90th=[137364], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 6, max= 167, per=25.05%, avg=77.41, stdev=28.36, samples=151 iops : min= 1, max= 41, avg=18.75, stdev= 7.13, samples=151 write: IOPS=20, BW=82.6KiB/s (84.5kB/s)(6348KiB/76889msec); 0 zone resets clat (usec): min=842, max=762066, avg=25366.59, stdev=31089.21 lat (usec): min=842, max=762067, avg=25369.13, stdev=31088.76 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1352], 10.00th=[ 1893], 20.00th=[ 3359], | 30.00th=[ 5932], 40.00th=[ 12387], 50.00th=[ 19006], 60.00th=[ 25297], | 70.00th=[ 32900], 80.00th=[ 42730], 90.00th=[ 56886], 95.00th=[ 70779], | 99.00th=[109577], 99.50th=[135267], 99.90th=[225444], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 23, max= 175, per=25.49%, avg=82.59, stdev=29.97, samples=151 iops : min= 5, max= 43, avg=20.05, stdev= 7.52, samples=151 lat (usec) : 50=0.65%, 100=2.83%, 250=0.85%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.37%, 4=6.71%, 10=8.85%, 20=24.51%, 50=39.19% lat (msec) : 100=9.86%, 250=0.88%, 1000=0.03% cpu : usr=0.09%, sys=9.42%, ctx=6889, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145338: Thu Sep 3 16:26:43 2026 read: IOPS=19, BW=78.4KiB/s (80.3kB/s)(6028KiB/76839msec) clat (usec): min=27, max=767162, avg=24871.51, stdev=27788.04 lat (usec): min=27, max=767163, avg=24873.20, stdev=27788.30 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 68], 10.00th=[ 644], 20.00th=[ 11994], | 30.00th=[ 15139], 40.00th=[ 17695], 50.00th=[ 20841], 60.00th=[ 24511], | 70.00th=[ 28967], 80.00th=[ 34866], 90.00th=[ 44827], 95.00th=[ 54264], | 99.00th=[ 86508], 99.50th=[129500], 99.90th=[299893], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 6, max= 160, per=25.25%, avg=78.03, stdev=28.97, samples=152 iops : min= 1, max= 40, avg=18.91, stdev= 7.26, samples=152 write: IOPS=20, BW=81.5KiB/s (83.4kB/s)(6260KiB/76839msec); 0 zone resets clat (usec): min=855, max=179070, avg=24975.98, stdev=23474.48 lat (usec): min=857, max=179072, avg=24978.03, stdev=23474.04 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1237], 10.00th=[ 1745], 20.00th=[ 3097], | 30.00th=[ 6128], 40.00th=[ 13042], 50.00th=[ 20317], 60.00th=[ 26870], | 70.00th=[ 34341], 80.00th=[ 43254], 90.00th=[ 56886], 95.00th=[ 69731], | 99.00th=[ 96994], 99.50th=[109577], 99.90th=[170918], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 20, max= 158, per=24.97%, avg=80.91, stdev=28.65, samples=152 iops : min= 5, max= 39, avg=19.63, stdev= 7.17, samples=152 lat (usec) : 50=0.65%, 100=3.35%, 250=0.68%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=5.86%, 4=6.32%, 10=8.53%, 20=22.82%, 50=40.95% lat (msec) : 100=9.51%, 250=0.68%, 500=0.07%, 1000=0.03% cpu : usr=0.11%, sys=9.12%, ctx=6952, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145339: Thu Sep 3 16:26:43 2026 read: IOPS=19, BW=78.0KiB/s (79.9kB/s)(6052KiB/77587msec) clat (usec): min=31, max=173483, avg=24577.95, stdev=18007.12 lat (usec): min=31, max=173484, avg=24580.57, stdev=18006.86 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 469], 20.00th=[ 11863], | 30.00th=[ 15008], 40.00th=[ 17695], 50.00th=[ 20579], 60.00th=[ 24773], | 70.00th=[ 29754], 80.00th=[ 36963], 90.00th=[ 47449], 95.00th=[ 58459], | 99.00th=[ 78119], 99.50th=[105382], 99.90th=[137364], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 23, max= 151, per=25.19%, avg=77.83, stdev=25.69, samples=151 iops : min= 5, max= 37, avg=18.87, stdev= 6.47, samples=151 write: IOPS=20, BW=80.4KiB/s (82.3kB/s)(6236KiB/77587msec); 0 zone resets clat (usec): min=905, max=807741, avg=25737.06, stdev=33258.33 lat (usec): min=906, max=807744, avg=25739.95, stdev=33257.93 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1254], 10.00th=[ 1844], 20.00th=[ 3326], | 30.00th=[ 5866], 40.00th=[ 12256], 50.00th=[ 19792], 60.00th=[ 26084], | 70.00th=[ 33162], 80.00th=[ 42206], 90.00th=[ 58983], 95.00th=[ 73925], | 99.00th=[105382], 99.50th=[112722], 99.90th=[459277], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 15, max= 158, per=24.69%, avg=80.00, stdev=30.38, samples=152 iops : min= 3, max= 39, avg=19.41, stdev= 7.60, samples=152 lat (usec) : 50=0.91%, 100=3.16%, 250=0.68%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=5.86%, 4=6.02%, 10=8.66%, 20=23.50%, 50=39.71% lat (msec) : 100=10.16%, 250=0.75%, 500=0.07%, 1000=0.03% cpu : usr=0.11%, sys=9.14%, ctx=6993, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=309KiB/s (317kB/s), 77.3KiB/s-78.4KiB/s (79.1kB/s-80.3kB/s), io=23.4MiB (24.6MB), run=76839-77587msec WRITE: bw=324KiB/s (332kB/s), 80.4KiB/s-82.6KiB/s (82.3kB/s-84.5kB/s), io=24.6MiB (25.7MB), run=76839-77587msec fio: pid=145335, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=145332: Thu Sep 3 16:28:21 2026 read: IOPS=8, BW=34.4KiB/s (35.2kB/s)(5992KiB/174432msec) clat (msec): min=4, max=773, avg=24.37, stdev=30.34 lat (msec): min=4, max=773, avg=24.37, stdev=30.34 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 47], 95.00th=[ 63], | 99.00th=[ 122], 99.50th=[ 153], 99.90th=[ 317], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 128, per=26.81%, avg=35.40, stdev=22.36, samples=331 iops : min= 1, max= 32, avg= 8.33, stdev= 5.61, samples=331 write: IOPS=9, BW=36.1KiB/s (36.0kB/s)(6296KiB/174432msec); 0 zone resets clat (msec): min=31, max=322, avg=87.46, stdev=35.24 lat (msec): min=31, max=322, avg=87.46, stdev=35.24 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 45], 10.00th=[ 51], 20.00th=[ 58], | 30.00th=[ 67], 40.00th=[ 73], 50.00th=[ 82], 60.00th=[ 89], | 70.00th=[ 100], 80.00th=[ 113], 90.00th=[ 136], 95.00th=[ 155], | 99.00th=[ 199], 99.50th=[ 224], 99.90th=[ 313], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 72, per=25.89%, avg=35.73, stdev=13.33, samples=344 iops : min= 1, max= 18, avg= 8.40, stdev= 3.39, samples=344 lat (msec) : 10=9.83%, 20=19.50%, 50=20.38%, 100=34.34%, 250=15.66% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.05%, sys=1.79%, ctx=5625, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145333: Thu Sep 3 16:28:21 2026 read: IOPS=8, BW=33.8KiB/s (34.7kB/s)(5940KiB/175485msec) clat (msec): min=4, max=722, avg=23.92, stdev=28.90 lat (msec): min=4, max=722, avg=23.92, stdev=28.90 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 45], 95.00th=[ 63], | 99.00th=[ 110], 99.50th=[ 174], 99.90th=[ 321], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 104, per=26.91%, avg=35.52, stdev=21.05, samples=328 iops : min= 1, max= 26, avg= 8.35, stdev= 5.28, samples=328 write: IOPS=9, BW=36.2KiB/s (37.0kB/s)(6348KiB/175485msec); 0 zone resets clat (msec): min=30, max=490, avg=88.01, stdev=36.92 lat (msec): min=30, max=490, avg=88.01, stdev=36.92 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 45], 10.00th=[ 50], 20.00th=[ 59], | 30.00th=[ 66], 40.00th=[ 73], 50.00th=[ 82], 60.00th=[ 89], | 70.00th=[ 99], 80.00th=[ 114], 90.00th=[ 136], 95.00th=[ 157], | 99.00th=[ 201], 99.50th=[ 230], 99.90th=[ 321], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 71, per=25.98%, avg=35.85, stdev=13.78, samples=347 iops : min= 1, max= 17, avg= 8.44, stdev= 3.51, samples=347 lat (msec) : 10=9.67%, 20=18.68%, 50=21.88%, 100=34.08%, 250=15.49% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.05%, sys=1.84%, ctx=5617, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145334: Thu Sep 3 16:28:21 2026 read: IOPS=8, BW=34.7KiB/s (35.5kB/s)(6028KiB/173932msec) clat (msec): min=4, max=249, avg=24.66, stdev=22.57 lat (msec): min=4, max=249, avg=24.66, stdev=22.57 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 33], 90.00th=[ 47], 95.00th=[ 65], | 99.00th=[ 121], 99.50th=[ 165], 99.90th=[ 226], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 7, max= 120, per=26.68%, avg=35.22, stdev=21.09, samples=335 iops : min= 1, max= 30, avg= 8.28, stdev= 5.31, samples=335 write: IOPS=8, BW=35.0KiB/s (36.9kB/s)(6260KiB/173932msec); 0 zone resets clat (msec): min=26, max=766, avg=87.22, stdev=39.54 lat (msec): min=26, max=766, avg=87.22, stdev=39.54 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 45], 10.00th=[ 50], 20.00th=[ 58], | 30.00th=[ 65], 40.00th=[ 71], 50.00th=[ 80], 60.00th=[ 89], | 70.00th=[ 97], 80.00th=[ 111], 90.00th=[ 134], 95.00th=[ 155], | 99.00th=[ 205], 99.50th=[ 241], 99.90th=[ 313], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 71, per=25.77%, avg=35.56, stdev=14.08, samples=344 iops : min= 1, max= 17, avg= 8.36, stdev= 3.57, samples=344 lat (msec) : 10=8.59%, 20=18.52%, 50=22.85%, 100=35.16%, 250=14.68% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.05%, sys=1.78%, ctx=5498, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145335: Thu Sep 3 16:28:21 2026 read: IOPS=8, BW=34.8KiB/s (35.7kB/s)(5316KiB/152635msec) clat (msec): min=5, max=265, avg=23.88, stdev=23.77 lat (msec): min=5, max=265, avg=23.88, stdev=23.77 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 51], 95.00th=[ 65], | 99.00th=[ 120], 99.50th=[ 159], 99.90th=[ 232], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 7, max= 120, per=27.22%, avg=35.93, stdev=22.44, samples=290 iops : min= 1, max= 30, avg= 8.46, stdev= 5.65, samples=290 write: IOPS=8, BW=35.5KiB/s (36.3kB/s)(5416KiB/152635msec); 0 zone resets clat (msec): min=30, max=806, avg=89.08, stdev=43.20 lat (msec): min=30, max=806, avg=89.08, stdev=43.20 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 44], 10.00th=[ 50], 20.00th=[ 58], | 30.00th=[ 65], 40.00th=[ 73], 50.00th=[ 81], 60.00th=[ 90], | 70.00th=[ 101], 80.00th=[ 116], 90.00th=[ 140], 95.00th=[ 161], | 99.00th=[ 220], 99.50th=[ 234], 99.90th=[ 489], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 72, per=25.42%, avg=35.07, stdev=14.35, samples=302 iops : min= 1, max= 18, avg= 8.24, stdev= 3.66, samples=302 lat (msec) : 10=11.62%, 20=18.78%, 50=19.60%, 100=33.87%, 250=15.87% lat (msec) : 500=0.19%, 1000=0.04% cpu : usr=0.05%, sys=1.86%, ctx=4655, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1330,1354,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=133KiB/s (136kB/s), 33.8KiB/s-34.8KiB/s (34.7kB/s-35.7kB/s), io=22.7MiB (23.8MB), run=152635-175485msec WRITE: bw=139KiB/s (142kB/s), 35.5KiB/s-36.2KiB/s (36.3kB/s-37.0kB/s), io=23.8MiB (24.9MB), run=152635-175485msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145378: Thu Sep 3 16:28:50 2026 read: IOPS=17, BW=285KiB/s (292kB/s)(5920KiB/20783msec) clat (usec): min=40, max=232982, avg=28471.36, stdev=24063.74 lat (usec): min=41, max=232983, avg=28472.46, stdev=24063.65 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 11076], | 30.00th=[ 17433], 40.00th=[ 20841], 50.00th=[ 25297], 60.00th=[ 29230], | 70.00th=[ 35390], 80.00th=[ 42730], 90.00th=[ 56886], 95.00th=[ 68682], | 99.00th=[103285], 99.50th=[129500], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 63, max= 608, per=24.69%, avg=284.44, stdev=109.05, samples=41 iops : min= 3, max= 38, avg=17.10, stdev= 6.89, samples=41 write: IOPS=19, BW=306KiB/s (314kB/s)(6368KiB/20783msec); 0 zone resets clat (usec): min=1427, max=157126, avg=25396.64, stdev=26269.89 lat (usec): min=1429, max=157129, avg=25399.23, stdev=26269.28 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 2147], 10.00th=[ 2868], 20.00th=[ 4490], | 30.00th=[ 6325], 40.00th=[ 8979], 50.00th=[ 15664], 60.00th=[ 23200], | 70.00th=[ 32900], 80.00th=[ 45351], 90.00th=[ 61604], 95.00th=[ 77071], | 99.00th=[114820], 99.50th=[154141], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 63, max= 544, per=25.30%, avg=306.63, stdev=90.82, samples=41 iops : min= 3, max= 34, avg=18.49, stdev= 5.82, samples=41 lat (usec) : 50=0.91%, 100=6.38%, 250=1.04%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.34%, 4=6.64%, 10=13.02%, 20=16.28%, 50=37.11% lat (msec) : 100=14.32%, 250=1.30% cpu : usr=0.10%, sys=8.95%, ctx=1693, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145379: Thu Sep 3 16:28:50 2026 read: IOPS=17, BW=288KiB/s (295kB/s)(5744KiB/19955msec) clat (usec): min=42, max=185811, avg=29448.62, stdev=25504.32 lat (usec): min=43, max=185811, avg=29454.60, stdev=25502.48 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 578], | 30.00th=[ 17695], 40.00th=[ 23200], 50.00th=[ 26608], 60.00th=[ 31589], | 70.00th=[ 36439], 80.00th=[ 44303], 90.00th=[ 54789], 95.00th=[ 69731], | 99.00th=[122160], 99.50th=[158335], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 108, max= 510, per=24.96%, avg=287.54, stdev=91.11, samples=39 iops : min= 6, max= 31, avg=17.28, stdev= 5.82, samples=39 write: IOPS=20, BW=328KiB/s (336kB/s)(6544KiB/19955msec); 0 zone resets clat (usec): min=1406, max=127093, avg=22786.30, stdev=22872.52 lat (usec): min=1408, max=127094, avg=22788.26, stdev=22872.73 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2114], 10.00th=[ 2933], 20.00th=[ 4621], | 30.00th=[ 6652], 40.00th=[ 9765], 50.00th=[ 14484], 60.00th=[ 19006], | 70.00th=[ 28443], 80.00th=[ 40109], 90.00th=[ 54264], 95.00th=[ 70779], | 99.00th=[ 98042], 99.50th=[104334], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 95, max= 574, per=26.95%, avg=326.64, stdev=118.66, samples=39 iops : min= 5, max= 35, avg=19.74, stdev= 7.45, samples=39 lat (usec) : 50=0.26%, 100=7.68%, 250=1.04%, 500=0.26%, 750=0.26% lat (msec) : 2=2.34%, 4=6.12%, 10=13.54%, 20=17.06%, 50=38.54% lat (msec) : 100=11.46%, 250=1.43% cpu : usr=0.11%, sys=9.08%, ctx=1505, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145380: Thu Sep 3 16:28:50 2026 read: IOPS=19, BW=311KiB/s (319kB/s)(6256KiB/20093msec) clat (usec): min=36, max=198247, avg=26692.20, stdev=23132.14 lat (usec): min=36, max=198248, avg=26693.32, stdev=23132.19 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 104], | 30.00th=[ 15664], 40.00th=[ 20317], 50.00th=[ 26084], 60.00th=[ 29754], | 70.00th=[ 35914], 80.00th=[ 41681], 90.00th=[ 52691], 95.00th=[ 64750], | 99.00th=[109577], 99.50th=[115868], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 63, max= 540, per=27.03%, avg=311.33, stdev=115.57, samples=39 iops : min= 3, max= 33, avg=18.77, stdev= 7.30, samples=39 write: IOPS=18, BW=300KiB/s (307kB/s)(6032KiB/20093msec); 0 zone resets clat (usec): min=1369, max=230237, avg=25290.51, stdev=25552.76 lat (usec): min=1371, max=230239, avg=25293.71, stdev=25551.63 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1942], 10.00th=[ 3032], 20.00th=[ 4752], | 30.00th=[ 7046], 40.00th=[ 12125], 50.00th=[ 18220], 60.00th=[ 25035], | 70.00th=[ 31327], 80.00th=[ 40109], 90.00th=[ 57934], 95.00th=[ 72877], | 99.00th=[111674], 99.50th=[121111], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 95, max= 512, per=24.46%, avg=296.51, stdev=98.12, samples=39 iops : min= 5, max= 32, avg=17.85, stdev= 6.31, samples=39 lat (usec) : 50=1.17%, 100=8.85%, 250=1.56%, 500=0.52%, 750=0.26% lat (msec) : 2=2.60%, 4=5.34%, 10=11.20%, 20=13.93%, 50=40.89% lat (msec) : 100=12.24%, 250=1.43% cpu : usr=0.07%, sys=8.92%, ctx=1553, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145381: Thu Sep 3 16:28:50 2026 read: IOPS=18, BW=295KiB/s (302kB/s)(6032KiB/20433msec) clat (usec): min=32, max=166492, avg=28216.97, stdev=23728.30 lat (usec): min=32, max=166493, avg=28217.99, stdev=23728.31 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 149], | 30.00th=[ 17433], 40.00th=[ 21627], 50.00th=[ 25297], 60.00th=[ 29230], | 70.00th=[ 37487], 80.00th=[ 44303], 90.00th=[ 54264], 95.00th=[ 68682], | 99.00th=[112722], 99.50th=[162530], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 109, max= 480, per=25.23%, avg=290.68, stdev=100.59, samples=40 iops : min= 6, max= 30, avg=17.48, stdev= 6.33, samples=40 write: IOPS=19, BW=306KiB/s (314kB/s)(6256KiB/20433msec); 0 zone resets clat (usec): min=1382, max=211761, avg=24648.73, stdev=25930.84 lat (usec): min=1384, max=211763, avg=24653.09, stdev=25929.82 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2073], 10.00th=[ 3195], 20.00th=[ 4752], | 30.00th=[ 7177], 40.00th=[ 10683], 50.00th=[ 17433], 60.00th=[ 22676], | 70.00th=[ 28705], 80.00th=[ 41681], 90.00th=[ 57934], 95.00th=[ 70779], | 99.00th=[128451], 99.50th=[143655], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 126, max= 573, per=25.03%, avg=303.40, stdev=103.06, samples=40 iops : min= 7, max= 35, avg=18.27, stdev= 6.48, samples=40 lat (usec) : 50=0.91%, 100=7.42%, 250=1.95%, 500=0.13% lat (msec) : 2=2.47%, 4=5.34%, 10=12.63%, 20=14.71%, 50=40.10% lat (msec) : 100=12.89%, 250=1.43% cpu : usr=0.10%, sys=8.83%, ctx=1569, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1152KiB/s (1180kB/s), 285KiB/s-311KiB/s (292kB/s-319kB/s), io=23.4MiB (24.5MB), run=19955-20783msec WRITE: bw=1213KiB/s (1242kB/s), 300KiB/s-328KiB/s (307kB/s-336kB/s), io=24.6MiB (25.8MB), run=19955-20783msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145383: Thu Sep 3 16:29:18 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5920KiB/47593msec) clat (msec): min=6, max=152, avg=25.74, stdev=23.60 lat (msec): min=6, max=152, avg=25.74, stdev=23.60 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 56], 95.00th=[ 83], | 99.00th=[ 121], 99.50th=[ 126], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 31, max= 441, per=25.64%, avg=126.67, stdev=79.36, samples=92 iops : min= 1, max= 27, avg= 7.21, stdev= 5.00, samples=92 write: IOPS=8, BW=134KiB/s (137kB/s)(6368KiB/47593msec); 0 zone resets clat (msec): min=34, max=285, avg=94.87, stdev=42.14 lat (msec): min=34, max=285, avg=94.87, stdev=42.14 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 51], 10.00th=[ 55], 20.00th=[ 63], | 30.00th=[ 68], 40.00th=[ 78], 50.00th=[ 85], 60.00th=[ 94], | 70.00th=[ 105], 80.00th=[ 125], 90.00th=[ 146], 95.00th=[ 174], | 99.00th=[ 271], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 223, per=25.92%, avg=134.81, stdev=50.50, samples=93 iops : min= 1, max= 13, avg= 7.71, stdev= 3.18, samples=93 lat (msec) : 10=5.34%, 20=24.74%, 50=14.32%, 100=36.98%, 250=17.97% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.76%, ctx=1329, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145384: Thu Sep 3 16:29:18 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(5744KiB/48404msec) clat (msec): min=5, max=178, avg=25.06, stdev=25.53 lat (msec): min=5, max=178, avg=25.06, stdev=25.53 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 50], 95.00th=[ 72], | 99.00th=[ 146], 99.50th=[ 171], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 26, max= 416, per=25.40%, avg=125.48, stdev=74.13, samples=89 iops : min= 1, max= 26, avg= 7.12, stdev= 4.72, samples=89 write: IOPS=8, BW=135KiB/s (138kB/s)(6544KiB/48404msec); 0 zone resets clat (msec): min=38, max=329, avg=95.81, stdev=41.78 lat (msec): min=38, max=329, avg=95.82, stdev=41.78 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 65], | 30.00th=[ 71], 40.00th=[ 77], 50.00th=[ 84], 60.00th=[ 94], | 70.00th=[ 106], 80.00th=[ 122], 90.00th=[ 155], 95.00th=[ 176], | 99.00th=[ 234], 99.50th=[ 255], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 26, max= 255, per=25.75%, avg=133.92, stdev=52.22, samples=95 iops : min= 1, max= 15, avg= 7.66, stdev= 3.31, samples=95 lat (msec) : 10=4.95%, 20=23.57%, 50=15.89%, 100=35.55%, 250=19.66% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=1.80%, ctx=1439, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145385: Thu Sep 3 16:29:18 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/46169msec) clat (msec): min=5, max=174, avg=24.78, stdev=24.17 lat (msec): min=5, max=174, avg=24.78, stdev=24.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 51], 95.00th=[ 77], | 99.00th=[ 138], 99.50th=[ 161], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 415, per=28.80%, avg=142.25, stdev=91.10, samples=87 iops : min= 1, max= 25, avg= 8.17, stdev= 5.71, samples=87 write: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/46169msec); 0 zone resets clat (msec): min=36, max=326, avg=96.41, stdev=41.27 lat (msec): min=36, max=326, avg=96.41, stdev=41.27 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 64], | 30.00th=[ 71], 40.00th=[ 78], 50.00th=[ 86], 60.00th=[ 97], | 70.00th=[ 108], 80.00th=[ 125], 90.00th=[ 155], 95.00th=[ 178], | 99.00th=[ 239], 99.50th=[ 279], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 224, per=24.92%, avg=129.56, stdev=49.56, samples=91 iops : min= 1, max= 14, avg= 7.40, stdev= 3.17, samples=91 lat (msec) : 10=6.12%, 20=24.87%, 50=17.45%, 100=32.42%, 250=18.75% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.76%, ctx=1355, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145386: Thu Sep 3 16:29:18 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(6032KiB/47845msec) clat (msec): min=6, max=259, avg=26.20, stdev=28.03 lat (msec): min=6, max=259, avg=26.21, stdev=28.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 51], 95.00th=[ 89], | 99.00th=[ 144], 99.50th=[ 174], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 352, per=25.75%, avg=127.23, stdev=79.13, samples=92 iops : min= 1, max= 22, avg= 7.24, stdev= 5.00, samples=92 write: IOPS=8, BW=131KiB/s (134kB/s)(6256KiB/47845msec); 0 zone resets clat (msec): min=34, max=271, avg=96.42, stdev=40.20 lat (msec): min=34, max=271, avg=96.42, stdev=40.20 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 65], | 30.00th=[ 72], 40.00th=[ 80], 50.00th=[ 88], 60.00th=[ 96], | 70.00th=[ 108], 80.00th=[ 124], 90.00th=[ 146], 95.00th=[ 186], | 99.00th=[ 224], 99.50th=[ 245], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 27, max= 254, per=24.92%, avg=129.61, stdev=52.24, samples=94 iops : min= 1, max= 15, avg= 7.38, stdev= 3.32, samples=94 lat (msec) : 10=5.08%, 20=26.56%, 50=15.10%, 100=33.46%, 250=19.53% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.67%, ctx=1416, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=495KiB/s (507kB/s), 119KiB/s-136KiB/s (122kB/s-139kB/s), io=23.4MiB (24.5MB), run=46169-48404msec WRITE: bw=521KiB/s (533kB/s), 131KiB/s-135KiB/s (134kB/s-138kB/s), io=24.6MiB (25.8MB), run=46169-48404msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145402: Thu Sep 3 16:29:31 2026 read: IOPS=2, BW=2453KiB/s (2512kB/s)(7168KiB/2922msec) clat (usec): min=557, max=292794, avg=201964.78, stdev=97006.40 lat (usec): min=559, max=292795, avg=201966.05, stdev=97006.49 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[160433], | 30.00th=[231736], 40.00th=[231736], 50.00th=[238027], 60.00th=[238027], | 70.00th=[238027], 80.00th=[250610], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 1718, max= 4162, per=51.01%, avg=2457.75, stdev=1143.41, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1752KiB/s (1794kB/s)(5120KiB/2922msec); 0 zone resets clat (msec): min=173, max=366, avg=283.05, stdev=73.87 lat (msec): min=173, max=366, avg=283.12, stdev=73.86 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1924, max= 3878, per=38.68%, avg=2609.67, stdev=1099.62, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=19.86%, ctx=233, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145403: Thu Sep 3 16:29:31 2026 read: IOPS=0, BW=482KiB/s (493kB/s)(2048KiB/4250msec) clat (usec): min=1386, max=248246, avg=124816.83, stdev=174556.38 lat (usec): min=1388, max=248249, avg=124818.79, stdev=174557.14 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[248513], | 70.00th=[248513], 80.00th=[248513], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 1381, max= 1939, per=34.45%, avg=1660.00, stdev=394.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2409KiB/s (2467kB/s)(10.0MiB/4250msec); 0 zone resets clat (msec): min=139, max=842, avg=392.44, stdev=213.52 lat (msec): min=139, max=842, avg=392.50, stdev=213.51 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 203], | 30.00th=[ 236], 40.00th=[ 247], 50.00th=[ 305], 60.00th=[ 409], | 70.00th=[ 456], 80.00th=[ 502], 90.00th=[ 592], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2011, max= 4039, per=46.85%, avg=3160.80, stdev=1044.84, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 2=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=16.19%, ctx=143, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145404: Thu Sep 3 16:29:31 2026 read: IOPS=1, BW=1889KiB/s (1934kB/s)(6144KiB/3253msec) clat (usec): min=449, max=407638, avg=127116.41, stdev=161517.42 lat (usec): min=450, max=407639, avg=127117.29, stdev=161517.44 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 766], | 30.00th=[ 766], 40.00th=[ 50070], 50.00th=[ 50070], 60.00th=[ 72877], | 70.00th=[231736], 80.00th=[231736], 90.00th=[408945], 95.00th=[408945], | 99.00th=[408945], 99.50th=[408945], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 1700, max= 4071, per=66.71%, avg=3214.00, stdev=1314.97, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1889KiB/s (1934kB/s)(6144KiB/3253msec); 0 zone resets clat (msec): min=181, max=589, avg=408.09, stdev=180.52 lat (msec): min=181, max=589, avg=408.15, stdev=180.52 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 502], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1700, max= 3953, per=34.26%, avg=2311.00, stdev=926.34, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67% cpu : usr=0.06%, sys=16.36%, ctx=209, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145405: Thu Sep 3 16:29:31 2026 read: IOPS=1, BW=1647KiB/s (1687kB/s)(5120KiB/3108msec) clat (usec): min=459, max=330438, avg=151689.04, stdev=137841.14 lat (usec): min=460, max=330439, avg=151690.13, stdev=137841.17 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 461], | 30.00th=[ 29754], 40.00th=[ 29754], 50.00th=[168821], 60.00th=[168821], | 70.00th=[229639], 80.00th=[229639], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2027, max= 5818, per=81.41%, avg=3922.50, stdev=2680.64, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2306KiB/s (2362kB/s)(7168KiB/3108msec); 0 zone resets clat (msec): min=163, max=558, avg=322.78, stdev=143.40 lat (msec): min=163, max=558, avg=323.02, stdev=143.57 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 178], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 296], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 447], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1430, max= 3849, per=32.50%, avg=2192.60, stdev=954.23, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=21.44%, ctx=146, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4819KiB/s (4934kB/s), 482KiB/s-2453KiB/s (493kB/s-2512kB/s), io=20.0MiB (20.0MB), run=2922-4250msec WRITE: bw=6746KiB/s (6908kB/s), 1752KiB/s-2409KiB/s (1794kB/s-2467kB/s), io=28.0MiB (29.4MB), run=2922-4250msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145407: Thu Sep 3 16:29:31 2026 read: IOPS=1, BW=1887KiB/s (1932kB/s)(7168KiB/3799msec) clat (msec): min=74, max=691, avg=293.81, stdev=257.11 lat (msec): min=74, max=691, avg=293.81, stdev=257.10 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 99], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 167], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 625], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1917, max= 4063, per=51.07%, avg=2487.25, stdev=1051.45, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1348KiB/s (1380kB/s)(5120KiB/3799msec); 0 zone resets clat (msec): min=140, max=707, avg=322.81, stdev=221.23 lat (msec): min=140, max=707, avg=322.93, stdev=221.21 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2031, max= 4087, per=39.92%, avg=2722.00, stdev=1182.16, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.03%, sys=6.24%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145408: Thu Sep 3 16:29:31 2026 read: IOPS=0, BW=487KiB/s (499kB/s)(2048KiB/4205msec) clat (msec): min=77, max=125, avg=101.35, stdev=34.12 lat (msec): min=77, max=125, avg=101.35, stdev=34.12 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 126], | 70.00th=[ 126], 80.00th=[ 126], 90.00th=[ 126], 95.00th=[ 126], | 99.00th=[ 126], 99.50th=[ 126], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 1943, max= 2043, per=40.92%, avg=1993.00, stdev=70.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2435KiB/s (2494kB/s)(10.0MiB/4205msec); 0 zone resets clat (msec): min=146, max=1133, avg=387.82, stdev=333.52 lat (msec): min=146, max=1133, avg=388.05, stdev=333.65 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 165], 50.00th=[ 239], 60.00th=[ 241], | 70.00th=[ 271], 80.00th=[ 634], 90.00th=[ 726], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2031, max= 6119, per=53.32%, avg=3635.60, stdev=1697.98, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.48, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=5.64%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145409: Thu Sep 3 16:29:31 2026 read: IOPS=1, BW=1600KiB/s (1638kB/s)(6144KiB/3840msec) clat (msec): min=53, max=376, avg=156.67, stdev=125.87 lat (msec): min=53, max=376, avg=156.67, stdev=125.87 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 107], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2023, max= 4087, per=55.72%, avg=2713.67, stdev=1189.35, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1600KiB/s (1638kB/s)(6144KiB/3840msec); 0 zone resets clat (msec): min=136, max=1167, avg=467.01, stdev=442.42 lat (msec): min=136, max=1167, avg=467.08, stdev=442.43 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 300], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 2031, max= 4055, per=37.32%, avg=2544.25, stdev=1007.19, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.00%, ctx=105, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145410: Thu Sep 3 16:29:31 2026 read: IOPS=1, BW=1228KiB/s (1258kB/s)(5120KiB/4169msec) clat (msec): min=53, max=284, avg=189.38, stdev=96.48 lat (msec): min=53, max=284, avg=189.38, stdev=96.48 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 2043, max= 6144, per=84.06%, avg=4093.50, stdev=2899.84, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1719KiB/s (1761kB/s)(7168KiB/4169msec); 0 zone resets clat (msec): min=80, max=1008, avg=445.50, stdev=376.08 lat (msec): min=80, max=1008, avg=445.61, stdev=376.05 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 136], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 220], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 785], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1980, max= 4079, per=43.94%, avg=2995.75, stdev=1146.15, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=5.78%, ctx=88, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4870KiB/s (4987kB/s), 487KiB/s-1887KiB/s (499kB/s-1932kB/s), io=20.0MiB (20.0MB), run=3799-4205msec WRITE: bw=6819KiB/s (6982kB/s), 1348KiB/s-2435KiB/s (1380kB/s-2494kB/s), io=28.0MiB (29.4MB), run=3799-4205msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145416: Thu Sep 3 16:29:43 2026 read: IOPS=1, BW=5238KiB/s (5364kB/s)(12.0MiB/2346msec) clat (msec): min=729, max=781, avg=759.43, stdev=26.99 lat (msec): min=729, max=781, avg=759.43, stdev=26.99 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.51%, ctx=382, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145417: Thu Sep 3 16:29:43 2026 read: IOPS=0, BW=1381KiB/s (1415kB/s)(4096KiB/2965msec) clat (nsec): min=804672k, max=804672k, avg=804671724.00, stdev= 0.00 lat (nsec): min=804674k, max=804674k, avg=804674130.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2763KiB/s (2829kB/s)(8192KiB/2965msec); 0 zone resets clat (msec): min=523, max=1592, avg=1058.28, stdev=756.11 lat (msec): min=524, max=1593, avg=1059.02, stdev=755.61 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8159, max= 8159, per=73.83%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.70%, ctx=205, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145418: Thu Sep 3 16:29:43 2026 write: IOPS=1, BW=7656KiB/s (7840kB/s)(12.0MiB/1605msec); 0 zone resets clat (msec): min=341, max=620, avg=526.49, stdev=159.95 lat (msec): min=342, max=621, avg=527.20, stdev=160.31 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 6380, max= 8159, per=65.78%, avg=7269.50, stdev=1257.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=7.42%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145419: Thu Sep 3 16:29:43 2026 write: IOPS=1, BW=5694KiB/s (5831kB/s)(12.0MiB/2158msec); 0 zone resets clat (msec): min=433, max=987, avg=706.00, stdev=276.99 lat (msec): min=434, max=987, avg=706.82, stdev=276.29 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8078, max= 8159, per=73.46%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.58%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5526KiB/s (5658kB/s), 1381KiB/s-5238KiB/s (1415kB/s-5364kB/s), io=16.0MiB (16.8MB), run=2346-2965msec WRITE: bw=10.8MiB/s (11.3MB/s), 2763KiB/s-7656KiB/s (2829kB/s-7840kB/s), io=32.0MiB (33.6MB), run=1605-2965msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145421: Thu Sep 3 16:29:43 2026 read: IOPS=1, BW=4815KiB/s (4931kB/s)(12.0MiB/2552msec) clat (msec): min=255, max=1500, avg=850.40, stdev=624.48 lat (msec): min=255, max=1500, avg=850.40, stdev=624.48 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=3.92%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145422: Thu Sep 3 16:29:43 2026 read: IOPS=0, BW=1536KiB/s (1573kB/s)(4096KiB/2666msec) clat (nsec): min=998688k, max=998688k, avg=998688040.00, stdev= 0.00 lat (nsec): min=998690k, max=998690k, avg=998690257.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3073KiB/s (3147kB/s)(8192KiB/2666msec); 0 zone resets clat (msec): min=349, max=1312, avg=830.97, stdev=681.42 lat (msec): min=349, max=1313, avg=831.31, stdev=681.41 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8094, max= 8094, per=65.85%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.39%, ctx=47, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145423: Thu Sep 3 16:29:43 2026 write: IOPS=1, BW=5065KiB/s (5187kB/s)(12.0MiB/2426msec); 0 zone resets clat (msec): min=622, max=1127, avg=794.07, stdev=288.96 lat (msec): min=622, max=1127, avg=794.36, stdev=288.90 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 6140, max= 8143, per=58.10%, avg=7141.50, stdev=1416.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.14%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145424: Thu Sep 3 16:29:43 2026 write: IOPS=1, BW=5413KiB/s (5543kB/s)(12.0MiB/2270msec); 0 zone resets clat (msec): min=192, max=1476, avg=755.79, stdev=656.54 lat (msec): min=192, max=1477, avg=756.18, stdev=656.49 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 6815, max= 8143, per=60.85%, avg=7479.00, stdev=939.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.76%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6146KiB/s (6293kB/s), 1536KiB/s-4815KiB/s (1573kB/s-4931kB/s), io=16.0MiB (16.8MB), run=2552-2666msec WRITE: bw=12.0MiB/s (12.6MB/s), 3073KiB/s-5413KiB/s (3147kB/s-5543kB/s), io=32.0MiB (33.6MB), run=2270-2666msec