== sanity test 398b: DIO and buffer IO race ============== 14:41:39 (1788288099) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.93493 s, 8.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178583: Tue Sep 1 14:44:06 2026 read: IOPS=11, BW=47.8KiB/s (48.0kB/s)(5992KiB/125344msec) clat (usec): min=35, max=760644, avg=45283.33, stdev=35196.47 lat (usec): min=35, max=760646, avg=45284.89, stdev=35196.68 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 8586], 10.00th=[ 15795], 20.00th=[ 22152], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[152044], 99.50th=[177210], 99.90th=[233833], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 111, per=25.18%, avg=47.59, stdev=19.54, samples=245 iops : min= 1, max= 27, avg=11.24, stdev= 4.92, samples=245 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6296KiB/125344msec); 0 zone resets clat (usec): min=760, max=464728, avg=36190.06, stdev=38226.79 lat (usec): min=760, max=464729, avg=36192.99, stdev=38228.39 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1369], 20.00th=[ 3556], | 30.00th=[ 7308], 40.00th=[ 17695], 50.00th=[ 26870], 60.00th=[ 34866], | 70.00th=[ 46924], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[162530], 99.50th=[183501], 99.90th=[258999], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 119, per=25.36%, avg=50.21, stdev=21.21, samples=244 iops : min= 1, max= 29, avg=11.90, stdev= 5.34, samples=244 lat (usec) : 50=0.52%, 100=1.53%, 500=0.10%, 1000=0.26% lat (msec) : 2=6.80%, 4=3.97%, 10=6.32%, 20=10.32%, 50=39.75% lat (msec) : 100=24.80%, 250=5.53%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=4.51%, ctx=6277, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178586: Tue Sep 1 14:44:06 2026 read: IOPS=11, BW=47.6KiB/s (48.8kB/s)(5940KiB/124768msec) clat (usec): min=35, max=844379, avg=47449.98, stdev=39427.03 lat (usec): min=36, max=844382, avg=47452.58, stdev=39427.45 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11207], 10.00th=[ 17433], 20.00th=[ 23200], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 65799], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[181404], 99.50th=[208667], 99.90th=[387974], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 111, per=25.21%, avg=47.64, stdev=19.12, samples=243 iops : min= 1, max= 27, avg=11.25, stdev= 4.81, samples=243 write: IOPS=12, BW=50.9KiB/s (52.1kB/s)(6348KiB/124768msec); 0 zone resets clat (usec): min=853, max=248397, avg=33932.51, stdev=35730.57 lat (usec): min=855, max=248400, avg=33936.71, stdev=35730.10 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 2769], | 30.00th=[ 6128], 40.00th=[ 15139], 50.00th=[ 24511], 60.00th=[ 33162], | 70.00th=[ 44303], 80.00th=[ 59507], 90.00th=[ 82314], 95.00th=[107480], | 99.00th=[156238], 99.50th=[168821], 99.90th=[185598], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 120, per=25.57%, avg=50.63, stdev=21.48, samples=244 iops : min= 1, max= 30, avg=12.00, stdev= 5.42, samples=244 lat (usec) : 50=0.26%, 100=1.66%, 250=0.03%, 1000=0.13% lat (msec) : 2=8.50%, 4=4.04%, 10=5.96%, 20=9.77%, 50=39.55% lat (msec) : 100=23.70%, 250=6.32%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=4.47%, ctx=6055, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178589: Tue Sep 1 14:44:06 2026 read: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6028KiB/126518msec) clat (usec): min=37, max=837112, avg=46478.51, stdev=38627.27 lat (usec): min=38, max=837113, avg=46481.19, stdev=38627.58 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 7570], 10.00th=[ 16188], 20.00th=[ 22414], | 30.00th=[ 27132], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[170918], 99.50th=[206570], 99.90th=[270533], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 6, max= 111, per=24.93%, avg=47.12, stdev=18.88, samples=248 iops : min= 1, max= 27, avg=11.12, stdev= 4.75, samples=248 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6260KiB/126518msec); 0 zone resets clat (usec): min=801, max=258319, avg=35834.28, stdev=37962.83 lat (usec): min=802, max=258320, avg=35837.96, stdev=37962.05 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1270], 20.00th=[ 2966], | 30.00th=[ 6456], 40.00th=[ 15270], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 46924], 80.00th=[ 62653], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[162530], 99.50th=[179307], 99.90th=[246416], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 127, per=24.92%, avg=49.34, stdev=21.46, samples=246 iops : min= 1, max= 31, avg=11.68, stdev= 5.41, samples=246 lat (usec) : 50=0.33%, 100=1.92%, 250=0.13%, 500=0.03%, 1000=0.33% lat (msec) : 2=7.32%, 4=4.33%, 10=6.15%, 20=9.67%, 50=38.67% lat (msec) : 100=24.45%, 250=6.51%, 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=4.40%, ctx=6268, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178590: Tue Sep 1 14:44:06 2026 read: IOPS=12, BW=48.8KiB/s (49.9kB/s)(6052KiB/124113msec) clat (usec): min=39, max=220998, avg=45513.02, stdev=29171.07 lat (usec): min=39, max=220999, avg=45516.30, stdev=29170.88 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10159], 10.00th=[ 16319], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 33424], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 66323], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[139461], 99.50th=[156238], 99.90th=[189793], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 7, max= 110, per=25.76%, avg=48.69, stdev=19.32, samples=243 iops : min= 1, max= 27, avg=11.51, stdev= 4.88, samples=243 write: IOPS=12, BW=50.2KiB/s (51.5kB/s)(6236KiB/124113msec); 0 zone resets clat (usec): min=733, max=890455, avg=35180.04, stdev=42232.26 lat (usec): min=735, max=890459, avg=35181.61, stdev=42232.26 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3032], | 30.00th=[ 6587], 40.00th=[ 16057], 50.00th=[ 24773], 60.00th=[ 34341], | 70.00th=[ 44303], 80.00th=[ 60031], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[156238], 99.50th=[175113], 99.90th=[278922], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 111, per=25.35%, avg=50.19, stdev=21.11, samples=243 iops : min= 1, max= 27, avg=11.89, stdev= 5.32, samples=243 lat (usec) : 50=0.16%, 100=1.76%, 250=0.03%, 750=0.03%, 1000=0.36% lat (msec) : 2=7.55%, 4=4.07%, 10=6.15%, 20=9.99%, 50=39.78% lat (msec) : 100=24.15%, 250=5.89%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.50%, ctx=6198, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (194kB/s), 47.6KiB/s-48.8KiB/s (48.8kB/s-49.9kB/s), io=23.4MiB (24.6MB), run=124113-126518msec WRITE: bw=199KiB/s (203kB/s), 49.5KiB/s-50.9KiB/s (50.7kB/s-52.1kB/s), io=24.6MiB (25.7MB), run=124113-126518msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178584: Tue Sep 1 14:44:46 2026 read: IOPS=8, BW=35.9KiB/s (36.7kB/s)(5992KiB/167133msec) clat (msec): min=4, max=848, avg=43.93, stdev=44.73 lat (msec): min=4, max=848, avg=43.94, stdev=44.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 97], 95.00th=[ 133], | 99.00th=[ 194], 99.50th=[ 215], 99.90th=[ 249], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 118, per=25.54%, avg=36.52, stdev=25.17, samples=319 iops : min= 1, max= 29, avg= 8.47, stdev= 6.33, samples=319 write: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6296KiB/167133msec); 0 zone resets clat (msec): min=12, max=454, avg=64.12, stdev=48.64 lat (msec): min=12, max=454, avg=64.13, stdev=48.64 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 95], 90.00th=[ 127], 95.00th=[ 157], | 99.00th=[ 230], 99.50th=[ 288], 99.90th=[ 435], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 111, per=24.94%, avg=37.42, stdev=23.71, samples=327 iops : min= 1, max= 27, avg= 8.69, stdev= 5.96, samples=327 lat (msec) : 10=2.28%, 20=14.52%, 50=46.29%, 100=23.11%, 250=13.38% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4630, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178585: Tue Sep 1 14:44:46 2026 read: IOPS=8, BW=35.5KiB/s (36.4kB/s)(5940KiB/167145msec) clat (msec): min=5, max=878, avg=44.85, stdev=47.37 lat (msec): min=5, max=878, avg=44.86, stdev=47.37 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 213], 99.50th=[ 224], 99.90th=[ 359], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 135, per=25.72%, avg=36.78, stdev=25.49, samples=314 iops : min= 1, max= 33, avg= 8.54, stdev= 6.41, samples=314 write: IOPS=9, BW=37.0KiB/s (38.9kB/s)(6348KiB/167145msec); 0 zone resets clat (msec): min=10, max=438, avg=63.10, stdev=47.09 lat (msec): min=10, max=438, avg=63.11, stdev=47.09 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 161], | 99.00th=[ 245], 99.50th=[ 288], 99.90th=[ 313], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 120, per=25.42%, avg=38.12, stdev=23.92, samples=324 iops : min= 1, max= 30, avg= 8.87, stdev= 6.02, samples=324 lat (msec) : 10=2.28%, 20=15.85%, 50=44.63%, 100=23.80%, 250=12.86% lat (msec) : 500=0.55%, 1000=0.03% cpu : usr=0.06%, sys=1.58%, ctx=4706, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178587: Tue Sep 1 14:44:46 2026 read: IOPS=9, BW=36.1KiB/s (36.9kB/s)(6028KiB/167057msec) clat (msec): min=5, max=358, avg=44.01, stdev=39.22 lat (msec): min=5, max=358, avg=44.01, stdev=39.22 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 96], 95.00th=[ 130], | 99.00th=[ 186], 99.50th=[ 215], 99.90th=[ 279], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 134, per=25.47%, avg=36.43, stdev=23.89, samples=322 iops : min= 1, max= 33, avg= 8.45, stdev= 6.02, samples=322 write: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6260KiB/167057msec); 0 zone resets clat (msec): min=11, max=793, avg=64.07, stdev=50.09 lat (msec): min=11, max=793, avg=64.07, stdev=50.08 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 95], 90.00th=[ 127], 95.00th=[ 155], | 99.00th=[ 218], 99.50th=[ 268], 99.90th=[ 443], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 119, per=24.99%, avg=37.49, stdev=23.64, samples=325 iops : min= 1, max= 29, avg= 8.71, stdev= 5.94, samples=325 lat (msec) : 10=1.89%, 20=14.10%, 50=45.87%, 100=24.38%, 250=13.41% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=1.57%, ctx=4683, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178588: Tue Sep 1 14:44:46 2026 read: IOPS=9, BW=36.5KiB/s (37.4kB/s)(6052KiB/165808msec) clat (msec): min=4, max=359, avg=43.23, stdev=40.40 lat (msec): min=4, max=359, avg=43.23, stdev=40.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 99], 95.00th=[ 125], | 99.00th=[ 190], 99.50th=[ 236], 99.90th=[ 305], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 141, per=26.51%, avg=37.91, stdev=24.60, samples=310 iops : min= 1, max= 35, avg= 8.82, stdev= 6.19, samples=310 write: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6236KiB/165808msec); 0 zone resets clat (msec): min=9, max=904, avg=64.15, stdev=52.08 lat (msec): min=9, max=904, avg=64.15, stdev=52.08 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 90], 90.00th=[ 125], 95.00th=[ 157], | 99.00th=[ 234], 99.50th=[ 296], 99.90th=[ 477], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 111, per=24.91%, avg=37.36, stdev=23.39, samples=324 iops : min= 1, max= 27, avg= 8.68, stdev= 5.88, samples=324 lat (msec) : 10=2.54%, 20=15.04%, 50=45.57%, 100=23.60%, 250=12.70% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.06%, sys=1.61%, ctx=4579, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=144KiB/s (147kB/s), 35.5KiB/s-36.5KiB/s (36.4kB/s-37.4kB/s), io=23.4MiB (24.6MB), run=165808-167145msec WRITE: bw=150KiB/s (154kB/s), 37.5KiB/s-37.0KiB/s (38.4kB/s-38.9kB/s), io=24.6MiB (25.7MB), run=165808-167145msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178636: Tue Sep 1 14:45:25 2026 read: IOPS=13, BW=219KiB/s (225kB/s)(5920KiB/26997msec) clat (usec): min=40, max=184953, avg=37267.41, stdev=24165.47 lat (usec): min=40, max=184953, avg=37268.72, stdev=24165.48 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 76], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 29754], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 54789], 90.00th=[ 65799], 95.00th=[ 77071], | 99.00th=[ 96994], 99.50th=[154141], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 91, max= 409, per=25.89%, avg=222.38, stdev=72.59, samples=52 iops : min= 5, max= 25, avg=13.21, stdev= 4.60, samples=52 write: IOPS=14, BW=236KiB/s (242kB/s)(6368KiB/26997msec); 0 zone resets clat (usec): min=1310, max=172787, avg=32021.90, stdev=31407.06 lat (usec): min=1313, max=172790, avg=32054.83, stdev=31414.40 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1811], 10.00th=[ 2278], 20.00th=[ 4490], | 30.00th=[ 9241], 40.00th=[ 15533], 50.00th=[ 23725], 60.00th=[ 30802], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[166724], 99.50th=[170918], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 62, max= 470, per=26.58%, avg=240.06, stdev=91.66, samples=52 iops : min= 3, max= 29, avg=14.33, stdev= 5.79, samples=52 lat (usec) : 50=0.78%, 100=4.56%, 250=0.39% lat (msec) : 2=4.56%, 4=5.08%, 10=6.77%, 20=10.29%, 50=43.23% lat (msec) : 100=22.14%, 250=2.21% cpu : usr=0.09%, sys=5.54%, ctx=1519, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178637: Tue Sep 1 14:45:25 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5744KiB/27882msec) clat (usec): min=35, max=159111, avg=42374.85, stdev=27755.76 lat (usec): min=36, max=159112, avg=42376.20, stdev=27755.74 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 192], 20.00th=[ 20579], | 30.00th=[ 27395], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[147850], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 29, max= 352, per=23.85%, avg=204.89, stdev=78.09, samples=55 iops : min= 1, max= 22, avg=12.11, stdev= 4.99, samples=55 write: IOPS=14, BW=235KiB/s (240kB/s)(6544KiB/27882msec); 0 zone resets clat (usec): min=1229, max=178911, avg=30369.04, stdev=30796.33 lat (usec): min=1234, max=178912, avg=30372.60, stdev=30795.34 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1795], 10.00th=[ 2343], 20.00th=[ 4146], | 30.00th=[ 7767], 40.00th=[ 12911], 50.00th=[ 21103], 60.00th=[ 30278], | 70.00th=[ 37487], 80.00th=[ 51643], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[133694], 99.50th=[143655], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 62, max= 408, per=25.90%, avg=233.85, stdev=96.41, samples=55 iops : min= 3, max= 25, avg=13.93, stdev= 6.11, samples=55 lat (usec) : 50=0.39%, 100=3.91%, 250=0.52%, 500=0.13% lat (msec) : 2=4.04%, 4=6.12%, 10=8.33%, 20=10.68%, 50=38.28% lat (msec) : 100=23.96%, 250=3.65% cpu : usr=0.06%, sys=5.38%, ctx=1584, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178638: Tue Sep 1 14:45:25 2026 read: IOPS=14, BW=230KiB/s (236kB/s)(6256KiB/27141msec) clat (usec): min=38, max=208849, avg=38978.11, stdev=28775.91 lat (usec): min=38, max=208850, avg=38979.82, stdev=28776.11 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 21365], | 30.00th=[ 25822], 40.00th=[ 30016], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 46924], 80.00th=[ 55837], 90.00th=[ 70779], 95.00th=[ 81265], | 99.00th=[154141], 99.50th=[175113], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 448, per=26.73%, avg=229.58, stdev=81.57, samples=53 iops : min= 1, max= 28, avg=13.66, stdev= 5.22, samples=53 write: IOPS=13, BW=222KiB/s (228kB/s)(6032KiB/27141msec); 0 zone resets clat (usec): min=1387, max=173136, avg=30788.31, stdev=31994.66 lat (usec): min=1389, max=173137, avg=30790.44, stdev=31994.63 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1762], 10.00th=[ 2343], 20.00th=[ 4621], | 30.00th=[ 7439], 40.00th=[ 13435], 50.00th=[ 22676], 60.00th=[ 29492], | 70.00th=[ 36439], 80.00th=[ 49546], 90.00th=[ 69731], 95.00th=[104334], | 99.00th=[145753], 99.50th=[168821], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 448, per=24.06%, avg=217.23, stdev=89.45, samples=53 iops : min= 1, max= 28, avg=12.91, stdev= 5.67, samples=53 lat (usec) : 50=0.78%, 100=5.21%, 250=0.52%, 500=0.26% lat (msec) : 2=4.56%, 4=3.91%, 10=8.98%, 20=8.20%, 50=44.53% lat (msec) : 100=19.01%, 250=4.04% cpu : usr=0.07%, sys=5.56%, ctx=1550, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178640: Tue Sep 1 14:45:25 2026 read: IOPS=14, BW=227KiB/s (232kB/s)(6032KiB/26580msec) clat (usec): min=41, max=191286, avg=42049.68, stdev=27281.48 lat (usec): min=41, max=191287, avg=42051.11, stdev=27281.29 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 64], 10.00th=[ 8094], 20.00th=[ 22152], | 30.00th=[ 28181], 40.00th=[ 33162], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 62129], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[130548], 99.50th=[158335], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 91, max= 409, per=26.29%, avg=225.87, stdev=69.38, samples=52 iops : min= 5, max= 25, avg=13.42, stdev= 4.41, samples=52 write: IOPS=14, BW=235KiB/s (241kB/s)(6256KiB/26580msec); 0 zone resets clat (usec): min=1146, max=139048, avg=27254.58, stdev=29209.38 lat (usec): min=1148, max=139050, avg=27256.64, stdev=29209.41 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1795], 10.00th=[ 1942], 20.00th=[ 3720], | 30.00th=[ 5997], 40.00th=[ 9896], 50.00th=[ 16188], 60.00th=[ 24773], | 70.00th=[ 33817], 80.00th=[ 48497], 90.00th=[ 69731], 95.00th=[ 87557], | 99.00th=[123208], 99.50th=[132645], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 95, max= 498, per=26.13%, avg=235.96, stdev=92.86, samples=52 iops : min= 5, max= 31, avg=14.08, stdev= 5.95, samples=52 lat (usec) : 50=0.26%, 100=4.04%, 250=0.26%, 500=0.13% lat (msec) : 2=5.60%, 4=5.34%, 10=9.90%, 20=10.81%, 50=38.02% lat (msec) : 100=22.79%, 250=2.86% cpu : usr=0.11%, sys=5.49%, ctx=1534, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=859KiB/s (880kB/s), 206KiB/s-230KiB/s (211kB/s-236kB/s), io=23.4MiB (24.5MB), run=26580-27882msec WRITE: bw=904KiB/s (926kB/s), 222KiB/s-236KiB/s (228kB/s-242kB/s), io=24.6MiB (25.8MB), run=26580-27882msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178639: Tue Sep 1 14:45:36 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(5920KiB/38200msec) clat (msec): min=6, max=196, avg=39.69, stdev=35.29 lat (msec): min=6, max=196, avg=39.69, stdev=35.29 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 90], 95.00th=[ 112], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 445, per=25.00%, avg=155.01, stdev=99.67, samples=74 iops : min= 1, max= 27, avg= 8.91, stdev= 6.31, samples=74 write: IOPS=10, BW=167KiB/s (171kB/s)(6368KiB/38200msec); 0 zone resets clat (msec): min=14, max=205, avg=58.32, stdev=36.95 lat (msec): min=14, max=205, avg=58.33, stdev=36.96 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 108], 95.00th=[ 140], | 99.00th=[ 188], 99.50th=[ 197], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 30, max= 447, per=25.76%, avg=167.93, stdev=95.68, samples=74 iops : min= 1, max= 27, avg= 9.72, stdev= 6.01, samples=74 lat (msec) : 10=1.82%, 20=14.97%, 50=49.87%, 100=23.05%, 250=10.29% cpu : usr=0.05%, sys=1.74%, ctx=1203, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178641: Tue Sep 1 14:45:36 2026 read: IOPS=9, BW=149KiB/s (152kB/s)(5744KiB/38608msec) clat (msec): min=7, max=222, avg=41.33, stdev=36.94 lat (msec): min=7, max=222, avg=41.34, stdev=36.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 97], 95.00th=[ 120], | 99.00th=[ 199], 99.50th=[ 205], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 30, max= 493, per=24.31%, avg=150.72, stdev=101.66, samples=74 iops : min= 1, max= 30, avg= 8.62, stdev= 6.43, samples=74 write: IOPS=10, BW=169KiB/s (174kB/s)(6544KiB/38608msec); 0 zone resets clat (msec): min=12, max=307, avg=57.71, stdev=38.59 lat (msec): min=12, max=307, avg=57.73, stdev=38.57 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 106], 95.00th=[ 126], | 99.00th=[ 180], 99.50th=[ 211], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 62, max= 509, per=25.71%, avg=167.66, stdev=102.35, samples=76 iops : min= 3, max= 31, avg= 9.70, stdev= 6.45, samples=76 lat (msec) : 10=1.69%, 20=16.93%, 50=45.44%, 100=25.52%, 250=10.16% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=1.66%, ctx=1133, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178642: Tue Sep 1 14:45:36 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(6256KiB/38302msec) clat (msec): min=7, max=200, avg=39.69, stdev=33.74 lat (msec): min=7, max=200, avg=39.69, stdev=33.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 88], 95.00th=[ 113], | 99.00th=[ 171], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 479, per=26.53%, avg=164.46, stdev=109.36, samples=74 iops : min= 1, max= 29, avg= 9.50, stdev= 6.95, samples=74 write: IOPS=9, BW=157KiB/s (161kB/s)(6032KiB/38302msec); 0 zone resets clat (msec): min=13, max=195, avg=59.15, stdev=37.91 lat (msec): min=13, max=195, avg=59.20, stdev=37.94 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 70], 80.00th=[ 85], 90.00th=[ 117], 95.00th=[ 144], | 99.00th=[ 171], 99.50th=[ 182], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 30, max= 415, per=23.66%, avg=154.27, stdev=92.09, samples=75 iops : min= 1, max= 25, avg= 8.85, stdev= 5.81, samples=75 lat (msec) : 10=1.17%, 20=17.84%, 50=45.70%, 100=24.61%, 250=10.68% cpu : usr=0.06%, sys=2.03%, ctx=1234, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178643: Tue Sep 1 14:45:36 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(6032KiB/38358msec) clat (msec): min=6, max=208, avg=41.30, stdev=35.95 lat (msec): min=6, max=208, avg=41.30, stdev=35.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 120], | 99.00th=[ 190], 99.50th=[ 197], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 30, max= 540, per=25.24%, avg=156.51, stdev=106.66, samples=74 iops : min= 1, max= 33, avg= 8.99, stdev= 6.74, samples=74 write: IOPS=10, BW=163KiB/s (167kB/s)(6256KiB/38358msec); 0 zone resets clat (msec): min=13, max=292, avg=57.21, stdev=40.15 lat (msec): min=13, max=292, avg=57.22, stdev=40.15 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 107], 95.00th=[ 138], | 99.00th=[ 186], 99.50th=[ 284], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 447, per=24.63%, avg=160.57, stdev=98.32, samples=75 iops : min= 1, max= 27, avg= 9.25, stdev= 6.23, samples=75 lat (msec) : 10=2.47%, 20=16.93%, 50=45.44%, 100=24.22%, 250=10.68% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.71%, ctx=1199, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=620KiB/s (635kB/s), 149KiB/s-163KiB/s (152kB/s-167kB/s), io=23.4MiB (24.5MB), run=38200-38608msec WRITE: bw=653KiB/s (668kB/s), 157KiB/s-169KiB/s (161kB/s-174kB/s), io=24.6MiB (25.8MB), run=38200-38608msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178658: Tue Sep 1 14:45:52 2026 read: IOPS=2, BW=2209KiB/s (2262kB/s)(7168KiB/3245msec) clat (usec): min=496, max=670221, avg=224990.70, stdev=209257.42 lat (usec): min=498, max=670223, avg=224992.45, stdev=209257.50 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[149947], | 30.00th=[149947], 40.00th=[149947], 50.00th=[179307], 60.00th=[198181], | 70.00th=[198181], 80.00th=[227541], 90.00th=[666895], 95.00th=[666895], | 99.00th=[666895], 99.50th=[666895], 99.90th=[666895], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 1753, max= 3968, per=46.90%, avg=2365.40, stdev=904.24, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1578KiB/s (1616kB/s)(5120KiB/3245msec); 0 zone resets clat (msec): min=269, max=392, avg=323.61, stdev=54.16 lat (msec): min=269, max=393, avg=324.08, stdev=54.39 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1753, max= 2048, per=27.69%, avg=1955.00, stdev=138.00, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=12.85%, ctx=136, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178659: Tue Sep 1 14:45:52 2026 read: IOPS=0, BW=504KiB/s (516kB/s)(2048KiB/4061msec) clat (msec): min=287, max=423, avg=355.49, stdev=96.69 lat (msec): min=287, max=423, avg=355.49, stdev=96.69 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1885, max= 2035, per=38.87%, avg=1960.00, stdev=106.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2522KiB/s (2582kB/s)(10.0MiB/4061msec); 0 zone resets clat (msec): min=135, max=532, avg=302.45, stdev=145.96 lat (msec): min=135, max=532, avg=302.54, stdev=145.97 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 169], | 30.00th=[ 211], 40.00th=[ 224], 50.00th=[ 230], 60.00th=[ 241], | 70.00th=[ 313], 80.00th=[ 460], 90.00th=[ 514], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1885, max= 5930, per=44.89%, avg=3169.00, stdev=1772.19, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=12.12%, ctx=175, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178660: Tue Sep 1 14:45:52 2026 read: IOPS=1, BW=1783KiB/s (1826kB/s)(6144KiB/3445msec) clat (usec): min=613, max=404878, avg=182147.27, stdev=161129.98 lat (usec): min=614, max=404879, avg=182148.45, stdev=161130.12 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 1680], | 30.00th=[ 1680], 40.00th=[168821], 50.00th=[168821], 60.00th=[221250], | 70.00th=[295699], 80.00th=[295699], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 1885, max= 4055, per=49.54%, avg=2498.50, stdev=1039.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1783KiB/s (1826kB/s)(6144KiB/3445msec); 0 zone resets clat (msec): min=148, max=800, avg=369.94, stdev=256.39 lat (msec): min=148, max=800, avg=370.02, stdev=256.38 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 430], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1885, max= 2642, per=29.97%, avg=2116.20, stdev=299.96, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=10.71%, ctx=219, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178663: Tue Sep 1 14:45:52 2026 read: IOPS=1, BW=1362KiB/s (1395kB/s)(5120KiB/3758msec) clat (usec): min=414, max=254699, avg=104835.92, stdev=109533.99 lat (usec): min=416, max=254699, avg=104836.98, stdev=109533.71 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], 20.00th=[ 416], | 30.00th=[ 457], 40.00th=[ 457], 50.00th=[102237], 60.00th=[102237], | 70.00th=[166724], 80.00th=[166724], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1907KiB/s (1953kB/s)(7168KiB/3758msec); 0 zone resets clat (msec): min=138, max=804, avg=431.47, stdev=271.35 lat (msec): min=138, max=804, avg=431.73, stdev=271.61 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 174], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 309], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 735], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1885, max= 2035, per=28.21%, avg=1991.60, stdev=61.75, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=16.67% lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.05%, sys=10.75%, ctx=103, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5043KiB/s (5164kB/s), 504KiB/s-2209KiB/s (516kB/s-2262kB/s), io=20.0MiB (20.0MB), run=3245-4061msec WRITE: bw=7060KiB/s (7230kB/s), 1578KiB/s-2522KiB/s (1616kB/s-2582kB/s), io=28.0MiB (29.4MB), run=3245-4061msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178661: Tue Sep 1 14:45:52 2026 read: IOPS=1, BW=1905KiB/s (1951kB/s)(7168KiB/3763msec) clat (msec): min=63, max=405, avg=177.86, stdev=113.48 lat (msec): min=63, max=405, avg=177.86, stdev=113.48 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 75], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 184], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 190], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1868, max= 4243, per=59.19%, avg=2714.00, stdev=1326.66, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1361KiB/s (1393kB/s)(5120KiB/3763msec); 0 zone resets clat (msec): min=254, max=683, avg=489.41, stdev=166.11 lat (msec): min=254, max=683, avg=489.51, stdev=166.11 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2000, max= 2043, per=31.52%, avg=2023.33, stdev=21.73, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=3.72%, ctx=96, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178662: Tue Sep 1 14:45:52 2026 read: IOPS=0, BW=459KiB/s (470kB/s)(2048KiB/4466msec) clat (msec): min=97, max=430, avg=264.13, stdev=235.83 lat (msec): min=97, max=430, avg=264.13, stdev=235.83 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1508, max= 2043, per=38.72%, avg=1775.50, stdev=378.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2293KiB/s (2348kB/s)(10.0MiB/4466msec); 0 zone resets clat (msec): min=60, max=1006, avg=374.26, stdev=294.44 lat (msec): min=60, max=1006, avg=374.36, stdev=294.45 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 138], | 30.00th=[ 165], 40.00th=[ 184], 50.00th=[ 232], 60.00th=[ 268], | 70.00th=[ 506], 80.00th=[ 575], 90.00th=[ 617], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 2000, max= 6107, per=47.51%, avg=3050.00, stdev=1709.50, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.09%, sys=6.61%, ctx=146, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178664: Tue Sep 1 14:45:52 2026 read: IOPS=1, BW=1544KiB/s (1581kB/s)(6144KiB/3979msec) clat (msec): min=75, max=296, avg=169.10, stdev=83.62 lat (msec): min=75, max=296, avg=169.10, stdev=83.62 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 165], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 4000, max= 4096, per=88.29%, avg=4048.00, stdev=67.88, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1544KiB/s (1581kB/s)(6144KiB/3979msec); 0 zone resets clat (msec): min=87, max=717, avg=442.91, stdev=244.70 lat (msec): min=87, max=717, avg=443.02, stdev=244.73 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 542], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1868, max= 2048, per=31.21%, avg=2003.40, stdev=76.17, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=3.29%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178665: Tue Sep 1 14:45:52 2026 read: IOPS=1, BW=1417KiB/s (1451kB/s)(5120KiB/3614msec) clat (msec): min=109, max=399, avg=194.66, stdev=119.01 lat (msec): min=109, max=399, avg=194.66, stdev=119.01 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 4000, max= 4063, per=87.93%, avg=4031.50, stdev=44.55, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1983KiB/s (2031kB/s)(7168KiB/3614msec); 0 zone resets clat (msec): min=65, max=612, avg=344.64, stdev=185.90 lat (msec): min=65, max=612, avg=344.76, stdev=185.91 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 142], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 368], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 439], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1519, max= 3737, per=36.33%, avg=2332.50, stdev=967.66, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=3.99%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4586KiB/s (4696kB/s), 459KiB/s-1905KiB/s (470kB/s-1951kB/s), io=20.0MiB (20.0MB), run=3614-4466msec WRITE: bw=6420KiB/s (6574kB/s), 1361KiB/s-2293KiB/s (1393kB/s-2348kB/s), io=28.0MiB (29.4MB), run=3614-4466msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178672: Tue Sep 1 14:46:04 2026 read: IOPS=1, BW=4808KiB/s (4923kB/s)(12.0MiB/2556msec) clat (msec): min=687, max=1039, avg=823.25, stdev=189.44 lat (msec): min=687, max=1039, avg=823.25, stdev=189.45 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.63%, ctx=327, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178673: Tue Sep 1 14:46:04 2026 read: IOPS=0, BW=1710KiB/s (1751kB/s)(4096KiB/2395msec) clat (nsec): min=1039.3M, max=1039.3M, avg=1039273613.00, stdev= 0.00 lat (nsec): min=1039.3M, max=1039.3M, avg=1039276133.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3420KiB/s (3503kB/s)(8192KiB/2395msec); 0 zone resets clat (msec): min=258, max=975, avg=617.34, stdev=506.94 lat (msec): min=259, max=979, avg=619.32, stdev=508.99 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8175, max= 8175, per=68.03%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.26%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178674: Tue Sep 1 14:46:04 2026 write: IOPS=1, BW=4551KiB/s (4660kB/s)(12.0MiB/2700msec); 0 zone resets clat (msec): min=359, max=1189, avg=898.59, stdev=467.57 lat (msec): min=359, max=1192, avg=899.72, stdev=468.31 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8175, max= 8175, per=68.03%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.96%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178675: Tue Sep 1 14:46:04 2026 write: IOPS=1, BW=4506KiB/s (4614kB/s)(12.0MiB/2727msec); 0 zone resets clat (msec): min=383, max=1927, avg=907.25, stdev=883.59 lat (msec): min=384, max=1927, avg=908.19, stdev=883.13 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 5587, max= 8175, per=57.27%, avg=6881.00, stdev=1829.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.23%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6410KiB/s (6564kB/s), 1710KiB/s-4808KiB/s (1751kB/s-4923kB/s), io=16.0MiB (16.8MB), run=2395-2556msec WRITE: bw=11.7MiB/s (12.3MB/s), 3420KiB/s-4551KiB/s (3503kB/s-4660kB/s), io=32.0MiB (33.6MB), run=2395-2727msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178677: Tue Sep 1 14:46:05 2026 read: IOPS=1, BW=4783KiB/s (4898kB/s)(12.0MiB/2569msec) clat (msec): min=99, max=1629, avg=855.77, stdev=765.20 lat (msec): min=99, max=1629, avg=855.77, stdev=765.20 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.00%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178678: Tue Sep 1 14:46:05 2026 read: IOPS=0, BW=1630KiB/s (1669kB/s)(4096KiB/2513msec) clat (nsec): min=1114.6M, max=1114.6M, avg=1114571972.00, stdev= 0.00 lat (nsec): min=1114.6M, max=1114.6M, avg=1114574135.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3260KiB/s (3338kB/s)(8192KiB/2513msec); 0 zone resets clat (msec): min=379, max=1015, avg=697.89, stdev=449.86 lat (msec): min=380, max=1016, avg=698.62, stdev=449.50 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8126, max= 8126, per=64.38%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.16%, sys=2.43%, ctx=36, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178679: Tue Sep 1 14:46:05 2026 write: IOPS=1, BW=4794KiB/s (4909kB/s)(12.0MiB/2563msec); 0 zone resets clat (msec): min=275, max=1471, avg=850.39, stdev=599.55 lat (msec): min=275, max=1481, avg=853.94, stdev=604.40 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8126, max= 8126, per=64.38%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.85%, ctx=36, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178680: Tue Sep 1 14:46:05 2026 write: IOPS=1, BW=4733KiB/s (4847kB/s)(12.0MiB/2596msec); 0 zone resets clat (msec): min=252, max=1958, avg=864.58, stdev=949.25 lat (msec): min=253, max=1958, avg=864.95, stdev=949.21 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 7013, max= 8192, per=60.23%, avg=7602.50, stdev=833.68, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.62%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6378KiB/s (6531kB/s), 1630KiB/s-4783KiB/s (1669kB/s-4898kB/s), io=16.0MiB (16.8MB), run=2513-2569msec WRITE: bw=12.3MiB/s (12.9MB/s), 3260KiB/s-4794KiB/s (3338kB/s-4909kB/s), io=32.0MiB (33.6MB), run=2513-2596msec