== sanity test 398b: DIO and buffer IO race ============== 04:42:57 (1781685777) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.2387 s, 15.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158360: Wed Jun 17 04:45:00 2026 read: IOPS=13, BW=52.0KiB/s (54.3kB/s)(5992KiB/113058msec) clat (usec): min=36, max=665072, avg=36793.37, stdev=41531.62 lat (usec): min=36, max=665073, avg=36794.45, stdev=41531.64 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 906], 20.00th=[ 15270], | 30.00th=[ 19530], 40.00th=[ 23200], 50.00th=[ 28181], 60.00th=[ 33817], | 70.00th=[ 41681], 80.00th=[ 51643], 90.00th=[ 68682], 95.00th=[ 90702], | 99.00th=[187696], 99.50th=[274727], 99.90th=[624952], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 4, max= 144, per=25.49%, avg=53.79, stdev=28.10, samples=216 iops : min= 1, max= 36, avg=12.82, stdev= 7.05, samples=216 write: IOPS=13, BW=55.7KiB/s (57.0kB/s)(6296KiB/113058msec); 0 zone resets clat (usec): min=1112, max=632622, avg=36607.23, stdev=48470.74 lat (usec): min=1112, max=632623, avg=36609.89, stdev=48471.59 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1450], 10.00th=[ 2212], 20.00th=[ 3884], | 30.00th=[ 7046], 40.00th=[ 14746], 50.00th=[ 23725], 60.00th=[ 33162], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[109577], | 99.00th=[221250], 99.50th=[312476], 99.90th=[513803], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 135, per=25.63%, avg=56.64, stdev=28.06, samples=215 iops : min= 1, max= 33, avg=13.54, stdev= 7.02, samples=215 lat (usec) : 50=0.52%, 100=3.58%, 250=0.59%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.62%, 4=6.09%, 10=7.71%, 20=15.72%, 50=37.50% lat (msec) : 100=18.29%, 250=4.43%, 500=0.62%, 750=0.13% cpu : usr=0.07%, sys=6.77%, ctx=6866, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158361: Wed Jun 17 04:45:00 2026 read: IOPS=13, BW=52.3KiB/s (53.6kB/s)(5940KiB/113586msec) clat (usec): min=26, max=673117, avg=37008.67, stdev=43339.75 lat (usec): min=26, max=673118, avg=37010.31, stdev=43339.73 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 676], 20.00th=[ 15270], | 30.00th=[ 18482], 40.00th=[ 22938], 50.00th=[ 27657], 60.00th=[ 34341], | 70.00th=[ 40633], 80.00th=[ 50594], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[223347], 99.50th=[291505], 99.90th=[574620], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 144, per=25.08%, avg=52.91, stdev=26.97, samples=218 iops : min= 1, max= 36, avg=12.59, stdev= 6.77, samples=218 write: IOPS=13, BW=55.9KiB/s (57.2kB/s)(6348KiB/113586msec); 0 zone resets clat (usec): min=1103, max=723477, avg=36684.56, stdev=48456.85 lat (usec): min=1104, max=723477, avg=36686.07, stdev=48456.92 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1516], 10.00th=[ 2278], 20.00th=[ 4178], | 30.00th=[ 7832], 40.00th=[ 16319], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 58983], 90.00th=[ 83362], 95.00th=[106431], | 99.00th=[206570], 99.50th=[295699], 99.90th=[549454], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 143, per=25.42%, avg=56.18, stdev=27.81, samples=218 iops : min= 1, max= 35, avg=13.43, stdev= 6.98, samples=218 lat (usec) : 50=0.65%, 100=3.52%, 250=0.36%, 500=0.16%, 750=0.20% lat (usec) : 1000=0.07% lat (msec) : 2=4.59%, 4=5.40%, 10=7.23%, 20=16.67%, 50=38.02% lat (msec) : 100=18.16%, 250=4.26%, 500=0.55%, 750=0.16% cpu : usr=0.09%, sys=6.89%, ctx=7000, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158362: Wed Jun 17 04:45:00 2026 read: IOPS=13, BW=53.2KiB/s (54.5kB/s)(6028KiB/113225msec) clat (usec): min=17, max=548372, avg=36560.87, stdev=40125.73 lat (usec): min=17, max=548374, avg=36562.72, stdev=40125.68 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 153], 20.00th=[ 15008], | 30.00th=[ 19006], 40.00th=[ 22676], 50.00th=[ 27919], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 50594], 90.00th=[ 69731], 95.00th=[ 92799], | 99.00th=[219153], 99.50th=[278922], 99.90th=[429917], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 143, per=25.28%, avg=53.34, stdev=27.09, samples=220 iops : min= 1, max= 35, avg=12.71, stdev= 6.79, samples=220 write: IOPS=13, BW=55.3KiB/s (56.6kB/s)(6260KiB/113225msec); 0 zone resets clat (usec): min=1060, max=680656, avg=36778.65, stdev=42668.62 lat (usec): min=1061, max=680658, avg=36780.38, stdev=42668.61 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1532], 10.00th=[ 2278], 20.00th=[ 4555], | 30.00th=[ 9372], 40.00th=[ 18220], 50.00th=[ 25297], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 59507], 90.00th=[ 82314], 95.00th=[109577], | 99.00th=[175113], 99.50th=[212861], 99.90th=[501220], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 6, max= 136, per=25.16%, avg=55.60, stdev=27.35, samples=219 iops : min= 1, max= 34, avg=13.28, stdev= 6.85, samples=219 lat (usec) : 20=0.03%, 50=0.68%, 100=3.71%, 250=0.68%, 500=0.26% lat (usec) : 750=0.03%, 1000=0.07% lat (msec) : 2=3.97%, 4=5.40%, 10=7.58%, 20=15.46%, 50=38.05% lat (msec) : 100=18.46%, 250=4.98%, 500=0.52%, 750=0.10% cpu : usr=0.07%, sys=6.69%, ctx=7092, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158363: Wed Jun 17 04:45:00 2026 read: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6052KiB/113541msec) clat (usec): min=33, max=637375, avg=36209.19, stdev=40206.50 lat (usec): min=33, max=637376, avg=36211.37, stdev=40206.55 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 215], 20.00th=[ 14353], | 30.00th=[ 18482], 40.00th=[ 22938], 50.00th=[ 28181], 60.00th=[ 33817], | 70.00th=[ 41681], 80.00th=[ 51119], 90.00th=[ 66323], 95.00th=[ 85459], | 99.00th=[173016], 99.50th=[291505], 99.90th=[574620], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 135, per=25.48%, avg=53.76, stdev=26.53, samples=217 iops : min= 1, max= 33, avg=12.82, stdev= 6.66, samples=217 write: IOPS=13, BW=54.9KiB/s (56.2kB/s)(6236KiB/113541msec); 0 zone resets clat (usec): min=1104, max=426488, avg=37495.24, stdev=45607.16 lat (usec): min=1105, max=426489, avg=37498.72, stdev=45608.46 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1516], 10.00th=[ 2245], 20.00th=[ 4146], | 30.00th=[ 7701], 40.00th=[ 16188], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 62653], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[219153], 99.50th=[308282], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 4, max= 136, per=24.79%, avg=54.79, stdev=27.48, samples=220 iops : min= 1, max= 34, avg=13.08, stdev= 6.89, samples=220 lat (usec) : 50=0.81%, 100=3.42%, 250=0.72%, 500=0.13%, 750=0.10% lat (msec) : 2=4.17%, 4=5.70%, 10=8.14%, 20=15.53%, 50=37.73% lat (msec) : 100=18.10%, 250=4.72%, 500=0.68%, 750=0.07% cpu : usr=0.08%, sys=6.70%, ctx=7028, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=211KiB/s (216kB/s), 52.3KiB/s-53.3KiB/s (53.6kB/s-54.6kB/s), io=23.4MiB (24.6MB), run=113058-113586msec WRITE: bw=221KiB/s (227kB/s), 54.9KiB/s-55.9KiB/s (56.2kB/s-57.2kB/s), io=24.6MiB (25.7MB), run=113058-113586msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158365: Wed Jun 17 04:46:56 2026 read: IOPS=6, BW=26.1KiB/s (26.7kB/s)(5992KiB/229511msec) clat (msec): min=5, max=774, avg=30.82, stdev=50.27 lat (msec): min=5, max=774, avg=30.82, stdev=50.28 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 37], 90.00th=[ 65], 95.00th=[ 89], | 99.00th=[ 201], 99.50th=[ 279], 99.90th=[ 768], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 5, max= 112, per=27.60%, avg=28.70, stdev=20.03, samples=406 iops : min= 1, max= 28, avg= 6.59, stdev= 5.09, samples=406 write: IOPS=6, BW=27.4KiB/s (28.1kB/s)(6296KiB/229511msec); 0 zone resets clat (msec): min=31, max=750, avg=116.33, stdev=71.80 lat (msec): min=31, max=750, avg=116.34, stdev=71.80 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 68], | 30.00th=[ 77], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 109], | 70.00th=[ 126], 80.00th=[ 155], 90.00th=[ 194], 95.00th=[ 249], | 99.00th=[ 418], 99.50th=[ 477], 99.90th=[ 701], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 4, max= 64, per=25.31%, avg=27.58, stdev=14.08, samples=443 iops : min= 1, max= 16, avg= 6.30, stdev= 3.62, samples=443 lat (msec) : 10=6.77%, 20=20.90%, 50=17.19%, 100=29.75%, 250=22.56% lat (msec) : 500=2.54%, 750=0.20%, 1000=0.10% cpu : usr=0.04%, sys=1.59%, ctx=5430, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158366: Wed Jun 17 04:46:56 2026 read: IOPS=6, BW=25.9KiB/s (26.5kB/s)(5940KiB/229534msec) clat (msec): min=5, max=575, avg=28.25, stdev=34.15 lat (msec): min=5, max=575, avg=28.25, stdev=34.15 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 38], 90.00th=[ 59], 95.00th=[ 82], | 99.00th=[ 155], 99.50th=[ 224], 99.90th=[ 405], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 119, per=28.39%, avg=29.53, stdev=20.48, samples=391 iops : min= 1, max= 29, avg= 6.79, stdev= 5.19, samples=391 write: IOPS=6, BW=27.7KiB/s (28.3kB/s)(6348KiB/229534msec); 0 zone resets clat (msec): min=31, max=803, avg=118.08, stdev=78.92 lat (msec): min=31, max=803, avg=118.08, stdev=78.92 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 86], 50.00th=[ 96], 60.00th=[ 109], | 70.00th=[ 128], 80.00th=[ 155], 90.00th=[ 194], 95.00th=[ 255], | 99.00th=[ 472], 99.50th=[ 600], 99.90th=[ 760], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 64, per=25.41%, avg=27.70, stdev=13.99, samples=445 iops : min= 1, max= 16, avg= 6.33, stdev= 3.60, samples=445 lat (msec) : 10=6.12%, 20=22.36%, 50=16.18%, 100=30.14%, 250=22.36% lat (msec) : 500=2.38%, 750=0.39%, 1000=0.07% cpu : usr=0.04%, sys=1.56%, ctx=5332, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158367: Wed Jun 17 04:46:56 2026 read: IOPS=6, BW=26.3KiB/s (26.9kB/s)(6028KiB/229234msec) clat (msec): min=5, max=669, avg=30.50, stdev=39.56 lat (msec): min=5, max=669, avg=30.51, stdev=39.56 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 63], 95.00th=[ 91], | 99.00th=[ 171], 99.50th=[ 224], 99.90th=[ 567], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 119, per=27.39%, avg=28.48, stdev=19.39, samples=411 iops : min= 1, max= 29, avg= 6.54, stdev= 4.91, samples=411 write: IOPS=6, BW=27.3KiB/s (27.0kB/s)(6260KiB/229234msec); 0 zone resets clat (msec): min=34, max=854, avg=116.95, stdev=76.65 lat (msec): min=34, max=854, avg=116.95, stdev=76.65 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 56], 20.00th=[ 67], | 30.00th=[ 75], 40.00th=[ 87], 50.00th=[ 97], 60.00th=[ 111], | 70.00th=[ 127], 80.00th=[ 150], 90.00th=[ 192], 95.00th=[ 236], | 99.00th=[ 426], 99.50th=[ 550], 99.90th=[ 726], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 4, max= 72, per=25.11%, avg=27.37, stdev=14.29, samples=443 iops : min= 1, max= 18, avg= 6.25, stdev= 3.67, samples=443 lat (msec) : 10=6.15%, 20=21.00%, 50=17.22%, 100=29.56%, 250=23.67% lat (msec) : 500=1.99%, 750=0.39%, 1000=0.03% cpu : usr=0.04%, sys=1.59%, ctx=5420, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158368: Wed Jun 17 04:46:56 2026 read: IOPS=6, BW=26.5KiB/s (27.1kB/s)(6052KiB/228480msec) clat (msec): min=4, max=766, avg=30.21, stdev=44.45 lat (msec): min=4, max=766, avg=30.21, stdev=44.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 63], 95.00th=[ 86], | 99.00th=[ 190], 99.50th=[ 338], 99.90th=[ 567], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 5, max= 118, per=28.60%, avg=29.74, stdev=20.80, samples=396 iops : min= 1, max= 29, avg= 6.85, stdev= 5.27, samples=396 write: IOPS=6, BW=27.3KiB/s (27.9kB/s)(6236KiB/228480msec); 0 zone resets clat (msec): min=31, max=810, avg=117.06, stdev=75.52 lat (msec): min=31, max=810, avg=117.06, stdev=75.52 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 68], | 30.00th=[ 77], 40.00th=[ 86], 50.00th=[ 97], 60.00th=[ 110], | 70.00th=[ 125], 80.00th=[ 153], 90.00th=[ 201], 95.00th=[ 251], | 99.00th=[ 397], 99.50th=[ 558], 99.90th=[ 793], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 72, per=25.06%, avg=27.32, stdev=14.11, samples=443 iops : min= 1, max= 18, avg= 6.23, stdev= 3.63, samples=443 lat (msec) : 10=7.19%, 20=22.01%, 50=15.95%, 100=29.00%, 250=22.92% lat (msec) : 500=2.54%, 750=0.26%, 1000=0.13% cpu : usr=0.04%, sys=1.59%, ctx=5423, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=105KiB/s (107kB/s), 25.9KiB/s-26.5KiB/s (26.5kB/s-27.1kB/s), io=23.4MiB (24.6MB), run=228480-229534msec WRITE: bw=110KiB/s (112kB/s), 27.3KiB/s-27.7KiB/s (27.9kB/s-28.3kB/s), io=24.6MiB (25.7MB), run=228480-229534msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158418: Wed Jun 17 04:47:26 2026 read: IOPS=18, BW=302KiB/s (309kB/s)(5920KiB/19625msec) clat (usec): min=31, max=170891, avg=26975.06, stdev=24480.39 lat (usec): min=31, max=170893, avg=26982.42, stdev=24487.12 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 49], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 717], 40.00th=[ 20579], 50.00th=[ 26084], 60.00th=[ 31327], | 70.00th=[ 37487], 80.00th=[ 46400], 90.00th=[ 59507], 95.00th=[ 66847], | 99.00th=[ 91751], 99.50th=[129500], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 159, max= 701, per=27.07%, avg=299.37, stdev=103.59, samples=38 iops : min= 9, max= 43, avg=18.05, stdev= 6.46, samples=38 write: IOPS=20, BW=324KiB/s (332kB/s)(6368KiB/19625msec); 0 zone resets clat (usec): min=1458, max=110412, avg=24063.52, stdev=23666.46 lat (usec): min=1458, max=110413, avg=24065.56, stdev=23666.35 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2180], 10.00th=[ 3261], 20.00th=[ 4883], | 30.00th=[ 6652], 40.00th=[ 8586], 50.00th=[ 13435], 60.00th=[ 23462], | 70.00th=[ 31327], 80.00th=[ 42206], 90.00th=[ 62129], 95.00th=[ 73925], | 99.00th=[ 94897], 99.50th=[105382], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 126, max= 636, per=27.90%, avg=324.53, stdev=114.49, samples=38 iops : min= 7, max= 39, avg=19.61, stdev= 7.19, samples=38 lat (usec) : 50=2.47%, 100=9.77%, 250=1.30%, 500=0.39%, 750=0.52% lat (usec) : 1000=0.13% lat (msec) : 2=1.56%, 4=5.60%, 10=16.02%, 20=10.03%, 50=37.11% lat (msec) : 100=14.32%, 250=0.78% cpu : usr=0.09%, sys=9.33%, ctx=1486, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158419: Wed Jun 17 04:47:26 2026 read: IOPS=17, BW=275KiB/s (282kB/s)(5744KiB/20851msec) clat (usec): min=35, max=195625, avg=27138.77, stdev=24640.59 lat (usec): min=35, max=195626, avg=27140.46, stdev=24641.05 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 97], | 30.00th=[ 11338], 40.00th=[ 20055], 50.00th=[ 25822], 60.00th=[ 31589], | 70.00th=[ 36963], 80.00th=[ 44303], 90.00th=[ 57410], 95.00th=[ 69731], | 99.00th=[100140], 99.50th=[110625], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 130, max= 446, per=25.12%, avg=277.83, stdev=80.92, samples=40 iops : min= 8, max= 27, avg=16.70, stdev= 5.08, samples=40 write: IOPS=19, BW=314KiB/s (321kB/s)(6544KiB/20851msec); 0 zone resets clat (usec): min=1519, max=132469, avg=26656.45, stdev=26983.63 lat (usec): min=1521, max=132470, avg=26661.50, stdev=26981.52 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2245], 10.00th=[ 3130], 20.00th=[ 4293], | 30.00th=[ 6521], 40.00th=[ 8717], 50.00th=[ 15664], 60.00th=[ 24511], | 70.00th=[ 36439], 80.00th=[ 51119], 90.00th=[ 64226], 95.00th=[ 80217], | 99.00th=[108528], 99.50th=[128451], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 94, max= 569, per=26.85%, avg=312.27, stdev=113.34, samples=40 iops : min= 5, max= 35, avg=18.85, stdev= 7.15, samples=40 lat (usec) : 50=0.78%, 100=8.85%, 250=2.73%, 500=0.26%, 750=0.39% lat (usec) : 1000=0.26% lat (msec) : 2=2.21%, 4=8.20%, 10=12.24%, 20=11.85%, 50=34.51% lat (msec) : 100=16.28%, 250=1.43% cpu : usr=0.07%, sys=8.79%, ctx=1503, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158421: Wed Jun 17 04:47:26 2026 read: IOPS=18, BW=299KiB/s (306kB/s)(6256KiB/20957msec) clat (usec): min=34, max=149603, avg=27450.71, stdev=22821.19 lat (usec): min=34, max=149605, avg=27452.11, stdev=22820.86 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 80], | 30.00th=[ 13698], 40.00th=[ 22414], 50.00th=[ 26870], 60.00th=[ 31851], | 70.00th=[ 39584], 80.00th=[ 45876], 90.00th=[ 56361], 95.00th=[ 65799], | 99.00th=[ 83362], 99.50th=[110625], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 128, max= 416, per=27.14%, avg=300.17, stdev=76.20, samples=41 iops : min= 8, max= 26, avg=18.10, stdev= 4.71, samples=41 write: IOPS=17, BW=288KiB/s (295kB/s)(6032KiB/20957msec); 0 zone resets clat (usec): min=1487, max=135855, avg=26352.55, stdev=24432.54 lat (usec): min=1488, max=135855, avg=26358.02, stdev=24432.13 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2409], 10.00th=[ 3326], 20.00th=[ 5342], | 30.00th=[ 7373], 40.00th=[ 13566], 50.00th=[ 19792], 60.00th=[ 26346], | 70.00th=[ 32637], 80.00th=[ 44303], 90.00th=[ 61604], 95.00th=[ 73925], | 99.00th=[111674], 99.50th=[128451], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 94, max= 512, per=24.80%, avg=288.37, stdev=98.05, samples=41 iops : min= 5, max= 32, avg=17.34, stdev= 6.24, samples=41 lat (usec) : 50=2.08%, 100=9.24%, 250=2.47%, 500=0.13% lat (msec) : 2=1.56%, 4=4.95%, 10=10.55%, 20=12.11%, 50=40.76% lat (msec) : 100=15.23%, 250=0.91% cpu : usr=0.08%, sys=8.66%, ctx=1535, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158423: Wed Jun 17 04:47:26 2026 read: IOPS=17, BW=279KiB/s (285kB/s)(6032KiB/21650msec) clat (usec): min=36, max=122704, avg=25741.47, stdev=23400.04 lat (usec): min=36, max=122705, avg=25742.63, stdev=23400.12 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 48], 10.00th=[ 60], 20.00th=[ 74], | 30.00th=[ 245], 40.00th=[ 19530], 50.00th=[ 25822], 60.00th=[ 30540], | 70.00th=[ 35390], 80.00th=[ 44827], 90.00th=[ 55837], 95.00th=[ 66323], | 99.00th=[ 93848], 99.50th=[110625], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 44, max= 554, per=25.28%, avg=279.55, stdev=103.13, samples=42 iops : min= 2, max= 34, avg=16.79, stdev= 6.42, samples=42 write: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21650msec); 0 zone resets clat (usec): min=1543, max=205955, avg=29694.05, stdev=30927.50 lat (usec): min=1543, max=205957, avg=29696.91, stdev=30926.94 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2376], 10.00th=[ 3589], 20.00th=[ 6652], | 30.00th=[ 10683], 40.00th=[ 14615], 50.00th=[ 20317], 60.00th=[ 27132], | 70.00th=[ 34341], 80.00th=[ 44303], 90.00th=[ 65274], 95.00th=[ 83362], | 99.00th=[162530], 99.50th=[193987], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 88, max= 538, per=25.19%, avg=292.90, stdev=92.40, samples=42 iops : min= 5, max= 33, avg=17.64, stdev= 5.80, samples=42 lat (usec) : 50=2.86%, 100=9.38%, 250=2.73%, 500=0.52%, 750=0.13% lat (msec) : 2=2.08%, 4=4.04%, 10=8.85%, 20=14.71%, 50=38.80% lat (msec) : 100=13.67%, 250=2.21% cpu : usr=0.08%, sys=8.50%, ctx=1535, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1106KiB/s (1133kB/s), 275KiB/s-302KiB/s (282kB/s-309kB/s), io=23.4MiB (24.5MB), run=19625-21650msec WRITE: bw=1164KiB/s (1192kB/s), 288KiB/s-324KiB/s (295kB/s-332kB/s), io=24.6MiB (25.8MB), run=19625-21650msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158417: Wed Jun 17 04:47:56 2026 read: IOPS=7, BW=115KiB/s (118kB/s)(5920KiB/51316msec) clat (msec): min=5, max=194, avg=29.23, stdev=29.48 lat (msec): min=5, max=194, avg=29.23, stdev=29.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 39], 90.00th=[ 60], 95.00th=[ 95], | 99.00th=[ 146], 99.50th=[ 186], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 31, max= 352, per=25.19%, avg=117.39, stdev=71.17, samples=97 iops : min= 1, max= 22, avg= 6.66, stdev= 4.56, samples=97 write: IOPS=7, BW=124KiB/s (127kB/s)(6368KiB/51316msec); 0 zone resets clat (msec): min=33, max=289, avg=101.07, stdev=41.81 lat (msec): min=33, max=289, avg=101.08, stdev=41.81 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 74], 40.00th=[ 84], 50.00th=[ 92], 60.00th=[ 102], | 70.00th=[ 110], 80.00th=[ 131], 90.00th=[ 161], 95.00th=[ 190], | 99.00th=[ 228], 99.50th=[ 271], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 254, per=25.08%, avg=122.88, stdev=52.29, samples=101 iops : min= 1, max= 15, avg= 6.99, stdev= 3.37, samples=101 lat (msec) : 10=4.04%, 20=22.79%, 50=17.32%, 100=32.68%, 250=22.92% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.94%, ctx=1420, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158420: Wed Jun 17 04:47:56 2026 read: IOPS=6, BW=112KiB/s (115kB/s)(5744KiB/51326msec) clat (msec): min=7, max=313, avg=29.09, stdev=30.72 lat (msec): min=7, max=313, avg=29.09, stdev=30.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 63], 95.00th=[ 79], | 99.00th=[ 144], 99.50th=[ 247], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 415, per=25.72%, avg=119.87, stdev=79.23, samples=95 iops : min= 1, max= 25, avg= 6.80, stdev= 4.99, samples=95 write: IOPS=7, BW=127KiB/s (131kB/s)(6544KiB/51326msec); 0 zone resets clat (msec): min=37, max=279, avg=99.34, stdev=41.03 lat (msec): min=37, max=279, avg=99.35, stdev=41.03 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 52], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 82], 50.00th=[ 88], 60.00th=[ 97], | 70.00th=[ 112], 80.00th=[ 133], 90.00th=[ 157], 95.00th=[ 182], | 99.00th=[ 230], 99.50th=[ 247], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 224, per=25.91%, avg=126.97, stdev=51.68, samples=102 iops : min= 1, max= 14, avg= 7.25, stdev= 3.35, samples=102 lat (msec) : 10=3.65%, 20=21.88%, 50=17.19%, 100=36.07%, 250=20.96% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.92%, ctx=1375, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158422: Wed Jun 17 04:47:56 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(6256KiB/49722msec) clat (msec): min=6, max=157, avg=27.60, stdev=24.88 lat (msec): min=6, max=157, avg=27.61, stdev=24.88 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 36], 90.00th=[ 54], 95.00th=[ 78], | 99.00th=[ 150], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 31, max= 351, per=27.67%, avg=128.94, stdev=82.15, samples=96 iops : min= 1, max= 21, avg= 7.36, stdev= 5.25, samples=96 write: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49722msec); 0 zone resets clat (msec): min=37, max=224, avg=102.48, stdev=42.42 lat (msec): min=37, max=224, avg=102.48, stdev=42.42 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 83], 50.00th=[ 94], 60.00th=[ 103], | 70.00th=[ 114], 80.00th=[ 133], 90.00th=[ 171], 95.00th=[ 199], | 99.00th=[ 220], 99.50th=[ 222], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 256, per=24.45%, avg=119.81, stdev=48.97, samples=98 iops : min= 1, max= 16, avg= 6.80, stdev= 3.13, samples=98 lat (msec) : 10=2.47%, 20=26.17%, 50=19.27%, 100=29.43%, 250=22.66% cpu : usr=0.06%, sys=2.00%, ctx=1436, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158424: Wed Jun 17 04:47:56 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(6032KiB/50533msec) clat (msec): min=7, max=311, avg=29.11, stdev=31.51 lat (msec): min=7, max=311, avg=29.11, stdev=31.51 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 60], 95.00th=[ 96], | 99.00th=[ 161], 99.50th=[ 228], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 352, per=27.17%, avg=126.62, stdev=77.42, samples=93 iops : min= 1, max= 22, avg= 7.24, stdev= 4.89, samples=93 write: IOPS=7, BW=124KiB/s (127kB/s)(6256KiB/50533msec); 0 zone resets clat (msec): min=40, max=267, avg=100.90, stdev=42.22 lat (msec): min=40, max=267, avg=100.90, stdev=42.22 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 58], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 83], 50.00th=[ 88], 60.00th=[ 99], | 70.00th=[ 116], 80.00th=[ 136], 90.00th=[ 161], 95.00th=[ 184], | 99.00th=[ 232], 99.50th=[ 243], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 254, per=25.13%, avg=123.14, stdev=53.05, samples=100 iops : min= 1, max= 15, avg= 7.00, stdev= 3.42, samples=100 lat (msec) : 10=3.78%, 20=22.66%, 50=18.36%, 100=33.72%, 250=21.22% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=2.12%, ctx=1423, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=467KiB/s (478kB/s), 112KiB/s-126KiB/s (115kB/s-129kB/s), io=23.4MiB (24.5MB), run=49722-51326msec WRITE: bw=491KiB/s (503kB/s), 121KiB/s-127KiB/s (124kB/s-131kB/s), io=24.6MiB (25.8MB), run=49722-51326msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158436: Wed Jun 17 04:48:06 2026 read: IOPS=2, BW=2142KiB/s (2193kB/s)(7168KiB/3347msec) clat (msec): min=61, max=692, avg=223.42, stdev=225.85 lat (msec): min=61, max=692, avg=223.42, stdev=225.85 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 100], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 296], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1928, max= 5774, per=71.62%, avg=3862.67, stdev=1923.11, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1530KiB/s (1566kB/s)(5120KiB/3347msec); 0 zone resets clat (msec): min=228, max=522, avg=353.63, stdev=120.14 lat (msec): min=228, max=522, avg=353.71, stdev=120.17 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1924, max= 4031, per=32.84%, avg=2479.50, stdev=1035.61, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=33.33%, 250=16.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=6.84%, ctx=96, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158437: Wed Jun 17 04:48:06 2026 read: IOPS=0, BW=539KiB/s (552kB/s)(2048KiB/3797msec) clat (msec): min=80, max=226, avg=153.89, stdev=103.31 lat (msec): min=80, max=226, avg=153.89, stdev=103.31 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 82], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 1928, max= 1935, per=35.81%, avg=1931.50, stdev= 4.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2697KiB/s (2762kB/s)(10.0MiB/3797msec); 0 zone resets clat (msec): min=135, max=762, avg=345.12, stdev=238.84 lat (msec): min=135, max=762, avg=345.22, stdev=238.83 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 140], | 30.00th=[ 155], 40.00th=[ 184], 50.00th=[ 192], 60.00th=[ 288], | 70.00th=[ 426], 80.00th=[ 439], 90.00th=[ 735], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1928, max= 6119, per=39.61%, avg=2990.67, stdev=1733.65, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=9.33%, ctx=120, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158438: Wed Jun 17 04:48:06 2026 read: IOPS=1, BW=2041KiB/s (2090kB/s)(6144KiB/3010msec) clat (msec): min=86, max=634, avg=274.88, stdev=205.13 lat (msec): min=86, max=635, avg=274.96, stdev=205.27 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 232], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1889, max= 4071, per=45.87%, avg=2473.75, stdev=1065.66, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=2041KiB/s (2090kB/s)(6144KiB/3010msec); 0 zone resets clat (msec): min=98, max=363, avg=218.51, stdev=114.76 lat (msec): min=98, max=363, avg=218.65, stdev=114.80 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 218], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1943, max= 5667, per=42.49%, avg=3208.33, stdev=2129.57, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=5.95%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158439: Wed Jun 17 04:48:06 2026 read: IOPS=1, BW=1532KiB/s (1569kB/s)(5120KiB/3342msec) clat (msec): min=67, max=663, avg=313.79, stdev=249.58 lat (msec): min=67, max=663, avg=313.79, stdev=249.58 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2015, max= 3984, per=49.66%, avg=2678.00, stdev=1131.07, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2145KiB/s (2196kB/s)(7168KiB/3342msec); 0 zone resets clat (msec): min=106, max=387, avg=250.43, stdev=112.24 lat (msec): min=107, max=387, avg=251.44, stdev=112.42 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 132], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 284], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 359], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 1928, max= 4031, per=32.90%, avg=2484.25, stdev=1032.25, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.06%, sys=7.24%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5394KiB/s (5523kB/s), 539KiB/s-2142KiB/s (552kB/s-2193kB/s), io=20.0MiB (20.0MB), run=3010-3797msec WRITE: bw=7551KiB/s (7732kB/s), 1530KiB/s-2697KiB/s (1566kB/s-2762kB/s), io=28.0MiB (29.4MB), run=3010-3797msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158441: Wed Jun 17 04:48:06 2026 read: IOPS=2, BW=2665KiB/s (2729kB/s)(7168KiB/2690msec) clat (msec): min=159, max=399, avg=242.38, stdev=81.72 lat (msec): min=159, max=399, avg=242.38, stdev=81.72 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 178], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 232], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 284], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2007, max= 4151, per=48.61%, avg=2732.33, stdev=1228.71, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1903KiB/s (1949kB/s)(5120KiB/2690msec); 0 zone resets clat (msec): min=152, max=284, avg=198.04, stdev=52.56 lat (msec): min=152, max=284, avg=198.38, stdev=52.49 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 2007, max= 4071, per=34.38%, avg=2705.67, stdev=1182.52, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=75.00%, 500=25.00% cpu : usr=0.07%, sys=31.09%, ctx=305, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158442: Wed Jun 17 04:48:06 2026 read: IOPS=0, BW=562KiB/s (576kB/s)(2048KiB/3643msec) clat (usec): min=537, max=145832, avg=73185.08, stdev=102739.37 lat (usec): min=538, max=145834, avg=73186.76, stdev=102739.51 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 537], 60.00th=[145753], | 70.00th=[145753], 80.00th=[145753], 90.00th=[145753], 95.00th=[145753], | 99.00th=[145753], 99.50th=[145753], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 1380, max= 1932, per=29.46%, avg=1656.00, stdev=390.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2811KiB/s (2878kB/s)(10.0MiB/3643msec); 0 zone resets clat (msec): min=107, max=735, avg=349.39, stdev=235.24 lat (msec): min=107, max=735, avg=349.47, stdev=235.23 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 112], | 30.00th=[ 140], 40.00th=[ 146], 50.00th=[ 213], 60.00th=[ 426], | 70.00th=[ 439], 80.00th=[ 567], 90.00th=[ 609], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1380, max= 4079, per=28.53%, avg=2245.33, stdev=933.05, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=23.50%, ctx=181, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158443: Wed Jun 17 04:48:06 2026 read: IOPS=1, BW=2014KiB/s (2062kB/s)(6144KiB/3051msec) clat (msec): min=128, max=209, avg=171.62, stdev=28.87 lat (msec): min=128, max=209, avg=171.62, stdev=28.87 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 186], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 209], 95.00th=[ 209], | 99.00th=[ 209], 99.50th=[ 209], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 1932, max= 4071, per=59.41%, avg=3339.33, stdev=1219.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=2014KiB/s (2062kB/s)(6144KiB/3051msec); 0 zone resets clat (msec): min=153, max=557, avg=336.45, stdev=186.75 lat (msec): min=153, max=557, avg=336.52, stdev=186.75 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 435], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2007, max= 2856, per=28.39%, avg=2234.25, stdev=414.74, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=75.00%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=22.69%, ctx=248, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158444: Wed Jun 17 04:48:06 2026 read: IOPS=1, BW=1583KiB/s (1621kB/s)(5120KiB/3235msec) clat (usec): min=512, max=405349, avg=123280.92, stdev=181352.92 lat (usec): min=513, max=405350, avg=123282.06, stdev=181352.55 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 2089], 60.00th=[ 2089], | 70.00th=[208667], 80.00th=[208667], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 3864, max= 4071, per=70.58%, avg=3967.50, stdev=146.37, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2216KiB/s (2269kB/s)(7168KiB/3235msec); 0 zone resets clat (msec): min=170, max=496, avg=373.62, stdev=129.31 lat (msec): min=170, max=497, avg=373.75, stdev=129.34 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 211], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 418], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1374, max= 2039, per=23.68%, avg=1863.75, stdev=326.81, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 250=25.00%, 500=50.00% cpu : usr=0.00%, sys=23.62%, ctx=150, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5622KiB/s (5757kB/s), 562KiB/s-2665KiB/s (576kB/s-2729kB/s), io=20.0MiB (20.0MB), run=2690-3643msec WRITE: bw=7870KiB/s (8059kB/s), 1903KiB/s-2811KiB/s (1949kB/s-2878kB/s), io=28.0MiB (29.4MB), run=2690-3643msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158453: Wed Jun 17 04:48:16 2026 read: IOPS=1, BW=5099KiB/s (5221kB/s)(12.0MiB/2410msec) clat (msec): min=570, max=920, avg=755.71, stdev=175.92 lat (msec): min=570, max=920, avg=755.71, stdev=175.92 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.07%, ctx=320, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158455: Wed Jun 17 04:48:16 2026 read: IOPS=0, BW=1368KiB/s (1401kB/s)(4096KiB/2994msec) clat (nsec): min=855351k, max=855351k, avg=855350932.00, stdev= 0.00 lat (nsec): min=855353k, max=855353k, avg=855353441.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2736KiB/s (2802kB/s)(8192KiB/2994msec); 0 zone resets clat (msec): min=690, max=1376, avg=1033.54, stdev=484.69 lat (msec): min=692, max=1376, avg=1034.63, stdev=483.83 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=77.38%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=5.55%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158457: Wed Jun 17 04:48:16 2026 write: IOPS=1, BW=4279KiB/s (4381kB/s)(12.0MiB/2872msec); 0 zone resets clat (msec): min=583, max=1107, avg=902.17, stdev=280.11 lat (msec): min=583, max=1108, avg=902.55, stdev=280.15 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8126, max= 8192, per=77.07%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.13%, ctx=97, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158458: Wed Jun 17 04:48:16 2026 write: IOPS=0, BW=3970KiB/s (4066kB/s)(12.0MiB/3095msec); 0 zone resets clat (msec): min=244, max=1797, avg=928.81, stdev=792.61 lat (msec): min=245, max=1797, avg=929.56, stdev=792.38 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8175, max= 8175, per=77.22%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.14%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5472KiB/s (5604kB/s), 1368KiB/s-5099KiB/s (1401kB/s-5221kB/s), io=16.0MiB (16.8MB), run=2410-2994msec WRITE: bw=10.3MiB/s (10.8MB/s), 2736KiB/s-4279KiB/s (2802kB/s-4381kB/s), io=32.0MiB (33.6MB), run=2872-3095msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158451: Wed Jun 17 04:48:17 2026 read: IOPS=2, BW=9585KiB/s (9815kB/s)(12.0MiB/1282msec) clat (msec): min=353, max=391, avg=376.98, stdev=20.55 lat (msec): min=353, max=391, avg=376.98, stdev=20.55 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 6736, max= 7922, per=100.00%, avg=7329.00, stdev=838.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=10.38%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158452: Wed Jun 17 04:48:17 2026 read: IOPS=0, BW=1205KiB/s (1234kB/s)(4096KiB/3398msec) clat (nsec): min=1509.2M, max=1509.2M, avg=1509153239.00, stdev= 0.00 lat (nsec): min=1509.2M, max=1509.2M, avg=1509154865.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1502], 5.00th=[ 1502], 10.00th=[ 1502], 20.00th=[ 1502], | 30.00th=[ 1502], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2411KiB/s (2469kB/s)(8192KiB/3398msec); 0 zone resets clat (msec): min=364, max=1239, avg=802.06, stdev=618.31 lat (msec): min=366, max=1239, avg=803.00, stdev=617.50 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8110, max= 8110, per=93.28%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.18%, ctx=65, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158454: Wed Jun 17 04:48:17 2026 write: IOPS=0, BW=3260KiB/s (3339kB/s)(12.0MiB/3769msec); 0 zone resets clat (msec): min=173, max=1870, avg=1164.19, stdev=883.28 lat (msec): min=174, max=1870, avg=1164.56, stdev=883.39 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8110, max= 8110, per=93.28%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.14%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158456: Wed Jun 17 04:48:17 2026 write: IOPS=1, BW=5378KiB/s (5507kB/s)(12.0MiB/2285msec); 0 zone resets clat (msec): min=410, max=1106, avg=705.73, stdev=360.14 lat (msec): min=410, max=1107, avg=706.13, stdev=360.33 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 6930, max= 7772, per=84.55%, avg=7351.00, stdev=595.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.21%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4822KiB/s (4937kB/s), 1205KiB/s-9585KiB/s (1234kB/s-9815kB/s), io=16.0MiB (16.8MB), run=1282-3398msec WRITE: bw=8694KiB/s (8903kB/s), 2411KiB/s-5378KiB/s (2469kB/s-5507kB/s), io=32.0MiB (33.6MB), run=2285-3769msec