== sanity test 398b: DIO and buffer IO race ============== 10:01:06 (1788876066) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.57883 s, 9.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178832: Tue Sep 8 10:02:40 2026 read: IOPS=18, BW=75.9KiB/s (77.8kB/s)(5992KiB/78913msec) clat (usec): min=36, max=151685, avg=29146.74, stdev=17722.13 lat (usec): min=37, max=151686, avg=29149.53, stdev=17722.09 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 8586], 10.00th=[ 11863], 20.00th=[ 15139], | 30.00th=[ 18220], 40.00th=[ 21890], 50.00th=[ 26084], 60.00th=[ 30540], | 70.00th=[ 34866], 80.00th=[ 41157], 90.00th=[ 50070], 95.00th=[ 61080], | 99.00th=[ 92799], 99.50th=[101188], 99.90th=[127402], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 23, max= 119, per=24.76%, avg=75.26, stdev=21.52, samples=156 iops : min= 5, max= 29, avg=18.22, stdev= 5.38, samples=156 write: IOPS=19, BW=79.8KiB/s (81.7kB/s)(6296KiB/78913msec); 0 zone resets clat (usec): min=692, max=142803, avg=22339.72, stdev=21570.47 lat (usec): min=693, max=142803, avg=22343.28, stdev=21571.48 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 1139], 10.00th=[ 1319], 20.00th=[ 2540], | 30.00th=[ 5211], 40.00th=[ 11469], 50.00th=[ 17433], 60.00th=[ 22414], | 70.00th=[ 29230], 80.00th=[ 39060], 90.00th=[ 52167], 95.00th=[ 66323], | 99.00th=[ 90702], 99.50th=[ 95945], 99.90th=[116917], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 7, max= 183, per=24.92%, avg=79.24, stdev=28.87, samples=156 iops : min= 1, max= 45, avg=19.24, stdev= 7.26, samples=156 lat (usec) : 50=0.42%, 100=0.94%, 250=0.20%, 750=0.07%, 1000=0.59% lat (msec) : 2=7.94%, 4=4.92%, 10=7.36%, 20=23.01%, 50=43.72% lat (msec) : 100=10.35%, 250=0.49% cpu : usr=0.08%, sys=7.60%, ctx=6614, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178833: Tue Sep 8 10:02:40 2026 read: IOPS=19, BW=76.4KiB/s (78.2kB/s)(5940KiB/77770msec) clat (usec): min=31, max=278758, avg=28986.82, stdev=19530.77 lat (usec): min=31, max=278759, avg=28988.27, stdev=19532.25 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9110], 10.00th=[ 12125], 20.00th=[ 15401], | 30.00th=[ 18220], 40.00th=[ 21365], 50.00th=[ 24773], 60.00th=[ 28705], | 70.00th=[ 33424], 80.00th=[ 40109], 90.00th=[ 49546], 95.00th=[ 62653], | 99.00th=[ 98042], 99.50th=[109577], 99.90th=[200279], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 12, max= 151, per=24.99%, avg=75.98, stdev=24.15, samples=154 iops : min= 3, max= 37, avg=18.42, stdev= 6.03, samples=154 write: IOPS=20, BW=81.6KiB/s (83.6kB/s)(6348KiB/77770msec); 0 zone resets clat (usec): min=825, max=163390, avg=21813.00, stdev=21479.97 lat (usec): min=826, max=163392, avg=21816.64, stdev=21481.05 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 2507], | 30.00th=[ 5080], 40.00th=[ 10945], 50.00th=[ 16581], 60.00th=[ 21627], | 70.00th=[ 28967], 80.00th=[ 37487], 90.00th=[ 50594], 95.00th=[ 61604], | 99.00th=[ 92799], 99.50th=[110625], 99.90th=[156238], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 7, max= 262, per=25.52%, avg=81.16, stdev=31.01, samples=154 iops : min= 1, max= 65, avg=19.71, stdev= 7.81, samples=154 lat (usec) : 50=0.20%, 100=1.04%, 250=0.10%, 1000=0.59% lat (msec) : 2=8.37%, 4=5.24%, 10=7.62%, 20=23.18%, 50=43.59% lat (msec) : 100=9.41%, 250=0.65%, 500=0.03% cpu : usr=0.10%, sys=7.65%, ctx=6579, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178834: Tue Sep 8 10:02:40 2026 read: IOPS=19, BW=78.5KiB/s (80.4kB/s)(6028KiB/76791msec) clat (usec): min=38, max=165071, avg=28051.82, stdev=17842.74 lat (usec): min=39, max=165072, avg=28054.93, stdev=17841.73 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 8586], 10.00th=[ 11469], 20.00th=[ 14484], | 30.00th=[ 17695], 40.00th=[ 20841], 50.00th=[ 24249], 60.00th=[ 28443], | 70.00th=[ 33424], 80.00th=[ 39584], 90.00th=[ 49021], 95.00th=[ 58983], | 99.00th=[ 92799], 99.50th=[113771], 99.90th=[139461], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 15, max= 135, per=25.64%, avg=77.94, stdev=24.33, samples=152 iops : min= 3, max= 33, avg=18.91, stdev= 6.10, samples=152 write: IOPS=20, BW=81.5KiB/s (83.5kB/s)(6260KiB/76791msec); 0 zone resets clat (usec): min=598, max=306264, avg=21990.84, stdev=23090.15 lat (usec): min=599, max=306266, avg=21996.18, stdev=23093.00 clat percentiles (usec): | 1.00th=[ 955], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 2409], | 30.00th=[ 4555], 40.00th=[ 10028], 50.00th=[ 16057], 60.00th=[ 21365], | 70.00th=[ 28705], 80.00th=[ 38011], 90.00th=[ 53216], 95.00th=[ 65274], | 99.00th=[ 94897], 99.50th=[103285], 99.90th=[158335], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 23, max= 174, per=25.46%, avg=80.96, stdev=29.31, samples=152 iops : min= 5, max= 43, avg=19.66, stdev= 7.38, samples=152 lat (usec) : 50=0.33%, 100=1.30%, 250=0.10%, 750=0.07%, 1000=0.65% lat (msec) : 2=8.11%, 4=5.44%, 10=7.88%, 20=24.02%, 50=41.15% lat (msec) : 100=10.29%, 250=0.65%, 500=0.03% cpu : usr=0.08%, sys=7.54%, ctx=6370, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178835: Tue Sep 8 10:02:40 2026 read: IOPS=19, BW=78.4KiB/s (80.3kB/s)(6052KiB/77207msec) clat (usec): min=35, max=153681, avg=28181.13, stdev=17729.98 lat (usec): min=35, max=153682, avg=28190.95, stdev=17726.05 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 6521], 10.00th=[ 11076], 20.00th=[ 15008], | 30.00th=[ 17957], 40.00th=[ 21365], 50.00th=[ 25035], 60.00th=[ 28967], | 70.00th=[ 34341], 80.00th=[ 39584], 90.00th=[ 49021], 95.00th=[ 59507], | 99.00th=[ 89654], 99.50th=[110625], 99.90th=[143655], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 18, max= 159, per=25.67%, avg=78.03, stdev=22.61, samples=153 iops : min= 4, max= 39, avg=18.93, stdev= 5.67, samples=153 write: IOPS=20, BW=80.8KiB/s (82.7kB/s)(6236KiB/77207msec); 0 zone resets clat (usec): min=831, max=300867, avg=22105.87, stdev=23493.53 lat (usec): min=832, max=300871, avg=22107.30, stdev=23493.35 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1188], 10.00th=[ 1418], 20.00th=[ 2409], | 30.00th=[ 5014], 40.00th=[ 10683], 50.00th=[ 16057], 60.00th=[ 21365], | 70.00th=[ 28443], 80.00th=[ 38011], 90.00th=[ 52167], 95.00th=[ 65799], | 99.00th=[ 94897], 99.50th=[112722], 99.90th=[193987], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 23, max= 176, per=25.29%, avg=80.41, stdev=28.05, samples=153 iops : min= 5, max= 44, avg=19.53, stdev= 7.05, samples=153 lat (usec) : 50=0.49%, 100=1.56%, 250=0.07%, 500=0.07%, 1000=0.39% lat (msec) : 2=8.01%, 4=5.34%, 10=7.71%, 20=23.31%, 50=42.61% lat (msec) : 100=9.83%, 250=0.59%, 500=0.03% cpu : usr=0.08%, sys=7.53%, ctx=6472, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=304KiB/s (312kB/s), 75.9KiB/s-78.5KiB/s (77.8kB/s-80.4kB/s), io=23.4MiB (24.6MB), run=76791-78913msec WRITE: bw=319KiB/s (326kB/s), 79.8KiB/s-81.6KiB/s (81.7kB/s-83.6kB/s), io=24.6MiB (25.7MB), run=76791-78913msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178827: Tue Sep 8 10:03:08 2026 read: IOPS=14, BW=56.5KiB/s (57.9kB/s)(5992KiB/105970msec) clat (msec): min=3, max=633, avg=28.03, stdev=28.05 lat (msec): min=3, max=633, avg=28.03, stdev=28.05 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 59], 95.00th=[ 79], | 99.00th=[ 114], 99.50th=[ 130], 99.90th=[ 180], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 208, per=25.38%, avg=56.86, stdev=34.80, samples=207 iops : min= 1, max= 52, avg=13.60, stdev= 8.76, samples=207 write: IOPS=14, BW=59.4KiB/s (60.8kB/s)(6296KiB/105970msec); 0 zone resets clat (msec): min=8, max=201, avg=40.45, stdev=26.58 lat (msec): min=8, max=201, avg=40.45, stdev=26.58 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 77], 95.00th=[ 94], | 99.00th=[ 136], 99.50th=[ 155], 99.90th=[ 201], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 15, max= 174, per=25.30%, avg=59.46, stdev=32.39, samples=208 iops : min= 3, max= 43, avg=14.25, stdev= 8.16, samples=208 lat (msec) : 4=0.07%, 10=8.01%, 20=27.57%, 50=43.36%, 100=18.16% lat (msec) : 250=2.80%, 750=0.03% cpu : usr=0.07%, sys=2.65%, ctx=4816, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178828: Tue Sep 8 10:03:08 2026 read: IOPS=14, BW=56.0KiB/s (57.4kB/s)(5940KiB/106058msec) clat (msec): min=4, max=754, avg=27.61, stdev=29.58 lat (msec): min=4, max=754, avg=27.61, stdev=29.58 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 57], 95.00th=[ 75], | 99.00th=[ 116], 99.50th=[ 131], 99.90th=[ 182], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 199, per=25.04%, avg=56.09, stdev=35.74, samples=208 iops : min= 1, max= 49, avg=13.40, stdev= 8.99, samples=208 write: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6348KiB/106058msec); 0 zone resets clat (msec): min=6, max=178, avg=40.78, stdev=26.06 lat (msec): min=6, max=178, avg=40.78, stdev=26.06 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 78], 95.00th=[ 92], | 99.00th=[ 126], 99.50th=[ 142], 99.90th=[ 165], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 7, max= 183, per=25.44%, avg=59.79, stdev=31.49, samples=208 iops : min= 1, max= 45, avg=14.33, stdev= 7.94, samples=208 lat (msec) : 10=8.27%, 20=27.80%, 50=42.97%, 100=18.13%, 250=2.80% lat (msec) : 1000=0.03% cpu : usr=0.07%, sys=2.57%, ctx=4816, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178829: Tue Sep 8 10:03:08 2026 read: IOPS=14, BW=56.4KiB/s (57.7kB/s)(6028KiB/106923msec) clat (msec): min=3, max=187, avg=27.91, stdev=23.03 lat (msec): min=3, max=187, avg=27.91, stdev=23.03 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 61], 95.00th=[ 73], | 99.00th=[ 110], 99.50th=[ 129], 99.90th=[ 180], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 7, max= 207, per=25.19%, avg=56.42, stdev=33.92, samples=210 iops : min= 1, max= 51, avg=13.48, stdev= 8.54, samples=210 write: IOPS=14, BW=58.5KiB/s (59.0kB/s)(6260KiB/106923msec); 0 zone resets clat (msec): min=6, max=778, avg=41.24, stdev=33.28 lat (msec): min=6, max=778, avg=41.24, stdev=33.28 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 59], 90.00th=[ 80], 95.00th=[ 96], | 99.00th=[ 142], 99.50th=[ 161], 99.90th=[ 190], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 198, per=24.79%, avg=58.27, stdev=34.25, samples=211 iops : min= 1, max= 49, avg=13.95, stdev= 8.62, samples=211 lat (msec) : 4=0.03%, 10=7.75%, 20=28.81%, 50=41.73%, 100=18.88% lat (msec) : 250=2.77%, 1000=0.03% cpu : usr=0.07%, sys=2.62%, ctx=4940, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178830: Tue Sep 8 10:03:08 2026 read: IOPS=14, BW=56.7KiB/s (58.1kB/s)(6052KiB/106649msec) clat (msec): min=4, max=196, avg=28.10, stdev=24.27 lat (msec): min=4, max=196, avg=28.10, stdev=24.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 59], 95.00th=[ 78], | 99.00th=[ 121], 99.50th=[ 134], 99.90th=[ 190], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 7, max= 200, per=25.57%, avg=57.29, stdev=35.61, samples=207 iops : min= 1, max= 50, avg=13.70, stdev= 8.97, samples=207 write: IOPS=14, BW=58.5KiB/s (59.9kB/s)(6236KiB/106649msec); 0 zone resets clat (msec): min=8, max=782, avg=40.94, stdev=33.13 lat (msec): min=8, max=782, avg=40.95, stdev=33.14 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 79], 95.00th=[ 96], | 99.00th=[ 138], 99.50th=[ 161], 99.90th=[ 209], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8, max= 175, per=24.72%, avg=58.10, stdev=33.46, samples=210 iops : min= 2, max= 43, avg=13.90, stdev= 8.43, samples=210 lat (msec) : 10=8.24%, 20=28.42%, 50=42.38%, 100=17.90%, 250=3.03% lat (msec) : 1000=0.03% cpu : usr=0.08%, sys=2.66%, ctx=4854, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=225KiB/s (230kB/s), 56.0KiB/s-56.7KiB/s (57.4kB/s-58.1kB/s), io=23.4MiB (24.6MB), run=105970-106923msec WRITE: bw=235KiB/s (241kB/s), 58.5KiB/s-59.9KiB/s (59.9kB/s-61.3kB/s), io=24.6MiB (25.7MB), run=105970-106923msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178864: Tue Sep 8 10:03:36 2026 read: IOPS=17, BW=274KiB/s (281kB/s)(5920KiB/21571msec) clat (usec): min=31, max=135118, avg=31405.76, stdev=21160.86 lat (usec): min=31, max=135119, avg=31406.85, stdev=21160.91 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 7767], 20.00th=[ 16057], | 30.00th=[ 20055], 40.00th=[ 24249], 50.00th=[ 29492], 60.00th=[ 33424], | 70.00th=[ 37487], 80.00th=[ 42730], 90.00th=[ 53216], 95.00th=[ 68682], | 99.00th=[108528], 99.50th=[129500], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 158, max= 440, per=24.30%, avg=269.74, stdev=69.68, samples=42 iops : min= 9, max= 27, avg=16.17, stdev= 4.40, samples=42 write: IOPS=18, BW=295KiB/s (302kB/s)(6368KiB/21571msec); 0 zone resets clat (usec): min=1111, max=135407, avg=24634.76, stdev=22699.14 lat (usec): min=1113, max=135409, avg=24636.47, stdev=22699.10 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1795], 10.00th=[ 2409], 20.00th=[ 4178], | 30.00th=[ 7373], 40.00th=[ 13829], 50.00th=[ 19268], 60.00th=[ 25560], | 70.00th=[ 32113], 80.00th=[ 40109], 90.00th=[ 56886], 95.00th=[ 68682], | 99.00th=[109577], 99.50th=[121111], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 63, max= 542, per=25.04%, avg=292.48, stdev=109.43, samples=42 iops : min= 3, max= 33, avg=17.60, stdev= 6.82, samples=42 lat (usec) : 50=0.78%, 100=2.86%, 250=0.52%, 500=0.13% lat (msec) : 2=4.56%, 4=5.34%, 10=8.46%, 20=18.23%, 50=46.09% lat (msec) : 100=11.85%, 250=1.17% cpu : usr=0.08%, sys=8.39%, ctx=1730, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178865: Tue Sep 8 10:03:36 2026 read: IOPS=17, BW=274KiB/s (280kB/s)(5744KiB/20976msec) clat (usec): min=47, max=123579, avg=31335.29, stdev=20063.81 lat (usec): min=48, max=123579, avg=31336.32, stdev=20063.84 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 11600], 20.00th=[ 16909], | 30.00th=[ 20841], 40.00th=[ 24511], 50.00th=[ 28181], 60.00th=[ 32375], | 70.00th=[ 38011], 80.00th=[ 44827], 90.00th=[ 55837], 95.00th=[ 69731], | 99.00th=[ 98042], 99.50th=[116917], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 159, max= 540, per=24.56%, avg=272.59, stdev=81.60, samples=41 iops : min= 9, max= 33, avg=16.34, stdev= 5.12, samples=41 write: IOPS=19, BW=312KiB/s (319kB/s)(6544KiB/20976msec); 0 zone resets clat (usec): min=1344, max=124406, avg=23296.71, stdev=21609.03 lat (usec): min=1345, max=124408, avg=23300.98, stdev=21608.73 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1876], 10.00th=[ 2540], 20.00th=[ 4359], | 30.00th=[ 6521], 40.00th=[ 11469], 50.00th=[ 16581], 60.00th=[ 23462], | 70.00th=[ 31327], 80.00th=[ 39060], 90.00th=[ 55313], 95.00th=[ 64750], | 99.00th=[ 84411], 99.50th=[ 89654], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 158, max= 542, per=26.50%, avg=309.54, stdev=91.53, samples=41 iops : min= 9, max= 33, avg=18.66, stdev= 5.68, samples=41 lat (usec) : 50=0.39%, 100=3.12%, 250=0.65% lat (msec) : 2=2.99%, 4=6.64%, 10=10.29%, 20=19.01%, 50=43.49% lat (msec) : 100=12.89%, 250=0.52% cpu : usr=0.09%, sys=8.53%, ctx=1720, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178866: Tue Sep 8 10:03:36 2026 read: IOPS=18, BW=298KiB/s (305kB/s)(6256KiB/20991msec) clat (usec): min=36, max=158354, avg=30811.86, stdev=19831.48 lat (usec): min=37, max=158356, avg=30812.85, stdev=19831.50 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 11600], 20.00th=[ 16319], | 30.00th=[ 20579], 40.00th=[ 23462], 50.00th=[ 27395], 60.00th=[ 31851], | 70.00th=[ 36439], 80.00th=[ 43779], 90.00th=[ 53740], 95.00th=[ 62653], | 99.00th=[103285], 99.50th=[116917], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 126, max= 574, per=26.72%, avg=296.54, stdev=94.05, samples=41 iops : min= 7, max= 35, avg=17.83, stdev= 5.92, samples=41 write: IOPS=17, BW=287KiB/s (294kB/s)(6032KiB/20991msec); 0 zone resets clat (usec): min=1474, max=127253, avg=23643.18, stdev=22403.25 lat (usec): min=1475, max=127255, avg=23645.12, stdev=22403.16 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1975], 10.00th=[ 2606], 20.00th=[ 4080], | 30.00th=[ 6587], 40.00th=[ 11076], 50.00th=[ 16057], 60.00th=[ 23725], | 70.00th=[ 30802], 80.00th=[ 40633], 90.00th=[ 54789], 95.00th=[ 68682], | 99.00th=[ 92799], 99.50th=[121111], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 63, max= 477, per=24.19%, avg=282.54, stdev=96.29, samples=41 iops : min= 3, max= 29, avg=16.95, stdev= 6.09, samples=41 lat (usec) : 50=0.39%, 100=3.12%, 250=0.13% lat (msec) : 2=2.60%, 4=6.77%, 10=10.42%, 20=18.49%, 50=45.05% lat (msec) : 100=12.11%, 250=0.91% cpu : usr=0.07%, sys=8.11%, ctx=1723, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178867: Tue Sep 8 10:03:36 2026 read: IOPS=18, BW=293KiB/s (300kB/s)(6032KiB/20557msec) clat (usec): min=43, max=158305, avg=29577.23, stdev=20825.23 lat (usec): min=44, max=158306, avg=29578.18, stdev=20825.28 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 102], 20.00th=[ 16057], | 30.00th=[ 20055], 40.00th=[ 23200], 50.00th=[ 26870], 60.00th=[ 30278], | 70.00th=[ 35390], 80.00th=[ 41681], 90.00th=[ 51643], 95.00th=[ 64226], | 99.00th=[111674], 99.50th=[143655], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 128, max= 571, per=26.38%, avg=292.80, stdev=85.87, samples=40 iops : min= 8, max= 35, avg=17.60, stdev= 5.39, samples=40 write: IOPS=19, BW=304KiB/s (312kB/s)(6256KiB/20557msec); 0 zone resets clat (usec): min=1026, max=106182, avg=23559.43, stdev=22341.77 lat (usec): min=1027, max=106183, avg=23561.41, stdev=22341.90 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1811], 10.00th=[ 2409], 20.00th=[ 4146], | 30.00th=[ 6652], 40.00th=[ 10683], 50.00th=[ 17695], 60.00th=[ 22938], | 70.00th=[ 29492], 80.00th=[ 40633], 90.00th=[ 55313], 95.00th=[ 69731], | 99.00th=[ 95945], 99.50th=[105382], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 190, max= 477, per=25.95%, avg=303.10, stdev=80.64, samples=40 iops : min= 11, max= 29, avg=18.25, stdev= 5.12, samples=40 lat (usec) : 50=0.65%, 100=4.17%, 250=0.39%, 500=0.13% lat (msec) : 2=3.91%, 4=5.86%, 10=11.20%, 20=16.41%, 50=44.79% lat (msec) : 100=11.46%, 250=1.04% cpu : usr=0.14%, sys=8.32%, ctx=1670, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1110KiB/s (1137kB/s), 274KiB/s-298KiB/s (280kB/s-305kB/s), io=23.4MiB (24.5MB), run=20557-21571msec WRITE: bw=1168KiB/s (1196kB/s), 287KiB/s-312KiB/s (294kB/s-319kB/s), io=24.6MiB (25.8MB), run=20557-21571msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178868: Tue Sep 8 10:03:43 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5920KiB/27952msec) clat (msec): min=4, max=137, avg=29.55, stdev=25.57 lat (msec): min=4, max=137, avg=29.55, stdev=25.57 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 70], 95.00th=[ 89], | 99.00th=[ 118], 99.50th=[ 125], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 764, per=24.61%, avg=209.15, stdev=135.80, samples=55 iops : min= 3, max= 47, avg=12.33, stdev= 8.56, samples=55 write: IOPS=14, BW=228KiB/s (233kB/s)(6368KiB/27952msec); 0 zone resets clat (msec): min=10, max=154, avg=42.36, stdev=27.92 lat (msec): min=10, max=154, avg=42.36, stdev=27.92 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 53], 80.00th=[ 67], 90.00th=[ 85], 95.00th=[ 101], | 99.00th=[ 130], 99.50th=[ 142], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 63, max= 574, per=25.34%, avg=226.56, stdev=137.78, samples=55 iops : min= 3, max= 35, avg=13.42, stdev= 8.69, samples=55 lat (msec) : 10=6.25%, 20=30.47%, 50=38.80%, 100=20.83%, 250=3.65% cpu : usr=0.05%, sys=2.50%, ctx=1184, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178869: Tue Sep 8 10:03:43 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(5744KiB/27764msec) clat (msec): min=5, max=162, avg=27.84, stdev=25.30 lat (msec): min=5, max=162, avg=27.85, stdev=25.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 41], 90.00th=[ 65], 95.00th=[ 85], | 99.00th=[ 130], 99.50th=[ 134], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 30, max= 702, per=25.26%, avg=214.72, stdev=142.57, samples=53 iops : min= 1, max= 43, avg=12.66, stdev= 9.01, samples=53 write: IOPS=14, BW=236KiB/s (241kB/s)(6544KiB/27764msec); 0 zone resets clat (msec): min=9, max=165, avg=42.99, stdev=29.83 lat (msec): min=9, max=165, avg=42.99, stdev=29.83 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 67], 90.00th=[ 86], 95.00th=[ 104], | 99.00th=[ 142], 99.50th=[ 155], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 94, max= 733, per=26.26%, avg=234.73, stdev=145.43, samples=55 iops : min= 5, max= 45, avg=13.93, stdev= 9.18, samples=55 lat (msec) : 10=7.16%, 20=30.60%, 50=38.80%, 100=19.27%, 250=4.17% cpu : usr=0.05%, sys=2.64%, ctx=1197, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178870: Tue Sep 8 10:03:43 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(6256KiB/27817msec) clat (msec): min=5, max=157, avg=28.23, stdev=24.98 lat (msec): min=5, max=157, avg=28.24, stdev=24.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 63], 95.00th=[ 86], | 99.00th=[ 121], 99.50th=[ 150], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 31, max= 637, per=26.50%, avg=225.24, stdev=165.30, samples=55 iops : min= 1, max= 39, avg=13.35, stdev=10.43, samples=55 write: IOPS=13, BW=217KiB/s (222kB/s)(6032KiB/27817msec); 0 zone resets clat (msec): min=9, max=181, avg=44.34, stdev=30.69 lat (msec): min=9, max=181, avg=44.34, stdev=30.69 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 90], 95.00th=[ 107], | 99.00th=[ 146], 99.50th=[ 169], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 63, max= 670, per=24.10%, avg=215.49, stdev=134.96, samples=55 iops : min= 3, max= 41, avg=12.73, stdev= 8.53, samples=55 lat (msec) : 10=8.07%, 20=30.34%, 50=37.76%, 100=19.27%, 250=4.56% cpu : usr=0.06%, sys=2.48%, ctx=1149, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178871: Tue Sep 8 10:03:43 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28170msec) clat (msec): min=5, max=146, avg=30.14, stdev=26.44 lat (msec): min=5, max=147, avg=30.14, stdev=26.45 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 33], 80.00th=[ 48], 90.00th=[ 73], 95.00th=[ 89], | 99.00th=[ 127], 99.50th=[ 138], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 31, max= 640, per=24.48%, avg=208.09, stdev=134.96, samples=55 iops : min= 1, max= 40, avg=12.25, stdev= 8.53, samples=55 write: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28170msec); 0 zone resets clat (msec): min=10, max=199, avg=42.49, stdev=29.98 lat (msec): min=10, max=199, avg=42.49, stdev=29.98 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 62], 90.00th=[ 86], 95.00th=[ 108], | 99.00th=[ 136], 99.50th=[ 150], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 63, max= 701, per=24.43%, avg=218.42, stdev=138.93, samples=55 iops : min= 3, max= 43, avg=12.91, stdev= 8.75, samples=55 lat (msec) : 10=7.03%, 20=32.16%, 50=36.85%, 100=19.27%, 250=4.69% cpu : usr=0.08%, sys=2.52%, ctx=1221, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=850KiB/s (871kB/s), 207KiB/s-225KiB/s (212kB/s-230kB/s), io=23.4MiB (24.5MB), run=27764-28170msec WRITE: bw=895KiB/s (916kB/s), 217KiB/s-236KiB/s (222kB/s-241kB/s), io=24.6MiB (25.8MB), run=27764-28170msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178885: Tue Sep 8 10:03:55 2026 read: IOPS=2, BW=2352KiB/s (2408kB/s)(7168KiB/3048msec) clat (usec): min=764, max=379457, avg=202052.00, stdev=114650.61 lat (usec): min=765, max=379459, avg=202053.38, stdev=114650.75 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[152044], | 30.00th=[183501], 40.00th=[183501], 50.00th=[206570], 60.00th=[244319], | 70.00th=[244319], 80.00th=[248513], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 2035, max= 4219, per=54.22%, avg=2767.33, stdev=1257.20, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1680KiB/s (1720kB/s)(5120KiB/3048msec); 0 zone resets clat (msec): min=212, max=456, avg=318.50, stdev=109.40 lat (msec): min=212, max=456, avg=318.57, stdev=109.39 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2035, max= 4087, per=38.09%, avg=2721.67, stdev=1182.42, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=41.67% cpu : usr=0.00%, sys=22.71%, ctx=256, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178886: Tue Sep 8 10:03:55 2026 read: IOPS=0, BW=510KiB/s (523kB/s)(2048KiB/4012msec) clat (msec): min=215, max=219, avg=217.60, stdev= 2.79 lat (msec): min=215, max=219, avg=217.61, stdev= 2.79 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1479, max= 2043, per=34.50%, avg=1761.00, stdev=398.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2552KiB/s (2614kB/s)(10.0MiB/4012msec); 0 zone resets clat (msec): min=74, max=883, avg=331.06, stdev=255.45 lat (msec): min=74, max=884, avg=331.13, stdev=255.46 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 153], 40.00th=[ 224], 50.00th=[ 232], 60.00th=[ 243], | 70.00th=[ 372], 80.00th=[ 430], 90.00th=[ 617], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2035, max= 4096, per=40.05%, avg=2861.80, stdev=1122.57, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=21.74%, ctx=183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178887: Tue Sep 8 10:03:55 2026 read: IOPS=2, BW=2055KiB/s (2104kB/s)(6144KiB/2990msec) clat (usec): min=479, max=256832, avg=79734.41, stdev=105673.50 lat (usec): min=480, max=256832, avg=79735.46, stdev=105673.34 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[ 1205], 50.00th=[ 1205], 60.00th=[ 65274], | 70.00th=[154141], 80.00th=[154141], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 2043, max= 6107, per=79.84%, avg=4075.00, stdev=2873.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2055KiB/s (2104kB/s)(6144KiB/2990msec); 0 zone resets clat (msec): min=230, max=598, avg=395.51, stdev=153.26 lat (msec): min=230, max=598, avg=395.59, stdev=153.26 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 393], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1438, max= 2048, per=26.89%, avg=1921.40, stdev=270.27, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=21.71%, ctx=130, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178888: Tue Sep 8 10:03:55 2026 read: IOPS=1, BW=1386KiB/s (1420kB/s)(5120KiB/3693msec) clat (usec): min=473, max=222517, avg=88121.02, stdev=102941.87 lat (usec): min=474, max=222518, avg=88122.15, stdev=102941.82 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 474], | 30.00th=[ 734], 40.00th=[ 734], 50.00th=[ 44303], 60.00th=[ 44303], | 70.00th=[173016], 80.00th=[173016], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 2043, max= 5774, per=76.58%, avg=3908.50, stdev=2638.22, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1941KiB/s (1988kB/s)(7168KiB/3693msec); 0 zone resets clat (msec): min=97, max=848, avg=443.66, stdev=265.89 lat (msec): min=98, max=848, avg=443.73, stdev=265.88 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 257], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 372], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 634], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1517, max= 2048, per=26.74%, avg=1910.75, stdev=262.55, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=17.82%, ctx=139, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5105KiB/s (5227kB/s), 510KiB/s-2352KiB/s (523kB/s-2408kB/s), io=20.0MiB (20.0MB), run=2990-4012msec WRITE: bw=7147KiB/s (7318kB/s), 1680KiB/s-2552KiB/s (1720kB/s-2614kB/s), io=28.0MiB (29.4MB), run=2990-4012msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178881: Tue Sep 8 10:03:55 2026 read: IOPS=2, BW=2086KiB/s (2136kB/s)(7168KiB/3436msec) clat (msec): min=81, max=520, avg=277.65, stdev=149.86 lat (msec): min=81, max=520, avg=277.65, stdev=149.86 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 118], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 262], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2003, max= 3856, per=49.23%, avg=2391.20, stdev=818.96, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1490KiB/s (1526kB/s)(5120KiB/3436msec); 0 zone resets clat (msec): min=151, max=410, avg=292.27, stdev=112.06 lat (msec): min=151, max=410, avg=292.36, stdev=112.04 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1965, max= 4063, per=37.02%, avg=2517.50, stdev=1030.78, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=58.33%, 750=8.33% cpu : usr=0.06%, sys=6.90%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178882: Tue Sep 8 10:03:55 2026 read: IOPS=0, BW=520KiB/s (533kB/s)(2048KiB/3936msec) clat (msec): min=96, max=192, avg=144.58, stdev=68.08 lat (msec): min=96, max=192, avg=144.58, stdev=68.08 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 1420, max= 2031, per=35.53%, avg=1725.50, stdev=432.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2602KiB/s (2664kB/s)(10.0MiB/3936msec); 0 zone resets clat (msec): min=86, max=1017, avg=356.44, stdev=276.55 lat (msec): min=86, max=1017, avg=356.51, stdev=276.55 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 104], | 30.00th=[ 122], 40.00th=[ 236], 50.00th=[ 279], 60.00th=[ 326], | 70.00th=[ 460], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1961, max= 6131, per=47.78%, avg=3249.20, stdev=1847.91, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.95, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 2000=8.33% cpu : usr=0.03%, sys=6.86%, ctx=108, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178883: Tue Sep 8 10:03:55 2026 read: IOPS=1, BW=1457KiB/s (1492kB/s)(6144KiB/4216msec) clat (msec): min=75, max=445, avg=221.10, stdev=128.46 lat (msec): min=75, max=445, avg=221.10, stdev=128.46 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 234], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1965, max= 4087, per=52.10%, avg=2530.50, stdev=1038.20, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1457KiB/s (1492kB/s)(6144KiB/4216msec); 0 zone resets clat (msec): min=154, max=1017, avg=450.15, stdev=352.29 lat (msec): min=154, max=1017, avg=450.24, stdev=352.29 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 584], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1855, max= 4087, per=35.11%, avg=2387.40, stdev=952.39, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=6.57%, ctx=83, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178884: Tue Sep 8 10:03:55 2026 read: IOPS=1, BW=1397KiB/s (1431kB/s)(5120KiB/3664msec) clat (msec): min=60, max=901, avg=258.49, stdev=361.20 lat (msec): min=60, max=901, avg=258.49, stdev=361.20 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 110], 60.00th=[ 110], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 3930, max= 4079, per=82.45%, avg=4004.50, stdev=105.36, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1956KiB/s (2003kB/s)(7168KiB/3664msec); 0 zone resets clat (msec): min=69, max=774, avg=319.46, stdev=242.76 lat (msec): min=69, max=774, avg=319.53, stdev=242.76 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 132], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 284], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 493], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1914, max= 5896, per=51.07%, avg=3473.00, stdev=1899.96, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 1000=16.67% cpu : usr=0.05%, sys=8.95%, ctx=122, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4858KiB/s (4974kB/s), 520KiB/s-2086KiB/s (533kB/s-2136kB/s), io=20.0MiB (20.0MB), run=3436-4216msec WRITE: bw=6801KiB/s (6964kB/s), 1457KiB/s-2602KiB/s (1492kB/s-2664kB/s), io=28.0MiB (29.4MB), run=3436-4216msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178895: Tue Sep 8 10:04:06 2026 read: IOPS=0, BW=3364KiB/s (3445kB/s)(12.0MiB/3653msec) clat (msec): min=680, max=1947, avg=1188.63, stdev=669.75 lat (msec): min=680, max=1947, avg=1188.63, stdev=669.75 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8015, max= 8143, per=100.00%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.34%, ctx=446, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178896: Tue Sep 8 10:04:06 2026 read: IOPS=0, BW=1056KiB/s (1082kB/s)(4096KiB/3878msec) clat (nsec): min=1961.8M, max=1961.8M, avg=1961814857.00, stdev= 0.00 lat (nsec): min=1961.8M, max=1961.8M, avg=1961815887.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1955], 5.00th=[ 1955], 10.00th=[ 1955], 20.00th=[ 1955], | 30.00th=[ 1955], 40.00th=[ 1955], 50.00th=[ 1955], 60.00th=[ 1955], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2112KiB/s (2163kB/s)(8192KiB/3878msec); 0 zone resets clat (msec): min=522, max=1267, avg=895.31, stdev=526.59 lat (msec): min=523, max=1268, avg=895.67, stdev=526.67 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.82%, ctx=543, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178897: Tue Sep 8 10:04:06 2026 write: IOPS=0, BW=3521KiB/s (3605kB/s)(12.0MiB/3490msec); 0 zone resets clat (msec): min=802, max=1545, avg=1113.42, stdev=386.02 lat (msec): min=803, max=1547, avg=1114.55, stdev=386.48 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8000, max= 8175, per=100.00%, avg=8087.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.56%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178900: Tue Sep 8 10:04:06 2026 write: IOPS=0, BW=2874KiB/s (2943kB/s)(12.0MiB/4275msec); 0 zone resets clat (msec): min=231, max=2114, avg=1394.57, stdev=1016.53 lat (msec): min=232, max=2114, avg=1395.02, stdev=1016.53 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8015, max= 8126, per=100.00%, avg=8070.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.74%, ctx=73, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4225KiB/s (4326kB/s), 1056KiB/s-3364KiB/s (1082kB/s-3445kB/s), io=16.0MiB (16.8MB), run=3653-3878msec WRITE: bw=7665KiB/s (7849kB/s), 2112KiB/s-3521KiB/s (2163kB/s-3605kB/s), io=32.0MiB (33.6MB), run=3490-4275msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178898: Tue Sep 8 10:04:07 2026 read: IOPS=0, BW=3279KiB/s (3358kB/s)(12.0MiB/3747msec) clat (msec): min=637, max=2064, avg=1222.26, stdev=747.43 lat (msec): min=637, max=2064, avg=1222.26, stdev=747.43 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 8062, max= 8126, per=100.00%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.90%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178899: Tue Sep 8 10:04:07 2026 read: IOPS=0, BW=907KiB/s (929kB/s)(4096KiB/4515msec) clat (nsec): min=2446.2M, max=2446.2M, avg=2446231595.00, stdev= 0.00 lat (nsec): min=2446.2M, max=2446.2M, avg=2446232625.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2433], 5.00th=[ 2433], 10.00th=[ 2433], 20.00th=[ 2433], | 30.00th=[ 2433], 40.00th=[ 2433], 50.00th=[ 2433], 60.00th=[ 2433], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1814KiB/s (1858kB/s)(8192KiB/4515msec); 0 zone resets clat (msec): min=549, max=1392, avg=970.83, stdev=596.11 lat (msec): min=549, max=1392, avg=971.13, stdev=596.10 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.26%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178901: Tue Sep 8 10:04:07 2026 write: IOPS=0, BW=2751KiB/s (2817kB/s)(12.0MiB/4466msec); 0 zone resets clat (msec): min=180, max=3675, avg=1459.36, stdev=1926.72 lat (msec): min=180, max=3676, avg=1460.18, stdev=1926.72 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.03%, ctx=80, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178902: Tue Sep 8 10:04:07 2026 write: IOPS=0, BW=3829KiB/s (3921kB/s)(12.0MiB/3209msec); 0 zone resets clat (msec): min=382, max=1483, avg=1045.26, stdev=583.98 lat (msec): min=382, max=1484, avg=1045.67, stdev=584.22 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7876, max= 8062, per=100.00%, avg=7969.00, stdev=131.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.17%, ctx=105, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3629KiB/s (3716kB/s), 907KiB/s-3279KiB/s (929kB/s-3358kB/s), io=16.0MiB (16.8MB), run=3747-4515msec WRITE: bw=7258KiB/s (7432kB/s), 1814KiB/s-3829KiB/s (1858kB/s-3921kB/s), io=32.0MiB (33.6MB), run=3209-4515msec