== sanity test 398b: DIO and buffer IO race ============== 19:34:17 (1781220857) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.9875 s, 16.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154717: Thu Jun 11 19:35:26 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(5992KiB/58033msec) clat (usec): min=32, max=726679, avg=19960.97, stdev=23303.08 lat (usec): min=33, max=726681, avg=19961.99, stdev=23303.07 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 109], 10.00th=[ 8225], 20.00th=[ 10552], | 30.00th=[ 12125], 40.00th=[ 13829], 50.00th=[ 16450], 60.00th=[ 19530], | 70.00th=[ 22676], 80.00th=[ 27132], 90.00th=[ 33817], 95.00th=[ 41681], | 99.00th=[ 77071], 99.50th=[ 99091], 99.90th=[189793], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 13, max= 207, per=25.08%, avg=102.81, stdev=30.03, samples=115 iops : min= 3, max= 51, avg=25.30, stdev= 7.52, samples=115 write: IOPS=27, BW=108KiB/s (111kB/s)(6296KiB/58033msec); 0 zone resets clat (usec): min=1047, max=256753, avg=17724.54, stdev=17481.91 lat (usec): min=1048, max=256754, avg=17726.30, stdev=17482.20 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1860], 10.00th=[ 2409], 20.00th=[ 3392], | 30.00th=[ 5211], 40.00th=[ 9503], 50.00th=[ 13435], 60.00th=[ 17433], | 70.00th=[ 22414], 80.00th=[ 29230], 90.00th=[ 38011], 95.00th=[ 49021], | 99.00th=[ 77071], 99.50th=[ 94897], 99.90th=[105382], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 207, per=25.43%, avg=109.09, stdev=33.52, samples=114 iops : min= 7, max= 51, avg=26.87, stdev= 8.43, samples=114 lat (usec) : 50=0.39%, 100=1.73%, 250=1.07%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.19%, 4=9.64%, 10=12.76%, 20=34.08%, 50=33.14% lat (msec) : 100=3.48%, 250=0.29%, 500=0.03%, 750=0.03% cpu : usr=0.12%, sys=17.14%, ctx=8128, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154718: Thu Jun 11 19:35:26 2026 read: IOPS=25, BW=102KiB/s (105kB/s)(5940KiB/58150msec) clat (usec): min=30, max=101508, avg=18965.79, stdev=12465.75 lat (usec): min=31, max=101510, avg=18966.91, stdev=12465.78 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 131], 10.00th=[ 8160], 20.00th=[ 10552], | 30.00th=[ 12125], 40.00th=[ 13829], 50.00th=[ 16319], 60.00th=[ 18744], | 70.00th=[ 22414], 80.00th=[ 26870], 90.00th=[ 33817], 95.00th=[ 41157], | 99.00th=[ 61604], 99.50th=[ 78119], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 6, max= 183, per=24.84%, avg=101.85, stdev=31.40, samples=115 iops : min= 1, max= 45, avg=25.06, stdev= 7.95, samples=115 write: IOPS=27, BW=109KiB/s (112kB/s)(6348KiB/58150msec); 0 zone resets clat (usec): min=969, max=664961, avg=18764.44, stdev=24327.51 lat (usec): min=970, max=664962, avg=18766.35, stdev=24327.22 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1860], 10.00th=[ 2507], 20.00th=[ 3687], | 30.00th=[ 6128], 40.00th=[ 10683], 50.00th=[ 14615], 60.00th=[ 18744], | 70.00th=[ 23200], 80.00th=[ 28967], 90.00th=[ 39584], 95.00th=[ 50594], | 99.00th=[ 72877], 99.50th=[ 95945], 99.90th=[248513], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 6, max= 199, per=25.30%, avg=108.54, stdev=34.36, samples=115 iops : min= 1, max= 49, avg=26.73, stdev= 8.64, samples=115 lat (usec) : 50=0.26%, 100=1.43%, 250=1.33%, 500=0.07%, 1000=0.10% lat (msec) : 2=3.22%, 4=8.24%, 10=13.54%, 20=35.09%, 50=32.91% lat (msec) : 100=3.58%, 250=0.20%, 750=0.03% cpu : usr=0.10%, sys=16.93%, ctx=8059, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154719: Thu Jun 11 19:35:26 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(6028KiB/57894msec) clat (usec): min=27, max=684289, avg=19112.04, stdev=22834.09 lat (usec): min=28, max=684290, avg=19116.38, stdev=22835.03 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 85], 10.00th=[ 4686], 20.00th=[ 9896], | 30.00th=[ 11731], 40.00th=[ 13829], 50.00th=[ 16188], 60.00th=[ 18744], | 70.00th=[ 22414], 80.00th=[ 27132], 90.00th=[ 33162], 95.00th=[ 40633], | 99.00th=[ 53216], 99.50th=[101188], 99.90th=[223347], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 32, max= 192, per=25.54%, avg=104.72, stdev=33.05, samples=114 iops : min= 8, max= 48, avg=25.78, stdev= 8.33, samples=114 write: IOPS=27, BW=108KiB/s (111kB/s)(6260KiB/57894msec); 0 zone resets clat (usec): min=847, max=138777, avg=18451.30, stdev=16499.73 lat (usec): min=848, max=138779, avg=18453.49, stdev=16500.11 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1876], 10.00th=[ 2540], 20.00th=[ 3851], | 30.00th=[ 6652], 40.00th=[ 11207], 50.00th=[ 14615], 60.00th=[ 19006], | 70.00th=[ 23725], 80.00th=[ 30278], 90.00th=[ 39584], 95.00th=[ 50070], | 99.00th=[ 70779], 99.50th=[ 89654], 99.90th=[127402], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 20, max= 184, per=25.08%, avg=107.61, stdev=29.96, samples=115 iops : min= 5, max= 46, avg=26.50, stdev= 7.54, samples=115 lat (usec) : 50=0.62%, 100=2.51%, 250=1.30%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.16% lat (msec) : 2=3.12%, 4=7.45%, 10=13.67%, 20=34.11%, 50=33.46% lat (msec) : 100=2.90%, 250=0.39%, 750=0.03% cpu : usr=0.11%, sys=17.08%, ctx=7905, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154720: Thu Jun 11 19:35:26 2026 read: IOPS=25, BW=103KiB/s (106kB/s)(6052KiB/58486msec) clat (usec): min=33, max=263168, avg=18977.54, stdev=14709.13 lat (usec): min=33, max=263169, avg=18979.66, stdev=14707.85 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 100], 10.00th=[ 6915], 20.00th=[ 10028], | 30.00th=[ 11994], 40.00th=[ 14091], 50.00th=[ 16712], 60.00th=[ 19268], | 70.00th=[ 22676], 80.00th=[ 26608], 90.00th=[ 32900], 95.00th=[ 40109], | 99.00th=[ 62129], 99.50th=[ 92799], 99.90th=[152044], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 192, per=25.22%, avg=103.38, stdev=31.50, samples=115 iops : min= 1, max= 48, avg=25.44, stdev= 7.90, samples=115 write: IOPS=26, BW=107KiB/s (109kB/s)(6236KiB/58486msec); 0 zone resets clat (usec): min=944, max=715050, avg=18954.29, stdev=24101.36 lat (usec): min=945, max=715052, avg=18956.32, stdev=24101.53 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1647], 10.00th=[ 2409], 20.00th=[ 3523], | 30.00th=[ 6259], 40.00th=[ 11207], 50.00th=[ 15139], 60.00th=[ 18744], | 70.00th=[ 23725], 80.00th=[ 30278], 90.00th=[ 40633], 95.00th=[ 51119], | 99.00th=[ 74974], 99.50th=[ 84411], 99.90th=[127402], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 31, max= 192, per=24.90%, avg=106.81, stdev=31.36, samples=115 iops : min= 7, max= 48, avg=26.30, stdev= 7.92, samples=115 lat (usec) : 50=0.36%, 100=2.12%, 250=1.37%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=3.48%, 4=7.88%, 10=13.31%, 20=33.69%, 50=33.85% lat (msec) : 100=3.45%, 250=0.23%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=16.95%, ctx=8043, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=411KiB/s (420kB/s), 102KiB/s-104KiB/s (105kB/s-107kB/s), io=23.4MiB (24.6MB), run=57894-58486msec WRITE: bw=430KiB/s (440kB/s), 107KiB/s-109KiB/s (109kB/s-112kB/s), io=24.6MiB (25.7MB), run=57894-58486msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154713: Thu Jun 11 19:36:06 2026 read: IOPS=15, BW=61.3KiB/s (62.8kB/s)(5992KiB/97714msec) clat (msec): min=3, max=734, avg=15.07, stdev=23.57 lat (msec): min=3, max=734, avg=15.07, stdev=23.57 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 15], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 69], 99.50th=[ 74], 99.90th=[ 197], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 168, per=25.48%, avg=61.66, stdev=38.46, samples=192 iops : min= 1, max= 42, avg=15.01, stdev= 9.69, samples=192 write: IOPS=16, BW=64.4KiB/s (65.0kB/s)(6296KiB/97714msec); 0 zone resets clat (msec): min=17, max=231, avg=47.57, stdev=25.79 lat (msec): min=17, max=231, avg=47.58, stdev=25.79 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 82], 95.00th=[ 96], | 99.00th=[ 134], 99.50th=[ 163], 99.90th=[ 222], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7, max= 136, per=25.36%, avg=64.41, stdev=31.81, samples=193 iops : min= 1, max= 34, avg=15.69, stdev= 8.06, samples=193 lat (msec) : 4=0.16%, 10=27.70%, 20=11.07%, 50=42.45%, 100=16.28% lat (msec) : 250=2.31%, 750=0.03% cpu : usr=0.07%, sys=5.16%, ctx=5676, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154714: Thu Jun 11 19:36:06 2026 read: IOPS=15, BW=60.0KiB/s (61.5kB/s)(5940KiB/98929msec) clat (msec): min=3, max=681, avg=15.22, stdev=22.43 lat (msec): min=3, max=681, avg=15.22, stdev=22.43 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 15], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 75], 99.50th=[ 91], 99.90th=[ 142], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 168, per=25.33%, avg=61.29, stdev=38.51, samples=192 iops : min= 1, max= 42, avg=14.92, stdev= 9.74, samples=192 write: IOPS=16, BW=64.2KiB/s (65.7kB/s)(6348KiB/98929msec); 0 zone resets clat (msec): min=17, max=268, avg=47.94, stdev=26.51 lat (msec): min=17, max=268, avg=47.94, stdev=26.51 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 67], 90.00th=[ 84], 95.00th=[ 101], | 99.00th=[ 142], 99.50th=[ 163], 99.90th=[ 199], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 128, per=25.26%, avg=64.16, stdev=31.52, samples=196 iops : min= 1, max= 32, avg=15.64, stdev= 7.99, samples=196 lat (msec) : 4=0.23%, 10=27.31%, 20=11.00%, 50=42.42%, 100=16.37% lat (msec) : 250=2.60%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=4.99%, ctx=5651, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154715: Thu Jun 11 19:36:06 2026 read: IOPS=15, BW=61.1KiB/s (62.5kB/s)(6028KiB/98714msec) clat (msec): min=3, max=202, avg=15.53, stdev=16.27 lat (msec): min=3, max=202, avg=15.53, stdev=16.27 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 49], | 99.00th=[ 75], 99.50th=[ 102], 99.90th=[ 144], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 7, max= 183, per=25.36%, avg=61.36, stdev=37.67, samples=194 iops : min= 1, max= 45, avg=14.94, stdev= 9.50, samples=194 write: IOPS=15, BW=63.4KiB/s (64.9kB/s)(6260KiB/98714msec); 0 zone resets clat (msec): min=16, max=738, avg=47.96, stdev=32.51 lat (msec): min=16, max=738, avg=47.97, stdev=32.51 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 32], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 66], 90.00th=[ 85], 95.00th=[ 101], | 99.00th=[ 150], 99.50th=[ 178], 99.90th=[ 275], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 128, per=24.90%, avg=63.26, stdev=32.77, samples=195 iops : min= 1, max= 32, avg=15.41, stdev= 8.30, samples=195 lat (msec) : 4=0.29%, 10=27.64%, 20=10.29%, 50=43.46%, 100=15.40% lat (msec) : 250=2.80%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.06%, ctx=5681, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154716: Thu Jun 11 19:36:06 2026 read: IOPS=15, BW=61.5KiB/s (62.9kB/s)(6052KiB/98459msec) clat (msec): min=3, max=177, avg=14.94, stdev=15.43 lat (msec): min=3, max=177, avg=14.94, stdev=15.43 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 34], 95.00th=[ 47], | 99.00th=[ 72], 99.50th=[ 103], 99.90th=[ 146], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 7, max= 192, per=25.68%, avg=62.14, stdev=38.09, samples=193 iops : min= 1, max= 48, avg=15.13, stdev= 9.62, samples=193 write: IOPS=15, BW=63.3KiB/s (64.9kB/s)(6236KiB/98459msec); 0 zone resets clat (msec): min=17, max=709, avg=48.50, stdev=31.82 lat (msec): min=17, max=709, avg=48.50, stdev=31.82 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 54], 80.00th=[ 68], 90.00th=[ 83], 95.00th=[ 101], | 99.00th=[ 148], 99.50th=[ 174], 99.90th=[ 279], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 15, max= 128, per=24.94%, avg=63.34, stdev=31.27, samples=195 iops : min= 3, max= 32, avg=15.43, stdev= 7.92, samples=195 lat (msec) : 4=0.46%, 10=27.57%, 20=11.33%, 50=41.89%, 100=15.95% lat (msec) : 250=2.70%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=5.15%, ctx=5640, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=243KiB/s (249kB/s), 60.0KiB/s-61.5KiB/s (61.5kB/s-62.9kB/s), io=23.4MiB (24.6MB), run=97714-98929msec WRITE: bw=254KiB/s (260kB/s), 63.3KiB/s-64.4KiB/s (64.9kB/s-65.0kB/s), io=24.6MiB (25.7MB), run=97714-98929msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154748: Thu Jun 11 19:36:28 2026 read: IOPS=24, BW=389KiB/s (399kB/s)(5920KiB/15199msec) clat (usec): min=46, max=107261, avg=20722.49, stdev=13743.73 lat (usec): min=48, max=107262, avg=20723.50, stdev=13743.73 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 80], 10.00th=[ 118], 20.00th=[ 11863], | 30.00th=[ 14353], 40.00th=[ 16909], 50.00th=[ 20055], 60.00th=[ 22414], | 70.00th=[ 25560], 80.00th=[ 30278], 90.00th=[ 36963], 95.00th=[ 44827], | 99.00th=[ 66847], 99.50th=[ 69731], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 255, max= 638, per=25.88%, avg=389.00, stdev=86.85, samples=30 iops : min= 15, max= 39, avg=23.73, stdev= 5.39, samples=30 write: IOPS=26, BW=419KiB/s (429kB/s)(6368KiB/15199msec); 0 zone resets clat (usec): min=1750, max=108957, avg=18823.80, stdev=16497.09 lat (usec): min=1752, max=108960, avg=18826.84, stdev=16496.48 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2900], 10.00th=[ 3720], 20.00th=[ 4817], | 30.00th=[ 6849], 40.00th=[ 9765], 50.00th=[ 13829], 60.00th=[ 17957], | 70.00th=[ 25035], 80.00th=[ 31327], 90.00th=[ 40633], 95.00th=[ 53216], | 99.00th=[ 69731], 99.50th=[ 86508], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 63, max= 608, per=26.47%, avg=418.47, stdev=123.92, samples=30 iops : min= 3, max= 38, avg=25.57, stdev= 7.91, samples=30 lat (usec) : 50=0.39%, 100=3.26%, 250=2.73%, 500=0.26%, 750=0.13% lat (msec) : 2=0.91%, 4=5.60%, 10=15.36%, 20=28.39%, 50=38.54% lat (msec) : 100=4.17%, 250=0.26% cpu : usr=0.11%, sys=18.14%, ctx=2005, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154749: Thu Jun 11 19:36:28 2026 read: IOPS=22, BW=361KiB/s (369kB/s)(5744KiB/15933msec) clat (usec): min=40, max=180218, avg=22764.99, stdev=17237.06 lat (usec): min=41, max=180220, avg=22766.05, stdev=17237.06 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 75], 10.00th=[ 135], 20.00th=[ 12780], | 30.00th=[ 15664], 40.00th=[ 18482], 50.00th=[ 20841], 60.00th=[ 23462], | 70.00th=[ 26870], 80.00th=[ 31589], 90.00th=[ 39060], 95.00th=[ 51119], | 99.00th=[ 83362], 99.50th=[121111], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 159, max= 544, per=24.03%, avg=361.16, stdev=106.04, samples=31 iops : min= 9, max= 34, avg=21.97, stdev= 6.74, samples=31 write: IOPS=25, BW=411KiB/s (421kB/s)(6544KiB/15933msec); 0 zone resets clat (usec): min=1489, max=174645, avg=18709.67, stdev=17863.27 lat (usec): min=1492, max=174646, avg=18711.98, stdev=17863.18 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2704], 10.00th=[ 3523], 20.00th=[ 4752], | 30.00th=[ 6194], 40.00th=[ 8717], 50.00th=[ 13698], 60.00th=[ 18220], | 70.00th=[ 23725], 80.00th=[ 30802], 90.00th=[ 42730], 95.00th=[ 49021], | 99.00th=[ 69731], 99.50th=[ 81265], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 159, max= 667, per=26.00%, avg=411.10, stdev=113.07, samples=31 iops : min= 9, max= 41, avg=25.10, stdev= 7.15, samples=31 lat (usec) : 50=0.13%, 100=3.39%, 250=1.95%, 500=0.13%, 750=0.13% lat (msec) : 2=0.91%, 4=6.38%, 10=16.28%, 20=26.43%, 50=39.06% lat (msec) : 100=4.82%, 250=0.39% cpu : usr=0.09%, sys=17.47%, ctx=2028, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154750: Thu Jun 11 19:36:28 2026 read: IOPS=24, BW=398KiB/s (408kB/s)(6256KiB/15708msec) clat (usec): min=42, max=106468, avg=20447.39, stdev=14699.54 lat (usec): min=43, max=106470, avg=20449.31, stdev=14699.15 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 68], 10.00th=[ 106], 20.00th=[ 11076], | 30.00th=[ 14353], 40.00th=[ 16450], 50.00th=[ 19006], 60.00th=[ 21627], | 70.00th=[ 25035], 80.00th=[ 30802], 90.00th=[ 37487], 95.00th=[ 46400], | 99.00th=[ 68682], 99.50th=[ 84411], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 223, max= 760, per=26.60%, avg=399.84, stdev=122.24, samples=31 iops : min= 13, max= 47, avg=24.42, stdev= 7.69, samples=31 write: IOPS=24, BW=384KiB/s (393kB/s)(6032KiB/15708msec); 0 zone resets clat (usec): min=1338, max=117804, avg=20239.62, stdev=19034.66 lat (usec): min=1340, max=117806, avg=20242.82, stdev=19034.19 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 89], 99.50th=[ 105], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 159, max= 576, per=24.11%, avg=381.26, stdev=113.22, samples=31 iops : min= 9, max= 36, avg=23.23, stdev= 7.17, samples=31 lat (usec) : 50=0.39%, 100=4.04%, 250=3.12%, 500=0.65%, 750=0.13% lat (msec) : 2=0.39%, 4=6.38%, 10=14.58%, 20=28.39%, 50=36.33% lat (msec) : 100=5.21%, 250=0.39% cpu : usr=0.11%, sys=17.43%, ctx=1978, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154751: Thu Jun 11 19:36:28 2026 read: IOPS=23, BW=379KiB/s (388kB/s)(6032KiB/15907msec) clat (usec): min=41, max=120914, avg=21332.83, stdev=15218.47 lat (usec): min=42, max=120915, avg=21334.46, stdev=15217.63 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 75], 10.00th=[ 109], 20.00th=[ 11076], | 30.00th=[ 14353], 40.00th=[ 16909], 50.00th=[ 20317], 60.00th=[ 22938], | 70.00th=[ 26346], 80.00th=[ 31327], 90.00th=[ 38011], 95.00th=[ 46400], | 99.00th=[ 71828], 99.50th=[ 83362], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 127, max= 606, per=25.08%, avg=376.94, stdev=116.90, samples=31 iops : min= 7, max= 37, avg=22.97, stdev= 7.40, samples=31 write: IOPS=24, BW=393KiB/s (403kB/s)(6256KiB/15907msec); 0 zone resets clat (usec): min=1611, max=127917, avg=19763.86, stdev=18138.84 lat (usec): min=1612, max=127919, avg=19766.15, stdev=18139.21 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2507], 10.00th=[ 3884], 20.00th=[ 5473], | 30.00th=[ 7373], 40.00th=[ 9765], 50.00th=[ 13829], 60.00th=[ 18220], | 70.00th=[ 24249], 80.00th=[ 32637], 90.00th=[ 43779], 95.00th=[ 56886], | 99.00th=[ 81265], 99.50th=[ 96994], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 223, max= 736, per=24.86%, avg=393.10, stdev=103.04, samples=31 iops : min= 13, max= 46, avg=23.97, stdev= 6.52, samples=31 lat (usec) : 50=0.39%, 100=3.52%, 250=3.65% lat (msec) : 2=1.30%, 4=4.30%, 10=16.93%, 20=26.04%, 50=38.67% lat (msec) : 100=4.95%, 250=0.26% cpu : usr=0.10%, sys=17.22%, ctx=2042, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1503KiB/s (1539kB/s), 361KiB/s-398KiB/s (369kB/s-408kB/s), io=23.4MiB (24.5MB), run=15199-15933msec WRITE: bw=1582KiB/s (1620kB/s), 384KiB/s-419KiB/s (393kB/s-429kB/s), io=24.6MiB (25.8MB), run=15199-15933msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154752: Thu Jun 11 19:36:44 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(5920KiB/31694msec) clat (msec): min=5, max=156, avg=20.88, stdev=20.27 lat (msec): min=5, max=156, avg=20.88, stdev=20.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 39], 95.00th=[ 63], | 99.00th=[ 129], 99.50th=[ 144], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 447, per=24.49%, avg=184.68, stdev=99.91, samples=62 iops : min= 1, max= 27, avg=10.92, stdev= 6.24, samples=62 write: IOPS=12, BW=201KiB/s (206kB/s)(6368KiB/31694msec); 0 zone resets clat (msec): min=23, max=198, avg=60.10, stdev=28.20 lat (msec): min=23, max=198, avg=60.10, stdev=28.20 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 40], | 30.00th=[ 44], 40.00th=[ 49], 50.00th=[ 53], 60.00th=[ 58], | 70.00th=[ 66], 80.00th=[ 77], 90.00th=[ 97], 95.00th=[ 118], | 99.00th=[ 169], 99.50th=[ 197], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 383, per=25.26%, avg=200.34, stdev=87.74, samples=62 iops : min= 1, max= 23, avg=11.89, stdev= 5.60, samples=62 lat (msec) : 10=16.02%, 20=15.49%, 50=35.81%, 100=27.60%, 250=5.08% cpu : usr=0.09%, sys=4.37%, ctx=1543, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154753: Thu Jun 11 19:36:44 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(5744KiB/31739msec) clat (msec): min=4, max=173, avg=20.40, stdev=21.49 lat (msec): min=4, max=173, avg=20.41, stdev=21.49 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 41], 95.00th=[ 57], | 99.00th=[ 117], 99.50th=[ 157], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 32, max= 574, per=24.35%, avg=183.62, stdev=117.28, samples=61 iops : min= 2, max= 35, avg=10.85, stdev= 7.35, samples=61 write: IOPS=12, BW=206KiB/s (211kB/s)(6544KiB/31739msec); 0 zone resets clat (msec): min=23, max=219, avg=59.37, stdev=28.02 lat (msec): min=23, max=219, avg=59.37, stdev=28.02 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 30], 10.00th=[ 33], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 53], 60.00th=[ 59], | 70.00th=[ 65], 80.00th=[ 75], 90.00th=[ 95], 95.00th=[ 116], | 99.00th=[ 155], 99.50th=[ 159], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 63, max= 383, per=25.91%, avg=205.48, stdev=82.57, samples=62 iops : min= 3, max= 23, avg=12.21, stdev= 5.25, samples=62 lat (msec) : 10=15.49%, 20=17.32%, 50=35.16%, 100=26.95%, 250=5.08% cpu : usr=0.08%, sys=4.36%, ctx=1505, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154754: Thu Jun 11 19:36:44 2026 read: IOPS=12, BW=203KiB/s (207kB/s)(6256KiB/30884msec) clat (msec): min=4, max=151, avg=19.51, stdev=18.10 lat (msec): min=4, max=151, avg=19.51, stdev=18.10 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 56], | 99.00th=[ 88], 99.50th=[ 140], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 31, max= 734, per=27.48%, avg=207.20, stdev=127.29, samples=60 iops : min= 1, max= 45, avg=12.33, stdev= 7.93, samples=60 write: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30884msec); 0 zone resets clat (msec): min=24, max=185, avg=61.43, stdev=29.41 lat (msec): min=24, max=185, avg=61.43, stdev=29.41 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 32], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 61], | 70.00th=[ 69], 80.00th=[ 81], 90.00th=[ 105], 95.00th=[ 127], | 99.00th=[ 169], 99.50th=[ 180], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 383, per=24.58%, avg=194.92, stdev=86.10, samples=61 iops : min= 1, max= 23, avg=11.56, stdev= 5.47, samples=61 lat (msec) : 10=16.28%, 20=20.44%, 50=33.98%, 100=23.31%, 250=5.99% cpu : usr=0.06%, sys=4.51%, ctx=1577, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154755: Thu Jun 11 19:36:44 2026 read: IOPS=12, BW=193KiB/s (197kB/s)(6032KiB/31282msec) clat (msec): min=4, max=167, avg=21.18, stdev=19.81 lat (msec): min=4, max=167, avg=21.19, stdev=19.81 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 64], | 99.00th=[ 105], 99.50th=[ 112], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 31, max= 352, per=25.43%, avg=191.73, stdev=97.22, samples=62 iops : min= 1, max= 22, avg=11.35, stdev= 6.15, samples=62 write: IOPS=12, BW=200KiB/s (205kB/s)(6256KiB/31282msec); 0 zone resets clat (msec): min=20, max=234, avg=59.17, stdev=28.43 lat (msec): min=20, max=234, avg=59.17, stdev=28.43 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 53], 60.00th=[ 57], | 70.00th=[ 65], 80.00th=[ 77], 90.00th=[ 94], 95.00th=[ 109], | 99.00th=[ 169], 99.50th=[ 213], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 63, max= 415, per=25.28%, avg=200.44, stdev=88.53, samples=62 iops : min= 3, max= 25, avg=11.90, stdev= 5.61, samples=62 lat (msec) : 10=14.06%, 20=20.31%, 50=34.64%, 100=26.04%, 250=4.95% cpu : usr=0.09%, sys=4.64%, ctx=1637, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=755KiB/s (773kB/s), 181KiB/s-203KiB/s (185kB/s-207kB/s), io=23.4MiB (24.5MB), run=30884-31739msec WRITE: bw=794KiB/s (813kB/s), 195KiB/s-206KiB/s (200kB/s-211kB/s), io=24.6MiB (25.8MB), run=30884-31739msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154765: Thu Jun 11 19:36:55 2026 read: IOPS=1, BW=1912KiB/s (1958kB/s)(7168KiB/3748msec) clat (msec): min=74, max=1637, avg=390.40, stdev=560.83 lat (msec): min=74, max=1637, avg=390.40, stdev=560.83 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 111], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 155], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 405], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 1965, max= 6144, per=94.46%, avg=4062.67, stdev=2089.55, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 write: IOPS=1, BW=1366KiB/s (1399kB/s)(5120KiB/3748msec); 0 zone resets clat (msec): min=93, max=349, avg=184.33, stdev=101.57 lat (msec): min=93, max=349, avg=184.47, stdev=101.56 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1965, max= 6131, per=56.15%, avg=3381.33, stdev=2381.64, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=27.36%, ctx=745, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154766: Thu Jun 11 19:36:55 2026 read: IOPS=0, BW=430KiB/s (440kB/s)(2048KiB/4761msec) clat (msec): min=117, max=1964, avg=1041.13, stdev=1305.72 lat (msec): min=117, max=1964, avg=1041.13, stdev=1305.72 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 1972], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 1954, max= 2048, per=46.52%, avg=2001.00, stdev=66.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2151KiB/s (2202kB/s)(10.0MiB/4761msec); 0 zone resets clat (msec): min=103, max=414, avg=261.02, stdev=115.96 lat (msec): min=103, max=414, avg=261.12, stdev=115.97 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 138], | 30.00th=[ 163], 40.00th=[ 171], 50.00th=[ 239], 60.00th=[ 266], | 70.00th=[ 342], 80.00th=[ 384], 90.00th=[ 393], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2039, max= 6131, per=59.95%, avg=3610.20, stdev=1693.38, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=50.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=27.08%, ctx=663, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154767: Thu Jun 11 19:36:55 2026 read: IOPS=1, BW=1429KiB/s (1463kB/s)(6144KiB/4299msec) clat (usec): min=560, max=336264, avg=193669.72, stdev=110968.45 lat (usec): min=561, max=336265, avg=193671.01, stdev=110968.54 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[170918], | 30.00th=[170918], 40.00th=[187696], 50.00th=[187696], 60.00th=[223347], | 70.00th=[242222], 80.00th=[242222], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 2039, max= 5896, per=77.33%, avg=3326.00, stdev=2225.69, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1429KiB/s (1463kB/s)(6144KiB/4299msec); 0 zone resets clat (msec): min=97, max=1916, avg=514.69, stdev=712.21 lat (msec): min=97, max=1917, avg=514.83, stdev=712.18 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 197], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1954, max= 3453, per=38.04%, avg=2290.80, stdev=650.98, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=22.27%, ctx=430, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154768: Thu Jun 11 19:36:55 2026 read: IOPS=1, BW=1199KiB/s (1228kB/s)(5120KiB/4270msec) clat (usec): min=1194, max=333108, avg=181230.65, stdev=133959.63 lat (usec): min=1196, max=333110, avg=181232.05, stdev=133959.79 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1188], 10.00th=[ 1188], 20.00th=[ 1188], | 30.00th=[107480], 40.00th=[107480], 50.00th=[179307], 60.00th=[179307], | 70.00th=[287310], 80.00th=[287310], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2039, max= 6131, per=94.98%, avg=4085.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1679KiB/s (1719kB/s)(7168KiB/4270msec); 0 zone resets clat (msec): min=168, max=1817, avg=476.79, stdev=602.47 lat (msec): min=168, max=1817, avg=476.88, stdev=602.48 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 176], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 222], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 506], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 1715, max= 4079, per=45.59%, avg=2745.20, stdev=1157.17, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=22.65%, ctx=244, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4302KiB/s (4405kB/s), 430KiB/s-1912KiB/s (440kB/s-1958kB/s), io=20.0MiB (20.0MB), run=3748-4761msec WRITE: bw=6022KiB/s (6167kB/s), 1366KiB/s-2151KiB/s (1399kB/s-2202kB/s), io=28.0MiB (29.4MB), run=3748-4761msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154770: Thu Jun 11 19:36:55 2026 read: IOPS=1, BW=1511KiB/s (1547kB/s)(7168KiB/4744msec) clat (msec): min=54, max=1616, avg=459.42, stdev=561.23 lat (msec): min=54, max=1616, avg=459.42, stdev=561.23 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 83], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 255], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 751], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 2019, max= 4023, per=75.54%, avg=3026.25, stdev=1146.39, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1079KiB/s (1105kB/s)(5120KiB/4744msec); 0 zone resets clat (msec): min=187, max=435, avg=296.48, stdev=100.91 lat (msec): min=187, max=435, avg=296.58, stdev=100.91 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2015, max= 4047, per=48.03%, avg=2693.67, stdev=1172.02, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.51%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154771: Thu Jun 11 19:36:55 2026 read: IOPS=0, BW=404KiB/s (414kB/s)(2048KiB/5069msec) clat (msec): min=286, max=2167, avg=1226.94, stdev=1330.20 lat (msec): min=286, max=2167, avg=1226.94, stdev=1330.20 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 2007, max= 2019, per=50.25%, avg=2013.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2020KiB/s (2069kB/s)(10.0MiB/5069msec); 0 zone resets clat (msec): min=86, max=593, avg=246.92, stdev=181.95 lat (msec): min=86, max=593, avg=247.04, stdev=181.94 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 94], | 30.00th=[ 101], 40.00th=[ 104], 50.00th=[ 124], 60.00th=[ 213], | 70.00th=[ 292], 80.00th=[ 426], 90.00th=[ 439], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2019, max= 4047, per=60.02%, avg=3365.67, stdev=1166.27, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=8.11%, ctx=166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154772: Thu Jun 11 19:36:55 2026 read: IOPS=1, BW=1249KiB/s (1279kB/s)(6144KiB/4918msec) clat (msec): min=56, max=777, avg=276.41, stdev=310.77 lat (msec): min=56, max=777, avg=276.42, stdev=310.77 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 64], | 30.00th=[ 64], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 125], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2011, max= 2023, per=50.35%, avg=2017.00, stdev= 5.16, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1249KiB/s (1279kB/s)(6144KiB/4918msec); 0 zone resets clat (msec): min=109, max=2193, avg=520.16, stdev=825.67 lat (msec): min=109, max=2193, avg=520.27, stdev=825.68 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 159], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 2007, max= 4031, per=47.91%, avg=2687.00, stdev=1163.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.43%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154773: Thu Jun 11 19:36:55 2026 read: IOPS=0, BW=1002KiB/s (1026kB/s)(5120KiB/5112msec) clat (msec): min=47, max=430, avg=264.45, stdev=138.11 lat (msec): min=47, max=430, avg=264.45, stdev=138.12 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 2023, max= 4039, per=75.66%, avg=3031.00, stdev=1425.53, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1402KiB/s (1436kB/s)(7168KiB/5112msec); 0 zone resets clat (msec): min=76, max=2096, avg=503.10, stdev=734.49 lat (msec): min=76, max=2096, avg=503.22, stdev=734.49 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 85], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 184], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 693], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 4015, max= 4023, per=71.67%, avg=4019.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=41.67%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=6.03%, ctx=90, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4006KiB/s (4102kB/s), 404KiB/s-1511KiB/s (414kB/s-1547kB/s), io=20.0MiB (20.0MB), run=4744-5112msec WRITE: bw=5609KiB/s (5743kB/s), 1079KiB/s-2020KiB/s (1105kB/s-2069kB/s), io=28.0MiB (29.4MB), run=4744-5112msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=154780: Thu Jun 11 19:37:04 2026 read: IOPS=1, BW=4599KiB/s (4709kB/s)(12.0MiB/2672msec) clat (msec): min=406, max=1619, avg=877.02, stdev=650.99 lat (msec): min=406, max=1619, avg=877.02, stdev=650.99 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=31.82%, ctx=1688, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154782: Thu Jun 11 19:37:04 2026 read: IOPS=0, BW=1504KiB/s (1540kB/s)(4096KiB/2723msec) clat (nsec): min=1463.5M, max=1463.5M, avg=1463536344.00, stdev= 0.00 lat (nsec): min=1463.5M, max=1463.5M, avg=1463539365.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1469], 5.00th=[ 1469], 10.00th=[ 1469], 20.00th=[ 1469], | 30.00th=[ 1469], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3008KiB/s (3081kB/s)(8192KiB/2723msec); 0 zone resets clat (msec): min=402, max=838, avg=620.52, stdev=307.88 lat (msec): min=403, max=838, avg=621.04, stdev=307.90 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8159, max= 8159, per=67.81%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=22.34%, ctx=768, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154784: Thu Jun 11 19:37:04 2026 write: IOPS=1, BW=5540KiB/s (5673kB/s)(12.0MiB/2218msec); 0 zone resets clat (msec): min=271, max=1381, avg=727.14, stdev=581.01 lat (msec): min=272, max=1382, avg=727.66, stdev=581.09 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min=16157, max=16157, per=100.00%, avg=16157.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=13.08%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154786: Thu Jun 11 19:37:04 2026 write: IOPS=1, BW=5065KiB/s (5187kB/s)(12.0MiB/2426msec); 0 zone resets clat (msec): min=148, max=2088, avg=803.11, stdev=1113.28 lat (msec): min=149, max=2088, avg=803.54, stdev=1113.19 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min=11055, max=11055, per=91.87%, avg=11055.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=9.77%, ctx=88, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6017KiB/s (6161kB/s), 1504KiB/s-4599KiB/s (1540kB/s-4709kB/s), io=16.0MiB (16.8MB), run=2672-2723msec WRITE: bw=11.8MiB/s (12.3MB/s), 3008KiB/s-5540KiB/s (3081kB/s-5673kB/s), io=32.0MiB (33.6MB), run=2218-2723msec rand-rw: (groupid=0, jobs=1): err= 0: pid=154781: Thu Jun 11 19:37:04 2026 read: IOPS=1, BW=4524KiB/s (4633kB/s)(12.0MiB/2716msec) clat (msec): min=393, max=1797, avg=889.49, stdev=787.54 lat (msec): min=393, max=1797, avg=889.49, stdev=787.54 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.14%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154783: Thu Jun 11 19:37:04 2026 read: IOPS=0, BW=1365KiB/s (1398kB/s)(4096KiB/3001msec) clat (nsec): min=1740.5M, max=1740.5M, avg=1740460048.00, stdev= 0.00 lat (nsec): min=1740.5M, max=1740.5M, avg=1740462872.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1737], 5.00th=[ 1737], 10.00th=[ 1737], 20.00th=[ 1737], | 30.00th=[ 1737], 40.00th=[ 1737], 50.00th=[ 1737], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2730KiB/s (2795kB/s)(8192KiB/3001msec); 0 zone resets clat (msec): min=595, max=643, avg=619.34, stdev=33.74 lat (msec): min=595, max=643, avg=619.65, stdev=33.78 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8192, max= 8192, per=76.23%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.87%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154785: Thu Jun 11 19:37:04 2026 write: IOPS=0, BW=4030KiB/s (4127kB/s)(12.0MiB/3049msec); 0 zone resets clat (msec): min=237, max=2088, avg=996.76, stdev=969.14 lat (msec): min=237, max=2088, avg=997.18, stdev=969.25 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 8143, max= 8143, per=75.77%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=12.37%, ctx=92, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=154787: Thu Jun 11 19:37:04 2026 write: IOPS=1, BW=4821KiB/s (4936kB/s)(12.0MiB/2549msec); 0 zone resets clat (msec): min=119, max=2108, avg=844.65, stdev=1098.43 lat (msec): min=119, max=2108, avg=845.04, stdev=1098.39 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min=11538, max=11538, per=100.00%, avg=11538.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.08%, sys=8.83%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5460KiB/s (5591kB/s), 1365KiB/s-4524KiB/s (1398kB/s-4633kB/s), io=16.0MiB (16.8MB), run=2716-3001msec WRITE: bw=10.5MiB/s (11.0MB/s), 2730KiB/s-4821KiB/s (2795kB/s-4936kB/s), io=32.0MiB (33.6MB), run=2549-3049msec