== sanity test 398b: DIO and buffer IO race ============== 15:03:40 (1783969420) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.16029 s, 6.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178712: Mon Jul 13 15:06:35 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(5992KiB/144872msec) clat (usec): min=49, max=1071.5k, avg=55058.29, stdev=44000.59 lat (usec): min=50, max=1071.5k, avg=55064.40, stdev=43996.63 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 13698], 10.00th=[ 19530], | 20.00th=[ 27657], 30.00th=[ 34341], 40.00th=[ 40109], | 50.00th=[ 47449], 60.00th=[ 55837], 70.00th=[ 64750], | 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[ 119014], | 99.00th=[ 181404], 99.50th=[ 198181], 99.90th=[ 392168], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 103, per=25.19%, avg=41.06, stdev=18.76, samples=283 iops : min= 1, max= 25, avg= 9.60, stdev= 4.74, samples=283 write: IOPS=10, BW=43.5KiB/s (44.5kB/s)(6296KiB/144872msec); 0 zone resets clat (usec): min=1041, max=285691, avg=39530.13, stdev=42737.84 lat (usec): min=1042, max=285693, avg=39537.55, stdev=42741.31 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1336], 10.00th=[ 1467], 20.00th=[ 3425], | 30.00th=[ 7177], 40.00th=[ 15008], 50.00th=[ 26870], 60.00th=[ 37487], | 70.00th=[ 50594], 80.00th=[ 68682], 90.00th=[100140], 95.00th=[124257], | 99.00th=[185598], 99.50th=[196084], 99.90th=[263193], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 143, per=25.50%, avg=43.35, stdev=21.00, samples=282 iops : min= 1, max= 35, avg=10.17, stdev= 5.30, samples=282 lat (usec) : 50=0.07%, 100=1.60%, 250=0.07%, 1000=0.03% lat (msec) : 2=7.36%, 4=3.94%, 10=7.06%, 20=7.13%, 50=34.11% lat (msec) : 100=28.74%, 250=9.73%, 500=0.13%, 2000=0.03% cpu : usr=0.06%, sys=4.16%, ctx=6216, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178713: Mon Jul 13 15:06:35 2026 read: IOPS=10, BW=41.3KiB/s (42.3kB/s)(5940KiB/143664msec) clat (usec): min=37, max=943957, avg=54649.84, stdev=42616.70 lat (usec): min=38, max=943959, avg=54652.46, stdev=42616.69 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 14615], 10.00th=[ 19792], 20.00th=[ 26608], | 30.00th=[ 32900], 40.00th=[ 40109], 50.00th=[ 46924], 60.00th=[ 54264], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[123208], | 99.00th=[193987], 99.50th=[214959], 99.90th=[299893], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 103, per=25.43%, avg=41.44, stdev=18.08, samples=279 iops : min= 1, max= 25, avg= 9.69, stdev= 4.55, samples=279 write: IOPS=11, BW=44.2KiB/s (45.2kB/s)(6348KiB/143664msec); 0 zone resets clat (usec): min=776, max=306237, avg=39240.59, stdev=42672.04 lat (usec): min=777, max=306240, avg=39242.89, stdev=42671.67 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1336], 10.00th=[ 1516], 20.00th=[ 3884], | 30.00th=[ 7439], 40.00th=[ 16057], 50.00th=[ 27395], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[123208], | 99.00th=[189793], 99.50th=[231736], 99.90th=[278922], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 140, per=25.78%, avg=43.83, stdev=22.29, samples=282 iops : min= 1, max= 35, avg=10.30, stdev= 5.62, samples=282 lat (usec) : 50=0.13%, 100=1.20%, 250=0.13%, 500=0.03%, 1000=0.07% lat (msec) : 2=6.41%, 4=4.10%, 10=7.29%, 20=7.65%, 50=35.25% lat (msec) : 100=28.68%, 250=8.85%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.20%, ctx=6217, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178714: Mon Jul 13 15:06:35 2026 read: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6028KiB/146026msec) clat (usec): min=32, max=337322, avg=52920.93, stdev=36029.30 lat (usec): min=32, max=337323, avg=52927.52, stdev=36031.24 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 13304], 10.00th=[ 19006], 20.00th=[ 25560], | 30.00th=[ 31851], 40.00th=[ 38011], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[173016], 99.50th=[214959], 99.90th=[308282], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 135, per=25.12%, avg=40.94, stdev=18.21, samples=285 iops : min= 1, max= 33, avg= 9.57, stdev= 4.58, samples=285 write: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6260KiB/146026msec); 0 zone resets clat (usec): min=1018, max=1023.1k, avg=42224.34, stdev=50975.60 lat (usec): min=1019, max=1023.1k, avg=42226.40, stdev=50977.13 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1336], 10.00th=[ 1598], | 20.00th=[ 4228], 30.00th=[ 8094], 40.00th=[ 17433], | 50.00th=[ 28705], 60.00th=[ 40109], 70.00th=[ 53216], | 80.00th=[ 71828], 90.00th=[ 102237], 95.00th=[ 130548], | 99.00th=[ 198181], 99.50th=[ 225444], 99.90th=[ 337642], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 149, per=25.24%, avg=42.91, stdev=22.16, samples=282 iops : min= 1, max= 37, avg=10.07, stdev= 5.61, samples=282 lat (usec) : 50=0.42%, 100=1.11%, 250=0.23%, 500=0.07% lat (msec) : 2=5.96%, 4=3.97%, 10=7.23%, 20=7.98%, 50=35.51% lat (msec) : 100=27.80%, 250=9.47%, 500=0.23%, 2000=0.03% cpu : usr=0.06%, sys=4.12%, ctx=6198, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178715: Mon Jul 13 15:06:35 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6052KiB/147145msec) clat (usec): min=39, max=272320, avg=54251.84, stdev=37174.64 lat (usec): min=40, max=272321, avg=54253.38, stdev=37174.69 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9241], 10.00th=[ 17433], 20.00th=[ 26346], | 30.00th=[ 32900], 40.00th=[ 40109], 50.00th=[ 47449], 60.00th=[ 55313], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[100140], 95.00th=[121111], | 99.00th=[196084], 99.50th=[219153], 99.90th=[265290], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 103, per=25.20%, avg=41.07, stdev=18.65, samples=287 iops : min= 1, max= 25, avg= 9.60, stdev= 4.69, samples=287 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6236KiB/147145msec); 0 zone resets clat (usec): min=1101, max=1017.1k, avg=41645.56, stdev=50407.71 lat (usec): min=1102, max=1017.1k, avg=41647.20, stdev=50407.80 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1352], 10.00th=[ 1827], | 20.00th=[ 4621], 30.00th=[ 8586], 40.00th=[ 16909], | 50.00th=[ 27919], 60.00th=[ 38536], 70.00th=[ 53216], | 80.00th=[ 71828], 90.00th=[ 102237], 95.00th=[ 128451], | 99.00th=[ 185598], 99.50th=[ 240124], 99.90th=[ 325059], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 159, per=24.82%, avg=42.19, stdev=21.73, samples=288 iops : min= 1, max= 39, avg= 9.89, stdev= 5.46, samples=288 lat (usec) : 50=0.23%, 100=1.95%, 250=0.13% lat (msec) : 2=5.47%, 4=3.91%, 10=7.52%, 20=8.85%, 50=32.78% lat (msec) : 100=29.07%, 250=9.83%, 500=0.23%, 2000=0.03% cpu : usr=0.06%, sys=4.25%, ctx=6292, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 41.1KiB/s-41.4KiB/s (42.1kB/s-42.4kB/s), io=23.4MiB (24.6MB), run=143664-147145msec WRITE: bw=171KiB/s (175kB/s), 42.4KiB/s-44.2KiB/s (43.4kB/s-45.2kB/s), io=24.6MiB (25.7MB), run=143664-147145msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178707: Mon Jul 13 15:07:15 2026 read: IOPS=7, BW=31.9KiB/s (32.7kB/s)(5992KiB/187886msec) clat (msec): min=5, max=1516, avg=49.64, stdev=62.10 lat (msec): min=5, max=1516, avg=49.67, stdev=62.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 72], 90.00th=[ 116], 95.00th=[ 159], | 99.00th=[ 239], 99.50th=[ 255], 99.90th=[ 447], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7, max= 150, per=26.43%, avg=33.56, stdev=25.97, samples=347 iops : min= 1, max= 37, avg= 7.73, stdev= 6.52, samples=347 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6296KiB/187886msec); 0 zone resets clat (msec): min=12, max=492, avg=71.75, stdev=58.37 lat (msec): min=12, max=492, avg=71.75, stdev=58.37 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 63], | 70.00th=[ 84], 80.00th=[ 110], 90.00th=[ 150], 95.00th=[ 190], | 99.00th=[ 279], 99.50th=[ 317], 99.90th=[ 380], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 151, per=25.53%, avg=33.96, stdev=25.38, samples=360 iops : min= 1, max= 37, avg= 7.83, stdev= 6.37, samples=360 lat (msec) : 10=2.25%, 20=15.92%, 50=42.35%, 100=21.45%, 250=16.93% lat (msec) : 500=1.07%, 2000=0.03% cpu : usr=0.05%, sys=1.74%, ctx=4961, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178708: Mon Jul 13 15:07:15 2026 read: IOPS=7, BW=31.8KiB/s (32.5kB/s)(5940KiB/187053msec) clat (msec): min=6, max=1379, avg=47.74, stdev=57.45 lat (msec): min=6, max=1379, avg=47.74, stdev=57.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 71], 90.00th=[ 111], 95.00th=[ 148], | 99.00th=[ 222], 99.50th=[ 271], 99.90th=[ 347], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 119, per=26.43%, avg=33.57, stdev=25.67, samples=343 iops : min= 1, max= 29, avg= 7.73, stdev= 6.45, samples=343 write: IOPS=8, BW=33.9KiB/s (34.8kB/s)(6348KiB/187053msec); 0 zone resets clat (msec): min=10, max=480, avg=72.84, stdev=59.97 lat (msec): min=10, max=480, avg=72.85, stdev=59.97 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 52], 60.00th=[ 65], | 70.00th=[ 85], 80.00th=[ 110], 90.00th=[ 155], 95.00th=[ 194], | 99.00th=[ 284], 99.50th=[ 351], 99.90th=[ 397], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 134, per=26.05%, avg=34.64, stdev=25.85, samples=356 iops : min= 1, max= 33, avg= 8.00, stdev= 6.50, samples=356 lat (msec) : 10=1.99%, 20=16.18%, 50=41.24%, 100=22.75%, 250=16.67% lat (msec) : 500=1.14%, 2000=0.03% cpu : usr=0.05%, sys=1.74%, ctx=5000, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178709: Mon Jul 13 15:07:15 2026 read: IOPS=8, BW=32.2KiB/s (32.9kB/s)(6028KiB/187350msec) clat (msec): min=5, max=353, avg=48.53, stdev=49.87 lat (msec): min=5, max=353, avg=48.53, stdev=49.87 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 71], 90.00th=[ 113], 95.00th=[ 161], | 99.00th=[ 245], 99.50th=[ 279], 99.90th=[ 342], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 143, per=26.28%, avg=33.38, stdev=26.23, samples=351 iops : min= 1, max= 35, avg= 7.69, stdev= 6.60, samples=351 write: IOPS=8, BW=33.4KiB/s (34.2kB/s)(6260KiB/187350msec); 0 zone resets clat (msec): min=12, max=1424, avg=72.64, stdev=67.19 lat (msec): min=12, max=1424, avg=72.64, stdev=67.19 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 63], | 70.00th=[ 85], 80.00th=[ 112], 90.00th=[ 155], 95.00th=[ 194], | 99.00th=[ 275], 99.50th=[ 330], 99.90th=[ 489], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 158, per=25.24%, avg=33.57, stdev=26.16, samples=362 iops : min= 1, max= 39, avg= 7.74, stdev= 6.56, samples=362 lat (msec) : 10=2.80%, 20=15.36%, 50=42.61%, 100=21.00%, 250=16.99% lat (msec) : 500=1.20%, 2000=0.03% cpu : usr=0.04%, sys=1.72%, ctx=4840, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178710: Mon Jul 13 15:07:15 2026 read: IOPS=8, BW=32.3KiB/s (33.0kB/s)(6052KiB/187580msec) clat (msec): min=5, max=454, avg=48.44, stdev=48.68 lat (msec): min=5, max=454, avg=48.44, stdev=48.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 39], | 70.00th=[ 52], 80.00th=[ 74], 90.00th=[ 113], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 255], 99.90th=[ 388], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 142, per=26.60%, avg=33.78, stdev=26.70, samples=347 iops : min= 1, max= 35, avg= 7.79, stdev= 6.71, samples=347 write: IOPS=8, BW=33.2KiB/s (34.0kB/s)(6236KiB/187580msec); 0 zone resets clat (msec): min=10, max=1426, avg=72.96, stdev=66.63 lat (msec): min=10, max=1426, avg=72.96, stdev=66.63 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 52], 60.00th=[ 68], | 70.00th=[ 87], 80.00th=[ 110], 90.00th=[ 146], 95.00th=[ 190], | 99.00th=[ 288], 99.50th=[ 313], 99.90th=[ 518], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 134, per=25.32%, avg=33.68, stdev=24.72, samples=358 iops : min= 1, max= 33, avg= 7.77, stdev= 6.21, samples=358 lat (msec) : 10=2.51%, 20=15.56%, 50=40.62%, 100=22.72%, 250=17.58% lat (msec) : 500=0.94%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.78%, ctx=5004, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (131kB/s), 31.8KiB/s-32.3KiB/s (32.5kB/s-33.0kB/s), io=23.4MiB (24.6MB), run=187053-187886msec WRITE: bw=134KiB/s (137kB/s), 33.2KiB/s-33.9KiB/s (34.0kB/s-34.8kB/s), io=24.6MiB (25.7MB), run=187053-187886msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178761: Mon Jul 13 15:07:57 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5920KiB/32352msec) clat (usec): min=36, max=166778, avg=44446.78, stdev=29071.04 lat (usec): min=36, max=166778, avg=44452.10, stdev=29073.19 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 77], 20.00th=[ 23462], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 65274], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[123208], 99.50th=[156238], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 61, max= 475, per=25.25%, avg=183.03, stdev=82.22, samples=63 iops : min= 3, max= 29, avg=10.73, stdev= 5.19, samples=63 write: IOPS=12, BW=197KiB/s (202kB/s)(6368KiB/32352msec); 0 zone resets clat (usec): min=1515, max=195740, avg=39850.75, stdev=39045.46 lat (usec): min=1516, max=195743, avg=39852.85, stdev=39045.49 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2024], 10.00th=[ 3097], 20.00th=[ 5866], | 30.00th=[ 11863], 40.00th=[ 18744], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[125305], | 99.00th=[179307], 99.50th=[189793], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 442, per=25.80%, avg=196.86, stdev=83.22, samples=63 iops : min= 1, max= 27, avg=11.62, stdev= 5.25, samples=63 lat (usec) : 50=0.65%, 100=4.82%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.08%, 4=4.95%, 10=7.29%, 20=8.98%, 50=36.20% lat (msec) : 100=27.99%, 250=6.51% cpu : usr=0.07%, sys=5.38%, ctx=1760, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178762: Mon Jul 13 15:07:57 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(5744KiB/33022msec) clat (usec): min=40, max=141791, avg=48179.65, stdev=29362.44 lat (usec): min=41, max=141792, avg=48181.14, stdev=29362.59 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 62], 10.00th=[ 13566], 20.00th=[ 26084], | 30.00th=[ 32375], 40.00th=[ 38011], 50.00th=[ 43779], 60.00th=[ 51119], | 70.00th=[ 58983], 80.00th=[ 72877], 90.00th=[ 87557], 95.00th=[101188], | 99.00th=[139461], 99.50th=[141558], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 31, max= 351, per=24.04%, avg=174.32, stdev=68.28, samples=63 iops : min= 1, max= 21, avg=10.21, stdev= 4.33, samples=63 write: IOPS=12, BW=198KiB/s (203kB/s)(6544KiB/33022msec); 0 zone resets clat (usec): min=1446, max=197960, avg=38326.48, stdev=37361.89 lat (usec): min=1448, max=197962, avg=38329.11, stdev=37362.00 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1926], 10.00th=[ 2540], 20.00th=[ 5211], | 30.00th=[ 10683], 40.00th=[ 18482], 50.00th=[ 26870], 60.00th=[ 39060], | 70.00th=[ 48497], 80.00th=[ 65274], 90.00th=[ 92799], 95.00th=[115868], | 99.00th=[143655], 99.50th=[185598], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 60, max= 411, per=25.40%, avg=193.81, stdev=78.47, samples=64 iops : min= 3, max= 25, avg=11.42, stdev= 4.93, samples=64 lat (usec) : 50=0.26%, 100=3.39%, 250=0.39% lat (msec) : 2=3.52%, 4=4.95%, 10=7.16%, 20=8.72%, 50=36.59% lat (msec) : 100=28.65%, 250=6.38% cpu : usr=0.07%, sys=5.41%, ctx=1749, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178763: Mon Jul 13 15:07:57 2026 read: IOPS=12, BW=193KiB/s (197kB/s)(6256KiB/32439msec) clat (usec): min=40, max=224122, avg=46445.08, stdev=32940.35 lat (usec): min=40, max=224124, avg=46446.40, stdev=32940.31 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 5276], 20.00th=[ 23725], | 30.00th=[ 30016], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 47449], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[191890], 99.50th=[221250], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 30, max= 351, per=26.56%, avg=192.54, stdev=77.61, samples=63 iops : min= 1, max= 21, avg=11.33, stdev= 4.86, samples=63 write: IOPS=11, BW=186KiB/s (190kB/s)(6032KiB/32439msec); 0 zone resets clat (usec): min=1487, max=251793, avg=37782.29, stdev=38959.34 lat (usec): min=1488, max=251795, avg=37798.96, stdev=38948.99 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1975], 10.00th=[ 2900], 20.00th=[ 6325], | 30.00th=[ 10945], 40.00th=[ 16581], 50.00th=[ 26608], 60.00th=[ 33817], | 70.00th=[ 49021], 80.00th=[ 63177], 90.00th=[ 85459], 95.00th=[114820], | 99.00th=[181404], 99.50th=[217056], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 348, per=23.95%, avg=182.71, stdev=82.09, samples=63 iops : min= 1, max= 21, avg=10.71, stdev= 5.16, samples=63 lat (usec) : 50=0.39%, 100=4.30%, 250=0.26%, 500=0.13% lat (msec) : 2=2.86%, 4=3.52%, 10=8.07%, 20=10.55%, 50=35.81% lat (msec) : 100=27.86%, 250=6.12%, 500=0.13% cpu : usr=0.06%, sys=5.07%, ctx=1669, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178764: Mon Jul 13 15:07:57 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(6032KiB/31396msec) clat (usec): min=40, max=202221, avg=44864.87, stdev=31371.76 lat (usec): min=41, max=202222, avg=44866.20, stdev=31371.80 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 76], 20.00th=[ 23462], | 30.00th=[ 29754], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[154141], 99.50th=[175113], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 414, per=26.20%, avg=189.92, stdev=82.02, samples=61 iops : min= 1, max= 25, avg=11.16, stdev= 5.12, samples=61 write: IOPS=12, BW=199KiB/s (204kB/s)(6256KiB/31396msec); 0 zone resets clat (usec): min=1219, max=342953, avg=36946.28, stdev=37161.06 lat (usec): min=1220, max=342956, avg=36952.34, stdev=37167.64 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2147], 10.00th=[ 3163], 20.00th=[ 5997], | 30.00th=[ 11994], 40.00th=[ 17957], 50.00th=[ 26346], 60.00th=[ 38011], | 70.00th=[ 48497], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[183501], 99.50th=[187696], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 62, max= 380, per=25.83%, avg=197.10, stdev=76.59, samples=61 iops : min= 3, max= 23, avg=11.62, stdev= 4.86, samples=61 lat (usec) : 50=0.65%, 100=4.82%, 250=0.52%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.95%, 4=4.69%, 10=6.90%, 20=10.29%, 50=36.20% lat (msec) : 100=28.52%, 250=4.69%, 500=0.13% cpu : usr=0.06%, sys=5.10%, ctx=1662, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=725KiB/s (743kB/s), 174KiB/s-193KiB/s (178kB/s-197kB/s), io=23.4MiB (24.5MB), run=31396-33022msec WRITE: bw=763KiB/s (781kB/s), 186KiB/s-199KiB/s (190kB/s-204kB/s), io=24.6MiB (25.8MB), run=31396-33022msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178756: Mon Jul 13 15:08:09 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5920KiB/44910msec) clat (msec): min=6, max=319, avg=48.38, stdev=44.55 lat (msec): min=6, max=319, avg=48.39, stdev=44.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 100], 95.00th=[ 138], | 99.00th=[ 239], 99.50th=[ 243], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 478, per=24.96%, avg=133.05, stdev=87.34, samples=86 iops : min= 1, max= 29, avg= 7.47, stdev= 5.49, samples=86 write: IOPS=8, BW=142KiB/s (145kB/s)(6368KiB/44910msec); 0 zone resets clat (msec): min=9, max=335, avg=67.57, stdev=49.66 lat (msec): min=9, max=335, avg=67.57, stdev=49.66 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 75], 80.00th=[ 96], 90.00th=[ 128], 95.00th=[ 180], | 99.00th=[ 257], 99.50th=[ 326], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 383, per=25.64%, avg=143.83, stdev=83.90, samples=86 iops : min= 1, max= 23, avg= 8.14, stdev= 5.28, samples=86 lat (msec) : 10=1.69%, 20=9.90%, 50=46.88%, 100=27.60%, 250=13.15% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=1.98%, ctx=1232, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178757: Mon Jul 13 15:08:09 2026 read: IOPS=8, BW=128KiB/s (132kB/s)(5744KiB/44726msec) clat (msec): min=6, max=240, avg=46.09, stdev=37.26 lat (msec): min=6, max=240, avg=46.11, stdev=37.28 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 53], 80.00th=[ 67], 90.00th=[ 97], 95.00th=[ 121], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 447, per=24.70%, avg=131.67, stdev=82.40, samples=85 iops : min= 1, max= 27, avg= 7.38, stdev= 5.18, samples=85 write: IOPS=9, BW=146KiB/s (150kB/s)(6544KiB/44726msec); 0 zone resets clat (msec): min=11, max=238, avg=68.71, stdev=45.04 lat (msec): min=11, max=238, avg=68.71, stdev=45.04 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 79], 80.00th=[ 108], 90.00th=[ 138], 95.00th=[ 161], | 99.00th=[ 224], 99.50th=[ 232], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 29, max= 412, per=26.59%, avg=149.19, stdev=81.14, samples=86 iops : min= 1, max= 25, avg= 8.49, stdev= 5.13, samples=86 lat (msec) : 10=1.17%, 20=9.38%, 50=45.96%, 100=27.86%, 250=15.63% cpu : usr=0.05%, sys=1.84%, ctx=1215, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178758: Mon Jul 13 15:08:09 2026 read: IOPS=8, BW=141KiB/s (145kB/s)(6256KiB/44238msec) clat (msec): min=7, max=242, avg=46.33, stdev=40.53 lat (msec): min=7, max=242, avg=46.34, stdev=40.54 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 99], 95.00th=[ 133], | 99.00th=[ 220], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 30, max= 479, per=27.16%, avg=144.74, stdev=94.07, samples=85 iops : min= 1, max= 29, avg= 8.20, stdev= 5.92, samples=85 write: IOPS=8, BW=136KiB/s (140kB/s)(6032KiB/44238msec); 0 zone resets clat (msec): min=16, max=354, avg=68.79, stdev=47.07 lat (msec): min=16, max=354, avg=68.79, stdev=47.07 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 80], 80.00th=[ 100], 90.00th=[ 128], 95.00th=[ 148], | 99.00th=[ 288], 99.50th=[ 313], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 383, per=24.95%, avg=139.96, stdev=76.44, samples=84 iops : min= 1, max= 23, avg= 7.90, stdev= 4.83, samples=84 lat (msec) : 10=0.65%, 20=10.29%, 50=47.27%, 100=27.34%, 250=13.93% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.85%, ctx=1174, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178759: Mon Jul 13 15:08:09 2026 read: IOPS=8, BW=135KiB/s (138kB/s)(6032KiB/44693msec) clat (msec): min=7, max=254, avg=47.33, stdev=39.88 lat (msec): min=7, max=254, avg=47.33, stdev=39.88 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 247], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 447, per=25.36%, avg=135.15, stdev=82.09, samples=87 iops : min= 1, max= 27, avg= 7.60, stdev= 5.16, samples=87 write: IOPS=8, BW=140KiB/s (143kB/s)(6256KiB/44693msec); 0 zone resets clat (msec): min=14, max=360, avg=68.13, stdev=49.39 lat (msec): min=14, max=360, avg=68.13, stdev=49.40 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 101], 90.00th=[ 130], 95.00th=[ 159], | 99.00th=[ 264], 99.50th=[ 330], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 446, per=24.91%, avg=139.74, stdev=84.86, samples=88 iops : min= 1, max= 27, avg= 7.89, stdev= 5.34, samples=88 lat (msec) : 10=1.17%, 20=10.55%, 50=46.74%, 100=27.08%, 250=13.80% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.90%, ctx=1195, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=533KiB/s (546kB/s), 128KiB/s-141KiB/s (132kB/s-145kB/s), io=23.4MiB (24.5MB), run=44238-44910msec WRITE: bw=561KiB/s (575kB/s), 136KiB/s-146KiB/s (140kB/s-150kB/s), io=24.6MiB (25.8MB), run=44238-44910msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178784: Mon Jul 13 15:08:23 2026 read: IOPS=2, BW=2455KiB/s (2514kB/s)(7168KiB/2920msec) clat (usec): min=745, max=279294, avg=161714.19, stdev=86769.32 lat (usec): min=746, max=279295, avg=161715.62, stdev=86769.53 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[114820], | 30.00th=[156238], 40.00th=[156238], 50.00th=[181404], 60.00th=[196084], | 70.00th=[196084], 80.00th=[200279], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2043, max= 4117, per=70.19%, avg=3405.00, stdev=1179.93, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1753KiB/s (1796kB/s)(5120KiB/2920msec); 0 zone resets clat (msec): min=99, max=637, avg=340.80, stdev=219.89 lat (msec): min=100, max=638, avg=341.92, stdev=218.83 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2027, max= 3984, per=37.17%, avg=2524.25, stdev=973.20, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=15.52%, ctx=229, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178785: Mon Jul 13 15:08:23 2026 read: IOPS=0, BW=485KiB/s (497kB/s)(2048KiB/4221msec) clat (usec): min=607, max=216311, avg=108459.24, stdev=152525.73 lat (usec): min=608, max=216313, avg=108461.03, stdev=152526.69 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 611], 50.00th=[ 611], 60.00th=[217056], | 70.00th=[217056], 80.00th=[217056], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 1412, max= 1878, per=33.91%, avg=1645.00, stdev=329.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2426KiB/s (2484kB/s)(10.0MiB/4221msec); 0 zone resets clat (msec): min=69, max=1037, avg=385.25, stdev=284.11 lat (msec): min=69, max=1037, avg=385.36, stdev=284.09 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 114], | 30.00th=[ 199], 40.00th=[ 275], 50.00th=[ 292], 60.00th=[ 372], | 70.00th=[ 409], 80.00th=[ 435], 90.00th=[ 651], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1878, max= 6083, per=51.52%, avg=3499.00, stdev=1972.11, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=14.08%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178786: Mon Jul 13 15:08:23 2026 read: IOPS=2, BW=2098KiB/s (2148kB/s)(6144KiB/2929msec) clat (usec): min=545, max=308620, avg=164841.77, stdev=126364.65 lat (usec): min=546, max=308621, avg=164842.83, stdev=126364.65 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 61604], | 30.00th=[ 61604], 40.00th=[132645], 50.00th=[132645], 60.00th=[179307], | 70.00th=[308282], 80.00th=[308282], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 2043, max= 4055, per=69.28%, avg=3360.67, stdev=1141.68, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2098KiB/s (2148kB/s)(6144KiB/2929msec); 0 zone resets clat (msec): min=112, max=581, avg=277.26, stdev=171.80 lat (msec): min=112, max=581, avg=277.36, stdev=171.80 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 249], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1992, max= 2888, per=32.37%, avg=2198.60, stdev=385.95, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=17.49%, ctx=243, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178787: Mon Jul 13 15:08:23 2026 read: IOPS=1, BW=1363KiB/s (1396kB/s)(5120KiB/3756msec) clat (usec): min=582, max=319479, avg=156393.22, stdev=152688.39 lat (usec): min=583, max=319479, avg=156394.37, stdev=152688.13 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 586], | 30.00th=[ 734], 40.00th=[ 734], 50.00th=[170918], 60.00th=[170918], | 70.00th=[291505], 80.00th=[291505], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 4087, max= 4087, per=84.25%, avg=4087.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1908KiB/s (1954kB/s)(7168KiB/3756msec); 0 zone resets clat (msec): min=209, max=576, avg=402.99, stdev=130.44 lat (msec): min=209, max=577, avg=403.09, stdev=130.44 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 271], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 397], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 502], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1464, max= 2043, per=27.69%, avg=1880.80, stdev=241.75, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=16.67%, 500=50.00%, 750=16.67% cpu : usr=0.05%, sys=12.81%, ctx=174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4852KiB/s (4968kB/s), 485KiB/s-2455KiB/s (497kB/s-2514kB/s), io=20.0MiB (20.0MB), run=2920-4221msec WRITE: bw=6793KiB/s (6956kB/s), 1753KiB/s-2426KiB/s (1796kB/s-2484kB/s), io=28.0MiB (29.4MB), run=2920-4221msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178779: Mon Jul 13 15:08:23 2026 read: IOPS=2, BW=2101KiB/s (2151kB/s)(7168KiB/3412msec) clat (msec): min=119, max=302, avg=195.16, stdev=73.18 lat (msec): min=119, max=302, avg=195.16, stdev=73.18 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 129], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 184], 60.00th=[ 205], | 70.00th=[ 205], 80.00th=[ 284], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1976, max= 4748, per=75.66%, avg=3593.00, stdev=1442.59, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1501KiB/s (1537kB/s)(5120KiB/3412msec); 0 zone resets clat (msec): min=207, max=882, avg=384.98, stdev=287.10 lat (msec): min=207, max=882, avg=385.06, stdev=287.10 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1921, max= 3953, per=39.49%, avg=2625.67, stdev=1150.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=25.00%, 1000=8.33% cpu : usr=0.03%, sys=5.39%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178780: Mon Jul 13 15:08:23 2026 read: IOPS=0, BW=475KiB/s (486kB/s)(2048KiB/4312msec) clat (msec): min=154, max=212, avg=183.70, stdev=40.93 lat (msec): min=154, max=212, avg=183.70, stdev=40.92 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 213], 95.00th=[ 213], | 99.00th=[ 213], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 1544, max= 1976, per=37.06%, avg=1760.00, stdev=305.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2375KiB/s (2432kB/s)(10.0MiB/4312msec); 0 zone resets clat (msec): min=96, max=671, avg=375.97, stdev=196.05 lat (msec): min=96, max=671, avg=376.06, stdev=196.05 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 192], | 30.00th=[ 199], 40.00th=[ 243], 50.00th=[ 309], 60.00th=[ 447], | 70.00th=[ 460], 80.00th=[ 535], 90.00th=[ 609], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2003, max= 4087, per=45.36%, avg=3015.67, stdev=1087.90, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=5.68%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178781: Mon Jul 13 15:08:23 2026 read: IOPS=1, BW=1459KiB/s (1494kB/s)(6144KiB/4212msec) clat (msec): min=71, max=1197, avg=355.30, stdev=437.51 lat (msec): min=71, max=1197, avg=355.30, stdev=437.51 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 188], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 3842, max= 3953, per=82.07%, avg=3897.50, stdev=78.49, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1459KiB/s (1494kB/s)(6144KiB/4212msec); 0 zone resets clat (msec): min=138, max=510, avg=343.51, stdev=149.26 lat (msec): min=138, max=510, avg=343.61, stdev=149.25 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 426], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1921, max= 3160, per=34.41%, avg=2287.75, stdev=584.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=5.51%, ctx=74, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178782: Mon Jul 13 15:08:23 2026 read: IOPS=1, BW=1285KiB/s (1316kB/s)(5120KiB/3983msec) clat (msec): min=121, max=457, avg=280.53, stdev=163.13 lat (msec): min=121, max=457, avg=280.53, stdev=163.13 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2027, max= 4007, per=56.73%, avg=2694.00, stdev=1137.14, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1800KiB/s (1843kB/s)(7168KiB/3983msec); 0 zone resets clat (msec): min=143, max=590, avg=342.56, stdev=194.51 lat (msec): min=143, max=590, avg=342.66, stdev=194.50 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 148], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 317], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1532, max= 6131, per=51.28%, avg=3409.75, stdev=2126.33, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=4.97%, ctx=180, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4750KiB/s (4864kB/s), 475KiB/s-2101KiB/s (486kB/s-2151kB/s), io=20.0MiB (20.0MB), run=3412-4312msec WRITE: bw=6649KiB/s (6809kB/s), 1459KiB/s-2375KiB/s (1494kB/s-2432kB/s), io=28.0MiB (29.4MB), run=3412-4312msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178794: Mon Jul 13 15:08:35 2026 read: IOPS=1, BW=4794KiB/s (4909kB/s)(12.0MiB/2563msec) clat (msec): min=763, max=864, avg=798.70, stdev=56.77 lat (msec): min=763, max=864, avg=798.70, stdev=56.78 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8000, max= 8062, per=100.00%, avg=8031.00, stdev=43.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=13.19%, ctx=263, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178795: Mon Jul 13 15:08:35 2026 read: IOPS=0, BW=1277KiB/s (1308kB/s)(4096KiB/3207msec) clat (nsec): min=776045k, max=776045k, avg=776045276.00, stdev= 0.00 lat (nsec): min=776048k, max=776048k, avg=776048373.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2554KiB/s (2616kB/s)(8192KiB/3207msec); 0 zone resets clat (msec): min=637, max=1733, avg=1185.57, stdev=775.54 lat (msec): min=637, max=1734, avg=1185.88, stdev=775.53 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8192, max= 8192, per=80.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.43%, ctx=140, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178797: Mon Jul 13 15:08:35 2026 write: IOPS=1, BW=4703KiB/s (4816kB/s)(12.0MiB/2613msec); 0 zone resets clat (msec): min=296, max=1158, avg=861.25, stdev=489.34 lat (msec): min=296, max=1158, avg=861.71, stdev=489.40 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8159, max= 8192, per=80.02%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.86%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178799: Mon Jul 13 15:08:35 2026 write: IOPS=1, BW=4496KiB/s (4604kB/s)(12.0MiB/2733msec); 0 zone resets clat (msec): min=434, max=1662, avg=877.31, stdev=681.52 lat (msec): min=435, max=1662, avg=878.57, stdev=680.88 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 6095, max= 8062, per=69.28%, avg=7078.50, stdev=1390.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.84%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5109KiB/s (5231kB/s), 1277KiB/s-4794KiB/s (1308kB/s-4909kB/s), io=16.0MiB (16.8MB), run=2563-3207msec WRITE: bw=9.98MiB/s (10.5MB/s), 2554KiB/s-4703KiB/s (2616kB/s-4816kB/s), io=32.0MiB (33.6MB), run=2613-3207msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178796: Mon Jul 13 15:08:36 2026 read: IOPS=0, BW=2957KiB/s (3028kB/s)(12.0MiB/4155msec) clat (msec): min=460, max=1879, avg=1318.09, stdev=754.21 lat (msec): min=460, max=1879, avg=1318.10, stdev=754.21 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 7937, max= 8110, per=100.00%, avg=8023.50, stdev=122.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.14%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178798: Mon Jul 13 15:08:36 2026 read: IOPS=0, BW=1042KiB/s (1067kB/s)(4096KiB/3930msec) clat (nsec): min=2233.4M, max=2233.4M, avg=2233402119.00, stdev= 0.00 lat (nsec): min=2233.4M, max=2233.4M, avg=2233404715.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2232], 5.00th=[ 2232], 10.00th=[ 2232], 20.00th=[ 2232], | 30.00th=[ 2232], 40.00th=[ 2232], 50.00th=[ 2232], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 7831, max= 7831, per=100.00%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2084KiB/s (2135kB/s)(8192KiB/3930msec); 0 zone resets clat (msec): min=271, max=1192, avg=731.82, stdev=651.03 lat (msec): min=271, max=1192, avg=732.12, stdev=651.18 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8078, max= 8078, per=96.89%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.44%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178800: Mon Jul 13 15:08:36 2026 write: IOPS=0, BW=3309KiB/s (3389kB/s)(12.0MiB/3713msec); 0 zone resets clat (msec): min=389, max=1768, avg=1219.80, stdev=731.20 lat (msec): min=390, max=1768, avg=1220.72, stdev=731.48 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8062, max= 8126, per=97.09%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.21%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178801: Mon Jul 13 15:08:36 2026 write: IOPS=0, BW=3941KiB/s (4036kB/s)(12.0MiB/3118msec); 0 zone resets clat (msec): min=275, max=1784, avg=981.92, stdev=759.15 lat (msec): min=275, max=1784, avg=982.23, stdev=759.15 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8015, max= 8015, per=96.14%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.82%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3943KiB/s (4038kB/s), 1042KiB/s-2957KiB/s (1067kB/s-3028kB/s), io=16.0MiB (16.8MB), run=3930-4155msec WRITE: bw=8338KiB/s (8538kB/s), 2084KiB/s-3941KiB/s (2135kB/s-4036kB/s), io=32.0MiB (33.6MB), run=3118-3930msec