== sanity test 398b: DIO and buffer IO race ============== 08:37:25 (1787143045) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.19666 s, 6.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178994: Wed Aug 19 08:40:09 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(5992KiB/143169msec) clat (usec): min=45, max=381583, avg=52221.22, stdev=34887.33 lat (usec): min=46, max=381585, avg=52224.67, stdev=34886.75 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12780], 10.00th=[ 18220], 20.00th=[ 26346], | 30.00th=[ 31851], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 62129], 80.00th=[ 74974], 90.00th=[ 95945], 95.00th=[113771], | 99.00th=[177210], 99.50th=[191890], 99.90th=[287310], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 127, per=25.07%, avg=41.87, stdev=18.00, samples=278 iops : min= 1, max= 31, avg= 9.78, stdev= 4.51, samples=278 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6296KiB/143169msec); 0 zone resets clat (usec): min=810, max=335587, avg=41135.97, stdev=42057.16 lat (usec): min=811, max=335589, avg=41137.93, stdev=42057.04 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 1942], 20.00th=[ 4948], | 30.00th=[ 9634], 40.00th=[ 20055], 50.00th=[ 29230], 60.00th=[ 38011], | 70.00th=[ 51643], 80.00th=[ 71828], 90.00th=[102237], 95.00th=[123208], | 99.00th=[177210], 99.50th=[191890], 99.90th=[265290], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 119, per=24.77%, avg=43.35, stdev=20.22, samples=282 iops : min= 1, max= 29, avg=10.16, stdev= 5.08, samples=282 lat (usec) : 50=0.26%, 100=1.37%, 750=0.07%, 1000=0.03% lat (msec) : 2=5.24%, 4=3.52%, 10=6.71%, 20=9.08%, 50=37.08% lat (msec) : 100=26.79%, 250=9.67%, 500=0.20% cpu : usr=0.06%, sys=4.22%, ctx=6480, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178995: Wed Aug 19 08:40:09 2026 read: IOPS=10, BW=41.8KiB/s (42.8kB/s)(5940KiB/142166msec) clat (usec): min=47, max=337894, avg=53883.70, stdev=34793.34 lat (usec): min=47, max=337896, avg=53889.95, stdev=34791.51 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 16188], 10.00th=[ 20579], 20.00th=[ 27132], | 30.00th=[ 32900], 40.00th=[ 39060], 50.00th=[ 46400], 60.00th=[ 54264], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 96994], 95.00th=[117965], | 99.00th=[173016], 99.50th=[193987], 99.90th=[270533], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 87, per=24.89%, avg=41.56, stdev=17.03, samples=278 iops : min= 1, max= 21, avg= 9.70, stdev= 4.28, samples=278 write: IOPS=11, BW=44.7KiB/s (45.7kB/s)(6348KiB/142166msec); 0 zone resets clat (usec): min=1024, max=311140, avg=39055.18, stdev=40210.83 lat (usec): min=1024, max=311142, avg=39058.96, stdev=40209.76 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1352], 10.00th=[ 1598], 20.00th=[ 4555], | 30.00th=[ 8455], 40.00th=[ 18744], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 49546], 80.00th=[ 66323], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[173016], 99.50th=[191890], 99.90th=[270533], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 102, per=25.34%, avg=44.34, stdev=19.56, samples=278 iops : min= 1, max= 25, avg=10.40, stdev= 4.91, samples=278 lat (usec) : 50=0.13%, 100=1.14%, 250=0.07% lat (msec) : 2=5.89%, 4=3.65%, 10=7.36%, 20=7.85%, 50=36.69% lat (msec) : 100=28.52%, 250=8.53%, 500=0.20% cpu : usr=0.06%, sys=4.34%, ctx=6519, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178996: Wed Aug 19 08:40:09 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6028KiB/141475msec) clat (usec): min=48, max=327969, avg=52236.20, stdev=36446.54 lat (usec): min=49, max=327970, avg=52240.95, stdev=36443.26 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12649], 10.00th=[ 19792], 20.00th=[ 26084], | 30.00th=[ 32113], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 51643], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[196084], 99.50th=[233833], 99.90th=[320865], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 94, per=25.09%, avg=41.89, stdev=17.55, samples=278 iops : min= 1, max= 23, avg= 9.79, stdev= 4.41, samples=278 write: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6260KiB/141475msec); 0 zone resets clat (usec): min=876, max=257582, avg=39956.31, stdev=41041.87 lat (usec): min=877, max=257583, avg=39969.28, stdev=41042.37 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1336], 10.00th=[ 1680], 20.00th=[ 4490], | 30.00th=[ 8979], 40.00th=[ 19792], 50.00th=[ 28967], 60.00th=[ 38536], | 70.00th=[ 50070], 80.00th=[ 66847], 90.00th=[ 99091], 95.00th=[123208], | 99.00th=[179307], 99.50th=[225444], 99.90th=[250610], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 7, max= 116, per=24.85%, avg=43.49, stdev=20.47, samples=278 iops : min= 1, max= 29, avg=10.20, stdev= 5.16, samples=278 lat (usec) : 50=0.10%, 100=1.30%, 250=0.07%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.73%, 4=3.78%, 10=6.64%, 20=7.71%, 50=38.31% lat (msec) : 100=27.44%, 250=8.37%, 500=0.29% cpu : usr=0.06%, sys=4.27%, ctx=6389, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178997: Wed Aug 19 08:40:09 2026 read: IOPS=10, BW=42.2KiB/s (43.3kB/s)(6052KiB/143250msec) clat (usec): min=42, max=272188, avg=52544.88, stdev=33247.96 lat (usec): min=43, max=272189, avg=52547.02, stdev=33248.61 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 14484], 10.00th=[ 19792], 20.00th=[ 27132], | 30.00th=[ 33162], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 52691], | 70.00th=[ 62653], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[113771], | 99.00th=[162530], 99.50th=[191890], 99.90th=[254804], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 95, per=25.02%, avg=41.79, stdev=16.99, samples=281 iops : min= 1, max= 23, avg= 9.77, stdev= 4.27, samples=281 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6236KiB/143250msec); 0 zone resets clat (usec): min=903, max=259781, avg=40778.85, stdev=41245.20 lat (usec): min=904, max=259783, avg=40784.76, stdev=41242.71 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1860], 20.00th=[ 4555], | 30.00th=[ 9896], 40.00th=[ 20055], 50.00th=[ 29754], 60.00th=[ 39584], | 70.00th=[ 53216], 80.00th=[ 70779], 90.00th=[ 98042], 95.00th=[124257], | 99.00th=[183501], 99.50th=[204473], 99.90th=[242222], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 104, per=24.59%, avg=43.03, stdev=18.82, samples=281 iops : min= 1, max= 26, avg=10.08, stdev= 4.73, samples=281 lat (usec) : 50=0.20%, 100=1.27%, 250=0.07%, 1000=0.10% lat (msec) : 2=5.37%, 4=4.04%, 10=5.99%, 20=8.27%, 50=36.88% lat (msec) : 100=29.13%, 250=8.59%, 500=0.10% cpu : usr=0.06%, sys=4.32%, ctx=6475, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (172kB/s), 41.8KiB/s-42.6KiB/s (42.8kB/s-43.6kB/s), io=23.4MiB (24.6MB), run=141475-143250msec WRITE: bw=175KiB/s (180kB/s), 43.5KiB/s-44.7KiB/s (44.6kB/s-45.7kB/s), io=24.6MiB (25.7MB), run=141475-143250msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178989: Wed Aug 19 08:40:56 2026 read: IOPS=7, BW=31.3KiB/s (32.1kB/s)(5992KiB/191284msec) clat (msec): min=5, max=993, avg=51.06, stdev=51.93 lat (msec): min=5, max=993, avg=51.06, stdev=51.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 71], 90.00th=[ 108], 95.00th=[ 150], | 99.00th=[ 245], 99.50th=[ 271], 99.90th=[ 414], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 133, per=25.35%, avg=31.69, stdev=21.67, samples=365 iops : min= 1, max= 33, avg= 7.25, stdev= 5.44, samples=365 write: IOPS=8, BW=32.9KiB/s (33.7kB/s)(6296KiB/191284msec); 0 zone resets clat (msec): min=11, max=391, avg=72.62, stdev=50.19 lat (msec): min=11, max=391, avg=72.62, stdev=50.19 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 107], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 266], 99.50th=[ 284], 99.90th=[ 342], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 126, per=25.02%, avg=32.78, stdev=19.96, samples=371 iops : min= 1, max= 31, avg= 7.52, stdev= 5.01, samples=371 lat (msec) : 10=1.30%, 20=10.51%, 50=42.87%, 100=27.70%, 250=16.50% lat (msec) : 500=1.07%, 1000=0.03% cpu : usr=0.04%, sys=1.82%, ctx=4895, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178990: Wed Aug 19 08:40:56 2026 read: IOPS=7, BW=31.4KiB/s (32.2kB/s)(5940KiB/188900msec) clat (msec): min=7, max=905, avg=47.67, stdev=46.23 lat (msec): min=7, max=905, avg=47.67, stdev=46.24 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 102], 95.00th=[ 133], | 99.00th=[ 207], 99.50th=[ 243], 99.90th=[ 430], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 127, per=25.87%, avg=32.34, stdev=21.86, samples=356 iops : min= 1, max= 31, avg= 7.41, stdev= 5.48, samples=356 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6348KiB/188900msec); 0 zone resets clat (msec): min=13, max=417, avg=74.10, stdev=52.06 lat (msec): min=13, max=417, avg=74.10, stdev=52.06 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 84], 80.00th=[ 110], 90.00th=[ 142], 95.00th=[ 174], | 99.00th=[ 271], 99.50th=[ 305], 99.90th=[ 388], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 111, per=25.42%, avg=33.30, stdev=19.47, samples=370 iops : min= 1, max= 27, avg= 7.65, stdev= 4.90, samples=370 lat (msec) : 10=0.88%, 20=11.26%, 50=42.61%, 100=28.13%, 250=16.18% lat (msec) : 500=0.91%, 1000=0.03% cpu : usr=0.05%, sys=1.74%, ctx=4825, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178991: Wed Aug 19 08:40:56 2026 read: IOPS=7, BW=31.5KiB/s (32.3kB/s)(6028KiB/191107msec) clat (msec): min=5, max=371, avg=50.76, stdev=42.96 lat (msec): min=5, max=371, avg=50.77, stdev=42.96 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 108], 95.00th=[ 142], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 300], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 119, per=25.42%, avg=31.77, stdev=19.94, samples=367 iops : min= 1, max= 29, avg= 7.27, stdev= 5.00, samples=367 write: IOPS=8, BW=32.8KiB/s (33.5kB/s)(6260KiB/191107msec); 0 zone resets clat (msec): min=10, max=927, avg=72.92, stdev=54.74 lat (msec): min=10, max=927, avg=72.93, stdev=54.73 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 83], 80.00th=[ 105], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 271], 99.50th=[ 300], 99.90th=[ 393], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 111, per=24.86%, avg=32.56, stdev=19.76, samples=372 iops : min= 1, max= 27, avg= 7.46, stdev= 4.97, samples=372 lat (msec) : 10=1.24%, 20=10.09%, 50=43.55%, 100=28.19%, 250=16.21% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.05%, sys=1.86%, ctx=5003, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178992: Wed Aug 19 08:40:56 2026 read: IOPS=7, BW=31.7KiB/s (32.5kB/s)(6052KiB/190755msec) clat (msec): min=5, max=428, avg=50.88, stdev=45.35 lat (msec): min=5, max=428, avg=50.88, stdev=45.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 72], 90.00th=[ 110], 95.00th=[ 144], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 422], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 119, per=25.85%, avg=32.32, stdev=21.66, samples=362 iops : min= 1, max= 29, avg= 7.41, stdev= 5.45, samples=362 write: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6236KiB/190755msec); 0 zone resets clat (msec): min=11, max=902, avg=72.66, stdev=55.83 lat (msec): min=11, max=902, avg=72.67, stdev=55.83 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 82], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 180], | 99.00th=[ 279], 99.50th=[ 309], 99.90th=[ 409], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 103, per=25.00%, avg=32.76, stdev=19.33, samples=368 iops : min= 1, max= 25, avg= 7.51, stdev= 4.86, samples=368 lat (msec) : 10=1.24%, 20=9.86%, 50=43.52%, 100=28.61%, 250=15.79% lat (msec) : 500=0.94%, 1000=0.03% cpu : usr=0.05%, sys=1.79%, ctx=4969, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=126KiB/s (129kB/s), 31.3KiB/s-31.7KiB/s (32.1kB/s-32.5kB/s), io=23.4MiB (24.6MB), run=188900-191284msec WRITE: bw=131KiB/s (135kB/s), 32.7KiB/s-33.6KiB/s (33.5kB/s-34.4kB/s), io=24.6MiB (25.7MB), run=188900-191284msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179045: Wed Aug 19 08:41:54 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5920KiB/44765msec) clat (usec): min=42, max=353558, avg=63568.03, stdev=44333.54 lat (usec): min=44, max=353559, avg=63570.42, stdev=44333.17 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 86], 10.00th=[ 20055], 20.00th=[ 30540], | 30.00th=[ 39584], 40.00th=[ 46924], 50.00th=[ 54789], 60.00th=[ 65799], | 70.00th=[ 79168], 80.00th=[ 91751], 90.00th=[114820], 95.00th=[145753], | 99.00th=[214959], 99.50th=[287310], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 286, per=25.55%, avg=132.62, stdev=51.71, samples=86 iops : min= 1, max= 17, avg= 7.45, stdev= 3.28, samples=86 write: IOPS=8, BW=142KiB/s (146kB/s)(6368KiB/44765msec); 0 zone resets clat (usec): min=1243, max=237523, avg=51939.09, stdev=49428.67 lat (usec): min=1245, max=237526, avg=51966.25, stdev=49429.74 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2114], 10.00th=[ 4047], 20.00th=[ 9634], | 30.00th=[ 15926], 40.00th=[ 24249], 50.00th=[ 37487], 60.00th=[ 49546], | 70.00th=[ 67634], 80.00th=[ 87557], 90.00th=[126354], 95.00th=[156238], | 99.00th=[200279], 99.50th=[202376], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 30, max= 317, per=26.93%, avg=147.04, stdev=65.61, samples=84 iops : min= 1, max= 19, avg= 8.36, stdev= 4.16, samples=84 lat (usec) : 50=0.13%, 100=2.47%, 250=0.65% lat (msec) : 2=2.34%, 4=3.26%, 10=5.86%, 20=8.20%, 50=29.82% lat (msec) : 100=31.25%, 250=15.76%, 500=0.26% cpu : usr=0.05%, sys=3.99%, ctx=1681, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179046: Wed Aug 19 08:41:54 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5744KiB/45197msec) clat (usec): min=47, max=378893, avg=69521.44, stdev=47641.29 lat (usec): min=48, max=378895, avg=69523.25, stdev=47641.50 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 77], 10.00th=[ 23200], 20.00th=[ 35390], | 30.00th=[ 43779], 40.00th=[ 54264], 50.00th=[ 62129], 60.00th=[ 72877], | 70.00th=[ 83362], 80.00th=[ 98042], 90.00th=[115868], 95.00th=[149947], | 99.00th=[256902], 99.50th=[333448], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 30, max= 277, per=24.50%, avg=127.16, stdev=59.24, samples=87 iops : min= 1, max= 17, avg= 7.10, stdev= 3.74, samples=87 write: IOPS=9, BW=145KiB/s (148kB/s)(6544KiB/45197msec); 0 zone resets clat (usec): min=1706, max=347201, avg=48977.67, stdev=48618.10 lat (usec): min=1709, max=347204, avg=48979.95, stdev=48618.02 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2638], 10.00th=[ 5145], 20.00th=[ 8717], | 30.00th=[ 13698], 40.00th=[ 23462], 50.00th=[ 35914], 60.00th=[ 50070], | 70.00th=[ 61604], 80.00th=[ 77071], 90.00th=[113771], 95.00th=[141558], | 99.00th=[223347], 99.50th=[244319], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 30, max= 444, per=26.26%, avg=143.40, stdev=78.13, samples=88 iops : min= 1, max= 27, avg= 8.15, stdev= 4.94, samples=88 lat (usec) : 50=0.13%, 100=2.47%, 250=0.26%, 500=0.13% lat (msec) : 2=1.30%, 4=2.86%, 10=8.59%, 20=8.33%, 50=23.96% lat (msec) : 100=36.20%, 250=14.97%, 500=0.78% cpu : usr=0.04%, sys=3.80%, ctx=1699, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179047: Wed Aug 19 08:41:54 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/46114msec) clat (usec): min=38, max=540120, avg=68379.58, stdev=52098.02 lat (usec): min=39, max=540122, avg=68381.00, stdev=52098.06 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 79], 10.00th=[ 18482], 20.00th=[ 33817], | 30.00th=[ 41681], 40.00th=[ 51643], 50.00th=[ 60556], 60.00th=[ 69731], | 70.00th=[ 81265], 80.00th=[ 94897], 90.00th=[123208], 95.00th=[160433], | 99.00th=[221250], 99.50th=[333448], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 30, max= 349, per=26.42%, avg=137.10, stdev=66.12, samples=89 iops : min= 1, max= 21, avg= 7.73, stdev= 4.17, samples=89 write: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/46114msec); 0 zone resets clat (usec): min=1221, max=342200, avg=49864.13, stdev=51942.63 lat (usec): min=1222, max=342202, avg=49873.82, stdev=51936.80 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2057], 10.00th=[ 3032], 20.00th=[ 7701], | 30.00th=[ 13698], 40.00th=[ 23725], 50.00th=[ 34866], 60.00th=[ 46924], | 70.00th=[ 60556], 80.00th=[ 84411], 90.00th=[117965], 95.00th=[154141], | 99.00th=[235930], 99.50th=[267387], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 27, max= 444, per=23.84%, avg=130.18, stdev=71.05, samples=89 iops : min= 1, max= 27, avg= 7.30, stdev= 4.50, samples=89 lat (usec) : 50=0.13%, 100=3.65%, 1000=0.13% lat (msec) : 2=1.82%, 4=4.43%, 10=5.99%, 20=7.29%, 50=27.47% lat (msec) : 100=33.72%, 250=14.58%, 500=0.65%, 750=0.13% cpu : usr=0.05%, sys=4.16%, ctx=1742, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179048: Wed Aug 19 08:41:54 2026 read: IOPS=8, BW=137KiB/s (141kB/s)(6032KiB/43885msec) clat (usec): min=51, max=287305, avg=65174.32, stdev=45710.07 lat (usec): min=52, max=287306, avg=65175.79, stdev=45709.84 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 65], 10.00th=[ 149], 20.00th=[ 32900], | 30.00th=[ 42206], 40.00th=[ 49546], 50.00th=[ 57934], 60.00th=[ 65799], | 70.00th=[ 77071], 80.00th=[ 98042], 90.00th=[122160], 95.00th=[141558], | 99.00th=[233833], 99.50th=[270533], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 254, per=26.67%, avg=138.41, stdev=55.07, samples=85 iops : min= 1, max= 15, avg= 7.82, stdev= 3.48, samples=85 write: IOPS=8, BW=143KiB/s (146kB/s)(6256KiB/43885msec); 0 zone resets clat (usec): min=1632, max=315238, avg=47684.42, stdev=49046.41 lat (usec): min=1634, max=315240, avg=47687.35, stdev=49045.85 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2638], 10.00th=[ 4424], 20.00th=[ 7439], | 30.00th=[ 13042], 40.00th=[ 21890], 50.00th=[ 36439], 60.00th=[ 45351], | 70.00th=[ 62653], 80.00th=[ 79168], 90.00th=[106431], 95.00th=[139461], | 99.00th=[229639], 99.50th=[308282], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 30, max= 350, per=26.73%, avg=145.95, stdev=71.08, samples=84 iops : min= 1, max= 21, avg= 8.31, stdev= 4.51, samples=84 lat (usec) : 100=4.56%, 250=0.52%, 750=0.13% lat (msec) : 2=1.56%, 4=2.99%, 10=8.59%, 20=7.03%, 50=26.30% lat (msec) : 100=33.46%, 250=14.06%, 500=0.78% cpu : usr=0.05%, sys=4.06%, ctx=1689, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=519KiB/s (532kB/s), 127KiB/s-137KiB/s (130kB/s-141kB/s), io=23.4MiB (24.5MB), run=43885-46114msec WRITE: bw=546KiB/s (560kB/s), 131KiB/s-145KiB/s (134kB/s-148kB/s), io=24.6MiB (25.8MB), run=43885-46114msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179040: Wed Aug 19 08:42:07 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(5920KiB/58746msec) clat (msec): min=8, max=403, avg=58.47, stdev=56.85 lat (msec): min=8, max=403, avg=58.47, stdev=56.85 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 79], 90.00th=[ 124], 95.00th=[ 180], | 99.00th=[ 309], 99.50th=[ 397], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 414, per=26.24%, avg=106.29, stdev=77.48, samples=108 iops : min= 1, max= 25, avg= 5.81, stdev= 4.87, samples=108 write: IOPS=6, BW=108KiB/s (111kB/s)(6368KiB/58746msec); 0 zone resets clat (msec): min=14, max=484, avg=92.00, stdev=73.65 lat (msec): min=14, max=484, avg=92.01, stdev=73.66 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 54], 50.00th=[ 66], 60.00th=[ 84], | 70.00th=[ 112], 80.00th=[ 140], 90.00th=[ 199], 95.00th=[ 239], | 99.00th=[ 330], 99.50th=[ 477], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 31, max= 350, per=26.33%, avg=112.16, stdev=78.43, samples=111 iops : min= 1, max= 21, avg= 6.18, stdev= 4.96, samples=111 lat (msec) : 10=0.78%, 20=8.07%, 50=39.84%, 100=27.21%, 250=20.96% lat (msec) : 500=3.12% cpu : usr=0.04%, sys=1.55%, ctx=1204, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179041: Wed Aug 19 08:42:07 2026 read: IOPS=6, BW=97.3KiB/s (99.7kB/s)(5744KiB/59019msec) clat (msec): min=9, max=396, avg=62.27, stdev=61.22 lat (msec): min=9, max=396, avg=62.27, stdev=61.22 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 63], 80.00th=[ 85], 90.00th=[ 140], 95.00th=[ 201], | 99.00th=[ 313], 99.50th=[ 359], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 22, max= 318, per=27.54%, avg=111.55, stdev=74.38, samples=101 iops : min= 1, max= 19, avg= 6.15, stdev= 4.67, samples=101 write: IOPS=6, BW=111KiB/s (114kB/s)(6544KiB/59019msec); 0 zone resets clat (msec): min=17, max=492, avg=88.63, stdev=70.34 lat (msec): min=17, max=492, avg=88.64, stdev=70.34 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 38], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 65], 60.00th=[ 79], | 70.00th=[ 105], 80.00th=[ 132], 90.00th=[ 167], 95.00th=[ 224], | 99.00th=[ 351], 99.50th=[ 477], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 368, per=26.82%, avg=114.26, stdev=74.84, samples=112 iops : min= 1, max= 23, avg= 6.32, stdev= 4.73, samples=112 lat (msec) : 10=0.52%, 20=6.25%, 50=41.54%, 100=27.08%, 250=21.88% lat (msec) : 500=2.73% cpu : usr=0.03%, sys=1.49%, ctx=1207, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179042: Wed Aug 19 08:42:07 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(6256KiB/58979msec) clat (msec): min=8, max=374, avg=59.83, stdev=56.49 lat (msec): min=8, max=374, avg=59.84, stdev=56.49 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 48], | 70.00th=[ 64], 80.00th=[ 82], 90.00th=[ 138], 95.00th=[ 188], | 99.00th=[ 266], 99.50th=[ 284], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 470, per=27.16%, avg=109.99, stdev=93.92, samples=112 iops : min= 1, max= 29, avg= 6.04, stdev= 5.92, samples=112 write: IOPS=6, BW=102KiB/s (105kB/s)(6032KiB/58979msec); 0 zone resets clat (msec): min=16, max=481, avg=93.16, stdev=75.62 lat (msec): min=16, max=481, avg=93.16, stdev=75.63 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 52], 50.00th=[ 66], 60.00th=[ 88], | 70.00th=[ 109], 80.00th=[ 138], 90.00th=[ 199], 95.00th=[ 243], | 99.00th=[ 372], 99.50th=[ 409], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 30, max= 349, per=24.72%, avg=105.31, stdev=72.51, samples=112 iops : min= 1, max= 21, avg= 5.74, stdev= 4.57, samples=112 lat (msec) : 10=0.39%, 20=8.20%, 50=41.41%, 100=24.87%, 250=22.40% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.37%, ctx=1215, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179043: Wed Aug 19 08:42:07 2026 read: IOPS=6, BW=102KiB/s (105kB/s)(6032KiB/59105msec) clat (msec): min=7, max=455, avg=64.89, stdev=62.20 lat (msec): min=7, max=455, avg=64.89, stdev=62.20 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 66], 80.00th=[ 102], 90.00th=[ 155], 95.00th=[ 188], | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 23, max= 351, per=27.23%, avg=110.26, stdev=75.96, samples=106 iops : min= 1, max= 21, avg= 6.06, stdev= 4.79, samples=106 write: IOPS=6, BW=106KiB/s (108kB/s)(6256KiB/59105msec); 0 zone resets clat (msec): min=15, max=406, avg=88.39, stdev=73.06 lat (msec): min=15, max=406, avg=88.41, stdev=73.07 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 101], 80.00th=[ 138], 90.00th=[ 188], 95.00th=[ 249], | 99.00th=[ 355], 99.50th=[ 384], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 349, per=25.26%, avg=107.62, stdev=79.23, samples=113 iops : min= 1, max= 21, avg= 5.89, stdev= 4.99, samples=113 lat (msec) : 10=0.91%, 20=7.68%, 50=41.54%, 100=24.61%, 250=21.74% lat (msec) : 500=3.52% cpu : usr=0.04%, sys=1.54%, ctx=1210, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=405KiB/s (415kB/s), 97.3KiB/s-106KiB/s (99.7kB/s-109kB/s), io=23.4MiB (24.5MB), run=58746-59105msec WRITE: bw=426KiB/s (437kB/s), 102KiB/s-111KiB/s (105kB/s-114kB/s), io=24.6MiB (25.8MB), run=58746-59105msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179064: Wed Aug 19 08:42:23 2026 read: IOPS=1, BW=2004KiB/s (2052kB/s)(7168KiB/3577msec) clat (usec): min=572, max=350136, avg=199354.14, stdev=146142.17 lat (usec): min=574, max=350137, avg=199355.56, stdev=146142.15 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 1696], | 30.00th=[200279], 40.00th=[200279], 50.00th=[217056], 60.00th=[287310], | 70.00th=[287310], 80.00th=[333448], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 1602, max= 4015, per=56.65%, avg=2310.20, stdev=967.16, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1431KiB/s (1466kB/s)(5120KiB/3577msec); 0 zone resets clat (msec): min=110, max=718, avg=398.57, stdev=240.80 lat (msec): min=110, max=718, avg=404.09, stdev=244.82 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1841, max= 3968, per=45.24%, avg=2582.67, stdev=1200.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=12.25%, ctx=156, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179065: Wed Aug 19 08:42:23 2026 read: IOPS=0, BW=408KiB/s (418kB/s)(2048KiB/5022msec) clat (msec): min=125, max=278, avg=202.03, stdev=108.06 lat (msec): min=125, max=278, avg=202.03, stdev=108.07 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1462, max= 1878, per=40.95%, avg=1670.00, stdev=294.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2039KiB/s (2088kB/s)(10.0MiB/5022msec); 0 zone resets clat (msec): min=202, max=974, avg=428.45, stdev=252.35 lat (msec): min=202, max=974, avg=428.79, stdev=252.12 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 215], | 30.00th=[ 236], 40.00th=[ 268], 50.00th=[ 309], 60.00th=[ 397], | 70.00th=[ 439], 80.00th=[ 518], 90.00th=[ 726], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1835, max= 3984, per=44.25%, avg=2526.14, stdev=948.90, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=13.30%, ctx=222, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179067: Wed Aug 19 08:42:23 2026 read: IOPS=1, BW=1419KiB/s (1453kB/s)(6144KiB/4331msec) clat (usec): min=543, max=303625, avg=96750.61, stdev=148833.82 lat (usec): min=544, max=303627, avg=96751.74, stdev=148833.81 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 1663], | 70.00th=[274727], 80.00th=[274727], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 1835, max= 4071, per=60.24%, avg=2456.75, stdev=1079.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1419KiB/s (1453kB/s)(6144KiB/4331msec); 0 zone resets clat (msec): min=319, max=942, avg=569.69, stdev=205.28 lat (msec): min=320, max=948, avg=570.67, stdev=207.28 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 550], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1835, max= 2043, per=34.43%, avg=1965.80, stdev=87.02, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=25.00% lat (msec) : 2=8.33%, 500=33.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=10.23%, ctx=184, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179069: Wed Aug 19 08:42:23 2026 read: IOPS=1, BW=1117KiB/s (1144kB/s)(5120KiB/4583msec) clat (usec): min=479, max=413558, avg=156844.80, stdev=171219.18 lat (usec): min=480, max=413559, avg=156845.92, stdev=171219.30 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 482], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[162530], 60.00th=[162530], | 70.00th=[206570], 80.00th=[206570], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 7515, max= 7515, per=100.00%, avg=7515.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1564KiB/s (1602kB/s)(7168KiB/4583msec); 0 zone resets clat (msec): min=254, max=836, avg=495.60, stdev=228.62 lat (msec): min=254, max=836, avg=495.70, stdev=228.63 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 262], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 498], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 743], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1381, max= 2043, per=33.03%, avg=1885.50, stdev=259.07, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=11.17%, ctx=158, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4078KiB/s (4176kB/s), 408KiB/s-2004KiB/s (418kB/s-2052kB/s), io=20.0MiB (20.0MB), run=3577-5022msec WRITE: bw=5709KiB/s (5846kB/s), 1419KiB/s-2039KiB/s (1453kB/s-2088kB/s), io=28.0MiB (29.4MB), run=3577-5022msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179063: Wed Aug 19 08:42:24 2026 read: IOPS=1, BW=1574KiB/s (1612kB/s)(7168KiB/4553msec) clat (msec): min=111, max=726, avg=323.02, stdev=200.79 lat (msec): min=111, max=726, avg=323.02, stdev=200.79 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 142], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 317], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 347], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1549, max= 4031, per=78.70%, avg=2874.75, stdev=1279.09, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1125KiB/s (1152kB/s)(5120KiB/4553msec); 0 zone resets clat (msec): min=143, max=687, avg=423.22, stdev=200.49 lat (msec): min=143, max=687, avg=423.34, stdev=200.48 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1917, max= 4023, per=48.88%, avg=2499.50, stdev=1017.07, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=50.00%, 750=25.00% cpu : usr=0.00%, sys=4.68%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179066: Wed Aug 19 08:42:24 2026 read: IOPS=0, BW=416KiB/s (425kB/s)(2048KiB/4929msec) clat (msec): min=169, max=211, avg=190.37, stdev=29.18 lat (msec): min=169, max=211, avg=190.37, stdev=29.19 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 211], 95.00th=[ 211], | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 1462, max= 1954, per=46.76%, avg=1708.00, stdev=347.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2078KiB/s (2127kB/s)(10.0MiB/4929msec); 0 zone resets clat (msec): min=101, max=784, avg=445.83, stdev=252.09 lat (msec): min=102, max=784, avg=446.02, stdev=252.13 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 169], | 30.00th=[ 239], 40.00th=[ 279], 50.00th=[ 326], 60.00th=[ 542], | 70.00th=[ 584], 80.00th=[ 684], 90.00th=[ 751], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1954, max= 4096, per=50.23%, avg=2568.71, stdev=957.54, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=41.67%, 500=16.67%, 750=25.00%, 1000=16.67% cpu : usr=0.02%, sys=3.90%, ctx=92, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179068: Wed Aug 19 08:42:24 2026 read: IOPS=1, BW=1096KiB/s (1122kB/s)(6144KiB/5606msec) clat (msec): min=146, max=531, avg=357.94, stdev=135.78 lat (msec): min=146, max=531, avg=357.94, stdev=135.78 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 397], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1917, max= 2039, per=53.96%, avg=1971.20, stdev=51.78, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1096KiB/s (1122kB/s)(6144KiB/5606msec); 0 zone resets clat (msec): min=194, max=768, avg=515.87, stdev=257.72 lat (msec): min=194, max=768, avg=516.01, stdev=257.77 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 667], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1665, max= 2048, per=37.96%, avg=1941.20, stdev=160.74, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=25.00%, 500=33.33%, 750=33.33%, 1000=8.33% cpu : usr=0.04%, sys=3.23%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179070: Wed Aug 19 08:42:24 2026 read: IOPS=0, BW=989KiB/s (1013kB/s)(5120KiB/5178msec) clat (msec): min=51, max=931, avg=362.58, stdev=350.73 lat (msec): min=51, max=931, avg=362.58, stdev=350.72 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1917, max= 2019, per=54.07%, avg=1975.25, stdev=48.43, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1384KiB/s (1418kB/s)(7168KiB/5178msec); 0 zone resets clat (msec): min=218, max=760, avg=465.79, stdev=190.95 lat (msec): min=218, max=760, avg=465.99, stdev=190.90 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 288], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 456], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 634], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1771, max= 4079, per=48.38%, avg=2474.00, stdev=1076.59, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.06%, sys=5.37%, ctx=111, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3653KiB/s (3741kB/s), 416KiB/s-1574KiB/s (425kB/s-1612kB/s), io=20.0MiB (20.0MB), run=4553-5606msec WRITE: bw=5115KiB/s (5237kB/s), 1096KiB/s-2078KiB/s (1122kB/s-2127kB/s), io=28.0MiB (29.4MB), run=4553-5606msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179080: Wed Aug 19 08:42:42 2026 read: IOPS=0, BW=3693KiB/s (3782kB/s)(12.0MiB/3327msec) clat (msec): min=240, max=2306, avg=1060.16, stdev=1097.04 lat (msec): min=240, max=2306, avg=1060.17, stdev=1097.04 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min=15906, max=15906, per=100.00%, avg=15906.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=2.53%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179082: Wed Aug 19 08:42:42 2026 read: IOPS=0, BW=1338KiB/s (1370kB/s)(4096KiB/3062msec) clat (nsec): min=1869.1M, max=1869.1M, avg=1869083426.00, stdev= 0.00 lat (nsec): min=1869.1M, max=1869.1M, avg=1869085646.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1871], 5.00th=[ 1871], 10.00th=[ 1871], 20.00th=[ 1871], | 30.00th=[ 1871], 40.00th=[ 1871], 50.00th=[ 1871], 60.00th=[ 1871], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2675KiB/s (2740kB/s)(8192KiB/3062msec); 0 zone resets clat (msec): min=214, max=886, avg=550.61, stdev=474.84 lat (msec): min=215, max=886, avg=551.04, stdev=474.87 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7984, max= 7984, per=98.91%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.20%, sys=3.01%, ctx=36, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179084: Wed Aug 19 08:42:42 2026 write: IOPS=0, BW=3027KiB/s (3100kB/s)(12.0MiB/4059msec); 0 zone resets clat (msec): min=318, max=3162, avg=1308.94, stdev=1606.80 lat (msec): min=321, max=3163, avg=1310.22, stdev=1605.84 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.05%, sys=2.49%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179085: Wed Aug 19 08:42:42 2026 write: IOPS=0, BW=3371KiB/s (3452kB/s)(12.0MiB/3645msec); 0 zone resets clat (msec): min=252, max=2687, avg=1198.49, stdev=1305.35 lat (msec): min=252, max=2688, avg=1199.14, stdev=1305.61 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.28%, ctx=32, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4925KiB/s (5043kB/s), 1338KiB/s-3693KiB/s (1370kB/s-3782kB/s), io=16.0MiB (16.8MB), run=3062-3327msec WRITE: bw=8073KiB/s (8267kB/s), 2675KiB/s-3371KiB/s (2740kB/s-3452kB/s), io=32.0MiB (33.6MB), run=3062-4059msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179078: Wed Aug 19 08:42:42 2026 read: IOPS=0, BW=3550KiB/s (3636kB/s)(12.0MiB/3461msec) clat (msec): min=703, max=1785, avg=1083.30, stdev=608.78 lat (msec): min=703, max=1785, avg=1083.31, stdev=608.78 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7984, max= 8062, per=100.00%, avg=8023.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.00%, ctx=267, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179079: Wed Aug 19 08:42:42 2026 read: IOPS=0, BW=2024KiB/s (2072kB/s)(4096KiB/2024msec) clat (nsec): min=697872k, max=697872k, avg=697872312.00, stdev= 0.00 lat (nsec): min=697876k, max=697876k, avg=697875931.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4047KiB/s (4145kB/s)(8192KiB/2024msec); 0 zone resets clat (msec): min=594, max=648, avg=621.36, stdev=38.51 lat (msec): min=594, max=648, avg=621.89, stdev=38.32 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7984, max= 7984, per=96.74%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.05%, sys=7.71%, ctx=97, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179081: Wed Aug 19 08:42:42 2026 write: IOPS=0, BW=3239KiB/s (3317kB/s)(12.0MiB/3794msec); 0 zone resets clat (msec): min=431, max=2772, avg=1239.77, stdev=1327.83 lat (msec): min=431, max=2772, avg=1240.16, stdev=1327.94 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 8062, max= 8110, per=97.98%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.01%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179083: Wed Aug 19 08:42:42 2026 write: IOPS=0, BW=3095KiB/s (3169kB/s)(12.0MiB/3970msec); 0 zone resets clat (msec): min=273, max=2684, avg=1288.44, stdev=1249.64 lat (msec): min=273, max=2684, avg=1289.01, stdev=1249.78 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 7953, max= 7984, per=96.55%, avg=7968.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=2.62%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4734KiB/s (4848kB/s), 2024KiB/s-3550KiB/s (2072kB/s-3636kB/s), io=16.0MiB (16.8MB), run=2024-3461msec WRITE: bw=8254KiB/s (8452kB/s), 3095KiB/s-4047KiB/s (3169kB/s-4145kB/s), io=32.0MiB (33.6MB), run=2024-3970msec