== sanity test 398b: DIO and buffer IO race ============== 01:49:44 (1788846584) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.96315 s, 10.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178388: Tue Sep 8 01:52:24 2026 read: IOPS=10, BW=42.4KiB/s (43.5kB/s)(5992KiB/141185msec) clat (usec): min=40, max=1383.3k, avg=52142.53, stdev=48111.95 lat (usec): min=40, max=1383.3k, avg=52147.68, stdev=48112.49 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11994], 10.00th=[ 17695], | 20.00th=[ 26084], 30.00th=[ 31851], 40.00th=[ 36963], | 50.00th=[ 44827], 60.00th=[ 52691], 70.00th=[ 61604], | 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[ 109577], | 99.00th=[ 164627], 99.50th=[ 202376], 99.90th=[ 320865], | 99.95th=[1384121], 99.99th=[1384121] bw ( KiB/s): min= 7, max= 110, per=25.17%, avg=42.29, stdev=17.70, samples=275 iops : min= 1, max= 27, avg= 9.90, stdev= 4.44, samples=275 write: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6296KiB/141185msec); 0 zone resets clat (usec): min=830, max=336809, avg=39717.67, stdev=44833.90 lat (usec): min=831, max=336812, avg=39722.18, stdev=44842.23 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1369], 20.00th=[ 3326], | 30.00th=[ 6521], 40.00th=[ 13698], 50.00th=[ 25560], 60.00th=[ 38011], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[126354], | 99.00th=[206570], 99.50th=[227541], 99.90th=[304088], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 157, per=25.27%, avg=44.48, stdev=20.51, samples=275 iops : min= 1, max= 39, avg=10.44, stdev= 5.15, samples=275 lat (usec) : 50=0.16%, 100=1.63%, 250=0.13%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=7.55%, 4=3.84%, 10=7.13%, 20=8.43%, 50=33.07% lat (msec) : 100=29.07%, 250=8.27%, 500=0.26%, 2000=0.03% cpu : usr=0.08%, sys=4.20%, ctx=6219, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178389: Tue Sep 8 01:52:24 2026 read: IOPS=10, BW=42.1KiB/s (43.1kB/s)(5940KiB/141068msec) clat (usec): min=46, max=1177.8k, avg=53343.19, stdev=47952.06 lat (usec): min=47, max=1177.8k, avg=53353.86, stdev=47956.76 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 13435], 10.00th=[ 19792], | 20.00th=[ 25035], 30.00th=[ 31589], 40.00th=[ 38011], | 50.00th=[ 43779], 60.00th=[ 51643], 70.00th=[ 62129], | 80.00th=[ 74974], 90.00th=[ 95945], 95.00th=[ 116917], | 99.00th=[ 200279], 99.50th=[ 256902], 99.90th=[ 379585], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 95, per=24.79%, avg=41.65, stdev=18.25, samples=277 iops : min= 1, max= 23, avg= 9.73, stdev= 4.58, samples=277 write: IOPS=11, BW=44.0KiB/s (46.1kB/s)(6348KiB/141068msec); 0 zone resets clat (usec): min=842, max=298675, avg=38625.14, stdev=43260.77 lat (usec): min=844, max=298676, avg=38638.23, stdev=43253.74 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1483], 20.00th=[ 3195], | 30.00th=[ 6194], 40.00th=[ 14222], 50.00th=[ 24511], 60.00th=[ 35914], | 70.00th=[ 49546], 80.00th=[ 68682], 90.00th=[ 98042], 95.00th=[124257], | 99.00th=[189793], 99.50th=[214959], 99.90th=[287310], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 127, per=25.16%, avg=44.28, stdev=20.97, samples=277 iops : min= 1, max= 31, avg=10.40, stdev= 5.27, samples=277 lat (usec) : 50=0.10%, 100=1.46%, 250=0.07%, 1000=0.20% lat (msec) : 2=7.23%, 4=4.59%, 10=7.10%, 20=7.52%, 50=36.13% lat (msec) : 100=26.53%, 250=8.66%, 500=0.39%, 2000=0.03% cpu : usr=0.08%, sys=4.19%, ctx=6221, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178390: Tue Sep 8 01:52:24 2026 read: IOPS=10, BW=43.0KiB/s (44.0kB/s)(6028KiB/140186msec) clat (usec): min=31, max=1397.2k, avg=51260.86, stdev=47862.06 lat (usec): min=32, max=1397.2k, avg=51271.00, stdev=47870.41 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10159], 10.00th=[ 16909], | 20.00th=[ 25560], 30.00th=[ 31327], 40.00th=[ 37487], | 50.00th=[ 43254], 60.00th=[ 51119], 70.00th=[ 60031], | 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[ 111674], | 99.00th=[ 170918], 99.50th=[ 187696], 99.90th=[ 250610], | 99.95th=[1400898], 99.99th=[1400898] bw ( KiB/s): min= 7, max= 102, per=25.47%, avg=42.79, stdev=18.02, samples=273 iops : min= 1, max= 25, avg=10.03, stdev= 4.53, samples=273 write: IOPS=11, BW=44.7KiB/s (45.7kB/s)(6260KiB/140186msec); 0 zone resets clat (usec): min=822, max=366121, avg=39837.79, stdev=44246.53 lat (usec): min=823, max=366123, avg=39840.57, stdev=44247.44 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1401], 20.00th=[ 3228], | 30.00th=[ 7046], 40.00th=[ 16057], 50.00th=[ 26346], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 67634], 90.00th=[ 95945], 95.00th=[124257], | 99.00th=[198181], 99.50th=[229639], 99.90th=[312476], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 149, per=25.21%, avg=44.36, stdev=21.64, samples=273 iops : min= 1, max= 37, avg=10.42, stdev= 5.44, samples=273 lat (usec) : 50=0.36%, 100=1.56%, 250=0.23%, 1000=0.07% lat (msec) : 2=7.42%, 4=3.84%, 10=6.54%, 20=8.82%, 50=35.16% lat (msec) : 100=27.64%, 250=8.17%, 500=0.16%, 2000=0.03% cpu : usr=0.08%, sys=4.22%, ctx=6251, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178391: Tue Sep 8 01:52:24 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(6052KiB/142537msec) clat (usec): min=39, max=313109, avg=51909.64, stdev=34958.11 lat (usec): min=39, max=313111, avg=51911.24, stdev=34958.10 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11600], 10.00th=[ 18220], 20.00th=[ 25822], | 30.00th=[ 32113], 40.00th=[ 38011], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 62129], 80.00th=[ 76022], 90.00th=[ 93848], 95.00th=[113771], | 99.00th=[175113], 99.50th=[196084], 99.90th=[256902], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 125, per=25.12%, avg=42.21, stdev=18.67, samples=279 iops : min= 1, max= 31, avg= 9.87, stdev= 4.71, samples=279 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6236KiB/142537msec); 0 zone resets clat (usec): min=877, max=1389.5k, avg=40719.33, stdev=55812.93 lat (usec): min=878, max=1389.5k, avg=40722.42, stdev=55812.36 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1369], | 20.00th=[ 3523], 30.00th=[ 6915], 40.00th=[ 15139], | 50.00th=[ 26346], 60.00th=[ 37487], 70.00th=[ 51119], | 80.00th=[ 68682], 90.00th=[ 99091], 95.00th=[ 128451], | 99.00th=[ 185598], 99.50th=[ 217056], 99.90th=[ 383779], | 99.95th=[1384121], 99.99th=[1384121] bw ( KiB/s): min= 7, max= 135, per=24.98%, avg=43.97, stdev=19.97, samples=276 iops : min= 1, max= 33, avg=10.32, stdev= 5.02, samples=276 lat (usec) : 50=0.13%, 100=1.46%, 250=0.23%, 750=0.10%, 1000=0.16% lat (msec) : 2=6.77%, 4=3.97%, 10=7.00%, 20=8.27%, 50=35.74% lat (msec) : 100=27.21%, 250=8.72%, 500=0.20%, 2000=0.03% cpu : usr=0.08%, sys=4.19%, ctx=6361, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (173kB/s), 42.1KiB/s-43.0KiB/s (43.1kB/s-44.0kB/s), io=23.4MiB (24.6MB), run=140186-142537msec WRITE: bw=176KiB/s (181kB/s), 43.8KiB/s-44.0KiB/s (44.8kB/s-46.1kB/s), io=24.6MiB (25.7MB), run=140186-142537msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178393: Tue Sep 8 01:53:16 2026 read: IOPS=7, BW=31.2KiB/s (31.9kB/s)(5992KiB/192121msec) clat (msec): min=5, max=1250, avg=51.28, stdev=55.07 lat (msec): min=5, max=1250, avg=51.28, stdev=55.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 71], 90.00th=[ 111], 95.00th=[ 155], | 99.00th=[ 222], 99.50th=[ 257], 99.90th=[ 338], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 112, per=25.46%, avg=31.57, stdev=22.05, samples=367 iops : min= 1, max= 28, avg= 7.22, stdev= 5.56, samples=367 write: IOPS=8, BW=32.8KiB/s (33.6kB/s)(6296KiB/192121msec); 0 zone resets clat (msec): min=12, max=525, avg=73.12, stdev=54.11 lat (msec): min=12, max=525, avg=73.12, stdev=54.11 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 83], 80.00th=[ 106], 90.00th=[ 146], 95.00th=[ 182], | 99.00th=[ 259], 99.50th=[ 338], 99.90th=[ 372], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 103, per=25.15%, avg=32.69, stdev=21.03, samples=372 iops : min= 1, max= 25, avg= 7.49, stdev= 5.31, samples=372 lat (msec) : 10=1.37%, 20=10.64%, 50=43.91%, 100=26.53%, 250=16.67% lat (msec) : 500=0.81%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.51%, ctx=4851, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178394: Tue Sep 8 01:53:16 2026 read: IOPS=7, BW=30.9KiB/s (31.7kB/s)(5940KiB/191967msec) clat (msec): min=5, max=1446, avg=50.25, stdev=57.77 lat (msec): min=5, max=1446, avg=50.25, stdev=57.77 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 111], 95.00th=[ 157], | 99.00th=[ 211], 99.50th=[ 232], 99.90th=[ 334], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 7, max= 112, per=25.70%, avg=31.87, stdev=22.54, samples=361 iops : min= 1, max= 28, avg= 7.29, stdev= 5.70, samples=361 write: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6348KiB/191967msec); 0 zone resets clat (msec): min=12, max=504, avg=73.83, stdev=54.97 lat (msec): min=12, max=504, avg=73.83, stdev=54.97 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 142], 95.00th=[ 182], | 99.00th=[ 284], 99.50th=[ 347], 99.90th=[ 397], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 103, per=25.46%, avg=33.10, stdev=20.80, samples=371 iops : min= 1, max= 25, avg= 7.60, stdev= 5.25, samples=371 lat (msec) : 10=1.37%, 20=10.87%, 50=44.60%, 100=25.88%, 250=16.31% lat (msec) : 500=0.91%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.52%, ctx=4651, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178395: Tue Sep 8 01:53:16 2026 read: IOPS=7, BW=31.3KiB/s (32.0kB/s)(6028KiB/192833msec) clat (msec): min=5, max=331, avg=50.78, stdev=46.08 lat (msec): min=5, max=331, avg=50.78, stdev=46.08 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 112], 95.00th=[ 150], | 99.00th=[ 224], 99.50th=[ 249], 99.90th=[ 321], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 126, per=25.71%, avg=31.88, stdev=21.81, samples=367 iops : min= 1, max= 31, avg= 7.29, stdev= 5.51, samples=367 write: IOPS=8, BW=32.5KiB/s (33.2kB/s)(6260KiB/192833msec); 0 zone resets clat (msec): min=12, max=1426, avg=74.20, stdev=63.30 lat (msec): min=12, max=1426, avg=74.20, stdev=63.30 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 109], 90.00th=[ 142], 95.00th=[ 176], | 99.00th=[ 257], 99.50th=[ 338], 99.90th=[ 535], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 119, per=24.96%, avg=32.44, stdev=21.17, samples=374 iops : min= 1, max= 29, avg= 7.44, stdev= 5.34, samples=374 lat (msec) : 10=1.04%, 20=11.49%, 50=42.71%, 100=26.89%, 250=17.06% lat (msec) : 500=0.72%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.44%, ctx=4646, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178396: Tue Sep 8 01:53:16 2026 read: IOPS=7, BW=31.6KiB/s (32.3kB/s)(6052KiB/191662msec) clat (msec): min=5, max=351, avg=48.35, stdev=44.00 lat (msec): min=5, max=353, avg=48.36, stdev=44.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 69], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 201], 99.50th=[ 241], 99.90th=[ 330], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 112, per=26.77%, avg=33.19, stdev=22.93, samples=353 iops : min= 1, max= 28, avg= 7.62, stdev= 5.79, samples=353 write: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6236KiB/191662msec); 0 zone resets clat (msec): min=8, max=1433, avg=75.90, stdev=65.70 lat (msec): min=8, max=1433, avg=75.91, stdev=65.70 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 109], 90.00th=[ 150], 95.00th=[ 190], | 99.00th=[ 284], 99.50th=[ 334], 99.90th=[ 418], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7, max= 103, per=24.93%, avg=32.41, stdev=20.52, samples=372 iops : min= 1, max= 25, avg= 7.42, stdev= 5.18, samples=372 lat (msec) : 10=1.30%, 20=11.26%, 50=43.36%, 100=26.60%, 250=16.41% lat (msec) : 500=1.04%, 2000=0.03% cpu : usr=0.06%, sys=1.49%, ctx=4934, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=125KiB/s (128kB/s), 30.9KiB/s-31.6KiB/s (31.7kB/s-32.3kB/s), io=23.4MiB (24.6MB), run=191662-192833msec WRITE: bw=130KiB/s (134kB/s), 32.5KiB/s-33.1KiB/s (33.2kB/s-33.9kB/s), io=24.6MiB (25.7MB), run=191662-192833msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178442: Tue Sep 8 01:54:12 2026 read: IOPS=8, BW=133KiB/s (137kB/s)(5920KiB/44410msec) clat (usec): min=33, max=323332, avg=67337.28, stdev=48530.27 lat (usec): min=33, max=323334, avg=67343.60, stdev=48540.46 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 62], 10.00th=[ 367], 20.00th=[ 32113], | 30.00th=[ 42206], 40.00th=[ 51643], 50.00th=[ 59507], 60.00th=[ 67634], | 70.00th=[ 83362], 80.00th=[100140], 90.00th=[124257], 95.00th=[158335], | 99.00th=[225444], 99.50th=[308282], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 29, max= 381, per=24.89%, avg=132.44, stdev=65.57, samples=87 iops : min= 1, max= 23, avg= 7.47, stdev= 4.11, samples=87 write: IOPS=8, BW=143KiB/s (147kB/s)(6368KiB/44410msec); 0 zone resets clat (usec): min=1162, max=350870, avg=48197.38, stdev=53984.46 lat (usec): min=1164, max=350873, avg=48200.44, stdev=53984.21 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1795], 10.00th=[ 2606], 20.00th=[ 6783], | 30.00th=[ 11469], 40.00th=[ 17957], 50.00th=[ 29492], 60.00th=[ 40109], | 70.00th=[ 59507], 80.00th=[ 80217], 90.00th=[125305], 95.00th=[164627], | 99.00th=[274727], 99.50th=[291505], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 30, max= 540, per=25.78%, avg=144.36, stdev=81.84, samples=86 iops : min= 1, max= 33, avg= 8.22, stdev= 5.14, samples=86 lat (usec) : 50=0.78%, 100=3.12%, 250=0.65%, 500=0.26% lat (msec) : 2=4.17%, 4=2.73%, 10=7.94%, 20=8.33%, 50=23.70% lat (msec) : 100=31.51%, 250=16.02%, 500=0.78% cpu : usr=0.04%, sys=4.04%, ctx=1581, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178443: Tue Sep 8 01:54:12 2026 read: IOPS=8, BW=128KiB/s (131kB/s)(5744KiB/44857msec) clat (usec): min=47, max=335649, avg=68482.77, stdev=47558.76 lat (usec): min=48, max=335650, avg=68484.28, stdev=47558.85 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 85], 10.00th=[ 25035], 20.00th=[ 34341], | 30.00th=[ 41681], 40.00th=[ 50070], 50.00th=[ 57934], 60.00th=[ 66847], | 70.00th=[ 76022], 80.00th=[ 94897], 90.00th=[132645], 95.00th=[164627], | 99.00th=[229639], 99.50th=[291505], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 30, max= 286, per=24.13%, avg=128.37, stdev=56.82, samples=87 iops : min= 1, max= 17, avg= 7.22, stdev= 3.61, samples=87 write: IOPS=9, BW=146KiB/s (149kB/s)(6544KiB/44857msec); 0 zone resets clat (usec): min=1471, max=318229, avg=49270.58, stdev=55118.01 lat (usec): min=1474, max=322624, avg=49316.18, stdev=55158.77 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1827], 10.00th=[ 3195], 20.00th=[ 7177], | 30.00th=[ 12125], 40.00th=[ 20841], 50.00th=[ 33424], 60.00th=[ 45876], | 70.00th=[ 60031], 80.00th=[ 78119], 90.00th=[115868], 95.00th=[156238], | 99.00th=[291505], 99.50th=[304088], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 386, per=26.17%, avg=146.55, stdev=81.59, samples=87 iops : min= 1, max= 24, avg= 8.37, stdev= 5.15, samples=87 lat (usec) : 50=0.13%, 100=2.34%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.26%, 4=3.12%, 10=7.81%, 20=6.77%, 50=28.78% lat (msec) : 100=31.77%, 250=14.71%, 500=1.04% cpu : usr=0.05%, sys=4.48%, ctx=1674, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178444: Tue Sep 8 01:54:12 2026 read: IOPS=8, BW=139KiB/s (143kB/s)(6256KiB/44954msec) clat (usec): min=38, max=345014, avg=67365.44, stdev=45084.39 lat (usec): min=38, max=345016, avg=67366.86, stdev=45084.45 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 69], 10.00th=[ 18744], 20.00th=[ 35914], | 30.00th=[ 42730], 40.00th=[ 50070], 50.00th=[ 60556], 60.00th=[ 70779], | 70.00th=[ 81265], 80.00th=[ 94897], 90.00th=[128451], 95.00th=[147850], | 99.00th=[210764], 99.50th=[256902], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 318, per=26.43%, avg=140.62, stdev=57.42, samples=87 iops : min= 1, max= 19, avg= 8.00, stdev= 3.63, samples=87 write: IOPS=8, BW=134KiB/s (137kB/s)(6032KiB/44954msec); 0 zone resets clat (usec): min=1291, max=343907, avg=48640.22, stdev=56637.04 lat (usec): min=1295, max=343909, avg=48642.93, stdev=56636.95 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1745], 10.00th=[ 2008], 20.00th=[ 6128], | 30.00th=[ 10552], 40.00th=[ 17957], 50.00th=[ 30802], 60.00th=[ 41681], | 70.00th=[ 55837], 80.00th=[ 82314], 90.00th=[122160], 95.00th=[158335], | 99.00th=[283116], 99.50th=[291505], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 445, per=24.87%, avg=139.30, stdev=74.92, samples=84 iops : min= 1, max= 27, avg= 7.89, stdev= 4.75, samples=84 lat (usec) : 50=0.52%, 100=3.52%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=4.82%, 4=2.47%, 10=6.90%, 20=6.77%, 50=27.21% lat (msec) : 100=30.99%, 250=15.49%, 500=0.91% cpu : usr=0.05%, sys=3.77%, ctx=1572, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178445: Tue Sep 8 01:54:12 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6032KiB/44412msec) clat (usec): min=38, max=312827, avg=62749.33, stdev=48749.39 lat (usec): min=38, max=312828, avg=62750.76, stdev=48749.52 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 75], 20.00th=[ 26608], | 30.00th=[ 38011], 40.00th=[ 47449], 50.00th=[ 54789], 60.00th=[ 64226], | 70.00th=[ 77071], 80.00th=[ 93848], 90.00th=[119014], 95.00th=[154141], | 99.00th=[248513], 99.50th=[261096], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 29, max= 413, per=25.63%, avg=136.33, stdev=69.54, samples=86 iops : min= 1, max= 25, avg= 7.71, stdev= 4.38, samples=86 write: IOPS=8, BW=141KiB/s (144kB/s)(6256KiB/44412msec); 0 zone resets clat (usec): min=1338, max=584608, avg=52322.13, stdev=61111.04 lat (usec): min=1340, max=584612, avg=52324.53, stdev=61111.12 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1778], 10.00th=[ 3097], 20.00th=[ 6849], | 30.00th=[ 10683], 40.00th=[ 18482], 50.00th=[ 34341], 60.00th=[ 50070], | 70.00th=[ 65799], 80.00th=[ 87557], 90.00th=[131597], 95.00th=[158335], | 99.00th=[242222], 99.50th=[346031], 99.90th=[583009], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 30, max= 445, per=25.39%, avg=142.20, stdev=68.94, samples=86 iops : min= 1, max= 27, avg= 8.08, stdev= 4.36, samples=86 lat (usec) : 50=0.26%, 100=5.21%, 250=1.17%, 500=0.13% lat (msec) : 2=4.30%, 4=1.82%, 10=8.33%, 20=7.94%, 50=23.57% lat (msec) : 100=30.60%, 250=16.02%, 500=0.52%, 750=0.13% cpu : usr=0.06%, sys=3.63%, ctx=1476, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=533KiB/s (546kB/s), 128KiB/s-139KiB/s (131kB/s-143kB/s), io=23.4MiB (24.5MB), run=44410-44954msec WRITE: bw=561KiB/s (574kB/s), 134KiB/s-146KiB/s (137kB/s-149kB/s), io=24.6MiB (25.8MB), run=44410-44954msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178447: Tue Sep 8 01:54:24 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(5920KiB/55479msec) clat (msec): min=6, max=357, avg=59.01, stdev=59.78 lat (msec): min=6, max=357, avg=59.01, stdev=59.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 34], 60.00th=[ 47], | 70.00th=[ 61], 80.00th=[ 94], 90.00th=[ 138], 95.00th=[ 194], | 99.00th=[ 300], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 384, per=26.51%, avg=113.18, stdev=87.21, samples=101 iops : min= 1, max= 24, avg= 6.31, stdev= 5.56, samples=101 write: IOPS=7, BW=115KiB/s (118kB/s)(6368KiB/55479msec); 0 zone resets clat (msec): min=16, max=563, avg=84.21, stdev=75.88 lat (msec): min=16, max=563, avg=84.22, stdev=75.88 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 69], | 70.00th=[ 92], 80.00th=[ 131], 90.00th=[ 188], 95.00th=[ 247], | 99.00th=[ 351], 99.50th=[ 506], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 28, max= 416, per=26.74%, avg=120.31, stdev=95.51, samples=103 iops : min= 1, max= 26, avg= 6.75, stdev= 6.07, samples=103 lat (msec) : 10=1.30%, 20=10.94%, 50=42.32%, 100=22.40%, 250=20.18% lat (msec) : 500=2.60%, 750=0.26% cpu : usr=0.03%, sys=1.18%, ctx=1134, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178448: Tue Sep 8 01:54:24 2026 read: IOPS=6, BW=103KiB/s (105kB/s)(5744KiB/55783msec) clat (msec): min=7, max=360, avg=57.50, stdev=60.29 lat (msec): min=7, max=360, avg=57.50, stdev=60.29 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 44], | 70.00th=[ 61], 80.00th=[ 93], 90.00th=[ 138], 95.00th=[ 186], | 99.00th=[ 296], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 21, max= 480, per=27.04%, avg=115.47, stdev=98.15, samples=97 iops : min= 1, max= 30, avg= 6.42, stdev= 6.25, samples=97 write: IOPS=7, BW=117KiB/s (120kB/s)(6544KiB/55783msec); 0 zone resets clat (msec): min=14, max=474, avg=85.59, stdev=72.88 lat (msec): min=14, max=474, avg=85.59, stdev=72.88 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 72], | 70.00th=[ 99], 80.00th=[ 138], 90.00th=[ 186], 95.00th=[ 241], | 99.00th=[ 326], 99.50th=[ 351], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 29, max= 416, per=26.31%, avg=118.39, stdev=91.23, samples=108 iops : min= 1, max= 26, avg= 6.64, stdev= 5.79, samples=108 lat (msec) : 10=0.91%, 20=11.85%, 50=41.02%, 100=22.01%, 250=21.22% lat (msec) : 500=2.99% cpu : usr=0.03%, sys=1.37%, ctx=1151, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178449: Tue Sep 8 01:54:24 2026 read: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55750msec) clat (msec): min=8, max=436, avg=55.90, stdev=57.64 lat (msec): min=8, max=436, avg=55.90, stdev=57.64 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 57], 80.00th=[ 91], 90.00th=[ 138], 95.00th=[ 178], | 99.00th=[ 271], 99.50th=[ 317], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 30, max= 544, per=29.39%, avg=125.49, stdev=108.20, samples=98 iops : min= 1, max= 34, avg= 7.08, stdev= 6.86, samples=98 write: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55750msec); 0 zone resets clat (msec): min=9, max=460, avg=89.71, stdev=75.79 lat (msec): min=9, max=460, avg=89.72, stdev=75.79 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 57], 60.00th=[ 77], | 70.00th=[ 113], 80.00th=[ 146], 90.00th=[ 197], 95.00th=[ 251], | 99.00th=[ 321], 99.50th=[ 347], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 30, max= 377, per=24.53%, avg=110.40, stdev=87.38, samples=106 iops : min= 1, max= 23, avg= 6.12, stdev= 5.56, samples=106 lat (msec) : 10=1.30%, 20=14.06%, 50=40.76%, 100=19.27%, 250=21.61% lat (msec) : 500=2.99% cpu : usr=0.05%, sys=1.19%, ctx=1129, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178450: Tue Sep 8 01:54:24 2026 read: IOPS=6, BW=108KiB/s (110kB/s)(6032KiB/55974msec) clat (msec): min=7, max=338, avg=59.70, stdev=58.98 lat (msec): min=7, max=338, avg=59.70, stdev=58.98 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 49], | 70.00th=[ 66], 80.00th=[ 92], 90.00th=[ 140], 95.00th=[ 186], | 99.00th=[ 309], 99.50th=[ 326], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 29, max= 410, per=27.22%, avg=116.24, stdev=89.62, samples=100 iops : min= 1, max= 25, avg= 6.49, stdev= 5.71, samples=100 write: IOPS=6, BW=112KiB/s (114kB/s)(6256KiB/55974msec); 0 zone resets clat (msec): min=16, max=562, avg=85.22, stdev=75.90 lat (msec): min=16, max=562, avg=85.22, stdev=75.90 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 69], | 70.00th=[ 101], 80.00th=[ 136], 90.00th=[ 178], 95.00th=[ 241], | 99.00th=[ 355], 99.50th=[ 388], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 28, max= 352, per=24.78%, avg=111.51, stdev=93.03, samples=108 iops : min= 1, max= 22, avg= 6.19, stdev= 5.94, samples=108 lat (msec) : 10=0.91%, 20=11.46%, 50=41.54%, 100=21.35%, 250=21.48% lat (msec) : 500=3.12%, 750=0.13% cpu : usr=0.06%, sys=1.34%, ctx=1132, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=428KiB/s (438kB/s), 103KiB/s-112KiB/s (105kB/s-115kB/s), io=23.4MiB (24.5MB), run=55479-55974msec WRITE: bw=450KiB/s (461kB/s), 108KiB/s-117KiB/s (111kB/s-120kB/s), io=24.6MiB (25.8MB), run=55479-55974msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178469: Tue Sep 8 01:54:42 2026 read: IOPS=1, BW=1280KiB/s (1310kB/s)(7168KiB/5602msec) clat (usec): min=597, max=2692.3k, avg=550325.02, stdev=950085.05 lat (usec): min=598, max=2692.3k, avg=550326.77, stdev=950085.11 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], | 20.00th=[ 139461], 30.00th=[ 217056], 40.00th=[ 217056], | 50.00th=[ 233833], 60.00th=[ 238027], 70.00th=[ 238027], | 80.00th=[ 329253], 90.00th=[2701132], 95.00th=[2701132], | 99.00th=[2701132], 99.50th=[2701132], 99.90th=[2701132], | 99.95th=[2701132], 99.99th=[2701132] bw ( KiB/s): min= 1481, max= 3351, per=70.14%, avg=2123.00, stdev=722.37, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=914KiB/s (936kB/s)(5120KiB/5602msec); 0 zone resets clat (msec): min=208, max=504, avg=349.41, stdev=125.66 lat (msec): min=208, max=504, avg=349.50, stdev=125.62 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1692, max= 2035, per=44.10%, avg=1868.75, stdev=177.31, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=8.52%, ctx=631, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178470: Tue Sep 8 01:54:42 2026 read: IOPS=0, BW=303KiB/s (310kB/s)(2048KiB/6765msec) clat (msec): min=201, max=792, avg=496.80, stdev=418.20 lat (msec): min=201, max=792, avg=496.80, stdev=418.20 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2031, max= 2035, per=67.16%, avg=2033.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1514KiB/s (1550kB/s)(10.0MiB/6765msec); 0 zone resets clat (msec): min=132, max=2547, avg=576.81, stdev=713.60 lat (msec): min=132, max=2547, avg=576.98, stdev=713.56 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 178], | 30.00th=[ 253], 40.00th=[ 257], 50.00th=[ 305], 60.00th=[ 342], | 70.00th=[ 531], 80.00th=[ 584], 90.00th=[ 642], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1692, max= 5988, per=68.85%, avg=2917.67, stdev=1736.44, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.61%, ctx=113, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178471: Tue Sep 8 01:54:42 2026 read: IOPS=0, BW=984KiB/s (1007kB/s)(6144KiB/6247msec) clat (usec): min=741, max=399214, avg=148478.49, stdev=169839.01 lat (usec): min=741, max=399216, avg=148479.96, stdev=169839.22 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 2802], | 30.00th=[ 2802], 40.00th=[ 6587], 50.00th=[ 6587], 60.00th=[217056], | 70.00th=[265290], 80.00th=[265290], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 2035, max= 6965, per=100.00%, avg=4500.00, stdev=3486.04, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=0, BW=984KiB/s (1007kB/s)(6144KiB/6247msec); 0 zone resets clat (msec): min=300, max=2860, avg=889.22, stdev=980.49 lat (msec): min=300, max=2861, avg=889.52, stdev=981.02 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 625], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1692, max= 2884, per=48.89%, avg=2071.80, stdev=479.30, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=8.33%, 250=8.33%, 500=41.67%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.70%, ctx=149, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178472: Tue Sep 8 01:54:42 2026 read: IOPS=0, BW=823KiB/s (842kB/s)(5120KiB/6224msec) clat (usec): min=635, max=246832, avg=52739.44, stdev=108548.28 lat (usec): min=637, max=246833, avg=52740.63, stdev=108548.27 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 2737], 40.00th=[ 2737], 50.00th=[ 4178], 60.00th=[ 4178], | 70.00th=[ 9372], 80.00th=[ 9372], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 2035, max= 6107, per=100.00%, avg=4071.00, stdev=2879.34, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1152KiB/s (1179kB/s)(7168KiB/6224msec); 0 zone resets clat (msec): min=174, max=2917, avg=849.32, stdev=966.22 lat (msec): min=174, max=2917, avg=850.96, stdev=965.54 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 247], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 460], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 1083], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1741, max= 2035, per=46.48%, avg=1969.80, stdev=128.43, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=16.67%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.45%, ctx=75, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3027KiB/s (3100kB/s), 303KiB/s-1280KiB/s (310kB/s-1310kB/s), io=20.0MiB (20.0MB), run=5602-6765msec WRITE: bw=4238KiB/s (4340kB/s), 914KiB/s-1514KiB/s (936kB/s-1550kB/s), io=28.0MiB (29.4MB), run=5602-6765msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178464: Tue Sep 8 01:54:42 2026 read: IOPS=0, BW=1002KiB/s (1026kB/s)(7168KiB/7155msec) clat (msec): min=101, max=2701, avg=667.53, stdev=946.36 lat (msec): min=101, max=2701, avg=667.53, stdev=946.36 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 121], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 251], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 986], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1828, max= 4452, per=93.27%, avg=2565.75, stdev=1259.92, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=716KiB/s (733kB/s)(5120KiB/7155msec); 0 zone resets clat (msec): min=101, max=771, avg=457.41, stdev=276.74 lat (msec): min=101, max=772, avg=457.64, stdev=276.73 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2007, max= 4000, per=69.56%, avg=2679.33, stdev=1143.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=1.87%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178465: Tue Sep 8 01:54:42 2026 read: IOPS=0, BW=275KiB/s (282kB/s)(2048KiB/7443msec) clat (msec): min=116, max=509, avg=313.09, stdev=277.67 lat (msec): min=116, max=509, avg=313.09, stdev=277.67 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1418, max= 2007, per=62.25%, avg=1712.50, stdev=416.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1376KiB/s (1409kB/s)(10.0MiB/7443msec); 0 zone resets clat (msec): min=156, max=3156, avg=675.77, stdev=924.60 lat (msec): min=157, max=3157, avg=676.54, stdev=924.56 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 184], | 30.00th=[ 201], 40.00th=[ 203], 50.00th=[ 207], 60.00th=[ 372], | 70.00th=[ 447], 80.00th=[ 701], 90.00th=[ 1133], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1828, max= 4254, per=59.93%, avg=2308.43, stdev=861.04, samples=7 iops : min= 1, max= 4, avg= 1.43, stdev= 1.13, samples=7 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.81%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178466: Tue Sep 8 01:54:42 2026 read: IOPS=0, BW=890KiB/s (912kB/s)(6144KiB/6901msec) clat (msec): min=126, max=773, avg=415.99, stdev=261.40 lat (msec): min=126, max=773, avg=415.99, stdev=261.40 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 393], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1828, max= 2031, per=71.89%, avg=1977.80, stdev=84.64, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=890KiB/s (912kB/s)(6144KiB/6901msec); 0 zone resets clat (msec): min=168, max=2765, avg=705.51, stdev=1023.21 lat (msec): min=168, max=2765, avg=706.11, stdev=1022.93 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 271], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1976, max= 2925, per=57.92%, avg=2231.00, stdev=463.06, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=3.12%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178467: Tue Sep 8 01:54:42 2026 read: IOPS=0, BW=759KiB/s (777kB/s)(5120KiB/6744msec) clat (msec): min=96, max=2862, avg=843.81, stdev=1163.78 lat (msec): min=96, max=2862, avg=843.81, stdev=1163.78 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 2000, max= 2031, per=73.26%, avg=2015.25, stdev=14.24, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1063KiB/s (1088kB/s)(7168KiB/6744msec); 0 zone resets clat (msec): min=138, max=999, avg=348.10, stdev=305.35 lat (msec): min=138, max=999, avg=348.41, stdev=305.31 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 174], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 213], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 451], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1783, max= 4407, per=65.17%, avg=2510.25, stdev=1268.78, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.19%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2752KiB/s (2818kB/s), 275KiB/s-1002KiB/s (282kB/s-1026kB/s), io=20.0MiB (20.0MB), run=6744-7443msec WRITE: bw=3852KiB/s (3945kB/s), 716KiB/s-1376KiB/s (733kB/s-1409kB/s), io=28.0MiB (29.4MB), run=6744-7443msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178478: Tue Sep 8 01:54:55 2026 read: IOPS=0, BW=3701KiB/s (3790kB/s)(12.0MiB/3320msec) clat (msec): min=676, max=1393, avg=985.63, stdev=368.87 lat (msec): min=676, max=1393, avg=985.63, stdev=368.87 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8000, max= 8078, per=100.00%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.89%, ctx=191, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178479: Tue Sep 8 01:54:55 2026 read: IOPS=0, BW=1070KiB/s (1096kB/s)(4096KiB/3828msec) clat (nsec): min=683883k, max=683883k, avg=683883025.00, stdev= 0.00 lat (nsec): min=683886k, max=683886k, avg=683885761.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2140KiB/s (2191kB/s)(8192KiB/3828msec); 0 zone resets clat (msec): min=551, max=2187, avg=1369.50, stdev=1156.25 lat (msec): min=556, max=2191, avg=1373.78, stdev=1156.42 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 7627, max= 7627, per=95.46%, avg=7627.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.05%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178480: Tue Sep 8 01:54:55 2026 write: IOPS=0, BW=3367KiB/s (3447kB/s)(12.0MiB/3650msec); 0 zone resets clat (msec): min=473, max=1912, avg=1144.17, stdev=724.09 lat (msec): min=474, max=1912, avg=1144.65, stdev=724.10 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 7613, max= 8159, per=98.70%, avg=7886.00, stdev=386.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.11%, sys=4.82%, ctx=112, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178481: Tue Sep 8 01:54:55 2026 write: IOPS=0, BW=2996KiB/s (3068kB/s)(12.0MiB/4101msec); 0 zone resets clat (msec): min=780, max=1566, avg=1270.67, stdev=427.90 lat (msec): min=780, max=1567, avg=1271.02, stdev=427.89 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8000, max= 8094, per=100.00%, avg=8047.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.90%, ctx=99, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4280KiB/s (4383kB/s), 1070KiB/s-3701KiB/s (1096kB/s-3790kB/s), io=16.0MiB (16.8MB), run=3320-3828msec WRITE: bw=7990KiB/s (8182kB/s), 2140KiB/s-3367KiB/s (2191kB/s-3447kB/s), io=32.0MiB (33.6MB), run=3650-4101msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178483: Tue Sep 8 01:54:56 2026 read: IOPS=0, BW=4055KiB/s (4153kB/s)(12.0MiB/3030msec) clat (msec): min=311, max=1512, avg=1008.44, stdev=623.09 lat (msec): min=311, max=1512, avg=1008.44, stdev=623.09 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7968, max= 8110, per=100.00%, avg=8039.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.13%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178484: Tue Sep 8 01:54:56 2026 read: IOPS=0, BW=1389KiB/s (1423kB/s)(4096KiB/2948msec) clat (nsec): min=1729.4M, max=1729.4M, avg=1729404840.00, stdev= 0.00 lat (nsec): min=1729.4M, max=1729.4M, avg=1729406468.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1737], 5.00th=[ 1737], 10.00th=[ 1737], 20.00th=[ 1737], | 30.00th=[ 1737], 40.00th=[ 1737], 50.00th=[ 1737], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2779KiB/s (2846kB/s)(8192KiB/2948msec); 0 zone resets clat (msec): min=297, max=907, avg=602.54, stdev=431.85 lat (msec): min=309, max=908, avg=608.77, stdev=423.89 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8192, max= 8192, per=73.70%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.85%, ctx=36, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178485: Tue Sep 8 01:54:56 2026 write: IOPS=1, BW=4499KiB/s (4607kB/s)(12.0MiB/2731msec); 0 zone resets clat (msec): min=345, max=1287, avg=906.67, stdev=496.21 lat (msec): min=346, max=1288, avg=907.15, stdev=496.23 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7876, max= 8192, per=72.28%, avg=8034.00, stdev=223.45, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.59%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178486: Tue Sep 8 01:54:56 2026 write: IOPS=1, BW=5069KiB/s (5191kB/s)(12.0MiB/2424msec); 0 zone resets clat (msec): min=321, max=1044, avg=789.46, stdev=406.21 lat (msec): min=321, max=1044, avg=789.79, stdev=406.20 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7876, max= 7876, per=70.86%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.71%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5407KiB/s (5537kB/s), 1389KiB/s-4055KiB/s (1423kB/s-4153kB/s), io=16.0MiB (16.8MB), run=2948-3030msec WRITE: bw=10.9MiB/s (11.4MB/s), 2779KiB/s-5069KiB/s (2846kB/s-5191kB/s), io=32.0MiB (33.6MB), run=2424-2948msec