== sanity test 398b: DIO and buffer IO race ============== 14:09:17 (1786039757) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.80563 s, 6.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144579: Thu Aug 6 14:11:50 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(5992KiB/128842msec) clat (usec): min=32, max=876932, avg=42325.45, stdev=37201.27 lat (usec): min=33, max=876933, avg=42335.58, stdev=37199.75 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 1156], 20.00th=[ 19792], | 30.00th=[ 25560], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 62129], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[149947], 99.50th=[170918], 99.90th=[246416], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 119, per=25.55%, avg=46.51, stdev=20.22, samples=251 iops : min= 1, max= 29, avg=10.97, stdev= 5.10, samples=251 write: IOPS=12, BW=48.9KiB/s (50.0kB/s)(6296KiB/128842msec); 0 zone resets clat (usec): min=1030, max=432734, avg=41196.52, stdev=44352.22 lat (usec): min=1031, max=432735, avg=41198.91, stdev=44351.57 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1401], 10.00th=[ 1958], 20.00th=[ 4113], | 30.00th=[ 8029], 40.00th=[ 17695], 50.00th=[ 30016], 60.00th=[ 39584], | 70.00th=[ 53216], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[128451], | 99.00th=[179307], 99.50th=[217056], 99.90th=[354419], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 111, per=25.46%, avg=48.63, stdev=21.32, samples=252 iops : min= 1, max= 27, avg=11.50, stdev= 5.37, samples=252 lat (usec) : 50=0.62%, 100=3.94%, 250=0.16%, 500=0.10%, 750=0.03% lat (msec) : 2=5.37%, 4=4.85%, 10=7.65%, 20=8.43%, 50=37.53% lat (msec) : 100=24.09%, 250=7.06%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=4.81%, ctx=6527, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144580: Thu Aug 6 14:11:50 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(5940KiB/129962msec) clat (usec): min=35, max=504863, avg=43259.63, stdev=35579.90 lat (usec): min=36, max=504864, avg=43261.15, stdev=35579.89 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 8979], 20.00th=[ 20579], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 36439], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[193987], 99.90th=[429917], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 5, max= 111, per=25.00%, avg=45.50, stdev=20.09, samples=254 iops : min= 1, max= 27, avg=10.72, stdev= 5.05, samples=254 write: IOPS=12, BW=48.8KiB/s (50.0kB/s)(6348KiB/129962msec); 0 zone resets clat (usec): min=1055, max=1267.2k, avg=41048.16, stdev=52947.81 lat (usec): min=1055, max=1267.3k, avg=41052.52, stdev=52947.46 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1369], 10.00th=[ 1762], | 20.00th=[ 4228], 30.00th=[ 8029], 40.00th=[ 16909], | 50.00th=[ 28443], 60.00th=[ 40633], 70.00th=[ 53740], | 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[ 120062], | 99.00th=[ 179307], 99.50th=[ 212861], 99.90th=[ 476054], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 5, max= 111, per=25.42%, avg=48.56, stdev=21.24, samples=254 iops : min= 1, max= 27, avg=11.48, stdev= 5.35, samples=254 lat (usec) : 50=0.52%, 100=3.81%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.15%, 4=3.84%, 10=7.45%, 20=9.18%, 50=36.17% lat (msec) : 100=25.98%, 250=6.25%, 500=0.29%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=4.88%, ctx=6521, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144582: Thu Aug 6 14:11:50 2026 read: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6028KiB/131257msec) clat (usec): min=29, max=394182, avg=42071.94, stdev=32002.65 lat (usec): min=29, max=394184, avg=42080.89, stdev=32006.69 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 1303], 20.00th=[ 20055], | 30.00th=[ 25297], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[145753], 99.50th=[166724], 99.90th=[337642], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 117, per=25.35%, avg=46.15, stdev=20.87, samples=255 iops : min= 1, max= 29, avg=10.87, stdev= 5.26, samples=255 write: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6260KiB/131257msec); 0 zone resets clat (usec): min=897, max=827236, avg=42960.33, stdev=47315.37 lat (usec): min=898, max=827238, avg=42965.94, stdev=47319.32 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1942], 20.00th=[ 5080], | 30.00th=[ 10552], 40.00th=[ 20579], 50.00th=[ 32113], 60.00th=[ 43254], | 70.00th=[ 56886], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[189793], 99.50th=[233833], 99.90th=[480248], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 110, per=24.79%, avg=47.34, stdev=18.48, samples=258 iops : min= 1, max= 27, avg=11.18, stdev= 4.65, samples=258 lat (usec) : 50=0.98%, 100=3.42%, 250=0.23%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.14%, 4=3.68%, 10=6.22%, 20=9.67%, 50=37.34% lat (msec) : 100=25.85%, 250=6.90%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=4.83%, ctx=6665, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144585: Thu Aug 6 14:11:50 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6052KiB/130962msec) clat (usec): min=32, max=345877, avg=42117.51, stdev=32652.25 lat (usec): min=32, max=345879, avg=42119.16, stdev=32652.19 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 260], 20.00th=[ 19268], | 30.00th=[ 25035], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[145753], 99.50th=[183501], 99.90th=[312476], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 109, per=25.41%, avg=46.24, stdev=19.40, samples=254 iops : min= 1, max= 27, avg=10.90, stdev= 4.88, samples=254 write: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6236KiB/130962msec); 0 zone resets clat (usec): min=1064, max=1488.9k, avg=42737.86, stdev=56861.96 lat (usec): min=1064, max=1488.9k, avg=42740.33, stdev=56862.09 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1401], 10.00th=[ 2057], | 20.00th=[ 5407], 30.00th=[ 10159], 40.00th=[ 20317], | 50.00th=[ 30278], 60.00th=[ 41157], 70.00th=[ 54264], | 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[ 124257], | 99.00th=[ 198181], 99.50th=[ 258999], 99.90th=[ 371196], | 99.95th=[1484784], 99.99th=[1484784] bw ( KiB/s): min= 7, max= 118, per=24.88%, avg=47.51, stdev=21.08, samples=255 iops : min= 1, max= 29, avg=11.22, stdev= 5.31, samples=255 lat (usec) : 50=0.88%, 100=3.87%, 250=0.16%, 500=0.13%, 750=0.07% lat (msec) : 2=5.05%, 4=3.42%, 10=7.10%, 20=9.93%, 50=37.30% lat (msec) : 100=25.16%, 250=6.61%, 500=0.29%, 2000=0.03% cpu : usr=0.07%, sys=4.83%, ctx=6519, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=183KiB/s (187kB/s), 45.7KiB/s-46.5KiB/s (46.8kB/s-47.6kB/s), io=23.4MiB (24.6MB), run=128842-131257msec WRITE: bw=192KiB/s (196kB/s), 47.6KiB/s-48.9KiB/s (48.8kB/s-50.0kB/s), io=24.6MiB (25.7MB), run=128842-131257msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144581: Thu Aug 6 14:14:13 2026 read: IOPS=5, BW=22.1KiB/s (22.6kB/s)(5992KiB/271510msec) clat (msec): min=4, max=895, avg=34.48, stdev=41.29 lat (msec): min=4, max=895, avg=34.48, stdev=41.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 102], | 99.00th=[ 171], 99.50th=[ 201], 99.90th=[ 489], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 104, per=28.71%, avg=24.97, stdev=17.32, samples=464 iops : min= 1, max= 26, avg= 5.62, stdev= 4.37, samples=464 write: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6296KiB/271510msec); 0 zone resets clat (msec): min=37, max=538, avg=139.32, stdev=68.44 lat (msec): min=37, max=538, avg=139.32, stdev=68.44 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 228], 95.00th=[ 268], | 99.00th=[ 384], 99.50th=[ 456], 99.90th=[ 527], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 47, per=25.18%, avg=22.91, stdev=10.52, samples=529 iops : min= 1, max= 11, avg= 5.10, stdev= 2.69, samples=529 lat (msec) : 10=3.35%, 20=18.29%, 50=18.59%, 100=21.97%, 250=34.08% lat (msec) : 500=3.58%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5199, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144583: Thu Aug 6 14:14:13 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5940KiB/274024msec) clat (msec): min=5, max=1272, avg=34.72, stdev=45.31 lat (msec): min=5, max=1272, avg=34.72, stdev=45.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 102], | 99.00th=[ 165], 99.50th=[ 197], 99.90th=[ 279], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 103, per=28.13%, avg=24.48, stdev=16.84, samples=468 iops : min= 1, max= 25, avg= 5.50, stdev= 4.26, samples=468 write: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6348KiB/274024msec); 0 zone resets clat (msec): min=36, max=574, avg=139.85, stdev=67.39 lat (msec): min=36, max=574, avg=139.85, stdev=67.39 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 226], 95.00th=[ 268], | 99.00th=[ 368], 99.50th=[ 422], 99.90th=[ 542], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 56, per=25.11%, avg=22.85, stdev=10.54, samples=534 iops : min= 1, max= 14, avg= 5.09, stdev= 2.70, samples=534 lat (msec) : 10=3.71%, 20=17.15%, 50=19.37%, 100=21.32%, 250=34.77% lat (msec) : 500=3.55%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.19%, ctx=5041, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144584: Thu Aug 6 14:14:13 2026 read: IOPS=5, BW=22.0KiB/s (22.6kB/s)(6028KiB/273398msec) clat (msec): min=5, max=386, avg=35.89, stdev=35.88 lat (msec): min=5, max=386, avg=35.90, stdev=35.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 78], 95.00th=[ 109], | 99.00th=[ 169], 99.50th=[ 215], 99.90th=[ 368], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 103, per=27.83%, avg=24.22, stdev=16.66, samples=481 iops : min= 1, max= 25, avg= 5.43, stdev= 4.20, samples=481 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6260KiB/273398msec); 0 zone resets clat (msec): min=36, max=1330, avg=139.79, stdev=72.14 lat (msec): min=36, max=1330, avg=139.79, stdev=72.14 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 112], 50.00th=[ 125], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 226], 95.00th=[ 264], | 99.00th=[ 363], 99.50th=[ 426], 99.90th=[ 617], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 56, per=25.04%, avg=22.79, stdev=10.30, samples=529 iops : min= 1, max= 14, avg= 5.07, stdev= 2.63, samples=529 lat (msec) : 10=3.26%, 20=16.37%, 50=20.31%, 100=22.10%, 250=34.64% lat (msec) : 500=3.22%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=5182, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144586: Thu Aug 6 14:14:13 2026 read: IOPS=5, BW=22.2KiB/s (22.8kB/s)(6052KiB/272031msec) clat (msec): min=5, max=491, avg=35.51, stdev=37.33 lat (msec): min=5, max=491, avg=35.51, stdev=37.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 103], | 99.00th=[ 169], 99.50th=[ 220], 99.90th=[ 388], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 88, per=28.76%, avg=25.02, stdev=16.13, samples=467 iops : min= 1, max= 22, avg= 5.64, stdev= 4.08, samples=467 write: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6236KiB/272031msec); 0 zone resets clat (msec): min=27, max=1452, avg=139.70, stdev=74.31 lat (msec): min=27, max=1452, avg=139.70, stdev=74.31 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 232], 95.00th=[ 271], | 99.00th=[ 372], 99.50th=[ 418], 99.90th=[ 617], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 7, max= 55, per=24.96%, avg=22.72, stdev=10.10, samples=528 iops : min= 1, max= 13, avg= 5.05, stdev= 2.59, samples=528 lat (msec) : 10=3.22%, 20=17.64%, 50=19.47%, 100=22.66%, 250=33.04% lat (msec) : 500=3.87%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5219, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=87.6KiB/s (89.7kB/s), 21.7KiB/s-22.2KiB/s (22.2kB/s-22.8kB/s), io=23.4MiB (24.6MB), run=271510-274024msec WRITE: bw=91.7KiB/s (93.9kB/s), 22.9KiB/s-23.2KiB/s (23.4kB/s-23.7kB/s), io=24.6MiB (25.7MB), run=271510-274024msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144644: Thu Aug 6 14:14:51 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(5920KiB/27205msec) clat (usec): min=34, max=260506, avg=37499.35, stdev=36550.97 lat (usec): min=34, max=260507, avg=37501.32, stdev=36550.80 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 81], | 30.00th=[ 16909], 40.00th=[ 25035], 50.00th=[ 32113], 60.00th=[ 39584], | 70.00th=[ 50070], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[162530], 99.50th=[183501], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 382, per=24.66%, avg=214.06, stdev=87.29, samples=53 iops : min= 1, max= 23, avg=12.58, stdev= 5.51, samples=53 write: IOPS=14, BW=234KiB/s (240kB/s)(6368KiB/27205msec); 0 zone resets clat (usec): min=1352, max=149482, avg=33074.98, stdev=31777.39 lat (usec): min=1355, max=149483, avg=33078.61, stdev=31780.34 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2073], 10.00th=[ 3163], 20.00th=[ 5211], | 30.00th=[ 7832], 40.00th=[ 11600], 50.00th=[ 23200], 60.00th=[ 32900], | 70.00th=[ 45876], 80.00th=[ 61080], 90.00th=[ 83362], 95.00th=[ 94897], | 99.00th=[125305], 99.50th=[137364], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 30, max= 505, per=25.55%, avg=233.28, stdev=92.41, samples=53 iops : min= 1, max= 31, avg=13.79, stdev= 5.85, samples=53 lat (usec) : 50=1.82%, 100=8.98%, 250=1.69%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=5.34%, 10=10.81%, 20=8.72%, 50=31.51% lat (msec) : 100=23.18%, 250=4.82%, 500=0.13% cpu : usr=0.06%, sys=5.19%, ctx=1333, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144645: Thu Aug 6 14:14:51 2026 read: IOPS=13, BW=208KiB/s (213kB/s)(5744KiB/27574msec) clat (usec): min=33, max=162123, avg=36523.57, stdev=31064.95 lat (usec): min=33, max=162125, avg=36528.72, stdev=31064.15 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 19268], 40.00th=[ 28443], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 50594], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[135267], 99.50th=[154141], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 31, max= 498, per=23.73%, avg=206.00, stdev=93.93, samples=54 iops : min= 1, max= 31, avg=12.09, stdev= 5.95, samples=54 write: IOPS=14, BW=237KiB/s (243kB/s)(6544KiB/27574msec); 0 zone resets clat (usec): min=1489, max=195071, avg=34987.94, stdev=36366.02 lat (usec): min=1490, max=195073, avg=34992.11, stdev=36365.87 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1942], 10.00th=[ 2900], 20.00th=[ 5145], | 30.00th=[ 7898], 40.00th=[ 11994], 50.00th=[ 21103], 60.00th=[ 31065], | 70.00th=[ 48497], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[103285], | 99.00th=[154141], 99.50th=[170918], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 94, max= 512, per=25.65%, avg=234.19, stdev=81.29, samples=54 iops : min= 5, max= 32, avg=13.87, stdev= 5.19, samples=54 lat (usec) : 50=1.56%, 100=9.77%, 250=0.52%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.26%, 4=5.60%, 10=10.55%, 20=8.07%, 50=30.60% lat (msec) : 100=24.74%, 250=4.82% cpu : usr=0.07%, sys=5.76%, ctx=1396, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144646: Thu Aug 6 14:14:51 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26920msec) clat (usec): min=24, max=245604, avg=36866.53, stdev=32853.42 lat (usec): min=24, max=245606, avg=36875.08, stdev=32850.27 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 76], | 30.00th=[ 17695], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[145753], 99.50th=[179307], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 63, max= 351, per=26.81%, avg=232.68, stdev=71.64, samples=53 iops : min= 3, max= 21, avg=13.75, stdev= 4.51, samples=53 write: IOPS=14, BW=224KiB/s (229kB/s)(6032KiB/26920msec); 0 zone resets clat (usec): min=1647, max=209199, avg=32649.24, stdev=32640.47 lat (usec): min=1649, max=209202, avg=32675.56, stdev=32653.54 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1942], 10.00th=[ 2999], 20.00th=[ 4883], | 30.00th=[ 8291], 40.00th=[ 11994], 50.00th=[ 22676], 60.00th=[ 31851], | 70.00th=[ 44303], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[128451], 99.50th=[162530], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 63, max= 413, per=24.35%, avg=222.30, stdev=83.84, samples=53 iops : min= 3, max= 25, avg=13.11, stdev= 5.30, samples=53 lat (usec) : 50=1.95%, 100=10.03%, 250=0.78%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=5.08%, 10=10.03%, 20=8.98%, 50=32.42% lat (msec) : 100=23.44%, 250=3.91% cpu : usr=0.07%, sys=5.58%, ctx=1421, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144647: Thu Aug 6 14:14:51 2026 read: IOPS=14, BW=226KiB/s (232kB/s)(6032KiB/26653msec) clat (usec): min=24, max=172314, avg=36683.36, stdev=32224.43 lat (usec): min=25, max=172316, avg=36684.84, stdev=32224.27 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 74], | 30.00th=[ 19268], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 62653], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[149947], 99.50th=[168821], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 478, per=25.99%, avg=225.58, stdev=104.96, samples=52 iops : min= 1, max= 29, avg=13.31, stdev= 6.60, samples=52 write: IOPS=14, BW=235KiB/s (240kB/s)(6256KiB/26653msec); 0 zone resets clat (usec): min=1656, max=234461, avg=32614.93, stdev=36226.70 lat (usec): min=1659, max=234464, avg=32618.73, stdev=36227.96 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1991], 10.00th=[ 2376], 20.00th=[ 5473], | 30.00th=[ 7570], 40.00th=[ 11338], 50.00th=[ 18744], 60.00th=[ 28705], | 70.00th=[ 41157], 80.00th=[ 54264], 90.00th=[ 83362], 95.00th=[110625], | 99.00th=[152044], 99.50th=[204473], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 63, max= 504, per=25.74%, avg=235.04, stdev=100.32, samples=52 iops : min= 3, max= 31, avg=13.92, stdev= 6.30, samples=52 lat (usec) : 50=1.82%, 100=9.90%, 250=0.91%, 750=0.26%, 1000=0.13% lat (msec) : 2=2.86%, 4=5.73%, 10=10.94%, 20=8.46%, 50=33.20% lat (msec) : 100=20.31%, 250=5.47% cpu : usr=0.07%, sys=5.61%, ctx=1371, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=869KiB/s (889kB/s), 208KiB/s-232KiB/s (213kB/s-238kB/s), io=23.4MiB (24.5MB), run=26653-27574msec WRITE: bw=914KiB/s (936kB/s), 224KiB/s-237KiB/s (229kB/s-243kB/s), io=24.6MiB (25.8MB), run=26653-27574msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144649: Thu Aug 6 14:15:33 2026 read: IOPS=5, BW=86.2KiB/s (88.3kB/s)(5920KiB/68638msec) clat (msec): min=7, max=308, avg=39.69, stdev=39.02 lat (msec): min=7, max=308, avg=39.70, stdev=39.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 115], | 99.00th=[ 222], 99.50th=[ 228], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 283, per=27.15%, avg=93.66, stdev=56.20, samples=123 iops : min= 1, max= 17, avg= 5.10, stdev= 3.60, samples=123 write: IOPS=5, BW=92.8KiB/s (95.0kB/s)(6368KiB/68638msec); 0 zone resets clat (msec): min=54, max=417, avg=135.33, stdev=56.33 lat (msec): min=54, max=417, avg=135.33, stdev=56.33 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 72], 10.00th=[ 80], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 111], 50.00th=[ 123], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 264], | 99.00th=[ 321], 99.50th=[ 326], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 31, max= 192, per=26.24%, avg=95.24, stdev=38.49, samples=131 iops : min= 1, max= 12, avg= 5.20, stdev= 2.54, samples=131 lat (msec) : 10=1.56%, 20=14.45%, 50=22.01%, 100=21.09%, 250=37.50% lat (msec) : 500=3.39% cpu : usr=0.03%, sys=1.38%, ctx=1330, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144650: Thu Aug 6 14:15:33 2026 read: IOPS=5, BW=82.9KiB/s (84.9kB/s)(5744KiB/69289msec) clat (msec): min=6, max=226, avg=37.66, stdev=34.42 lat (msec): min=6, max=226, avg=37.67, stdev=34.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 84], 95.00th=[ 106], | 99.00th=[ 182], 99.50th=[ 222], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 29, max= 414, per=27.34%, avg=94.33, stdev=67.47, samples=120 iops : min= 1, max= 25, avg= 5.15, stdev= 4.32, samples=120 write: IOPS=5, BW=94.4KiB/s (96.7kB/s)(6544KiB/69289msec); 0 zone resets clat (msec): min=43, max=471, avg=136.17, stdev=64.65 lat (msec): min=43, max=471, avg=136.18, stdev=64.65 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 134], | 70.00th=[ 153], 80.00th=[ 178], 90.00th=[ 213], 95.00th=[ 253], | 99.00th=[ 359], 99.50th=[ 443], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 29, max= 224, per=26.42%, avg=95.91, stdev=38.28, samples=134 iops : min= 1, max= 14, avg= 5.25, stdev= 2.52, samples=134 lat (msec) : 10=1.82%, 20=13.41%, 50=23.70%, 100=21.09%, 250=37.24% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.36%, ctx=1325, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144651: Thu Aug 6 14:15:33 2026 read: IOPS=5, BW=94.3KiB/s (96.5kB/s)(6256KiB/66358msec) clat (msec): min=7, max=220, avg=39.41, stdev=31.56 lat (msec): min=7, max=220, avg=39.42, stdev=31.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 114], | 99.00th=[ 165], 99.50th=[ 197], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 30, max= 320, per=30.08%, avg=103.77, stdev=65.53, samples=119 iops : min= 1, max= 20, avg= 5.74, stdev= 4.15, samples=119 write: IOPS=5, BW=90.9KiB/s (93.1kB/s)(6032KiB/66358msec); 0 zone resets clat (msec): min=41, max=433, avg=134.85, stdev=59.27 lat (msec): min=41, max=433, avg=134.86, stdev=59.27 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 123], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 203], 95.00th=[ 251], | 99.00th=[ 372], 99.50th=[ 418], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 29, max= 160, per=25.27%, avg=91.72, stdev=33.98, samples=129 iops : min= 1, max= 10, avg= 4.98, stdev= 2.24, samples=129 lat (msec) : 10=0.65%, 20=10.68%, 50=29.56%, 100=21.35%, 250=35.29% lat (msec) : 500=2.47% cpu : usr=0.04%, sys=1.39%, ctx=1292, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144652: Thu Aug 6 14:15:33 2026 read: IOPS=5, BW=89.6KiB/s (91.7kB/s)(6032KiB/67338msec) clat (msec): min=6, max=298, avg=39.23, stdev=36.86 lat (msec): min=7, max=298, avg=39.23, stdev=36.86 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 80], 95.00th=[ 111], | 99.00th=[ 203], 99.50th=[ 251], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 287, per=28.93%, avg=99.81, stdev=63.77, samples=118 iops : min= 1, max= 17, avg= 5.51, stdev= 4.04, samples=118 write: IOPS=5, BW=92.9KiB/s (95.1kB/s)(6256KiB/67338msec); 0 zone resets clat (msec): min=38, max=385, avg=134.21, stdev=57.44 lat (msec): min=38, max=385, avg=134.21, stdev=57.44 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 239], | 99.00th=[ 355], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 192, per=26.08%, avg=94.66, stdev=37.92, samples=130 iops : min= 1, max= 12, avg= 5.17, stdev= 2.48, samples=130 lat (msec) : 10=1.69%, 20=13.80%, 50=22.92%, 100=22.79%, 250=36.46% lat (msec) : 500=2.34% cpu : usr=0.04%, sys=1.47%, ctx=1323, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=346KiB/s (354kB/s), 82.9KiB/s-94.3KiB/s (84.9kB/s-96.5kB/s), io=23.4MiB (24.5MB), run=66358-69289msec WRITE: bw=364KiB/s (372kB/s), 90.9KiB/s-94.4KiB/s (93.1kB/s-96.7kB/s), io=24.6MiB (25.8MB), run=66358-69289msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144672: Thu Aug 6 14:15:49 2026 read: IOPS=1, BW=1529KiB/s (1566kB/s)(7168KiB/4687msec) clat (usec): min=552, max=2646.2k, avg=488110.43, stdev=960843.25 lat (usec): min=553, max=2646.2k, avg=488111.92, stdev=960843.01 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 1795], 30.00th=[ 2114], 40.00th=[ 2114], | 50.00th=[ 185598], 60.00th=[ 256902], 70.00th=[ 256902], | 80.00th=[ 320865], 90.00th=[2634023], 95.00th=[2634023], | 99.00th=[2634023], 99.50th=[2634023], 99.90th=[2634023], | 99.95th=[2634023], 99.99th=[2634023] bw ( KiB/s): min= 2015, max= 4055, per=74.53%, avg=2949.33, stdev=1030.74, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1092KiB/s (1119kB/s)(5120KiB/4687msec); 0 zone resets clat (msec): min=106, max=647, avg=253.07, stdev=234.00 lat (msec): min=109, max=647, avg=253.68, stdev=233.57 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 111], 60.00th=[ 111], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2027, max= 3992, per=54.32%, avg=3009.50, stdev=1389.46, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.60%, ctx=181, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144673: Thu Aug 6 14:15:49 2026 read: IOPS=0, BW=396KiB/s (405kB/s)(2048KiB/5175msec) clat (usec): min=794, max=349519, avg=175157.25, stdev=246585.62 lat (usec): min=796, max=349521, avg=175158.76, stdev=246585.75 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 799], 10.00th=[ 799], 20.00th=[ 799], | 30.00th=[ 799], 40.00th=[ 799], 50.00th=[ 799], 60.00th=[350225], | 70.00th=[350225], 80.00th=[350225], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 2007, max= 2019, per=50.87%, avg=2013.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1979KiB/s (2026kB/s)(10.0MiB/5175msec); 0 zone resets clat (msec): min=193, max=1591, avg=482.17, stdev=415.03 lat (msec): min=193, max=1591, avg=482.36, stdev=415.06 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 207], 40.00th=[ 279], 50.00th=[ 342], 60.00th=[ 414], | 70.00th=[ 510], 80.00th=[ 523], 90.00th=[ 575], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 2007, max= 4063, per=46.94%, avg=2600.71, stdev=988.15, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=10.28%, ctx=106, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144674: Thu Aug 6 14:15:49 2026 read: IOPS=1, BW=1373KiB/s (1406kB/s)(6144KiB/4475msec) clat (usec): min=368, max=441431, avg=115645.36, stdev=187074.09 lat (usec): min=369, max=441433, avg=115646.73, stdev=187074.20 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 371], 10.00th=[ 371], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 668], 50.00th=[ 668], 60.00th=[ 5211], | 70.00th=[246416], 80.00th=[246416], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 2027, max= 4079, per=84.80%, avg=3355.67, stdev=1152.17, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1373KiB/s (1406kB/s)(6144KiB/4475msec); 0 zone resets clat (msec): min=231, max=1631, avg=629.66, stdev=534.92 lat (msec): min=231, max=1631, avg=629.77, stdev=534.88 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 542], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 1980, max= 2904, per=40.35%, avg=2235.50, stdev=446.27, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 10=8.33%, 250=25.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=8.31%, ctx=110, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144675: Thu Aug 6 14:15:49 2026 read: IOPS=1, BW=1186KiB/s (1215kB/s)(5120KiB/4316msec) clat (usec): min=360, max=359310, avg=116696.59, stdev=166369.67 lat (usec): min=360, max=359311, avg=116697.66, stdev=166370.14 clat percentiles (usec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 375], 40.00th=[ 375], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[223347], 80.00th=[223347], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1661KiB/s (1701kB/s)(7168KiB/4316msec); 0 zone resets clat (msec): min=161, max=1799, avg=531.01, stdev=579.74 lat (msec): min=161, max=1799, avg=532.96, stdev=579.28 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 176], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 342], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 600], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1387, max= 4079, per=48.79%, avg=2703.20, stdev=1244.52, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 500=25.00% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.76%, ctx=105, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3957KiB/s (4052kB/s), 396KiB/s-1529KiB/s (405kB/s-1566kB/s), io=20.0MiB (20.0MB), run=4316-5175msec WRITE: bw=5540KiB/s (5673kB/s), 1092KiB/s-1979KiB/s (1119kB/s-2026kB/s), io=28.0MiB (29.4MB), run=4316-5175msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144667: Thu Aug 6 14:15:50 2026 read: IOPS=1, BW=1868KiB/s (1913kB/s)(7168KiB/3837msec) clat (msec): min=78, max=1109, avg=286.73, stdev=365.64 lat (msec): min=78, max=1109, avg=286.73, stdev=365.64 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 128], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 148], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 220], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 2003, max= 4039, per=72.73%, avg=2431.20, stdev=898.96, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1334KiB/s (1366kB/s)(5120KiB/3837msec); 0 zone resets clat (msec): min=252, max=411, avg=340.28, stdev=68.31 lat (msec): min=252, max=411, avg=340.51, stdev=68.26 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2003, max= 2048, per=43.27%, avg=2025.25, stdev=18.45, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 2000=8.33% cpu : usr=0.03%, sys=4.04%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144668: Thu Aug 6 14:15:50 2026 read: IOPS=0, BW=334KiB/s (342kB/s)(2048KiB/6126msec) clat (msec): min=120, max=353, avg=237.26, stdev=164.87 lat (msec): min=120, max=353, avg=237.26, stdev=164.86 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2019, max= 2027, per=60.51%, avg=2023.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1672KiB/s (1712kB/s)(10.0MiB/6126msec); 0 zone resets clat (msec): min=215, max=1444, avg=556.18, stdev=431.48 lat (msec): min=215, max=1445, avg=556.38, stdev=431.65 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 226], | 30.00th=[ 288], 40.00th=[ 296], 50.00th=[ 313], 60.00th=[ 317], | 70.00th=[ 535], 80.00th=[ 776], 90.00th=[ 1150], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1924, max= 4087, per=48.57%, avg=2273.25, stdev=733.92, samples=8 iops : min= 1, max= 3, avg= 1.37, stdev= 0.74, samples=8 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.02%, sys=2.32%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144669: Thu Aug 6 14:15:50 2026 read: IOPS=1, BW=1046KiB/s (1071kB/s)(6144KiB/5872msec) clat (msec): min=171, max=707, avg=343.59, stdev=202.68 lat (msec): min=171, max=707, avg=343.59, stdev=202.68 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 288], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1996, max= 4055, per=75.69%, avg=2530.25, stdev=1016.69, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1046KiB/s (1071kB/s)(6144KiB/5872msec); 0 zone resets clat (msec): min=201, max=1870, avg=629.67, stdev=623.62 lat (msec): min=201, max=1870, avg=629.80, stdev=623.65 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 531], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1996, max= 4055, per=54.18%, avg=2535.50, stdev=1013.27, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 2000=8.33% cpu : usr=0.03%, sys=2.10%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144670: Thu Aug 6 14:15:50 2026 read: IOPS=0, BW=837KiB/s (857kB/s)(5120KiB/6120msec) clat (msec): min=73, max=736, avg=324.72, stdev=283.99 lat (msec): min=73, max=736, avg=324.72, stdev=283.99 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 4063, max= 4087, per=100.00%, avg=4075.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1171KiB/s (1199kB/s)(7168KiB/6120msec); 0 zone resets clat (msec): min=220, max=1868, avg=621.96, stdev=569.94 lat (msec): min=220, max=1868, avg=622.24, stdev=569.88 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 296], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 456], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 676], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1996, max= 2727, per=46.29%, avg=2166.60, stdev=313.86, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=33.33%, 2000=8.33% cpu : usr=0.00%, sys=2.11%, ctx=60, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3343KiB/s (3423kB/s), 334KiB/s-1868KiB/s (342kB/s-1913kB/s), io=20.0MiB (20.0MB), run=3837-6126msec WRITE: bw=4680KiB/s (4793kB/s), 1046KiB/s-1672KiB/s (1071kB/s-1712kB/s), io=28.0MiB (29.4MB), run=3837-6126msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144688: Thu Aug 6 14:16:10 2026 read: IOPS=0, BW=3627KiB/s (3714kB/s)(12.0MiB/3388msec) clat (msec): min=953, max=1238, avg=1105.08, stdev=143.24 lat (msec): min=953, max=1238, avg=1105.08, stdev=143.24 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8047, max= 8078, per=100.00%, avg=8062.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=8.80%, ctx=202, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144689: Thu Aug 6 14:16:10 2026 read: IOPS=0, BW=955KiB/s (978kB/s)(4096KiB/4290msec) clat (nsec): min=1014.9M, max=1014.9M, avg=1014876568.00, stdev= 0.00 lat (nsec): min=1014.9M, max=1014.9M, avg=1014878999.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1910KiB/s (1955kB/s)(8192KiB/4290msec); 0 zone resets clat (msec): min=1095, max=2109, avg=1602.60, stdev=716.55 lat (msec): min=1096, max=2109, avg=1603.14, stdev=716.77 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 2106], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=3.38%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144690: Thu Aug 6 14:16:10 2026 write: IOPS=0, BW=2755KiB/s (2821kB/s)(12.0MiB/4461msec); 0 zone resets clat (msec): min=449, max=2180, avg=1461.88, stdev=902.32 lat (msec): min=450, max=2182, avg=1463.17, stdev=902.72 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8000, max= 8143, per=100.00%, avg=8071.50, stdev=101.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.61%, ctx=32, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144691: Thu Aug 6 14:16:10 2026 write: IOPS=0, BW=3797KiB/s (3888kB/s)(12.0MiB/3236msec); 0 zone resets clat (msec): min=692, max=1286, avg=1060.39, stdev=321.52 lat (msec): min=692, max=1287, avg=1060.91, stdev=321.53 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8000, max= 8078, per=100.00%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.46%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3819KiB/s (3911kB/s), 955KiB/s-3627KiB/s (978kB/s-3714kB/s), io=16.0MiB (16.8MB), run=3388-4290msec WRITE: bw=7345KiB/s (7522kB/s), 1910KiB/s-3797KiB/s (1955kB/s-3888kB/s), io=32.0MiB (33.6MB), run=3236-4461msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144684: Thu Aug 6 14:16:10 2026 read: IOPS=0, BW=2557KiB/s (2618kB/s)(12.0MiB/4806msec) clat (msec): min=214, max=2392, avg=1565.08, stdev=1179.13 lat (msec): min=214, max=2392, avg=1565.08, stdev=1179.13 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 2089], 50.00th=[ 2089], 60.00th=[ 2089], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 7656, max= 8031, per=100.00%, avg=7843.50, stdev=265.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.75%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144685: Thu Aug 6 14:16:10 2026 read: IOPS=0, BW=977KiB/s (1000kB/s)(4096KiB/4193msec) clat (nsec): min=813333k, max=813333k, avg=813333364.00, stdev= 0.00 lat (nsec): min=813337k, max=813337k, avg=813337049.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1954KiB/s (2001kB/s)(8192KiB/4193msec); 0 zone resets clat (msec): min=1021, max=1978, avg=1500.06, stdev=676.94 lat (msec): min=1021, max=1981, avg=1501.59, stdev=678.41 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1972], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.81%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144686: Thu Aug 6 14:16:10 2026 write: IOPS=0, BW=3024KiB/s (3097kB/s)(12.0MiB/4063msec); 0 zone resets clat (msec): min=438, max=1757, avg=1268.68, stdev=722.62 lat (msec): min=438, max=1767, avg=1272.41, stdev=726.14 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 7529, max= 8110, per=100.00%, avg=7819.50, stdev=410.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.10%, sys=4.51%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144687: Thu Aug 6 14:16:10 2026 write: IOPS=0, BW=3906KiB/s (4000kB/s)(12.0MiB/3146msec); 0 zone resets clat (msec): min=779, max=1453, avg=1021.94, stdev=375.08 lat (msec): min=780, max=1454, avg=1022.32, stdev=375.18 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 7406, max= 8159, per=99.60%, avg=7782.50, stdev=532.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.67%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3409KiB/s (3491kB/s), 977KiB/s-2557KiB/s (1000kB/s-2618kB/s), io=16.0MiB (16.8MB), run=4193-4806msec WRITE: bw=7815KiB/s (8002kB/s), 1954KiB/s-3906KiB/s (2001kB/s-4000kB/s), io=32.0MiB (33.6MB), run=3146-4193msec