== sanity test 398b: DIO and buffer IO race ============== 03:14:59 (1788592499) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.35781 s, 11.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179306: Sat Sep 5 03:16:57 2026 read: IOPS=14, BW=58.5KiB/s (59.9kB/s)(5992KiB/102373msec) clat (usec): min=36, max=955979, avg=37181.75, stdev=32900.97 lat (usec): min=37, max=955982, avg=37183.52, stdev=32900.92 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 7635], 10.00th=[ 13435], 20.00th=[ 18482], | 30.00th=[ 22938], 40.00th=[ 27657], 50.00th=[ 32637], 60.00th=[ 38011], | 70.00th=[ 44827], 80.00th=[ 53216], 90.00th=[ 65799], 95.00th=[ 77071], | 99.00th=[110625], 99.50th=[130548], 99.90th=[196084], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 143, per=25.05%, avg=58.61, stdev=20.22, samples=201 iops : min= 1, max= 35, avg=14.02, stdev= 5.08, samples=201 write: IOPS=15, BW=61.5KiB/s (62.0kB/s)(6296KiB/102373msec); 0 zone resets clat (usec): min=1001, max=307827, avg=29312.35, stdev=30823.28 lat (usec): min=1001, max=307829, avg=29314.88, stdev=30823.91 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1778], 20.00th=[ 3458], | 30.00th=[ 6063], 40.00th=[ 13829], 50.00th=[ 21890], 60.00th=[ 28705], | 70.00th=[ 37487], 80.00th=[ 50070], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[124257], 99.50th=[141558], 99.90th=[299893], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 8, max= 199, per=25.13%, avg=61.56, stdev=25.51, samples=201 iops : min= 2, max= 49, avg=14.76, stdev= 6.40, samples=201 lat (usec) : 50=0.29%, 100=1.56%, 250=0.36%, 500=0.03%, 1000=0.03% lat (msec) : 2=6.05%, 4=5.70%, 10=7.13%, 20=14.39%, 50=42.64% lat (msec) : 100=19.37%, 250=2.31%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=6.18%, ctx=6932, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179307: Sat Sep 5 03:16:57 2026 read: IOPS=14, BW=59.0KiB/s (60.5kB/s)(5940KiB/100602msec) clat (usec): min=33, max=293625, avg=36889.10, stdev=24418.70 lat (usec): min=33, max=293636, avg=36894.90, stdev=24416.49 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 10814], 10.00th=[ 14484], 20.00th=[ 19006], | 30.00th=[ 22414], 40.00th=[ 27132], 50.00th=[ 32900], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 51643], 90.00th=[ 65274], 95.00th=[ 78119], | 99.00th=[112722], 99.50th=[135267], 99.90th=[256902], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 119, per=25.09%, avg=58.71, stdev=19.79, samples=198 iops : min= 1, max= 29, avg=14.05, stdev= 4.98, samples=198 write: IOPS=15, BW=63.1KiB/s (64.6kB/s)(6348KiB/100602msec); 0 zone resets clat (usec): min=980, max=912101, avg=28553.17, stdev=37764.68 lat (usec): min=981, max=912103, avg=28577.33, stdev=37756.42 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1614], 20.00th=[ 3064], | 30.00th=[ 5080], 40.00th=[ 9896], 50.00th=[ 20055], 60.00th=[ 27395], | 70.00th=[ 35914], 80.00th=[ 49021], 90.00th=[ 67634], 95.00th=[ 86508], | 99.00th=[130548], 99.50th=[158335], 99.90th=[274727], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 8, max= 135, per=25.72%, avg=63.02, stdev=25.06, samples=197 iops : min= 2, max= 33, avg=15.13, stdev= 6.29, samples=197 lat (usec) : 50=0.26%, 100=1.24%, 250=0.20%, 500=0.10%, 1000=0.03% lat (msec) : 2=6.58%, 4=6.54%, 10=7.94%, 20=13.83%, 50=42.48% lat (msec) : 100=18.29%, 250=2.38%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=6.13%, ctx=6643, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179308: Sat Sep 5 03:16:57 2026 read: IOPS=14, BW=59.7KiB/s (61.2kB/s)(6028KiB/100891msec) clat (usec): min=36, max=975356, avg=36941.38, stdev=33570.81 lat (usec): min=36, max=975358, avg=36943.90, stdev=33571.92 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9503], 10.00th=[ 14353], 20.00th=[ 18744], | 30.00th=[ 23200], 40.00th=[ 27132], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 51119], 90.00th=[ 63701], 95.00th=[ 76022], | 99.00th=[124257], 99.50th=[147850], 99.90th=[223347], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 126, per=25.43%, avg=59.51, stdev=20.47, samples=199 iops : min= 1, max= 31, avg=14.25, stdev= 5.15, samples=199 write: IOPS=15, BW=62.0KiB/s (63.5kB/s)(6260KiB/100891msec); 0 zone resets clat (usec): min=887, max=212292, avg=28592.98, stdev=29305.52 lat (usec): min=889, max=212294, avg=28608.35, stdev=29317.52 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1254], 10.00th=[ 1680], 20.00th=[ 3195], | 30.00th=[ 5997], 40.00th=[ 13042], 50.00th=[ 21365], 60.00th=[ 27657], | 70.00th=[ 36963], 80.00th=[ 49546], 90.00th=[ 67634], 95.00th=[ 86508], | 99.00th=[123208], 99.50th=[147850], 99.90th=[210764], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 15, max= 143, per=25.21%, avg=61.76, stdev=24.87, samples=199 iops : min= 3, max= 35, avg=14.81, stdev= 6.25, samples=199 lat (usec) : 50=0.33%, 100=1.66%, 250=0.16%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.12%, 4=6.02%, 10=6.67%, 20=14.49%, 50=43.98% lat (msec) : 100=17.94%, 250=2.31%, 1000=0.03% cpu : usr=0.10%, sys=6.04%, ctx=6697, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179309: Sat Sep 5 03:16:57 2026 read: IOPS=14, BW=59.8KiB/s (61.2kB/s)(6052KiB/101237msec) clat (usec): min=34, max=820709, avg=37642.24, stdev=33260.52 lat (usec): min=34, max=820710, avg=37644.28, stdev=33260.25 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9896], 10.00th=[ 14222], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 27132], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 52167], 90.00th=[ 64226], 95.00th=[ 76022], | 99.00th=[141558], 99.50th=[170918], 99.90th=[299893], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 119, per=25.34%, avg=59.29, stdev=19.15, samples=199 iops : min= 1, max= 29, avg=14.19, stdev= 4.80, samples=199 write: IOPS=15, BW=61.6KiB/s (63.1kB/s)(6236KiB/101237msec); 0 zone resets clat (usec): min=931, max=207891, avg=28122.56, stdev=28146.23 lat (usec): min=932, max=207893, avg=28126.79, stdev=28144.70 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1631], 20.00th=[ 3163], | 30.00th=[ 5932], 40.00th=[ 12387], 50.00th=[ 20841], 60.00th=[ 27919], | 70.00th=[ 36963], 80.00th=[ 50594], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[119014], 99.50th=[133694], 99.90th=[206570], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 7, max= 119, per=24.97%, avg=61.17, stdev=22.38, samples=199 iops : min= 1, max= 29, avg=14.66, stdev= 5.60, samples=199 lat (usec) : 50=0.33%, 100=1.46%, 250=0.23%, 750=0.07%, 1000=0.20% lat (msec) : 2=6.15%, 4=5.60%, 10=7.29%, 20=14.71%, 50=42.68% lat (msec) : 100=18.91%, 250=2.28%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.95%, ctx=6608, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=235KiB/s (240kB/s), 58.5KiB/s-59.8KiB/s (59.9kB/s-61.2kB/s), io=23.4MiB (24.6MB), run=100602-102373msec WRITE: bw=246KiB/s (251kB/s), 61.5KiB/s-63.1KiB/s (62.0kB/s-64.6kB/s), io=24.6MiB (25.7MB), run=100602-102373msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179310: Sat Sep 5 03:17:34 2026 read: IOPS=10, BW=43.0KiB/s (44.1kB/s)(5992KiB/139204msec) clat (msec): min=5, max=969, avg=34.96, stdev=37.93 lat (msec): min=5, max=969, avg=34.97, stdev=37.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 74], 95.00th=[ 95], | 99.00th=[ 146], 99.50th=[ 176], 99.90th=[ 284], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 151, per=25.25%, avg=43.44, stdev=27.47, samples=270 iops : min= 1, max= 37, avg=10.20, stdev= 6.90, samples=270 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6296KiB/139204msec); 0 zone resets clat (msec): min=9, max=306, avg=54.93, stdev=36.20 lat (msec): min=9, max=306, avg=54.93, stdev=36.20 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 80], 90.00th=[ 104], 95.00th=[ 127], | 99.00th=[ 178], 99.50th=[ 220], 99.90th=[ 266], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 134, per=25.05%, avg=45.08, stdev=24.75, samples=273 iops : min= 1, max= 33, avg=10.63, stdev= 6.22, samples=273 lat (msec) : 10=3.03%, 20=18.55%, 50=47.95%, 100=23.01%, 250=7.26% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=2.13%, ctx=4870, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179311: Sat Sep 5 03:17:34 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(5940KiB/138588msec) clat (msec): min=5, max=853, avg=35.75, stdev=37.72 lat (msec): min=5, max=853, avg=35.76, stdev=37.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 80], 95.00th=[ 100], | 99.00th=[ 150], 99.50th=[ 182], 99.90th=[ 284], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 182, per=25.16%, avg=43.28, stdev=27.66, samples=268 iops : min= 1, max= 45, avg=10.16, stdev= 6.93, samples=268 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6348KiB/138588msec); 0 zone resets clat (msec): min=7, max=339, avg=53.61, stdev=36.55 lat (msec): min=7, max=339, avg=53.61, stdev=36.55 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 78], 90.00th=[ 97], 95.00th=[ 121], | 99.00th=[ 184], 99.50th=[ 241], 99.90th=[ 313], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 136, per=25.26%, avg=45.46, stdev=25.34, samples=272 iops : min= 1, max= 34, avg=10.71, stdev= 6.36, samples=272 lat (msec) : 10=3.45%, 20=18.33%, 50=47.88%, 100=23.18%, 250=6.80% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=2.10%, ctx=4869, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179312: Sat Sep 5 03:17:34 2026 read: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6028KiB/139127msec) clat (msec): min=4, max=284, avg=36.60, stdev=31.53 lat (msec): min=4, max=284, avg=36.60, stdev=31.53 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 103], | 99.00th=[ 153], 99.50th=[ 167], 99.90th=[ 279], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 143, per=25.05%, avg=43.09, stdev=26.73, samples=272 iops : min= 1, max= 35, avg=10.12, stdev= 6.70, samples=272 write: IOPS=11, BW=44.0KiB/s (46.1kB/s)(6260KiB/139127msec); 0 zone resets clat (msec): min=9, max=832, avg=53.35, stdev=41.97 lat (msec): min=9, max=832, avg=53.36, stdev=41.97 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 78], 90.00th=[ 104], 95.00th=[ 125], | 99.00th=[ 194], 99.50th=[ 234], 99.90th=[ 326], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 135, per=24.75%, avg=44.55, stdev=26.87, samples=273 iops : min= 1, max= 33, avg=10.48, stdev= 6.75, samples=273 lat (msec) : 10=3.12%, 20=18.82%, 50=48.01%, 100=21.78%, 250=8.01% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.06%, ctx=4849, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179313: Sat Sep 5 03:17:34 2026 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6052KiB/137509msec) clat (msec): min=5, max=279, avg=35.44, stdev=30.71 lat (msec): min=5, max=279, avg=35.45, stdev=30.71 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 144], 99.50th=[ 180], 99.90th=[ 257], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 160, per=25.72%, avg=44.24, stdev=27.73, samples=267 iops : min= 1, max= 40, avg=10.41, stdev= 6.96, samples=267 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6236KiB/137509msec); 0 zone resets clat (msec): min=9, max=807, avg=53.48, stdev=40.57 lat (msec): min=9, max=807, avg=53.49, stdev=40.56 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 60], 80.00th=[ 75], 90.00th=[ 100], 95.00th=[ 124], | 99.00th=[ 178], 99.50th=[ 245], 99.90th=[ 321], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 127, per=25.05%, avg=45.08, stdev=24.68, samples=270 iops : min= 1, max= 31, avg=10.61, stdev= 6.19, samples=270 lat (msec) : 10=3.29%, 20=18.46%, 50=48.63%, 100=22.33%, 250=7.06% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=2.11%, ctx=4784, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=172KiB/s (177kB/s), 42.9KiB/s-44.0KiB/s (43.9kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=137509-139204msec WRITE: bw=181KiB/s (185kB/s), 44.0KiB/s-45.8KiB/s (46.1kB/s-46.9kB/s), io=24.6MiB (25.7MB), run=137509-139204msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179348: Sat Sep 5 03:18:10 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(5920KiB/27077msec) clat (usec): min=41, max=180747, avg=38951.78, stdev=24943.26 lat (usec): min=41, max=180749, avg=38953.15, stdev=24943.32 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 68], 10.00th=[ 12256], 20.00th=[ 21627], | 30.00th=[ 25822], 40.00th=[ 30802], 50.00th=[ 34341], 60.00th=[ 39584], | 70.00th=[ 47973], 80.00th=[ 58459], 90.00th=[ 68682], 95.00th=[ 80217], | 99.00th=[119014], 99.50th=[124257], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 95, max= 410, per=25.50%, avg=217.55, stdev=69.79, samples=53 iops : min= 5, max= 25, avg=12.89, stdev= 4.36, samples=53 write: IOPS=14, BW=235KiB/s (241kB/s)(6368KiB/27077msec); 0 zone resets clat (usec): min=1368, max=145917, avg=31453.53, stdev=29871.40 lat (usec): min=1370, max=145920, avg=31456.18, stdev=29871.40 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1975], 10.00th=[ 2769], 20.00th=[ 5538], | 30.00th=[ 8979], 40.00th=[ 14746], 50.00th=[ 22938], 60.00th=[ 30016], | 70.00th=[ 41157], 80.00th=[ 53216], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[113771], 99.50th=[135267], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 62, max= 410, per=26.25%, avg=235.72, stdev=87.14, samples=53 iops : min= 3, max= 25, avg=14.02, stdev= 5.49, samples=53 lat (usec) : 50=0.78%, 100=3.26%, 250=0.26%, 500=0.13% lat (msec) : 2=2.60%, 4=5.34%, 10=9.51%, 20=10.55%, 50=42.06% lat (msec) : 100=22.40%, 250=3.12% cpu : usr=0.09%, sys=6.88%, ctx=1790, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179349: Sat Sep 5 03:18:10 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5744KiB/28054msec) clat (usec): min=42, max=157223, avg=41278.40, stdev=26802.48 lat (usec): min=42, max=157224, avg=41279.78, stdev=26802.49 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 11863], 20.00th=[ 20579], | 30.00th=[ 25822], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 53216], 80.00th=[ 61080], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[116917], 99.50th=[143655], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 62, max= 383, per=23.94%, avg=204.20, stdev=66.55, samples=55 iops : min= 3, max= 23, avg=12.04, stdev= 4.19, samples=55 write: IOPS=14, BW=233KiB/s (239kB/s)(6544KiB/28054msec); 0 zone resets clat (usec): min=1499, max=177517, avg=32002.48, stdev=30953.90 lat (usec): min=1501, max=177518, avg=32005.37, stdev=30953.99 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2057], 10.00th=[ 3130], 20.00th=[ 5866], | 30.00th=[ 9110], 40.00th=[ 15533], 50.00th=[ 22152], 60.00th=[ 28705], | 70.00th=[ 40109], 80.00th=[ 54264], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[122160], 99.50th=[127402], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 416, per=25.85%, avg=232.13, stdev=89.56, samples=55 iops : min= 1, max= 26, avg=13.80, stdev= 5.68, samples=55 lat (usec) : 50=0.26%, 100=3.12%, 250=0.52%, 500=0.13% lat (msec) : 2=2.21%, 4=4.95%, 10=10.29%, 20=11.59%, 50=38.41% lat (msec) : 100=24.48%, 250=4.04% cpu : usr=0.08%, sys=6.65%, ctx=1830, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179350: Sat Sep 5 03:18:10 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(6256KiB/28036msec) clat (usec): min=41, max=190825, avg=40061.67, stdev=27185.70 lat (usec): min=41, max=190826, avg=40073.01, stdev=27172.88 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 3458], 20.00th=[ 20317], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 58983], 90.00th=[ 71828], 95.00th=[ 84411], | 99.00th=[129500], 99.50th=[177210], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 62, max= 384, per=26.23%, avg=223.76, stdev=73.04, samples=55 iops : min= 3, max= 24, avg=13.27, stdev= 4.68, samples=55 write: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28036msec); 0 zone resets clat (usec): min=1356, max=172195, avg=32644.25, stdev=31430.09 lat (usec): min=1365, max=172199, avg=32646.67, stdev=31430.10 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2343], 10.00th=[ 3163], 20.00th=[ 5473], | 30.00th=[ 10028], 40.00th=[ 16712], 50.00th=[ 23987], 60.00th=[ 30802], | 70.00th=[ 40633], 80.00th=[ 56886], 90.00th=[ 76022], 95.00th=[ 98042], | 99.00th=[137364], 99.50th=[149947], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 63, max= 384, per=23.67%, avg=212.58, stdev=80.62, samples=55 iops : min= 3, max= 24, avg=12.58, stdev= 5.12, samples=55 lat (usec) : 50=0.26%, 100=3.65%, 250=0.91%, 500=0.13% lat (msec) : 2=1.30%, 4=5.47%, 10=8.33%, 20=11.72%, 50=40.23% lat (msec) : 100=24.61%, 250=3.39% cpu : usr=0.07%, sys=6.88%, ctx=1848, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179351: Sat Sep 5 03:18:10 2026 read: IOPS=13, BW=220KiB/s (226kB/s)(6032KiB/27387msec) clat (usec): min=45, max=143799, avg=38030.25, stdev=26306.35 lat (usec): min=46, max=143800, avg=38037.21, stdev=26309.22 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 66], 10.00th=[ 186], 20.00th=[ 19792], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 33162], 60.00th=[ 40109], | 70.00th=[ 46400], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[131597], 99.50th=[133694], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 63, max= 413, per=25.59%, avg=218.24, stdev=77.58, samples=54 iops : min= 3, max= 25, avg=12.93, stdev= 4.91, samples=54 write: IOPS=14, BW=228KiB/s (234kB/s)(6256KiB/27387msec); 0 zone resets clat (usec): min=1435, max=140005, avg=33029.48, stdev=29930.25 lat (usec): min=1437, max=140008, avg=33032.45, stdev=29930.68 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2409], 10.00th=[ 3490], 20.00th=[ 6063], | 30.00th=[ 9372], 40.00th=[ 16188], 50.00th=[ 25822], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[127402], 99.50th=[137364], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 63, max= 413, per=25.36%, avg=227.70, stdev=76.73, samples=54 iops : min= 3, max= 25, avg=13.52, stdev= 4.84, samples=54 lat (usec) : 50=0.13%, 100=4.17%, 250=0.78%, 500=0.39% lat (msec) : 2=1.43%, 4=5.08%, 10=9.64%, 20=11.85%, 50=41.54% lat (msec) : 100=21.61%, 250=3.39% cpu : usr=0.09%, sys=6.81%, ctx=1855, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=854KiB/s (874kB/s), 205KiB/s-223KiB/s (210kB/s-228kB/s), io=23.4MiB (24.5MB), run=27077-28054msec WRITE: bw=898KiB/s (920kB/s), 215KiB/s-235KiB/s (220kB/s-241kB/s), io=24.6MiB (25.8MB), run=27077-28054msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179353: Sat Sep 5 03:18:20 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5920KiB/37204msec) clat (msec): min=6, max=196, avg=38.59, stdev=31.11 lat (msec): min=6, max=196, avg=38.60, stdev=31.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 78], 95.00th=[ 108], | 99.00th=[ 163], 99.50th=[ 188], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 478, per=25.33%, avg=158.85, stdev=102.21, samples=73 iops : min= 1, max= 29, avg= 9.15, stdev= 6.41, samples=73 write: IOPS=10, BW=171KiB/s (175kB/s)(6368KiB/37204msec); 0 zone resets clat (msec): min=12, max=267, avg=57.42, stdev=38.27 lat (msec): min=12, max=267, avg=57.43, stdev=38.27 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 188], 99.50th=[ 234], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 476, per=25.94%, avg=171.21, stdev=98.98, samples=73 iops : min= 1, max= 29, avg= 9.93, stdev= 6.25, samples=73 lat (msec) : 10=1.43%, 20=16.02%, 50=49.09%, 100=23.18%, 250=10.16% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.13%, ctx=1200, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179354: Sat Sep 5 03:18:20 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(5744KiB/38167msec) clat (msec): min=8, max=222, avg=40.70, stdev=34.05 lat (msec): min=8, max=222, avg=40.71, stdev=34.05 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 65], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 171], 99.50th=[ 205], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 24, max= 442, per=24.23%, avg=151.95, stdev=97.78, samples=74 iops : min= 1, max= 27, avg= 8.73, stdev= 6.15, samples=74 write: IOPS=10, BW=171KiB/s (176kB/s)(6544KiB/38167msec); 0 zone resets clat (msec): min=12, max=254, avg=57.33, stdev=38.88 lat (msec): min=12, max=254, avg=57.33, stdev=38.88 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 107], 95.00th=[ 131], | 99.00th=[ 197], 99.50th=[ 236], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 447, per=25.80%, avg=170.31, stdev=93.10, samples=75 iops : min= 1, max= 27, avg= 9.88, stdev= 5.84, samples=75 lat (msec) : 10=1.04%, 20=16.15%, 50=46.48%, 100=27.21%, 250=8.98% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.19%, ctx=1258, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179355: Sat Sep 5 03:18:20 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37809msec) clat (msec): min=7, max=217, avg=40.82, stdev=33.62 lat (msec): min=7, max=217, avg=40.82, stdev=33.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 92], 95.00th=[ 116], | 99.00th=[ 153], 99.50th=[ 184], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 448, per=26.84%, avg=168.30, stdev=107.86, samples=73 iops : min= 1, max= 28, avg= 9.74, stdev= 6.76, samples=73 write: IOPS=9, BW=160KiB/s (163kB/s)(6032KiB/37809msec); 0 zone resets clat (msec): min=10, max=253, avg=57.71, stdev=38.29 lat (msec): min=10, max=253, avg=57.71, stdev=38.29 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 112], 95.00th=[ 138], | 99.00th=[ 194], 99.50th=[ 251], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 31, max= 480, per=23.83%, avg=157.31, stdev=93.87, samples=74 iops : min= 1, max= 30, avg= 9.05, stdev= 5.92, samples=74 lat (msec) : 10=2.34%, 20=16.80%, 50=46.48%, 100=24.61%, 250=9.64% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.25%, ctx=1245, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179356: Sat Sep 5 03:18:20 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37587msec) clat (msec): min=6, max=208, avg=42.36, stdev=35.23 lat (msec): min=6, max=208, avg=42.36, stdev=35.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 101], 95.00th=[ 121], | 99.00th=[ 155], 99.50th=[ 186], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 480, per=25.78%, avg=161.62, stdev=102.20, samples=73 iops : min= 1, max= 30, avg= 9.33, stdev= 6.46, samples=73 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37587msec); 0 zone resets clat (msec): min=12, max=261, avg=55.06, stdev=36.62 lat (msec): min=12, max=261, avg=55.06, stdev=36.62 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 77], 90.00th=[ 99], 95.00th=[ 133], | 99.00th=[ 190], 99.50th=[ 205], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 542, per=25.54%, avg=168.56, stdev=97.48, samples=73 iops : min= 1, max= 33, avg= 9.77, stdev= 6.10, samples=73 lat (msec) : 10=1.95%, 20=15.36%, 50=47.79%, 100=25.26%, 250=9.51% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.27%, ctx=1253, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=628KiB/s (643kB/s), 150KiB/s-165KiB/s (154kB/s-169kB/s), io=23.4MiB (24.5MB), run=37204-38167msec WRITE: bw=660KiB/s (676kB/s), 160KiB/s-171KiB/s (163kB/s-176kB/s), io=24.6MiB (25.8MB), run=37204-38167msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179368: Sat Sep 5 03:18:33 2026 read: IOPS=2, BW=2309KiB/s (2364kB/s)(7168KiB/3105msec) clat (msec): min=79, max=480, avg=215.91, stdev=162.25 lat (msec): min=79, max=480, avg=215.91, stdev=162.25 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 99], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 118], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 405], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1957, max= 5807, per=54.70%, avg=2951.50, stdev=1903.94, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1649KiB/s (1689kB/s)(5120KiB/3105msec); 0 zone resets clat (msec): min=80, max=471, avg=291.56, stdev=166.77 lat (msec): min=80, max=471, avg=291.65, stdev=166.77 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2031, max= 4015, per=33.46%, avg=2528.00, stdev=991.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=7.99%, ctx=123, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179369: Sat Sep 5 03:18:33 2026 read: IOPS=0, BW=555KiB/s (568kB/s)(2048KiB/3691msec) clat (msec): min=60, max=108, avg=84.33, stdev=34.38 lat (msec): min=60, max=108, avg=84.33, stdev=34.38 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 109], | 70.00th=[ 109], 80.00th=[ 109], 90.00th=[ 109], 95.00th=[ 109], | 99.00th=[ 109], 99.50th=[ 109], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 1924, max= 2031, per=36.65%, avg=1977.50, stdev=75.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2774KiB/s (2841kB/s)(10.0MiB/3691msec); 0 zone resets clat (msec): min=120, max=683, avg=344.82, stdev=193.08 lat (msec): min=120, max=683, avg=345.20, stdev=193.47 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 131], | 30.00th=[ 161], 40.00th=[ 257], 50.00th=[ 279], 60.00th=[ 334], | 70.00th=[ 414], 80.00th=[ 506], 90.00th=[ 567], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1924, max= 4096, per=34.26%, avg=2588.14, stdev=1022.29, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=8.43%, ctx=154, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179370: Sat Sep 5 03:18:33 2026 read: IOPS=1, BW=1619KiB/s (1658kB/s)(6144KiB/3795msec) clat (msec): min=63, max=646, avg=223.78, stdev=221.08 lat (msec): min=63, max=647, avg=223.80, stdev=221.12 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 144], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2048, max= 4087, per=63.15%, avg=3407.33, stdev=1177.22, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1619KiB/s (1658kB/s)(6144KiB/3795msec); 0 zone resets clat (msec): min=153, max=786, avg=334.07, stdev=227.69 lat (msec): min=153, max=787, avg=334.15, stdev=227.69 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1426, max= 4096, per=37.99%, avg=2870.00, stdev=1337.18, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.48%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179371: Sat Sep 5 03:18:33 2026 read: IOPS=1, BW=1376KiB/s (1409kB/s)(5120KiB/3722msec) clat (msec): min=57, max=564, avg=241.53, stdev=215.04 lat (msec): min=57, max=564, avg=241.53, stdev=215.04 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 58], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 125], 60.00th=[ 125], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2043, max= 3992, per=55.92%, avg=3017.50, stdev=1378.15, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1926KiB/s (1972kB/s)(7168KiB/3722msec); 0 zone resets clat (msec): min=87, max=579, avg=301.57, stdev=210.81 lat (msec): min=87, max=579, avg=301.64, stdev=210.81 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 92], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 203], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 514], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2031, max= 3915, per=35.25%, avg=2663.00, stdev=1084.28, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=4.65%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5397KiB/s (5526kB/s), 555KiB/s-2309KiB/s (568kB/s-2364kB/s), io=20.0MiB (20.0MB), run=3105-3795msec WRITE: bw=7555KiB/s (7737kB/s), 1619KiB/s-2774KiB/s (1658kB/s-2841kB/s), io=28.0MiB (29.4MB), run=3105-3795msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179372: Sat Sep 5 03:18:33 2026 read: IOPS=2, BW=2161KiB/s (2213kB/s)(7168KiB/3317msec) clat (usec): min=902, max=536825, avg=145361.62, stdev=204139.09 lat (usec): min=904, max=536826, avg=145363.27, stdev=204139.06 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 906], 10.00th=[ 906], 20.00th=[ 2507], | 30.00th=[ 7308], 40.00th=[ 7308], 50.00th=[ 8455], 60.00th=[191890], | 70.00th=[191890], 80.00th=[270533], 90.00th=[534774], 95.00th=[534774], | 99.00th=[534774], 99.50th=[534774], 99.90th=[534774], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 2048, max= 4071, per=59.84%, avg=3004.00, stdev=1107.61, samples=4 iops : min= 2, max= 3, avg= 2.50, stdev= 0.58, samples=4 write: IOPS=1, BW=1544KiB/s (1581kB/s)(5120KiB/3317msec); 0 zone resets clat (msec): min=174, max=691, avg=371.73, stdev=224.14 lat (msec): min=174, max=692, avg=372.02, stdev=224.52 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1924, max= 3976, per=37.69%, avg=2649.33, stdev=1150.60, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 10=16.67%, 250=33.33%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=17.10%, ctx=244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179373: Sat Sep 5 03:18:33 2026 read: IOPS=0, BW=502KiB/s (514kB/s)(2048KiB/4079msec) clat (msec): min=151, max=175, avg=163.15, stdev=17.09 lat (msec): min=151, max=175, avg=163.15, stdev=17.09 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 1532, max= 1988, per=35.06%, avg=1760.00, stdev=322.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2510KiB/s (2571kB/s)(10.0MiB/4079msec); 0 zone resets clat (msec): min=75, max=954, avg=358.99, stdev=293.81 lat (msec): min=75, max=954, avg=359.07, stdev=293.79 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 107], | 30.00th=[ 112], 40.00th=[ 182], 50.00th=[ 255], 60.00th=[ 271], | 70.00th=[ 426], 80.00th=[ 460], 90.00th=[ 751], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1532, max= 2048, per=27.45%, avg=1929.17, stdev=200.34, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=17.61%, ctx=139, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179374: Sat Sep 5 03:18:33 2026 read: IOPS=1, BW=1802KiB/s (1846kB/s)(6144KiB/3409msec) clat (usec): min=617, max=317472, avg=123249.90, stdev=144872.73 lat (usec): min=619, max=317473, avg=123251.23, stdev=144872.89 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[ 734], 50.00th=[ 734], 60.00th=[149947], | 70.00th=[270533], 80.00th=[270533], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 1988, max= 4096, per=65.96%, avg=3311.00, stdev=1152.39, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1802KiB/s (1846kB/s)(6144KiB/3409msec); 0 zone resets clat (msec): min=137, max=843, avg=368.11, stdev=257.55 lat (msec): min=137, max=843, avg=368.93, stdev=257.27 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 313], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1924, max= 4096, per=35.72%, avg=2510.75, stdev=1057.81, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=25.00% lat (msec) : 250=25.00%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=13.76%, ctx=159, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179375: Sat Sep 5 03:18:33 2026 read: IOPS=1, BW=2001KiB/s (2049kB/s)(5120KiB/2559msec) clat (msec): min=75, max=183, avg=141.73, stdev=42.24 lat (msec): min=75, max=183, avg=141.73, stdev=42.24 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 184], 95.00th=[ 184], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2801KiB/s (2868kB/s)(7168KiB/2559msec); 0 zone resets clat (msec): min=207, max=317, avg=253.78, stdev=38.88 lat (msec): min=208, max=318, avg=253.87, stdev=38.88 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 224], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 284], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 3088, max= 4071, per=52.20%, avg=3669.33, stdev=515.54, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=25.00% cpu : usr=0.04%, sys=24.08%, ctx=210, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5021KiB/s (5141kB/s), 502KiB/s-2161KiB/s (514kB/s-2213kB/s), io=20.0MiB (20.0MB), run=2559-4079msec WRITE: bw=7029KiB/s (7198kB/s), 1544KiB/s-2801KiB/s (1581kB/s-2868kB/s), io=28.0MiB (29.4MB), run=2559-4079msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179382: Sat Sep 5 03:18:46 2026 read: IOPS=2, BW=9555KiB/s (9785kB/s)(12.0MiB/1286msec) clat (msec): min=344, max=526, avg=408.92, stdev=102.13 lat (msec): min=344, max=526, avg=408.92, stdev=102.13 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 5777, max= 8192, per=100.00%, avg=6984.50, stdev=1707.66, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=12.06%, ctx=73, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179383: Sat Sep 5 03:18:46 2026 read: IOPS=0, BW=1604KiB/s (1643kB/s)(4096KiB/2553msec) clat (nsec): min=868879k, max=868879k, avg=868879440.00, stdev= 0.00 lat (nsec): min=868881k, max=868881k, avg=868881407.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3209KiB/s (3286kB/s)(8192KiB/2553msec); 0 zone resets clat (msec): min=585, max=1002, avg=794.01, stdev=294.77 lat (msec): min=586, max=1002, avg=794.65, stdev=294.34 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8078, max= 8078, per=68.81%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.49%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179385: Sat Sep 5 03:18:46 2026 write: IOPS=1, BW=4403KiB/s (4508kB/s)(12.0MiB/2791msec); 0 zone resets clat (msec): min=190, max=1348, avg=880.45, stdev=610.07 lat (msec): min=190, max=1349, avg=881.15, stdev=610.45 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8078, max= 8078, per=68.81%, avg=8078.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.01%, ctx=38, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179386: Sat Sep 5 03:18:46 2026 write: IOPS=1, BW=4963KiB/s (5082kB/s)(12.0MiB/2476msec); 0 zone resets clat (msec): min=239, max=1125, avg=771.07, stdev=469.09 lat (msec): min=239, max=1126, avg=771.80, stdev=469.53 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 6196, max= 8078, per=60.79%, avg=7137.00, stdev=1330.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.71%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6418KiB/s (6572kB/s), 1604KiB/s-9555KiB/s (1643kB/s-9785kB/s), io=16.0MiB (16.8MB), run=1286-2553msec WRITE: bw=11.5MiB/s (12.0MB/s), 3209KiB/s-4963KiB/s (3286kB/s-5082kB/s), io=32.0MiB (33.6MB), run=2476-2791msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179387: Sat Sep 5 03:18:46 2026 read: IOPS=1, BW=6508KiB/s (6665kB/s)(12.0MiB/1888msec) clat (msec): min=614, max=637, avg=628.86, stdev=12.82 lat (msec): min=614, max=637, avg=628.86, stdev=12.82 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 5826, max= 8192, per=98.48%, avg=7009.00, stdev=1673.01, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.32%, sys=21.99%, ctx=455, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179388: Sat Sep 5 03:18:46 2026 read: IOPS=0, BW=1779KiB/s (1822kB/s)(4096KiB/2302msec) clat (nsec): min=595735k, max=595735k, avg=595734971.00, stdev= 0.00 lat (nsec): min=595737k, max=595737k, avg=595737363.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 6159, max= 6159, per=86.54%, avg=6159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3559KiB/s (3644kB/s)(8192KiB/2302msec); 0 zone resets clat (msec): min=764, max=935, avg=850.25, stdev=121.20 lat (msec): min=764, max=937, avg=851.17, stdev=121.93 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8192, max= 8192, per=68.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.87%, ctx=166, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179389: Sat Sep 5 03:18:46 2026 write: IOPS=1, BW=4536KiB/s (4645kB/s)(12.0MiB/2709msec); 0 zone resets clat (msec): min=122, max=1291, avg=900.90, stdev=673.95 lat (msec): min=123, max=1291, avg=901.21, stdev=673.88 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8126, max= 8192, per=68.30%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.06%, ctx=38, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179390: Sat Sep 5 03:18:46 2026 write: IOPS=1, BW=4480KiB/s (4587kB/s)(12.0MiB/2743msec); 0 zone resets clat (msec): min=223, max=2006, avg=911.70, stdev=958.92 lat (msec): min=223, max=2007, avg=912.24, stdev=958.85 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 5557, max= 5557, per=46.52%, avg=5557.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=4.08%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7117KiB/s (7288kB/s), 1779KiB/s-6508KiB/s (1822kB/s-6665kB/s), io=16.0MiB (16.8MB), run=1888-2302msec WRITE: bw=11.7MiB/s (12.2MB/s), 3559KiB/s-4536KiB/s (3644kB/s-4645kB/s), io=32.0MiB (33.6MB), run=2302-2743msec