== sanity test 398b: DIO and buffer IO race ============== 11:52:25 (1787586745) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.07886 s, 9.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179619: Mon Aug 24 11:54:23 2026 read: IOPS=14, BW=58.5KiB/s (59.9kB/s)(5992KiB/102491msec) clat (usec): min=42, max=906570, avg=36657.69, stdev=32090.83 lat (usec): min=43, max=906572, avg=36683.52, stdev=32099.21 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9241], 10.00th=[ 14091], 20.00th=[ 18482], | 30.00th=[ 22414], 40.00th=[ 26870], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 50594], 90.00th=[ 63701], 95.00th=[ 78119], | 99.00th=[119014], 99.50th=[135267], 99.90th=[193987], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 111, per=25.02%, avg=58.29, stdev=19.89, samples=202 iops : min= 1, max= 27, avg=13.95, stdev= 5.00, samples=202 write: IOPS=15, BW=61.4KiB/s (62.9kB/s)(6296KiB/102491msec); 0 zone resets clat (usec): min=891, max=188581, avg=29916.67, stdev=29249.19 lat (usec): min=893, max=188582, avg=29919.21, stdev=29249.67 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1369], 10.00th=[ 1991], 20.00th=[ 3752], | 30.00th=[ 7046], 40.00th=[ 15270], 50.00th=[ 22414], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 68682], 95.00th=[ 89654], | 99.00th=[119014], 99.50th=[137364], 99.90th=[179307], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 15, max= 182, per=25.22%, avg=61.54, stdev=24.06, samples=201 iops : min= 3, max= 45, avg=14.76, stdev= 6.04, samples=201 lat (usec) : 50=0.20%, 100=1.43%, 250=0.39%, 500=0.07%, 1000=0.13% lat (msec) : 2=5.18%, 4=5.79%, 10=7.16%, 20=14.91%, 50=43.52% lat (msec) : 100=18.75%, 250=2.44%, 1000=0.03% cpu : usr=0.08%, sys=6.68%, ctx=6880, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179621: Mon Aug 24 11:54:23 2026 read: IOPS=14, BW=58.9KiB/s (60.3kB/s)(5940KiB/100792msec) clat (usec): min=40, max=172243, avg=36739.90, stdev=22762.16 lat (usec): min=40, max=172245, avg=36741.77, stdev=22762.27 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11338], 10.00th=[ 14877], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 26870], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 64226], 95.00th=[ 76022], | 99.00th=[113771], 99.50th=[132645], 99.90th=[162530], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 7, max= 111, per=25.22%, avg=58.77, stdev=19.28, samples=199 iops : min= 1, max= 27, avg=14.07, stdev= 4.86, samples=199 write: IOPS=15, BW=62.0KiB/s (64.5kB/s)(6348KiB/100792msec); 0 zone resets clat (usec): min=997, max=891077, avg=28826.16, stdev=35953.03 lat (usec): min=998, max=891079, avg=28830.29, stdev=35951.99 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1385], 10.00th=[ 2024], 20.00th=[ 3818], | 30.00th=[ 6652], 40.00th=[ 13566], 50.00th=[ 20317], 60.00th=[ 27657], | 70.00th=[ 35914], 80.00th=[ 47973], 90.00th=[ 68682], 95.00th=[ 85459], | 99.00th=[119014], 99.50th=[143655], 99.90th=[200279], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 15, max= 134, per=25.88%, avg=63.14, stdev=23.68, samples=198 iops : min= 3, max= 33, avg=15.16, stdev= 5.94, samples=198 lat (usec) : 50=0.07%, 100=1.24%, 250=0.20%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.01%, 4=6.05%, 10=7.88%, 20=16.41%, 50=42.09% lat (msec) : 100=18.75%, 250=2.21%, 1000=0.03% cpu : usr=0.10%, sys=6.76%, ctx=6932, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179623: Mon Aug 24 11:54:23 2026 read: IOPS=14, BW=58.7KiB/s (60.1kB/s)(6028KiB/102641msec) clat (usec): min=34, max=197414, avg=36293.62, stdev=23222.60 lat (usec): min=34, max=197415, avg=36299.71, stdev=23224.20 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9503], 10.00th=[ 13698], 20.00th=[ 19006], | 30.00th=[ 23200], 40.00th=[ 27132], 50.00th=[ 31589], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 51643], 90.00th=[ 65799], 95.00th=[ 77071], | 99.00th=[110625], 99.50th=[141558], 99.90th=[181404], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 15, max= 134, per=25.33%, avg=59.02, stdev=20.74, samples=200 iops : min= 3, max= 33, avg=14.13, stdev= 5.20, samples=200 write: IOPS=15, BW=60.0KiB/s (62.5kB/s)(6260KiB/102641msec); 0 zone resets clat (usec): min=890, max=1020.1k, avg=30365.72, stdev=38634.62 lat (usec): min=891, max=1020.1k, avg=30368.84, stdev=38633.98 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1336], 10.00th=[ 1844], | 20.00th=[ 3425], 30.00th=[ 5997], 40.00th=[ 14746], | 50.00th=[ 22414], 60.00th=[ 29492], 70.00th=[ 40109], | 80.00th=[ 50594], 90.00th=[ 70779], 95.00th=[ 90702], | 99.00th=[ 126354], 99.50th=[ 145753], 99.90th=[ 185598], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 15, max= 127, per=24.94%, avg=60.87, stdev=24.29, samples=201 iops : min= 3, max= 31, avg=14.59, stdev= 6.08, samples=201 lat (usec) : 50=0.33%, 100=1.66%, 250=0.23%, 1000=0.07% lat (msec) : 2=5.83%, 4=5.76%, 10=6.87%, 20=13.93%, 50=44.47% lat (msec) : 100=18.42%, 250=2.41%, 2000=0.03% cpu : usr=0.09%, sys=6.54%, ctx=6845, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179625: Mon Aug 24 11:54:23 2026 read: IOPS=14, BW=58.0KiB/s (60.4kB/s)(6052KiB/102582msec) clat (usec): min=41, max=210541, avg=36965.46, stdev=24270.86 lat (usec): min=41, max=210543, avg=36970.60, stdev=24269.85 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9503], 10.00th=[ 14222], 20.00th=[ 19006], | 30.00th=[ 22414], 40.00th=[ 27132], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 52167], 90.00th=[ 65799], 95.00th=[ 79168], | 99.00th=[128451], 99.50th=[149947], 99.90th=[170918], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 103, per=25.39%, avg=59.16, stdev=19.29, samples=201 iops : min= 1, max= 25, avg=14.16, stdev= 4.84, samples=201 write: IOPS=15, BW=60.8KiB/s (62.2kB/s)(6236KiB/102582msec); 0 zone resets clat (usec): min=950, max=1004.0k, avg=29633.25, stdev=37697.05 lat (usec): min=951, max=1004.0k, avg=29639.47, stdev=37694.79 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1401], 10.00th=[ 2089], | 20.00th=[ 3785], 30.00th=[ 6325], 40.00th=[ 13435], | 50.00th=[ 21890], 60.00th=[ 29230], 70.00th=[ 38011], | 80.00th=[ 51119], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[ 115868], 99.50th=[ 139461], 99.90th=[ 181404], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 142, per=24.97%, avg=60.93, stdev=23.77, samples=201 iops : min= 1, max= 35, avg=14.60, stdev= 5.95, samples=201 lat (usec) : 50=0.26%, 100=1.33%, 250=0.26%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.85%, 4=6.35%, 10=7.88%, 20=14.10%, 50=43.36% lat (msec) : 100=18.75%, 250=2.54%, 2000=0.03% cpu : usr=0.10%, sys=6.86%, ctx=7033, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=234KiB/s (240kB/s), 58.5KiB/s-58.0KiB/s (59.9kB/s-60.4kB/s), io=23.4MiB (24.6MB), run=100792-102641msec WRITE: bw=245KiB/s (251kB/s), 60.8KiB/s-62.0KiB/s (62.2kB/s-64.5kB/s), io=24.6MiB (25.7MB), run=100792-102641msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179620: Mon Aug 24 11:54:58 2026 read: IOPS=10, BW=43.4KiB/s (44.4kB/s)(5992KiB/138095msec) clat (msec): min=4, max=915, avg=34.89, stdev=35.98 lat (msec): min=4, max=915, avg=34.89, stdev=35.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 93], | 99.00th=[ 138], 99.50th=[ 148], 99.90th=[ 207], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 182, per=25.31%, avg=43.79, stdev=28.25, samples=268 iops : min= 1, max= 45, avg=10.31, stdev= 7.09, samples=268 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6296KiB/138095msec); 0 zone resets clat (msec): min=8, max=269, avg=54.28, stdev=35.99 lat (msec): min=8, max=269, avg=54.28, stdev=35.99 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 80], 90.00th=[ 104], 95.00th=[ 130], | 99.00th=[ 176], 99.50th=[ 207], 99.90th=[ 245], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 135, per=24.90%, avg=45.32, stdev=24.40, samples=272 iops : min= 1, max= 33, avg=10.69, stdev= 6.14, samples=272 lat (msec) : 10=3.45%, 20=19.08%, 50=46.48%, 100=23.47%, 250=7.45% lat (msec) : 500=0.03%, 1000=0.03% cpu : usr=0.06%, sys=2.32%, ctx=4838, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179622: Mon Aug 24 11:54:58 2026 read: IOPS=10, BW=43.1KiB/s (44.1kB/s)(5940KiB/137850msec) clat (msec): min=5, max=974, avg=35.49, stdev=39.54 lat (msec): min=5, max=975, avg=35.50, stdev=39.54 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 161], 99.50th=[ 184], 99.90th=[ 262], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 167, per=25.03%, avg=43.31, stdev=28.43, samples=268 iops : min= 1, max= 41, avg=10.20, stdev= 7.14, samples=268 write: IOPS=11, BW=46.0KiB/s (47.2kB/s)(6348KiB/137850msec); 0 zone resets clat (msec): min=8, max=308, avg=53.40, stdev=35.04 lat (msec): min=8, max=308, avg=53.40, stdev=35.04 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 64], 80.00th=[ 78], 90.00th=[ 100], 95.00th=[ 121], | 99.00th=[ 178], 99.50th=[ 205], 99.90th=[ 296], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 159, per=25.08%, avg=45.64, stdev=25.76, samples=271 iops : min= 1, max= 39, avg=10.78, stdev= 6.48, samples=271 lat (msec) : 10=3.91%, 20=18.68%, 50=47.30%, 100=22.69%, 250=7.26% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=2.25%, ctx=4852, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179624: Mon Aug 24 11:54:58 2026 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6028KiB/136977msec) clat (msec): min=4, max=260, avg=35.37, stdev=29.72 lat (msec): min=4, max=260, avg=35.37, stdev=29.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 97], | 99.00th=[ 146], 99.50th=[ 165], 99.90th=[ 209], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 143, per=25.28%, avg=43.73, stdev=26.08, samples=269 iops : min= 1, max= 35, avg=10.29, stdev= 6.55, samples=269 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6260KiB/136977msec); 0 zone resets clat (msec): min=12, max=1005, avg=53.21, stdev=41.34 lat (msec): min=12, max=1005, avg=53.21, stdev=41.34 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 77], 90.00th=[ 100], 95.00th=[ 117], | 99.00th=[ 169], 99.50th=[ 186], 99.90th=[ 296], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 135, per=24.89%, avg=45.30, stdev=26.13, samples=269 iops : min= 1, max= 33, avg=10.70, stdev= 6.56, samples=269 lat (msec) : 10=2.96%, 20=18.10%, 50=48.24%, 100=23.50%, 250=7.06% lat (msec) : 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=2.34%, ctx=4908, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179626: Mon Aug 24 11:54:58 2026 read: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6052KiB/137599msec) clat (msec): min=5, max=238, avg=35.46, stdev=29.82 lat (msec): min=5, max=238, avg=35.46, stdev=29.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 75], 95.00th=[ 99], | 99.00th=[ 136], 99.50th=[ 174], 99.90th=[ 218], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7, max= 159, per=25.66%, avg=44.40, stdev=26.95, samples=267 iops : min= 1, max= 39, avg=10.46, stdev= 6.77, samples=267 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6236KiB/137599msec); 0 zone resets clat (msec): min=8, max=997, avg=53.60, stdev=42.92 lat (msec): min=8, max=997, avg=53.60, stdev=42.92 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 77], 90.00th=[ 101], 95.00th=[ 124], | 99.00th=[ 178], 99.50th=[ 211], 99.90th=[ 313], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 159, per=24.76%, avg=45.06, stdev=25.14, samples=271 iops : min= 1, max= 39, avg=10.63, stdev= 6.30, samples=271 lat (msec) : 10=3.52%, 20=18.39%, 50=47.82%, 100=22.88%, 250=7.26% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=2.23%, ctx=4731, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (178kB/s), 43.1KiB/s-44.0KiB/s (44.1kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=136977-138095msec WRITE: bw=182KiB/s (186kB/s), 45.3KiB/s-46.0KiB/s (46.4kB/s-47.2kB/s), io=24.6MiB (25.7MB), run=136977-138095msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179666: Mon Aug 24 11:55:40 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5920KiB/28299msec) clat (usec): min=48, max=202587, avg=42362.69, stdev=28376.09 lat (usec): min=48, max=202588, avg=42406.57, stdev=28368.12 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 14222], 20.00th=[ 23462], | 30.00th=[ 28181], 40.00th=[ 33424], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 50070], 80.00th=[ 58983], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[143655], 99.50th=[193987], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 124, max= 480, per=26.60%, avg=208.04, stdev=64.02, samples=55 iops : min= 7, max= 30, avg=12.24, stdev= 4.10, samples=55 write: IOPS=14, BW=225KiB/s (230kB/s)(6368KiB/28299msec); 0 zone resets clat (usec): min=1646, max=163966, avg=31217.67, stdev=30125.25 lat (usec): min=1647, max=163968, avg=31228.35, stdev=30124.64 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2245], 10.00th=[ 2933], 20.00th=[ 5735], | 30.00th=[ 9110], 40.00th=[ 15008], 50.00th=[ 20579], 60.00th=[ 28705], | 70.00th=[ 40109], 80.00th=[ 53216], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[126354], 99.50th=[139461], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 62, max= 447, per=27.32%, avg=224.87, stdev=95.93, samples=55 iops : min= 3, max= 27, avg=13.29, stdev= 6.08, samples=55 lat (usec) : 50=0.13%, 100=2.99%, 250=0.39%, 500=0.26% lat (msec) : 2=2.21%, 4=5.08%, 10=10.03%, 20=11.98%, 50=40.49% lat (msec) : 100=22.40%, 250=4.04% cpu : usr=0.08%, sys=6.34%, ctx=1771, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179669: Mon Aug 24 11:55:40 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5744KiB/29480msec) clat (usec): min=40, max=184179, avg=43308.07, stdev=27859.27 lat (usec): min=40, max=184180, avg=43309.22, stdev=27859.28 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 68], 10.00th=[ 15533], 20.00th=[ 23200], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[143655], 99.50th=[154141], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 62, max= 415, per=24.93%, avg=194.95, stdev=80.87, samples=57 iops : min= 3, max= 25, avg=11.40, stdev= 5.15, samples=57 write: IOPS=13, BW=222KiB/s (227kB/s)(6544KiB/29480msec); 0 zone resets clat (usec): min=1272, max=250390, avg=33868.02, stdev=32794.87 lat (usec): min=1274, max=250393, avg=33870.66, stdev=32795.11 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2343], 10.00th=[ 3130], 20.00th=[ 6259], | 30.00th=[ 10421], 40.00th=[ 19792], 50.00th=[ 25297], 60.00th=[ 31327], | 70.00th=[ 44303], 80.00th=[ 55313], 90.00th=[ 77071], 95.00th=[100140], | 99.00th=[139461], 99.50th=[164627], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 94, max= 448, per=26.83%, avg=220.84, stdev=93.90, samples=57 iops : min= 5, max= 28, avg=13.05, stdev= 5.97, samples=57 lat (usec) : 50=0.52%, 100=2.73%, 250=0.13%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.34%, 4=4.69%, 10=8.72%, 20=9.24%, 50=42.71% lat (msec) : 100=23.83%, 250=4.69%, 500=0.13% cpu : usr=0.04%, sys=5.92%, ctx=1803, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179672: Mon Aug 24 11:55:40 2026 read: IOPS=12, BW=205KiB/s (209kB/s)(6256KiB/30588msec) clat (usec): min=46, max=184906, avg=42353.46, stdev=26329.53 lat (usec): min=46, max=184907, avg=42354.61, stdev=26329.56 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 545], 10.00th=[ 17695], 20.00th=[ 22676], | 30.00th=[ 27657], 40.00th=[ 33424], 50.00th=[ 39060], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 57934], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[168821], 99.50th=[183501], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 448, per=26.33%, avg=205.93, stdev=92.10, samples=60 iops : min= 1, max= 28, avg=12.10, stdev= 5.89, samples=60 write: IOPS=12, BW=197KiB/s (202kB/s)(6032KiB/30588msec); 0 zone resets clat (usec): min=1556, max=258626, avg=36181.11, stdev=35111.12 lat (usec): min=1558, max=258628, avg=36183.74, stdev=35111.27 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2180], 10.00th=[ 3490], 20.00th=[ 7046], | 30.00th=[ 12518], 40.00th=[ 20579], 50.00th=[ 27657], 60.00th=[ 34341], | 70.00th=[ 43779], 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[109577], | 99.00th=[166724], 99.50th=[170918], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 63, max= 480, per=23.83%, avg=196.10, stdev=82.07, samples=60 iops : min= 3, max= 30, avg=11.48, stdev= 5.17, samples=60 lat (usec) : 50=0.26%, 100=1.95%, 250=0.26%, 750=0.13% lat (msec) : 2=1.95%, 4=3.39%, 10=8.46%, 20=9.90%, 50=45.70% lat (msec) : 100=23.83%, 250=4.04%, 500=0.13% cpu : usr=0.06%, sys=5.93%, ctx=1840, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179673: Mon Aug 24 11:55:40 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(6032KiB/30616msec) clat (usec): min=38, max=212452, avg=43580.95, stdev=30473.14 lat (usec): min=38, max=212453, avg=43582.12, stdev=30473.19 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 15008], 20.00th=[ 23462], | 30.00th=[ 27395], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[170918], 99.50th=[185598], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 62, max= 447, per=25.20%, avg=197.10, stdev=79.62, samples=60 iops : min= 3, max= 27, avg=11.55, stdev= 5.01, samples=60 write: IOPS=12, BW=204KiB/s (209kB/s)(6256KiB/30616msec); 0 zone resets clat (usec): min=1326, max=149871, avg=35660.35, stdev=31753.12 lat (usec): min=1327, max=149873, avg=35663.72, stdev=31752.08 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2278], 10.00th=[ 4146], 20.00th=[ 6587], | 30.00th=[ 11469], 40.00th=[ 18744], 50.00th=[ 27657], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 61604], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[132645], 99.50th=[135267], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 62, max= 442, per=24.91%, avg=205.00, stdev=84.39, samples=60 iops : min= 3, max= 27, avg=12.05, stdev= 5.36, samples=60 lat (usec) : 50=0.26%, 100=2.99%, 250=0.26%, 1000=0.13% lat (msec) : 2=2.08%, 4=2.86%, 10=8.59%, 20=11.46%, 50=41.80% lat (msec) : 100=23.83%, 250=5.73% cpu : usr=0.08%, sys=6.17%, ctx=1835, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=782KiB/s (801kB/s), 195KiB/s-209KiB/s (200kB/s-214kB/s), io=23.4MiB (24.5MB), run=28299-30616msec WRITE: bw=823KiB/s (843kB/s), 197KiB/s-225KiB/s (202kB/s-230kB/s), io=24.6MiB (25.8MB), run=28299-30616msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179667: Mon Aug 24 11:55:50 2026 read: IOPS=9, BW=149KiB/s (152kB/s)(5920KiB/39811msec) clat (msec): min=7, max=202, avg=41.14, stdev=34.35 lat (msec): min=7, max=202, avg=41.14, stdev=34.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 115], | 99.00th=[ 174], 99.50th=[ 176], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 31, max= 447, per=24.95%, avg=149.47, stdev=92.59, samples=76 iops : min= 1, max= 27, avg= 8.53, stdev= 5.82, samples=76 write: IOPS=9, BW=160KiB/s (164kB/s)(6368KiB/39811msec); 0 zone resets clat (msec): min=13, max=260, avg=61.22, stdev=42.14 lat (msec): min=13, max=260, avg=61.23, stdev=42.15 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 92], 90.00th=[ 124], 95.00th=[ 150], | 99.00th=[ 213], 99.50th=[ 245], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 446, per=25.53%, avg=160.86, stdev=91.14, samples=77 iops : min= 1, max= 27, avg= 9.23, stdev= 5.76, samples=77 lat (msec) : 10=1.17%, 20=14.45%, 50=49.22%, 100=22.79%, 250=12.24% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.05%, ctx=1170, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179668: Mon Aug 24 11:55:50 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5744KiB/39981msec) clat (msec): min=6, max=190, avg=40.77, stdev=34.85 lat (msec): min=6, max=190, avg=40.77, stdev=34.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 90], 95.00th=[ 124], | 99.00th=[ 159], 99.50th=[ 171], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 30, max= 411, per=24.35%, avg=145.87, stdev=92.06, samples=77 iops : min= 1, max= 25, avg= 8.30, stdev= 5.82, samples=77 write: IOPS=10, BW=164KiB/s (168kB/s)(6544KiB/39981msec); 0 zone resets clat (msec): min=12, max=262, avg=61.70, stdev=43.97 lat (msec): min=12, max=262, avg=61.70, stdev=43.97 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 123], 95.00th=[ 155], | 99.00th=[ 213], 99.50th=[ 247], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 480, per=26.06%, avg=164.15, stdev=97.14, samples=78 iops : min= 1, max= 30, avg= 9.45, stdev= 6.14, samples=78 lat (msec) : 10=2.08%, 20=15.23%, 50=48.18%, 100=21.35%, 250=12.89% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.91%, ctx=1193, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179670: Mon Aug 24 11:55:50 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(6256KiB/39542msec) clat (msec): min=7, max=209, avg=41.47, stdev=34.36 lat (msec): min=7, max=209, avg=41.47, stdev=34.36 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 114], | 99.00th=[ 165], 99.50th=[ 180], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 479, per=26.78%, avg=160.43, stdev=108.57, samples=77 iops : min= 1, max= 29, avg= 9.21, stdev= 6.85, samples=77 write: IOPS=9, BW=153KiB/s (156kB/s)(6032KiB/39542msec); 0 zone resets clat (msec): min=12, max=287, avg=60.93, stdev=41.62 lat (msec): min=12, max=287, avg=60.94, stdev=41.62 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 90], 90.00th=[ 124], 95.00th=[ 148], | 99.00th=[ 182], 99.50th=[ 262], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 510, per=23.90%, avg=150.55, stdev=90.94, samples=78 iops : min= 1, max= 31, avg= 8.59, stdev= 5.74, samples=78 lat (msec) : 10=1.56%, 20=15.36%, 50=47.27%, 100=22.92%, 250=12.63% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.97%, ctx=1207, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179671: Mon Aug 24 11:55:50 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6032KiB/39841msec) clat (msec): min=5, max=183, avg=40.62, stdev=33.98 lat (msec): min=5, max=183, avg=40.62, stdev=33.98 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 93], 95.00th=[ 124], | 99.00th=[ 169], 99.50th=[ 174], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 542, per=25.02%, avg=149.86, stdev=97.77, samples=78 iops : min= 1, max= 33, avg= 8.53, stdev= 6.18, samples=78 write: IOPS=9, BW=157KiB/s (161kB/s)(6256KiB/39841msec); 0 zone resets clat (msec): min=15, max=246, avg=61.85, stdev=40.07 lat (msec): min=15, max=246, avg=61.86, stdev=40.07 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 89], 90.00th=[ 127], 95.00th=[ 148], | 99.00th=[ 186], 99.50th=[ 205], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 411, per=24.79%, avg=156.17, stdev=88.31, samples=78 iops : min= 1, max= 25, avg= 8.92, stdev= 5.55, samples=78 lat (msec) : 10=1.82%, 20=13.67%, 50=48.96%, 100=23.18%, 250=12.37% cpu : usr=0.04%, sys=2.11%, ctx=1217, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=599KiB/s (613kB/s), 144KiB/s-158KiB/s (147kB/s-162kB/s), io=23.4MiB (24.5MB), run=39542-39981msec WRITE: bw=630KiB/s (645kB/s), 153KiB/s-164KiB/s (156kB/s-168kB/s), io=24.6MiB (25.8MB), run=39542-39981msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179685: Mon Aug 24 11:56:03 2026 read: IOPS=2, BW=2166KiB/s (2218kB/s)(7168KiB/3309msec) clat (usec): min=586, max=445883, avg=202269.98, stdev=158183.13 lat (usec): min=588, max=445884, avg=202271.60, stdev=158183.18 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 2114], | 30.00th=[208667], 40.00th=[208667], 50.00th=[221250], 60.00th=[248513], | 70.00th=[248513], 80.00th=[287310], 90.00th=[446694], 95.00th=[446694], | 99.00th=[446694], 99.50th=[446694], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 1802, max= 2959, per=46.93%, avg=2161.80, stdev=456.13, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=1, BW=1547KiB/s (1584kB/s)(5120KiB/3309msec); 0 zone resets clat (msec): min=225, max=597, avg=362.79, stdev=144.06 lat (msec): min=225, max=597, avg=362.88, stdev=144.08 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1802, max= 4055, per=40.87%, avg=2635.00, stdev=1235.89, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=19.53%, ctx=182, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179686: Mon Aug 24 11:56:03 2026 read: IOPS=0, BW=461KiB/s (472kB/s)(2048KiB/4446msec) clat (usec): min=565, max=214550, avg=107557.98, stdev=151309.66 lat (usec): min=567, max=214550, avg=107559.05, stdev=151309.12 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 570], 40.00th=[ 570], 50.00th=[ 570], 60.00th=[214959], | 70.00th=[214959], 80.00th=[214959], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 1497, max= 2027, per=38.25%, avg=1762.00, stdev=374.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2303KiB/s (2358kB/s)(10.0MiB/4446msec); 0 zone resets clat (msec): min=189, max=1061, avg=416.57, stdev=289.14 lat (msec): min=190, max=1061, avg=416.71, stdev=289.13 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 211], | 30.00th=[ 213], 40.00th=[ 234], 50.00th=[ 239], 60.00th=[ 257], | 70.00th=[ 472], 80.00th=[ 600], 90.00th=[ 693], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 2027, max= 4096, per=56.98%, avg=3673.80, stdev=920.69, samples=5 iops : min= 1, max= 4, avg= 3.00, stdev= 1.22, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=18.00%, ctx=152, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179687: Mon Aug 24 11:56:03 2026 read: IOPS=1, BW=1885KiB/s (1930kB/s)(6144KiB/3260msec) clat (usec): min=1250, max=388828, avg=133515.56, stdev=164213.96 lat (usec): min=1251, max=388829, avg=133516.74, stdev=164213.93 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1254], 10.00th=[ 1254], 20.00th=[ 1745], | 30.00th=[ 1745], 40.00th=[ 1975], 50.00th=[ 1975], 60.00th=[141558], | 70.00th=[265290], 80.00th=[265290], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 2027, max= 7876, per=100.00%, avg=4951.50, stdev=4135.87, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1885KiB/s (1930kB/s)(6144KiB/3260msec); 0 zone resets clat (msec): min=199, max=735, avg=400.93, stdev=214.04 lat (msec): min=200, max=735, avg=401.13, stdev=214.02 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 326], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1969, max= 2884, per=34.55%, avg=2227.75, stdev=438.42, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=25.00%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=17.49%, ctx=155, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179688: Mon Aug 24 11:56:03 2026 read: IOPS=1, BW=1516KiB/s (1553kB/s)(5120KiB/3377msec) clat (usec): min=519, max=243252, avg=51437.39, stdev=107287.64 lat (usec): min=520, max=243254, avg=51438.55, stdev=107287.74 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 519], | 30.00th=[ 1074], 40.00th=[ 1074], 50.00th=[ 2835], 60.00th=[ 2835], | 70.00th=[ 9503], 80.00th=[ 9503], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2123KiB/s (2174kB/s)(7168KiB/3377msec); 0 zone resets clat (msec): min=264, max=675, avg=434.07, stdev=168.97 lat (msec): min=264, max=675, avg=434.33, stdev=168.79 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 271], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 414], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 651], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1458, max= 3605, per=34.46%, avg=2222.20, stdev=810.42, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 10=8.33%, 250=8.33%, 500=41.67% lat (msec) : 750=16.67% cpu : usr=0.03%, sys=18.63%, ctx=142, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4606KiB/s (4717kB/s), 461KiB/s-2166KiB/s (472kB/s-2218kB/s), io=20.0MiB (20.0MB), run=3260-4446msec WRITE: bw=6449KiB/s (6604kB/s), 1547KiB/s-2303KiB/s (1584kB/s-2358kB/s), io=28.0MiB (29.4MB), run=3260-4446msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179690: Mon Aug 24 11:56:04 2026 read: IOPS=1, BW=1617KiB/s (1656kB/s)(7168KiB/4432msec) clat (msec): min=78, max=955, avg=371.81, stdev=312.70 lat (msec): min=78, max=955, avg=371.81, stdev=312.70 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 99], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 393], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 498], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1741, max= 2043, per=44.59%, avg=1967.00, stdev=113.05, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=1, BW=1155KiB/s (1183kB/s)(5120KiB/4432msec); 0 zone resets clat (msec): min=124, max=546, avg=312.08, stdev=178.61 lat (msec): min=124, max=546, avg=312.28, stdev=178.48 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1973, max= 6131, per=54.61%, avg=3373.00, stdev=2388.59, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.05%, sys=6.91%, ctx=117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179691: Mon Aug 24 11:56:04 2026 read: IOPS=0, BW=457KiB/s (468kB/s)(2048KiB/4482msec) clat (msec): min=299, max=344, avg=322.22, stdev=32.08 lat (msec): min=299, max=344, avg=322.22, stdev=32.08 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1799, max= 2019, per=43.28%, avg=1909.00, stdev=155.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2285KiB/s (2340kB/s)(10.0MiB/4482msec); 0 zone resets clat (msec): min=178, max=536, avg=364.88, stdev=109.55 lat (msec): min=179, max=536, avg=365.16, stdev=109.63 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 266], | 30.00th=[ 317], 40.00th=[ 321], 50.00th=[ 334], 60.00th=[ 359], | 70.00th=[ 384], 80.00th=[ 430], 90.00th=[ 523], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1973, max= 4031, per=37.30%, avg=2303.86, stdev=761.93, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=8.33%, 500=75.00%, 750=16.67% cpu : usr=0.07%, sys=9.02%, ctx=165, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Mon Aug 24 11:56:04 2026 read: IOPS=1, BW=1525KiB/s (1561kB/s)(6144KiB/4030msec) clat (msec): min=85, max=596, avg=197.26, stdev=197.06 lat (msec): min=85, max=596, avg=197.26, stdev=197.06 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 127], 50.00th=[ 127], 60.00th=[ 134], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 3946, max= 4087, per=91.06%, avg=4016.50, stdev=99.70, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1525KiB/s (1561kB/s)(6144KiB/4030msec); 0 zone resets clat (msec): min=169, max=743, avg=424.00, stdev=257.32 lat (msec): min=169, max=743, avg=424.11, stdev=257.30 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 477], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1703, max= 2043, per=31.71%, avg=1958.20, stdev=143.26, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.05%, sys=4.47%, ctx=60, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179693: Mon Aug 24 11:56:04 2026 read: IOPS=1, BW=1103KiB/s (1129kB/s)(5120KiB/4642msec) clat (msec): min=77, max=503, avg=203.46, stdev=172.56 lat (msec): min=77, max=503, avg=203.46, stdev=172.56 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2019, max= 6131, per=92.38%, avg=4075.00, stdev=2907.62, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1544KiB/s (1581kB/s)(7168KiB/4642msec); 0 zone resets clat (msec): min=132, max=1234, avg=500.56, stdev=376.69 lat (msec): min=132, max=1234, avg=500.67, stdev=376.70 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 167], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 447], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 693], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1973, max= 4079, per=38.13%, avg=2354.67, stdev=845.00, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=5.73%, ctx=142, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4412KiB/s (4518kB/s), 457KiB/s-1617KiB/s (468kB/s-1656kB/s), io=20.0MiB (20.0MB), run=4030-4642msec WRITE: bw=6177KiB/s (6325kB/s), 1155KiB/s-2285KiB/s (1183kB/s-2340kB/s), io=28.0MiB (29.4MB), run=4030-4642msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179702: Mon Aug 24 11:56:17 2026 read: IOPS=1, BW=4907KiB/s (5025kB/s)(12.0MiB/2504msec) clat (msec): min=744, max=892, avg=813.10, stdev=74.56 lat (msec): min=744, max=892, avg=813.10, stdev=74.56 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7968, max= 8143, per=100.00%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=4.71%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179704: Mon Aug 24 11:56:17 2026 read: IOPS=0, BW=1153KiB/s (1181kB/s)(4096KiB/3551msec) clat (nsec): min=2268.9M, max=2268.9M, avg=2268925602.00, stdev= 0.00 lat (nsec): min=2268.9M, max=2268.9M, avg=2268928144.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2265], 5.00th=[ 2265], 10.00th=[ 2265], 20.00th=[ 2265], | 30.00th=[ 2265], 40.00th=[ 2265], 50.00th=[ 2265], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2307KiB/s (2362kB/s)(8192KiB/3551msec); 0 zone resets clat (msec): min=356, max=724, avg=540.16, stdev=260.33 lat (msec): min=360, max=724, avg=542.45, stdev=257.73 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8110, max= 8110, per=87.89%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.08%, ctx=54, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179706: Mon Aug 24 11:56:17 2026 write: IOPS=0, BW=4020KiB/s (4116kB/s)(12.0MiB/3057msec); 0 zone resets clat (msec): min=314, max=1503, avg=988.36, stdev=610.50 lat (msec): min=316, max=1504, avg=990.48, stdev=610.18 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8143, max= 8143, per=88.25%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.96%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179707: Mon Aug 24 11:56:17 2026 write: IOPS=1, BW=4438KiB/s (4544kB/s)(12.0MiB/2769msec); 0 zone resets clat (msec): min=266, max=1992, avg=876.09, stdev=967.94 lat (msec): min=267, max=1993, avg=876.69, stdev=968.14 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 6714, max= 7968, per=79.56%, avg=7341.00, stdev=886.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.82%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4614KiB/s (4725kB/s), 1153KiB/s-4907KiB/s (1181kB/s-5025kB/s), io=16.0MiB (16.8MB), run=2504-3551msec WRITE: bw=9228KiB/s (9449kB/s), 2307KiB/s-4438KiB/s (2362kB/s-4544kB/s), io=32.0MiB (33.6MB), run=2769-3551msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179700: Mon Aug 24 11:56:17 2026 read: IOPS=1, BW=5278KiB/s (5405kB/s)(12.0MiB/2328msec) clat (msec): min=680, max=793, avg=747.65, stdev=59.24 lat (msec): min=680, max=793, avg=747.66, stdev=59.24 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7922, max= 8015, per=100.00%, avg=7968.50, stdev=65.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.58%, ctx=373, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179701: Mon Aug 24 11:56:17 2026 read: IOPS=0, BW=1299KiB/s (1331kB/s)(4096KiB/3152msec) clat (nsec): min=729709k, max=729709k, avg=729708638.00, stdev= 0.00 lat (nsec): min=729711k, max=729711k, avg=729711484.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2599KiB/s (2661kB/s)(8192KiB/3152msec); 0 zone resets clat (msec): min=578, max=1781, avg=1179.87, stdev=850.88 lat (msec): min=578, max=1782, avg=1180.35, stdev=851.00 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1787], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7922, max= 7922, per=85.32%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.01%, ctx=202, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179703: Mon Aug 24 11:56:17 2026 write: IOPS=0, BW=3482KiB/s (3566kB/s)(12.0MiB/3529msec); 0 zone resets clat (msec): min=259, max=1614, avg=1134.45, stdev=758.60 lat (msec): min=262, max=1614, avg=1135.52, stdev=757.63 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8094, max= 8143, per=87.44%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.71%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179705: Mon Aug 24 11:56:17 2026 write: IOPS=0, BW=3977KiB/s (4072kB/s)(12.0MiB/3090msec); 0 zone resets clat (msec): min=616, max=1740, avg=992.81, stdev=647.32 lat (msec): min=616, max=1740, avg=993.51, stdev=647.07 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 5595, max= 8175, per=74.15%, avg=6885.00, stdev=1824.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.92%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5198KiB/s (5323kB/s), 1299KiB/s-5278KiB/s (1331kB/s-5405kB/s), io=16.0MiB (16.8MB), run=2328-3152msec WRITE: bw=9285KiB/s (9508kB/s), 2599KiB/s-3977KiB/s (2661kB/s-4072kB/s), io=32.0MiB (33.6MB), run=3090-3529msec