== sanity test 398b: DIO and buffer IO race ============== 03:39:16 (1787470756) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.27342 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144051: Sun Aug 23 03:42:07 2026 read: IOPS=10, BW=40.7KiB/s (41.6kB/s)(5992KiB/147344msec) clat (usec): min=36, max=1247.3k, avg=47991.95, stdev=44494.32 lat (usec): min=36, max=1247.3k, avg=48010.64, stdev=44516.15 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 73], 10.00th=[ 14615], | 20.00th=[ 24249], 30.00th=[ 29754], 40.00th=[ 35390], | 50.00th=[ 41681], 60.00th=[ 49546], 70.00th=[ 57934], | 80.00th=[ 69731], 90.00th=[ 84411], 95.00th=[ 103285], | 99.00th=[ 152044], 99.50th=[ 173016], 99.90th=[ 371196], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 95, per=25.59%, avg=40.68, stdev=17.82, samples=286 iops : min= 1, max= 23, avg= 9.52, stdev= 4.50, samples=286 write: IOPS=10, BW=42.7KiB/s (43.8kB/s)(6296KiB/147344msec); 0 zone resets clat (usec): min=1141, max=556594, avg=47533.63, stdev=48932.90 lat (usec): min=1143, max=556595, avg=47537.22, stdev=48933.01 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1598], 10.00th=[ 2376], 20.00th=[ 6325], | 30.00th=[ 12911], 40.00th=[ 24511], 50.00th=[ 35914], 60.00th=[ 46400], | 70.00th=[ 62129], 80.00th=[ 80217], 90.00th=[109577], 95.00th=[135267], | 99.00th=[208667], 99.50th=[250610], 99.90th=[509608], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 110, per=25.49%, avg=42.57, stdev=18.45, samples=287 iops : min= 1, max= 27, avg=10.00, stdev= 4.67, samples=287 lat (usec) : 50=0.29%, 100=2.86%, 250=0.62%, 500=0.07%, 750=0.03% lat (msec) : 2=4.85%, 4=2.57%, 10=6.58%, 20=7.65%, 50=36.13% lat (msec) : 100=29.52%, 250=8.46%, 500=0.26%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.32%, ctx=6880, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144052: Sun Aug 23 03:42:07 2026 read: IOPS=9, BW=39.5KiB/s (40.4kB/s)(5940KiB/150449msec) clat (usec): min=31, max=567797, avg=49237.04, stdev=37224.33 lat (usec): min=31, max=567799, avg=49239.98, stdev=37225.04 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 75], 10.00th=[ 15401], 20.00th=[ 24249], | 30.00th=[ 30016], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[106431], | 99.00th=[170918], 99.50th=[200279], 99.90th=[434111], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 93, per=24.90%, avg=39.59, stdev=17.87, samples=291 iops : min= 1, max= 23, avg= 9.24, stdev= 4.54, samples=291 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6348KiB/150449msec); 0 zone resets clat (usec): min=1148, max=1248.4k, avg=48329.31, stdev=54870.58 lat (usec): min=1150, max=1248.4k, avg=48337.89, stdev=54872.90 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1647], 10.00th=[ 3064], | 20.00th=[ 6718], 30.00th=[ 13173], 40.00th=[ 24511], | 50.00th=[ 36439], 60.00th=[ 49546], 70.00th=[ 63701], | 80.00th=[ 80217], 90.00th=[ 109577], 95.00th=[ 135267], | 99.00th=[ 198181], 99.50th=[ 244319], 99.90th=[ 400557], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 115, per=25.05%, avg=41.83, stdev=17.00, samples=293 iops : min= 1, max= 28, avg= 9.81, stdev= 4.28, samples=293 lat (usec) : 50=0.29%, 100=2.90%, 250=0.42%, 500=0.10% lat (msec) : 2=3.52%, 4=3.03%, 10=7.10%, 20=7.98%, 50=34.96% lat (msec) : 100=30.11%, 250=9.31%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=4.97%, ctx=6749, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144053: Sun Aug 23 03:42:07 2026 read: IOPS=10, BW=40.2KiB/s (41.2kB/s)(6028KiB/149814msec) clat (usec): min=35, max=1228.6k, avg=50068.21, stdev=49242.49 lat (usec): min=35, max=1228.6k, avg=50095.57, stdev=49246.76 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 70], 10.00th=[ 14484], | 20.00th=[ 24511], 30.00th=[ 30278], 40.00th=[ 35914], | 50.00th=[ 42206], 60.00th=[ 49546], 70.00th=[ 59507], | 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[ 108528], | 99.00th=[ 183501], 99.50th=[ 261096], 99.90th=[ 616563], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 93, per=25.18%, avg=40.04, stdev=17.15, samples=292 iops : min= 1, max= 23, avg= 9.36, stdev= 4.36, samples=292 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6260KiB/149814msec); 0 zone resets clat (usec): min=1172, max=299420, avg=47070.55, stdev=46173.03 lat (usec): min=1172, max=299422, avg=47077.21, stdev=46171.89 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1598], 10.00th=[ 2507], 20.00th=[ 6325], | 30.00th=[ 11338], 40.00th=[ 23200], 50.00th=[ 35914], 60.00th=[ 47973], | 70.00th=[ 64226], 80.00th=[ 79168], 90.00th=[109577], 95.00th=[139461], | 99.00th=[198181], 99.50th=[229639], 99.90th=[261096], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 93, per=24.82%, avg=41.45, stdev=18.14, samples=293 iops : min= 1, max= 23, avg= 9.71, stdev= 4.58, samples=293 lat (usec) : 50=0.46%, 100=3.12%, 250=0.49%, 500=0.07%, 1000=0.10% lat (msec) : 2=4.10%, 4=2.93%, 10=7.58%, 20=7.71%, 50=34.44% lat (msec) : 100=29.30%, 250=9.31%, 500=0.33%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.96%, ctx=6795, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144054: Sun Aug 23 03:42:07 2026 read: IOPS=10, BW=40.2KiB/s (41.2kB/s)(6052KiB/150399msec) clat (usec): min=30, max=399980, avg=49363.96, stdev=37190.50 lat (usec): min=30, max=399980, avg=49373.00, stdev=37193.28 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 15401], 20.00th=[ 24249], | 30.00th=[ 31065], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[175113], 99.50th=[258999], 99.90th=[392168], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 102, per=25.31%, avg=40.24, stdev=17.84, samples=291 iops : min= 1, max= 25, avg= 9.41, stdev= 4.50, samples=291 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6236KiB/150399msec); 0 zone resets clat (usec): min=1136, max=1236.8k, avg=48168.46, stdev=55453.09 lat (usec): min=1137, max=1236.8k, avg=48174.98, stdev=55453.82 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1582], 10.00th=[ 2540], | 20.00th=[ 6390], 30.00th=[ 12387], 40.00th=[ 24511], | 50.00th=[ 38011], 60.00th=[ 50070], 70.00th=[ 63177], | 80.00th=[ 81265], 90.00th=[ 107480], 95.00th=[ 135267], | 99.00th=[ 187696], 99.50th=[ 204473], 99.90th=[ 557843], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 111, per=24.74%, avg=41.31, stdev=16.93, samples=292 iops : min= 1, max= 27, avg= 9.67, stdev= 4.28, samples=292 lat (usec) : 50=0.33%, 100=3.22%, 250=0.39%, 500=0.10%, 750=0.10% lat (msec) : 2=4.26%, 4=3.29%, 10=5.89%, 20=7.58%, 50=34.41% lat (msec) : 100=30.73%, 250=9.31%, 500=0.33%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.28%, ctx=6887, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=160KiB/s (163kB/s), 39.5KiB/s-40.7KiB/s (40.4kB/s-41.6kB/s), io=23.4MiB (24.6MB), run=147344-150449msec WRITE: bw=167KiB/s (171kB/s), 41.5KiB/s-42.7KiB/s (42.5kB/s-43.8kB/s), io=24.6MiB (25.7MB), run=147344-150449msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144056: Sun Aug 23 03:44:47 2026 read: IOPS=4, BW=19.4KiB/s (19.9kB/s)(5992KiB/308225msec) clat (msec): min=6, max=1302, avg=40.25, stdev=52.81 lat (msec): min=6, max=1302, avg=40.26, stdev=52.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 86], 95.00th=[ 122], | 99.00th=[ 222], 99.50th=[ 253], 99.90th=[ 625], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 94, per=29.52%, avg=22.73, stdev=15.69, samples=507 iops : min= 1, max= 23, avg= 5.04, stdev= 3.96, samples=507 write: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6296KiB/308225msec); 0 zone resets clat (msec): min=37, max=613, avg=157.40, stdev=72.31 lat (msec): min=37, max=613, avg=157.40, stdev=72.30 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 78], 10.00th=[ 88], 20.00th=[ 103], | 30.00th=[ 113], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 203], 90.00th=[ 257], 95.00th=[ 300], | 99.00th=[ 409], 99.50th=[ 464], 99.90th=[ 550], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 40, per=24.92%, avg=20.19, stdev= 8.81, samples=596 iops : min= 1, max= 10, avg= 4.40, stdev= 2.26, samples=596 lat (msec) : 10=2.08%, 20=15.14%, 50=21.68%, 100=15.82%, 250=39.39% lat (msec) : 500=5.70%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.30%, ctx=5188, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144057: Sun Aug 23 03:44:47 2026 read: IOPS=4, BW=19.2KiB/s (19.6kB/s)(5940KiB/309856msec) clat (msec): min=6, max=1288, avg=38.73, stdev=50.77 lat (msec): min=6, max=1288, avg=38.74, stdev=50.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 87], 95.00th=[ 116], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 338], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 88, per=29.46%, avg=22.68, stdev=15.42, samples=504 iops : min= 1, max= 22, avg= 5.03, stdev= 3.90, samples=504 write: IOPS=5, BW=20.5KiB/s (20.0kB/s)(6348KiB/309856msec); 0 zone resets clat (msec): min=49, max=611, avg=158.91, stdev=73.18 lat (msec): min=49, max=611, avg=158.91, stdev=73.18 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 77], 10.00th=[ 89], 20.00th=[ 104], | 30.00th=[ 115], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 207], 90.00th=[ 259], 95.00th=[ 309], | 99.00th=[ 422], 99.50th=[ 443], 99.90th=[ 575], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 47, per=24.90%, avg=20.17, stdev= 9.06, samples=603 iops : min= 1, max= 11, avg= 4.39, stdev= 2.31, samples=603 lat (msec) : 10=2.28%, 20=16.24%, 50=20.31%, 100=15.04%, 250=40.27% lat (msec) : 500=5.73%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.30%, ctx=5295, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144058: Sun Aug 23 03:44:47 2026 read: IOPS=4, BW=19.5KiB/s (19.0kB/s)(6028KiB/308922msec) clat (msec): min=6, max=619, avg=41.10, stdev=45.02 lat (msec): min=6, max=619, avg=41.11, stdev=45.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 56], 90.00th=[ 90], 95.00th=[ 114], | 99.00th=[ 234], 99.50th=[ 334], 99.90th=[ 414], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 87, per=28.90%, avg=22.25, stdev=14.65, samples=521 iops : min= 1, max= 21, avg= 4.92, stdev= 3.71, samples=521 write: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6260KiB/308922msec); 0 zone resets clat (msec): min=44, max=1533, avg=157.69, stdev=80.50 lat (msec): min=44, max=1533, avg=157.69, stdev=80.50 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 75], 10.00th=[ 85], 20.00th=[ 100], | 30.00th=[ 111], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 207], 90.00th=[ 259], 95.00th=[ 300], | 99.00th=[ 401], 99.50th=[ 443], 99.90th=[ 575], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7, max= 47, per=24.91%, avg=20.17, stdev= 9.11, samples=594 iops : min= 1, max= 11, avg= 4.39, stdev= 2.33, samples=594 lat (msec) : 10=1.40%, 20=14.81%, 50=22.20%, 100=17.35%, 250=38.35% lat (msec) : 500=5.70%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5241, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144059: Sun Aug 23 03:44:47 2026 read: IOPS=4, BW=19.8KiB/s (20.2kB/s)(6052KiB/306253msec) clat (msec): min=5, max=478, avg=38.42, stdev=41.96 lat (msec): min=5, max=478, avg=38.42, stdev=41.96 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 83], 95.00th=[ 109], | 99.00th=[ 220], 99.50th=[ 296], 99.90th=[ 426], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 104, per=29.58%, avg=22.78, stdev=16.29, samples=511 iops : min= 1, max= 26, avg= 5.05, stdev= 4.13, samples=511 write: IOPS=5, BW=20.4KiB/s (20.8kB/s)(6236KiB/306253msec); 0 zone resets clat (msec): min=44, max=1383, avg=159.02, stdev=80.22 lat (msec): min=44, max=1383, avg=159.02, stdev=80.22 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 77], 10.00th=[ 86], 20.00th=[ 101], | 30.00th=[ 114], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 209], 90.00th=[ 257], 95.00th=[ 305], | 99.00th=[ 418], 99.50th=[ 451], 99.90th=[ 550], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 48, per=24.81%, avg=20.09, stdev= 8.96, samples=593 iops : min= 1, max= 12, avg= 4.38, stdev= 2.29, samples=593 lat (msec) : 10=1.60%, 20=15.66%, 50=22.49%, 100=16.28%, 250=37.83% lat (msec) : 500=6.05%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.29%, ctx=5226, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=77.5KiB/s (79.4kB/s), 19.2KiB/s-19.8KiB/s (19.6kB/s-20.2kB/s), io=23.4MiB (24.6MB), run=306253-309856msec WRITE: bw=81.1KiB/s (83.1kB/s), 20.3KiB/s-20.5KiB/s (20.8kB/s-20.0kB/s), io=24.6MiB (25.7MB), run=306253-309856msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144128: Sun Aug 23 03:45:39 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(5920KiB/38090msec) clat (usec): min=41, max=315583, avg=58874.58, stdev=47156.04 lat (usec): min=42, max=315585, avg=58876.06, stdev=47156.06 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 24511], | 30.00th=[ 37487], 40.00th=[ 44827], 50.00th=[ 52167], 60.00th=[ 60556], | 70.00th=[ 72877], 80.00th=[ 88605], 90.00th=[109577], 95.00th=[129500], | 99.00th=[240124], 99.50th=[304088], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 30, max= 317, per=26.37%, avg=154.26, stdev=65.68, samples=74 iops : min= 1, max= 19, avg= 8.85, stdev= 4.15, samples=74 write: IOPS=10, BW=167KiB/s (171kB/s)(6368KiB/38090msec); 0 zone resets clat (usec): min=1652, max=261165, avg=40864.61, stdev=43348.93 lat (usec): min=1655, max=261168, avg=40870.46, stdev=43347.05 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2089], 10.00th=[ 3523], 20.00th=[ 6783], | 30.00th=[ 10421], 40.00th=[ 14484], 50.00th=[ 23200], 60.00th=[ 35914], | 70.00th=[ 50070], 80.00th=[ 71828], 90.00th=[101188], 95.00th=[129500], | 99.00th=[202376], 99.50th=[227541], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 381, per=27.49%, avg=169.34, stdev=83.27, samples=73 iops : min= 1, max= 23, avg= 9.81, stdev= 5.25, samples=73 lat (usec) : 50=0.78%, 100=6.25%, 250=0.52% lat (msec) : 2=1.82%, 4=4.43%, 10=9.51%, 20=9.77%, 50=25.13% lat (msec) : 100=29.04%, 250=12.37%, 500=0.39% cpu : usr=0.08%, sys=5.37%, ctx=1551, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144129: Sun Aug 23 03:45:39 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(5744KiB/40577msec) clat (usec): min=43, max=280073, avg=62146.96, stdev=44401.73 lat (usec): min=43, max=280075, avg=62148.67, stdev=44401.75 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 90], 20.00th=[ 29230], | 30.00th=[ 40109], 40.00th=[ 47973], 50.00th=[ 56886], 60.00th=[ 66323], | 70.00th=[ 79168], 80.00th=[ 91751], 90.00th=[111674], 95.00th=[135267], | 99.00th=[233833], 99.50th=[254804], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 350, per=24.34%, avg=142.38, stdev=64.53, samples=78 iops : min= 1, max= 21, avg= 8.10, stdev= 4.03, samples=78 write: IOPS=10, BW=161KiB/s (165kB/s)(6544KiB/40577msec); 0 zone resets clat (usec): min=1739, max=325374, avg=44401.59, stdev=46815.29 lat (usec): min=1766, max=325377, avg=44406.04, stdev=46815.92 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2900], 10.00th=[ 4359], 20.00th=[ 8291], | 30.00th=[ 11863], 40.00th=[ 17433], 50.00th=[ 25560], 60.00th=[ 40109], | 70.00th=[ 53216], 80.00th=[ 78119], 90.00th=[116917], 95.00th=[135267], | 99.00th=[193987], 99.50th=[208667], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 31, max= 411, per=26.26%, avg=161.76, stdev=75.71, samples=78 iops : min= 1, max= 25, avg= 9.32, stdev= 4.78, samples=78 lat (usec) : 50=0.26%, 100=4.56%, 250=0.78%, 500=0.13% lat (msec) : 2=0.65%, 4=4.43%, 10=8.72%, 20=10.94%, 50=25.78% lat (msec) : 100=29.69%, 250=13.67%, 500=0.39% cpu : usr=0.08%, sys=5.38%, ctx=1601, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144130: Sun Aug 23 03:45:39 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40378msec) clat (usec): min=38, max=319925, avg=60048.40, stdev=45882.64 lat (usec): min=38, max=319927, avg=60051.14, stdev=45881.21 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 29754], | 30.00th=[ 38011], 40.00th=[ 45876], 50.00th=[ 53740], 60.00th=[ 61080], | 70.00th=[ 71828], 80.00th=[ 89654], 90.00th=[110625], 95.00th=[137364], | 99.00th=[254804], 99.50th=[278922], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 347, per=26.48%, avg=154.90, stdev=64.08, samples=79 iops : min= 1, max= 21, avg= 8.89, stdev= 4.07, samples=79 write: IOPS=9, BW=149KiB/s (153kB/s)(6032KiB/40378msec); 0 zone resets clat (usec): min=1535, max=251716, avg=44582.19, stdev=45198.22 lat (usec): min=1537, max=251717, avg=44585.35, stdev=45199.55 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2245], 10.00th=[ 3982], 20.00th=[ 8848], | 30.00th=[ 13173], 40.00th=[ 18482], 50.00th=[ 28443], 60.00th=[ 40109], | 70.00th=[ 54264], 80.00th=[ 80217], 90.00th=[107480], 95.00th=[141558], | 99.00th=[191890], 99.50th=[244319], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 314, per=24.73%, avg=152.36, stdev=70.77, samples=77 iops : min= 1, max= 19, avg= 8.74, stdev= 4.48, samples=77 lat (usec) : 50=0.26%, 100=5.73%, 250=0.91% lat (msec) : 2=1.43%, 4=3.52%, 10=6.51%, 20=9.64%, 50=28.52% lat (msec) : 100=30.08%, 250=12.76%, 500=0.65% cpu : usr=0.06%, sys=5.45%, ctx=1616, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144131: Sun Aug 23 03:45:39 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(6032KiB/40878msec) clat (usec): min=49, max=353459, avg=58121.28, stdev=46440.80 lat (usec): min=50, max=353461, avg=58123.53, stdev=46440.81 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 27657], | 30.00th=[ 36963], 40.00th=[ 45351], 50.00th=[ 52691], 60.00th=[ 62653], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[106431], 95.00th=[127402], | 99.00th=[278922], 99.50th=[308282], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 376, per=25.13%, avg=147.03, stdev=70.32, samples=79 iops : min= 1, max= 23, avg= 8.39, stdev= 4.47, samples=79 write: IOPS=9, BW=153KiB/s (157kB/s)(6256KiB/40878msec); 0 zone resets clat (usec): min=1581, max=415672, avg=48248.15, stdev=57031.23 lat (usec): min=1584, max=415675, avg=48250.93, stdev=57031.25 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2671], 10.00th=[ 4293], 20.00th=[ 8455], | 30.00th=[ 11731], 40.00th=[ 20317], 50.00th=[ 30016], 60.00th=[ 39060], | 70.00th=[ 56886], 80.00th=[ 77071], 90.00th=[112722], 95.00th=[149947], | 99.00th=[325059], 99.50th=[375391], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 31, max= 347, per=25.02%, avg=154.11, stdev=67.60, samples=79 iops : min= 1, max= 21, avg= 8.84, stdev= 4.24, samples=79 lat (usec) : 50=0.13%, 100=5.86%, 250=1.30% lat (msec) : 2=0.65%, 4=4.04%, 10=7.94%, 20=8.46%, 50=27.60% lat (msec) : 100=30.99%, 250=11.72%, 500=1.30% cpu : usr=0.05%, sys=5.25%, ctx=1559, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=586KiB/s (600kB/s), 142KiB/s-155KiB/s (145kB/s-159kB/s), io=23.4MiB (24.5MB), run=38090-40878msec WRITE: bw=616KiB/s (631kB/s), 149KiB/s-167KiB/s (153kB/s-171kB/s), io=24.6MiB (25.8MB), run=38090-40878msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144123: Sun Aug 23 03:46:25 2026 read: IOPS=4, BW=68.0KiB/s (69.7kB/s)(5920KiB/87008msec) clat (msec): min=8, max=317, avg=48.39, stdev=47.34 lat (msec): min=8, max=317, avg=48.41, stdev=47.34 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 105], 95.00th=[ 157], | 99.00th=[ 239], 99.50th=[ 284], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 256, per=30.20%, avg=81.84, stdev=52.20, samples=141 iops : min= 1, max= 16, avg= 4.30, stdev= 3.33, samples=141 write: IOPS=4, BW=73.2KiB/s (74.9kB/s)(6368KiB/87008msec); 0 zone resets clat (msec): min=56, max=535, avg=173.08, stdev=91.88 lat (msec): min=56, max=535, avg=173.09, stdev=91.88 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 78], 10.00th=[ 89], 20.00th=[ 106], | 30.00th=[ 116], 40.00th=[ 133], 50.00th=[ 146], 60.00th=[ 165], | 70.00th=[ 186], 80.00th=[ 232], 90.00th=[ 288], 95.00th=[ 376], | 99.00th=[ 514], 99.50th=[ 531], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 27, max= 159, per=26.06%, avg=74.53, stdev=35.03, samples=167 iops : min= 1, max= 9, avg= 3.83, stdev= 2.23, samples=167 lat (msec) : 10=0.39%, 20=10.29%, 50=24.74%, 100=16.41%, 250=39.19% lat (msec) : 500=8.07%, 750=0.91% cpu : usr=0.03%, sys=1.26%, ctx=1340, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144124: Sun Aug 23 03:46:25 2026 read: IOPS=4, BW=65.2KiB/s (66.8kB/s)(5744KiB/88071msec) clat (msec): min=8, max=421, avg=51.74, stdev=54.23 lat (msec): min=8, max=421, avg=51.74, stdev=54.23 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 69], 90.00th=[ 116], 95.00th=[ 167], | 99.00th=[ 253], 99.50th=[ 384], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 26, max= 318, per=30.31%, avg=82.13, stdev=57.11, samples=136 iops : min= 1, max= 19, avg= 4.32, stdev= 3.61, samples=136 write: IOPS=4, BW=74.3KiB/s (76.1kB/s)(6544KiB/88071msec); 0 zone resets clat (msec): min=53, max=684, avg=169.66, stdev=88.83 lat (msec): min=53, max=684, avg=169.66, stdev=88.83 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 82], 10.00th=[ 92], 20.00th=[ 106], | 30.00th=[ 121], 40.00th=[ 131], 50.00th=[ 140], 60.00th=[ 159], | 70.00th=[ 184], 80.00th=[ 222], 90.00th=[ 292], 95.00th=[ 359], | 99.00th=[ 489], 99.50th=[ 550], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 30, max= 160, per=26.66%, avg=76.24, stdev=35.90, samples=167 iops : min= 1, max= 10, avg= 3.93, stdev= 2.30, samples=167 lat (msec) : 10=0.39%, 20=9.38%, 50=23.44%, 100=15.89%, 250=43.10% lat (msec) : 500=7.29%, 750=0.52% cpu : usr=0.05%, sys=1.21%, ctx=1321, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144125: Sun Aug 23 03:46:25 2026 read: IOPS=4, BW=73.0KiB/s (75.8kB/s)(6256KiB/84543msec) clat (msec): min=6, max=458, avg=51.66, stdev=58.49 lat (msec): min=6, max=458, avg=51.66, stdev=58.49 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 67], 90.00th=[ 105], 95.00th=[ 180], | 99.00th=[ 326], 99.50th=[ 384], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 28, max= 287, per=32.67%, avg=88.53, stdev=59.65, samples=139 iops : min= 1, max= 17, avg= 4.71, stdev= 3.78, samples=139 write: IOPS=4, BW=71.3KiB/s (73.1kB/s)(6032KiB/84543msec); 0 zone resets clat (msec): min=42, max=533, avg=169.98, stdev=82.05 lat (msec): min=42, max=533, avg=169.99, stdev=82.05 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 82], 10.00th=[ 89], 20.00th=[ 105], | 30.00th=[ 117], 40.00th=[ 134], 50.00th=[ 146], 60.00th=[ 165], | 70.00th=[ 186], 80.00th=[ 228], 90.00th=[ 292], 95.00th=[ 330], | 99.00th=[ 439], 99.50th=[ 489], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 27, max= 160, per=25.53%, avg=73.02, stdev=34.43, samples=161 iops : min= 1, max= 10, avg= 3.73, stdev= 2.19, samples=161 lat (msec) : 10=0.91%, 20=12.11%, 50=23.44%, 100=16.93%, 250=37.63% lat (msec) : 500=8.85%, 750=0.13% cpu : usr=0.03%, sys=1.30%, ctx=1402, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144126: Sun Aug 23 03:46:25 2026 read: IOPS=4, BW=68.7KiB/s (70.3kB/s)(6032KiB/87814msec) clat (msec): min=8, max=379, avg=52.00, stdev=52.98 lat (msec): min=8, max=379, avg=52.00, stdev=52.98 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 52], 80.00th=[ 73], 90.00th=[ 116], 95.00th=[ 150], | 99.00th=[ 292], 99.50th=[ 317], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 28, max= 255, per=30.34%, avg=82.23, stdev=51.67, samples=143 iops : min= 1, max= 15, avg= 4.30, stdev= 3.25, samples=143 write: IOPS=4, BW=71.2KiB/s (72.0kB/s)(6256KiB/87814msec); 0 zone resets clat (msec): min=55, max=540, avg=173.69, stdev=83.61 lat (msec): min=55, max=540, avg=173.70, stdev=83.61 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 83], 10.00th=[ 95], 20.00th=[ 110], | 30.00th=[ 124], 40.00th=[ 136], 50.00th=[ 150], 60.00th=[ 167], | 70.00th=[ 197], 80.00th=[ 228], 90.00th=[ 279], 95.00th=[ 334], | 99.00th=[ 464], 99.50th=[ 502], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 26, max= 160, per=25.72%, avg=73.56, stdev=33.63, samples=167 iops : min= 1, max= 10, avg= 3.76, stdev= 2.15, samples=167 lat (msec) : 10=0.39%, 20=10.29%, 50=23.31%, 100=15.36%, 250=41.54% lat (msec) : 500=8.85%, 750=0.26% cpu : usr=0.03%, sys=1.30%, ctx=1360, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=272KiB/s (278kB/s), 65.2KiB/s-73.0KiB/s (66.8kB/s-75.8kB/s), io=23.4MiB (24.5MB), run=84543-88071msec WRITE: bw=286KiB/s (293kB/s), 71.2KiB/s-74.3KiB/s (72.0kB/s-76.1kB/s), io=24.6MiB (25.8MB), run=84543-88071msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144150: Sun Aug 23 03:46:47 2026 read: IOPS=1, BW=1107KiB/s (1134kB/s)(7168KiB/6475msec) clat (usec): min=577, max=3315.8k, avg=678275.11, stdev=1171637.23 lat (usec): min=578, max=3315.8k, avg=678277.22, stdev=1171637.27 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], | 20.00th=[ 143655], 30.00th=[ 183501], 40.00th=[ 183501], | 50.00th=[ 350225], 60.00th=[ 358613], 70.00th=[ 358613], | 80.00th=[ 392168], 90.00th=[3305112], 95.00th=[3305112], | 99.00th=[3305112], 99.50th=[3305112], 99.90th=[3305112], | 99.95th=[3305112], 99.99th=[3305112] bw ( KiB/s): min= 1549, max= 4031, per=87.46%, avg=2265.20, stdev=1006.75, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=791KiB/s (810kB/s)(5120KiB/6475msec); 0 zone resets clat (msec): min=73, max=630, avg=334.47, stdev=226.16 lat (msec): min=73, max=630, avg=334.57, stdev=226.21 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1723, max= 3992, per=67.25%, avg=2439.25, stdev=1044.66, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.85%, ctx=676, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144151: Sun Aug 23 03:46:47 2026 read: IOPS=0, BW=259KiB/s (265kB/s)(2048KiB/7905msec) clat (usec): min=534, max=185061, avg=92797.88, stdev=130480.31 lat (usec): min=535, max=185065, avg=92800.76, stdev=130482.15 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 537], 60.00th=[185598], | 70.00th=[185598], 80.00th=[185598], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 1565, max= 1921, per=67.30%, avg=1743.00, stdev=251.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1295KiB/s (1326kB/s)(10.0MiB/7905msec); 0 zone resets clat (msec): min=123, max=3681, avg=754.36, stdev=1150.83 lat (msec): min=123, max=3681, avg=754.44, stdev=1150.84 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 129], | 30.00th=[ 163], 40.00th=[ 190], 50.00th=[ 234], 60.00th=[ 330], | 70.00th=[ 380], 80.00th=[ 460], 90.00th=[ 1854], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 1723, max= 6047, per=98.33%, avg=3566.60, stdev=1786.63, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.00%, ctx=211, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144152: Sun Aug 23 03:46:47 2026 read: IOPS=0, BW=796KiB/s (815kB/s)(6144KiB/7720msec) clat (usec): min=498, max=378794, avg=146523.45, stdev=167830.92 lat (usec): min=500, max=378795, avg=146525.39, stdev=167830.97 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 519], | 30.00th=[ 519], 40.00th=[ 586], 50.00th=[ 586], 60.00th=[219153], | 70.00th=[278922], 80.00th=[278922], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 3842, max= 3992, per=100.00%, avg=3917.00, stdev=106.07, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=796KiB/s (815kB/s)(6144KiB/7720msec); 0 zone resets clat (msec): min=264, max=4606, avg=1067.58, stdev=1735.52 lat (msec): min=264, max=4606, avg=1067.70, stdev=1735.50 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 405], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 1921, max= 4096, per=69.39%, avg=2516.75, stdev=1053.99, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=8.33%, 500=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.43%, ctx=177, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144154: Sun Aug 23 03:46:47 2026 read: IOPS=0, BW=866KiB/s (887kB/s)(5120KiB/5912msec) clat (usec): min=521, max=300572, avg=170403.11, stdev=156188.46 lat (usec): min=524, max=300573, avg=170404.85, stdev=156187.97 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[252707], 60.00th=[252707], | 70.00th=[295699], 80.00th=[295699], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 2015, max= 6071, per=100.00%, avg=4043.00, stdev=2868.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1212KiB/s (1242kB/s)(7168KiB/5912msec); 0 zone resets clat (msec): min=124, max=3721, avg=713.46, stdev=1329.38 lat (msec): min=124, max=3721, avg=714.28, stdev=1329.09 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 127], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 190], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 388], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1747, max= 6059, per=91.45%, avg=3317.00, stdev=1974.47, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=33.33%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.61%, ctx=124, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2591KiB/s (2653kB/s), 259KiB/s-1107KiB/s (265kB/s-1134kB/s), io=20.0MiB (20.0MB), run=5912-7905msec WRITE: bw=3627KiB/s (3714kB/s), 791KiB/s-1295KiB/s (810kB/s-1326kB/s), io=28.0MiB (29.4MB), run=5912-7905msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144155: Sun Aug 23 03:46:49 2026 read: IOPS=0, BW=778KiB/s (797kB/s)(7168KiB/9209msec) clat (msec): min=61, max=3245, avg=1064.42, stdev=1287.26 lat (msec): min=61, max=3245, avg=1064.42, stdev=1287.27 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 101], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 439], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 2567], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1984, max= 2039, per=90.73%, avg=2017.00, stdev=25.17, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=556KiB/s (569kB/s)(5120KiB/9209msec); 0 zone resets clat (msec): min=115, max=680, avg=295.87, stdev=221.83 lat (msec): min=115, max=680, avg=295.96, stdev=221.84 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1988, max= 4096, per=97.72%, avg=3042.00, stdev=1490.58, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=1.27%, ctx=64, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144156: Sun Aug 23 03:46:49 2026 read: IOPS=0, BW=231KiB/s (237kB/s)(2048KiB/8856msec) clat (msec): min=170, max=188, avg=179.31, stdev=12.90 lat (msec): min=170, max=188, avg=179.32, stdev=12.90 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 1438, max= 1988, per=77.06%, avg=1713.00, stdev=388.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1156KiB/s (1184kB/s)(10.0MiB/8856msec); 0 zone resets clat (msec): min=164, max=4073, avg=818.86, stdev=1183.73 lat (msec): min=164, max=4073, avg=819.29, stdev=1183.61 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 292], 50.00th=[ 401], 60.00th=[ 435], | 70.00th=[ 460], 80.00th=[ 567], 90.00th=[ 1250], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 1988, max= 4079, per=85.04%, avg=2647.33, stdev=985.08, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.67%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144157: Sun Aug 23 03:46:49 2026 read: IOPS=0, BW=698KiB/s (715kB/s)(6144KiB/8804msec) clat (msec): min=96, max=976, avg=396.79, stdev=354.46 lat (msec): min=96, max=976, avg=396.79, stdev=354.46 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 443], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 2035, max= 4063, per=100.00%, avg=2545.00, stdev=1012.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=698KiB/s (715kB/s)(6144KiB/8804msec); 0 zone resets clat (msec): min=256, max=4506, avg=1029.15, stdev=1703.98 lat (msec): min=256, max=4506, avg=1029.24, stdev=1703.99 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 359], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1428, max= 2043, per=61.60%, avg=1917.60, stdev=273.71, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.92%, ctx=65, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144158: Sun Aug 23 03:46:49 2026 read: IOPS=0, BW=575KiB/s (588kB/s)(5120KiB/8910msec) clat (msec): min=83, max=673, avg=328.68, stdev=239.89 lat (msec): min=83, max=673, avg=328.68, stdev=239.89 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1988, max= 2039, per=91.01%, avg=2023.25, stdev=23.73, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=804KiB/s (824kB/s)(7168KiB/8910msec); 0 zone resets clat (msec): min=213, max=4457, avg=1029.44, stdev=1530.76 lat (msec): min=213, max=4457, avg=1029.54, stdev=1530.76 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 220], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 584], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 860], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1414, max= 4096, per=72.02%, avg=2242.00, stdev=938.55, samples=6 iops : min= 1, max= 4, avg= 1.50, stdev= 1.22, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.75%, ctx=112, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2224KiB/s (2277kB/s), 231KiB/s-778KiB/s (237kB/s-797kB/s), io=20.0MiB (20.0MB), run=8804-9209msec WRITE: bw=3113KiB/s (3188kB/s), 556KiB/s-1156KiB/s (569kB/s-1184kB/s), io=28.0MiB (29.4MB), run=8804-9209msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144165: Sun Aug 23 03:47:05 2026 read: IOPS=1, BW=4125KiB/s (4224kB/s)(12.0MiB/2979msec) clat (msec): min=724, max=1128, avg=959.23, stdev=209.97 lat (msec): min=724, max=1128, avg=959.23, stdev=209.97 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7699, max= 8031, per=100.00%, avg=7865.00, stdev=234.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.02%, ctx=65, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144166: Sun Aug 23 03:47:05 2026 read: IOPS=0, BW=975KiB/s (999kB/s)(4096KiB/4199msec) clat (nsec): min=1015.2M, max=1015.2M, avg=1015245757.00, stdev= 0.00 lat (nsec): min=1015.2M, max=1015.2M, avg=1015248044.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1951KiB/s (1998kB/s)(8192KiB/4199msec); 0 zone resets clat (msec): min=1341, max=1676, avg=1509.15, stdev=237.04 lat (msec): min=1343, max=1677, avg=1510.75, stdev=235.92 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.83%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144167: Sun Aug 23 03:47:05 2026 write: IOPS=1, BW=7984KiB/s (8176kB/s)(12.0MiB/1539msec); 0 zone resets clat (msec): min=429, max=560, avg=482.85, stdev=68.94 lat (msec): min=435, max=561, avg=484.97, stdev=67.03 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7366, max= 7699, per=96.53%, avg=7532.50, stdev=235.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=7.08%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144168: Sun Aug 23 03:47:05 2026 write: IOPS=0, BW=3696KiB/s (3784kB/s)(12.0MiB/3325msec); 0 zone resets clat (msec): min=474, max=1871, avg=1085.01, stdev=714.62 lat (msec): min=475, max=1871, avg=1085.40, stdev=714.62 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 5777, max= 8175, per=89.40%, avg=6976.00, stdev=1695.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.86%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3902KiB/s (3996kB/s), 975KiB/s-4125KiB/s (999kB/s-4224kB/s), io=16.0MiB (16.8MB), run=2979-4199msec WRITE: bw=7804KiB/s (7991kB/s), 1951KiB/s-7984KiB/s (1998kB/s-8176kB/s), io=32.0MiB (33.6MB), run=1539-4199msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144170: Sun Aug 23 03:47:05 2026 read: IOPS=1, BW=4164KiB/s (4264kB/s)(12.0MiB/2951msec) clat (msec): min=871, max=1060, avg=976.53, stdev=96.07 lat (msec): min=871, max=1060, avg=976.53, stdev=96.07 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8000, max= 8159, per=100.00%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.29%, ctx=227, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144171: Sun Aug 23 03:47:05 2026 read: IOPS=0, BW=1117KiB/s (1144kB/s)(4096KiB/3667msec) clat (nsec): min=978313k, max=978313k, avg=978313120.00, stdev= 0.00 lat (nsec): min=978314k, max=978314k, avg=978314410.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2234KiB/s (2288kB/s)(8192KiB/3667msec); 0 zone resets clat (msec): min=1331, max=1354, avg=1343.04, stdev=16.82 lat (msec): min=1331, max=1355, avg=1343.37, stdev=16.85 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7922, max= 7922, per=88.66%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.39%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144172: Sun Aug 23 03:47:05 2026 write: IOPS=0, BW=3701KiB/s (3790kB/s)(12.0MiB/3320msec); 0 zone resets clat (msec): min=947, max=1231, avg=1105.81, stdev=144.88 lat (msec): min=947, max=1231, avg=1106.12, stdev=144.86 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8047, max= 8192, per=90.87%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.30%, ctx=73, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144173: Sun Aug 23 03:47:05 2026 write: IOPS=1, BW=4240KiB/s (4342kB/s)(12.0MiB/2898msec); 0 zone resets clat (msec): min=650, max=1285, avg=965.17, stdev=317.75 lat (msec): min=650, max=1286, avg=965.47, stdev=317.68 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8143, max= 8175, per=91.32%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.56%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4468KiB/s (4575kB/s), 1117KiB/s-4164KiB/s (1144kB/s-4264kB/s), io=16.0MiB (16.8MB), run=2951-3667msec WRITE: bw=8936KiB/s (9150kB/s), 2234KiB/s-4240KiB/s (2288kB/s-4342kB/s), io=32.0MiB (33.6MB), run=2898-3667msec