== sanity test 398b: DIO and buffer IO race ============== 01:33:35 (1777008815) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 10.3952 s, 4.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180518: Fri Apr 24 01:37:56 2026 read: IOPS=6, BW=26.8KiB/s (27.4kB/s)(5992KiB/223823msec) clat (usec): min=68, max=365428, avg=79926.42, stdev=47311.07 lat (usec): min=70, max=365432, avg=79941.26, stdev=47303.49 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 26870], 10.00th=[ 35390], 20.00th=[ 43779], | 30.00th=[ 52167], 40.00th=[ 60556], 50.00th=[ 70779], 60.00th=[ 81265], | 70.00th=[ 93848], 80.00th=[110625], 90.00th=[137364], 95.00th=[160433], | 99.00th=[246416], 99.50th=[291505], 99.90th=[362808], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 71, per=25.79%, avg=26.82, stdev=11.92, samples=429 iops : min= 1, max= 17, avg= 6.01, stdev= 3.01, samples=429 write: IOPS=7, BW=28.1KiB/s (28.8kB/s)(6296KiB/223823msec); 0 zone resets clat (usec): min=1807, max=1763.1k, avg=65603.46, stdev=76309.21 lat (usec): min=1809, max=1763.1k, avg=65616.42, stdev=76317.48 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 18], 40.00th=[ 31], 50.00th=[ 46], 60.00th=[ 61], | 70.00th=[ 83], 80.00th=[ 111], 90.00th=[ 159], 95.00th=[ 190], | 99.00th=[ 275], 99.50th=[ 326], 99.90th=[ 447], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7, max= 100, per=26.04%, avg=28.38, stdev=14.84, samples=426 iops : min= 1, max= 25, avg= 6.41, stdev= 3.75, samples=426 lat (usec) : 100=0.62%, 250=0.46%, 500=0.16%, 750=0.07% lat (msec) : 2=0.10%, 4=1.60%, 10=6.80%, 20=8.46%, 50=22.40% lat (msec) : 100=35.61%, 250=22.46%, 500=1.24%, 2000=0.03% cpu : usr=0.01%, sys=1.26%, ctx=7983, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180520: Fri Apr 24 01:37:56 2026 read: IOPS=6, BW=25.9KiB/s (26.5kB/s)(5940KiB/229686msec) clat (usec): min=59, max=456353, avg=82528.84, stdev=49626.51 lat (usec): min=60, max=456355, avg=82534.99, stdev=49626.12 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 27395], 10.00th=[ 34866], 20.00th=[ 45876], | 30.00th=[ 53740], 40.00th=[ 62653], 50.00th=[ 71828], 60.00th=[ 84411], | 70.00th=[ 98042], 80.00th=[114820], 90.00th=[139461], 95.00th=[166724], | 99.00th=[254804], 99.50th=[291505], 99.90th=[379585], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 6, max= 64, per=24.99%, avg=25.99, stdev=11.65, samples=439 iops : min= 1, max= 16, avg= 5.79, stdev= 2.94, samples=439 write: IOPS=6, BW=27.6KiB/s (28.3kB/s)(6348KiB/229686msec); 0 zone resets clat (usec): min=1840, max=1856.6k, avg=66916.96, stdev=74167.93 lat (usec): min=1843, max=1856.6k, avg=66926.49, stdev=74164.82 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 14], | 30.00th=[ 22], 40.00th=[ 37], 50.00th=[ 51], 60.00th=[ 66], | 70.00th=[ 85], 80.00th=[ 112], 90.00th=[ 150], 95.00th=[ 180], | 99.00th=[ 264], 99.50th=[ 313], 99.90th=[ 351], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 6, max= 79, per=25.82%, avg=28.15, stdev=14.25, samples=434 iops : min= 1, max= 19, avg= 6.34, stdev= 3.59, samples=434 lat (usec) : 100=0.68%, 250=0.72%, 500=0.07% lat (msec) : 2=0.07%, 4=1.24%, 10=6.18%, 20=7.78%, 50=21.09% lat (msec) : 100=35.90%, 250=25.03%, 500=1.20%, 2000=0.03% cpu : usr=0.01%, sys=1.27%, ctx=8258, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180522: Fri Apr 24 01:37:56 2026 read: IOPS=6, BW=26.9KiB/s (27.5kB/s)(6028KiB/224306msec) clat (usec): min=63, max=463719, avg=80338.90, stdev=49014.38 lat (usec): min=64, max=463722, avg=80356.63, stdev=49008.98 clat percentiles (usec): | 1.00th=[ 91], 5.00th=[ 25035], 10.00th=[ 33162], 20.00th=[ 42730], | 30.00th=[ 53216], 40.00th=[ 60556], 50.00th=[ 70779], 60.00th=[ 82314], | 70.00th=[ 95945], 80.00th=[111674], 90.00th=[135267], 95.00th=[166724], | 99.00th=[258999], 99.50th=[316670], 99.90th=[379585], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 71, per=25.98%, avg=27.01, stdev=12.62, samples=428 iops : min= 1, max= 17, avg= 6.06, stdev= 3.18, samples=428 write: IOPS=6, BW=27.9KiB/s (28.6kB/s)(6260KiB/224306msec); 0 zone resets clat (usec): min=1772, max=1821.3k, avg=65351.22, stdev=76106.18 lat (usec): min=1775, max=1821.3k, avg=65369.82, stdev=76114.62 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 12], | 30.00th=[ 18], 40.00th=[ 31], 50.00th=[ 48], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 110], 90.00th=[ 150], 95.00th=[ 182], | 99.00th=[ 279], 99.50th=[ 309], 99.90th=[ 584], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 7, max= 71, per=25.69%, avg=28.00, stdev=13.65, samples=429 iops : min= 1, max= 17, avg= 6.31, stdev= 3.45, samples=429 lat (usec) : 100=0.78%, 250=0.55%, 500=0.16%, 750=0.03%, 1000=0.03% lat (msec) : 2=0.16%, 4=1.27%, 10=6.97%, 20=8.24%, 50=21.16% lat (msec) : 100=35.29%, 250=24.09%, 500=1.20%, 750=0.03%, 2000=0.03% cpu : usr=0.01%, sys=1.25%, ctx=7740, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180524: Fri Apr 24 01:37:56 2026 read: IOPS=6, BW=26.3KiB/s (26.9kB/s)(6052KiB/229992msec) clat (usec): min=69, max=1916.9k, avg=85283.88, stdev=69851.95 lat (usec): min=70, max=1916.9k, avg=85302.57, stdev=69843.50 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 28705], 10.00th=[ 35914], | 20.00th=[ 45876], 30.00th=[ 54789], 40.00th=[ 64226], | 50.00th=[ 74974], 60.00th=[ 85459], 70.00th=[ 96994], | 80.00th=[ 114820], 90.00th=[ 141558], 95.00th=[ 170918], | 99.00th=[ 274727], 99.50th=[ 341836], 99.90th=[ 467665], | 99.95th=[1920992], 99.99th=[1920992] bw ( KiB/s): min= 6, max= 63, per=25.42%, avg=26.44, stdev=11.97, samples=439 iops : min= 1, max= 15, avg= 5.91, stdev= 3.02, samples=439 write: IOPS=6, BW=27.1KiB/s (27.8kB/s)(6236KiB/229992msec); 0 zone resets clat (usec): min=1757, max=437775, avg=64210.59, stdev=60566.99 lat (usec): min=1759, max=437777, avg=64222.67, stdev=60565.11 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 9], 20.00th=[ 13], | 30.00th=[ 20], 40.00th=[ 33], 50.00th=[ 48], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 107], 90.00th=[ 148], 95.00th=[ 184], | 99.00th=[ 284], 99.50th=[ 317], 99.90th=[ 397], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 79, per=25.21%, avg=27.48, stdev=14.22, samples=435 iops : min= 1, max= 19, avg= 6.17, stdev= 3.59, samples=435 lat (usec) : 100=0.55%, 250=0.68%, 500=0.16%, 1000=0.03% lat (msec) : 2=0.20%, 4=1.11%, 10=6.71%, 20=7.94%, 50=20.70% lat (msec) : 100=36.75%, 250=23.63%, 500=1.50%, 2000=0.03% cpu : usr=0.02%, sys=1.30%, ctx=8104, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=104KiB/s (107kB/s), 25.9KiB/s-26.9KiB/s (26.5kB/s-27.5kB/s), io=23.4MiB (24.6MB), run=223823-229992msec WRITE: bw=109KiB/s (112kB/s), 27.1KiB/s-28.1KiB/s (27.8kB/s-28.8kB/s), io=24.6MiB (25.7MB), run=223823-229992msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180517: Fri Apr 24 01:39:22 2026 read: IOPS=4, BW=18.0KiB/s (19.4kB/s)(5992KiB/315936msec) clat (msec): min=11, max=1568, avg=80.96, stdev=77.33 lat (msec): min=11, max=1568, avg=80.96, stdev=77.33 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 109], 90.00th=[ 176], 95.00th=[ 228], | 99.00th=[ 342], 99.50th=[ 372], 99.90th=[ 584], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 78, per=27.28%, avg=20.73, stdev=13.36, samples=550 iops : min= 1, max= 19, avg= 4.47, stdev= 3.37, samples=550 write: IOPS=4, BW=19.9KiB/s (20.4kB/s)(6296KiB/315936msec); 0 zone resets clat (msec): min=29, max=595, avg=123.07, stdev=73.87 lat (msec): min=29, max=595, avg=123.08, stdev=73.87 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 60], 20.00th=[ 68], | 30.00th=[ 77], 40.00th=[ 86], 50.00th=[ 99], 60.00th=[ 116], | 70.00th=[ 140], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 271], | 99.00th=[ 380], 99.50th=[ 456], 99.90th=[ 527], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 6, max= 63, per=26.01%, avg=20.55, stdev=11.41, samples=583 iops : min= 1, max= 15, avg= 4.42, stdev= 2.86, samples=583 lat (msec) : 20=1.27%, 50=21.94%, 100=40.66%, 250=31.22%, 500=4.79% lat (msec) : 750=0.10%, 2000=0.03% cpu : usr=0.03%, sys=1.03%, ctx=5443, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180519: Fri Apr 24 01:39:22 2026 read: IOPS=4, BW=18.8KiB/s (19.3kB/s)(5940KiB/315347msec) clat (msec): min=12, max=1916, avg=80.90, stdev=82.09 lat (msec): min=12, max=1916, avg=80.91, stdev=82.09 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 85], 80.00th=[ 109], 90.00th=[ 167], 95.00th=[ 224], | 99.00th=[ 330], 99.50th=[ 368], 99.90th=[ 592], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 7, max= 87, per=27.24%, avg=20.70, stdev=13.25, samples=546 iops : min= 1, max= 21, avg= 4.46, stdev= 3.33, samples=546 write: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6348KiB/315347msec); 0 zone resets clat (msec): min=26, max=636, avg=122.53, stdev=71.23 lat (msec): min=26, max=636, avg=122.53, stdev=71.23 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 87], 50.00th=[ 100], 60.00th=[ 117], | 70.00th=[ 140], 80.00th=[ 169], 90.00th=[ 222], 95.00th=[ 266], | 99.00th=[ 368], 99.50th=[ 409], 99.90th=[ 514], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 63, per=26.10%, avg=20.62, stdev=11.10, samples=586 iops : min= 1, max= 15, avg= 4.44, stdev= 2.79, samples=586 lat (msec) : 20=1.04%, 50=21.84%, 100=40.89%, 250=31.32%, 500=4.75% lat (msec) : 750=0.13%, 2000=0.03% cpu : usr=0.02%, sys=1.01%, ctx=5450, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180521: Fri Apr 24 01:39:22 2026 read: IOPS=4, BW=19.1KiB/s (19.6kB/s)(6028KiB/315511msec) clat (msec): min=12, max=549, avg=81.42, stdev=64.56 lat (msec): min=12, max=549, avg=81.43, stdev=64.56 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 118], 90.00th=[ 171], 95.00th=[ 215], | 99.00th=[ 309], 99.50th=[ 355], 99.90th=[ 502], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 6, max= 79, per=26.70%, avg=20.29, stdev=13.39, samples=564 iops : min= 1, max= 19, avg= 4.36, stdev= 3.37, samples=564 write: IOPS=4, BW=19.8KiB/s (20.3kB/s)(6260KiB/315511msec); 0 zone resets clat (msec): min=21, max=1933, avg=122.71, stdev=84.94 lat (msec): min=21, max=1934, avg=122.72, stdev=84.95 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 56], 20.00th=[ 67], | 30.00th=[ 75], 40.00th=[ 87], 50.00th=[ 99], 60.00th=[ 115], | 70.00th=[ 140], 80.00th=[ 171], 90.00th=[ 218], 95.00th=[ 268], | 99.00th=[ 393], 99.50th=[ 422], 99.90th=[ 518], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 7, max= 63, per=25.64%, avg=20.26, stdev=11.89, samples=587 iops : min= 1, max= 15, avg= 4.35, stdev= 2.98, samples=587 lat (msec) : 20=1.20%, 50=20.64%, 100=41.02%, 250=32.81%, 500=4.17% lat (msec) : 750=0.13%, 2000=0.03% cpu : usr=0.02%, sys=0.98%, ctx=5440, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180523: Fri Apr 24 01:39:22 2026 read: IOPS=4, BW=19.3KiB/s (19.8kB/s)(6052KiB/313576msec) clat (msec): min=10, max=550, avg=77.17, stdev=60.95 lat (msec): min=10, max=550, avg=77.17, stdev=60.95 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 67], | 70.00th=[ 83], 80.00th=[ 109], 90.00th=[ 155], 95.00th=[ 209], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 498], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 6, max= 78, per=28.10%, avg=21.36, stdev=13.20, samples=541 iops : min= 1, max= 19, avg= 4.62, stdev= 3.32, samples=541 write: IOPS=4, BW=19.9KiB/s (20.4kB/s)(6236KiB/313576msec); 0 zone resets clat (msec): min=29, max=1830, avg=125.68, stdev=86.60 lat (msec): min=29, max=1830, avg=125.68, stdev=86.61 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 88], 50.00th=[ 101], 60.00th=[ 117], | 70.00th=[ 142], 80.00th=[ 174], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 414], 99.50th=[ 468], 99.90th=[ 625], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 7, max= 63, per=25.66%, avg=20.27, stdev=11.28, samples=586 iops : min= 1, max= 15, avg= 4.35, stdev= 2.83, samples=586 lat (msec) : 20=1.11%, 50=21.81%, 100=39.97%, 250=32.45%, 500=4.56% lat (msec) : 750=0.07%, 2000=0.03% cpu : usr=0.02%, sys=1.01%, ctx=5631, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=76.0KiB/s (77.8kB/s), 18.8KiB/s-19.3KiB/s (19.3kB/s-19.8kB/s), io=23.4MiB (24.6MB), run=313576-315936msec WRITE: bw=79.6KiB/s (81.5kB/s), 19.8KiB/s-20.1KiB/s (20.3kB/s-20.6kB/s), io=24.6MiB (25.7MB), run=313576-315936msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180590: Fri Apr 24 01:40:41 2026 read: IOPS=6, BW=102KiB/s (105kB/s)(5920KiB/57794msec) clat (usec): min=49, max=514799, avg=80596.37, stdev=53711.03 lat (usec): min=50, max=514801, avg=80616.81, stdev=53708.39 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 93], 10.00th=[ 31851], 20.00th=[ 45351], | 30.00th=[ 53216], 40.00th=[ 63701], 50.00th=[ 71828], 60.00th=[ 82314], | 70.00th=[ 94897], 80.00th=[115868], 90.00th=[137364], 95.00th=[158335], | 99.00th=[270533], 99.50th=[308282], 99.90th=[513803], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 30, max= 283, per=25.35%, avg=103.44, stdev=50.41, samples=111 iops : min= 1, max= 17, avg= 5.63, stdev= 3.20, samples=111 write: IOPS=6, BW=110KiB/s (113kB/s)(6368KiB/57794msec); 0 zone resets clat (msec): min=4, max=370, avg=69.54, stdev=60.95 lat (msec): min=4, max=370, avg=69.54, stdev=60.95 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 24], 40.00th=[ 40], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 84], 80.00th=[ 110], 90.00th=[ 163], 95.00th=[ 197], | 99.00th=[ 264], 99.50th=[ 292], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 24, max= 318, per=27.02%, avg=116.17, stdev=53.95, samples=107 iops : min= 1, max= 19, avg= 6.44, stdev= 3.40, samples=107 lat (usec) : 50=0.13%, 100=3.26%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 10=3.39%, 20=9.77%, 50=19.40%, 100=36.98%, 250=24.87% lat (msec) : 500=1.17%, 750=0.13% cpu : usr=0.01%, sys=1.11%, ctx=2047, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180591: Fri Apr 24 01:40:41 2026 read: IOPS=6, BW=98.2KiB/s (101kB/s)(5744KiB/58511msec) clat (usec): min=77, max=392837, avg=83022.64, stdev=51074.94 lat (usec): min=79, max=392881, avg=83025.55, stdev=51076.38 clat percentiles (usec): | 1.00th=[ 83], 5.00th=[ 247], 10.00th=[ 34341], 20.00th=[ 46924], | 30.00th=[ 56361], 40.00th=[ 66323], 50.00th=[ 80217], 60.00th=[ 87557], | 70.00th=[100140], 80.00th=[110625], 90.00th=[132645], 95.00th=[168821], | 99.00th=[295699], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 24, max= 211, per=24.58%, avg=100.29, stdev=45.54, samples=111 iops : min= 1, max= 13, avg= 5.43, stdev= 2.91, samples=111 write: IOPS=6, BW=112KiB/s (115kB/s)(6544KiB/58511msec); 0 zone resets clat (msec): min=3, max=345, avg=69.15, stdev=59.09 lat (msec): min=3, max=345, avg=69.16, stdev=59.09 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 17], | 30.00th=[ 25], 40.00th=[ 43], 50.00th=[ 56], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 113], 90.00th=[ 155], 95.00th=[ 194], | 99.00th=[ 251], 99.50th=[ 271], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 24, max= 350, per=25.98%, avg=111.70, stdev=59.01, samples=114 iops : min= 1, max= 21, avg= 6.16, stdev= 3.74, samples=114 lat (usec) : 100=1.43%, 250=0.91%, 500=0.39%, 750=0.26% lat (msec) : 4=0.39%, 10=5.47%, 20=7.16%, 50=18.49%, 100=39.19% lat (msec) : 250=25.13%, 500=1.17% cpu : usr=0.01%, sys=1.39%, ctx=2166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180592: Fri Apr 24 01:40:41 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(6256KiB/58593msec) clat (usec): min=72, max=293662, avg=84784.03, stdev=50548.46 lat (usec): min=74, max=293664, avg=84787.81, stdev=50549.19 clat percentiles (usec): | 1.00th=[ 86], 5.00th=[ 147], 10.00th=[ 36963], 20.00th=[ 46924], | 30.00th=[ 56886], 40.00th=[ 66323], 50.00th=[ 76022], 60.00th=[ 86508], | 70.00th=[100140], 80.00th=[120062], 90.00th=[149947], 95.00th=[173016], | 99.00th=[252707], 99.50th=[278922], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 247, per=26.16%, avg=106.74, stdev=47.00, samples=114 iops : min= 1, max= 15, avg= 5.84, stdev= 2.99, samples=114 write: IOPS=6, BW=103KiB/s (105kB/s)(6032KiB/58593msec); 0 zone resets clat (msec): min=3, max=296, avg=66.50, stdev=54.58 lat (msec): min=3, max=296, avg=66.55, stdev=54.58 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 28], 40.00th=[ 40], 50.00th=[ 52], 60.00th=[ 70], | 70.00th=[ 88], 80.00th=[ 112], 90.00th=[ 138], 95.00th=[ 176], | 99.00th=[ 239], 99.50th=[ 275], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 29, max= 287, per=23.69%, avg=101.85, stdev=52.08, samples=113 iops : min= 1, max= 17, avg= 5.52, stdev= 3.30, samples=113 lat (usec) : 100=1.69%, 250=1.30%, 500=0.13% lat (msec) : 4=0.26%, 10=4.30%, 20=8.07%, 50=19.66%, 100=36.46% lat (msec) : 250=27.21%, 500=0.91% cpu : usr=0.02%, sys=1.32%, ctx=2140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180593: Fri Apr 24 01:40:41 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(6032KiB/57572msec) clat (usec): min=72, max=348154, avg=82849.75, stdev=50659.53 lat (usec): min=74, max=348156, avg=82852.09, stdev=50659.56 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 121], 10.00th=[ 33817], 20.00th=[ 50070], | 30.00th=[ 57934], 40.00th=[ 66323], 50.00th=[ 73925], 60.00th=[ 86508], | 70.00th=[ 98042], 80.00th=[114820], 90.00th=[143655], 95.00th=[170918], | 99.00th=[278922], 99.50th=[316670], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 25, max= 254, per=25.72%, avg=104.93, stdev=46.04, samples=110 iops : min= 1, max= 15, avg= 5.73, stdev= 2.92, samples=110 write: IOPS=6, BW=109KiB/s (111kB/s)(6256KiB/57572msec); 0 zone resets clat (msec): min=2, max=335, avg=66.96, stdev=58.99 lat (msec): min=2, max=335, avg=66.99, stdev=59.05 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 23], 40.00th=[ 36], 50.00th=[ 50], 60.00th=[ 66], | 70.00th=[ 89], 80.00th=[ 117], 90.00th=[ 150], 95.00th=[ 178], | 99.00th=[ 251], 99.50th=[ 279], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 223, per=25.07%, avg=107.81, stdev=49.70, samples=112 iops : min= 1, max= 13, avg= 5.90, stdev= 3.13, samples=112 lat (usec) : 100=2.08%, 250=1.30%, 500=0.39%, 750=0.26%, 1000=0.13% lat (msec) : 2=0.13%, 4=0.26%, 10=4.56%, 20=9.51%, 50=16.93% lat (msec) : 100=37.63%, 250=25.65%, 500=1.17% cpu : usr=0.02%, sys=1.31%, ctx=2110, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=409KiB/s (419kB/s), 98.2KiB/s-107KiB/s (101kB/s-109kB/s), io=23.4MiB (24.5MB), run=57572-58593msec WRITE: bw=430KiB/s (440kB/s), 103KiB/s-112KiB/s (105kB/s-115kB/s), io=24.6MiB (25.8MB), run=57572-58593msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180594: Fri Apr 24 01:41:03 2026 read: IOPS=4, BW=74.9KiB/s (76.7kB/s)(5920KiB/79018msec) clat (msec): min=12, max=501, avg=83.01, stdev=71.81 lat (msec): min=12, max=501, avg=83.02, stdev=71.81 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 113], 90.00th=[ 186], 95.00th=[ 234], | 99.00th=[ 355], 99.50th=[ 405], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 29, max= 287, per=28.16%, avg=84.21, stdev=53.58, samples=137 iops : min= 1, max= 17, avg= 4.39, stdev= 3.36, samples=137 write: IOPS=5, BW=80.6KiB/s (82.5kB/s)(6368KiB/79018msec); 0 zone resets clat (msec): min=32, max=463, avg=120.97, stdev=72.53 lat (msec): min=32, max=463, avg=120.97, stdev=72.53 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 66], | 30.00th=[ 75], 40.00th=[ 86], 50.00th=[ 96], 60.00th=[ 109], | 70.00th=[ 133], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 275], | 99.00th=[ 372], 99.50th=[ 418], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 29, max= 222, per=27.31%, avg=86.02, stdev=45.77, samples=145 iops : min= 1, max= 13, avg= 4.50, stdev= 2.90, samples=145 lat (msec) : 20=1.17%, 50=20.18%, 100=43.88%, 250=29.56%, 500=5.08% lat (msec) : 750=0.13% cpu : usr=0.01%, sys=1.02%, ctx=1376, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180595: Fri Apr 24 01:41:03 2026 read: IOPS=4, BW=71.9KiB/s (73.6kB/s)(5744KiB/79930msec) clat (msec): min=15, max=393, avg=78.78, stdev=67.92 lat (msec): min=15, max=393, avg=78.78, stdev=67.92 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 46], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 83], 80.00th=[ 114], 90.00th=[ 171], 95.00th=[ 234], | 99.00th=[ 347], 99.50th=[ 380], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 26, max= 255, per=28.73%, avg=85.89, stdev=54.73, samples=131 iops : min= 1, max= 15, avg= 4.50, stdev= 3.44, samples=131 write: IOPS=5, BW=81.9KiB/s (83.8kB/s)(6544KiB/79930msec); 0 zone resets clat (msec): min=32, max=611, avg=125.53, stdev=74.49 lat (msec): min=32, max=611, avg=125.54, stdev=74.49 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 86], 50.00th=[ 101], 60.00th=[ 117], | 70.00th=[ 148], 80.00th=[ 184], 90.00th=[ 228], 95.00th=[ 275], | 99.00th=[ 334], 99.50th=[ 368], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 26, max= 222, per=26.69%, avg=84.07, stdev=49.02, samples=152 iops : min= 1, max= 13, avg= 4.38, stdev= 3.08, samples=152 lat (msec) : 20=1.04%, 50=23.44%, 100=37.76%, 250=31.90%, 500=5.73% lat (msec) : 750=0.13% cpu : usr=0.01%, sys=1.04%, ctx=1472, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180596: Fri Apr 24 01:41:03 2026 read: IOPS=4, BW=79.0KiB/s (80.9kB/s)(6256KiB/79151msec) clat (msec): min=12, max=413, avg=80.67, stdev=69.46 lat (msec): min=12, max=413, avg=80.68, stdev=69.46 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 66], | 70.00th=[ 83], 80.00th=[ 122], 90.00th=[ 186], 95.00th=[ 232], | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 29, max= 351, per=29.49%, avg=88.17, stdev=62.25, samples=139 iops : min= 1, max= 21, avg= 4.64, stdev= 3.93, samples=139 write: IOPS=4, BW=76.2KiB/s (78.0kB/s)(6032KiB/79151msec); 0 zone resets clat (msec): min=36, max=556, avg=124.91, stdev=80.23 lat (msec): min=36, max=556, avg=124.91, stdev=80.23 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 65], | 30.00th=[ 74], 40.00th=[ 84], 50.00th=[ 100], 60.00th=[ 116], | 70.00th=[ 140], 80.00th=[ 178], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 460], 99.50th=[ 523], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 223, per=25.94%, avg=81.70, stdev=44.98, samples=143 iops : min= 1, max= 13, avg= 4.23, stdev= 2.82, samples=143 lat (msec) : 20=1.30%, 50=25.26%, 100=36.46%, 250=30.99%, 500=5.60% lat (msec) : 750=0.39% cpu : usr=0.02%, sys=0.96%, ctx=1375, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180597: Fri Apr 24 01:41:03 2026 read: IOPS=4, BW=76.6KiB/s (78.4kB/s)(6032KiB/78756msec) clat (msec): min=13, max=400, avg=80.42, stdev=70.23 lat (msec): min=13, max=400, avg=80.42, stdev=70.23 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 82], 80.00th=[ 109], 90.00th=[ 180], 95.00th=[ 241], | 99.00th=[ 347], 99.50th=[ 384], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 30, max= 286, per=29.48%, avg=88.14, stdev=53.79, samples=133 iops : min= 1, max= 17, avg= 4.64, stdev= 3.40, samples=133 write: IOPS=4, BW=79.4KiB/s (81.3kB/s)(6256KiB/78756msec); 0 zone resets clat (msec): min=35, max=540, avg=122.48, stdev=78.49 lat (msec): min=35, max=540, avg=122.50, stdev=78.49 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 65], | 30.00th=[ 75], 40.00th=[ 83], 50.00th=[ 95], 60.00th=[ 110], | 70.00th=[ 133], 80.00th=[ 171], 90.00th=[ 228], 95.00th=[ 292], | 99.00th=[ 414], 99.50th=[ 527], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 29, max= 222, per=26.62%, avg=83.85, stdev=48.58, samples=146 iops : min= 1, max= 13, avg= 4.37, stdev= 3.06, samples=146 lat (msec) : 20=1.30%, 50=23.44%, 100=39.58%, 250=30.08%, 500=5.21% lat (msec) : 750=0.39% cpu : usr=0.03%, sys=1.06%, ctx=1367, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=300KiB/s (307kB/s), 71.9KiB/s-79.0KiB/s (73.6kB/s-80.9kB/s), io=23.4MiB (24.5MB), run=78756-79930msec WRITE: bw=315KiB/s (323kB/s), 76.2KiB/s-81.9KiB/s (78.0kB/s-83.8kB/s), io=24.6MiB (25.8MB), run=78756-79930msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180619: Fri Apr 24 01:41:33 2026 read: IOPS=0, BW=703KiB/s (720kB/s)(7168KiB/10200msec) clat (usec): min=908, max=5563.9k, avg=1117642.80, stdev=1969632.50 lat (usec): min=909, max=5563.9k, avg=1117645.25, stdev=1969632.49 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 906], 10.00th=[ 906], | 20.00th=[ 337642], 30.00th=[ 421528], 40.00th=[ 421528], | 50.00th=[ 425722], 60.00th=[ 455082], 70.00th=[ 455082], | 80.00th=[ 624952], 90.00th=[5536482], 95.00th=[5536482], | 99.00th=[5536482], 99.50th=[5536482], 99.90th=[5536482], | 99.95th=[5536482], 99.99th=[5536482] bw ( KiB/s): min= 1656, max= 2048, per=100.00%, avg=1959.00, stdev=151.85, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=502KiB/s (514kB/s)(5120KiB/10200msec); 0 zone resets clat (msec): min=230, max=965, avg=461.18, stdev=291.77 lat (msec): min=230, max=965, avg=461.44, stdev=291.71 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2031, max= 3618, per=100.00%, avg=2560.00, stdev=916.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.83%, ctx=718, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180620: Fri Apr 24 01:41:33 2026 read: IOPS=0, BW=154KiB/s (158kB/s)(2048KiB/13301msec) clat (msec): min=2, max=357, avg=180.29, stdev=250.73 lat (msec): min=3, max=357, avg=180.30, stdev=250.73 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1848, max= 2035, per=100.00%, avg=1941.50, stdev=132.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=770KiB/s (788kB/s)(10.0MiB/13301msec); 0 zone resets clat (msec): min=274, max=5886, avg=1254.67, stdev=1694.05 lat (msec): min=274, max=5886, avg=1254.91, stdev=1693.97 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 430], | 30.00th=[ 489], 40.00th=[ 531], 50.00th=[ 535], 60.00th=[ 642], | 70.00th=[ 760], 80.00th=[ 1083], 90.00th=[ 1921], 95.00th=[ 5873], | 99.00th=[ 5873], 99.50th=[ 5873], 99.90th=[ 5873], 99.95th=[ 5873], | 99.99th=[ 5873] bw ( KiB/s): min= 1848, max= 4063, per=100.00%, avg=2250.14, stdev=803.70, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 4=8.33%, 500=33.33%, 750=25.00%, 1000=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.26%, ctx=191, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180621: Fri Apr 24 01:41:33 2026 read: IOPS=0, BW=534KiB/s (547kB/s)(6144KiB/11506msec) clat (usec): min=517, max=673147, avg=275795.54, stdev=308090.14 lat (usec): min=519, max=673150, avg=275797.56, stdev=308090.68 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 2573], | 30.00th=[ 2573], 40.00th=[ 5997], 50.00th=[ 5997], 60.00th=[438305], | 70.00th=[534774], 80.00th=[534774], 90.00th=[675283], 95.00th=[675283], | 99.00th=[675283], 99.50th=[675283], 99.90th=[675283], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 2019, max= 4096, per=100.00%, avg=2542.25, stdev=1035.85, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=534KiB/s (547kB/s)(6144KiB/11506msec); 0 zone resets clat (msec): min=219, max=6222, avg=1535.36, stdev=2304.19 lat (msec): min=219, max=6222, avg=1535.44, stdev=2304.19 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 701], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 6208], 95.00th=[ 6208], | 99.00th=[ 6208], 99.50th=[ 6208], 99.90th=[ 6208], 99.95th=[ 6208], | 99.99th=[ 6208] bw ( KiB/s): min= 1809, max= 4096, per=100.00%, avg=2368.80, stdev=970.81, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=8.33%, 250=8.33%, 500=8.33%, 750=50.00% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.40%, ctx=176, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180622: Fri Apr 24 01:41:33 2026 read: IOPS=0, BW=401KiB/s (411kB/s)(5120KiB/12768msec) clat (usec): min=611, max=1303.9k, avg=471447.61, stdev=514752.87 lat (usec): min=613, max=1303.9k, avg=471449.86, stdev=514752.67 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], | 20.00th=[ 611], 30.00th=[ 115868], 40.00th=[ 115868], | 50.00th=[ 371196], 60.00th=[ 371196], 70.00th=[ 566232], | 80.00th=[ 566232], 90.00th=[1300235], 95.00th=[1300235], | 99.00th=[1300235], 99.50th=[1300235], 99.90th=[1300235], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 3696, max= 3923, per=100.00%, avg=3809.50, stdev=160.51, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=561KiB/s (575kB/s)(7168KiB/12768msec); 0 zone resets clat (msec): min=242, max=6276, avg=1393.99, stdev=2184.19 lat (msec): min=242, max=6276, avg=1394.14, stdev=2184.17 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 271], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 1334], 90.00th=[ 6275], 95.00th=[ 6275], | 99.00th=[ 6275], 99.50th=[ 6275], 99.90th=[ 6275], 99.95th=[ 6275], | 99.99th=[ 6275] bw ( KiB/s): min= 2019, max= 3764, per=100.00%, avg=2378.60, stdev=774.53, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=25.00%, 750=25.00%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.18%, ctx=180, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1540KiB/s (1577kB/s), 154KiB/s-703KiB/s (158kB/s-720kB/s), io=20.0MiB (20.0MB), run=10200-13301msec WRITE: bw=2156KiB/s (2207kB/s), 502KiB/s-770KiB/s (514kB/s-788kB/s), io=28.0MiB (29.4MB), run=10200-13301msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180614: Fri Apr 24 01:41:33 2026 read: IOPS=0, BW=588KiB/s (602kB/s)(7168KiB/12186msec) clat (msec): min=127, max=6695, avg=1295.26, stdev=2393.38 lat (msec): min=127, max=6695, avg=1295.26, stdev=2393.38 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 199], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 439], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 860], 90.00th=[ 6678], 95.00th=[ 6678], | 99.00th=[ 6678], 99.50th=[ 6678], 99.90th=[ 6678], 99.95th=[ 6678], | 99.99th=[ 6678] bw ( KiB/s): min= 1835, max= 2039, per=100.00%, avg=1947.17, stdev=87.19, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=420KiB/s (430kB/s)(5120KiB/12186msec); 0 zone resets clat (msec): min=203, max=1156, avg=533.11, stdev=393.07 lat (msec): min=203, max=1156, avg=533.47, stdev=393.19 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1715, max= 4087, per=100.00%, avg=2423.00, stdev=1117.26, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=0.02%, ctx=37, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180615: Fri Apr 24 01:41:33 2026 read: IOPS=0, BW=155KiB/s (158kB/s)(2048KiB/13239msec) clat (msec): min=260, max=666, avg=463.47, stdev=287.48 lat (msec): min=260, max=666, avg=463.47, stdev=287.48 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1510, max= 1845, per=100.00%, avg=1677.50, stdev=236.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=773KiB/s (792kB/s)(10.0MiB/13239msec); 0 zone resets clat (msec): min=286, max=6068, avg=1203.44, stdev=1743.04 lat (msec): min=286, max=6068, avg=1203.59, stdev=1743.02 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 309], | 30.00th=[ 338], 40.00th=[ 531], 50.00th=[ 659], 60.00th=[ 701], | 70.00th=[ 726], 80.00th=[ 1070], 90.00th=[ 1368], 95.00th=[ 6074], | 99.00th=[ 6074], 99.50th=[ 6074], 99.90th=[ 6074], 99.95th=[ 6074], | 99.99th=[ 6074] bw ( KiB/s): min= 1715, max= 2043, per=95.10%, avg=1964.67, stdev=115.07, samples=9 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=9 lat (msec) : 500=33.33%, 750=41.67%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.08%, ctx=96, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180616: Fri Apr 24 01:41:33 2026 read: IOPS=0, BW=468KiB/s (479kB/s)(6144KiB/13132msec) clat (msec): min=310, max=2629, avg=825.93, stdev=894.96 lat (msec): min=310, max=2629, avg=825.93, stdev=894.96 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 443], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1851, max= 2043, per=100.00%, avg=1997.40, stdev=82.93, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=468KiB/s (479kB/s)(6144KiB/13132msec); 0 zone resets clat (msec): min=216, max=6017, avg=1349.30, stdev=2292.36 lat (msec): min=217, max=6017, avg=1349.51, stdev=2292.27 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 493], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 6007], 95.00th=[ 6007], | 99.00th=[ 6007], 99.50th=[ 6007], 99.90th=[ 6007], 99.95th=[ 6007], | 99.99th=[ 6007] bw ( KiB/s): min= 1957, max= 2981, per=100.00%, avg=2203.20, stdev=436.12, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=8.33%, 500=58.33%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=0.24%, ctx=76, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180617: Fri Apr 24 01:41:33 2026 read: IOPS=0, BW=369KiB/s (378kB/s)(5120KiB/13878msec) clat (msec): min=150, max=1272, avg=589.37, stdev=502.47 lat (msec): min=150, max=1272, avg=589.38, stdev=502.47 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1835, max= 4079, per=100.00%, avg=2652.33, stdev=1239.90, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=517KiB/s (529kB/s)(7168KiB/13878msec); 0 zone resets clat (msec): min=225, max=6734, avg=1487.38, stdev=2334.11 lat (msec): min=225, max=6734, avg=1487.48, stdev=2334.10 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 284], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 802], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 1070], 90.00th=[ 6745], 95.00th=[ 6745], | 99.00th=[ 6745], 99.50th=[ 6745], 99.90th=[ 6745], 99.95th=[ 6745], | 99.99th=[ 6745] bw ( KiB/s): min= 1845, max= 2027, per=95.51%, avg=1973.17, stdev=66.98, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=25.00%, 500=25.00%, 1000=25.00%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=0.51%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1476KiB/s (1511kB/s), 155KiB/s-588KiB/s (158kB/s-602kB/s), io=20.0MiB (20.0MB), run=12186-13878msec WRITE: bw=2066KiB/s (2116kB/s), 420KiB/s-773KiB/s (430kB/s-792kB/s), io=28.0MiB (29.4MB), run=12186-13878msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180633: Fri Apr 24 01:42:00 2026 read: IOPS=0, BW=2494KiB/s (2554kB/s)(12.0MiB/4927msec) clat (msec): min=1377, max=1706, avg=1577.31, stdev=175.33 lat (msec): min=1377, max=1706, avg=1577.31, stdev=175.33 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7922, max= 8094, per=100.00%, avg=8008.00, stdev=121.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=1.40%, ctx=317, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180635: Fri Apr 24 01:42:00 2026 read: IOPS=0, BW=562KiB/s (576kB/s)(4096KiB/7285msec) clat (nsec): min=1073.3M, max=1073.3M, avg=1073317776.00, stdev= 0.00 lat (nsec): min=1073.3M, max=1073.3M, avg=1073321012.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1125KiB/s (1151kB/s)(8192KiB/7285msec); 0 zone resets clat (msec): min=1936, max=3694, avg=2815.17, stdev=1242.90 lat (msec): min=1936, max=3699, avg=2817.91, stdev=1246.47 clat percentiles (msec): | 1.00th=[ 1938], 5.00th=[ 1938], 10.00th=[ 1938], 20.00th=[ 1938], | 30.00th=[ 1938], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 3708], | 70.00th=[ 3708], 80.00th=[ 3708], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.07%, sys=1.59%, ctx=128, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180637: Fri Apr 24 01:42:00 2026 write: IOPS=0, BW=1784KiB/s (1827kB/s)(12.0MiB/6888msec); 0 zone resets clat (msec): min=562, max=3179, avg=2226.09, stdev=1445.79 lat (msec): min=562, max=3179, avg=2226.50, stdev=1445.78 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 2937], 50.00th=[ 2937], 60.00th=[ 2937], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 7922, max= 7953, per=100.00%, avg=7937.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=0.29%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180639: Fri Apr 24 01:42:00 2026 write: IOPS=0, BW=2191KiB/s (2243kB/s)(12.0MiB/5609msec); 0 zone resets clat (msec): min=595, max=2569, avg=1836.77, stdev=1081.22 lat (msec): min=595, max=2572, avg=1840.78, stdev=1084.15 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8015, max= 8175, per=100.00%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=0.27%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2249KiB/s (2303kB/s), 562KiB/s-2494KiB/s (576kB/s-2554kB/s), io=16.0MiB (16.8MB), run=4927-7285msec WRITE: bw=4498KiB/s (4606kB/s), 1125KiB/s-2191KiB/s (1151kB/s-2243kB/s), io=32.0MiB (33.6MB), run=5609-7285msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180632: Fri Apr 24 01:42:00 2026 read: IOPS=0, BW=2290KiB/s (2345kB/s)(12.0MiB/5366msec) clat (msec): min=1222, max=1865, avg=1640.56, stdev=362.64 lat (msec): min=1222, max=1865, avg=1640.57, stdev=362.64 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8078, max= 8126, per=100.00%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.02%, sys=0.60%, ctx=69, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180634: Fri Apr 24 01:42:00 2026 read: IOPS=0, BW=546KiB/s (559kB/s)(4096KiB/7501msec) clat (nsec): min=3949.9M, max=3949.9M, avg=3949862894.00, stdev= 0.00 lat (nsec): min=3949.9M, max=3949.9M, avg=3949866237.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3943], 5.00th=[ 3943], 10.00th=[ 3943], 20.00th=[ 3943], | 30.00th=[ 3943], 40.00th=[ 3943], 50.00th=[ 3943], 60.00th=[ 3943], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1092KiB/s (1118kB/s)(8192KiB/7501msec); 0 zone resets clat (msec): min=1495, max=1686, avg=1591.01, stdev=134.89 lat (msec): min=1497, max=1687, avg=1592.08, stdev=134.29 clat percentiles (msec): | 1.00th=[ 1502], 5.00th=[ 1502], 10.00th=[ 1502], 20.00th=[ 1502], | 30.00th=[ 1502], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1687], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.05%, sys=0.73%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180636: Fri Apr 24 01:42:00 2026 write: IOPS=0, BW=1843KiB/s (1887kB/s)(12.0MiB/6668msec); 0 zone resets clat (msec): min=476, max=3171, avg=2047.95, stdev=1401.93 lat (msec): min=478, max=3172, avg=2049.13, stdev=1401.26 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 2500], 50.00th=[ 2500], 60.00th=[ 2500], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=0.60%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180638: Fri Apr 24 01:42:00 2026 write: IOPS=0, BW=2434KiB/s (2493kB/s)(12.0MiB/5048msec); 0 zone resets clat (msec): min=844, max=2121, avg=1646.68, stdev=698.59 lat (msec): min=844, max=2121, avg=1647.06, stdev=698.60 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1972], 50.00th=[ 1972], 60.00th=[ 1972], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8062, max= 8078, per=100.00%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.96%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2184KiB/s (2237kB/s), 546KiB/s-2290KiB/s (559kB/s-2345kB/s), io=16.0MiB (16.8MB), run=5366-7501msec WRITE: bw=4368KiB/s (4473kB/s), 1092KiB/s-2434KiB/s (1118kB/s-2493kB/s), io=32.0MiB (33.6MB), run=5048-7501msec