== sanity test 398b: DIO and buffer IO race ============== 14:59:04 (1789066744) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.91729 s, 10.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145264: Thu Sep 10 15:01:04 2026 read: IOPS=14, BW=56.8KiB/s (58.2kB/s)(5992KiB/105405msec) clat (usec): min=34, max=691446, avg=33521.87, stdev=31058.22 lat (usec): min=34, max=691447, avg=33524.60, stdev=31058.56 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 83], 20.00th=[ 14091], | 30.00th=[ 18482], 40.00th=[ 22676], 50.00th=[ 27919], 60.00th=[ 34341], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 65274], 95.00th=[ 80217], | 99.00th=[117965], 99.50th=[137364], 99.90th=[231736], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 135, per=24.78%, avg=56.24, stdev=22.52, samples=207 iops : min= 3, max= 33, avg=13.45, stdev= 5.66, samples=207 write: IOPS=14, BW=59.7KiB/s (61.2kB/s)(6296KiB/105405msec); 0 zone resets clat (usec): min=958, max=305982, avg=34980.53, stdev=35455.97 lat (usec): min=959, max=305983, avg=34984.15, stdev=35456.65 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1696], 20.00th=[ 3621], | 30.00th=[ 7373], 40.00th=[ 16909], 50.00th=[ 27919], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[154141], 99.50th=[183501], 99.90th=[291505], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 8, max= 150, per=24.77%, avg=58.94, stdev=23.52, samples=207 iops : min= 2, max= 37, avg=14.13, stdev= 5.90, samples=207 lat (usec) : 50=0.72%, 100=4.43%, 250=0.72%, 500=0.16%, 750=0.13% lat (usec) : 1000=0.16% lat (msec) : 2=6.45%, 4=4.79%, 10=6.97%, 20=13.35%, 50=37.73% lat (msec) : 100=21.26%, 250=3.06%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=5.97%, ctx=6598, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145265: Thu Sep 10 15:01:04 2026 read: IOPS=14, BW=57.4KiB/s (58.8kB/s)(5940KiB/103500msec) clat (usec): min=28, max=920741, avg=32764.76, stdev=33574.90 lat (usec): min=28, max=920742, avg=32766.89, stdev=33577.27 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 69], 20.00th=[ 14746], | 30.00th=[ 19006], 40.00th=[ 22414], 50.00th=[ 27132], 60.00th=[ 33162], | 70.00th=[ 40109], 80.00th=[ 47973], 90.00th=[ 64750], 95.00th=[ 78119], | 99.00th=[110625], 99.50th=[127402], 99.90th=[196084], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 112, per=25.47%, avg=57.82, stdev=24.12, samples=202 iops : min= 1, max= 28, avg=13.85, stdev= 6.06, samples=202 write: IOPS=15, BW=61.3KiB/s (62.8kB/s)(6348KiB/103500msec); 0 zone resets clat (usec): min=973, max=431444, avg=34468.27, stdev=37377.74 lat (usec): min=974, max=431445, avg=34470.47, stdev=37377.30 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1270], 10.00th=[ 1893], 20.00th=[ 3556], | 30.00th=[ 6980], 40.00th=[ 15270], 50.00th=[ 25560], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[152044], 99.50th=[181404], 99.90th=[421528], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 15, max= 134, per=25.72%, avg=61.21, stdev=23.28, samples=204 iops : min= 3, max= 33, avg=14.71, stdev= 5.86, samples=204 lat (usec) : 50=0.94%, 100=4.49%, 250=0.59%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.66%, 4=5.96%, 10=6.80%, 20=14.29%, 50=38.15% lat (msec) : 100=19.34%, 250=3.35%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=6.15%, ctx=6610, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145266: Thu Sep 10 15:01:04 2026 read: IOPS=14, BW=57.7KiB/s (59.1kB/s)(6028KiB/104511msec) clat (usec): min=33, max=301080, avg=31394.59, stdev=25557.26 lat (usec): min=33, max=301081, avg=31397.96, stdev=25557.68 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 81], 20.00th=[ 13698], | 30.00th=[ 18220], 40.00th=[ 22414], 50.00th=[ 26346], 60.00th=[ 31327], | 70.00th=[ 38536], 80.00th=[ 47449], 90.00th=[ 62129], 95.00th=[ 76022], | 99.00th=[109577], 99.50th=[147850], 99.90th=[244319], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 168, per=25.61%, avg=58.14, stdev=25.45, samples=204 iops : min= 1, max= 42, avg=13.93, stdev= 6.39, samples=204 write: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6260KiB/104511msec); 0 zone resets clat (usec): min=912, max=958377, avg=36465.49, stdev=44479.25 lat (usec): min=912, max=958379, avg=36468.63, stdev=44478.67 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1254], 10.00th=[ 2024], 20.00th=[ 3982], | 30.00th=[ 7832], 40.00th=[ 16909], 50.00th=[ 27395], 60.00th=[ 35390], | 70.00th=[ 45876], 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[164627], 99.50th=[204473], 99.90th=[455082], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 15, max= 119, per=25.10%, avg=59.74, stdev=22.24, samples=206 iops : min= 3, max= 29, avg=14.33, stdev= 5.59, samples=206 lat (usec) : 50=0.88%, 100=4.59%, 250=0.72%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=5.05%, 4=5.24%, 10=7.23%, 20=14.94%, 50=38.44% lat (msec) : 100=18.75%, 250=3.65%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=6.08%, ctx=6648, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145267: Thu Sep 10 15:01:04 2026 read: IOPS=14, BW=58.1KiB/s (59.5kB/s)(6052KiB/104157msec) clat (usec): min=32, max=185475, avg=32190.78, stdev=24346.06 lat (usec): min=32, max=185476, avg=32193.67, stdev=24346.40 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 78], 20.00th=[ 14222], | 30.00th=[ 19006], 40.00th=[ 22414], 50.00th=[ 27132], 60.00th=[ 32113], | 70.00th=[ 40633], 80.00th=[ 49546], 90.00th=[ 64750], 95.00th=[ 78119], | 99.00th=[105382], 99.50th=[116917], 99.90th=[179307], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 7, max= 135, per=25.59%, avg=58.09, stdev=23.40, samples=204 iops : min= 1, max= 33, avg=13.91, stdev= 5.89, samples=204 write: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6236KiB/104157msec); 0 zone resets clat (usec): min=1020, max=969364, avg=35496.27, stdev=43721.48 lat (usec): min=1021, max=969366, avg=35497.80, stdev=43721.46 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1860], 20.00th=[ 3785], | 30.00th=[ 7046], 40.00th=[ 15270], 50.00th=[ 25297], 60.00th=[ 34866], | 70.00th=[ 46924], 80.00th=[ 59507], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[158335], 99.50th=[196084], 99.90th=[320865], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 141, per=24.98%, avg=59.45, stdev=22.89, samples=205 iops : min= 1, max= 35, avg=14.27, stdev= 5.75, samples=205 lat (usec) : 50=1.24%, 100=4.13%, 250=0.42%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.92%, 4=5.18%, 10=7.32%, 20=14.45%, 50=37.43% lat (msec) : 100=20.08%, 250=3.45%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=6.07%, ctx=6587, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=228KiB/s (233kB/s), 56.8KiB/s-58.1KiB/s (58.2kB/s-59.5kB/s), io=23.4MiB (24.6MB), run=103500-105405msec WRITE: bw=239KiB/s (244kB/s), 59.7KiB/s-61.3KiB/s (61.2kB/s-62.8kB/s), io=24.6MiB (25.7MB), run=103500-105405msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145259: Thu Sep 10 15:03:11 2026 read: IOPS=6, BW=26.0KiB/s (26.7kB/s)(5992KiB/230173msec) clat (msec): min=4, max=782, avg=30.57, stdev=37.05 lat (msec): min=4, max=782, avg=30.57, stdev=37.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 64], 95.00th=[ 89], | 99.00th=[ 150], 99.50th=[ 228], 99.90th=[ 368], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 104, per=27.01%, avg=27.82, stdev=17.91, samples=418 iops : min= 1, max= 26, avg= 6.35, stdev= 4.52, samples=418 write: IOPS=6, BW=27.4KiB/s (28.0kB/s)(6296KiB/230173msec); 0 zone resets clat (msec): min=35, max=435, avg=116.95, stdev=48.24 lat (msec): min=35, max=435, avg=116.95, stdev=48.24 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 108], 60.00th=[ 120], | 70.00th=[ 133], 80.00th=[ 150], 90.00th=[ 178], 95.00th=[ 209], | 99.00th=[ 275], 99.50th=[ 317], 99.90th=[ 426], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 63, per=25.02%, avg=27.02, stdev=10.51, samples=451 iops : min= 1, max= 15, avg= 6.14, stdev= 2.70, samples=451 lat (msec) : 10=4.79%, 20=20.38%, 50=17.25%, 100=25.68%, 250=30.83% lat (msec) : 500=1.04%, 1000=0.03% cpu : usr=0.04%, sys=1.24%, ctx=5207, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145260: Thu Sep 10 15:03:11 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(5940KiB/231777msec) clat (msec): min=5, max=1005, avg=29.59, stdev=37.54 lat (msec): min=5, max=1005, avg=29.59, stdev=37.54 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 63], 95.00th=[ 85], | 99.00th=[ 146], 99.50th=[ 163], 99.90th=[ 268], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 95, per=27.32%, avg=28.14, stdev=17.99, samples=410 iops : min= 1, max= 23, avg= 6.42, stdev= 4.54, samples=410 write: IOPS=6, BW=27.4KiB/s (28.0kB/s)(6348KiB/231777msec); 0 zone resets clat (msec): min=31, max=471, avg=118.17, stdev=50.07 lat (msec): min=31, max=471, avg=118.17, stdev=50.07 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 213], | 99.00th=[ 288], 99.50th=[ 321], 99.90th=[ 439], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 63, per=25.00%, avg=27.00, stdev=10.54, samples=456 iops : min= 1, max= 15, avg= 6.14, stdev= 2.69, samples=456 lat (msec) : 10=6.12%, 20=19.63%, 50=16.41%, 100=26.63%, 250=30.18% lat (msec) : 500=1.01%, 2000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5097, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145261: Thu Sep 10 15:03:11 2026 read: IOPS=6, BW=26.1KiB/s (26.8kB/s)(6028KiB/230544msec) clat (msec): min=4, max=360, avg=29.21, stdev=29.91 lat (msec): min=5, max=360, avg=29.21, stdev=29.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 61], 95.00th=[ 81], | 99.00th=[ 155], 99.50th=[ 192], 99.90th=[ 296], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 103, per=26.74%, avg=27.55, stdev=18.15, samples=425 iops : min= 1, max= 25, avg= 6.28, stdev= 4.57, samples=425 write: IOPS=6, BW=27.2KiB/s (27.8kB/s)(6260KiB/230544msec); 0 zone resets clat (msec): min=28, max=1053, avg=119.01, stdev=55.92 lat (msec): min=28, max=1053, avg=119.01, stdev=55.92 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 97], 50.00th=[ 109], 60.00th=[ 120], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 184], 95.00th=[ 211], | 99.00th=[ 300], 99.50th=[ 342], 99.90th=[ 472], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 55, per=25.02%, avg=27.02, stdev=10.60, samples=449 iops : min= 1, max= 13, avg= 6.14, stdev= 2.72, samples=449 lat (msec) : 10=6.45%, 20=18.85%, 50=18.07%, 100=25.94%, 250=29.75% lat (msec) : 500=0.91%, 2000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=4995, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145262: Thu Sep 10 15:03:11 2026 read: IOPS=6, BW=26.2KiB/s (26.8kB/s)(6052KiB/231318msec) clat (msec): min=4, max=296, avg=29.37, stdev=30.46 lat (msec): min=4, max=296, avg=29.37, stdev=30.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 61], 95.00th=[ 85], | 99.00th=[ 161], 99.50th=[ 215], 99.90th=[ 292], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 88, per=27.25%, avg=28.07, stdev=17.39, samples=419 iops : min= 1, max= 22, avg= 6.42, stdev= 4.38, samples=419 write: IOPS=6, BW=26.0KiB/s (27.6kB/s)(6236KiB/231318msec); 0 zone resets clat (msec): min=32, max=1049, avg=119.69, stdev=53.78 lat (msec): min=32, max=1049, avg=119.69, stdev=53.78 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 124], | 70.00th=[ 138], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 207], | 99.00th=[ 264], 99.50th=[ 309], 99.90th=[ 592], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 64, per=24.77%, avg=26.75, stdev=10.23, samples=452 iops : min= 1, max= 16, avg= 6.08, stdev= 2.62, samples=452 lat (msec) : 10=5.08%, 20=20.80%, 50=17.48%, 100=24.58%, 250=31.18% lat (msec) : 500=0.81%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.24%, ctx=4974, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=104KiB/s (106kB/s), 25.6KiB/s-26.2KiB/s (26.2kB/s-26.8kB/s), io=23.4MiB (24.6MB), run=230173-231777msec WRITE: bw=108KiB/s (111kB/s), 26.0KiB/s-27.4KiB/s (27.6kB/s-28.0kB/s), io=24.6MiB (25.7MB), run=230173-231777msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145328: Thu Sep 10 15:03:44 2026 read: IOPS=15, BW=244KiB/s (250kB/s)(5920KiB/24277msec) clat (usec): min=31, max=119565, avg=30307.17, stdev=26245.60 lat (usec): min=31, max=119567, avg=30308.29, stdev=26245.62 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 50], 10.00th=[ 59], 20.00th=[ 73], | 30.00th=[ 11863], 40.00th=[ 23725], 50.00th=[ 28967], 60.00th=[ 34341], | 70.00th=[ 41681], 80.00th=[ 51119], 90.00th=[ 68682], 95.00th=[ 78119], | 99.00th=[100140], 99.50th=[113771], 99.90th=[120062], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 64, max= 510, per=24.21%, avg=238.70, stdev=90.66, samples=47 iops : min= 4, max= 31, avg=14.23, stdev= 5.73, samples=47 write: IOPS=16, BW=262KiB/s (269kB/s)(6368KiB/24277msec); 0 zone resets clat (usec): min=1380, max=284636, avg=32177.24, stdev=37081.96 lat (usec): min=1383, max=284638, avg=32185.21, stdev=37087.85 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1696], 10.00th=[ 2606], 20.00th=[ 4080], | 30.00th=[ 6718], 40.00th=[ 10814], 50.00th=[ 18220], 60.00th=[ 28705], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[200279], 99.50th=[219153], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 63, max= 544, per=25.09%, avg=260.47, stdev=117.74, samples=47 iops : min= 3, max= 34, avg=15.60, stdev= 7.44, samples=47 lat (usec) : 50=2.47%, 100=9.11%, 250=1.17%, 500=0.39%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=4.30%, 4=6.12%, 10=9.77%, 20=9.90%, 50=34.11% lat (msec) : 100=19.14%, 250=2.86%, 500=0.13% cpu : usr=0.07%, sys=6.34%, ctx=1471, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145329: Thu Sep 10 15:03:44 2026 read: IOPS=14, BW=238KiB/s (244kB/s)(5744KiB/24108msec) clat (usec): min=37, max=234946, avg=34148.78, stdev=30471.05 lat (usec): min=37, max=234947, avg=34150.91, stdev=30470.82 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 91], | 30.00th=[ 20055], 40.00th=[ 26608], 50.00th=[ 31065], 60.00th=[ 36963], | 70.00th=[ 44303], 80.00th=[ 53216], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[131597], 99.50th=[219153], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 95, max= 510, per=24.20%, avg=238.57, stdev=96.21, samples=47 iops : min= 5, max= 31, avg=14.21, stdev= 6.00, samples=47 write: IOPS=16, BW=271KiB/s (278kB/s)(6544KiB/24108msec); 0 zone resets clat (usec): min=1477, max=134864, avg=28377.04, stdev=30626.60 lat (usec): min=1480, max=134865, avg=28393.16, stdev=30633.07 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1795], 10.00th=[ 2376], 20.00th=[ 3556], | 30.00th=[ 5211], 40.00th=[ 7898], 50.00th=[ 15533], 60.00th=[ 25297], | 70.00th=[ 38536], 80.00th=[ 55313], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[125305], 99.50th=[128451], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 31, max= 509, per=26.22%, avg=272.15, stdev=108.52, samples=47 iops : min= 1, max= 31, avg=16.34, stdev= 6.90, samples=47 lat (usec) : 50=1.69%, 100=7.94%, 250=1.04%, 500=0.26%, 1000=0.13% lat (msec) : 2=4.04%, 4=7.81%, 10=12.11%, 20=8.59%, 50=33.33% lat (msec) : 100=20.70%, 250=2.34% cpu : usr=0.09%, sys=6.23%, ctx=1484, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145330: Thu Sep 10 15:03:44 2026 read: IOPS=16, BW=269KiB/s (275kB/s)(6256KiB/23290msec) clat (usec): min=38, max=219883, avg=31465.60, stdev=29498.92 lat (usec): min=38, max=219885, avg=31466.73, stdev=29498.89 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 61], 20.00th=[ 79], | 30.00th=[ 14353], 40.00th=[ 22938], 50.00th=[ 28181], 60.00th=[ 33424], | 70.00th=[ 40633], 80.00th=[ 50594], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[128451], 99.50th=[152044], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 52, max= 444, per=27.65%, avg=272.60, stdev=87.54, samples=45 iops : min= 3, max= 27, avg=16.33, stdev= 5.50, samples=45 write: IOPS=16, BW=259KiB/s (265kB/s)(6032KiB/23290msec); 0 zone resets clat (usec): min=1419, max=249019, avg=28580.42, stdev=33024.93 lat (usec): min=1420, max=249020, avg=28582.43, stdev=33024.89 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1991], 10.00th=[ 3097], 20.00th=[ 4359], | 30.00th=[ 6259], 40.00th=[ 8455], 50.00th=[ 15664], 60.00th=[ 24249], | 70.00th=[ 34866], 80.00th=[ 49021], 90.00th=[ 69731], 95.00th=[ 93848], | 99.00th=[149947], 99.50th=[187696], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 95, max= 505, per=24.82%, avg=257.64, stdev=110.70, samples=45 iops : min= 5, max= 31, avg=15.40, stdev= 6.94, samples=45 lat (usec) : 50=0.91%, 100=10.81%, 250=1.17%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.73%, 4=6.38%, 10=12.50%, 20=9.64%, 50=34.90% lat (msec) : 100=16.93%, 250=3.26% cpu : usr=0.09%, sys=6.16%, ctx=1402, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145331: Thu Sep 10 15:03:44 2026 read: IOPS=15, BW=251KiB/s (257kB/s)(6032KiB/24003msec) clat (usec): min=36, max=193249, avg=31869.61, stdev=29049.95 lat (usec): min=36, max=193250, avg=31872.58, stdev=29050.10 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 58], 20.00th=[ 70], | 30.00th=[ 15664], 40.00th=[ 23200], 50.00th=[ 30278], 60.00th=[ 34866], | 70.00th=[ 41681], 80.00th=[ 51643], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[129500], 99.50th=[149947], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 539, per=25.28%, avg=249.28, stdev=101.69, samples=47 iops : min= 1, max= 33, avg=14.89, stdev= 6.45, samples=47 write: IOPS=16, BW=261KiB/s (267kB/s)(6256KiB/24003msec); 0 zone resets clat (usec): min=1331, max=279231, avg=30493.64, stdev=36471.57 lat (usec): min=1331, max=279233, avg=30504.76, stdev=36470.95 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1762], 10.00th=[ 2474], 20.00th=[ 4359], | 30.00th=[ 7242], 40.00th=[ 10421], 50.00th=[ 17433], 60.00th=[ 27395], | 70.00th=[ 35914], 80.00th=[ 48497], 90.00th=[ 74974], 95.00th=[100140], | 99.00th=[154141], 99.50th=[274727], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 414, per=25.04%, avg=259.94, stdev=87.34, samples=47 iops : min= 1, max= 25, avg=15.57, stdev= 5.54, samples=47 lat (usec) : 50=1.56%, 100=10.55%, 250=0.65%, 500=0.39% lat (msec) : 2=4.30%, 4=5.73%, 10=11.07%, 20=8.59%, 50=36.59% lat (msec) : 100=16.80%, 250=3.52%, 500=0.26% cpu : usr=0.06%, sys=5.80%, ctx=1372, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=987KiB/s (1010kB/s), 238KiB/s-269KiB/s (244kB/s-275kB/s), io=23.4MiB (24.5MB), run=23290-24277msec WRITE: bw=1038KiB/s (1063kB/s), 259KiB/s-271KiB/s (265kB/s-278kB/s), io=24.6MiB (25.8MB), run=23290-24277msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145332: Thu Sep 10 15:04:22 2026 read: IOPS=6, BW=97.1KiB/s (99.4kB/s)(5920KiB/60982msec) clat (msec): min=6, max=255, avg=34.34, stdev=30.42 lat (msec): min=6, max=255, avg=34.34, stdev=30.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 73], 95.00th=[ 103], | 99.00th=[ 144], 99.50th=[ 207], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 347, per=26.46%, avg=102.91, stdev=61.76, samples=113 iops : min= 1, max= 21, avg= 5.73, stdev= 3.95, samples=113 write: IOPS=6, BW=104KiB/s (107kB/s)(6368KiB/60982msec); 0 zone resets clat (msec): min=32, max=387, avg=120.55, stdev=48.09 lat (msec): min=32, max=387, avg=120.55, stdev=48.09 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 91], 40.00th=[ 101], 50.00th=[ 113], 60.00th=[ 123], | 70.00th=[ 136], 80.00th=[ 153], 90.00th=[ 188], 95.00th=[ 213], | 99.00th=[ 288], 99.50th=[ 296], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 31, max= 191, per=25.89%, avg=105.91, stdev=39.14, samples=118 iops : min= 1, max= 11, avg= 5.91, stdev= 2.49, samples=118 lat (msec) : 10=1.56%, 20=16.28%, 50=22.27%, 100=26.69%, 250=32.03% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.31%, ctx=1230, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145333: Thu Sep 10 15:04:22 2026 read: IOPS=5, BW=93.4KiB/s (95.7kB/s)(5744KiB/61478msec) clat (msec): min=7, max=243, avg=32.98, stdev=32.56 lat (msec): min=7, max=243, avg=32.98, stdev=32.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 71], 95.00th=[ 109], | 99.00th=[ 167], 99.50th=[ 194], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 27, max= 384, per=26.64%, avg=103.62, stdev=65.81, samples=108 iops : min= 1, max= 24, avg= 5.76, stdev= 4.12, samples=108 write: IOPS=6, BW=106KiB/s (109kB/s)(6544KiB/61478msec); 0 zone resets clat (msec): min=43, max=433, avg=120.76, stdev=50.35 lat (msec): min=43, max=433, avg=120.77, stdev=50.35 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 125], | 70.00th=[ 138], 80.00th=[ 153], 90.00th=[ 184], 95.00th=[ 218], | 99.00th=[ 275], 99.50th=[ 309], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 27, max= 222, per=25.98%, avg=106.24, stdev=40.63, samples=120 iops : min= 1, max= 13, avg= 5.93, stdev= 2.61, samples=120 lat (msec) : 10=2.60%, 20=18.49%, 50=19.40%, 100=24.22%, 250=33.98% lat (msec) : 500=1.30% cpu : usr=0.04%, sys=1.24%, ctx=1244, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145334: Thu Sep 10 15:04:22 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59835msec) clat (msec): min=6, max=284, avg=32.17, stdev=31.76 lat (msec): min=6, max=284, avg=32.17, stdev=31.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 71], 95.00th=[ 92], | 99.00th=[ 184], 99.50th=[ 194], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 320, per=29.70%, avg=115.53, stdev=71.24, samples=107 iops : min= 1, max= 20, avg= 6.52, stdev= 4.49, samples=107 write: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59835msec); 0 zone resets clat (msec): min=35, max=349, avg=124.50, stdev=49.11 lat (msec): min=35, max=349, avg=124.51, stdev=49.11 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 75], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 126], | 70.00th=[ 138], 80.00th=[ 155], 90.00th=[ 188], 95.00th=[ 224], | 99.00th=[ 305], 99.50th=[ 334], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 28, max= 192, per=24.44%, avg=99.96, stdev=36.15, samples=118 iops : min= 1, max= 12, avg= 5.53, stdev= 2.33, samples=118 lat (msec) : 10=2.47%, 20=20.44%, 50=20.44%, 100=22.14%, 250=33.07% lat (msec) : 500=1.43% cpu : usr=0.03%, sys=1.34%, ctx=1310, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145335: Thu Sep 10 15:04:22 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59842msec) clat (msec): min=6, max=277, avg=33.36, stdev=32.58 lat (msec): min=6, max=277, avg=33.36, stdev=32.58 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 70], 95.00th=[ 105], | 99.00th=[ 161], 99.50th=[ 268], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 352, per=27.66%, avg=107.60, stdev=65.62, samples=109 iops : min= 1, max= 22, avg= 6.02, stdev= 4.17, samples=109 write: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59842msec); 0 zone resets clat (msec): min=49, max=402, avg=120.74, stdev=45.85 lat (msec): min=49, max=403, avg=120.74, stdev=45.85 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 83], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 113], 60.00th=[ 123], | 70.00th=[ 136], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 215], | 99.00th=[ 249], 99.50th=[ 326], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 191, per=25.63%, avg=104.83, stdev=41.01, samples=117 iops : min= 1, max= 11, avg= 5.84, stdev= 2.62, samples=117 lat (msec) : 10=2.86%, 20=16.80%, 50=22.53%, 100=23.31%, 250=33.85% lat (msec) : 500=0.65% cpu : usr=0.03%, sys=1.32%, ctx=1277, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=390KiB/s (399kB/s), 93.4KiB/s-105KiB/s (95.7kB/s-107kB/s), io=23.4MiB (24.5MB), run=59835-61478msec WRITE: bw=410KiB/s (420kB/s), 101KiB/s-106KiB/s (103kB/s-109kB/s), io=24.6MiB (25.8MB), run=59835-61478msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145350: Thu Sep 10 15:04:35 2026 read: IOPS=1, BW=1864KiB/s (1908kB/s)(7168KiB/3846msec) clat (msec): min=71, max=486, avg=197.97, stdev=143.82 lat (msec): min=71, max=486, avg=197.97, stdev=143.82 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 73], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 171], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 249], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1946, max= 4036, per=92.85%, avg=3322.00, stdev=1191.93, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1331KiB/s (1363kB/s)(5120KiB/3846msec); 0 zone resets clat (msec): min=262, max=797, avg=453.40, stdev=231.71 lat (msec): min=262, max=798, avg=453.64, stdev=231.94 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1910, max= 3984, per=49.07%, avg=2458.00, stdev=1017.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=2.91%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145351: Thu Sep 10 15:04:35 2026 read: IOPS=0, BW=358KiB/s (366kB/s)(2048KiB/5723msec) clat (msec): min=148, max=180, avg=164.27, stdev=22.70 lat (msec): min=148, max=180, avg=164.27, stdev=22.70 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1910, max= 2039, per=55.18%, avg=1974.50, stdev=91.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1789KiB/s (1832kB/s)(10.0MiB/5723msec); 0 zone resets clat (msec): min=181, max=1131, avg=523.38, stdev=311.08 lat (msec): min=181, max=1131, avg=523.57, stdev=311.06 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 205], | 30.00th=[ 292], 40.00th=[ 376], 50.00th=[ 418], 60.00th=[ 460], | 70.00th=[ 514], 80.00th=[ 776], 90.00th=[ 885], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1976, max= 5896, per=51.40%, avg=2574.71, stdev=1464.73, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=2.87%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145352: Thu Sep 10 15:04:35 2026 read: IOPS=1, BW=1470KiB/s (1505kB/s)(6144KiB/4180msec) clat (msec): min=132, max=666, avg=267.11, stdev=202.35 lat (msec): min=132, max=666, avg=267.11, stdev=202.35 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 213], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1946, max= 3984, per=92.36%, avg=3304.67, stdev=1176.64, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1470KiB/s (1505kB/s)(6144KiB/4180msec); 0 zone resets clat (msec): min=161, max=845, avg=407.10, stdev=289.84 lat (msec): min=161, max=847, avg=407.40, stdev=290.23 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 279], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1910, max= 4090, per=52.88%, avg=2648.67, stdev=1248.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.07%, sys=2.37%, ctx=59, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145353: Thu Sep 10 15:04:35 2026 read: IOPS=1, BW=1214KiB/s (1244kB/s)(5120KiB/4216msec) clat (msec): min=85, max=997, avg=381.07, stdev=385.66 lat (msec): min=85, max=997, avg=381.07, stdev=385.66 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1965, max= 4079, per=75.00%, avg=2683.67, stdev=1208.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1700KiB/s (1741kB/s)(7168KiB/4216msec); 0 zone resets clat (msec): min=183, max=564, avg=324.37, stdev=142.04 lat (msec): min=183, max=564, avg=324.46, stdev=142.02 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 224], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 251], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 464], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1935, max= 3953, per=55.23%, avg=2766.60, stdev=1073.20, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=2.30%, ctx=51, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3579KiB/s (3664kB/s), 358KiB/s-1864KiB/s (366kB/s-1908kB/s), io=20.0MiB (20.0MB), run=3846-5723msec WRITE: bw=5010KiB/s (5130kB/s), 1331KiB/s-1789KiB/s (1363kB/s-1832kB/s), io=28.0MiB (29.4MB), run=3846-5723msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145355: Thu Sep 10 15:04:36 2026 read: IOPS=2, BW=2118KiB/s (2169kB/s)(7168KiB/3384msec) clat (usec): min=974, max=380149, avg=248838.82, stdev=127233.50 lat (usec): min=976, max=380150, avg=248840.33, stdev=127233.53 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 971], 10.00th=[ 971], 20.00th=[189793], | 30.00th=[229639], 40.00th=[229639], 50.00th=[283116], 60.00th=[316670], | 70.00th=[316670], 80.00th=[346031], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 1996, max= 3968, per=55.76%, avg=2410.60, stdev=870.76, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1513KiB/s (1549kB/s)(5120KiB/3384msec); 0 zone resets clat (msec): min=245, max=405, avg=328.01, stdev=58.78 lat (msec): min=246, max=406, avg=328.24, stdev=58.89 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1961, max= 2039, per=33.25%, avg=2012.50, stdev=35.30, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=66.67% cpu : usr=0.03%, sys=11.44%, ctx=173, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145356: Thu Sep 10 15:04:36 2026 read: IOPS=0, BW=432KiB/s (443kB/s)(2048KiB/4737msec) clat (msec): min=162, max=615, avg=389.40, stdev=320.37 lat (msec): min=162, max=615, avg=389.40, stdev=320.37 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1424, max= 1973, per=39.29%, avg=1698.50, stdev=388.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2162KiB/s (2214kB/s)(10.0MiB/4737msec); 0 zone resets clat (msec): min=190, max=561, avg=392.25, stdev=135.29 lat (msec): min=190, max=561, avg=392.54, stdev=135.23 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 247], | 30.00th=[ 284], 40.00th=[ 296], 50.00th=[ 363], 60.00th=[ 443], | 70.00th=[ 456], 80.00th=[ 542], 90.00th=[ 550], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1957, max= 4031, per=37.98%, avg=2298.43, stdev=764.71, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=33.33% cpu : usr=0.00%, sys=8.78%, ctx=123, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145357: Thu Sep 10 15:04:36 2026 read: IOPS=1, BW=1493KiB/s (1529kB/s)(6144KiB/4115msec) clat (usec): min=664, max=457616, avg=176192.58, stdev=199518.60 lat (usec): min=665, max=457617, avg=176193.72, stdev=199518.66 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 1188], | 30.00th=[ 1188], 40.00th=[ 7046], 50.00th=[ 7046], 60.00th=[270533], | 70.00th=[320865], 80.00th=[320865], 90.00th=[459277], 95.00th=[459277], | 99.00th=[459277], 99.50th=[459277], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 2039, max= 4087, per=77.66%, avg=3357.33, stdev=1143.88, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1493KiB/s (1529kB/s)(6144KiB/4115msec); 0 zone resets clat (msec): min=207, max=1313, avg=509.13, stdev=404.05 lat (msec): min=207, max=1313, avg=509.19, stdev=404.07 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 405], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1957, max= 2942, per=37.10%, avg=2245.25, stdev=466.19, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=8.33%, 500=58.33%, 2000=8.33% cpu : usr=0.00%, sys=8.87%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145358: Thu Sep 10 15:04:36 2026 read: IOPS=1, BW=1138KiB/s (1165kB/s)(5120KiB/4500msec) clat (usec): min=446, max=6107, avg=3212.89, stdev=2776.78 lat (usec): min=446, max=6108, avg=3213.73, stdev=2776.81 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 445], | 30.00th=[ 685], 40.00th=[ 685], 50.00th=[ 2737], 60.00th=[ 2737], | 70.00th=[ 6063], 80.00th=[ 6063], 90.00th=[ 6128], 95.00th=[ 6128], | 99.00th=[ 6128], 99.50th=[ 6128], 99.90th=[ 6128], 99.95th=[ 6128], | 99.99th=[ 6128] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1593KiB/s (1631kB/s)(7168KiB/4500msec); 0 zone resets clat (msec): min=231, max=1248, avg=639.77, stdev=375.78 lat (msec): min=231, max=1248, avg=640.21, stdev=375.80 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 435], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 489], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 1083], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1416, max= 4087, per=38.10%, avg=2306.00, stdev=1028.46, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 10=16.67%, 250=8.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.13%, sys=6.51%, ctx=100, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4323KiB/s (4427kB/s), 432KiB/s-2118KiB/s (443kB/s-2169kB/s), io=20.0MiB (20.0MB), run=3384-4737msec WRITE: bw=6053KiB/s (6198kB/s), 1493KiB/s-2162KiB/s (1529kB/s-2214kB/s), io=28.0MiB (29.4MB), run=3384-4737msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145366: Thu Sep 10 15:04:51 2026 read: IOPS=0, BW=3131KiB/s (3207kB/s)(12.0MiB/3924msec) clat (msec): min=1040, max=1304, avg=1214.32, stdev=150.75 lat (msec): min=1040, max=1304, avg=1214.32, stdev=150.75 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=7.34%, ctx=232, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145367: Thu Sep 10 15:04:51 2026 read: IOPS=0, BW=927KiB/s (949kB/s)(4096KiB/4419msec) clat (nsec): min=1029.0M, max=1029.0M, avg=1029997572.00, stdev= 0.00 lat (nsec): min=1029.0M, max=1029.0M, avg=1029998600.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1854KiB/s (1898kB/s)(8192KiB/4419msec); 0 zone resets clat (msec): min=877, max=2276, avg=1576.93, stdev=989.35 lat (msec): min=877, max=2277, avg=1577.75, stdev=989.98 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.12%, ctx=156, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145368: Thu Sep 10 15:04:51 2026 write: IOPS=0, BW=2232KiB/s (2286kB/s)(12.0MiB/5505msec); 0 zone resets clat (msec): min=466, max=2787, avg=1760.55, stdev=1183.09 lat (msec): min=467, max=2788, avg=1761.35, stdev=1183.51 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 2022], 50.00th=[ 2022], 60.00th=[ 2022], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.51%, ctx=67, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145369: Thu Sep 10 15:04:51 2026 write: IOPS=0, BW=3446KiB/s (3529kB/s)(12.0MiB/3566msec); 0 zone resets clat (msec): min=564, max=1939, avg=1084.12, stdev=746.17 lat (msec): min=565, max=1941, avg=1086.64, stdev=746.22 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.08%, sys=3.56%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3708KiB/s (3797kB/s), 927KiB/s-3131KiB/s (949kB/s-3207kB/s), io=16.0MiB (16.8MB), run=3924-4419msec WRITE: bw=5952KiB/s (6095kB/s), 1854KiB/s-3446KiB/s (1898kB/s-3529kB/s), io=32.0MiB (33.6MB), run=3566-5505msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145370: Thu Sep 10 15:04:51 2026 read: IOPS=0, BW=2837KiB/s (2905kB/s)(12.0MiB/4331msec) clat (msec): min=663, max=2004, avg=1390.77, stdev=677.37 lat (msec): min=663, max=2004, avg=1390.77, stdev=677.37 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.73%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145371: Thu Sep 10 15:04:51 2026 read: IOPS=0, BW=777KiB/s (795kB/s)(4096KiB/5273msec) clat (nsec): min=1725.6M, max=1725.6M, avg=1725622772.00, stdev= 0.00 lat (nsec): min=1725.6M, max=1725.6M, avg=1725624879.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1554KiB/s (1591kB/s)(8192KiB/5273msec); 0 zone resets clat (msec): min=1040, max=2204, avg=1622.62, stdev=823.49 lat (msec): min=1040, max=2205, avg=1622.91, stdev=823.50 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.08%, sys=1.50%, ctx=52, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145372: Thu Sep 10 15:04:51 2026 write: IOPS=0, BW=3107KiB/s (3182kB/s)(12.0MiB/3955msec); 0 zone resets clat (msec): min=898, max=1540, avg=1290.52, stdev=343.51 lat (msec): min=899, max=1540, avg=1291.13, stdev=343.56 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.05%, sys=3.39%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145373: Thu Sep 10 15:04:51 2026 write: IOPS=0, BW=2596KiB/s (2658kB/s)(12.0MiB/4734msec); 0 zone resets clat (msec): min=485, max=2937, avg=1482.88, stdev=1288.27 lat (msec): min=487, max=2937, avg=1483.72, stdev=1287.71 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.57%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3107KiB/s (3182kB/s), 777KiB/s-2837KiB/s (795kB/s-2905kB/s), io=16.0MiB (16.8MB), run=4331-5273msec WRITE: bw=6214KiB/s (6363kB/s), 1554KiB/s-3107KiB/s (1591kB/s-3182kB/s), io=32.0MiB (33.6MB), run=3955-5273msec