== sanity test 398b: DIO and buffer IO race ============== 07:20:41 (1782732041) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.56656 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144344: Mon Jun 29 07:23:07 2026 read: IOPS=12, BW=48.7KiB/s (49.8kB/s)(5992KiB/123083msec) clat (usec): min=34, max=893636, avg=39543.40, stdev=34803.22 lat (usec): min=34, max=893637, avg=39545.70, stdev=34802.92 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 8979], 20.00th=[ 19268], | 30.00th=[ 24249], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[128451], 99.50th=[143655], 99.90th=[193987], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 5, max= 127, per=25.61%, avg=48.92, stdev=22.74, samples=238 iops : min= 1, max= 31, avg=11.60, stdev= 5.73, samples=238 write: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6296KiB/123083msec); 0 zone resets clat (usec): min=991, max=419321, avg=40259.12, stdev=44368.70 lat (usec): min=992, max=419323, avg=40261.36, stdev=44368.92 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1467], 20.00th=[ 4424], | 30.00th=[ 8717], 40.00th=[ 17957], 50.00th=[ 27919], 60.00th=[ 39060], | 70.00th=[ 51119], 80.00th=[ 66847], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[196084], 99.50th=[252707], 99.90th=[383779], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 118, per=25.51%, avg=51.02, stdev=21.95, samples=240 iops : min= 1, max= 29, avg=12.15, stdev= 5.54, samples=240 lat (usec) : 50=0.65%, 100=3.74%, 250=0.13%, 500=0.07%, 1000=0.03% lat (msec) : 2=7.00%, 4=2.80%, 10=7.03%, 20=10.12%, 50=39.23% lat (msec) : 100=23.14%, 250=5.76%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=5.10%, ctx=6375, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144345: Mon Jun 29 07:23:07 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5940KiB/125586msec) clat (usec): min=24, max=817819, avg=42897.65, stdev=38353.51 lat (usec): min=24, max=817823, avg=42900.31, stdev=38354.91 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 12387], 20.00th=[ 20317], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 51119], 80.00th=[ 63701], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[132645], 99.50th=[160433], 99.90th=[549454], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 103, per=24.66%, avg=47.10, stdev=20.11, samples=245 iops : min= 1, max= 25, avg=11.14, stdev= 5.09, samples=245 write: IOPS=12, BW=50.5KiB/s (51.8kB/s)(6348KiB/125586msec); 0 zone resets clat (usec): min=984, max=415400, avg=38676.32, stdev=40724.84 lat (usec): min=985, max=415401, avg=38678.92, stdev=40723.85 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1549], 20.00th=[ 3884], | 30.00th=[ 7701], 40.00th=[ 18220], 50.00th=[ 28967], 60.00th=[ 39060], | 70.00th=[ 52167], 80.00th=[ 65274], 90.00th=[ 87557], 95.00th=[114820], | 99.00th=[185598], 99.50th=[208667], 99.90th=[333448], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 140, per=25.12%, avg=50.24, stdev=23.06, samples=245 iops : min= 1, max= 35, avg=11.95, stdev= 5.83, samples=245 lat (usec) : 50=0.52%, 100=3.12%, 250=0.16%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=6.41%, 4=4.10%, 10=7.03%, 20=8.98%, 50=38.09% lat (msec) : 100=25.52%, 250=5.60%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.98%, ctx=6411, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144346: Mon Jun 29 07:23:07 2026 read: IOPS=12, BW=48.1KiB/s (49.2kB/s)(6028KiB/125343msec) clat (usec): min=27, max=311448, avg=39180.59, stdev=30725.43 lat (usec): min=28, max=311450, avg=39182.77, stdev=30725.11 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 133], 20.00th=[ 17957], | 30.00th=[ 23200], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 56886], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[164627], 99.90th=[291505], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 111, per=25.26%, avg=48.24, stdev=22.07, samples=244 iops : min= 1, max= 27, avg=11.43, stdev= 5.58, samples=244 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6260KiB/125343msec); 0 zone resets clat (usec): min=1029, max=966339, avg=42056.65, stdev=49334.90 lat (usec): min=1031, max=966342, avg=42059.78, stdev=49335.23 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1647], 20.00th=[ 4228], | 30.00th=[ 9896], 40.00th=[ 21103], 50.00th=[ 31065], 60.00th=[ 41157], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[125305], | 99.00th=[202376], 99.50th=[254804], 99.90th=[400557], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 109, per=25.01%, avg=50.02, stdev=20.56, samples=244 iops : min= 1, max= 27, avg=11.88, stdev= 5.18, samples=244 lat (usec) : 50=0.52%, 100=4.26%, 250=0.49%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.18%, 4=3.78%, 10=6.02%, 20=10.25%, 50=38.93% lat (msec) : 100=23.37%, 250=5.73%, 500=0.33%, 1000=0.03% cpu : usr=0.07%, sys=4.75%, ctx=6279, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144347: Mon Jun 29 07:23:07 2026 read: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6052KiB/125684msec) clat (usec): min=34, max=580997, avg=40210.60, stdev=33696.90 lat (usec): min=34, max=580998, avg=40212.08, stdev=33697.02 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 3916], 20.00th=[ 18220], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[130548], 99.50th=[164627], 99.90th=[434111], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 7, max= 125, per=25.14%, avg=48.01, stdev=21.43, samples=244 iops : min= 1, max= 31, avg=11.37, stdev= 5.40, samples=244 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6236KiB/125684msec); 0 zone resets clat (usec): min=1003, max=830161, avg=41290.47, stdev=45503.89 lat (usec): min=1005, max=830165, avg=41298.13, stdev=45502.83 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1336], 10.00th=[ 1516], 20.00th=[ 4228], | 30.00th=[ 9503], 40.00th=[ 20317], 50.00th=[ 30278], 60.00th=[ 41157], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[181404], 99.50th=[198181], 99.90th=[308282], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 134, per=24.57%, avg=49.14, stdev=21.55, samples=246 iops : min= 1, max= 33, avg=11.66, stdev= 5.46, samples=246 lat (usec) : 50=0.78%, 100=3.81%, 250=0.13%, 500=0.03%, 750=0.16% lat (msec) : 2=6.48%, 4=3.42%, 10=5.99%, 20=10.64%, 50=37.89% lat (msec) : 100=24.32%, 250=6.09%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.97%, ctx=6466, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=191KiB/s (196kB/s), 47.3KiB/s-48.7KiB/s (48.4kB/s-49.8kB/s), io=23.4MiB (24.6MB), run=123083-125684msec WRITE: bw=200KiB/s (205kB/s), 49.6KiB/s-51.2KiB/s (50.8kB/s-52.4kB/s), io=24.6MiB (25.7MB), run=123083-125684msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144348: Mon Jun 29 07:25:15 2026 read: IOPS=5, BW=23.8KiB/s (24.3kB/s)(5992KiB/252002msec) clat (msec): min=5, max=910, avg=34.26, stdev=42.62 lat (msec): min=5, max=910, avg=34.27, stdev=42.62 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 75], 95.00th=[ 104], | 99.00th=[ 171], 99.50th=[ 220], 99.90th=[ 435], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 94, per=27.95%, avg=26.27, stdev=17.46, samples=442 iops : min= 1, max= 23, avg= 5.97, stdev= 4.43, samples=442 write: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6296KiB/252002msec); 0 zone resets clat (msec): min=32, max=593, avg=127.24, stdev=63.19 lat (msec): min=32, max=593, avg=127.24, stdev=63.19 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 167], 90.00th=[ 213], 95.00th=[ 253], | 99.00th=[ 338], 99.50th=[ 384], 99.90th=[ 514], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 56, per=25.03%, avg=24.78, stdev=11.55, samples=491 iops : min= 1, max= 14, avg= 5.59, stdev= 2.96, samples=491 lat (msec) : 10=4.30%, 20=19.04%, 50=17.64%, 100=25.46%, 250=30.66% lat (msec) : 500=2.80%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=5225, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144349: Mon Jun 29 07:25:15 2026 read: IOPS=5, BW=23.4KiB/s (23.0kB/s)(5940KiB/253679msec) clat (msec): min=4, max=844, avg=34.53, stdev=42.59 lat (msec): min=4, max=844, avg=34.54, stdev=42.60 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 81], 95.00th=[ 107], | 99.00th=[ 174], 99.50th=[ 209], 99.90th=[ 439], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 95, per=27.21%, avg=25.57, stdev=17.14, samples=449 iops : min= 1, max= 23, avg= 5.79, stdev= 4.32, samples=449 write: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6348KiB/253679msec); 0 zone resets clat (msec): min=31, max=593, avg=127.29, stdev=62.49 lat (msec): min=31, max=593, avg=127.30, stdev=62.49 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 142], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 253], | 99.00th=[ 338], 99.50th=[ 372], 99.90th=[ 439], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 79, per=25.08%, avg=24.83, stdev=11.59, samples=493 iops : min= 1, max= 19, avg= 5.60, stdev= 2.97, samples=493 lat (msec) : 10=4.72%, 20=17.68%, 50=19.01%, 100=24.77%, 250=30.99% lat (msec) : 500=2.77%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5234, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144350: Mon Jun 29 07:25:15 2026 read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(6028KiB/251792msec) clat (msec): min=5, max=396, avg=34.27, stdev=36.04 lat (msec): min=5, max=396, avg=34.27, stdev=36.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 79], 95.00th=[ 105], | 99.00th=[ 174], 99.50th=[ 197], 99.90th=[ 388], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 96, per=27.62%, avg=25.96, stdev=18.01, samples=449 iops : min= 1, max= 24, avg= 5.88, stdev= 4.54, samples=449 write: IOPS=6, BW=24.9KiB/s (25.5kB/s)(6260KiB/251792msec); 0 zone resets clat (msec): min=37, max=948, avg=127.65, stdev=67.00 lat (msec): min=37, max=948, avg=127.66, stdev=67.00 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 215], 95.00th=[ 251], | 99.00th=[ 342], 99.50th=[ 401], 99.90th=[ 634], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 56, per=24.73%, avg=24.49, stdev=11.65, samples=493 iops : min= 1, max= 14, avg= 5.51, stdev= 2.98, samples=493 lat (msec) : 10=4.56%, 20=17.61%, 50=18.42%, 100=26.40%, 250=30.14% lat (msec) : 500=2.77%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5171, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144351: Mon Jun 29 07:25:15 2026 read: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6052KiB/248990msec) clat (msec): min=5, max=430, avg=32.44, stdev=34.00 lat (msec): min=5, max=430, avg=32.44, stdev=34.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 157], 99.50th=[ 188], 99.90th=[ 397], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 118, per=28.81%, avg=27.09, stdev=18.03, samples=432 iops : min= 1, max= 29, avg= 6.16, stdev= 4.56, samples=432 write: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6236KiB/248990msec); 0 zone resets clat (msec): min=31, max=924, avg=127.93, stdev=64.92 lat (msec): min=31, max=924, avg=127.93, stdev=64.92 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 102], 50.00th=[ 112], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 211], 95.00th=[ 251], | 99.00th=[ 347], 99.50th=[ 372], 99.90th=[ 634], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 56, per=25.14%, avg=24.89, stdev=10.67, samples=483 iops : min= 1, max= 14, avg= 5.60, stdev= 2.74, samples=483 lat (msec) : 10=4.62%, 20=18.36%, 50=18.88%, 100=25.26%, 250=30.08% lat (msec) : 500=2.70%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5061, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=94.7KiB/s (96.9kB/s), 23.4KiB/s-24.3KiB/s (23.0kB/s-24.9kB/s), io=23.4MiB (24.6MB), run=248990-253679msec WRITE: bw=99.1KiB/s (101kB/s), 24.9KiB/s-25.0KiB/s (25.5kB/s-25.6kB/s), io=24.6MiB (25.7MB), run=248990-253679msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144402: Mon Jun 29 07:25:53 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5920KiB/27255msec) clat (usec): min=30, max=219067, avg=37428.70, stdev=33893.90 lat (usec): min=30, max=219068, avg=37433.39, stdev=33890.30 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 69], | 30.00th=[ 17695], 40.00th=[ 27132], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 48497], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[147850], 99.50th=[160433], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 95, max= 352, per=24.96%, avg=212.87, stdev=62.77, samples=53 iops : min= 5, max= 22, avg=12.57, stdev= 3.98, samples=53 write: IOPS=14, BW=234KiB/s (239kB/s)(6368KiB/27255msec); 0 zone resets clat (usec): min=1380, max=152313, avg=33471.69, stdev=31830.21 lat (usec): min=1382, max=152316, avg=33475.04, stdev=31830.08 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1909], 10.00th=[ 2671], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[ 14091], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 45876], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[139461], 99.50th=[143655], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 63, max= 480, per=25.69%, avg=230.68, stdev=93.70, samples=53 iops : min= 3, max= 30, avg=13.70, stdev= 5.99, samples=53 lat (usec) : 50=1.82%, 100=10.29%, 250=0.65%, 500=0.26% lat (msec) : 2=3.52%, 4=3.65%, 10=10.55%, 20=7.94%, 50=33.72% lat (msec) : 100=23.18%, 250=4.43% cpu : usr=0.09%, sys=5.73%, ctx=1396, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144404: Mon Jun 29 07:25:53 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5744KiB/28048msec) clat (usec): min=36, max=183611, avg=40815.25, stdev=33900.41 lat (usec): min=37, max=183613, avg=40821.53, stdev=33901.21 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 63], 20.00th=[ 87], | 30.00th=[ 21627], 40.00th=[ 31589], 50.00th=[ 40633], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[154141], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 30, max= 414, per=23.92%, avg=204.07, stdev=84.46, samples=55 iops : min= 1, max= 25, avg=12.00, stdev= 5.32, samples=55 write: IOPS=14, BW=233KiB/s (239kB/s)(6544KiB/28048msec); 0 zone resets clat (usec): min=1217, max=152834, avg=32117.76, stdev=31357.41 lat (usec): min=1219, max=152836, avg=32122.41, stdev=31356.94 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2008], 10.00th=[ 3228], 20.00th=[ 5342], | 30.00th=[ 7832], 40.00th=[ 10814], 50.00th=[ 22938], 60.00th=[ 31065], | 70.00th=[ 43779], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[ 94897], | 99.00th=[120062], 99.50th=[128451], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 63, max= 542, per=25.93%, avg=232.82, stdev=99.50, samples=55 iops : min= 3, max= 33, avg=13.82, stdev= 6.25, samples=55 lat (usec) : 50=0.78%, 100=8.98%, 250=0.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.60%, 4=5.08%, 10=12.89%, 20=7.16%, 50=32.29% lat (msec) : 100=24.61%, 250=4.56% cpu : usr=0.06%, sys=5.23%, ctx=1371, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144405: Mon Jun 29 07:25:53 2026 read: IOPS=14, BW=225KiB/s (231kB/s)(6256KiB/27746msec) clat (usec): min=37, max=181097, avg=36250.22, stdev=31144.55 lat (usec): min=37, max=181099, avg=36251.66, stdev=31144.56 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 74], | 30.00th=[ 17433], 40.00th=[ 28967], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[129500], 99.50th=[137364], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 570, per=26.91%, avg=229.51, stdev=93.92, samples=53 iops : min= 1, max= 35, avg=13.62, stdev= 5.90, samples=53 write: IOPS=13, BW=217KiB/s (223kB/s)(6032KiB/27746msec); 0 zone resets clat (usec): min=1541, max=253688, avg=35261.71, stdev=38401.59 lat (usec): min=1543, max=253690, avg=35264.14, stdev=38401.64 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2008], 10.00th=[ 2606], 20.00th=[ 5276], | 30.00th=[ 8029], 40.00th=[ 12780], 50.00th=[ 22414], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 57410], 90.00th=[ 81265], 95.00th=[106431], | 99.00th=[187696], 99.50th=[227541], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 60, max= 416, per=23.85%, avg=214.13, stdev=87.33, samples=54 iops : min= 3, max= 26, avg=12.65, stdev= 5.53, samples=54 lat (usec) : 50=2.47%, 100=10.03%, 250=0.65%, 500=0.26%, 1000=0.26% lat (msec) : 2=2.34%, 4=5.86%, 10=8.98%, 20=8.33%, 50=33.98% lat (msec) : 100=22.01%, 250=4.69%, 500=0.13% cpu : usr=0.08%, sys=5.37%, ctx=1445, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144407: Mon Jun 29 07:25:53 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(6032KiB/27454msec) clat (usec): min=39, max=259083, avg=39276.84, stdev=32111.55 lat (usec): min=39, max=259086, avg=39278.43, stdev=32111.72 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 78], | 30.00th=[ 23462], 40.00th=[ 32900], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[125305], 99.50th=[154141], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 32, max= 411, per=25.59%, avg=218.26, stdev=82.33, samples=54 iops : min= 2, max= 25, avg=12.91, stdev= 5.17, samples=54 write: IOPS=14, BW=228KiB/s (233kB/s)(6256KiB/27454msec); 0 zone resets clat (usec): min=1453, max=139995, avg=31766.27, stdev=33634.58 lat (usec): min=1455, max=139998, avg=31769.10, stdev=33634.56 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1860], 10.00th=[ 2442], 20.00th=[ 4178], | 30.00th=[ 7242], 40.00th=[ 10552], 50.00th=[ 17957], 60.00th=[ 28181], | 70.00th=[ 40633], 80.00th=[ 56886], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[137364], 99.50th=[139461], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 62, max= 383, per=25.36%, avg=227.74, stdev=89.88, samples=54 iops : min= 3, max= 23, avg=13.50, stdev= 5.67, samples=54 lat (usec) : 50=1.43%, 100=9.77%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=4.17%, 4=5.86%, 10=10.03%, 20=8.07%, 50=31.77% lat (msec) : 100=24.09%, 250=4.17%, 500=0.13% cpu : usr=0.09%, sys=5.28%, ctx=1389, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=854KiB/s (874kB/s), 205KiB/s-225KiB/s (210kB/s-231kB/s), io=23.4MiB (24.5MB), run=27255-28048msec WRITE: bw=898KiB/s (920kB/s), 217KiB/s-234KiB/s (223kB/s-239kB/s), io=24.6MiB (25.8MB), run=27255-28048msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144403: Mon Jun 29 07:26:29 2026 read: IOPS=5, BW=94.1KiB/s (96.4kB/s)(5920KiB/62888msec) clat (msec): min=7, max=255, avg=33.99, stdev=32.60 lat (msec): min=7, max=255, avg=33.99, stdev=32.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 67], 95.00th=[ 90], | 99.00th=[ 178], 99.50th=[ 215], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 377, per=27.65%, avg=103.70, stdev=70.62, samples=112 iops : min= 1, max= 23, avg= 5.70, stdev= 4.48, samples=112 write: IOPS=6, BW=101KiB/s (104kB/s)(6368KiB/62888msec); 0 zone resets clat (msec): min=31, max=385, avg=125.70, stdev=60.76 lat (msec): min=31, max=385, avg=125.70, stdev=60.76 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 63], 20.00th=[ 78], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 123], | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 203], 95.00th=[ 259], | 99.00th=[ 342], 99.50th=[ 351], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 192, per=26.20%, avg=103.50, stdev=44.16, samples=121 iops : min= 1, max= 12, avg= 5.68, stdev= 2.82, samples=121 lat (msec) : 10=2.86%, 20=16.41%, 50=21.74%, 100=24.61%, 250=31.51% lat (msec) : 500=2.86% cpu : usr=0.03%, sys=1.40%, ctx=1310, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144406: Mon Jun 29 07:26:29 2026 read: IOPS=5, BW=90.1KiB/s (92.2kB/s)(5744KiB/63770msec) clat (msec): min=6, max=298, avg=36.34, stdev=41.20 lat (msec): min=6, max=298, avg=36.34, stdev=41.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 85], 95.00th=[ 122], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 320, per=27.45%, avg=102.93, stdev=64.85, samples=109 iops : min= 1, max= 20, avg= 5.66, stdev= 4.11, samples=109 write: IOPS=6, BW=103KiB/s (105kB/s)(6544KiB/63770msec); 0 zone resets clat (msec): min=37, max=377, avg=123.30, stdev=61.74 lat (msec): min=37, max=377, avg=123.31, stdev=61.74 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 50], 10.00th=[ 59], 20.00th=[ 74], | 30.00th=[ 86], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 138], 80.00th=[ 165], 90.00th=[ 215], 95.00th=[ 262], | 99.00th=[ 317], 99.50th=[ 330], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 320, per=26.86%, avg=106.12, stdev=49.82, samples=121 iops : min= 1, max= 20, avg= 5.84, stdev= 3.20, samples=121 lat (msec) : 10=3.65%, 20=17.06%, 50=20.70%, 100=24.87%, 250=30.60% lat (msec) : 500=3.12% cpu : usr=0.04%, sys=1.44%, ctx=1419, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144408: Mon Jun 29 07:26:29 2026 read: IOPS=6, BW=103KiB/s (105kB/s)(6256KiB/60903msec) clat (msec): min=7, max=298, avg=33.43, stdev=34.79 lat (msec): min=7, max=298, avg=33.43, stdev=34.79 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 70], 95.00th=[ 97], | 99.00th=[ 184], 99.50th=[ 262], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 352, per=30.51%, avg=114.40, stdev=79.59, samples=108 iops : min= 1, max= 22, avg= 6.36, stdev= 5.02, samples=108 write: IOPS=6, BW=99.0KiB/s (101kB/s)(6032KiB/60903msec); 0 zone resets clat (msec): min=35, max=417, avg=126.52, stdev=63.41 lat (msec): min=35, max=417, avg=126.52, stdev=63.41 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 86], 40.00th=[ 94], 50.00th=[ 109], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 171], 90.00th=[ 215], 95.00th=[ 264], | 99.00th=[ 342], 99.50th=[ 414], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 220, per=24.86%, avg=98.21, stdev=45.42, samples=120 iops : min= 1, max= 13, avg= 5.34, stdev= 2.91, samples=120 lat (msec) : 10=3.52%, 20=18.75%, 50=21.61%, 100=26.56%, 250=26.69% lat (msec) : 500=2.86% cpu : usr=0.04%, sys=1.45%, ctx=1380, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144409: Mon Jun 29 07:26:29 2026 read: IOPS=6, BW=96.9KiB/s (99.2kB/s)(6032KiB/62275msec) clat (msec): min=7, max=230, avg=35.60, stdev=34.21 lat (msec): min=7, max=230, avg=35.61, stdev=34.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 81], 95.00th=[ 113], | 99.00th=[ 190], 99.50th=[ 205], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 320, per=27.81%, avg=104.28, stdev=68.73, samples=113 iops : min= 1, max= 20, avg= 5.73, stdev= 4.36, samples=113 write: IOPS=6, BW=100KiB/s (103kB/s)(6256KiB/62275msec); 0 zone resets clat (msec): min=45, max=405, avg=124.27, stdev=60.33 lat (msec): min=45, max=405, avg=124.28, stdev=60.33 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 107], 60.00th=[ 124], | 70.00th=[ 142], 80.00th=[ 163], 90.00th=[ 199], 95.00th=[ 245], | 99.00th=[ 342], 99.50th=[ 363], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 224, per=25.37%, avg=100.20, stdev=47.43, samples=123 iops : min= 1, max= 14, avg= 5.47, stdev= 3.03, samples=123 lat (msec) : 10=1.69%, 20=17.97%, 50=20.96%, 100=27.86%, 250=29.04% lat (msec) : 500=2.47% cpu : usr=0.04%, sys=1.42%, ctx=1314, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=376KiB/s (385kB/s), 90.1KiB/s-103KiB/s (92.2kB/s-105kB/s), io=23.4MiB (24.5MB), run=60903-63770msec WRITE: bw=395KiB/s (405kB/s), 99.0KiB/s-103KiB/s (101kB/s-105kB/s), io=24.6MiB (25.8MB), run=60903-63770msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144425: Mon Jun 29 07:26:45 2026 read: IOPS=1, BW=1463KiB/s (1498kB/s)(7168KiB/4901msec) clat (usec): min=1775, max=2198.3k, avg=491520.51, stdev=767142.09 lat (usec): min=1776, max=2198.3k, avg=491522.17, stdev=767141.99 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 1778], 10.00th=[ 1778], | 20.00th=[ 6259], 30.00th=[ 231736], 40.00th=[ 231736], | 50.00th=[ 308282], 60.00th=[ 341836], 70.00th=[ 341836], | 80.00th=[ 350225], 90.00th=[2197816], 95.00th=[2197816], | 99.00th=[2197816], 99.50th=[2197816], 99.90th=[2197816], | 99.95th=[2197816], 99.99th=[2197816] bw ( KiB/s): min= 1350, max= 4087, per=55.29%, avg=2310.00, stdev=1037.05, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1045KiB/s (1070kB/s)(5120KiB/4901msec); 0 zone resets clat (msec): min=154, max=348, avg=243.97, stdev=74.66 lat (msec): min=154, max=348, avg=244.06, stdev=74.66 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 2043, max= 4071, per=55.49%, avg=3246.00, stdev=1065.53, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 10=8.33%, 250=25.00%, 500=50.00%, >=2000=8.33% cpu : usr=0.06%, sys=6.92%, ctx=272, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144426: Mon Jun 29 07:26:45 2026 read: IOPS=0, BW=460KiB/s (471kB/s)(2048KiB/4450msec) clat (msec): min=160, max=349, avg=254.80, stdev=133.32 lat (msec): min=160, max=349, avg=254.80, stdev=133.32 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1488, max= 2031, per=42.11%, avg=1759.50, stdev=383.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2301KiB/s (2356kB/s)(10.0MiB/4450msec); 0 zone resets clat (msec): min=129, max=918, avg=364.99, stdev=260.48 lat (msec): min=129, max=924, avg=365.73, stdev=261.95 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 150], | 30.00th=[ 188], 40.00th=[ 197], 50.00th=[ 234], 60.00th=[ 305], | 70.00th=[ 317], 80.00th=[ 575], 90.00th=[ 642], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1812, max= 6131, per=61.46%, avg=3595.20, stdev=1760.56, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=10.56%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144428: Mon Jun 29 07:26:45 2026 read: IOPS=1, BW=1303KiB/s (1334kB/s)(6144KiB/4716msec) clat (usec): min=532, max=379906, avg=159584.92, stdev=177344.62 lat (usec): min=533, max=379908, avg=159586.56, stdev=177344.69 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 799], 50.00th=[ 799], 60.00th=[287310], | 70.00th=[291505], 80.00th=[291505], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 1812, max= 4063, per=78.17%, avg=3266.00, stdev=1261.15, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1303KiB/s (1334kB/s)(6144KiB/4716msec); 0 zone resets clat (msec): min=218, max=1309, avg=588.45, stdev=464.73 lat (msec): min=219, max=1309, avg=588.64, stdev=464.64 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 485], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1442, max= 2035, per=31.73%, avg=1856.20, stdev=248.51, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=16.67%, 500=41.67%, 2000=16.67% cpu : usr=0.00%, sys=6.83%, ctx=131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144430: Mon Jun 29 07:26:45 2026 read: IOPS=1, BW=1211KiB/s (1240kB/s)(5120KiB/4227msec) clat (usec): min=502, max=279506, avg=171077.00, stdev=117371.02 lat (usec): min=504, max=279508, avg=171078.53, stdev=117371.01 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[100140], 40.00th=[100140], 50.00th=[225444], 60.00th=[225444], | 70.00th=[250610], 80.00th=[250610], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1696KiB/s (1736kB/s)(7168KiB/4227msec); 0 zone resets clat (msec): min=136, max=1283, avg=477.26, stdev=431.96 lat (msec): min=136, max=1283, avg=477.36, stdev=431.93 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 201], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 292], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 877], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1434, max= 4087, per=49.72%, avg=2908.75, stdev=1377.93, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.54%, ctx=146, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4179KiB/s (4279kB/s), 460KiB/s-1463KiB/s (471kB/s-1498kB/s), io=20.0MiB (20.0MB), run=4227-4901msec WRITE: bw=5850KiB/s (5991kB/s), 1045KiB/s-2301KiB/s (1070kB/s-2356kB/s), io=28.0MiB (29.4MB), run=4227-4901msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144424: Mon Jun 29 07:26:46 2026 read: IOPS=1, BW=1227KiB/s (1257kB/s)(7168KiB/5840msec) clat (msec): min=47, max=1719, avg=568.81, stdev=627.82 lat (msec): min=47, max=1719, avg=568.81, stdev=627.82 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 81], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 300], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 1133], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1735, max= 2043, per=55.80%, avg=1956.50, stdev=120.37, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=877KiB/s (898kB/s)(5120KiB/5840msec); 0 zone resets clat (msec): min=123, max=814, avg=339.83, stdev=281.77 lat (msec): min=123, max=814, avg=340.12, stdev=281.70 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2035, max= 4079, per=55.39%, avg=2719.00, stdev=1177.80, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, 2000=16.67% cpu : usr=0.05%, sys=2.38%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144427: Mon Jun 29 07:26:46 2026 read: IOPS=0, BW=395KiB/s (404kB/s)(2048KiB/5187msec) clat (msec): min=163, max=592, avg=377.80, stdev=303.47 lat (msec): min=163, max=592, avg=377.80, stdev=303.47 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2019, max= 2035, per=57.82%, avg=2027.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1974KiB/s (2022kB/s)(10.0MiB/5187msec); 0 zone resets clat (msec): min=148, max=976, avg=408.66, stdev=226.95 lat (msec): min=148, max=976, avg=408.76, stdev=226.95 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 178], | 30.00th=[ 321], 40.00th=[ 338], 50.00th=[ 363], 60.00th=[ 435], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 460], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 2003, max= 4087, per=60.99%, avg=2993.83, stdev=1061.20, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 250=25.00%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.26%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144429: Mon Jun 29 07:26:46 2026 read: IOPS=1, BW=1125KiB/s (1152kB/s)(6144KiB/5462msec) clat (msec): min=88, max=996, avg=311.36, stdev=352.56 lat (msec): min=88, max=996, avg=311.36, stdev=352.56 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 157], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 2035, max= 3806, per=70.82%, avg=2483.00, stdev=882.02, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1125KiB/s (1152kB/s)(6144KiB/5462msec); 0 zone resets clat (msec): min=167, max=1205, avg=550.30, stdev=356.72 lat (msec): min=167, max=1206, avg=550.57, stdev=357.12 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 535], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1992, max= 2043, per=41.21%, avg=2023.20, stdev=19.60, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.16%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144431: Mon Jun 29 07:26:46 2026 read: IOPS=0, BW=965KiB/s (988kB/s)(5120KiB/5305msec) clat (msec): min=80, max=256, avg=156.21, stdev=75.47 lat (msec): min=80, max=256, avg=156.22, stdev=75.46 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 125], 60.00th=[ 125], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 4000, max= 4055, per=100.00%, avg=4027.50, stdev=38.89, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1351KiB/s (1384kB/s)(7168KiB/5305msec); 0 zone resets clat (msec): min=242, max=1115, avg=551.18, stdev=379.42 lat (msec): min=242, max=1115, avg=551.29, stdev=379.43 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 264], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 380], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 1083], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1903, max= 4096, per=51.02%, avg=2504.50, stdev=1062.22, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 2000=16.67% cpu : usr=0.00%, sys=3.43%, ctx=124, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3507KiB/s (3591kB/s), 395KiB/s-1227KiB/s (404kB/s-1257kB/s), io=20.0MiB (20.0MB), run=5187-5840msec WRITE: bw=4910KiB/s (5027kB/s), 877KiB/s-1974KiB/s (898kB/s-2022kB/s), io=28.0MiB (29.4MB), run=5187-5840msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144439: Mon Jun 29 07:27:01 2026 read: IOPS=1, BW=7132KiB/s (7303kB/s)(12.0MiB/1723msec) clat (msec): min=469, max=768, avg=571.45, stdev=171.09 lat (msec): min=469, max=768, avg=571.45, stdev=171.09 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.58%, ctx=184, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144440: Mon Jun 29 07:27:01 2026 read: IOPS=0, BW=797KiB/s (816kB/s)(4096KiB/5142msec) clat (nsec): min=4034.9M, max=4034.9M, avg=4034884716.00, stdev= 0.00 lat (nsec): min=4034.9M, max=4034.9M, avg=4034886032.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4044], 5.00th=[ 4044], 10.00th=[ 4044], 20.00th=[ 4044], | 30.00th=[ 4044], 40.00th=[ 4044], 50.00th=[ 4044], 60.00th=[ 4044], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1593KiB/s (1631kB/s)(8192KiB/5142msec); 0 zone resets clat (msec): min=523, max=581, avg=552.30, stdev=41.27 lat (msec): min=523, max=581, avg=552.73, stdev=41.25 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=6.26%, ctx=600, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144441: Mon Jun 29 07:27:01 2026 write: IOPS=0, BW=2469KiB/s (2529kB/s)(12.0MiB/4976msec); 0 zone resets clat (msec): min=397, max=3750, avg=1641.65, stdev=1836.50 lat (msec): min=398, max=3751, avg=1642.51, stdev=1836.09 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 3742], 80.00th=[ 3742], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min=16253, max=16253, per=100.00%, avg=16253.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.83%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144442: Mon Jun 29 07:27:01 2026 write: IOPS=0, BW=2318KiB/s (2374kB/s)(12.0MiB/5300msec); 0 zone resets clat (msec): min=632, max=3760, avg=1765.40, stdev=1733.17 lat (msec): min=632, max=3761, avg=1765.89, stdev=1733.17 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.19%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3186KiB/s (3263kB/s), 797KiB/s-7132KiB/s (816kB/s-7303kB/s), io=16.0MiB (16.8MB), run=1723-5142msec WRITE: bw=6183KiB/s (6331kB/s), 1593KiB/s-2469KiB/s (1631kB/s-2529kB/s), io=32.0MiB (33.6MB), run=4976-5300msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144444: Mon Jun 29 07:27:02 2026 read: IOPS=0, BW=2463KiB/s (2522kB/s)(12.0MiB/4990msec) clat (msec): min=423, max=3763, avg=1631.65, stdev=1851.35 lat (msec): min=423, max=3763, avg=1631.65, stdev=1851.35 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 7984, max= 8110, per=100.00%, avg=8047.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.98%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144445: Mon Jun 29 07:27:02 2026 read: IOPS=0, BW=796KiB/s (815kB/s)(4096KiB/5144msec) clat (nsec): min=4030.6M, max=4030.6M, avg=4030563833.00, stdev= 0.00 lat (nsec): min=4030.6M, max=4030.6M, avg=4030565823.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4044], 5.00th=[ 4044], 10.00th=[ 4044], 20.00th=[ 4044], | 30.00th=[ 4044], 40.00th=[ 4044], 50.00th=[ 4044], 60.00th=[ 4044], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1593KiB/s (1631kB/s)(8192KiB/5144msec); 0 zone resets clat (msec): min=450, max=616, avg=533.56, stdev=116.95 lat (msec): min=451, max=617, avg=534.61, stdev=117.83 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.77%, ctx=49, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144446: Mon Jun 29 07:27:02 2026 write: IOPS=0, BW=2315KiB/s (2371kB/s)(12.0MiB/5307msec); 0 zone resets clat (msec): min=408, max=4411, avg=1766.41, stdev=2290.88 lat (msec): min=409, max=4413, avg=1767.63, stdev=2291.79 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 8000, max= 8110, per=100.00%, avg=8055.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=2.58%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144447: Mon Jun 29 07:27:02 2026 write: IOPS=0, BW=2379KiB/s (2436kB/s)(12.0MiB/5165msec); 0 zone resets clat (msec): min=282, max=3825, avg=1719.08, stdev=1864.12 lat (msec): min=282, max=3827, avg=1719.92, stdev=1864.77 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 3842], 80.00th=[ 3842], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min=15968, max=15968, per=100.00%, avg=15968.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.09%, ctx=44, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3185KiB/s (3262kB/s), 796KiB/s-2463KiB/s (815kB/s-2522kB/s), io=16.0MiB (16.8MB), run=4990-5144msec WRITE: bw=6174KiB/s (6323kB/s), 1593KiB/s-2379KiB/s (1631kB/s-2436kB/s), io=32.0MiB (33.6MB), run=5144-5307msec