== sanity test 398b: DIO and buffer IO race ============== 05:32:53 (1788255173) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.00743 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144402: Tue Sep 1 05:35:01 2026 read: IOPS=13, BW=55.7KiB/s (57.0kB/s)(5992KiB/107602msec) clat (usec): min=31, max=1092.4k, avg=35736.03, stdev=39134.31 lat (usec): min=31, max=1092.4k, avg=35737.89, stdev=39134.00 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 54], 10.00th=[ 652], | 20.00th=[ 16057], 30.00th=[ 20317], 40.00th=[ 24511], | 50.00th=[ 29230], 60.00th=[ 35390], 70.00th=[ 43254], | 80.00th=[ 53216], 90.00th=[ 67634], 95.00th=[ 79168], | 99.00th=[ 128451], 99.50th=[ 170918], 99.90th=[ 367002], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 127, per=25.30%, avg=55.65, stdev=22.71, samples=211 iops : min= 1, max= 31, avg=13.26, stdev= 5.72, samples=211 write: IOPS=14, BW=58.5KiB/s (59.9kB/s)(6296KiB/107602msec); 0 zone resets clat (usec): min=930, max=361190, avg=34090.35, stdev=36965.13 lat (usec): min=931, max=361192, avg=34091.76, stdev=36965.04 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1139], 10.00th=[ 1401], 20.00th=[ 3097], | 30.00th=[ 6915], 40.00th=[ 14877], 50.00th=[ 24511], 60.00th=[ 32375], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[168821], 99.50th=[202376], 99.90th=[299893], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 15, max= 149, per=25.54%, avg=58.75, stdev=24.49, samples=210 iops : min= 3, max= 37, avg=14.03, stdev= 6.15, samples=210 lat (usec) : 50=1.17%, 100=3.35%, 250=0.16%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.33% lat (msec) : 2=7.39%, 4=4.04%, 10=6.90%, 20=13.41%, 50=38.35% lat (msec) : 100=21.19%, 250=3.29%, 500=0.16%, 2000=0.03% cpu : usr=0.08%, sys=5.26%, ctx=6373, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144403: Tue Sep 1 05:35:01 2026 read: IOPS=13, BW=54.6KiB/s (55.9kB/s)(5940KiB/108862msec) clat (usec): min=24, max=1035.6k, avg=35681.68, stdev=37145.72 lat (usec): min=25, max=1035.6k, avg=35682.82, stdev=37145.82 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 54], 10.00th=[ 91], | 20.00th=[ 15533], 30.00th=[ 20317], 40.00th=[ 24511], | 50.00th=[ 29230], 60.00th=[ 35390], 70.00th=[ 43779], | 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 81265], | 99.00th=[ 130548], 99.50th=[ 149947], 99.90th=[ 191890], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 133, per=24.80%, avg=54.56, stdev=22.86, samples=212 iops : min= 1, max= 33, avg=12.98, stdev= 5.76, samples=212 write: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6348KiB/108862msec); 0 zone resets clat (usec): min=970, max=220574, avg=34902.36, stdev=35224.67 lat (usec): min=971, max=220575, avg=34904.09, stdev=35224.68 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1385], 20.00th=[ 3195], | 30.00th=[ 6980], 40.00th=[ 16581], 50.00th=[ 26608], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[156238], 99.50th=[183501], 99.90th=[212861], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 7, max= 174, per=25.17%, avg=57.88, stdev=24.88, samples=213 iops : min= 1, max= 43, avg=13.82, stdev= 6.24, samples=213 lat (usec) : 50=1.14%, 100=3.81%, 250=0.42%, 500=0.16%, 750=0.13% lat (usec) : 1000=0.23% lat (msec) : 2=7.23%, 4=4.52%, 10=6.48%, 20=12.27%, 50=38.02% lat (msec) : 100=21.74%, 250=3.81%, 2000=0.03% cpu : usr=0.08%, sys=5.30%, ctx=6380, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144404: Tue Sep 1 05:35:01 2026 read: IOPS=13, BW=55.7KiB/s (57.1kB/s)(6028KiB/108162msec) clat (usec): min=34, max=330631, avg=34095.37, stdev=26016.11 lat (usec): min=34, max=330632, avg=34098.15, stdev=26015.38 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 117], 20.00th=[ 15926], | 30.00th=[ 20317], 40.00th=[ 24249], 50.00th=[ 28967], 60.00th=[ 34866], | 70.00th=[ 42206], 80.00th=[ 51119], 90.00th=[ 65799], 95.00th=[ 78119], | 99.00th=[114820], 99.50th=[145753], 99.90th=[183501], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 126, per=25.18%, avg=55.39, stdev=23.14, samples=213 iops : min= 1, max= 31, avg=13.20, stdev= 5.82, samples=213 write: IOPS=14, BW=57.9KiB/s (59.3kB/s)(6260KiB/108162msec); 0 zone resets clat (usec): min=949, max=1069.5k, avg=36017.53, stdev=44582.33 lat (usec): min=949, max=1069.5k, avg=36019.03, stdev=44582.19 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1123], 10.00th=[ 1319], | 20.00th=[ 3326], 30.00th=[ 6849], 40.00th=[ 16909], | 50.00th=[ 26608], 60.00th=[ 35914], 70.00th=[ 46924], | 80.00th=[ 63177], 90.00th=[ 83362], 95.00th=[ 105382], | 99.00th=[ 154141], 99.50th=[ 187696], 99.90th=[ 320865], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 151, per=25.12%, avg=57.77, stdev=24.70, samples=212 iops : min= 1, max= 37, avg=13.80, stdev= 6.21, samples=212 lat (usec) : 50=1.04%, 100=3.84%, 250=0.26%, 500=0.10%, 1000=0.20% lat (msec) : 2=7.03%, 4=4.20%, 10=6.90%, 20=12.79%, 50=39.45% lat (msec) : 100=20.08%, 250=4.00%, 500=0.07%, 2000=0.03% cpu : usr=0.07%, sys=5.09%, ctx=6399, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144405: Tue Sep 1 05:35:01 2026 read: IOPS=14, BW=56.6KiB/s (57.9kB/s)(6052KiB/106970msec) clat (usec): min=33, max=396665, avg=33167.26, stdev=27307.01 lat (usec): min=33, max=396666, avg=33168.30, stdev=27307.09 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 54], 10.00th=[ 83], 20.00th=[ 15008], | 30.00th=[ 19530], 40.00th=[ 23462], 50.00th=[ 27919], 60.00th=[ 33817], | 70.00th=[ 40633], 80.00th=[ 49021], 90.00th=[ 64750], 95.00th=[ 79168], | 99.00th=[114820], 99.50th=[135267], 99.90th=[283116], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 15, max= 119, per=26.01%, avg=57.23, stdev=21.83, samples=207 iops : min= 3, max= 29, avg=13.66, stdev= 5.46, samples=207 write: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6236KiB/106970msec); 0 zone resets clat (usec): min=941, max=1158.1k, avg=36128.32, stdev=47194.96 lat (usec): min=941, max=1158.1k, avg=36129.90, stdev=47194.81 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1123], 10.00th=[ 1352], | 20.00th=[ 3326], 30.00th=[ 6915], 40.00th=[ 15270], | 50.00th=[ 26608], 60.00th=[ 36439], 70.00th=[ 46924], | 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[ 106431], | 99.00th=[ 156238], 99.50th=[ 221250], 99.90th=[ 404751], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 15, max= 134, per=25.34%, avg=58.27, stdev=23.12, samples=209 iops : min= 3, max= 33, avg=13.92, stdev= 5.83, samples=209 lat (usec) : 50=1.33%, 100=3.87%, 250=0.33%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.26% lat (msec) : 2=7.06%, 4=3.81%, 10=7.36%, 20=13.28%, 50=38.96% lat (msec) : 100=19.69%, 250=3.68%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=5.06%, ctx=6329, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=221KiB/s (226kB/s), 54.6KiB/s-56.6KiB/s (55.9kB/s-57.9kB/s), io=23.4MiB (24.6MB), run=106970-108862msec WRITE: bw=231KiB/s (236kB/s), 57.9KiB/s-58.5KiB/s (59.3kB/s-59.9kB/s), io=24.6MiB (25.7MB), run=106970-108862msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144398: Tue Sep 1 05:36:57 2026 read: IOPS=6, BW=26.8KiB/s (27.4kB/s)(5992KiB/223899msec) clat (msec): min=5, max=1105, avg=29.45, stdev=40.76 lat (msec): min=5, max=1105, avg=29.46, stdev=40.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 87], | 99.00th=[ 142], 99.50th=[ 215], 99.90th=[ 397], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 128, per=27.28%, avg=28.91, stdev=20.53, samples=402 iops : min= 1, max= 32, avg= 6.63, stdev= 5.17, samples=402 write: IOPS=7, BW=28.1KiB/s (28.8kB/s)(6296KiB/223899msec); 0 zone resets clat (msec): min=35, max=617, avg=113.92, stdev=54.20 lat (msec): min=35, max=617, avg=113.92, stdev=54.20 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 70], | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 100], 60.00th=[ 111], | 70.00th=[ 129], 80.00th=[ 153], 90.00th=[ 190], 95.00th=[ 220], | 99.00th=[ 284], 99.50th=[ 313], 99.90th=[ 414], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 56, per=25.18%, avg=27.95, stdev=12.22, samples=436 iops : min= 1, max= 14, avg= 6.39, stdev= 3.13, samples=436 lat (msec) : 10=7.13%, 20=19.73%, 50=15.92%, 100=30.63%, 250=25.20% lat (msec) : 500=1.33%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5229, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144399: Tue Sep 1 05:36:57 2026 read: IOPS=6, BW=26.4KiB/s (27.0kB/s)(5940KiB/224935msec) clat (msec): min=5, max=1044, avg=29.27, stdev=39.81 lat (msec): min=5, max=1044, avg=29.27, stdev=39.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 39], 90.00th=[ 63], 95.00th=[ 83], | 99.00th=[ 140], 99.50th=[ 224], 99.90th=[ 355], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 119, per=26.71%, avg=28.31, stdev=19.05, samples=407 iops : min= 1, max= 29, avg= 6.48, stdev= 4.83, samples=407 write: IOPS=7, BW=28.2KiB/s (28.9kB/s)(6348KiB/224935msec); 0 zone resets clat (msec): min=30, max=611, avg=114.06, stdev=54.33 lat (msec): min=30, max=611, avg=114.07, stdev=54.33 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 72], | 30.00th=[ 83], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 113], | 70.00th=[ 131], 80.00th=[ 150], 90.00th=[ 186], 95.00th=[ 220], | 99.00th=[ 288], 99.50th=[ 313], 99.90th=[ 481], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 64, per=25.03%, avg=27.78, stdev=12.24, samples=442 iops : min= 1, max= 16, avg= 6.35, stdev= 3.14, samples=442 lat (msec) : 10=6.64%, 20=19.63%, 50=16.80%, 100=29.69%, 250=26.14% lat (msec) : 500=1.04%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.14%, ctx=5230, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144400: Tue Sep 1 05:36:57 2026 read: IOPS=6, BW=26.8KiB/s (27.5kB/s)(6028KiB/224720msec) clat (msec): min=4, max=348, avg=29.82, stdev=30.02 lat (msec): min=4, max=348, avg=29.83, stdev=30.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 66], 95.00th=[ 85], | 99.00th=[ 142], 99.50th=[ 201], 99.90th=[ 279], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 111, per=26.60%, avg=28.20, stdev=18.84, samples=415 iops : min= 1, max= 27, avg= 6.46, stdev= 4.74, samples=415 write: IOPS=6, BW=27.9KiB/s (28.5kB/s)(6260KiB/224720msec); 0 zone resets clat (msec): min=37, max=1193, avg=114.58, stdev=59.60 lat (msec): min=37, max=1193, avg=114.59, stdev=59.60 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 90], 50.00th=[ 101], 60.00th=[ 112], | 70.00th=[ 129], 80.00th=[ 153], 90.00th=[ 186], 95.00th=[ 220], | 99.00th=[ 288], 99.50th=[ 326], 99.90th=[ 472], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 56, per=24.76%, avg=27.48, stdev=12.45, samples=441 iops : min= 1, max= 14, avg= 6.27, stdev= 3.20, samples=441 lat (msec) : 10=6.35%, 20=19.47%, 50=17.02%, 100=29.88%, 250=26.01% lat (msec) : 500=1.24%, 2000=0.03% cpu : usr=0.04%, sys=1.21%, ctx=5189, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144401: Tue Sep 1 05:36:57 2026 read: IOPS=6, BW=26.0KiB/s (27.6kB/s)(6052KiB/224382msec) clat (msec): min=4, max=355, avg=29.66, stdev=30.69 lat (msec): min=4, max=355, avg=29.66, stdev=30.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 63], 95.00th=[ 85], | 99.00th=[ 148], 99.50th=[ 201], 99.90th=[ 330], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 126, per=27.61%, avg=29.27, stdev=18.29, samples=401 iops : min= 1, max= 31, avg= 6.72, stdev= 4.65, samples=401 write: IOPS=6, BW=27.8KiB/s (28.5kB/s)(6236KiB/224382msec); 0 zone resets clat (msec): min=31, max=1145, avg=114.87, stdev=56.95 lat (msec): min=31, max=1146, avg=114.88, stdev=56.95 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 74], | 30.00th=[ 83], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 114], | 70.00th=[ 131], 80.00th=[ 153], 90.00th=[ 188], 95.00th=[ 218], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 368], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 56, per=24.70%, avg=27.42, stdev=11.56, samples=440 iops : min= 1, max= 14, avg= 6.25, stdev= 2.97, samples=440 lat (msec) : 10=5.50%, 20=20.67%, 50=17.19%, 100=28.61%, 250=26.82% lat (msec) : 500=1.17%, 2000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=107KiB/s (109kB/s), 26.4KiB/s-26.0KiB/s (27.0kB/s-27.6kB/s), io=23.4MiB (24.6MB), run=223899-224935msec WRITE: bw=112KiB/s (114kB/s), 27.8KiB/s-28.2KiB/s (28.5kB/s-28.9kB/s), io=24.6MiB (25.7MB), run=223899-224935msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144456: Tue Sep 1 05:37:27 2026 read: IOPS=18, BW=289KiB/s (296kB/s)(5920KiB/20505msec) clat (usec): min=35, max=194959, avg=26931.78, stdev=24352.90 lat (usec): min=36, max=194960, avg=26933.31, stdev=24353.10 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 109], | 30.00th=[ 14746], 40.00th=[ 20579], 50.00th=[ 24511], 60.00th=[ 30016], | 70.00th=[ 34341], 80.00th=[ 41681], 90.00th=[ 54789], 95.00th=[ 63701], | 99.00th=[113771], 99.50th=[149947], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 638, per=24.46%, avg=281.32, stdev=114.34, samples=40 iops : min= 3, max= 39, avg=16.82, stdev= 7.15, samples=40 write: IOPS=19, BW=311KiB/s (318kB/s)(6368KiB/20505msec); 0 zone resets clat (usec): min=1446, max=163113, avg=25768.96, stdev=27678.27 lat (usec): min=1448, max=163113, avg=25770.91, stdev=27678.18 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1975], 10.00th=[ 2835], 20.00th=[ 4424], | 30.00th=[ 6194], 40.00th=[ 9765], 50.00th=[ 15795], 60.00th=[ 22938], | 70.00th=[ 34341], 80.00th=[ 44303], 90.00th=[ 62129], 95.00th=[ 69731], | 99.00th=[149947], 99.50th=[160433], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 56, max= 565, per=25.36%, avg=306.90, stdev=111.30, samples=40 iops : min= 3, max= 35, avg=18.45, stdev= 6.96, samples=40 lat (usec) : 50=2.08%, 100=6.90%, 250=1.95%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.60%, 4=5.86%, 10=13.15%, 20=14.06%, 50=38.41% lat (msec) : 100=12.24%, 250=1.95% cpu : usr=0.08%, sys=6.95%, ctx=1516, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144457: Tue Sep 1 05:37:27 2026 read: IOPS=17, BW=286KiB/s (293kB/s)(5744KiB/20061msec) clat (usec): min=30, max=168290, avg=27189.39, stdev=21020.57 lat (usec): min=30, max=168292, avg=27190.61, stdev=21020.82 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 1745], | 30.00th=[ 17957], 40.00th=[ 21627], 50.00th=[ 25560], 60.00th=[ 29754], | 70.00th=[ 33817], 80.00th=[ 41681], 90.00th=[ 53740], 95.00th=[ 61080], | 99.00th=[ 88605], 99.50th=[102237], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 55, max= 478, per=24.96%, avg=287.08, stdev=97.77, samples=39 iops : min= 3, max= 29, avg=17.21, stdev= 6.07, samples=39 write: IOPS=20, BW=326KiB/s (334kB/s)(6544KiB/20061msec); 0 zone resets clat (usec): min=1319, max=151665, avg=24784.22, stdev=25228.07 lat (usec): min=1321, max=151667, avg=24786.01, stdev=25228.09 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1663], 10.00th=[ 2343], 20.00th=[ 3916], | 30.00th=[ 5604], 40.00th=[ 10028], 50.00th=[ 16057], 60.00th=[ 23725], | 70.00th=[ 32113], 80.00th=[ 43779], 90.00th=[ 60556], 95.00th=[ 72877], | 99.00th=[ 99091], 99.50th=[128451], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 159, max= 572, per=26.97%, avg=326.31, stdev=104.90, samples=39 iops : min= 9, max= 35, avg=19.67, stdev= 6.61, samples=39 lat (usec) : 50=1.30%, 100=6.51%, 250=0.65%, 500=0.52%, 750=0.13% lat (msec) : 2=4.30%, 4=6.90%, 10=10.55%, 20=15.89%, 50=38.80% lat (msec) : 100=13.54%, 250=0.91% cpu : usr=0.12%, sys=7.62%, ctx=1536, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144458: Tue Sep 1 05:37:27 2026 read: IOPS=18, BW=300KiB/s (308kB/s)(6256KiB/20819msec) clat (usec): min=37, max=194808, avg=27259.65, stdev=22108.94 lat (usec): min=37, max=194809, avg=27261.10, stdev=22108.43 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 121], | 30.00th=[ 16909], 40.00th=[ 22152], 50.00th=[ 25560], 60.00th=[ 30540], | 70.00th=[ 36439], 80.00th=[ 44303], 90.00th=[ 53740], 95.00th=[ 62129], | 99.00th=[ 88605], 99.50th=[ 95945], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 32, max= 573, per=26.93%, avg=309.67, stdev=110.95, samples=40 iops : min= 2, max= 35, avg=18.60, stdev= 6.89, samples=40 write: IOPS=18, BW=290KiB/s (297kB/s)(6032KiB/20819msec); 0 zone resets clat (usec): min=1323, max=171089, avg=26015.80, stdev=29409.44 lat (usec): min=1325, max=171090, avg=26017.54, stdev=29409.38 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1729], 10.00th=[ 2376], 20.00th=[ 3982], | 30.00th=[ 5800], 40.00th=[ 8717], 50.00th=[ 17171], 60.00th=[ 23725], | 70.00th=[ 31065], 80.00th=[ 42730], 90.00th=[ 62129], 95.00th=[ 85459], | 99.00th=[147850], 99.50th=[164627], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 84, max= 570, per=23.64%, avg=286.10, stdev=115.67, samples=41 iops : min= 5, max= 35, avg=17.15, stdev= 7.24, samples=41 lat (usec) : 50=1.04%, 100=8.98%, 250=1.30%, 500=0.39% lat (msec) : 2=3.52%, 4=6.51%, 10=10.94%, 20=12.63%, 50=40.23% lat (msec) : 100=12.76%, 250=1.69% cpu : usr=0.09%, sys=7.20%, ctx=1519, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144459: Tue Sep 1 05:37:27 2026 read: IOPS=19, BW=305KiB/s (312kB/s)(6032KiB/19775msec) clat (usec): min=41, max=170694, avg=27126.02, stdev=21652.73 lat (usec): min=41, max=170695, avg=27128.20, stdev=21653.51 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 1434], | 30.00th=[ 16057], 40.00th=[ 20579], 50.00th=[ 26084], 60.00th=[ 31065], | 70.00th=[ 35914], 80.00th=[ 41681], 90.00th=[ 54264], 95.00th=[ 61604], | 99.00th=[ 93848], 99.50th=[106431], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 63, max= 534, per=27.10%, avg=311.61, stdev=97.66, samples=38 iops : min= 3, max= 33, avg=18.74, stdev= 6.20, samples=38 write: IOPS=19, BW=316KiB/s (324kB/s)(6256KiB/19775msec); 0 zone resets clat (usec): min=1279, max=133844, avg=23469.42, stdev=24705.49 lat (usec): min=1281, max=133846, avg=23471.18, stdev=24705.48 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1795], 10.00th=[ 2114], 20.00th=[ 3851], | 30.00th=[ 5997], 40.00th=[ 7898], 50.00th=[ 13435], 60.00th=[ 22414], | 70.00th=[ 30016], 80.00th=[ 40109], 90.00th=[ 58459], 95.00th=[ 73925], | 99.00th=[105382], 99.50th=[127402], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 84, max= 479, per=26.29%, avg=318.08, stdev=94.22, samples=39 iops : min= 5, max= 29, avg=19.15, stdev= 5.91, samples=39 lat (usec) : 50=1.04%, 100=6.38%, 250=1.69%, 500=0.26%, 750=0.26% lat (msec) : 2=4.56%, 4=7.16%, 10=11.98%, 20=14.84%, 50=38.41% lat (msec) : 100=12.11%, 250=1.30% cpu : usr=0.10%, sys=7.58%, ctx=1501, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1150KiB/s (1178kB/s), 286KiB/s-305KiB/s (293kB/s-312kB/s), io=23.4MiB (24.5MB), run=19775-20819msec WRITE: bw=1210KiB/s (1239kB/s), 290KiB/s-326KiB/s (297kB/s-334kB/s), io=24.6MiB (25.8MB), run=19775-20819msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144451: Tue Sep 1 05:38:03 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(5920KiB/56430msec) clat (msec): min=6, max=170, avg=32.28, stdev=25.00 lat (msec): min=6, max=170, avg=32.28, stdev=25.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 82], | 99.00th=[ 155], 99.50th=[ 161], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 31, max= 413, per=26.55%, avg=110.72, stdev=67.22, samples=106 iops : min= 1, max= 25, avg= 6.26, stdev= 4.28, samples=106 write: IOPS=7, BW=113KiB/s (116kB/s)(6368KiB/56430msec); 0 zone resets clat (msec): min=35, max=376, avg=111.59, stdev=43.35 lat (msec): min=35, max=376, avg=111.59, stdev=43.35 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 104], 60.00th=[ 114], | 70.00th=[ 125], 80.00th=[ 136], 90.00th=[ 163], 95.00th=[ 205], | 99.00th=[ 257], 99.50th=[ 279], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 192, per=25.60%, avg=112.40, stdev=40.86, samples=112 iops : min= 1, max= 12, avg= 6.38, stdev= 2.64, samples=112 lat (msec) : 10=1.82%, 20=15.76%, 50=25.00%, 100=27.86%, 250=29.04% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.47%, ctx=1361, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144452: Tue Sep 1 05:38:03 2026 read: IOPS=6, BW=100KiB/s (103kB/s)(5744KiB/57364msec) clat (msec): min=5, max=317, avg=34.38, stdev=32.16 lat (msec): min=5, max=317, avg=34.38, stdev=32.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 66], 95.00th=[ 95], | 99.00th=[ 167], 99.50th=[ 186], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 21, max= 287, per=26.20%, avg=109.26, stdev=64.90, samples=103 iops : min= 1, max= 17, avg= 6.18, stdev= 4.07, samples=103 write: IOPS=7, BW=114KiB/s (117kB/s)(6544KiB/57364msec); 0 zone resets clat (msec): min=31, max=300, avg=109.40, stdev=44.22 lat (msec): min=31, max=300, avg=109.40, stdev=44.22 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 83], 40.00th=[ 91], 50.00th=[ 103], 60.00th=[ 112], | 70.00th=[ 125], 80.00th=[ 136], 90.00th=[ 169], 95.00th=[ 194], | 99.00th=[ 257], 99.50th=[ 292], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 254, per=25.77%, avg=113.13, stdev=44.08, samples=113 iops : min= 1, max= 15, avg= 6.43, stdev= 2.81, samples=113 lat (msec) : 10=2.34%, 20=15.76%, 50=22.53%, 100=30.21%, 250=28.39% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.47%, ctx=1452, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144453: Tue Sep 1 05:38:03 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54838msec) clat (msec): min=5, max=169, avg=30.17, stdev=24.32 lat (msec): min=5, max=169, avg=30.17, stdev=24.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 39], 90.00th=[ 53], 95.00th=[ 80], | 99.00th=[ 142], 99.50th=[ 167], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 31, max= 384, per=29.11%, avg=121.40, stdev=77.12, samples=102 iops : min= 1, max= 24, avg= 6.94, stdev= 4.90, samples=102 write: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54838msec); 0 zone resets clat (msec): min=40, max=378, avg=113.52, stdev=45.27 lat (msec): min=40, max=378, avg=113.52, stdev=45.27 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 96], 50.00th=[ 107], 60.00th=[ 114], | 70.00th=[ 126], 80.00th=[ 144], 90.00th=[ 171], 95.00th=[ 201], | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 192, per=25.03%, avg=109.86, stdev=39.23, samples=108 iops : min= 1, max= 12, avg= 6.22, stdev= 2.50, samples=108 lat (msec) : 10=2.86%, 20=16.80%, 50=26.69%, 100=24.22%, 250=28.52% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.60%, ctx=1414, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144454: Tue Sep 1 05:38:03 2026 read: IOPS=6, BW=108KiB/s (110kB/s)(6032KiB/55982msec) clat (msec): min=5, max=167, avg=31.49, stdev=22.45 lat (msec): min=5, max=167, avg=31.49, stdev=22.44 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 58], 95.00th=[ 79], | 99.00th=[ 122], 99.50th=[ 140], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 31, max= 320, per=27.83%, avg=116.05, stdev=69.59, samples=102 iops : min= 1, max= 20, avg= 6.63, stdev= 4.47, samples=102 write: IOPS=6, BW=112KiB/s (114kB/s)(6256KiB/55982msec); 0 zone resets clat (msec): min=36, max=446, avg=112.34, stdev=45.04 lat (msec): min=36, max=446, avg=112.35, stdev=45.04 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 114], | 70.00th=[ 128], 80.00th=[ 142], 90.00th=[ 171], 95.00th=[ 199], | 99.00th=[ 241], 99.50th=[ 247], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 223, per=25.72%, avg=112.90, stdev=37.57, samples=109 iops : min= 1, max= 13, avg= 6.41, stdev= 2.39, samples=109 lat (msec) : 10=1.95%, 20=15.63%, 50=25.65%, 100=28.13%, 250=28.52% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.55%, ctx=1418, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=418KiB/s (428kB/s), 100KiB/s-114KiB/s (103kB/s-117kB/s), io=23.4MiB (24.5MB), run=54838-57364msec WRITE: bw=439KiB/s (450kB/s), 110KiB/s-114KiB/s (113kB/s-117kB/s), io=24.6MiB (25.8MB), run=54838-57364msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144477: Tue Sep 1 05:38:18 2026 read: IOPS=1, BW=2035KiB/s (2084kB/s)(7168KiB/3522msec) clat (usec): min=453, max=320022, avg=204720.52, stdev=103086.55 lat (usec): min=454, max=320022, avg=204721.82, stdev=103086.46 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[166724], | 30.00th=[214959], 40.00th=[214959], 50.00th=[217056], 60.00th=[225444], | 70.00th=[225444], 80.00th=[287310], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 1861, max= 4047, per=45.96%, avg=2353.80, stdev=948.33, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1454KiB/s (1489kB/s)(5120KiB/3522msec); 0 zone resets clat (msec): min=241, max=483, avg=382.32, stdev=95.35 lat (msec): min=241, max=484, avg=382.99, stdev=95.80 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1917, max= 2043, per=27.56%, avg=1976.00, stdev=66.34, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=14.83%, ctx=222, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144479: Tue Sep 1 05:38:18 2026 read: IOPS=0, BW=512KiB/s (524kB/s)(2048KiB/3999msec) clat (msec): min=321, max=452, avg=387.30, stdev=92.86 lat (msec): min=321, max=452, avg=387.30, stdev=92.87 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1765, max= 2023, per=36.98%, avg=1894.00, stdev=182.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2561KiB/s (2622kB/s)(10.0MiB/3999msec); 0 zone resets clat (msec): min=95, max=675, avg=314.73, stdev=200.83 lat (msec): min=95, max=675, avg=314.80, stdev=200.84 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 136], | 30.00th=[ 157], 40.00th=[ 167], 50.00th=[ 232], 60.00th=[ 255], | 70.00th=[ 405], 80.00th=[ 460], 90.00th=[ 575], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1917, max= 4087, per=44.12%, avg=3163.00, stdev=1093.16, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=13.93%, ctx=129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144481: Tue Sep 1 05:38:18 2026 read: IOPS=1, BW=1725KiB/s (1766kB/s)(6144KiB/3562msec) clat (usec): min=439, max=349858, avg=137508.80, stdev=146294.35 lat (usec): min=440, max=349858, avg=137509.79, stdev=146294.18 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 38536], 50.00th=[ 38536], 60.00th=[187696], | 70.00th=[246416], 80.00th=[246416], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 2023, max= 4087, per=64.73%, avg=3315.00, stdev=1125.98, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1725KiB/s (1766kB/s)(6144KiB/3562msec); 0 zone resets clat (msec): min=175, max=1109, avg=413.36, stdev=351.23 lat (msec): min=175, max=1111, avg=413.89, stdev=351.61 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 338], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1875, max= 2043, per=27.57%, avg=1976.20, stdev=75.15, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=8.33%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=11.01%, ctx=174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144482: Tue Sep 1 05:38:18 2026 read: IOPS=1, BW=1362KiB/s (1394kB/s)(5120KiB/3760msec) clat (usec): min=382, max=160880, avg=33223.37, stdev=71370.78 lat (usec): min=384, max=160880, avg=33224.41, stdev=71370.40 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 383], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 1123], 60.00th=[ 1123], | 70.00th=[ 3130], 80.00th=[ 3130], 90.00th=[160433], 95.00th=[160433], | 99.00th=[160433], 99.50th=[160433], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 2023, max= 5919, per=77.54%, avg=3971.00, stdev=2754.89, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1906KiB/s (1952kB/s)(7168KiB/3760msec); 0 zone resets clat (msec): min=95, max=1328, avg=437.63, stdev=413.80 lat (msec): min=95, max=1328, avg=437.70, stdev=413.80 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 142], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 347], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 468], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 2023, max= 4047, per=42.05%, avg=3014.75, stdev=1134.41, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=16.67%, 500=33.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=12.13%, ctx=110, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5121KiB/s (5244kB/s), 512KiB/s-2035KiB/s (524kB/s-2084kB/s), io=20.0MiB (20.0MB), run=3522-3999msec WRITE: bw=7170KiB/s (7342kB/s), 1454KiB/s-2561KiB/s (1489kB/s-2622kB/s), io=28.0MiB (29.4MB), run=3522-3999msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144475: Tue Sep 1 05:38:18 2026 read: IOPS=2, BW=2259KiB/s (2313kB/s)(7168KiB/3173msec) clat (msec): min=102, max=316, avg=209.38, stdev=85.34 lat (msec): min=102, max=316, avg=209.38, stdev=85.34 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 105], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 201], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 300], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2039, max= 3690, per=61.37%, avg=2767.25, stdev=853.81, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1614KiB/s (1652kB/s)(5120KiB/3173msec); 0 zone resets clat (msec): min=222, max=486, avg=311.82, stdev=101.63 lat (msec): min=222, max=487, avg=311.88, stdev=101.62 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1845, max= 3835, per=40.78%, avg=2574.33, stdev=1096.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=50.00% cpu : usr=0.03%, sys=5.55%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144476: Tue Sep 1 05:38:18 2026 read: IOPS=0, BW=465KiB/s (476kB/s)(2048KiB/4402msec) clat (msec): min=123, max=319, avg=221.60, stdev=138.60 lat (msec): min=123, max=319, avg=221.60, stdev=138.60 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1976, max= 2039, per=44.52%, avg=2007.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2326KiB/s (2382kB/s)(10.0MiB/4402msec); 0 zone resets clat (msec): min=124, max=1329, avg=367.55, stdev=372.27 lat (msec): min=124, max=1329, avg=367.64, stdev=372.26 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 138], | 30.00th=[ 150], 40.00th=[ 163], 50.00th=[ 213], 60.00th=[ 266], | 70.00th=[ 275], 80.00th=[ 372], 90.00th=[ 651], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1917, max= 6107, per=63.62%, avg=4016.00, stdev=1711.44, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.11%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144478: Tue Sep 1 05:38:18 2026 read: IOPS=1, BW=1537KiB/s (1574kB/s)(6144KiB/3997msec) clat (msec): min=115, max=600, avg=313.45, stdev=216.80 lat (msec): min=115, max=600, avg=313.45, stdev=216.80 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 249], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1976, max= 3690, per=53.96%, avg=2433.00, stdev=838.47, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1537KiB/s (1574kB/s)(6144KiB/3997msec); 0 zone resets clat (msec): min=201, max=496, avg=342.46, stdev=107.94 lat (msec): min=201, max=496, avg=342.53, stdev=107.94 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 342], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1622, max= 2039, per=29.78%, avg=1879.80, stdev=160.98, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=3.83%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144480: Tue Sep 1 05:38:18 2026 read: IOPS=1, BW=1127KiB/s (1154kB/s)(5120KiB/4542msec) clat (msec): min=84, max=656, avg=246.89, stdev=232.20 lat (msec): min=84, max=656, avg=246.89, stdev=232.20 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2043, max= 5930, per=88.41%, avg=3986.50, stdev=2748.52, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1578KiB/s (1616kB/s)(7168KiB/4542msec); 0 zone resets clat (msec): min=169, max=618, avg=415.94, stdev=186.61 lat (msec): min=169, max=618, avg=416.01, stdev=186.61 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 178], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 418], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1845, max= 2043, per=31.30%, avg=1975.80, stdev=90.25, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=33.33% cpu : usr=0.00%, sys=4.67%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4509KiB/s (4617kB/s), 465KiB/s-2259KiB/s (476kB/s-2313kB/s), io=20.0MiB (20.0MB), run=3173-4542msec WRITE: bw=6313KiB/s (6464kB/s), 1537KiB/s-2326KiB/s (1574kB/s-2382kB/s), io=28.0MiB (29.4MB), run=3173-4542msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144491: Tue Sep 1 05:38:33 2026 read: IOPS=0, BW=3457KiB/s (3539kB/s)(12.0MiB/3555msec) clat (msec): min=367, max=2732, avg=1156.61, stdev=1364.33 lat (msec): min=367, max=2732, avg=1156.61, stdev=1364.33 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 6617, max= 8143, per=100.00%, avg=7380.00, stdev=1079.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.32%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144492: Tue Sep 1 05:38:33 2026 read: IOPS=0, BW=706KiB/s (723kB/s)(4096KiB/5801msec) clat (nsec): min=1349.7M, max=1349.7M, avg=1349723833.00, stdev= 0.00 lat (nsec): min=1349.7M, max=1349.7M, avg=1349726255.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1351], 5.00th=[ 1351], 10.00th=[ 1351], 20.00th=[ 1351], | 30.00th=[ 1351], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1412KiB/s (1446kB/s)(8192KiB/5801msec); 0 zone resets clat (msec): min=1027, max=3333, avg=2180.17, stdev=1630.80 lat (msec): min=1027, max=3333, avg=2180.48, stdev=1630.79 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 3339], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.78%, ctx=42, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144493: Tue Sep 1 05:38:33 2026 write: IOPS=0, BW=2407KiB/s (2465kB/s)(12.0MiB/5105msec); 0 zone resets clat (msec): min=424, max=3788, avg=1662.49, stdev=1849.66 lat (msec): min=424, max=3792, avg=1663.87, stdev=1851.49 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=3.43%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144494: Tue Sep 1 05:38:33 2026 write: IOPS=0, BW=2404KiB/s (2462kB/s)(12.0MiB/5111msec); 0 zone resets clat (msec): min=426, max=3902, avg=1655.01, stdev=1948.98 lat (msec): min=428, max=3902, avg=1656.61, stdev=1947.94 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 3910], 80.00th=[ 3910], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.15%, ctx=59, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2824KiB/s (2892kB/s), 706KiB/s-3457KiB/s (723kB/s-3539kB/s), io=16.0MiB (16.8MB), run=3555-5801msec WRITE: bw=5649KiB/s (5784kB/s), 1412KiB/s-2407KiB/s (1446kB/s-2465kB/s), io=32.0MiB (33.6MB), run=5105-5801msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144496: Tue Sep 1 05:38:33 2026 read: IOPS=0, BW=2684KiB/s (2748kB/s)(12.0MiB/4579msec) clat (msec): min=614, max=2798, avg=1411.00, stdev=1206.17 lat (msec): min=614, max=2798, avg=1411.00, stdev=1206.17 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 8015, max= 8175, per=100.00%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=7.93%, ctx=893, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144497: Tue Sep 1 05:38:33 2026 read: IOPS=0, BW=840KiB/s (860kB/s)(4096KiB/4877msec) clat (nsec): min=886773k, max=886773k, avg=886773280.00, stdev= 0.00 lat (nsec): min=886776k, max=886776k, avg=886775990.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1680KiB/s (1720kB/s)(8192KiB/4877msec); 0 zone resets clat (msec): min=1182, max=2707, avg=1944.81, stdev=1078.30 lat (msec): min=1183, max=2707, avg=1945.67, stdev=1077.43 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 2702], | 70.00th=[ 2702], 80.00th=[ 2702], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.92%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144498: Tue Sep 1 05:38:33 2026 write: IOPS=0, BW=2254KiB/s (2308kB/s)(12.0MiB/5452msec); 0 zone resets clat (msec): min=324, max=4093, avg=1739.18, stdev=2052.92 lat (msec): min=324, max=4094, avg=1739.54, stdev=2052.90 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 4111], 80.00th=[ 4111], 90.00th=[ 4111], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=1.94%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144499: Tue Sep 1 05:38:33 2026 write: IOPS=0, BW=2403KiB/s (2461kB/s)(12.0MiB/5113msec); 0 zone resets clat (msec): min=681, max=2773, avg=1645.03, stdev=1055.84 lat (msec): min=682, max=2774, avg=1645.49, stdev=1055.92 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 8015, max= 8175, per=100.00%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.56%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3359KiB/s (3440kB/s), 840KiB/s-2684KiB/s (860kB/s-2748kB/s), io=16.0MiB (16.8MB), run=4579-4877msec WRITE: bw=6010KiB/s (6155kB/s), 1680KiB/s-2403KiB/s (1720kB/s-2461kB/s), io=32.0MiB (33.6MB), run=4877-5452msec