== sanity test 398b: DIO and buffer IO race ============== 16:54:56 (1783976096) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.82968 s, 7.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179023: Mon Jul 13 16:56:58 2026 read: IOPS=14, BW=58.0KiB/s (60.4kB/s)(5992KiB/101599msec) clat (usec): min=36, max=795792, avg=37459.13, stdev=31097.86 lat (usec): min=37, max=795794, avg=37462.31, stdev=31097.75 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 8979], 10.00th=[ 13566], 20.00th=[ 18482], | 30.00th=[ 22414], 40.00th=[ 26870], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 44303], 80.00th=[ 53740], 90.00th=[ 66847], 95.00th=[ 81265], | 99.00th=[110625], 99.50th=[141558], 99.90th=[196084], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 8, max= 152, per=25.51%, avg=58.93, stdev=21.10, samples=200 iops : min= 2, max= 38, avg=14.09, stdev= 5.31, samples=200 write: IOPS=15, BW=61.0KiB/s (63.5kB/s)(6296KiB/101599msec); 0 zone resets clat (usec): min=848, max=181929, avg=28590.50, stdev=28729.67 lat (usec): min=849, max=181930, avg=28592.48, stdev=28729.49 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1369], 10.00th=[ 1614], 20.00th=[ 3654], | 30.00th=[ 6783], 40.00th=[ 13829], 50.00th=[ 21103], 60.00th=[ 27657], | 70.00th=[ 36439], 80.00th=[ 49021], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[122160], 99.50th=[133694], 99.90th=[179307], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 7, max= 160, per=25.70%, avg=62.19, stdev=26.41, samples=199 iops : min= 1, max= 40, avg=14.91, stdev= 6.64, samples=199 lat (usec) : 50=0.42%, 100=1.50%, 250=0.16%, 500=0.07%, 1000=0.20% lat (msec) : 2=6.18%, 4=4.62%, 10=7.52%, 20=15.59%, 50=42.45% lat (msec) : 100=19.01%, 250=2.25%, 1000=0.03% cpu : usr=0.09%, sys=6.39%, ctx=6677, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179024: Mon Jul 13 16:56:58 2026 read: IOPS=14, BW=58.2KiB/s (59.6kB/s)(5940KiB/101980msec) clat (usec): min=41, max=876383, avg=37164.29, stdev=31946.87 lat (usec): min=42, max=876385, avg=37170.70, stdev=31946.58 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 8586], 10.00th=[ 13960], 20.00th=[ 18482], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 51643], 90.00th=[ 65274], 95.00th=[ 81265], | 99.00th=[117965], 99.50th=[135267], 99.90th=[229639], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 118, per=25.07%, avg=57.91, stdev=21.89, samples=200 iops : min= 1, max= 29, avg=13.83, stdev= 5.49, samples=200 write: IOPS=15, BW=62.2KiB/s (63.7kB/s)(6348KiB/101980msec); 0 zone resets clat (usec): min=953, max=217597, avg=29194.06, stdev=30553.74 lat (usec): min=954, max=217599, avg=29198.03, stdev=30553.46 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1647], 20.00th=[ 3425], | 30.00th=[ 6194], 40.00th=[ 12649], 50.00th=[ 20579], 60.00th=[ 27657], | 70.00th=[ 37487], 80.00th=[ 50070], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[135267], 99.50th=[149947], 99.90th=[181404], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 15, max= 144, per=25.62%, avg=62.01, stdev=25.03, samples=199 iops : min= 3, max= 36, avg=14.86, stdev= 6.31, samples=199 lat (usec) : 50=0.23%, 100=1.66%, 250=0.33%, 1000=0.10% lat (msec) : 2=6.25%, 4=5.40%, 10=7.78%, 20=15.30%, 50=41.86% lat (msec) : 100=18.46%, 250=2.60%, 1000=0.03% cpu : usr=0.09%, sys=6.33%, ctx=6610, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179025: Mon Jul 13 16:56:58 2026 read: IOPS=14, BW=59.8KiB/s (61.3kB/s)(6028KiB/100738msec) clat (usec): min=33, max=239852, avg=35923.34, stdev=23756.40 lat (usec): min=33, max=239854, avg=35924.77, stdev=23756.42 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 108], 10.00th=[ 13960], 20.00th=[ 18220], | 30.00th=[ 22676], 40.00th=[ 26870], 50.00th=[ 31851], 60.00th=[ 36439], | 70.00th=[ 42730], 80.00th=[ 50070], 90.00th=[ 63177], 95.00th=[ 76022], | 99.00th=[120062], 99.50th=[139461], 99.90th=[191890], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 135, per=26.10%, avg=60.30, stdev=23.76, samples=196 iops : min= 1, max= 33, avg=14.43, stdev= 5.96, samples=196 write: IOPS=15, BW=62.1KiB/s (63.6kB/s)(6260KiB/100738msec); 0 zone resets clat (usec): min=848, max=829032, avg=29459.62, stdev=35892.31 lat (usec): min=849, max=829035, avg=29467.15, stdev=35888.61 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1549], 20.00th=[ 3163], | 30.00th=[ 6259], 40.00th=[ 13829], 50.00th=[ 21103], 60.00th=[ 28443], | 70.00th=[ 37487], 80.00th=[ 51119], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[130548], 99.50th=[149947], 99.90th=[238027], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 15, max= 143, per=25.76%, avg=62.33, stdev=24.41, samples=197 iops : min= 3, max= 35, avg=14.94, stdev= 6.14, samples=197 lat (usec) : 50=0.52%, 100=1.92%, 250=0.23%, 1000=0.07% lat (msec) : 2=7.06%, 4=4.79%, 10=7.19%, 20=14.23%, 50=43.55% lat (msec) : 100=17.97%, 250=2.44%, 1000=0.03% cpu : usr=0.10%, sys=6.36%, ctx=6469, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179026: Mon Jul 13 16:56:58 2026 read: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6052KiB/103883msec) clat (usec): min=33, max=229317, avg=37406.02, stdev=23978.24 lat (usec): min=33, max=229319, avg=37407.42, stdev=23978.23 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8455], 10.00th=[ 14615], 20.00th=[ 19530], | 30.00th=[ 23725], 40.00th=[ 28181], 50.00th=[ 33162], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 51643], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[111674], 99.50th=[143655], 99.90th=[193987], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 135, per=25.29%, avg=58.41, stdev=20.65, samples=203 iops : min= 1, max= 33, avg=13.96, stdev= 5.18, samples=203 write: IOPS=15, BW=60.0KiB/s (61.5kB/s)(6236KiB/103883msec); 0 zone resets clat (usec): min=888, max=863044, avg=30017.83, stdev=36130.83 lat (usec): min=888, max=863046, avg=30022.37, stdev=36129.81 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1352], 10.00th=[ 1663], 20.00th=[ 3621], | 30.00th=[ 6783], 40.00th=[ 14877], 50.00th=[ 21890], 60.00th=[ 28967], | 70.00th=[ 39060], 80.00th=[ 51119], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[124257], 99.50th=[152044], 99.90th=[202376], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 135, per=24.72%, avg=59.83, stdev=25.74, samples=204 iops : min= 1, max= 33, avg=14.32, stdev= 6.46, samples=204 lat (usec) : 50=0.29%, 100=1.69%, 250=0.20%, 500=0.10%, 1000=0.07% lat (msec) : 2=6.48%, 4=4.39%, 10=7.55%, 20=13.22%, 50=44.76% lat (msec) : 100=18.49%, 250=2.73%, 1000=0.03% cpu : usr=0.09%, sys=6.38%, ctx=6706, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=231KiB/s (237kB/s), 58.2KiB/s-59.8KiB/s (59.6kB/s-61.3kB/s), io=23.4MiB (24.6MB), run=100738-103883msec WRITE: bw=242KiB/s (248kB/s), 60.0KiB/s-62.2KiB/s (61.5kB/s-63.7kB/s), io=24.6MiB (25.7MB), run=100738-103883msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179028: Mon Jul 13 16:57:37 2026 read: IOPS=10, BW=42.3KiB/s (43.3kB/s)(5992KiB/141723msec) clat (msec): min=6, max=811, avg=36.51, stdev=35.94 lat (msec): min=6, max=811, avg=36.52, stdev=35.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 74], 95.00th=[ 100], | 99.00th=[ 144], 99.50th=[ 184], 99.90th=[ 271], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 151, per=25.27%, avg=42.45, stdev=24.62, samples=275 iops : min= 1, max= 37, avg= 9.97, stdev= 6.20, samples=275 write: IOPS=11, BW=44.4KiB/s (45.5kB/s)(6296KiB/141723msec); 0 zone resets clat (msec): min=10, max=516, avg=55.09, stdev=36.95 lat (msec): min=10, max=516, avg=55.10, stdev=36.96 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 63], 80.00th=[ 77], 90.00th=[ 101], 95.00th=[ 127], | 99.00th=[ 182], 99.50th=[ 205], 99.90th=[ 279], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 143, per=25.07%, avg=44.12, stdev=23.40, samples=278 iops : min= 1, max= 35, avg=10.40, stdev= 5.88, samples=278 lat (msec) : 10=2.18%, 20=17.48%, 50=47.95%, 100=24.80%, 250=7.42% lat (msec) : 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=2.47%, ctx=5021, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179029: Mon Jul 13 16:57:37 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(5940KiB/142306msec) clat (msec): min=4, max=886, avg=37.00, stdev=37.56 lat (msec): min=4, max=886, avg=37.00, stdev=37.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 75], 95.00th=[ 100], | 99.00th=[ 161], 99.50th=[ 171], 99.90th=[ 257], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 151, per=24.94%, avg=41.91, stdev=26.27, samples=275 iops : min= 1, max= 37, avg= 9.84, stdev= 6.58, samples=275 write: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6348KiB/142306msec); 0 zone resets clat (msec): min=8, max=306, avg=54.85, stdev=37.01 lat (msec): min=8, max=306, avg=54.85, stdev=37.01 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 103], 95.00th=[ 126], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 279], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 143, per=25.03%, avg=44.06, stdev=24.37, samples=279 iops : min= 1, max= 35, avg=10.38, stdev= 6.13, samples=279 lat (msec) : 10=2.67%, 20=17.71%, 50=47.10%, 100=24.58%, 250=7.75% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=2.48%, ctx=4951, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179030: Mon Jul 13 16:57:37 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(6028KiB/141821msec) clat (msec): min=5, max=297, avg=36.33, stdev=30.08 lat (msec): min=5, max=297, avg=36.33, stdev=30.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 77], 95.00th=[ 94], | 99.00th=[ 146], 99.50th=[ 178], 99.90th=[ 275], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 127, per=25.58%, avg=42.97, stdev=23.86, samples=273 iops : min= 1, max= 31, avg=10.11, stdev= 6.01, samples=273 write: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6260KiB/141821msec); 0 zone resets clat (msec): min=9, max=879, avg=55.41, stdev=42.58 lat (msec): min=9, max=879, avg=55.41, stdev=42.57 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 78], 90.00th=[ 102], 95.00th=[ 121], | 99.00th=[ 180], 99.50th=[ 226], 99.90th=[ 542], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 151, per=24.83%, avg=43.71, stdev=23.89, samples=278 iops : min= 1, max= 37, avg=10.29, stdev= 6.00, samples=278 lat (msec) : 10=2.44%, 20=16.99%, 50=48.83%, 100=24.58%, 250=6.90% lat (msec) : 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=2.48%, ctx=4988, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179031: Mon Jul 13 16:57:37 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6052KiB/141993msec) clat (msec): min=4, max=280, avg=36.74, stdev=30.77 lat (msec): min=4, max=280, avg=36.75, stdev=30.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 79], 95.00th=[ 99], | 99.00th=[ 150], 99.50th=[ 171], 99.90th=[ 247], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 158, per=25.86%, avg=43.44, stdev=26.28, samples=272 iops : min= 1, max= 39, avg=10.22, stdev= 6.61, samples=272 write: IOPS=10, BW=43.9KiB/s (44.0kB/s)(6236KiB/141993msec); 0 zone resets clat (msec): min=9, max=888, avg=55.22, stdev=43.02 lat (msec): min=9, max=888, avg=55.22, stdev=43.02 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 80], 90.00th=[ 104], 95.00th=[ 133], | 99.00th=[ 178], 99.50th=[ 226], 99.90th=[ 447], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 143, per=24.95%, avg=43.91, stdev=23.98, samples=277 iops : min= 1, max= 35, avg=10.34, stdev= 6.02, samples=277 lat (msec) : 10=3.22%, 20=18.03%, 50=46.39%, 100=24.64%, 250=7.55% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=2.49%, ctx=4998, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=169KiB/s (173kB/s), 41.7KiB/s-42.6KiB/s (42.7kB/s-43.6kB/s), io=23.4MiB (24.6MB), run=141723-142306msec WRITE: bw=177KiB/s (181kB/s), 43.9KiB/s-44.6KiB/s (44.0kB/s-45.7kB/s), io=24.6MiB (25.7MB), run=141723-142306msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179073: Mon Jul 13 16:58:25 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5920KiB/35410msec) clat (usec): min=33, max=321326, avg=52012.65, stdev=35659.01 lat (usec): min=34, max=321327, avg=52018.32, stdev=35660.34 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 82], 10.00th=[ 18744], 20.00th=[ 27657], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 46400], 60.00th=[ 54264], | 70.00th=[ 61604], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[107480], | 99.00th=[173016], 99.50th=[291505], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 62, max= 347, per=25.38%, avg=167.00, stdev=62.52, samples=69 iops : min= 3, max= 21, avg= 9.67, stdev= 3.97, samples=69 write: IOPS=11, BW=180KiB/s (184kB/s)(6368KiB/35410msec); 0 zone resets clat (usec): min=1556, max=235373, avg=39993.22, stdev=37876.53 lat (usec): min=1557, max=235375, avg=40001.59, stdev=37873.88 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1975], 10.00th=[ 4080], 20.00th=[ 8094], | 30.00th=[ 13042], 40.00th=[ 20317], 50.00th=[ 29492], 60.00th=[ 38011], | 70.00th=[ 52167], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[120062], | 99.00th=[164627], 99.50th=[198181], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 29, max= 352, per=26.06%, avg=180.36, stdev=69.83, samples=69 iops : min= 1, max= 22, avg=10.51, stdev= 4.41, samples=69 lat (usec) : 50=0.26%, 100=2.34%, 250=0.26%, 750=0.26% lat (msec) : 2=2.60%, 4=2.47%, 10=7.81%, 20=9.51%, 50=35.81% lat (msec) : 100=30.60%, 250=7.81%, 500=0.26% cpu : usr=0.07%, sys=5.73%, ctx=1797, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179075: Mon Jul 13 16:58:25 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(5744KiB/36385msec) clat (usec): min=45, max=222119, avg=50999.64, stdev=31438.66 lat (usec): min=52, max=222121, avg=51013.13, stdev=31447.86 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 18482], 20.00th=[ 27132], | 30.00th=[ 34341], 40.00th=[ 40633], 50.00th=[ 45876], 60.00th=[ 54264], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 92799], 95.00th=[106431], | 99.00th=[166724], 99.50th=[179307], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 30, max= 347, per=24.22%, avg=159.36, stdev=66.26, samples=70 iops : min= 1, max= 21, avg= 9.16, stdev= 4.19, samples=70 write: IOPS=11, BW=180KiB/s (184kB/s)(6544KiB/36385msec); 0 zone resets clat (usec): min=1366, max=292459, avg=43175.90, stdev=43416.45 lat (usec): min=1368, max=292462, avg=43182.65, stdev=43415.04 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2376], 10.00th=[ 3916], 20.00th=[ 7898], | 30.00th=[ 13829], 40.00th=[ 20317], 50.00th=[ 29754], 60.00th=[ 38536], | 70.00th=[ 52691], 80.00th=[ 76022], 90.00th=[108528], 95.00th=[131597], | 99.00th=[168821], 99.50th=[185598], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 62, max= 509, per=26.36%, avg=182.43, stdev=74.71, samples=70 iops : min= 3, max= 31, avg=10.63, stdev= 4.65, samples=70 lat (usec) : 50=0.13%, 100=2.60%, 250=0.13%, 1000=0.13% lat (msec) : 2=1.95%, 4=3.78%, 10=7.03%, 20=10.55%, 50=35.68% lat (msec) : 100=29.04%, 250=8.85%, 500=0.13% cpu : usr=0.08%, sys=5.28%, ctx=1711, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179076: Mon Jul 13 16:58:25 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35772msec) clat (usec): min=38, max=201680, avg=50414.39, stdev=33223.93 lat (usec): min=38, max=201681, avg=50416.38, stdev=33223.49 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 18482], 20.00th=[ 26084], | 30.00th=[ 31589], 40.00th=[ 39060], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[115868], | 99.00th=[166724], 99.50th=[189793], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 60, max= 319, per=26.61%, avg=175.10, stdev=66.27, samples=70 iops : min= 3, max= 19, avg=10.16, stdev= 4.18, samples=70 write: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35772msec); 0 zone resets clat (usec): min=1832, max=207993, avg=42355.07, stdev=39112.09 lat (usec): min=1835, max=207996, avg=42357.36, stdev=39112.08 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2114], 10.00th=[ 3818], 20.00th=[ 7439], | 30.00th=[ 12911], 40.00th=[ 23725], 50.00th=[ 31589], 60.00th=[ 41157], | 70.00th=[ 57410], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[152044], 99.50th=[206570], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 62, max= 381, per=24.30%, avg=168.17, stdev=73.19, samples=70 iops : min= 3, max= 23, avg= 9.73, stdev= 4.65, samples=70 lat (usec) : 50=0.52%, 100=2.99%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.43%, 4=3.65%, 10=7.55%, 20=7.03%, 50=38.67% lat (msec) : 100=29.82%, 250=8.07% cpu : usr=0.05%, sys=5.40%, ctx=1733, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179077: Mon Jul 13 16:58:25 2026 read: IOPS=10, BW=174KiB/s (179kB/s)(6032KiB/34578msec) clat (usec): min=47, max=276907, avg=51057.98, stdev=34764.21 lat (usec): min=49, max=276907, avg=51059.46, stdev=34764.14 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 74], 10.00th=[ 15926], 20.00th=[ 24249], | 30.00th=[ 31065], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 54264], | 70.00th=[ 63701], 80.00th=[ 77071], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[160433], 99.50th=[208667], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 30, max= 345, per=26.94%, avg=177.24, stdev=68.89, samples=66 iops : min= 1, max= 21, avg=10.29, stdev= 4.38, samples=66 write: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34578msec); 0 zone resets clat (usec): min=1398, max=216849, avg=38256.77, stdev=36672.36 lat (usec): min=1400, max=216851, avg=38264.49, stdev=36667.43 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2008], 10.00th=[ 3425], 20.00th=[ 7635], | 30.00th=[ 11731], 40.00th=[ 20841], 50.00th=[ 29492], 60.00th=[ 38011], | 70.00th=[ 47973], 80.00th=[ 58983], 90.00th=[ 82314], 95.00th=[115868], | 99.00th=[181404], 99.50th=[193987], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 378, per=26.75%, avg=185.11, stdev=78.55, samples=66 iops : min= 1, max= 23, avg=10.77, stdev= 4.94, samples=66 lat (usec) : 50=0.26%, 100=3.12%, 500=0.39%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.47%, 4=3.12%, 10=7.68%, 20=9.11%, 50=37.63% lat (msec) : 100=28.26%, 250=7.55%, 500=0.13% cpu : usr=0.07%, sys=5.75%, ctx=1738, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=658KiB/s (674kB/s), 158KiB/s-175KiB/s (162kB/s-179kB/s), io=23.4MiB (24.5MB), run=34578-36385msec WRITE: bw=693KiB/s (709kB/s), 169KiB/s-181KiB/s (173kB/s-185kB/s), io=24.6MiB (25.8MB), run=34578-36385msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179069: Mon Jul 13 16:58:39 2026 read: IOPS=7, BW=120KiB/s (122kB/s)(5920KiB/49516msec) clat (msec): min=8, max=312, avg=53.09, stdev=45.13 lat (msec): min=8, max=312, avg=53.10, stdev=45.13 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 77], 90.00th=[ 116], 95.00th=[ 153], | 99.00th=[ 213], 99.50th=[ 253], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 448, per=25.21%, avg=121.74, stdev=75.78, samples=93 iops : min= 1, max= 28, avg= 6.86, stdev= 4.76, samples=93 write: IOPS=8, BW=129KiB/s (132kB/s)(6368KiB/49516msec); 0 zone resets clat (msec): min=9, max=393, avg=74.28, stdev=51.93 lat (msec): min=9, max=393, avg=74.28, stdev=51.93 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 28], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 105], 90.00th=[ 133], 95.00th=[ 178], | 99.00th=[ 288], 99.50th=[ 300], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 24, max= 349, per=25.57%, avg=129.91, stdev=71.51, samples=95 iops : min= 1, max= 21, avg= 7.37, stdev= 4.57, samples=95 lat (msec) : 10=1.04%, 20=9.11%, 50=39.97%, 100=32.16%, 250=16.54% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.94%, ctx=1359, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179070: Mon Jul 13 16:58:39 2026 read: IOPS=7, BW=117KiB/s (119kB/s)(5744KiB/49281msec) clat (msec): min=8, max=284, avg=52.03, stdev=45.40 lat (msec): min=8, max=284, avg=52.03, stdev=45.40 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 107], 95.00th=[ 155], | 99.00th=[ 232], 99.50th=[ 275], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 29, max= 352, per=25.67%, avg=123.99, stdev=72.76, samples=91 iops : min= 1, max= 22, avg= 7.01, stdev= 4.62, samples=91 write: IOPS=8, BW=133KiB/s (136kB/s)(6544KiB/49281msec); 0 zone resets clat (msec): min=15, max=435, avg=74.70, stdev=51.51 lat (msec): min=15, max=435, avg=74.71, stdev=51.50 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 72], | 70.00th=[ 86], 80.00th=[ 107], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 239], 99.50th=[ 300], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 349, per=26.29%, avg=133.55, stdev=72.97, samples=96 iops : min= 1, max= 21, avg= 7.59, stdev= 4.63, samples=96 lat (msec) : 10=0.52%, 20=7.03%, 50=44.53%, 100=30.86%, 250=16.41% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.84%, ctx=1242, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179071: Mon Jul 13 16:58:39 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(6256KiB/48977msec) clat (msec): min=6, max=281, avg=54.30, stdev=46.91 lat (msec): min=6, max=281, avg=54.31, stdev=46.91 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 73], 90.00th=[ 115], 95.00th=[ 148], | 99.00th=[ 259], 99.50th=[ 279], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 479, per=26.80%, avg=129.46, stdev=84.68, samples=95 iops : min= 1, max= 29, avg= 7.34, stdev= 5.35, samples=95 write: IOPS=7, BW=123KiB/s (126kB/s)(6032KiB/48977msec); 0 zone resets clat (msec): min=15, max=425, avg=73.10, stdev=49.05 lat (msec): min=15, max=425, avg=73.11, stdev=49.05 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 69], | 70.00th=[ 83], 80.00th=[ 96], 90.00th=[ 138], 95.00th=[ 171], | 99.00th=[ 253], 99.50th=[ 284], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 384, per=24.53%, avg=124.63, stdev=68.99, samples=94 iops : min= 1, max= 24, avg= 7.04, stdev= 4.39, samples=94 lat (msec) : 10=0.91%, 20=6.12%, 50=43.23%, 100=34.51%, 250=14.19% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=2.07%, ctx=1326, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179072: Mon Jul 13 16:58:39 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(6032KiB/49064msec) clat (msec): min=7, max=313, avg=52.72, stdev=44.42 lat (msec): min=7, max=313, avg=52.74, stdev=44.42 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 56], 80.00th=[ 71], 90.00th=[ 115], 95.00th=[ 153], | 99.00th=[ 236], 99.50th=[ 268], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 29, max= 314, per=25.99%, avg=125.54, stdev=69.57, samples=93 iops : min= 1, max= 19, avg= 7.09, stdev= 4.42, samples=93 write: IOPS=7, BW=128KiB/s (131kB/s)(6256KiB/49064msec); 0 zone resets clat (msec): min=12, max=319, avg=73.70, stdev=50.00 lat (msec): min=12, max=319, avg=73.71, stdev=50.00 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 68], | 70.00th=[ 81], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 182], | 99.00th=[ 266], 99.50th=[ 279], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 411, per=25.45%, avg=129.29, stdev=73.06, samples=94 iops : min= 1, max= 25, avg= 7.34, stdev= 4.64, samples=94 lat (msec) : 10=0.65%, 20=8.20%, 50=43.49%, 100=30.60%, 250=16.15% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.84%, ctx=1236, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=484KiB/s (495kB/s), 117KiB/s-128KiB/s (119kB/s-131kB/s), io=23.4MiB (24.5MB), run=48977-49516msec WRITE: bw=509KiB/s (521kB/s), 123KiB/s-133KiB/s (126kB/s-136kB/s), io=24.6MiB (25.8MB), run=48977-49516msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179090: Mon Jul 13 16:58:56 2026 read: IOPS=1, BW=1948KiB/s (1995kB/s)(7168KiB/3680msec) clat (msec): min=98, max=730, avg=282.80, stdev=249.86 lat (msec): min=98, max=730, avg=282.80, stdev=249.86 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 138], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 155], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 550], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2023, max= 4426, per=74.67%, avg=2829.33, stdev=1382.78, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1391KiB/s (1425kB/s)(5120KiB/3680msec); 0 zone resets clat (msec): min=159, max=542, avg=328.16, stdev=155.02 lat (msec): min=163, max=542, avg=329.14, stdev=153.90 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1865, max= 3984, per=49.45%, avg=2622.67, stdev=1181.46, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=4.89%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179091: Mon Jul 13 16:58:56 2026 read: IOPS=0, BW=382KiB/s (391kB/s)(2048KiB/5358msec) clat (msec): min=165, max=340, avg=252.91, stdev=124.20 lat (msec): min=165, max=340, avg=252.91, stdev=124.20 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1508, max= 1992, per=46.19%, avg=1750.00, stdev=342.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1911KiB/s (1957kB/s)(10.0MiB/5358msec); 0 zone resets clat (msec): min=238, max=790, avg=474.61, stdev=198.85 lat (msec): min=238, max=790, avg=474.74, stdev=198.83 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 249], | 30.00th=[ 347], 40.00th=[ 351], 50.00th=[ 388], 60.00th=[ 489], | 70.00th=[ 493], 80.00th=[ 659], 90.00th=[ 751], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1992, max= 4096, per=49.25%, avg=2612.43, stdev=1007.80, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=4.85%, ctx=112, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179092: Mon Jul 13 16:58:56 2026 read: IOPS=1, BW=1137KiB/s (1164kB/s)(6144KiB/5405msec) clat (msec): min=91, max=1012, avg=404.75, stdev=332.77 lat (msec): min=91, max=1012, avg=404.75, stdev=332.77 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 363], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1865, max= 4096, per=65.90%, avg=2497.00, stdev=1068.44, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1137KiB/s (1164kB/s)(6144KiB/5405msec); 0 zone resets clat (msec): min=134, max=896, avg=477.44, stdev=294.87 lat (msec): min=134, max=896, avg=477.55, stdev=294.87 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 481], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1501, max= 4071, per=43.96%, avg=2331.40, stdev=998.96, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.59%, ctx=111, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179093: Mon Jul 13 16:58:56 2026 read: IOPS=0, BW=998KiB/s (1022kB/s)(5120KiB/5130msec) clat (msec): min=113, max=931, avg=454.04, stdev=344.11 lat (msec): min=113, max=931, avg=454.04, stdev=344.11 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1865, max= 4087, per=70.30%, avg=2663.67, stdev=1235.71, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1397KiB/s (1431kB/s)(7168KiB/5130msec); 0 zone resets clat (msec): min=226, max=743, avg=396.33, stdev=171.90 lat (msec): min=227, max=743, avg=396.46, stdev=171.90 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 262], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 363], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 451], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1587, max= 4096, per=55.36%, avg=2936.25, stdev=1318.53, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.06%, sys=5.09%, ctx=98, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3789KiB/s (3880kB/s), 382KiB/s-1948KiB/s (391kB/s-1995kB/s), io=20.0MiB (20.0MB), run=3680-5405msec WRITE: bw=5305KiB/s (5432kB/s), 1137KiB/s-1911KiB/s (1164kB/s-1957kB/s), io=28.0MiB (29.4MB), run=3680-5405msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179095: Mon Jul 13 16:58:56 2026 read: IOPS=2, BW=2084KiB/s (2134kB/s)(7168KiB/3439msec) clat (usec): min=895, max=531679, avg=261708.34, stdev=198345.72 lat (usec): min=896, max=531681, avg=261709.84, stdev=198345.53 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 16188], | 30.00th=[221250], 40.00th=[221250], 50.00th=[295699], 60.00th=[354419], | 70.00th=[354419], 80.00th=[417334], 90.00th=[530580], 95.00th=[530580], | 99.00th=[530580], 99.50th=[530580], 99.90th=[530580], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 1617, max= 3923, per=57.48%, avg=2301.60, stdev=920.94, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1489KiB/s (1525kB/s)(5120KiB/3439msec); 0 zone resets clat (msec): min=150, max=668, avg=313.63, stdev=204.51 lat (msec): min=150, max=668, avg=313.74, stdev=204.50 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1957, max= 3900, per=46.49%, avg=2606.00, stdev=1120.64, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 20=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=16.26%, ctx=170, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179096: Mon Jul 13 16:58:56 2026 read: IOPS=0, BW=400KiB/s (410kB/s)(2048KiB/5114msec) clat (msec): min=164, max=303, avg=234.31, stdev=98.48 lat (msec): min=164, max=303, avg=234.31, stdev=98.48 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1590, max= 1950, per=44.21%, avg=1770.00, stdev=254.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2002KiB/s (2050kB/s)(10.0MiB/5114msec); 0 zone resets clat (msec): min=134, max=992, avg=463.88, stdev=270.06 lat (msec): min=134, max=992, avg=464.14, stdev=269.94 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 262], | 30.00th=[ 288], 40.00th=[ 300], 50.00th=[ 376], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 726], 90.00th=[ 760], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1950, max= 3930, per=40.40%, avg=2265.00, stdev=734.95, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 1000=16.67% cpu : usr=0.04%, sys=11.62%, ctx=186, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179097: Mon Jul 13 16:58:56 2026 read: IOPS=1, BW=1687KiB/s (1728kB/s)(6144KiB/3641msec) clat (usec): min=466, max=353744, avg=143475.97, stdev=162336.70 lat (usec): min=467, max=353746, avg=143477.77, stdev=162336.87 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 529], | 30.00th=[ 529], 40.00th=[ 1647], 50.00th=[ 1647], 60.00th=[214959], | 70.00th=[291505], 80.00th=[291505], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 1957, max= 4031, per=82.32%, avg=3296.00, stdev=1161.46, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1687KiB/s (1728kB/s)(6144KiB/3641msec); 0 zone resets clat (msec): min=271, max=722, avg=462.08, stdev=161.28 lat (msec): min=271, max=722, avg=462.84, stdev=161.71 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 489], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1753, max= 2003, per=34.33%, avg=1924.80, stdev=98.25, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=13.13%, ctx=125, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179098: Mon Jul 13 16:58:56 2026 read: IOPS=1, BW=1286KiB/s (1317kB/s)(5120KiB/3980msec) clat (usec): min=544, max=393516, avg=147623.09, stdev=201201.84 lat (usec): min=546, max=393518, avg=147624.53, stdev=201202.07 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 2835], 60.00th=[ 2835], | 70.00th=[341836], 80.00th=[341836], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7801, max= 7801, per=100.00%, avg=7801.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1801KiB/s (1844kB/s)(7168KiB/3980msec); 0 zone resets clat (msec): min=246, max=895, avg=462.33, stdev=224.82 lat (msec): min=246, max=895, avg=462.94, stdev=224.86 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 249], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 468], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1802, max= 2015, per=34.91%, avg=1956.80, stdev=89.45, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=12.16%, ctx=113, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4005KiB/s (4101kB/s), 400KiB/s-2084KiB/s (410kB/s-2134kB/s), io=20.0MiB (20.0MB), run=3439-5114msec WRITE: bw=5607KiB/s (5741kB/s), 1489KiB/s-2002KiB/s (1525kB/s-2050kB/s), io=28.0MiB (29.4MB), run=3439-5114msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179107: Mon Jul 13 16:59:10 2026 read: IOPS=1, BW=4632KiB/s (4743kB/s)(12.0MiB/2653msec) clat (msec): min=797, max=831, avg=815.54, stdev=16.89 lat (msec): min=797, max=831, avg=815.54, stdev=16.88 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=10.71%, ctx=215, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179109: Mon Jul 13 16:59:10 2026 read: IOPS=0, BW=1622KiB/s (1660kB/s)(4096KiB/2526msec) clat (nsec): min=1072.5M, max=1072.5M, avg=1072473236.00, stdev= 0.00 lat (nsec): min=1072.5M, max=1072.5M, avg=1072476458.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3243KiB/s (3321kB/s)(8192KiB/2526msec); 0 zone resets clat (msec): min=585, max=800, avg=693.10, stdev=152.27 lat (msec): min=586, max=801, avg=693.72, stdev=152.15 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8175, max= 8175, per=88.65%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.83%, ctx=126, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179111: Mon Jul 13 16:59:10 2026 write: IOPS=0, BW=3458KiB/s (3541kB/s)(12.0MiB/3553msec); 0 zone resets clat (msec): min=518, max=1951, avg=1156.57, stdev=728.90 lat (msec): min=520, max=1951, avg=1157.39, stdev=728.45 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8062, max= 8175, per=88.03%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=3.38%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179112: Mon Jul 13 16:59:10 2026 write: IOPS=0, BW=3556KiB/s (3641kB/s)(12.0MiB/3456msec); 0 zone resets clat (msec): min=447, max=2272, avg=1090.40, stdev=1024.80 lat (msec): min=447, max=2272, avg=1090.81, stdev=1025.03 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8078, max= 8175, per=88.12%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.15%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6176KiB/s (6324kB/s), 1622KiB/s-4632KiB/s (1660kB/s-4743kB/s), io=16.0MiB (16.8MB), run=2526-2653msec WRITE: bw=9223KiB/s (9444kB/s), 3243KiB/s-3556KiB/s (3321kB/s-3641kB/s), io=32.0MiB (33.6MB), run=2526-3553msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179105: Mon Jul 13 16:59:10 2026 read: IOPS=1, BW=4246KiB/s (4348kB/s)(12.0MiB/2894msec) clat (msec): min=404, max=1549, avg=943.71, stdev=575.49 lat (msec): min=404, max=1549, avg=943.71, stdev=575.49 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.63%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179106: Mon Jul 13 16:59:10 2026 read: IOPS=0, BW=1187KiB/s (1215kB/s)(4096KiB/3452msec) clat (nsec): min=2230.6M, max=2230.6M, avg=2230591599.00, stdev= 0.00 lat (nsec): min=2230.6M, max=2230.6M, avg=2230593698.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2232], 5.00th=[ 2232], 10.00th=[ 2232], 20.00th=[ 2232], | 30.00th=[ 2232], 40.00th=[ 2232], 50.00th=[ 2232], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2373KiB/s (2430kB/s)(8192KiB/3452msec); 0 zone resets clat (msec): min=330, max=754, avg=542.55, stdev=300.12 lat (msec): min=330, max=757, avg=544.19, stdev=302.06 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.81%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179108: Mon Jul 13 16:59:10 2026 write: IOPS=0, BW=2960KiB/s (3031kB/s)(12.0MiB/4151msec); 0 zone resets clat (msec): min=226, max=3192, avg=1311.49, stdev=1635.74 lat (msec): min=228, max=3193, avg=1312.54, stdev=1635.49 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.87%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179110: Mon Jul 13 16:59:10 2026 write: IOPS=0, BW=4029KiB/s (4126kB/s)(12.0MiB/3050msec); 0 zone resets clat (msec): min=292, max=2338, avg=1002.30, stdev=1158.03 lat (msec): min=293, max=2339, avg=1003.28, stdev=1157.56 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 6849, max= 8110, per=94.75%, avg=7479.50, stdev=891.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.80%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4746KiB/s (4860kB/s), 1187KiB/s-4246KiB/s (1215kB/s-4348kB/s), io=16.0MiB (16.8MB), run=2894-3452msec WRITE: bw=7894KiB/s (8083kB/s), 2373KiB/s-4029KiB/s (2430kB/s-4126kB/s), io=32.0MiB (33.6MB), run=3050-4151msec