== sanity test 398b: DIO and buffer IO race ============== 04:01:38 (1787385698) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.97248 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178823: Sat Aug 22 04:04:33 2026 read: IOPS=9, BW=38.8KiB/s (39.8kB/s)(5992KiB/154351msec) clat (usec): min=51, max=1255.4k, avg=57106.41, stdev=46758.64 lat (usec): min=51, max=1255.4k, avg=57119.31, stdev=46760.66 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 16909], 10.00th=[ 22676], | 20.00th=[ 29230], 30.00th=[ 35914], 40.00th=[ 42206], | 50.00th=[ 48497], 60.00th=[ 56886], 70.00th=[ 67634], | 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[ 115868], | 99.00th=[ 193987], 99.50th=[ 206570], 99.90th=[ 308282], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 95, per=24.83%, avg=38.48, stdev=15.76, samples=300 iops : min= 1, max= 23, avg= 8.93, stdev= 3.96, samples=300 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6296KiB/154351msec); 0 zone resets clat (usec): min=1135, max=320353, avg=43281.10, stdev=42737.20 lat (usec): min=1136, max=320355, avg=43304.58, stdev=42751.77 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1745], 10.00th=[ 3097], 20.00th=[ 6587], | 30.00th=[ 12387], 40.00th=[ 21103], 50.00th=[ 30540], 60.00th=[ 43254], | 70.00th=[ 55313], 80.00th=[ 74974], 90.00th=[101188], 95.00th=[126354], | 99.00th=[187696], 99.50th=[208667], 99.90th=[278922], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 118, per=25.12%, avg=40.70, stdev=19.27, samples=298 iops : min= 1, max= 29, avg= 9.50, stdev= 4.86, samples=298 lat (usec) : 100=1.11%, 250=0.03%, 500=0.07% lat (msec) : 2=3.32%, 4=3.32%, 10=7.19%, 20=8.43%, 50=35.29% lat (msec) : 100=31.45%, 250=9.60%, 500=0.16%, 2000=0.03% cpu : usr=0.10%, sys=5.04%, ctx=7074, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178824: Sat Aug 22 04:04:33 2026 read: IOPS=9, BW=38.8KiB/s (39.7kB/s)(5940KiB/153081msec) clat (usec): min=45, max=345741, avg=55910.15, stdev=34597.02 lat (usec): min=45, max=345742, avg=55912.59, stdev=34596.59 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 15926], 10.00th=[ 22152], 20.00th=[ 29754], | 30.00th=[ 35390], 40.00th=[ 42206], 50.00th=[ 49021], 60.00th=[ 56886], | 70.00th=[ 66323], 80.00th=[ 78119], 90.00th=[ 96994], 95.00th=[120062], | 99.00th=[168821], 99.50th=[212861], 99.90th=[274727], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 5, max= 103, per=24.84%, avg=38.49, stdev=16.63, samples=299 iops : min= 1, max= 25, avg= 8.94, stdev= 4.19, samples=299 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6348KiB/153081msec); 0 zone resets clat (usec): min=907, max=1228.7k, avg=43695.99, stdev=50196.86 lat (usec): min=909, max=1228.7k, avg=43707.72, stdev=50196.81 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1778], 10.00th=[ 2835], | 20.00th=[ 6980], 30.00th=[ 13304], 40.00th=[ 23725], | 50.00th=[ 32900], 60.00th=[ 42730], 70.00th=[ 55837], | 80.00th=[ 74974], 90.00th=[ 96994], 95.00th=[ 121111], | 99.00th=[ 177210], 99.50th=[ 196084], 99.90th=[ 304088], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 110, per=25.49%, avg=41.30, stdev=19.70, samples=298 iops : min= 1, max= 27, avg= 9.65, stdev= 4.99, samples=298 lat (usec) : 50=0.07%, 100=1.11%, 250=0.23%, 500=0.03%, 1000=0.03% lat (msec) : 2=3.65%, 4=3.09%, 10=6.51%, 20=7.94%, 50=36.07% lat (msec) : 100=32.23%, 250=8.82%, 500=0.20%, 2000=0.03% cpu : usr=0.10%, sys=5.13%, ctx=7150, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178827: Sat Aug 22 04:04:33 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(6028KiB/154128msec) clat (usec): min=46, max=271037, avg=55614.31, stdev=34048.26 lat (usec): min=47, max=271039, avg=55621.06, stdev=34048.85 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 16057], 10.00th=[ 22152], 20.00th=[ 29754], | 30.00th=[ 35914], 40.00th=[ 42730], 50.00th=[ 49021], 60.00th=[ 57410], | 70.00th=[ 65274], 80.00th=[ 77071], 90.00th=[ 96994], 95.00th=[116917], | 99.00th=[175113], 99.50th=[233833], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 85, per=25.19%, avg=39.04, stdev=15.99, samples=299 iops : min= 1, max= 21, avg= 9.07, stdev= 4.04, samples=299 write: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6260KiB/154128msec); 0 zone resets clat (usec): min=878, max=888096, avg=44456.87, stdev=49595.73 lat (usec): min=880, max=888099, avg=44460.17, stdev=49595.05 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1696], 10.00th=[ 2966], 20.00th=[ 6718], | 30.00th=[ 14353], 40.00th=[ 22938], 50.00th=[ 32375], 60.00th=[ 43254], | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[129500], | 99.00th=[208667], 99.50th=[254804], 99.90th=[417334], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 103, per=24.97%, avg=40.44, stdev=18.71, samples=300 iops : min= 1, max= 25, avg= 9.43, stdev= 4.71, samples=300 lat (usec) : 50=0.03%, 100=1.04%, 250=0.13%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=3.81%, 4=2.70%, 10=6.61%, 20=8.07%, 50=36.52% lat (msec) : 100=31.61%, 250=8.79%, 500=0.42%, 1000=0.03% cpu : usr=0.09%, sys=4.98%, ctx=6971, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178828: Sat Aug 22 04:04:33 2026 read: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6052KiB/153327msec) clat (usec): min=34, max=822677, avg=56923.01, stdev=41205.70 lat (usec): min=34, max=822678, avg=56927.45, stdev=41205.14 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 15664], 10.00th=[ 21890], 20.00th=[ 30016], | 30.00th=[ 36439], 40.00th=[ 42730], 50.00th=[ 50070], 60.00th=[ 57934], | 70.00th=[ 67634], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[120062], | 99.00th=[179307], 99.50th=[214959], 99.90th=[484443], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 87, per=25.34%, avg=39.28, stdev=15.97, samples=298 iops : min= 1, max= 21, avg= 9.13, stdev= 4.02, samples=298 write: IOPS=10, BW=40.7KiB/s (41.6kB/s)(6236KiB/153327msec); 0 zone resets clat (usec): min=1154, max=266430, avg=42684.20, stdev=42093.61 lat (usec): min=1156, max=266433, avg=42690.92, stdev=42092.71 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1696], 10.00th=[ 3163], 20.00th=[ 6128], | 30.00th=[ 10683], 40.00th=[ 20579], 50.00th=[ 31589], 60.00th=[ 41681], | 70.00th=[ 55313], 80.00th=[ 73925], 90.00th=[100140], 95.00th=[126354], | 99.00th=[181404], 99.50th=[214959], 99.90th=[265290], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 127, per=24.83%, avg=40.22, stdev=19.33, samples=299 iops : min= 1, max= 31, avg= 9.37, stdev= 4.87, samples=299 lat (usec) : 50=0.10%, 100=1.20%, 250=0.20%, 500=0.07%, 1000=0.07% lat (msec) : 2=3.68%, 4=2.60%, 10=8.46%, 20=7.55%, 50=34.18% lat (msec) : 100=32.13%, 250=9.57%, 500=0.16%, 1000=0.03% cpu : usr=0.11%, sys=5.06%, ctx=6960, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (159kB/s), 38.8KiB/s-39.5KiB/s (39.7kB/s-40.4kB/s), io=23.4MiB (24.6MB), run=153081-154351msec WRITE: bw=163KiB/s (167kB/s), 40.6KiB/s-41.5KiB/s (41.6kB/s-42.5kB/s), io=24.6MiB (25.7MB), run=153081-154351msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178822: Sat Aug 22 04:05:16 2026 read: IOPS=7, BW=30.4KiB/s (31.1kB/s)(5992KiB/197098msec) clat (msec): min=6, max=1261, avg=53.39, stdev=55.68 lat (msec): min=6, max=1261, avg=53.40, stdev=55.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 113], 95.00th=[ 150], | 99.00th=[ 232], 99.50th=[ 255], 99.90th=[ 451], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 134, per=25.79%, avg=31.21, stdev=22.85, samples=372 iops : min= 1, max= 33, avg= 7.12, stdev= 5.75, samples=372 write: IOPS=7, BW=31.9KiB/s (32.7kB/s)(6296KiB/197098msec); 0 zone resets clat (msec): min=11, max=622, avg=74.09, stdev=54.99 lat (msec): min=11, max=622, avg=74.09, stdev=54.99 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 69], | 70.00th=[ 88], 80.00th=[ 112], 90.00th=[ 146], 95.00th=[ 176], | 99.00th=[ 271], 99.50th=[ 321], 99.90th=[ 439], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 103, per=25.29%, avg=32.11, stdev=20.94, samples=380 iops : min= 1, max= 25, avg= 7.35, stdev= 5.26, samples=380 lat (msec) : 10=1.11%, 20=11.00%, 50=41.21%, 100=27.93%, 250=17.77% lat (msec) : 500=0.91%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=2.08%, ctx=5086, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178825: Sat Aug 22 04:05:16 2026 read: IOPS=7, BW=30.2KiB/s (30.9kB/s)(5940KiB/196526msec) clat (msec): min=5, max=868, avg=52.33, stdev=49.97 lat (msec): min=5, max=868, avg=52.33, stdev=49.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 79], 90.00th=[ 111], 95.00th=[ 144], | 99.00th=[ 222], 99.50th=[ 249], 99.90th=[ 456], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 127, per=26.02%, avg=31.48, stdev=22.16, samples=365 iops : min= 1, max= 31, avg= 7.19, stdev= 5.57, samples=365 write: IOPS=8, BW=32.3KiB/s (33.1kB/s)(6348KiB/196526msec); 0 zone resets clat (msec): min=8, max=517, avg=74.51, stdev=54.20 lat (msec): min=8, max=517, avg=74.53, stdev=54.21 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 87], 80.00th=[ 109], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 271], 99.50th=[ 317], 99.90th=[ 477], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 111, per=25.38%, avg=32.23, stdev=19.88, samples=380 iops : min= 1, max= 27, avg= 7.38, stdev= 5.00, samples=380 lat (msec) : 10=1.40%, 20=9.83%, 50=41.67%, 100=28.55%, 250=17.51% lat (msec) : 500=0.98%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=2.18%, ctx=5241, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178826: Sat Aug 22 04:05:16 2026 read: IOPS=7, BW=30.7KiB/s (31.4kB/s)(6028KiB/196442msec) clat (msec): min=5, max=353, avg=53.30, stdev=46.37 lat (msec): min=5, max=353, avg=53.30, stdev=46.37 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 80], 90.00th=[ 117], 95.00th=[ 155], | 99.00th=[ 211], 99.50th=[ 251], 99.90th=[ 334], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 135, per=25.79%, avg=31.20, stdev=21.11, samples=373 iops : min= 1, max= 33, avg= 7.12, stdev= 5.32, samples=373 write: IOPS=7, BW=31.9KiB/s (32.6kB/s)(6260KiB/196442msec); 0 zone resets clat (msec): min=10, max=865, avg=73.85, stdev=55.74 lat (msec): min=10, max=865, avg=73.85, stdev=55.74 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 88], 80.00th=[ 109], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 257], 99.50th=[ 313], 99.90th=[ 430], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 111, per=25.06%, avg=31.83, stdev=21.21, samples=380 iops : min= 1, max= 27, avg= 7.28, stdev= 5.33, samples=380 lat (msec) : 10=1.04%, 20=10.45%, 50=43.13%, 100=26.89%, 250=17.68% lat (msec) : 500=0.78%, 1000=0.03% cpu : usr=0.07%, sys=2.07%, ctx=5097, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178829: Sat Aug 22 04:05:16 2026 read: IOPS=7, BW=30.8KiB/s (31.6kB/s)(6052KiB/196397msec) clat (msec): min=4, max=289, avg=52.30, stdev=44.87 lat (msec): min=4, max=289, avg=52.30, stdev=44.87 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 79], 90.00th=[ 116], 95.00th=[ 148], | 99.00th=[ 213], 99.50th=[ 239], 99.90th=[ 275], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 143, per=26.79%, avg=32.42, stdev=22.22, samples=361 iops : min= 1, max= 35, avg= 7.43, stdev= 5.58, samples=361 write: IOPS=7, BW=31.8KiB/s (32.5kB/s)(6236KiB/196397msec); 0 zone resets clat (msec): min=9, max=881, avg=74.83, stdev=56.34 lat (msec): min=9, max=881, avg=74.84, stdev=56.34 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 72], | 70.00th=[ 86], 80.00th=[ 112], 90.00th=[ 144], 95.00th=[ 169], | 99.00th=[ 266], 99.50th=[ 288], 99.90th=[ 642], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 111, per=25.04%, avg=31.80, stdev=20.32, samples=379 iops : min= 1, max= 27, avg= 7.27, stdev= 5.11, samples=379 lat (msec) : 10=1.40%, 20=9.83%, 50=41.96%, 100=28.03%, 250=18.00% lat (msec) : 500=0.72%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=4893, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=122KiB/s (125kB/s), 30.2KiB/s-30.8KiB/s (30.9kB/s-31.6kB/s), io=23.4MiB (24.6MB), run=196397-197098msec WRITE: bw=128KiB/s (131kB/s), 31.8KiB/s-32.3KiB/s (32.5kB/s-33.1kB/s), io=24.6MiB (25.7MB), run=196397-197098msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178881: Sat Aug 22 04:06:08 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(5920KiB/39497msec) clat (usec): min=49, max=260416, avg=58518.85, stdev=37995.57 lat (usec): min=50, max=260417, avg=58523.06, stdev=37997.25 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 80], 10.00th=[ 19268], 20.00th=[ 31065], | 30.00th=[ 39060], 40.00th=[ 44303], 50.00th=[ 51643], 60.00th=[ 60031], | 70.00th=[ 70779], 80.00th=[ 83362], 90.00th=[104334], 95.00th=[129500], | 99.00th=[198181], 99.50th=[200279], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 318, per=25.06%, avg=150.37, stdev=66.16, samples=76 iops : min= 1, max= 19, avg= 8.61, stdev= 4.21, samples=76 write: IOPS=10, BW=161KiB/s (165kB/s)(6368KiB/39497msec); 0 zone resets clat (usec): min=1630, max=220695, avg=44129.34, stdev=40339.56 lat (usec): min=1635, max=220699, avg=44136.14, stdev=40339.48 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2540], 10.00th=[ 5407], 20.00th=[ 9503], | 30.00th=[ 16909], 40.00th=[ 24511], 50.00th=[ 31589], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 70779], 90.00th=[104334], 95.00th=[127402], | 99.00th=[181404], 99.50th=[204473], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 318, per=25.38%, avg=160.38, stdev=66.43, samples=77 iops : min= 1, max= 19, avg= 9.25, stdev= 4.19, samples=77 lat (usec) : 50=0.13%, 100=3.12%, 250=0.52%, 1000=0.13% lat (msec) : 2=0.78%, 4=3.26%, 10=7.03%, 20=7.68%, 50=35.81% lat (msec) : 100=29.95%, 250=11.46%, 500=0.13% cpu : usr=0.10%, sys=5.54%, ctx=1776, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178882: Sat Aug 22 04:06:08 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(5744KiB/39864msec) clat (usec): min=43, max=260898, avg=60380.20, stdev=39868.85 lat (usec): min=43, max=260900, avg=60383.82, stdev=39867.55 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 96], 10.00th=[ 19530], 20.00th=[ 30540], | 30.00th=[ 38011], 40.00th=[ 44303], 50.00th=[ 52167], 60.00th=[ 59507], | 70.00th=[ 74974], 80.00th=[ 87557], 90.00th=[114820], 95.00th=[137364], | 99.00th=[183501], 99.50th=[231736], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 349, per=23.95%, avg=143.68, stdev=64.92, samples=78 iops : min= 1, max= 21, avg= 8.18, stdev= 4.11, samples=78 write: IOPS=10, BW=164KiB/s (168kB/s)(6544KiB/39864msec); 0 zone resets clat (usec): min=1862, max=196259, avg=43624.47, stdev=39876.32 lat (usec): min=1864, max=196262, avg=43627.89, stdev=39876.56 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 6], 20.00th=[ 10], | 30.00th=[ 15], 40.00th=[ 24], 50.00th=[ 32], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 101], 95.00th=[ 126], | 99.00th=[ 190], 99.50th=[ 192], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 383, per=25.92%, avg=163.81, stdev=75.00, samples=78 iops : min= 1, max= 23, avg= 9.45, stdev= 4.72, samples=78 lat (usec) : 50=0.13%, 100=2.21%, 250=0.52% lat (msec) : 2=0.78%, 4=3.52%, 10=8.20%, 20=8.98%, 50=31.90% lat (msec) : 100=31.51%, 250=12.11%, 500=0.13% cpu : usr=0.06%, sys=5.51%, ctx=1844, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178883: Sat Aug 22 04:06:08 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(6256KiB/38635msec) clat (usec): min=38, max=237022, avg=57453.49, stdev=41613.16 lat (usec): min=39, max=237024, avg=57456.25, stdev=41612.36 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 81], 10.00th=[ 17171], 20.00th=[ 28705], | 30.00th=[ 35390], 40.00th=[ 41157], 50.00th=[ 49021], 60.00th=[ 57934], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[104334], 95.00th=[135267], | 99.00th=[225444], 99.50th=[235930], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 62, max= 318, per=27.04%, avg=162.25, stdev=61.97, samples=75 iops : min= 3, max= 19, avg= 9.37, stdev= 3.92, samples=75 write: IOPS=9, BW=156KiB/s (160kB/s)(6032KiB/38635msec); 0 zone resets clat (usec): min=1680, max=186360, avg=42024.25, stdev=35536.42 lat (usec): min=1682, max=186363, avg=42027.89, stdev=35536.07 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 10], | 30.00th=[ 17], 40.00th=[ 25], 50.00th=[ 34], 60.00th=[ 45], | 70.00th=[ 54], 80.00th=[ 68], 90.00th=[ 90], 95.00th=[ 117], | 99.00th=[ 153], 99.50th=[ 161], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 383, per=24.69%, avg=156.04, stdev=82.41, samples=74 iops : min= 1, max= 23, avg= 8.96, stdev= 5.21, samples=74 lat (usec) : 50=0.39%, 100=2.99%, 250=0.78%, 500=0.13% lat (msec) : 2=0.26%, 4=1.95%, 10=7.81%, 20=8.98%, 50=34.90% lat (msec) : 100=31.77%, 250=10.03% cpu : usr=0.07%, sys=5.73%, ctx=1894, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178884: Sat Aug 22 04:06:08 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(6032KiB/38377msec) clat (usec): min=40, max=336568, avg=56542.04, stdev=45067.56 lat (usec): min=40, max=336569, avg=56543.85, stdev=45067.55 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 78], 10.00th=[ 109], 20.00th=[ 26608], | 30.00th=[ 33424], 40.00th=[ 39584], 50.00th=[ 47973], 60.00th=[ 55837], | 70.00th=[ 68682], 80.00th=[ 77071], 90.00th=[107480], 95.00th=[143655], | 99.00th=[202376], 99.50th=[265290], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 319, per=25.99%, avg=155.95, stdev=65.69, samples=75 iops : min= 1, max= 19, avg= 8.96, stdev= 4.15, samples=75 write: IOPS=10, BW=163KiB/s (167kB/s)(6256KiB/38377msec); 0 zone resets clat (usec): min=1858, max=235885, avg=43161.99, stdev=42589.30 lat (usec): min=1860, max=235888, avg=43169.40, stdev=42590.78 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 13], 40.00th=[ 20], 50.00th=[ 30], 60.00th=[ 41], | 70.00th=[ 56], 80.00th=[ 77], 90.00th=[ 105], 95.00th=[ 134], | 99.00th=[ 186], 99.50th=[ 213], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 63, max= 352, per=25.77%, avg=162.87, stdev=64.42, samples=75 iops : min= 3, max= 22, avg= 9.40, stdev= 4.11, samples=75 lat (usec) : 50=0.26%, 100=4.30%, 250=0.91%, 1000=0.26% lat (msec) : 2=0.52%, 4=4.82%, 10=7.94%, 20=8.20%, 50=32.55% lat (msec) : 100=28.91%, 250=10.94%, 500=0.39% cpu : usr=0.07%, sys=5.45%, ctx=1701, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=601KiB/s (615kB/s), 144KiB/s-162KiB/s (148kB/s-166kB/s), io=23.4MiB (24.5MB), run=38377-39864msec WRITE: bw=632KiB/s (647kB/s), 156KiB/s-164KiB/s (160kB/s-168kB/s), io=24.6MiB (25.8MB), run=38377-39864msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178877: Sat Aug 22 04:06:23 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(5920KiB/54586msec) clat (msec): min=8, max=267, avg=58.01, stdev=46.32 lat (msec): min=8, max=267, avg=58.02, stdev=46.32 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 82], 90.00th=[ 126], 95.00th=[ 159], | 99.00th=[ 239], 99.50th=[ 259], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 351, per=26.26%, avg=114.51, stdev=69.47, samples=101 iops : min= 1, max= 21, avg= 6.32, stdev= 4.38, samples=101 write: IOPS=7, BW=117KiB/s (119kB/s)(6368KiB/54586msec); 0 zone resets clat (msec): min=15, max=344, avg=82.63, stdev=56.32 lat (msec): min=15, max=344, avg=82.63, stdev=56.31 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 66], 60.00th=[ 83], | 70.00th=[ 97], 80.00th=[ 117], 90.00th=[ 153], 95.00th=[ 207], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 383, per=25.86%, avg=118.71, stdev=69.84, samples=105 iops : min= 1, max= 23, avg= 6.59, stdev= 4.39, samples=105 lat (msec) : 10=0.52%, 20=6.77%, 50=38.54%, 100=33.98%, 250=18.88% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.92%, ctx=1315, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178878: Sat Aug 22 04:06:23 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(5744KiB/54536msec) clat (msec): min=8, max=299, avg=58.81, stdev=47.10 lat (msec): min=8, max=299, avg=58.81, stdev=47.09 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 88], 90.00th=[ 125], 95.00th=[ 163], | 99.00th=[ 211], 99.50th=[ 292], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 21, max= 447, per=24.89%, avg=108.51, stdev=75.54, samples=104 iops : min= 1, max= 27, avg= 5.94, stdev= 4.75, samples=104 write: IOPS=7, BW=120KiB/s (123kB/s)(6544KiB/54536msec); 0 zone resets clat (msec): min=11, max=361, avg=81.27, stdev=51.85 lat (msec): min=11, max=361, avg=81.27, stdev=51.85 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 41], | 30.00th=[ 47], 40.00th=[ 57], 50.00th=[ 67], 60.00th=[ 80], | 70.00th=[ 95], 80.00th=[ 115], 90.00th=[ 157], 95.00th=[ 188], | 99.00th=[ 245], 99.50th=[ 266], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 319, per=26.53%, avg=121.77, stdev=67.69, samples=105 iops : min= 1, max= 19, avg= 6.78, stdev= 4.26, samples=105 lat (msec) : 10=0.39%, 20=7.03%, 50=36.59%, 100=34.24%, 250=21.09% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.96%, ctx=1238, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178879: Sat Aug 22 04:06:23 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/53707msec) clat (msec): min=8, max=312, avg=59.69, stdev=44.90 lat (msec): min=8, max=312, avg=59.69, stdev=44.90 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 91], 90.00th=[ 125], 95.00th=[ 157], | 99.00th=[ 209], 99.50th=[ 232], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 319, per=27.83%, avg=121.34, stdev=70.93, samples=101 iops : min= 1, max= 19, avg= 6.75, stdev= 4.46, samples=101 write: IOPS=7, BW=112KiB/s (115kB/s)(6032KiB/53707msec); 0 zone resets clat (msec): min=15, max=360, avg=80.29, stdev=51.52 lat (msec): min=15, max=360, avg=80.30, stdev=51.52 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 68], 60.00th=[ 81], | 70.00th=[ 95], 80.00th=[ 118], 90.00th=[ 146], 95.00th=[ 176], | 99.00th=[ 271], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 447, per=24.73%, avg=113.50, stdev=65.52, samples=103 iops : min= 1, max= 27, avg= 6.25, stdev= 4.13, samples=103 lat (msec) : 10=0.26%, 20=6.25%, 50=38.93%, 100=32.16%, 250=21.74% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=2.06%, ctx=1326, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178880: Sat Aug 22 04:06:23 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54886msec) clat (msec): min=8, max=337, avg=59.27, stdev=50.98 lat (msec): min=8, max=337, avg=59.27, stdev=50.98 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 82], 90.00th=[ 133], 95.00th=[ 178], | 99.00th=[ 271], 99.50th=[ 317], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 447, per=26.40%, avg=115.10, stdev=69.98, samples=101 iops : min= 1, max= 27, avg= 6.37, stdev= 4.41, samples=101 write: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54886msec); 0 zone resets clat (msec): min=15, max=347, avg=82.72, stdev=55.00 lat (msec): min=15, max=347, avg=82.73, stdev=55.00 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 57], 50.00th=[ 70], 60.00th=[ 83], | 70.00th=[ 94], 80.00th=[ 112], 90.00th=[ 153], 95.00th=[ 197], | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 383, per=24.92%, avg=114.41, stdev=68.44, samples=106 iops : min= 1, max= 23, avg= 6.31, stdev= 4.30, samples=106 lat (msec) : 10=0.39%, 20=7.68%, 50=36.85%, 100=34.64%, 250=18.62% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.91%, ctx=1247, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=436KiB/s (447kB/s), 105KiB/s-116KiB/s (108kB/s-119kB/s), io=23.4MiB (24.5MB), run=53707-54886msec WRITE: bw=459KiB/s (470kB/s), 112KiB/s-120KiB/s (115kB/s-123kB/s), io=24.6MiB (25.8MB), run=53707-54886msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178899: Sat Aug 22 04:06:41 2026 read: IOPS=1, BW=1465KiB/s (1500kB/s)(7168KiB/4893msec) clat (usec): min=826, max=1181.9k, avg=324542.17, stdev=403644.49 lat (usec): min=827, max=1181.9k, avg=324543.79, stdev=403644.40 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], | 20.00th=[ 2311], 30.00th=[ 166724], 40.00th=[ 166724], | 50.00th=[ 258999], 60.00th=[ 283116], 70.00th=[ 283116], | 80.00th=[ 379585], 90.00th=[1182794], 95.00th=[1182794], | 99.00th=[1182794], 99.50th=[1182794], 99.90th=[1182794], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 1973, max= 2904, per=52.45%, avg=2195.00, stdev=397.50, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=1, BW=1046KiB/s (1072kB/s)(5120KiB/4893msec); 0 zone resets clat (msec): min=99, max=961, avg=488.73, stdev=347.33 lat (msec): min=100, max=961, avg=492.47, stdev=350.27 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1973, max= 4087, per=43.17%, avg=2529.50, stdev=1038.67, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=8.33%, 500=41.67%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.44%, ctx=301, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178900: Sat Aug 22 04:06:41 2026 read: IOPS=0, BW=443KiB/s (454kB/s)(2048KiB/4624msec) clat (msec): min=279, max=405, avg=342.60, stdev=89.07 lat (msec): min=279, max=405, avg=342.60, stdev=89.07 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1436, max= 2007, per=41.14%, avg=1721.50, stdev=403.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2215KiB/s (2268kB/s)(10.0MiB/4624msec); 0 zone resets clat (msec): min=81, max=952, avg=379.30, stdev=265.92 lat (msec): min=81, max=952, avg=379.43, stdev=265.88 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 174], | 30.00th=[ 192], 40.00th=[ 234], 50.00th=[ 241], 60.00th=[ 317], | 70.00th=[ 422], 80.00th=[ 535], 90.00th=[ 642], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1906, max= 6131, per=51.56%, avg=3020.67, stdev=1731.17, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=12.83%, ctx=123, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178901: Sat Aug 22 04:06:41 2026 read: IOPS=1, BW=1690KiB/s (1730kB/s)(6144KiB/3636msec) clat (usec): min=821, max=468522, avg=115006.04, stdev=189579.70 lat (usec): min=823, max=468523, avg=115007.57, stdev=189579.54 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], 20.00th=[ 1074], | 30.00th=[ 1074], 40.00th=[ 2376], 50.00th=[ 2376], 60.00th=[ 19268], | 70.00th=[198181], 80.00th=[198181], 90.00th=[467665], 95.00th=[467665], | 99.00th=[467665], 99.50th=[467665], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 2007, max= 4096, per=80.04%, avg=3349.67, stdev=1165.20, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1690KiB/s (1730kB/s)(6144KiB/3636msec); 0 zone resets clat (msec): min=181, max=923, avg=442.11, stdev=295.01 lat (msec): min=181, max=923, avg=442.19, stdev=295.01 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 326], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1497, max= 4015, per=38.95%, avg=2282.00, stdev=990.65, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 4=8.33%, 20=8.33%, 250=25.00%, 500=25.00% lat (msec) : 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=13.34%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178904: Sat Aug 22 04:06:41 2026 read: IOPS=1, BW=1877KiB/s (1922kB/s)(5120KiB/2728msec) clat (usec): min=746, max=352556, avg=159693.01, stdev=129666.13 lat (usec): min=747, max=352557, avg=159694.07, stdev=129666.19 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[ 750], | 30.00th=[102237], 40.00th=[102237], 50.00th=[147850], 60.00th=[147850], | 70.00th=[196084], 80.00th=[196084], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 2019, max= 6144, per=97.53%, avg=4081.50, stdev=2916.82, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2628KiB/s (2691kB/s)(7168KiB/2728msec); 0 zone resets clat (msec): min=60, max=724, avg=270.36, stdev=224.86 lat (msec): min=60, max=724, avg=270.48, stdev=224.87 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 67], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 215], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 338], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1414, max= 4039, per=40.14%, avg=2351.75, stdev=1157.17, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=21.86%, ctx=157, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4186KiB/s (4286kB/s), 443KiB/s-1877KiB/s (454kB/s-1922kB/s), io=20.0MiB (20.0MB), run=2728-4893msec WRITE: bw=5860KiB/s (6000kB/s), 1046KiB/s-2628KiB/s (1072kB/s-2691kB/s), io=28.0MiB (29.4MB), run=2728-4893msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178902: Sat Aug 22 04:06:42 2026 read: IOPS=1, BW=1232KiB/s (1262kB/s)(7168KiB/5816msec) clat (msec): min=109, max=815, avg=361.50, stdev=263.03 lat (msec): min=109, max=815, avg=361.51, stdev=263.03 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 138], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 275], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 609], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1440, max= 2048, per=54.50%, avg=1913.00, stdev=264.81, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=880KiB/s (901kB/s)(5120KiB/5816msec); 0 zone resets clat (msec): min=135, max=1591, avg=564.63, stdev=585.31 lat (msec): min=135, max=1592, avg=564.76, stdev=585.31 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1996, max= 2048, per=41.00%, avg=2014.67, stdev=28.94, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.56%, ctx=147, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178903: Sat Aug 22 04:06:42 2026 read: IOPS=0, BW=358KiB/s (367kB/s)(2048KiB/5717msec) clat (msec): min=235, max=745, avg=490.32, stdev=360.54 lat (msec): min=235, max=745, avg=490.33, stdev=360.54 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1969, max= 2048, per=57.22%, avg=2008.50, stdev=55.86, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1791KiB/s (1834kB/s)(10.0MiB/5717msec); 0 zone resets clat (msec): min=109, max=914, avg=465.28, stdev=260.74 lat (msec): min=109, max=914, avg=465.40, stdev=260.73 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 150], | 30.00th=[ 284], 40.00th=[ 334], 50.00th=[ 414], 60.00th=[ 472], | 70.00th=[ 584], 80.00th=[ 634], 90.00th=[ 760], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1973, max= 4000, per=46.68%, avg=2294.00, stdev=752.62, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=4.79%, ctx=104, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178905: Sat Aug 22 04:06:42 2026 read: IOPS=1, BW=1097KiB/s (1123kB/s)(6144KiB/5600msec) clat (msec): min=93, max=929, avg=359.49, stdev=359.98 lat (msec): min=93, max=929, avg=359.50, stdev=359.99 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 178], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 2000, max= 3992, per=76.04%, avg=2669.00, stdev=1145.78, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1097KiB/s (1123kB/s)(6144KiB/5600msec); 0 zone resets clat (msec): min=173, max=1411, avg=522.93, stdev=461.20 lat (msec): min=173, max=1412, avg=523.07, stdev=461.20 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 460], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 1973, max= 3938, per=50.50%, avg=2481.50, stdev=971.16, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=4.27%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178906: Sat Aug 22 04:06:42 2026 read: IOPS=0, BW=878KiB/s (899kB/s)(5120KiB/5834msec) clat (msec): min=102, max=849, avg=494.47, stdev=329.28 lat (msec): min=102, max=849, avg=494.47, stdev=329.28 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 2000, max= 3992, per=76.04%, avg=2669.00, stdev=1145.78, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1229KiB/s (1258kB/s)(7168KiB/5834msec); 0 zone resets clat (msec): min=89, max=792, avg=408.78, stdev=261.83 lat (msec): min=89, max=792, avg=408.94, stdev=261.80 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 201], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 326], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 726], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1969, max= 5965, per=70.71%, avg=3474.75, stdev=1898.24, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=3.93%, ctx=75, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3510KiB/s (3595kB/s), 358KiB/s-1232KiB/s (367kB/s-1262kB/s), io=20.0MiB (20.0MB), run=5600-5834msec WRITE: bw=4915KiB/s (5033kB/s), 880KiB/s-1791KiB/s (901kB/s-1834kB/s), io=28.0MiB (29.4MB), run=5600-5834msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178914: Sat Aug 22 04:06:58 2026 read: IOPS=0, BW=3638KiB/s (3725kB/s)(12.0MiB/3378msec) clat (msec): min=766, max=1542, avg=1083.99, stdev=406.52 lat (msec): min=766, max=1542, avg=1083.99, stdev=406.52 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7984, max= 8094, per=100.00%, avg=8039.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.29%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178915: Sat Aug 22 04:06:58 2026 read: IOPS=0, BW=1065KiB/s (1091kB/s)(4096KiB/3846msec) clat (nsec): min=1296.6M, max=1296.6M, avg=1296554582.00, stdev= 0.00 lat (nsec): min=1296.6M, max=1296.6M, avg=1296558183.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1301], 5.00th=[ 1301], 10.00th=[ 1301], 20.00th=[ 1301], | 30.00th=[ 1301], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2130KiB/s (2181kB/s)(8192KiB/3846msec); 0 zone resets clat (msec): min=711, max=1771, avg=1241.77, stdev=749.67 lat (msec): min=712, max=1772, avg=1242.31, stdev=749.59 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 1770], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8159, max= 8159, per=95.76%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.29%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178916: Sat Aug 22 04:06:58 2026 write: IOPS=2, BW=8469KiB/s (8672kB/s)(12.0MiB/1451msec); 0 zone resets clat (msec): min=208, max=887, avg=454.79, stdev=376.05 lat (msec): min=209, max=889, avg=456.05, stdev=376.90 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min=13791, max=13791, per=100.00%, avg=13791.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.07%, sys=10.61%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178918: Sat Aug 22 04:06:58 2026 write: IOPS=1, BW=4585KiB/s (4695kB/s)(12.0MiB/2680msec); 0 zone resets clat (msec): min=220, max=1297, avg=881.38, stdev=578.91 lat (msec): min=220, max=1297, avg=881.99, stdev=578.85 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7529, max= 8175, per=92.16%, avg=7852.00, stdev=456.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.11%, sys=4.85%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4260KiB/s (4362kB/s), 1065KiB/s-3638KiB/s (1091kB/s-3725kB/s), io=16.0MiB (16.8MB), run=3378-3846msec WRITE: bw=8520KiB/s (8725kB/s), 2130KiB/s-8469KiB/s (2181kB/s-8672kB/s), io=32.0MiB (33.6MB), run=1451-3846msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178917: Sat Aug 22 04:06:58 2026 read: IOPS=1, BW=4447KiB/s (4554kB/s)(12.0MiB/2763msec) clat (msec): min=750, max=1115, avg=893.56, stdev=194.99 lat (msec): min=750, max=1115, avg=893.56, stdev=194.99 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.43%, ctx=402, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178919: Sat Aug 22 04:06:58 2026 read: IOPS=0, BW=1257KiB/s (1287kB/s)(4096KiB/3259msec) clat (nsec): min=950452k, max=950452k, avg=950452326.00, stdev= 0.00 lat (nsec): min=950454k, max=950454k, avg=950454268.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2514KiB/s (2574kB/s)(8192KiB/3259msec); 0 zone resets clat (msec): min=901, max=1210, avg=1055.67, stdev=218.41 lat (msec): min=901, max=1212, avg=1057.01, stdev=219.55 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8031, max= 8031, per=92.90%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.39%, ctx=118, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178920: Sat Aug 22 04:06:58 2026 write: IOPS=0, BW=3242KiB/s (3320kB/s)(12.0MiB/3790msec); 0 zone resets clat (msec): min=278, max=1940, avg=1212.11, stdev=849.76 lat (msec): min=279, max=1941, avg=1212.43, stdev=849.78 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8031, max= 8126, per=93.45%, avg=8078.50, stdev=67.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.69%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178921: Sat Aug 22 04:06:58 2026 write: IOPS=0, BW=3817KiB/s (3909kB/s)(12.0MiB/3219msec); 0 zone resets clat (msec): min=395, max=1643, avg=1028.32, stdev=623.97 lat (msec): min=396, max=1644, avg=1029.17, stdev=624.44 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8031, max= 8110, per=93.35%, avg=8070.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.46%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5027KiB/s (5148kB/s), 1257KiB/s-4447KiB/s (1287kB/s-4554kB/s), io=16.0MiB (16.8MB), run=2763-3259msec WRITE: bw=8646KiB/s (8853kB/s), 2514KiB/s-3817KiB/s (2574kB/s-3909kB/s), io=32.0MiB (33.6MB), run=3219-3790msec