== sanity test 398b: DIO and buffer IO race ============== 22:21:06 (1767324066) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.2406 s, 15.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150640: Thu Jan 1 22:22:29 2026 read: IOPS=20, BW=82.0KiB/s (83.0kB/s)(5992KiB/73068msec) clat (usec): min=76, max=704712, avg=23789.42, stdev=26240.27 lat (usec): min=77, max=704713, avg=23791.39, stdev=26239.86 clat percentiles (usec): | 1.00th=[ 125], 5.00th=[ 182], 10.00th=[ 709], 20.00th=[ 10421], | 30.00th=[ 13698], 40.00th=[ 16450], 50.00th=[ 19268], 60.00th=[ 23725], | 70.00th=[ 28705], 80.00th=[ 35390], 90.00th=[ 44303], 95.00th=[ 54264], | 99.00th=[ 86508], 99.50th=[119014], 99.90th=[267387], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 238, per=24.84%, avg=81.47, stdev=31.00, samples=145 iops : min= 1, max= 59, avg=19.78, stdev= 7.76, samples=145 write: IOPS=21, BW=86.2KiB/s (88.2kB/s)(6296KiB/73068msec); 0 zone resets clat (usec): min=638, max=152651, avg=23582.62, stdev=22747.29 lat (usec): min=639, max=152652, avg=23584.96, stdev=22747.34 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 1123], 10.00th=[ 1401], 20.00th=[ 2606], | 30.00th=[ 5473], 40.00th=[ 12780], 50.00th=[ 19268], 60.00th=[ 24511], | 70.00th=[ 30540], 80.00th=[ 39584], 90.00th=[ 54789], 95.00th=[ 68682], | 99.00th=[ 98042], 99.50th=[108528], 99.90th=[133694], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 23, max= 238, per=25.03%, avg=86.11, stdev=32.03, samples=144 iops : min= 5, max= 59, avg=20.95, stdev= 8.06, samples=144 lat (usec) : 100=0.07%, 250=3.26%, 500=1.30%, 750=0.49%, 1000=1.07% lat (msec) : 2=7.32%, 4=5.40%, 10=8.79%, 20=23.73%, 50=39.13% lat (msec) : 100=8.59%, 250=0.78%, 500=0.03%, 750=0.03% cpu : usr=0.12%, sys=9.53%, ctx=6987, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150641: Thu Jan 1 22:22:29 2026 read: IOPS=20, BW=83.2KiB/s (85.2kB/s)(5940KiB/71368msec) clat (usec): min=63, max=192973, avg=23123.51, stdev=17252.32 lat (usec): min=63, max=192974, avg=23124.64, stdev=17252.30 clat percentiles (usec): | 1.00th=[ 125], 5.00th=[ 178], 10.00th=[ 1336], 20.00th=[ 11207], | 30.00th=[ 13960], 40.00th=[ 16581], 50.00th=[ 19792], 60.00th=[ 23200], | 70.00th=[ 27919], 80.00th=[ 34341], 90.00th=[ 44303], 95.00th=[ 52691], | 99.00th=[ 80217], 99.50th=[ 88605], 99.90th=[164627], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 7, max= 174, per=25.26%, avg=82.87, stdev=26.91, samples=141 iops : min= 1, max= 43, avg=20.13, stdev= 6.76, samples=141 write: IOPS=22, BW=88.9KiB/s (91.1kB/s)(6348KiB/71368msec); 0 zone resets clat (usec): min=687, max=718219, avg=23135.87, stdev=30144.66 lat (usec): min=688, max=718220, avg=23137.40, stdev=30144.55 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1172], 10.00th=[ 1500], 20.00th=[ 2737], | 30.00th=[ 5145], 40.00th=[ 10421], 50.00th=[ 17433], 60.00th=[ 23200], | 70.00th=[ 29492], 80.00th=[ 38536], 90.00th=[ 51643], 95.00th=[ 64226], | 99.00th=[102237], 99.50th=[122160], 99.90th=[283116], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 31, max= 191, per=25.91%, avg=89.12, stdev=30.88, samples=140 iops : min= 7, max= 47, avg=21.70, stdev= 7.76, samples=140 lat (usec) : 100=0.07%, 250=3.12%, 500=1.14%, 750=0.36%, 1000=0.75% lat (msec) : 2=7.52%, 4=5.86%, 10=9.54%, 20=24.25%, 50=38.57% lat (msec) : 100=8.01%, 250=0.68%, 500=0.10%, 750=0.03% cpu : usr=0.09%, sys=9.70%, ctx=6867, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150643: Thu Jan 1 22:22:29 2026 read: IOPS=20, BW=83.2KiB/s (85.2kB/s)(6028KiB/72444msec) clat (usec): min=76, max=164581, avg=22967.53, stdev=18269.59 lat (usec): min=77, max=164583, avg=22969.87, stdev=18269.75 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 212], 10.00th=[ 1037], 20.00th=[ 10814], | 30.00th=[ 13829], 40.00th=[ 16057], 50.00th=[ 18744], 60.00th=[ 22414], | 70.00th=[ 27395], 80.00th=[ 34341], 90.00th=[ 43254], 95.00th=[ 52691], | 99.00th=[ 85459], 99.50th=[124257], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 15, max= 176, per=25.47%, avg=83.54, stdev=30.56, samples=141 iops : min= 3, max= 44, avg=20.30, stdev= 7.67, samples=141 write: IOPS=21, BW=86.4KiB/s (88.5kB/s)(6260KiB/72444msec); 0 zone resets clat (usec): min=576, max=693376, avg=23985.87, stdev=28876.15 lat (usec): min=577, max=693378, avg=23988.10, stdev=28875.75 clat percentiles (usec): | 1.00th=[ 914], 5.00th=[ 1172], 10.00th=[ 1565], 20.00th=[ 2900], | 30.00th=[ 5473], 40.00th=[ 11469], 50.00th=[ 18220], 60.00th=[ 23725], | 70.00th=[ 31589], 80.00th=[ 41157], 90.00th=[ 55313], 95.00th=[ 65799], | 99.00th=[ 96994], 99.50th=[115868], 99.90th=[240124], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 143, per=24.98%, avg=85.92, stdev=27.47, samples=142 iops : min= 3, max= 35, avg=20.90, stdev= 6.91, samples=142 lat (usec) : 100=0.07%, 250=2.90%, 500=1.60%, 750=0.33%, 1000=0.88% lat (msec) : 2=6.67%, 4=5.53%, 10=9.80%, 20=25.81%, 50=37.21% lat (msec) : 100=8.40%, 250=0.78%, 750=0.03% cpu : usr=0.10%, sys=9.51%, ctx=6955, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150644: Thu Jan 1 22:22:29 2026 read: IOPS=20, BW=83.6KiB/s (85.7kB/s)(6052KiB/72351msec) clat (usec): min=77, max=231290, avg=23379.22, stdev=19051.17 lat (usec): min=77, max=231291, avg=23384.51, stdev=19050.91 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 208], 10.00th=[ 5276], 20.00th=[ 11076], | 30.00th=[ 13698], 40.00th=[ 16450], 50.00th=[ 19268], 60.00th=[ 22938], | 70.00th=[ 28181], 80.00th=[ 34866], 90.00th=[ 43779], 95.00th=[ 51643], | 99.00th=[ 80217], 99.50th=[116917], 99.90th=[210764], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 23, max= 159, per=25.48%, avg=83.58, stdev=29.16, samples=142 iops : min= 5, max= 39, avg=20.31, stdev= 7.33, samples=142 write: IOPS=21, BW=86.2KiB/s (88.3kB/s)(6236KiB/72351msec); 0 zone resets clat (usec): min=636, max=628133, avg=23524.26, stdev=27359.73 lat (usec): min=637, max=628134, avg=23526.07, stdev=27359.99 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 1172], 10.00th=[ 1614], 20.00th=[ 2933], | 30.00th=[ 5735], 40.00th=[ 11600], 50.00th=[ 17433], 60.00th=[ 22938], | 70.00th=[ 30802], 80.00th=[ 40109], 90.00th=[ 54264], 95.00th=[ 66323], | 99.00th=[ 93848], 99.50th=[107480], 99.90th=[210764], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 15, max= 191, per=24.88%, avg=85.60, stdev=29.47, samples=143 iops : min= 3, max= 47, avg=20.82, stdev= 7.39, samples=143 lat (usec) : 100=0.16%, 250=2.77%, 500=1.20%, 750=0.29%, 1000=0.78% lat (msec) : 2=6.48%, 4=5.60%, 10=9.34%, 20=26.79%, 50=37.63% lat (msec) : 100=8.17%, 250=0.75%, 750=0.03% cpu : usr=0.11%, sys=9.71%, ctx=7106, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=329KiB/s (337kB/s), 82.0KiB/s-83.6KiB/s (83.0kB/s-85.7kB/s), io=23.4MiB (24.6MB), run=71368-73068msec WRITE: bw=344KiB/s (352kB/s), 86.2KiB/s-88.9KiB/s (88.2kB/s-91.1kB/s), io=24.6MiB (25.7MB), run=71368-73068msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150637: Thu Jan 1 22:23:29 2026 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(5992KiB/132262msec) clat (msec): min=3, max=719, avg=18.91, stdev=27.10 lat (msec): min=3, max=719, avg=18.91, stdev=27.10 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 26], 90.00th=[ 43], 95.00th=[ 61], | 99.00th=[ 108], 99.50th=[ 134], 99.90th=[ 165], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 167, per=25.69%, avg=46.50, stdev=31.85, samples=252 iops : min= 1, max= 41, avg=11.13, stdev= 8.05, samples=252 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6296KiB/132262msec); 0 zone resets clat (msec): min=16, max=432, avg=65.85, stdev=38.93 lat (msec): min=16, max=432, avg=65.85, stdev=38.93 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 72], 80.00th=[ 93], 90.00th=[ 122], 95.00th=[ 140], | 99.00th=[ 197], 99.50th=[ 222], 99.90th=[ 317], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 119, per=25.07%, avg=47.38, stdev=25.09, samples=260 iops : min= 1, max= 29, avg=11.34, stdev= 6.38, samples=260 lat (msec) : 4=0.26%, 10=22.56%, 20=13.87%, 50=31.64%, 100=22.04% lat (msec) : 250=9.51%, 500=0.10%, 750=0.03% cpu : usr=0.07%, sys=2.39%, ctx=5460, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150638: Thu Jan 1 22:23:29 2026 read: IOPS=11, BW=44.9KiB/s (45.9kB/s)(5940KiB/132383msec) clat (msec): min=3, max=629, avg=18.27, stdev=24.17 lat (msec): min=3, max=629, avg=18.28, stdev=24.17 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 26], 90.00th=[ 42], 95.00th=[ 58], | 99.00th=[ 86], 99.50th=[ 108], 99.90th=[ 157], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 160, per=25.50%, avg=46.15, stdev=32.33, samples=253 iops : min= 1, max= 40, avg=11.04, stdev= 8.18, samples=253 write: IOPS=11, BW=47.0KiB/s (49.1kB/s)(6348KiB/132383msec); 0 zone resets clat (msec): min=15, max=335, avg=66.13, stdev=39.52 lat (msec): min=15, max=335, avg=66.14, stdev=39.52 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 123], 95.00th=[ 144], | 99.00th=[ 194], 99.50th=[ 230], 99.90th=[ 317], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 128, per=25.33%, avg=47.87, stdev=25.58, samples=261 iops : min= 1, max= 32, avg=11.47, stdev= 6.51, samples=261 lat (msec) : 4=0.20%, 10=22.53%, 20=13.90%, 50=32.42%, 100=21.71% lat (msec) : 250=9.08%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=2.34%, ctx=5494, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150639: Thu Jan 1 22:23:29 2026 read: IOPS=11, BW=45.9KiB/s (46.0kB/s)(6028KiB/131447msec) clat (msec): min=3, max=182, avg=18.79, stdev=19.21 lat (msec): min=3, max=182, avg=18.79, stdev=19.21 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 19], 80.00th=[ 29], 90.00th=[ 44], 95.00th=[ 61], | 99.00th=[ 96], 99.50th=[ 114], 99.90th=[ 159], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 7, max= 176, per=25.59%, avg=46.32, stdev=31.14, samples=256 iops : min= 1, max= 44, avg=11.08, stdev= 7.87, samples=256 write: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6260KiB/131447msec); 0 zone resets clat (msec): min=16, max=681, avg=65.71, stdev=41.94 lat (msec): min=16, max=681, avg=65.72, stdev=41.94 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 53], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 93], 90.00th=[ 117], 95.00th=[ 140], | 99.00th=[ 194], 99.50th=[ 226], 99.90th=[ 435], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 120, per=25.05%, avg=47.35, stdev=25.99, samples=260 iops : min= 1, max= 30, avg=11.33, stdev= 6.62, samples=260 lat (msec) : 4=0.20%, 10=21.71%, 20=13.87%, 50=33.11%, 100=22.04% lat (msec) : 250=8.85%, 500=0.20%, 750=0.03% cpu : usr=0.08%, sys=2.37%, ctx=5444, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150642: Thu Jan 1 22:23:29 2026 read: IOPS=11, BW=45.9KiB/s (46.0kB/s)(6052KiB/131867msec) clat (msec): min=3, max=183, avg=18.59, stdev=20.16 lat (msec): min=3, max=183, avg=18.59, stdev=20.16 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 44], 95.00th=[ 58], | 99.00th=[ 102], 99.50th=[ 132], 99.90th=[ 169], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 7, max= 208, per=26.03%, avg=47.12, stdev=31.99, samples=253 iops : min= 1, max= 52, avg=11.28, stdev= 8.13, samples=253 write: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6236KiB/131867msec); 0 zone resets clat (msec): min=16, max=712, avg=66.35, stdev=40.56 lat (msec): min=16, max=712, avg=66.35, stdev=40.56 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 53], 60.00th=[ 63], | 70.00th=[ 75], 80.00th=[ 95], 90.00th=[ 121], 95.00th=[ 144], | 99.00th=[ 186], 99.50th=[ 209], 99.90th=[ 271], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 120, per=24.88%, avg=47.02, stdev=25.01, samples=261 iops : min= 1, max= 30, avg=11.25, stdev= 6.36, samples=261 lat (msec) : 4=0.23%, 10=22.27%, 20=14.39%, 50=31.41%, 100=22.40% lat (msec) : 250=9.21%, 500=0.07%, 750=0.03% cpu : usr=0.06%, sys=2.49%, ctx=5426, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (186kB/s), 44.9KiB/s-45.9KiB/s (45.9kB/s-46.0kB/s), io=23.4MiB (24.6MB), run=131447-132383msec WRITE: bw=190KiB/s (194kB/s), 47.3KiB/s-47.0KiB/s (48.4kB/s-49.1kB/s), io=24.6MiB (25.7MB), run=131447-132383msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150681: Thu Jan 1 22:23:50 2026 read: IOPS=26, BW=428KiB/s (438kB/s)(5920KiB/13843msec) clat (usec): min=107, max=172259, avg=19752.94, stdev=16888.25 lat (usec): min=107, max=172260, avg=19753.95, stdev=16888.25 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 169], 10.00th=[ 277], 20.00th=[ 5080], | 30.00th=[ 11994], 40.00th=[ 14615], 50.00th=[ 17433], 60.00th=[ 21103], | 70.00th=[ 24511], 80.00th=[ 30016], 90.00th=[ 39584], 95.00th=[ 48497], | 99.00th=[ 69731], 99.50th=[ 90702], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 191, max= 704, per=26.99%, avg=428.00, stdev=120.09, samples=27 iops : min= 11, max= 44, avg=26.15, stdev= 7.61, samples=27 write: IOPS=28, BW=460KiB/s (471kB/s)(6368KiB/13843msec); 0 zone resets clat (usec): min=926, max=124985, avg=16338.63, stdev=17259.81 lat (usec): min=927, max=124987, avg=16340.48, stdev=17259.79 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1663], 10.00th=[ 2409], 20.00th=[ 3687], | 30.00th=[ 4948], 40.00th=[ 6587], 50.00th=[ 10028], 60.00th=[ 13829], | 70.00th=[ 20841], 80.00th=[ 27657], 90.00th=[ 37487], 95.00th=[ 48497], | 99.00th=[ 92799], 99.50th=[104334], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 190, max= 798, per=27.71%, avg=462.22, stdev=116.35, samples=27 iops : min= 11, max= 49, avg=28.30, stdev= 7.33, samples=27 lat (usec) : 250=4.43%, 500=3.12%, 750=0.65%, 1000=0.65% lat (msec) : 2=4.30%, 4=7.29%, 10=17.71%, 20=24.74%, 50=32.55% lat (msec) : 100=4.17%, 250=0.39% cpu : usr=0.10%, sys=14.69%, ctx=1614, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150682: Thu Jan 1 22:23:50 2026 read: IOPS=23, BW=380KiB/s (390kB/s)(5744KiB/15099msec) clat (usec): min=91, max=92734, avg=20555.88, stdev=15465.54 lat (usec): min=92, max=92735, avg=20557.55, stdev=15465.38 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 180], 10.00th=[ 262], 20.00th=[ 9896], | 30.00th=[13173], 40.00th=[15795], 50.00th=[18744], 60.00th=[22414], | 70.00th=[25822], 80.00th=[30278], 90.00th=[39584], 95.00th=[49021], | 99.00th=[76022], 99.50th=[89654], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 59, max= 704, per=23.86%, avg=378.45, stdev=137.30, samples=29 iops : min= 3, max= 44, avg=23.03, stdev= 8.60, samples=29 write: IOPS=27, BW=433KiB/s (444kB/s)(6544KiB/15099msec); 0 zone resets clat (usec): min=1239, max=198434, avg=18773.83, stdev=22310.76 lat (usec): min=1242, max=198436, avg=18777.30, stdev=22310.13 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1713], 10.00th=[ 2180], 20.00th=[ 3163], | 30.00th=[ 4424], 40.00th=[ 5735], 50.00th=[ 10159], 60.00th=[ 15926], | 70.00th=[ 22676], 80.00th=[ 32900], 90.00th=[ 44827], 95.00th=[ 59507], | 99.00th=[ 94897], 99.50th=[109577], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 160, max= 704, per=25.70%, avg=428.76, stdev=148.16, samples=29 iops : min= 10, max= 44, avg=26.17, stdev= 9.28, samples=29 lat (usec) : 100=0.26%, 250=3.65%, 500=2.47%, 750=0.91%, 1000=0.39% lat (msec) : 2=5.08%, 4=9.90%, 10=13.80%, 20=23.57%, 50=33.46% lat (msec) : 100=5.99%, 250=0.52% cpu : usr=0.14%, sys=13.85%, ctx=1758, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150683: Thu Jan 1 22:23:50 2026 read: IOPS=26, BW=421KiB/s (431kB/s)(6256KiB/14854msec) clat (usec): min=63, max=136324, avg=20552.05, stdev=16373.20 lat (usec): min=63, max=136326, avg=20553.13, stdev=16373.23 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 151], 10.00th=[ 281], 20.00th=[ 9503], | 30.00th=[ 13566], 40.00th=[ 15401], 50.00th=[ 18744], 60.00th=[ 22152], | 70.00th=[ 25035], 80.00th=[ 29492], 90.00th=[ 38011], 95.00th=[ 49021], | 99.00th=[ 74974], 99.50th=[114820], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 127, max= 638, per=26.78%, avg=424.72, stdev=109.45, samples=29 iops : min= 7, max= 39, avg=25.93, stdev= 6.89, samples=29 write: IOPS=25, BW=406KiB/s (416kB/s)(6032KiB/14854msec); 0 zone resets clat (usec): min=924, max=175564, avg=18026.36, stdev=18416.71 lat (usec): min=925, max=175566, avg=18028.93, stdev=18416.72 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1745], 10.00th=[ 2474], 20.00th=[ 3654], | 30.00th=[ 5145], 40.00th=[ 7701], 50.00th=[ 12518], 60.00th=[ 17171], | 70.00th=[ 24249], 80.00th=[ 30802], 90.00th=[ 39584], 95.00th=[ 51119], | 99.00th=[ 77071], 99.50th=[ 96994], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 126, max= 661, per=24.07%, avg=401.55, stdev=132.44, samples=29 iops : min= 7, max= 41, avg=24.48, stdev= 8.35, samples=29 lat (usec) : 100=0.52%, 250=4.30%, 500=1.95%, 750=0.39%, 1000=0.39% lat (msec) : 2=3.39%, 4=8.07%, 10=13.54%, 20=26.43%, 50=36.07% lat (msec) : 100=4.43%, 250=0.52% cpu : usr=0.11%, sys=13.59%, ctx=1824, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150684: Thu Jan 1 22:23:50 2026 read: IOPS=25, BW=406KiB/s (415kB/s)(6032KiB/14868msec) clat (usec): min=96, max=136805, avg=20849.32, stdev=18269.01 lat (usec): min=97, max=136805, avg=20850.57, stdev=18268.76 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 147], 10.00th=[ 233], 20.00th=[ 6718], | 30.00th=[ 12649], 40.00th=[ 15664], 50.00th=[ 18744], 60.00th=[ 21890], | 70.00th=[ 25560], 80.00th=[ 31065], 90.00th=[ 38536], 95.00th=[ 47973], | 99.00th=[105382], 99.50th=[128451], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 205, max= 698, per=25.50%, avg=404.41, stdev=107.10, samples=29 iops : min= 12, max= 43, avg=24.66, stdev= 6.77, samples=29 write: IOPS=26, BW=421KiB/s (431kB/s)(6256KiB/14868msec); 0 zone resets clat (usec): min=1141, max=178377, avg=17845.16, stdev=19041.82 lat (usec): min=1141, max=178378, avg=17854.79, stdev=19044.51 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1696], 10.00th=[ 2278], 20.00th=[ 3949], | 30.00th=[ 5342], 40.00th=[ 7308], 50.00th=[ 12387], 60.00th=[ 17171], | 70.00th=[ 21890], 80.00th=[ 28705], 90.00th=[ 41681], 95.00th=[ 55837], | 99.00th=[ 83362], 99.50th=[ 93848], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 205, max= 724, per=25.16%, avg=419.62, stdev=132.22, samples=29 iops : min= 12, max= 45, avg=25.62, stdev= 8.33, samples=29 lat (usec) : 100=0.13%, 250=5.21%, 500=2.60%, 750=0.65%, 1000=0.39% lat (msec) : 2=4.43%, 4=6.77%, 10=15.76%, 20=25.13%, 50=33.33% lat (msec) : 100=4.95%, 250=0.65% cpu : usr=0.16%, sys=14.00%, ctx=1686, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1586KiB/s (1624kB/s), 380KiB/s-428KiB/s (390kB/s-438kB/s), io=23.4MiB (24.5MB), run=13843-15099msec WRITE: bw=1669KiB/s (1709kB/s), 406KiB/s-460KiB/s (416kB/s-471kB/s), io=24.6MiB (25.8MB), run=13843-15099msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150676: Thu Jan 1 22:24:11 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5920KiB/35505msec) clat (msec): min=5, max=175, avg=20.89, stdev=20.27 lat (msec): min=5, max=175, avg=20.89, stdev=20.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 19], 80.00th=[ 28], 90.00th=[ 46], 95.00th=[ 60], | 99.00th=[ 94], 99.50th=[ 167], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 384, per=25.28%, avg=167.83, stdev=80.22, samples=69 iops : min= 1, max= 24, avg= 9.96, stdev= 5.09, samples=69 write: IOPS=11, BW=179KiB/s (184kB/s)(6368KiB/35505msec); 0 zone resets clat (msec): min=20, max=281, avg=69.65, stdev=28.26 lat (msec): min=20, max=281, avg=69.65, stdev=28.26 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 38], 10.00th=[ 42], 20.00th=[ 48], | 30.00th=[ 53], 40.00th=[ 59], 50.00th=[ 65], 60.00th=[ 72], | 70.00th=[ 78], 80.00th=[ 87], 90.00th=[ 105], 95.00th=[ 124], | 99.00th=[ 169], 99.50th=[ 218], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 319, per=25.57%, avg=178.76, stdev=65.10, samples=70 iops : min= 1, max= 19, avg=10.64, stdev= 4.09, samples=70 lat (msec) : 10=13.28%, 20=22.14%, 50=22.66%, 100=35.29%, 250=6.51% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.83%, ctx=1408, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150677: Thu Jan 1 22:24:11 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5744KiB/36049msec) clat (msec): min=4, max=114, avg=20.28, stdev=18.39 lat (msec): min=4, max=114, avg=20.28, stdev=18.39 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 59], | 99.00th=[ 109], 99.50th=[ 114], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 31, max= 448, per=24.14%, avg=160.27, stdev=90.52, samples=70 iops : min= 1, max= 28, avg= 9.49, stdev= 5.65, samples=70 write: IOPS=11, BW=182KiB/s (186kB/s)(6544KiB/36049msec); 0 zone resets clat (msec): min=24, max=216, avg=70.14, stdev=27.75 lat (msec): min=24, max=216, avg=70.14, stdev=27.75 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 36], 10.00th=[ 41], 20.00th=[ 49], | 30.00th=[ 54], 40.00th=[ 59], 50.00th=[ 64], 60.00th=[ 70], | 70.00th=[ 80], 80.00th=[ 90], 90.00th=[ 105], 95.00th=[ 124], | 99.00th=[ 153], 99.50th=[ 174], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 63, max= 320, per=25.80%, avg=180.32, stdev=59.76, samples=71 iops : min= 3, max= 20, avg=10.75, stdev= 3.82, samples=71 lat (msec) : 10=12.50%, 20=20.70%, 50=22.53%, 100=36.33%, 250=7.94% cpu : usr=0.07%, sys=2.60%, ctx=1404, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150678: Thu Jan 1 22:24:11 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(6256KiB/34792msec) clat (msec): min=4, max=110, avg=20.29, stdev=17.83 lat (msec): min=4, max=110, avg=20.29, stdev=17.83 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 57], | 99.00th=[ 97], 99.50th=[ 110], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 31, max= 508, per=27.09%, avg=179.90, stdev=105.31, samples=69 iops : min= 1, max= 31, avg=10.71, stdev= 6.57, samples=69 write: IOPS=10, BW=173KiB/s (178kB/s)(6032KiB/34792msec); 0 zone resets clat (msec): min=31, max=273, avg=71.00, stdev=29.94 lat (msec): min=31, max=273, avg=71.00, stdev=29.94 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 37], 10.00th=[ 42], 20.00th=[ 47], | 30.00th=[ 53], 40.00th=[ 58], 50.00th=[ 64], 60.00th=[ 71], | 70.00th=[ 80], 80.00th=[ 92], 90.00th=[ 110], 95.00th=[ 126], | 99.00th=[ 169], 99.50th=[ 224], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 63, max= 320, per=24.75%, avg=173.01, stdev=60.96, samples=69 iops : min= 3, max= 20, avg=10.28, stdev= 3.86, samples=69 lat (msec) : 10=11.85%, 20=24.48%, 50=22.40%, 100=33.33%, 250=7.81% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.89%, ctx=1406, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150679: Thu Jan 1 22:24:11 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(6032KiB/35263msec) clat (msec): min=4, max=175, avg=19.45, stdev=17.48 lat (msec): min=4, max=175, avg=19.45, stdev=17.48 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 59], | 99.00th=[ 85], 99.50th=[ 106], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 447, per=25.70%, avg=170.64, stdev=85.02, samples=70 iops : min= 1, max= 27, avg=10.13, stdev= 5.34, samples=70 write: IOPS=11, BW=177KiB/s (182kB/s)(6256KiB/35263msec); 0 zone resets clat (msec): min=30, max=265, avg=71.20, stdev=32.15 lat (msec): min=30, max=265, avg=71.21, stdev=32.15 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 37], 10.00th=[ 41], 20.00th=[ 48], | 30.00th=[ 54], 40.00th=[ 59], 50.00th=[ 63], 60.00th=[ 69], | 70.00th=[ 79], 80.00th=[ 90], 90.00th=[ 108], 95.00th=[ 136], | 99.00th=[ 192], 99.50th=[ 245], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 63, max= 286, per=25.37%, avg=177.33, stdev=62.01, samples=70 iops : min= 3, max= 17, avg=10.56, stdev= 3.95, samples=70 lat (msec) : 10=12.37%, 20=23.44%, 50=22.14%, 100=34.64%, 250=7.29% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=2.95%, ctx=1492, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=664KiB/s (680kB/s), 159KiB/s-180KiB/s (163kB/s-184kB/s), io=23.4MiB (24.5MB), run=34792-36049msec WRITE: bw=699KiB/s (716kB/s), 173KiB/s-182KiB/s (178kB/s-186kB/s), io=24.6MiB (25.8MB), run=34792-36049msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150695: Thu Jan 1 22:24:19 2026 read: IOPS=3, BW=3305KiB/s (3384kB/s)(7168KiB/2169msec) clat (msec): min=72, max=238, avg=139.11, stdev=59.87 lat (msec): min=72, max=238, avg=139.12, stdev=59.87 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 140], 80.00th=[ 199], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 2011, max= 5731, per=53.72%, avg=3940.33, stdev=1863.87, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2361KiB/s (2417kB/s)(5120KiB/2169msec); 0 zone resets clat (msec): min=120, max=500, avg=225.76, stdev=155.91 lat (msec): min=121, max=500, avg=225.85, stdev=155.91 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2048, max= 4079, per=32.95%, avg=3383.33, stdev=1156.77, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (msec) : 100=16.67%, 250=75.00%, 750=8.33% cpu : usr=0.00%, sys=8.03%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150696: Thu Jan 1 22:24:19 2026 read: IOPS=0, BW=734KiB/s (751kB/s)(2048KiB/2792msec) clat (usec): min=72739, max=91521, avg=82130.43, stdev=13280.54 lat (usec): min=72741, max=91522, avg=82132.38, stdev=13280.10 clat percentiles (usec): | 1.00th=[72877], 5.00th=[72877], 10.00th=[72877], 20.00th=[72877], | 30.00th=[72877], 40.00th=[72877], 50.00th=[72877], 60.00th=[91751], | 70.00th=[91751], 80.00th=[91751], 90.00th=[91751], 95.00th=[91751], | 99.00th=[91751], 99.50th=[91751], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 1845, max= 2011, per=26.28%, avg=1928.00, stdev=117.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3668KiB/s (3756kB/s)(10.0MiB/2792msec); 0 zone resets clat (msec): min=123, max=500, avg=255.36, stdev=122.08 lat (msec): min=123, max=500, avg=255.43, stdev=122.08 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 148], | 30.00th=[ 155], 40.00th=[ 165], 50.00th=[ 207], 60.00th=[ 241], | 70.00th=[ 296], 80.00th=[ 355], 90.00th=[ 363], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1845, max= 4096, per=31.26%, avg=3210.00, stdev=1159.85, samples=5 iops : min= 1, max= 4, avg= 2.40, stdev= 1.34, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=7.27%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150697: Thu Jan 1 22:24:19 2026 read: IOPS=2, BW=2228KiB/s (2281kB/s)(6144KiB/2758msec) clat (msec): min=60, max=222, avg=127.29, stdev=60.45 lat (msec): min=60, max=222, avg=127.29, stdev=60.45 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 146], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 2023, max= 6035, per=45.89%, avg=3365.67, stdev=2311.72, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=2, BW=2228KiB/s (2281kB/s)(6144KiB/2758msec); 0 zone resets clat (msec): min=135, max=516, avg=324.12, stdev=174.59 lat (msec): min=135, max=516, avg=324.20, stdev=174.57 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 435], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1889, max= 2048, per=19.50%, avg=2002.00, stdev=64.76, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=5.51%, ctx=94, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150698: Thu Jan 1 22:24:19 2026 read: IOPS=2, BW=2570KiB/s (2632kB/s)(5120KiB/1992msec) clat (msec): min=73, max=169, avg=115.95, stdev=37.70 lat (msec): min=73, max=169, avg=115.95, stdev=37.70 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 74], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 117], 60.00th=[ 117], | 70.00th=[ 132], 80.00th=[ 132], 90.00th=[ 169], 95.00th=[ 169], | 99.00th=[ 169], 99.50th=[ 169], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3598KiB/s (3685kB/s)(7168KiB/1992msec); 0 zone resets clat (msec): min=90, max=451, avg=198.91, stdev=122.38 lat (msec): min=90, max=451, avg=198.97, stdev=122.38 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 108], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 161], 60.00th=[ 209], | 70.00th=[ 209], 80.00th=[ 234], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2039, max= 4096, per=31.98%, avg=3283.67, stdev=1094.53, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 100=25.00%, 250=66.67%, 500=8.33% cpu : usr=0.00%, sys=5.78%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7335KiB/s (7511kB/s), 734KiB/s-3305KiB/s (751kB/s-3384kB/s), io=20.0MiB (20.0MB), run=1992-2792msec WRITE: bw=10.0MiB/s (10.5MB/s), 2228KiB/s-3668KiB/s (2281kB/s-3756kB/s), io=28.0MiB (29.4MB), run=1992-2792msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150700: Thu Jan 1 22:24:19 2026 read: IOPS=3, BW=3082KiB/s (3156kB/s)(7168KiB/2326msec) clat (msec): min=99, max=164, avg=130.47, stdev=24.05 lat (msec): min=99, max=164, avg=130.47, stdev=24.05 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 107], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 131], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 150], 90.00th=[ 165], 95.00th=[ 165], | 99.00th=[ 165], 99.50th=[ 165], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 2027, max= 5742, per=52.68%, avg=3933.33, stdev=1859.42, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2201KiB/s (2254kB/s)(5120KiB/2326msec); 0 zone resets clat (msec): min=134, max=436, avg=258.34, stdev=140.67 lat (msec): min=134, max=436, avg=258.42, stdev=140.67 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2035, max= 6083, per=38.83%, avg=4059.00, stdev=2862.37, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.00%, sys=23.66%, ctx=335, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150701: Thu Jan 1 22:24:19 2026 read: IOPS=0, BW=747KiB/s (765kB/s)(2048KiB/2743msec) clat (msec): min=127, max=215, avg=171.79, stdev=62.23 lat (msec): min=127, max=215, avg=171.79, stdev=62.23 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 1848, max= 2027, per=25.95%, avg=1937.50, stdev=126.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3733KiB/s (3823kB/s)(10.0MiB/2743msec); 0 zone resets clat (msec): min=95, max=393, avg=234.49, stdev=90.29 lat (msec): min=97, max=393, avg=234.92, stdev=90.02 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 114], | 30.00th=[ 213], 40.00th=[ 218], 50.00th=[ 228], 60.00th=[ 232], | 70.00th=[ 245], 80.00th=[ 264], 90.00th=[ 347], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1848, max= 4079, per=30.75%, avg=3213.60, stdev=1171.91, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=22.14%, ctx=240, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150702: Thu Jan 1 22:24:19 2026 read: IOPS=2, BW=2943KiB/s (3013kB/s)(6144KiB/2088msec) clat (usec): min=560, max=169399, avg=72346.65, stdev=80917.84 lat (usec): min=562, max=169400, avg=72347.79, stdev=80918.02 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 898], | 30.00th=[ 898], 40.00th=[ 1369], 50.00th=[ 1369], 60.00th=[106431], | 70.00th=[154141], 80.00th=[154141], 90.00th=[168821], 95.00th=[168821], | 99.00th=[168821], 99.50th=[168821], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 2027, max= 8062, per=67.57%, avg=5044.50, stdev=4267.39, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=2, BW=2943KiB/s (3013kB/s)(6144KiB/2088msec); 0 zone resets clat (msec): min=102, max=418, avg=244.26, stdev=127.70 lat (msec): min=102, max=418, avg=244.31, stdev=127.72 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 220], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1946, max= 4055, per=28.86%, avg=3016.75, stdev=1185.61, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 250=58.33%, 500=16.67% cpu : usr=0.05%, sys=20.46%, ctx=192, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150703: Thu Jan 1 22:24:19 2026 read: IOPS=1, BW=2026KiB/s (2075kB/s)(5120KiB/2527msec) clat (usec): min=645, max=153209, avg=50501.03, stdev=62985.17 lat (usec): min=646, max=153211, avg=50502.28, stdev=62985.27 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 644], | 30.00th=[ 668], 40.00th=[ 668], 50.00th=[ 35914], 60.00th=[ 35914], | 70.00th=[ 62129], 80.00th=[ 62129], 90.00th=[154141], 95.00th=[154141], | 99.00th=[154141], 99.50th=[154141], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2837KiB/s (2905kB/s)(7168KiB/2527msec); 0 zone resets clat (msec): min=126, max=528, avg=310.69, stdev=157.71 lat (msec): min=126, max=529, avg=310.78, stdev=157.71 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 159], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 259], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 443], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1899, max= 2035, per=19.08%, avg=1994.00, stdev=63.86, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=17.22%, ctx=148, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7466KiB/s (7645kB/s), 747KiB/s-3082KiB/s (765kB/s-3156kB/s), io=20.0MiB (20.0MB), run=2088-2743msec WRITE: bw=10.2MiB/s (10.7MB/s), 2201KiB/s-3733KiB/s (2254kB/s-3823kB/s), io=28.0MiB (29.4MB), run=2088-2743msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150714: Thu Jan 1 22:24:28 2026 read: IOPS=1, BW=6793KiB/s (6956kB/s)(12.0MiB/1809msec) clat (msec): min=468, max=753, avg=570.62, stdev=158.90 lat (msec): min=468, max=753, avg=570.62, stdev=158.90 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8192, max= 8192, per=90.46%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=22.12%, ctx=564, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150715: Thu Jan 1 22:24:28 2026 read: IOPS=0, BW=2631KiB/s (2694kB/s)(4096KiB/1557msec) clat (nsec): min=709193k, max=709193k, avg=709193394.00, stdev= 0.00 lat (nsec): min=709195k, max=709195k, avg=709195438.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8175, max= 8175, per=90.27%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5261KiB/s (5388kB/s)(8192KiB/1557msec); 0 zone resets clat (msec): min=325, max=487, avg=406.42, stdev=114.17 lat (msec): min=325, max=487, avg=406.70, stdev=114.17 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 8175, max= 8175, per=60.55%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=12.60%, ctx=286, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150716: Thu Jan 1 22:24:28 2026 write: IOPS=1, BW=5063KiB/s (5185kB/s)(12.0MiB/2427msec); 0 zone resets clat (msec): min=173, max=1574, avg=801.10, stdev=711.69 lat (msec): min=173, max=1574, avg=801.43, stdev=711.71 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8192, max= 8192, per=60.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=5.19%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150717: Thu Jan 1 22:24:28 2026 write: IOPS=1, BW=5715KiB/s (5853kB/s)(12.0MiB/2150msec); 0 zone resets clat (msec): min=523, max=1018, avg=703.91, stdev=273.80 lat (msec): min=524, max=1019, avg=704.23, stdev=273.82 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 5673, max= 8175, per=51.29%, avg=6924.00, stdev=1769.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.03%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9057KiB/s (9274kB/s), 2631KiB/s-6793KiB/s (2694kB/s-6956kB/s), io=16.0MiB (16.8MB), run=1557-1809msec WRITE: bw=13.2MiB/s (13.8MB/s), 5063KiB/s-5715KiB/s (5185kB/s-5853kB/s), io=32.0MiB (33.6MB), run=1557-2427msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150710: Thu Jan 1 22:24:28 2026 read: IOPS=3, BW=12.0MiB/s (13.6MB/s)(12.0MiB/925msec) clat (msec): min=176, max=330, avg=260.97, stdev=77.75 lat (msec): min=176, max=330, avg=260.98, stdev=77.75 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7327, max= 7327, per=100.00%, avg=7327.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.32%, sys=19.59%, ctx=65, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150711: Thu Jan 1 22:24:28 2026 read: IOPS=0, BW=1596KiB/s (1635kB/s)(4096KiB/2566msec) clat (nsec): min=822565k, max=822565k, avg=822564942.00, stdev= 0.00 lat (nsec): min=822566k, max=822566k, avg=822565892.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3193KiB/s (3269kB/s)(8192KiB/2566msec); 0 zone resets clat (msec): min=392, max=1213, avg=803.29, stdev=580.83 lat (msec): min=392, max=1214, avg=803.53, stdev=580.95 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.12%, sys=8.30%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150712: Thu Jan 1 22:24:28 2026 write: IOPS=1, BW=5170KiB/s (5294kB/s)(12.0MiB/2377msec); 0 zone resets clat (msec): min=313, max=1236, avg=742.41, stdev=464.90 lat (msec): min=313, max=1236, avg=742.78, stdev=464.89 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8078, max= 8192, per=63.70%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.34%, sys=8.54%, ctx=86, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150713: Thu Jan 1 22:24:28 2026 write: IOPS=1, BW=5777KiB/s (5916kB/s)(12.0MiB/2127msec); 0 zone resets clat (msec): min=332, max=1258, avg=642.69, stdev=533.29 lat (msec): min=333, max=1258, avg=643.13, stdev=533.17 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 6681, max= 8126, per=57.98%, avg=7403.50, stdev=1021.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.09%, sys=9.03%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6385KiB/s (6538kB/s), 1596KiB/s-12.0MiB/s (1635kB/s-13.6MB/s), io=16.0MiB (16.8MB), run=925-2566msec WRITE: bw=12.5MiB/s (13.1MB/s), 3193KiB/s-5777KiB/s (3269kB/s-5916kB/s), io=32.0MiB (33.6MB), run=2127-2566msec