== sanity test 398b: DIO and buffer IO race ============== 17:48:18 (1788644898) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.02954 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146098: Sat Sep 5 17:50:46 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5992KiB/128053msec) clat (usec): min=32, max=759520, avg=39971.28, stdev=37779.96 lat (usec): min=33, max=759522, avg=39976.16, stdev=37777.04 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 75], 20.00th=[ 16057], | 30.00th=[ 22152], 40.00th=[ 27657], 50.00th=[ 33424], 60.00th=[ 40633], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[139461], 99.50th=[191890], 99.90th=[392168], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 124, per=25.18%, avg=46.84, stdev=19.94, samples=249 iops : min= 1, max= 31, avg=11.09, stdev= 5.05, samples=249 write: IOPS=12, BW=49.2KiB/s (50.3kB/s)(6296KiB/128053msec); 0 zone resets clat (usec): min=904, max=335608, avg=43197.74, stdev=44712.15 lat (usec): min=905, max=335610, avg=43199.42, stdev=44712.35 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1631], 20.00th=[ 4424], | 30.00th=[ 9634], 40.00th=[ 21627], 50.00th=[ 32113], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[126354], | 99.00th=[193987], 99.50th=[221250], 99.90th=[329253], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 109, per=25.27%, avg=49.27, stdev=20.10, samples=249 iops : min= 1, max= 27, avg=11.71, stdev= 5.04, samples=249 lat (usec) : 50=0.68%, 100=5.08%, 250=0.81%, 500=0.26%, 750=0.10% lat (usec) : 1000=0.26% lat (msec) : 2=5.89%, 4=3.58%, 10=6.48%, 20=8.89%, 50=36.20% lat (msec) : 100=24.58%, 250=6.90%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=5.81%, ctx=6537, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146099: Sat Sep 5 17:50:46 2026 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(5940KiB/128882msec) clat (usec): min=29, max=590921, avg=40378.09, stdev=37388.75 lat (usec): min=30, max=590923, avg=40380.66, stdev=37388.25 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 76], 20.00th=[ 16188], | 30.00th=[ 22152], 40.00th=[ 27657], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[147850], 99.50th=[179307], 99.90th=[505414], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 5, max= 127, per=25.03%, avg=46.56, stdev=22.50, samples=249 iops : min= 1, max= 31, avg=11.02, stdev= 5.67, samples=249 write: IOPS=12, BW=49.3KiB/s (50.4kB/s)(6348KiB/128882msec); 0 zone resets clat (usec): min=919, max=620646, avg=43328.30, stdev=47384.80 lat (usec): min=921, max=620648, avg=43333.97, stdev=47382.42 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1598], 20.00th=[ 3884], | 30.00th=[ 7767], 40.00th=[ 18482], 50.00th=[ 31327], 60.00th=[ 43254], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[104334], 95.00th=[128451], | 99.00th=[204473], 99.50th=[219153], 99.90th=[383779], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 127, per=25.05%, avg=48.85, stdev=22.12, samples=253 iops : min= 1, max= 31, avg=11.60, stdev= 5.57, samples=253 lat (usec) : 50=0.88%, 100=4.98%, 250=0.62%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=6.09%, 4=4.26%, 10=6.87%, 20=9.60%, 50=33.92% lat (msec) : 100=24.32%, 250=7.71%, 500=0.20%, 750=0.10% cpu : usr=0.08%, sys=5.57%, ctx=6547, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146100: Sat Sep 5 17:50:46 2026 read: IOPS=11, BW=47.9KiB/s (49.1kB/s)(6028KiB/125802msec) clat (usec): min=33, max=292547, avg=37993.50, stdev=29210.34 lat (usec): min=33, max=292548, avg=37995.79, stdev=29210.22 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 79], 20.00th=[ 16319], | 30.00th=[ 22414], 40.00th=[ 27657], 50.00th=[ 32900], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 58459], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[124257], 99.50th=[139461], 99.90th=[252707], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 104, per=25.79%, avg=47.98, stdev=21.11, samples=245 iops : min= 1, max= 26, avg=11.38, stdev= 5.31, samples=245 write: IOPS=12, BW=49.8KiB/s (50.0kB/s)(6260KiB/125802msec); 0 zone resets clat (usec): min=934, max=683561, avg=43678.58, stdev=48247.93 lat (usec): min=935, max=683562, avg=43680.33, stdev=48247.86 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1205], 10.00th=[ 1860], 20.00th=[ 4490], | 30.00th=[ 9503], 40.00th=[ 19006], 50.00th=[ 32113], 60.00th=[ 42730], | 70.00th=[ 56886], 80.00th=[ 74974], 90.00th=[103285], 95.00th=[127402], | 99.00th=[187696], 99.50th=[244319], 99.90th=[480248], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 104, per=25.32%, avg=49.38, stdev=19.26, samples=247 iops : min= 1, max= 26, avg=11.74, stdev= 4.87, samples=247 lat (usec) : 50=0.78%, 100=4.82%, 250=0.55%, 500=0.20%, 750=0.16% lat (usec) : 1000=0.20% lat (msec) : 2=5.57%, 4=4.26%, 10=6.05%, 20=10.19%, 50=36.26% lat (msec) : 100=23.67%, 250=7.00%, 500=0.26%, 750=0.03% cpu : usr=0.07%, sys=5.65%, ctx=6539, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146101: Sat Sep 5 17:50:46 2026 read: IOPS=12, BW=48.8KiB/s (49.9kB/s)(6052KiB/124123msec) clat (usec): min=34, max=230832, avg=37981.48, stdev=28702.91 lat (usec): min=34, max=230834, avg=37983.95, stdev=28702.47 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 79], 20.00th=[ 17433], | 30.00th=[ 23200], 40.00th=[ 27657], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[127402], 99.50th=[152044], 99.90th=[212861], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 109, per=26.30%, avg=48.91, stdev=19.82, samples=242 iops : min= 1, max= 27, avg=11.62, stdev= 5.00, samples=242 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6236KiB/124123msec); 0 zone resets clat (usec): min=968, max=691753, avg=42648.76, stdev=49673.39 lat (usec): min=969, max=691755, avg=42652.30, stdev=49673.42 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1827], 20.00th=[ 4228], | 30.00th=[ 8455], 40.00th=[ 17695], 50.00th=[ 31065], 60.00th=[ 41157], | 70.00th=[ 55313], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[124257], | 99.00th=[185598], 99.50th=[263193], 99.90th=[616563], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 135, per=25.63%, avg=49.99, stdev=20.95, samples=244 iops : min= 1, max= 33, avg=11.88, stdev= 5.29, samples=244 lat (usec) : 50=1.01%, 100=4.65%, 250=0.65%, 500=0.10%, 1000=0.16% lat (msec) : 2=5.24%, 4=4.52%, 10=6.90%, 20=9.70%, 50=36.95% lat (msec) : 100=23.11%, 250=6.67%, 500=0.26%, 750=0.07% cpu : usr=0.07%, sys=5.57%, ctx=6372, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (191kB/s), 46.1KiB/s-48.8KiB/s (47.2kB/s-49.9kB/s), io=23.4MiB (24.6MB), run=124123-128882msec WRITE: bw=195KiB/s (200kB/s), 49.2KiB/s-50.2KiB/s (50.3kB/s-51.4kB/s), io=24.6MiB (25.7MB), run=124123-128882msec fio: pid=146094, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146093: Sat Sep 5 17:53:03 2026 read: IOPS=5, BW=22.5KiB/s (23.1kB/s)(5992KiB/265967msec) clat (msec): min=5, max=850, avg=36.73, stdev=40.44 lat (msec): min=5, max=850, avg=36.73, stdev=40.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 78], 95.00th=[ 104], | 99.00th=[ 163], 99.50th=[ 205], 99.90th=[ 418], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 104, per=28.30%, avg=24.62, stdev=17.63, samples=470 iops : min= 1, max= 26, avg= 5.51, stdev= 4.45, samples=470 write: IOPS=5, BW=23.7KiB/s (24.2kB/s)(6296KiB/265967msec); 0 zone resets clat (msec): min=38, max=729, avg=133.81, stdev=70.25 lat (msec): min=38, max=729, avg=133.81, stdev=70.25 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 91], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 129], | 70.00th=[ 150], 80.00th=[ 182], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 380], 99.50th=[ 418], 99.90th=[ 634], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 55, per=25.96%, avg=23.36, stdev=11.35, samples=519 iops : min= 1, max= 13, avg= 5.19, stdev= 2.90, samples=519 lat (msec) : 10=3.39%, 20=15.01%, 50=21.26%, 100=25.85%, 250=30.60% lat (msec) : 500=3.81%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.25%, ctx=5509, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146094: Sat Sep 5 17:53:03 2026 read: IOPS=5, BW=21.5KiB/s (21.0kB/s)(5068KiB/236053msec) clat (msec): min=5, max=697, avg=37.00, stdev=37.71 lat (msec): min=5, max=697, avg=37.00, stdev=37.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 79], 95.00th=[ 103], | 99.00th=[ 161], 99.50th=[ 203], 99.90th=[ 405], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 95, per=28.18%, avg=24.52, stdev=16.95, samples=399 iops : min= 1, max= 23, avg= 5.49, stdev= 4.29, samples=399 write: IOPS=5, BW=22.6KiB/s (23.2kB/s)(5340KiB/236053msec); 0 zone resets clat (msec): min=38, max=711, avg=141.45, stdev=74.03 lat (msec): min=38, max=711, avg=141.45, stdev=74.03 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 122], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 239], 95.00th=[ 292], | 99.00th=[ 393], 99.50th=[ 418], 99.90th=[ 617], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 48, per=24.62%, avg=22.16, stdev=11.07, samples=463 iops : min= 1, max= 12, avg= 4.89, stdev= 2.84, samples=463 lat (msec) : 10=3.38%, 20=14.48%, 50=20.94%, 100=24.78%, 250=32.04% lat (msec) : 500=4.15%, 750=0.19% cpu : usr=0.04%, sys=1.21%, ctx=4457, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1268,1335,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146095: Sat Sep 5 17:53:03 2026 read: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6028KiB/264855msec) clat (msec): min=5, max=649, avg=36.96, stdev=36.15 lat (msec): min=5, max=649, avg=36.96, stdev=36.15 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 81], 95.00th=[ 106], | 99.00th=[ 155], 99.50th=[ 182], 99.90th=[ 405], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 96, per=28.69%, avg=24.96, stdev=16.84, samples=465 iops : min= 1, max= 24, avg= 5.58, stdev= 4.24, samples=465 write: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6260KiB/264855msec); 0 zone resets clat (msec): min=41, max=779, avg=133.42, stdev=70.05 lat (msec): min=41, max=779, avg=133.43, stdev=70.05 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 148], 80.00th=[ 180], 90.00th=[ 224], 95.00th=[ 271], | 99.00th=[ 368], 99.50th=[ 435], 99.90th=[ 726], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 56, per=26.04%, avg=23.44, stdev=11.14, samples=513 iops : min= 1, max= 14, avg= 5.21, stdev= 2.84, samples=513 lat (msec) : 10=3.03%, 20=15.36%, 50=20.51%, 100=26.86%, 250=30.63% lat (msec) : 500=3.48%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.20%, ctx=5358, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146096: Sat Sep 5 17:53:03 2026 read: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6052KiB/264218msec) clat (msec): min=5, max=648, avg=36.82, stdev=37.92 lat (msec): min=5, max=648, avg=36.82, stdev=37.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 77], 95.00th=[ 105], | 99.00th=[ 167], 99.50th=[ 220], 99.90th=[ 372], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 95, per=29.40%, avg=25.58, stdev=17.41, samples=457 iops : min= 1, max= 23, avg= 5.75, stdev= 4.39, samples=457 write: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6236KiB/264218msec); 0 zone resets clat (msec): min=35, max=787, avg=133.53, stdev=69.08 lat (msec): min=35, max=787, avg=133.53, stdev=69.08 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 130], | 70.00th=[ 150], 80.00th=[ 178], 90.00th=[ 220], 95.00th=[ 266], | 99.00th=[ 372], 99.50th=[ 426], 99.90th=[ 558], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 55, per=25.93%, avg=23.33, stdev=11.04, samples=514 iops : min= 1, max= 13, avg= 5.18, stdev= 2.81, samples=514 lat (msec) : 10=3.32%, 20=15.36%, 50=21.39%, 100=25.39%, 250=30.92% lat (msec) : 500=3.48%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.24%, ctx=5573, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=87.0KiB/s (89.1kB/s), 21.5KiB/s-22.9KiB/s (21.0kB/s-23.5kB/s), io=22.6MiB (23.7MB), run=236053-265967msec WRITE: bw=90.7KiB/s (92.9kB/s), 22.6KiB/s-23.7KiB/s (23.2kB/s-24.2kB/s), io=23.6MiB (24.7MB), run=236053-265967msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146156: Sat Sep 5 17:53:38 2026 read: IOPS=13, BW=218KiB/s (223kB/s)(5920KiB/27126msec) clat (usec): min=35, max=231049, avg=36043.22, stdev=32919.79 lat (usec): min=35, max=231050, avg=36044.28, stdev=32919.79 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 102], | 30.00th=[ 17957], 40.00th=[ 26084], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 47449], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[217056], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 63, max= 411, per=24.78%, avg=216.81, stdev=89.58, samples=53 iops : min= 3, max= 25, avg=12.83, stdev= 5.67, samples=53 write: IOPS=14, BW=235KiB/s (240kB/s)(6368KiB/27126msec); 0 zone resets clat (usec): min=1464, max=267351, avg=34309.53, stdev=40350.66 lat (usec): min=1464, max=267354, avg=34319.15, stdev=40352.06 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1893], 10.00th=[ 2573], 20.00th=[ 4359], | 30.00th=[ 8455], 40.00th=[ 11731], 50.00th=[ 18744], 60.00th=[ 30016], | 70.00th=[ 45351], 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[110625], | 99.00th=[221250], 99.50th=[261096], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 30, max= 415, per=25.48%, avg=234.38, stdev=101.22, samples=53 iops : min= 1, max= 25, avg=13.92, stdev= 6.43, samples=53 lat (usec) : 50=1.43%, 100=7.81%, 250=1.82%, 500=0.39%, 1000=0.26% lat (msec) : 2=3.39%, 4=5.34%, 10=10.16%, 20=11.33%, 50=31.51% lat (msec) : 100=21.88%, 250=4.43%, 500=0.26% cpu : usr=0.09%, sys=6.45%, ctx=1433, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146157: Sat Sep 5 17:53:38 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(5744KiB/27026msec) clat (usec): min=35, max=305952, avg=36956.37, stdev=35112.92 lat (usec): min=35, max=305953, avg=36962.29, stdev=35112.80 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 102], | 30.00th=[ 20579], 40.00th=[ 24249], 50.00th=[ 31851], 60.00th=[ 38011], | 70.00th=[ 47973], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[166724], 99.50th=[210764], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 63, max= 415, per=24.74%, avg=216.46, stdev=94.63, samples=52 iops : min= 3, max= 25, avg=12.81, stdev= 5.97, samples=52 write: IOPS=15, BW=242KiB/s (248kB/s)(6544KiB/27026msec); 0 zone resets clat (usec): min=1378, max=250321, avg=33461.38, stdev=39756.37 lat (usec): min=1379, max=250323, avg=33467.49, stdev=39754.23 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1844], 10.00th=[ 3032], 20.00th=[ 5145], | 30.00th=[ 7963], 40.00th=[ 11994], 50.00th=[ 19530], 60.00th=[ 28967], | 70.00th=[ 40633], 80.00th=[ 53740], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[233833], 99.50th=[242222], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 63, max= 475, per=26.35%, avg=242.43, stdev=95.58, samples=53 iops : min= 3, max= 29, avg=14.43, stdev= 6.05, samples=53 lat (usec) : 50=1.17%, 100=8.07%, 250=0.91%, 500=0.52%, 750=0.13% lat (msec) : 2=3.65%, 4=5.21%, 10=10.16%, 20=10.68%, 50=34.24% lat (msec) : 100=20.44%, 250=4.56%, 500=0.26% cpu : usr=0.08%, sys=6.80%, ctx=1440, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146158: Sat Sep 5 17:53:38 2026 read: IOPS=14, BW=229KiB/s (234kB/s)(6256KiB/27369msec) clat (usec): min=26, max=288836, avg=40131.71, stdev=36616.69 lat (usec): min=27, max=288837, avg=40144.50, stdev=36604.73 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 11863], | 30.00th=[ 23462], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 52691], 80.00th=[ 61080], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[214959], 99.50th=[274727], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 63, max= 570, per=26.71%, avg=233.68, stdev=83.93, samples=53 iops : min= 3, max= 35, avg=13.89, stdev= 5.32, samples=53 write: IOPS=13, BW=220KiB/s (226kB/s)(6032KiB/27369msec); 0 zone resets clat (usec): min=1273, max=239584, avg=30224.59, stdev=35483.14 lat (usec): min=1276, max=239585, avg=30233.20, stdev=35478.68 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1762], 10.00th=[ 2540], 20.00th=[ 4686], | 30.00th=[ 7701], 40.00th=[ 10945], 50.00th=[ 16712], 60.00th=[ 26084], | 70.00th=[ 34866], 80.00th=[ 50594], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[168821], 99.50th=[229639], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 471, per=23.94%, avg=220.24, stdev=112.42, samples=54 iops : min= 1, max= 29, avg=13.06, stdev= 7.16, samples=54 lat (usec) : 50=1.04%, 100=6.90%, 250=1.56%, 500=0.52% lat (msec) : 2=3.91%, 4=4.43%, 10=10.42%, 20=11.07%, 50=34.24% lat (msec) : 100=21.74%, 250=3.91%, 500=0.26% cpu : usr=0.10%, sys=6.31%, ctx=1493, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146159: Sat Sep 5 17:53:38 2026 read: IOPS=14, BW=224KiB/s (229kB/s)(6032KiB/26916msec) clat (usec): min=32, max=289620, avg=36806.48, stdev=32835.04 lat (usec): min=32, max=289622, avg=36807.57, stdev=32835.03 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 93], | 30.00th=[ 18744], 40.00th=[ 25560], 50.00th=[ 33817], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[128451], 99.50th=[152044], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 476, per=25.63%, avg=224.28, stdev=99.50, samples=53 iops : min= 1, max= 29, avg=13.30, stdev= 6.33, samples=53 write: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26916msec); 0 zone resets clat (usec): min=1276, max=261268, avg=32801.45, stdev=37626.54 lat (usec): min=1278, max=261270, avg=32805.80, stdev=37625.28 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1713], 10.00th=[ 2073], 20.00th=[ 4424], | 30.00th=[ 6980], 40.00th=[ 9634], 50.00th=[ 17957], 60.00th=[ 27657], | 70.00th=[ 43254], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[107480], | 99.00th=[170918], 99.50th=[179307], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 63, max= 471, per=25.33%, avg=233.08, stdev=80.66, samples=53 iops : min= 3, max= 29, avg=13.85, stdev= 5.18, samples=53 lat (usec) : 50=0.91%, 100=9.24%, 250=1.69%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.69%, 4=4.69%, 10=12.11%, 20=9.11%, 50=29.43% lat (msec) : 100=22.79%, 250=4.82%, 500=0.26% cpu : usr=0.09%, sys=6.58%, ctx=1463, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=875KiB/s (896kB/s), 213KiB/s-229KiB/s (218kB/s-234kB/s), io=23.4MiB (24.5MB), run=26916-27369msec WRITE: bw=921KiB/s (943kB/s), 220KiB/s-242KiB/s (226kB/s-248kB/s), io=24.6MiB (25.8MB), run=26916-27369msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146161: Sat Sep 5 17:54:26 2026 read: IOPS=4, BW=79.5KiB/s (81.4kB/s)(5920KiB/74459msec) clat (msec): min=5, max=412, avg=37.10, stdev=38.01 lat (msec): min=5, max=412, avg=37.10, stdev=38.01 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 112], | 99.00th=[ 211], 99.50th=[ 226], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 30, max= 318, per=28.84%, avg=91.42, stdev=55.31, samples=127 iops : min= 1, max= 19, avg= 4.94, stdev= 3.47, samples=127 write: IOPS=5, BW=85.5KiB/s (87.6kB/s)(6368KiB/74459msec); 0 zone resets clat (msec): min=36, max=526, avg=152.09, stdev=71.29 lat (msec): min=36, max=526, avg=152.10, stdev=71.29 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 122], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 171], 80.00th=[ 201], 90.00th=[ 245], 95.00th=[ 288], | 99.00th=[ 409], 99.50th=[ 485], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 27, max= 191, per=25.84%, avg=86.04, stdev=36.71, samples=145 iops : min= 1, max= 11, avg= 4.60, stdev= 2.38, samples=145 lat (msec) : 10=0.91%, 20=15.63%, 50=23.18%, 100=17.19%, 250=38.15% lat (msec) : 500=4.82%, 750=0.13% cpu : usr=0.03%, sys=1.16%, ctx=1381, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146162: Sat Sep 5 17:54:26 2026 read: IOPS=4, BW=76.1KiB/s (77.9kB/s)(5744KiB/75526msec) clat (msec): min=7, max=248, avg=37.32, stdev=34.52 lat (msec): min=7, max=248, avg=37.33, stdev=34.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 116], | 99.00th=[ 180], 99.50th=[ 215], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 27, max= 320, per=28.29%, avg=89.68, stdev=59.58, samples=126 iops : min= 1, max= 20, avg= 4.82, stdev= 3.78, samples=126 write: IOPS=5, BW=86.6KiB/s (88.7kB/s)(6544KiB/75526msec); 0 zone resets clat (msec): min=31, max=525, avg=151.28, stdev=67.85 lat (msec): min=31, max=525, avg=151.28, stdev=67.85 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 68], 10.00th=[ 82], 20.00th=[ 100], | 30.00th=[ 112], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 199], 90.00th=[ 241], 95.00th=[ 300], | 99.00th=[ 359], 99.50th=[ 368], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 27, max= 223, per=26.43%, avg=88.00, stdev=37.61, samples=146 iops : min= 1, max= 13, avg= 4.73, stdev= 2.43, samples=146 lat (msec) : 10=1.82%, 20=14.84%, 50=22.40%, 100=15.89%, 250=40.23% lat (msec) : 500=4.69%, 750=0.13% cpu : usr=0.05%, sys=1.12%, ctx=1322, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146163: Sat Sep 5 17:54:26 2026 read: IOPS=5, BW=88.1KiB/s (90.2kB/s)(6256KiB/71033msec) clat (msec): min=6, max=311, avg=36.33, stdev=36.83 lat (msec): min=6, max=311, avg=36.33, stdev=36.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 70], 95.00th=[ 115], | 99.00th=[ 199], 99.50th=[ 224], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 380, per=30.93%, avg=98.06, stdev=67.26, samples=126 iops : min= 1, max= 23, avg= 5.37, stdev= 4.27, samples=126 write: IOPS=5, BW=84.9KiB/s (86.0kB/s)(6032KiB/71033msec); 0 zone resets clat (msec): min=41, max=459, avg=150.56, stdev=66.34 lat (msec): min=41, max=459, avg=150.56, stdev=66.35 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 73], 10.00th=[ 82], 20.00th=[ 95], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 171], 80.00th=[ 194], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 372], 99.50th=[ 435], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 30, max= 192, per=25.37%, avg=84.48, stdev=34.79, samples=140 iops : min= 1, max= 12, avg= 4.50, stdev= 2.24, samples=140 lat (msec) : 10=2.21%, 20=16.80%, 50=23.96%, 100=16.28%, 250=36.98% lat (msec) : 500=3.78% cpu : usr=0.05%, sys=1.31%, ctx=1399, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146164: Sat Sep 5 17:54:26 2026 read: IOPS=5, BW=81.4KiB/s (83.4kB/s)(6032KiB/74083msec) clat (msec): min=7, max=414, avg=39.22, stdev=39.60 lat (msec): min=7, max=414, avg=39.22, stdev=39.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 78], 95.00th=[ 122], | 99.00th=[ 194], 99.50th=[ 255], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 30, max= 286, per=29.71%, avg=94.18, stdev=60.49, samples=125 iops : min= 1, max= 17, avg= 5.12, stdev= 3.85, samples=125 write: IOPS=5, BW=84.4KiB/s (86.5kB/s)(6256KiB/74083msec); 0 zone resets clat (msec): min=48, max=480, avg=151.00, stdev=60.40 lat (msec): min=48, max=480, avg=151.00, stdev=60.40 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 73], 10.00th=[ 87], 20.00th=[ 104], | 30.00th=[ 116], 40.00th=[ 128], 50.00th=[ 142], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 190], 90.00th=[ 230], 95.00th=[ 268], | 99.00th=[ 330], 99.50th=[ 426], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 31, max= 222, per=25.60%, avg=85.25, stdev=33.48, samples=144 iops : min= 1, max= 13, avg= 4.56, stdev= 2.17, samples=144 lat (msec) : 10=1.43%, 20=12.50%, 50=26.43%, 100=14.45%, 250=41.41% lat (msec) : 500=3.78% cpu : usr=0.04%, sys=1.14%, ctx=1290, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=317KiB/s (325kB/s), 76.1KiB/s-88.1KiB/s (77.9kB/s-90.2kB/s), io=23.4MiB (24.5MB), run=71033-75526msec WRITE: bw=334KiB/s (342kB/s), 84.4KiB/s-86.6KiB/s (86.5kB/s-88.7kB/s), io=24.6MiB (25.8MB), run=71033-75526msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146182: Sat Sep 5 17:54:45 2026 read: IOPS=1, BW=1675KiB/s (1715kB/s)(7168KiB/4279msec) clat (msec): min=7, max=403, avg=291.11, stdev=138.19 lat (msec): min=7, max=403, avg=291.11, stdev=138.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 239], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 326], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 393], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1992, max= 3930, per=66.25%, avg=2925.50, stdev=1062.44, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1197KiB/s (1225kB/s)(5120KiB/4279msec); 0 zone resets clat (msec): min=180, max=582, avg=366.25, stdev=169.70 lat (msec): min=180, max=582, avg=366.32, stdev=169.70 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1984, max= 4087, per=43.61%, avg=2696.67, stdev=1204.19, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 10=8.33%, 250=16.67%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=9.09%, ctx=173, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146183: Sat Sep 5 17:54:45 2026 read: IOPS=0, BW=442KiB/s (452kB/s)(2048KiB/4637msec) clat (msec): min=345, max=524, avg=434.84, stdev=126.48 lat (msec): min=345, max=524, avg=434.84, stdev=126.48 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1965, max= 2019, per=45.11%, avg=1992.00, stdev=38.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2208KiB/s (2261kB/s)(10.0MiB/4637msec); 0 zone resets clat (msec): min=146, max=628, avg=325.48, stdev=132.54 lat (msec): min=146, max=628, avg=325.55, stdev=132.54 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 207], | 30.00th=[ 251], 40.00th=[ 262], 50.00th=[ 288], 60.00th=[ 338], | 70.00th=[ 359], 80.00th=[ 384], 90.00th=[ 393], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1984, max= 3984, per=42.62%, avg=2635.00, stdev=959.89, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=16.67%, 500=66.67%, 750=16.67% cpu : usr=0.00%, sys=11.82%, ctx=139, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146184: Sat Sep 5 17:54:45 2026 read: IOPS=1, BW=1450KiB/s (1485kB/s)(6144KiB/4236msec) clat (usec): min=481, max=752345, avg=229591.46, stdev=312659.98 lat (usec): min=482, max=752346, avg=229592.76, stdev=312660.18 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 2507], | 30.00th=[ 2507], 40.00th=[ 2769], 50.00th=[ 2769], 60.00th=[156238], | 70.00th=[463471], 80.00th=[463471], 90.00th=[750781], 95.00th=[750781], | 99.00th=[750781], 99.50th=[750781], 99.90th=[750781], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 1992, max= 4039, per=73.88%, avg=3262.67, stdev=1109.43, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1450KiB/s (1485kB/s)(6144KiB/4236msec); 0 zone resets clat (msec): min=160, max=1203, avg=410.33, stdev=391.90 lat (msec): min=160, max=1203, avg=410.62, stdev=391.84 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1878, max= 3930, per=39.80%, avg=2460.75, stdev=981.93, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 4=16.67%, 250=25.00%, 500=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.05%, sys=8.97%, ctx=130, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146186: Sat Sep 5 17:54:45 2026 read: IOPS=1, BW=1255KiB/s (1285kB/s)(5120KiB/4079msec) clat (usec): min=539, max=367020, avg=157587.99, stdev=176463.36 lat (usec): min=541, max=367021, avg=157589.08, stdev=176463.41 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 14746], 40.00th=[ 14746], 50.00th=[ 77071], 60.00th=[ 77071], | 70.00th=[329253], 80.00th=[329253], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7515, max= 7515, per=100.00%, avg=7515.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1757KiB/s (1799kB/s)(7168KiB/4079msec); 0 zone resets clat (msec): min=280, max=692, avg=457.27, stdev=149.01 lat (msec): min=280, max=692, avg=457.49, stdev=149.01 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 388], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 600], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1765, max= 2043, per=31.80%, avg=1966.50, stdev=102.68, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 100=8.33%, 500=50.00%, 750=25.00% cpu : usr=0.00%, sys=11.38%, ctx=157, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4417KiB/s (4523kB/s), 442KiB/s-1675KiB/s (452kB/s-1715kB/s), io=20.0MiB (20.0MB), run=4079-4637msec WRITE: bw=6183KiB/s (6332kB/s), 1197KiB/s-2208KiB/s (1225kB/s-2261kB/s), io=28.0MiB (29.4MB), run=4079-4637msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146185: Sat Sep 5 17:54:47 2026 read: IOPS=1, BW=1075KiB/s (1101kB/s)(7168KiB/6669msec) clat (msec): min=213, max=985, avg=579.87, stdev=335.98 lat (msec): min=213, max=985, avg=579.88, stdev=335.98 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 222], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 535], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 927], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1973, max= 2043, per=69.61%, avg=2018.67, stdev=24.74, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=768KiB/s (786kB/s)(5120KiB/6669msec); 0 zone resets clat (msec): min=254, max=943, avg=455.09, stdev=277.20 lat (msec): min=254, max=943, avg=455.18, stdev=277.20 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2011, max= 4079, per=62.47%, avg=2537.00, stdev=1028.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=16.67%, 500=41.67%, 750=8.33%, 1000=33.33% cpu : usr=0.07%, sys=2.46%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146187: Sat Sep 5 17:54:47 2026 read: IOPS=0, BW=298KiB/s (305kB/s)(2048KiB/6873msec) clat (msec): min=107, max=833, avg=470.40, stdev=513.89 lat (msec): min=107, max=833, avg=470.40, stdev=513.90 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2007, max= 2031, per=69.62%, avg=2019.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1490KiB/s (1526kB/s)(10.0MiB/6873msec); 0 zone resets clat (msec): min=243, max=955, avg=554.65, stdev=251.12 lat (msec): min=243, max=956, avg=554.89, stdev=251.14 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 264], | 30.00th=[ 305], 40.00th=[ 397], 50.00th=[ 558], 60.00th=[ 575], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 869], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2011, max= 4071, per=64.21%, avg=2607.57, stdev=997.04, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=25.00%, 750=33.33%, 1000=25.00% cpu : usr=0.00%, sys=1.76%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146188: Sat Sep 5 17:54:47 2026 read: IOPS=0, BW=1009KiB/s (1033kB/s)(6144KiB/6088msec) clat (msec): min=90, max=330, avg=221.03, stdev=97.58 lat (msec): min=90, max=330, avg=221.04, stdev=97.58 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 266], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 4063, max= 4063, per=100.00%, avg=4063.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=1009KiB/s (1033kB/s)(6144KiB/6088msec); 0 zone resets clat (msec): min=172, max=1291, avg=736.18, stdev=509.74 lat (msec): min=172, max=1291, avg=736.30, stdev=509.80 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 1028], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1992, max= 2039, per=49.66%, avg=2016.80, stdev=18.55, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 2000=25.00% cpu : usr=0.00%, sys=2.53%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146189: Sat Sep 5 17:54:47 2026 read: IOPS=0, BW=725KiB/s (743kB/s)(5120KiB/7060msec) clat (msec): min=134, max=326, avg=197.60, stdev=76.34 lat (msec): min=134, max=326, avg=197.60, stdev=76.34 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 2031, max= 6119, per=100.00%, avg=4075.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=1015KiB/s (1040kB/s)(7168KiB/7060msec); 0 zone resets clat (msec): min=326, max=2007, avg=849.05, stdev=601.32 lat (msec): min=326, max=2007, avg=849.19, stdev=601.26 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 334], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 659], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 1267], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 2007, max= 2035, per=49.82%, avg=2023.00, stdev=11.59, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.66%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2901KiB/s (2970kB/s), 298KiB/s-1075KiB/s (305kB/s-1101kB/s), io=20.0MiB (20.0MB), run=6088-7060msec WRITE: bw=4061KiB/s (4159kB/s), 768KiB/s-1490KiB/s (786kB/s-1526kB/s), io=28.0MiB (29.4MB), run=6088-7060msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146202: Sat Sep 5 17:55:01 2026 read: IOPS=1, BW=4961KiB/s (5080kB/s)(12.0MiB/2477msec) clat (msec): min=730, max=981, avg=814.84, stdev=143.99 lat (msec): min=730, max=981, avg=814.85, stdev=143.99 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.22%, ctx=327, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146203: Sat Sep 5 17:55:01 2026 read: IOPS=0, BW=1334KiB/s (1366kB/s)(4096KiB/3070msec) clat (nsec): min=800797k, max=800797k, avg=800797471.00, stdev= 0.00 lat (nsec): min=800799k, max=800799k, avg=800799286.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2668KiB/s (2732kB/s)(8192KiB/3070msec); 0 zone resets clat (msec): min=867, max=1399, avg=1133.80, stdev=376.23 lat (msec): min=868, max=1400, avg=1134.12, stdev=376.25 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8192, max= 8192, per=76.75%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.07%, sys=4.76%, ctx=142, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146204: Sat Sep 5 17:55:01 2026 write: IOPS=1, BW=4180KiB/s (4280kB/s)(12.0MiB/2940msec); 0 zone resets clat (msec): min=304, max=1567, avg=978.58, stdev=635.90 lat (msec): min=304, max=1569, avg=979.56, stdev=636.72 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8126, max= 8126, per=76.14%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.07%, sys=6.60%, ctx=60, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146205: Sat Sep 5 17:55:01 2026 write: IOPS=1, BW=4754KiB/s (4868kB/s)(12.0MiB/2585msec); 0 zone resets clat (msec): min=289, max=1764, avg=856.84, stdev=794.04 lat (msec): min=290, max=1764, avg=857.22, stdev=794.03 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7585, max= 7907, per=72.58%, avg=7746.00, stdev=227.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.07%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5337KiB/s (5465kB/s), 1334KiB/s-4961KiB/s (1366kB/s-5080kB/s), io=16.0MiB (16.8MB), run=2477-3070msec WRITE: bw=10.4MiB/s (10.9MB/s), 2668KiB/s-4754KiB/s (2732kB/s-4868kB/s), io=32.0MiB (33.6MB), run=2585-3070msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146197: Sat Sep 5 17:55:01 2026 read: IOPS=0, BW=3579KiB/s (3665kB/s)(12.0MiB/3433msec) clat (msec): min=798, max=1423, avg=1123.80, stdev=313.34 lat (msec): min=798, max=1423, avg=1123.80, stdev=313.34 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.47%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146198: Sat Sep 5 17:55:01 2026 read: IOPS=0, BW=982KiB/s (1006kB/s)(4096KiB/4169msec) clat (nsec): min=234402k, max=234402k, avg=234402150.00, stdev= 0.00 lat (nsec): min=234405k, max=234405k, avg=234404644.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 6907, max= 6907, per=100.00%, avg=6907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1965KiB/s (2012kB/s)(8192KiB/4169msec); 0 zone resets clat (msec): min=805, max=3102, avg=1954.24, stdev=1624.07 lat (msec): min=806, max=3103, avg=1955.02, stdev=1624.63 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 3104], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=3.33%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146199: Sat Sep 5 17:55:01 2026 write: IOPS=1, BW=6092KiB/s (6238kB/s)(12.0MiB/2017msec); 0 zone resets clat (msec): min=392, max=1085, avg=641.00, stdev=385.55 lat (msec): min=393, max=1085, avg=641.41, stdev=385.56 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 5641, max= 8159, per=87.80%, avg=6900.00, stdev=1780.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.01%, ctx=95, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146200: Sat Sep 5 17:55:01 2026 write: IOPS=1, BW=4798KiB/s (4913kB/s)(12.0MiB/2561msec); 0 zone resets clat (msec): min=421, max=1546, avg=829.90, stdev=622.40 lat (msec): min=422, max=1547, avg=830.65, stdev=623.14 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 5610, max= 8143, per=87.50%, avg=6876.50, stdev=1791.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.12%, sys=4.18%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3930KiB/s (4024kB/s), 982KiB/s-3579KiB/s (1006kB/s-3665kB/s), io=16.0MiB (16.8MB), run=3433-4169msec WRITE: bw=7860KiB/s (8049kB/s), 1965KiB/s-6092KiB/s (2012kB/s-6238kB/s), io=32.0MiB (33.6MB), run=2017-4169msec