== sanity test 398b: DIO and buffer IO race ============== 12:03:53 (1788624233) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.39277 s, 6.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144732: Sat Sep 5 12:06:22 2026 read: IOPS=11, BW=45.9KiB/s (47.0kB/s)(5992KiB/130470msec) clat (usec): min=31, max=292359, avg=40843.58, stdev=33927.53 lat (usec): min=32, max=292360, avg=40844.88, stdev=33927.55 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 16188], | 30.00th=[ 22676], 40.00th=[ 27919], 50.00th=[ 34341], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[154141], 99.50th=[168821], 99.90th=[265290], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 119, per=25.19%, avg=46.10, stdev=19.63, samples=253 iops : min= 1, max= 29, avg=10.86, stdev= 4.94, samples=253 write: IOPS=12, BW=48.3KiB/s (49.4kB/s)(6296KiB/130470msec); 0 zone resets clat (usec): min=609, max=704592, avg=43655.69, stdev=47737.65 lat (usec): min=610, max=704593, avg=43659.74, stdev=47736.15 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1663], 20.00th=[ 4555], | 30.00th=[ 9634], 40.00th=[ 20055], 50.00th=[ 31851], 60.00th=[ 42730], | 70.00th=[ 56361], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[130548], | 99.00th=[200279], 99.50th=[227541], 99.90th=[320865], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 127, per=25.01%, avg=48.02, stdev=20.50, samples=255 iops : min= 1, max= 31, avg=11.35, stdev= 5.16, samples=255 lat (usec) : 50=1.04%, 100=5.40%, 250=0.33%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.29% lat (msec) : 2=5.70%, 4=3.55%, 10=6.64%, 20=9.83%, 50=34.41% lat (msec) : 100=24.84%, 250=7.39%, 500=0.29%, 750=0.03% cpu : usr=0.08%, sys=5.13%, ctx=6187, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144734: Sat Sep 5 12:06:22 2026 read: IOPS=11, BW=46.1KiB/s (47.3kB/s)(5940KiB/128722msec) clat (usec): min=31, max=248731, avg=39667.51, stdev=30852.43 lat (usec): min=32, max=248733, avg=39674.19, stdev=30852.87 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 67], 20.00th=[ 15795], | 30.00th=[ 21890], 40.00th=[ 27919], 50.00th=[ 34341], 60.00th=[ 42206], | 70.00th=[ 51119], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[131597], 99.50th=[147850], 99.90th=[229639], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 117, per=25.23%, avg=46.16, stdev=21.17, samples=251 iops : min= 1, max= 29, avg=10.88, stdev= 5.33, samples=251 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6348KiB/128722msec); 0 zone resets clat (usec): min=928, max=755766, avg=43672.19, stdev=49383.48 lat (usec): min=929, max=755767, avg=43674.17, stdev=49383.69 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1385], 20.00th=[ 3884], | 30.00th=[ 7898], 40.00th=[ 18482], 50.00th=[ 31327], 60.00th=[ 43254], | 70.00th=[ 57410], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[124257], | 99.00th=[202376], 99.50th=[254804], 99.90th=[375391], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 143, per=25.51%, avg=48.98, stdev=20.16, samples=253 iops : min= 1, max= 35, avg=11.59, stdev= 5.07, samples=253 lat (usec) : 50=1.04%, 100=5.34%, 250=0.36%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=7.03%, 4=3.42%, 10=6.90%, 20=8.95%, 50=33.20% lat (msec) : 100=26.11%, 250=7.03%, 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=5.15%, ctx=6148, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144737: Sat Sep 5 12:06:22 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6028KiB/130591msec) clat (usec): min=32, max=391452, avg=38787.02, stdev=32289.63 lat (usec): min=32, max=391453, avg=38792.17, stdev=32286.32 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 15664], | 30.00th=[ 22152], 40.00th=[ 26870], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 48497], 80.00th=[ 59507], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[149947], 99.50th=[181404], 99.90th=[233833], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 119, per=25.31%, avg=46.31, stdev=21.52, samples=253 iops : min= 1, max= 29, avg=10.92, stdev= 5.43, samples=253 write: IOPS=11, BW=47.9KiB/s (49.1kB/s)(6260KiB/130591msec); 0 zone resets clat (usec): min=851, max=913447, avg=45817.37, stdev=50709.54 lat (usec): min=853, max=913450, avg=45822.76, stdev=50707.46 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1434], 20.00th=[ 4080], | 30.00th=[ 9634], 40.00th=[ 22414], 50.00th=[ 34341], 60.00th=[ 47449], | 70.00th=[ 61080], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[139461], | 99.00th=[193987], 99.50th=[238027], 99.90th=[308282], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 111, per=24.85%, avg=47.72, stdev=19.99, samples=255 iops : min= 1, max= 27, avg=11.27, stdev= 5.04, samples=255 lat (usec) : 50=1.37%, 100=4.75%, 250=0.46%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.33% lat (msec) : 2=6.74%, 4=3.29%, 10=5.92%, 20=9.08%, 50=34.93% lat (msec) : 100=24.97%, 250=7.65%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=5.18%, ctx=6181, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144738: Sat Sep 5 12:06:22 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6052KiB/129428msec) clat (usec): min=25, max=219443, avg=38926.28, stdev=30474.92 lat (usec): min=26, max=219444, avg=38937.12, stdev=30476.08 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 67], 20.00th=[ 16319], | 30.00th=[ 22414], 40.00th=[ 28181], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 49021], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[154141], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 111, per=25.70%, avg=47.03, stdev=20.03, samples=251 iops : min= 1, max= 27, avg=11.10, stdev= 5.06, samples=251 write: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6236KiB/129428msec); 0 zone resets clat (usec): min=778, max=851932, avg=44917.31, stdev=51528.61 lat (usec): min=779, max=851935, avg=44919.74, stdev=51528.56 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1188], 10.00th=[ 1467], 20.00th=[ 3687], | 30.00th=[ 7308], 40.00th=[ 16188], 50.00th=[ 30802], 60.00th=[ 45351], | 70.00th=[ 61080], 80.00th=[ 79168], 90.00th=[107480], 95.00th=[137364], | 99.00th=[204473], 99.50th=[225444], 99.90th=[404751], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 168, per=24.98%, avg=47.97, stdev=21.85, samples=253 iops : min= 1, max= 42, avg=11.34, stdev= 5.53, samples=253 lat (usec) : 50=1.24%, 100=5.27%, 250=0.33%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.49% lat (msec) : 2=6.54%, 4=4.13%, 10=6.38%, 20=9.51%, 50=32.91% lat (msec) : 100=24.48%, 250=8.43%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.02%, ctx=6107, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=184KiB/s (188kB/s), 45.9KiB/s-46.8KiB/s (47.0kB/s-47.9kB/s), io=23.4MiB (24.6MB), run=128722-130591msec WRITE: bw=193KiB/s (197kB/s), 47.9KiB/s-49.3KiB/s (49.1kB/s-50.5kB/s), io=24.6MiB (25.7MB), run=128722-130591msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144731: Sat Sep 5 12:08:50 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(5992KiB/277213msec) clat (msec): min=4, max=640, avg=34.12, stdev=41.37 lat (msec): min=4, max=640, avg=34.12, stdev=41.37 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 74], 95.00th=[ 110], | 99.00th=[ 203], 99.50th=[ 236], 99.90th=[ 493], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 103, per=29.39%, avg=25.28, stdev=17.96, samples=458 iops : min= 1, max= 25, avg= 5.72, stdev= 4.55, samples=458 write: IOPS=5, BW=22.7KiB/s (23.3kB/s)(6296KiB/277213msec); 0 zone resets clat (msec): min=39, max=591, avg=143.38, stdev=80.30 lat (msec): min=39, max=591, avg=143.38, stdev=80.30 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 194], 90.00th=[ 257], 95.00th=[ 309], | 99.00th=[ 443], 99.50th=[ 493], 99.90th=[ 567], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 55, per=25.06%, avg=22.55, stdev=11.54, samples=537 iops : min= 1, max= 13, avg= 5.03, stdev= 2.97, samples=537 lat (msec) : 10=4.49%, 20=18.78%, 50=18.07%, 100=22.40%, 250=30.50% lat (msec) : 500=5.57%, 750=0.20% cpu : usr=0.05%, sys=1.05%, ctx=5200, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144733: Sat Sep 5 12:08:50 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(5940KiB/278210msec) clat (msec): min=5, max=774, avg=34.20, stdev=44.86 lat (msec): min=5, max=774, avg=34.20, stdev=44.86 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 73], 95.00th=[ 107], | 99.00th=[ 201], 99.50th=[ 271], 99.90th=[ 542], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 95, per=29.31%, avg=25.21, stdev=17.83, samples=455 iops : min= 1, max= 23, avg= 5.69, stdev= 4.53, samples=455 write: IOPS=5, BW=22.8KiB/s (23.4kB/s)(6348KiB/278210msec); 0 zone resets clat (msec): min=31, max=652, avg=143.06, stdev=80.29 lat (msec): min=31, max=652, avg=143.06, stdev=80.29 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 82], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 197], 90.00th=[ 255], 95.00th=[ 309], | 99.00th=[ 426], 99.50th=[ 460], 99.90th=[ 592], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 63, per=25.12%, avg=22.61, stdev=11.53, samples=540 iops : min= 1, max= 15, avg= 5.03, stdev= 2.96, samples=540 lat (msec) : 10=5.76%, 20=17.64%, 50=17.42%, 100=22.62%, 250=30.47% lat (msec) : 500=5.86%, 750=0.20%, 1000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5124, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144735: Sat Sep 5 12:08:50 2026 read: IOPS=5, BW=21.7KiB/s (22.3kB/s)(6028KiB/277324msec) clat (msec): min=5, max=490, avg=34.74, stdev=38.70 lat (msec): min=5, max=490, avg=34.74, stdev=38.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 82], 95.00th=[ 104], | 99.00th=[ 178], 99.50th=[ 232], 99.90th=[ 397], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 104, per=27.99%, avg=24.07, stdev=17.25, samples=483 iops : min= 1, max= 26, avg= 5.41, stdev= 4.37, samples=483 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6260KiB/277324msec); 0 zone resets clat (msec): min=34, max=885, avg=143.50, stdev=82.66 lat (msec): min=34, max=885, avg=143.50, stdev=82.66 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 188], 90.00th=[ 253], 95.00th=[ 309], | 99.00th=[ 439], 99.50th=[ 493], 99.90th=[ 600], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 55, per=24.99%, avg=22.49, stdev=11.61, samples=535 iops : min= 1, max= 13, avg= 5.00, stdev= 2.99, samples=535 lat (msec) : 10=4.92%, 20=18.49%, 50=17.22%, 100=23.08%, 250=30.73% lat (msec) : 500=5.37%, 750=0.16%, 1000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5049, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144736: Sat Sep 5 12:08:50 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6052KiB/277828msec) clat (msec): min=5, max=540, avg=35.08, stdev=41.79 lat (msec): min=5, max=540, avg=35.08, stdev=41.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 79], 95.00th=[ 115], | 99.00th=[ 207], 99.50th=[ 245], 99.90th=[ 426], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 96, per=29.04%, avg=24.97, stdev=17.39, samples=469 iops : min= 1, max= 24, avg= 5.64, stdev= 4.42, samples=469 write: IOPS=5, BW=22.4KiB/s (22.0kB/s)(6236KiB/277828msec); 0 zone resets clat (msec): min=32, max=884, avg=143.92, stdev=81.60 lat (msec): min=32, max=884, avg=143.92, stdev=81.60 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 190], 90.00th=[ 253], 95.00th=[ 317], | 99.00th=[ 426], 99.50th=[ 514], 99.90th=[ 567], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 56, per=24.87%, avg=22.38, stdev=11.37, samples=537 iops : min= 1, max= 14, avg= 4.99, stdev= 2.93, samples=537 lat (msec) : 10=4.82%, 20=18.88%, 50=17.35%, 100=22.07%, 250=31.45% lat (msec) : 500=5.14%, 750=0.26%, 1000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5149, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.3KiB/s (88.4kB/s), 21.4KiB/s-21.8KiB/s (21.9kB/s-22.3kB/s), io=23.4MiB (24.6MB), run=277213-278210msec WRITE: bw=90.4KiB/s (92.5kB/s), 22.4KiB/s-22.8KiB/s (22.0kB/s-23.4kB/s), io=24.6MiB (25.7MB), run=277213-278210msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144795: Sat Sep 5 12:09:31 2026 read: IOPS=11, BW=191KiB/s (195kB/s)(5920KiB/31021msec) clat (usec): min=29, max=441608, avg=39373.93, stdev=42854.78 lat (usec): min=30, max=441609, avg=39376.55, stdev=42854.49 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 65], | 30.00th=[ 1516], 40.00th=[ 24249], 50.00th=[ 34341], 60.00th=[ 42206], | 70.00th=[ 51643], 80.00th=[ 64226], 90.00th=[ 91751], 95.00th=[106431], | 99.00th=[187696], 99.50th=[291505], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 31, max= 474, per=25.00%, avg=192.98, stdev=89.56, samples=59 iops : min= 1, max= 29, avg=11.34, stdev= 5.68, samples=59 write: IOPS=12, BW=205KiB/s (210kB/s)(6368KiB/31021msec); 0 zone resets clat (usec): min=1322, max=378583, avg=40509.15, stdev=50026.45 lat (usec): min=1323, max=378585, avg=40511.64, stdev=50026.08 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1614], 10.00th=[ 1762], 20.00th=[ 5145], | 30.00th=[ 9896], 40.00th=[ 15270], 50.00th=[ 22414], 60.00th=[ 33162], | 70.00th=[ 46924], 80.00th=[ 69731], 90.00th=[101188], 95.00th=[128451], | 99.00th=[278922], 99.50th=[358613], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 21, max= 537, per=25.41%, avg=206.35, stdev=99.38, samples=60 iops : min= 1, max= 33, avg=12.18, stdev= 6.26, samples=60 lat (usec) : 50=2.47%, 100=10.94%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=6.38%, 4=2.73%, 10=7.03%, 20=9.90%, 50=29.43% lat (msec) : 100=22.01%, 250=7.42%, 500=0.91% cpu : usr=0.04%, sys=5.36%, ctx=1324, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144797: Sat Sep 5 12:09:31 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(5744KiB/30275msec) clat (usec): min=33, max=366455, avg=40968.60, stdev=40922.61 lat (usec): min=33, max=366456, avg=40969.74, stdev=40922.64 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 51], 10.00th=[ 59], 20.00th=[ 74], | 30.00th=[ 19530], 40.00th=[ 29754], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 52167], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[202376], 99.50th=[254804], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 30, max= 414, per=24.60%, avg=189.88, stdev=90.41, samples=59 iops : min= 1, max= 25, avg=11.08, stdev= 5.70, samples=59 write: IOPS=13, BW=216KiB/s (221kB/s)(6544KiB/30275msec); 0 zone resets clat (usec): min=1105, max=231043, avg=37242.21, stdev=41116.18 lat (usec): min=1107, max=231044, avg=37252.59, stdev=41118.42 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1663], 10.00th=[ 2343], 20.00th=[ 5211], | 30.00th=[ 8356], 40.00th=[ 13173], 50.00th=[ 22414], 60.00th=[ 31589], | 70.00th=[ 45876], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[124257], | 99.00th=[179307], 99.50th=[208667], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 443, per=26.74%, avg=217.15, stdev=108.40, samples=59 iops : min= 1, max= 27, avg=12.81, stdev= 6.82, samples=59 lat (usec) : 50=2.21%, 100=9.24%, 250=0.52%, 500=0.13% lat (msec) : 2=4.95%, 4=4.17%, 10=9.64%, 20=8.72%, 50=29.82% lat (msec) : 100=23.44%, 250=6.90%, 500=0.26% cpu : usr=0.08%, sys=5.33%, ctx=1368, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144798: Sat Sep 5 12:09:31 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(6256KiB/30122msec) clat (usec): min=37, max=264027, avg=40370.09, stdev=37964.14 lat (usec): min=37, max=264028, avg=40378.24, stdev=37965.68 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 58], 20.00th=[ 71], | 30.00th=[ 17957], 40.00th=[ 27919], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[158335], 99.50th=[231736], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 63, max= 442, per=27.49%, avg=212.21, stdev=89.88, samples=58 iops : min= 3, max= 27, avg=12.48, stdev= 5.65, samples=58 write: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30122msec); 0 zone resets clat (usec): min=1330, max=249918, avg=37048.65, stdev=41866.56 lat (usec): min=1332, max=249921, avg=37051.33, stdev=41866.50 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1663], 10.00th=[ 1942], 20.00th=[ 4555], | 30.00th=[ 7439], 40.00th=[ 11338], 50.00th=[ 18482], 60.00th=[ 32637], | 70.00th=[ 46924], 80.00th=[ 66847], 90.00th=[101188], 95.00th=[116917], | 99.00th=[177210], 99.50th=[196084], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 62, max= 474, per=24.47%, avg=198.66, stdev=79.71, samples=59 iops : min= 3, max= 29, avg=11.64, stdev= 5.05, samples=59 lat (usec) : 50=1.43%, 100=10.55%, 250=1.43%, 500=0.13%, 750=0.13% lat (msec) : 2=5.08%, 4=4.43%, 10=8.59%, 20=9.77%, 50=27.73% lat (msec) : 100=22.92%, 250=7.68%, 500=0.13% cpu : usr=0.10%, sys=5.48%, ctx=1342, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144799: Sat Sep 5 12:09:31 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(6032KiB/27521msec) clat (usec): min=33, max=173109, avg=37576.99, stdev=33833.90 lat (usec): min=33, max=173111, avg=37578.49, stdev=33834.32 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 83], | 30.00th=[ 16909], 40.00th=[ 27132], 50.00th=[ 34341], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[147850], 99.50th=[160433], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 32, max= 570, per=28.66%, avg=221.26, stdev=85.52, samples=53 iops : min= 2, max= 35, avg=13.09, stdev= 5.38, samples=53 write: IOPS=14, BW=227KiB/s (233kB/s)(6256KiB/27521msec); 0 zone resets clat (usec): min=1303, max=342724, avg=33902.00, stdev=41002.39 lat (usec): min=1304, max=342726, avg=33904.57, stdev=41002.30 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1663], 10.00th=[ 1876], 20.00th=[ 3523], | 30.00th=[ 6128], 40.00th=[ 10421], 50.00th=[ 17171], 60.00th=[ 27919], | 70.00th=[ 42730], 80.00th=[ 61604], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[175113], 99.50th=[244319], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 89, max= 448, per=27.99%, avg=227.31, stdev=79.51, samples=54 iops : min= 5, max= 28, avg=13.46, stdev= 5.05, samples=54 lat (usec) : 50=1.69%, 100=9.51%, 250=1.30%, 500=0.39% lat (msec) : 2=5.86%, 4=5.47%, 10=9.77%, 20=9.11%, 50=28.65% lat (msec) : 100=22.01%, 250=6.12%, 500=0.13% cpu : usr=0.05%, sys=5.92%, ctx=1296, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=772KiB/s (791kB/s), 190KiB/s-219KiB/s (194kB/s-224kB/s), io=23.4MiB (24.5MB), run=27521-31021msec WRITE: bw=812KiB/s (832kB/s), 200KiB/s-227KiB/s (205kB/s-233kB/s), io=24.6MiB (25.8MB), run=27521-31021msec fio: pid=144796, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144796: Sat Sep 5 12:10:24 2026 read: IOPS=4, BW=64.2KiB/s (65.8kB/s)(5088KiB/79201msec) clat (msec): min=8, max=269, avg=45.73, stdev=37.13 lat (msec): min=8, max=269, avg=45.73, stdev=37.13 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 93], 95.00th=[ 128], | 99.00th=[ 190], 99.50th=[ 228], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 254, per=28.28%, avg=77.49, stdev=45.01, samples=129 iops : min= 1, max= 15, avg= 4.05, stdev= 2.86, samples=129 write: IOPS=4, BW=70.3KiB/s (71.0kB/s)(5568KiB/79201msec); 0 zone resets clat (msec): min=38, max=744, avg=184.83, stdev=90.69 lat (msec): min=38, max=744, avg=184.83, stdev=90.69 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 85], 10.00th=[ 101], 20.00th=[ 120], | 30.00th=[ 133], 40.00th=[ 150], 50.00th=[ 165], 60.00th=[ 182], | 70.00th=[ 203], 80.00th=[ 245], 90.00th=[ 300], 95.00th=[ 351], | 99.00th=[ 542], 99.50th=[ 584], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 30, max= 159, per=24.22%, avg=69.99, stdev=30.36, samples=155 iops : min= 1, max= 9, avg= 3.59, stdev= 2.00, samples=155 lat (msec) : 10=0.45%, 20=8.10%, 50=26.24%, 100=13.79%, 250=41.98% lat (msec) : 500=8.40%, 750=0.90% cpu : usr=0.04%, sys=1.09%, ctx=1080, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=319,348,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144800: Sat Sep 5 12:10:24 2026 read: IOPS=4, BW=68.2KiB/s (69.8kB/s)(5744KiB/84206msec) clat (msec): min=4, max=295, avg=42.99, stdev=39.41 lat (msec): min=4, max=295, avg=43.00, stdev=39.41 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 93], 95.00th=[ 128], | 99.00th=[ 188], 99.50th=[ 247], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 316, per=31.29%, avg=85.75, stdev=60.27, samples=130 iops : min= 1, max= 19, avg= 4.61, stdev= 3.82, samples=130 write: IOPS=4, BW=77.7KiB/s (79.6kB/s)(6544KiB/84206msec); 0 zone resets clat (msec): min=26, max=538, avg=167.23, stdev=82.45 lat (msec): min=26, max=538, avg=167.23, stdev=82.45 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 60], 10.00th=[ 80], 20.00th=[ 101], | 30.00th=[ 120], 40.00th=[ 136], 50.00th=[ 153], 60.00th=[ 178], | 70.00th=[ 199], 80.00th=[ 222], 90.00th=[ 271], 95.00th=[ 321], | 99.00th=[ 460], 99.50th=[ 493], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 223, per=27.09%, avg=78.30, stdev=39.08, samples=162 iops : min= 1, max= 13, avg= 4.12, stdev= 2.52, samples=162 lat (msec) : 10=2.21%, 20=12.24%, 50=21.48%, 100=17.32%, 250=39.32% lat (msec) : 500=7.16%, 750=0.26% cpu : usr=0.05%, sys=1.07%, ctx=1304, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144801: Sat Sep 5 12:10:24 2026 read: IOPS=4, BW=76.4KiB/s (78.2kB/s)(6256KiB/81895msec) clat (msec): min=5, max=226, avg=40.39, stdev=30.84 lat (msec): min=5, max=226, avg=40.39, stdev=30.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 107], | 99.00th=[ 165], 99.50th=[ 186], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 30, max= 254, per=32.19%, avg=88.19, stdev=57.84, samples=140 iops : min= 1, max= 15, avg= 4.76, stdev= 3.68, samples=140 write: IOPS=4, BW=73.7KiB/s (75.4kB/s)(6032KiB/81895msec); 0 zone resets clat (msec): min=42, max=551, avg=174.30, stdev=82.66 lat (msec): min=42, max=551, avg=174.31, stdev=82.66 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 108], | 30.00th=[ 126], 40.00th=[ 142], 50.00th=[ 163], 60.00th=[ 180], | 70.00th=[ 203], 80.00th=[ 226], 90.00th=[ 279], 95.00th=[ 347], | 99.00th=[ 430], 99.50th=[ 489], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 30, max= 224, per=25.98%, avg=75.08, stdev=33.79, samples=158 iops : min= 1, max= 14, avg= 3.92, stdev= 2.21, samples=158 lat (msec) : 10=1.69%, 20=9.64%, 50=28.65%, 100=16.80%, 250=36.20% lat (msec) : 500=6.90%, 750=0.13% cpu : usr=0.03%, sys=1.07%, ctx=1353, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144802: Sat Sep 5 12:10:24 2026 read: IOPS=4, BW=73.7KiB/s (75.5kB/s)(6032KiB/81823msec) clat (msec): min=7, max=231, avg=42.41, stdev=38.17 lat (msec): min=7, max=231, avg=42.41, stdev=38.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 41], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 128], | 99.00th=[ 207], 99.50th=[ 220], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 30, max= 288, per=32.64%, avg=89.45, stdev=51.46, samples=132 iops : min= 1, max= 18, avg= 4.84, stdev= 3.27, samples=132 write: IOPS=4, BW=76.5KiB/s (78.3kB/s)(6256KiB/81823msec); 0 zone resets clat (msec): min=39, max=678, avg=167.98, stdev=76.23 lat (msec): min=39, max=678, avg=167.99, stdev=76.23 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 74], 10.00th=[ 92], 20.00th=[ 112], | 30.00th=[ 123], 40.00th=[ 138], 50.00th=[ 155], 60.00th=[ 171], | 70.00th=[ 190], 80.00th=[ 215], 90.00th=[ 266], 95.00th=[ 305], | 99.00th=[ 447], 99.50th=[ 502], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 30, max= 224, per=27.01%, avg=78.06, stdev=32.35, samples=158 iops : min= 1, max= 14, avg= 4.11, stdev= 2.12, samples=158 lat (msec) : 10=0.78%, 20=12.37%, 50=25.00%, 100=14.19%, 250=41.15% lat (msec) : 500=6.25%, 750=0.26% cpu : usr=0.04%, sys=1.08%, ctx=1304, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=275KiB/s (281kB/s), 64.2KiB/s-76.4KiB/s (65.8kB/s-78.2kB/s), io=22.6MiB (23.7MB), run=79201-84206msec WRITE: bw=290KiB/s (297kB/s), 70.3KiB/s-77.7KiB/s (71.0kB/s-79.6kB/s), io=23.8MiB (24.0MB), run=79201-84206msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144821: Sat Sep 5 12:10:40 2026 read: IOPS=1, BW=1731KiB/s (1772kB/s)(7168KiB/4142msec) clat (msec): min=2, max=365, avg=197.35, stdev=117.32 lat (msec): min=2, max=365, avg=197.35, stdev=117.32 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 157], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 188], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 313], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1976, max= 3716, per=54.75%, avg=2421.00, stdev=863.38, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1236KiB/s (1266kB/s)(5120KiB/4142msec); 0 zone resets clat (msec): min=178, max=904, avg=534.28, stdev=270.78 lat (msec): min=178, max=904, avg=534.37, stdev=270.78 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1996, max= 4055, per=43.47%, avg=2691.33, stdev=1181.05, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=9.22%, ctx=225, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144822: Sat Sep 5 12:10:40 2026 read: IOPS=0, BW=442KiB/s (453kB/s)(2048KiB/4631msec) clat (msec): min=257, max=273, avg=265.63, stdev=10.86 lat (msec): min=257, max=273, avg=265.63, stdev=10.86 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1469, max= 2011, per=39.35%, avg=1740.00, stdev=383.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2211KiB/s (2264kB/s)(10.0MiB/4631msec); 0 zone resets clat (msec): min=128, max=1107, avg=399.51, stdev=293.08 lat (msec): min=129, max=1108, avg=399.70, stdev=293.37 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 136], | 30.00th=[ 220], 40.00th=[ 226], 50.00th=[ 255], 60.00th=[ 393], | 70.00th=[ 464], 80.00th=[ 481], 90.00th=[ 592], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1946, max= 5657, per=50.63%, avg=3134.60, stdev=1665.76, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.12%, ctx=138, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144824: Sat Sep 5 12:10:40 2026 read: IOPS=1, BW=1588KiB/s (1626kB/s)(6144KiB/3870msec) clat (usec): min=632, max=278785, avg=136066.55, stdev=127040.77 lat (usec): min=634, max=278786, avg=136067.78, stdev=127040.72 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 6718], | 30.00th=[ 6718], 40.00th=[ 71828], 50.00th=[ 71828], 60.00th=[185598], | 70.00th=[274727], 80.00th=[274727], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1992, max= 4000, per=56.77%, avg=2510.50, stdev=993.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1588KiB/s (1626kB/s)(6144KiB/3870msec); 0 zone resets clat (msec): min=102, max=806, avg=461.19, stdev=288.33 lat (msec): min=102, max=807, avg=461.29, stdev=288.35 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 451], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1946, max= 3984, per=40.14%, avg=2485.25, stdev=999.57, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 100=8.33%, 250=16.67%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=9.18%, ctx=173, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144825: Sat Sep 5 12:10:40 2026 read: IOPS=1, BW=1203KiB/s (1232kB/s)(5120KiB/4256msec) clat (usec): min=469, max=312913, avg=191245.29, stdev=127823.30 lat (usec): min=471, max=312914, avg=191246.38, stdev=127823.14 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 469], | 30.00th=[147850], 40.00th=[147850], 50.00th=[193987], 60.00th=[193987], | 70.00th=[304088], 80.00th=[304088], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2023, max= 6083, per=91.66%, avg=4053.00, stdev=2870.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1684KiB/s (1725kB/s)(7168KiB/4256msec); 0 zone resets clat (msec): min=106, max=930, avg=433.07, stdev=333.05 lat (msec): min=106, max=930, avg=433.15, stdev=333.06 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 114], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 255], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 709], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1976, max= 5626, per=43.99%, avg=2723.40, stdev=1622.69, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=10.27%, ctx=133, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4422KiB/s (4529kB/s), 442KiB/s-1731KiB/s (453kB/s-1772kB/s), io=20.0MiB (20.0MB), run=3870-4631msec WRITE: bw=6191KiB/s (6340kB/s), 1236KiB/s-2211KiB/s (1266kB/s-2264kB/s), io=28.0MiB (29.4MB), run=3870-4631msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144823: Sat Sep 5 12:10:40 2026 read: IOPS=2, BW=2164KiB/s (2216kB/s)(7168KiB/3312msec) clat (msec): min=86, max=459, avg=222.92, stdev=129.01 lat (msec): min=86, max=459, avg=222.92, stdev=129.01 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 142], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 188], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 334], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2035, max= 6059, per=75.66%, avg=3044.00, stdev=2010.00, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1546KiB/s (1583kB/s)(5120KiB/3312msec); 0 zone resets clat (msec): min=241, max=454, avg=341.08, stdev=89.23 lat (msec): min=241, max=454, avg=341.17, stdev=89.22 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1914, max= 4000, per=47.04%, avg=2649.67, stdev=1170.99, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=3.59%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144826: Sat Sep 5 12:10:40 2026 read: IOPS=0, BW=402KiB/s (412kB/s)(2048KiB/5090msec) clat (msec): min=180, max=225, avg=202.77, stdev=32.11 lat (msec): min=180, max=225, avg=202.78, stdev=32.11 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 1406, max= 2043, per=42.87%, avg=1724.50, stdev=450.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2012KiB/s (2060kB/s)(10.0MiB/5090msec); 0 zone resets clat (msec): min=83, max=1241, avg=439.57, stdev=342.27 lat (msec): min=83, max=1241, avg=439.94, stdev=342.24 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 132], | 30.00th=[ 153], 40.00th=[ 342], 50.00th=[ 372], 60.00th=[ 376], | 70.00th=[ 414], 80.00th=[ 592], 90.00th=[ 693], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1917, max= 5919, per=56.71%, avg=3194.20, stdev=1776.93, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.95, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=4.34%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144827: Sat Sep 5 12:10:40 2026 read: IOPS=1, BW=1304KiB/s (1335kB/s)(6144KiB/4713msec) clat (msec): min=82, max=432, avg=202.25, stdev=133.43 lat (msec): min=82, max=432, avg=202.25, stdev=133.43 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 188], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1996, max= 3953, per=66.26%, avg=2665.67, stdev=1115.17, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1304KiB/s (1335kB/s)(6144KiB/4713msec); 0 zone resets clat (msec): min=196, max=919, avg=545.21, stdev=277.22 lat (msec): min=196, max=919, avg=545.30, stdev=277.22 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 535], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1917, max= 2048, per=35.42%, avg=1995.00, stdev=51.04, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=3.40%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144828: Sat Sep 5 12:10:40 2026 read: IOPS=1, BW=1055KiB/s (1081kB/s)(5120KiB/4851msec) clat (msec): min=51, max=965, avg=331.60, stdev=363.74 lat (msec): min=51, max=965, avg=331.60, stdev=363.74 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 53], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 3953, max= 3992, per=98.74%, avg=3972.50, stdev=27.58, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1478KiB/s (1513kB/s)(7168KiB/4851msec); 0 zone resets clat (msec): min=225, max=754, avg=421.95, stdev=195.70 lat (msec): min=225, max=754, avg=422.05, stdev=195.70 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 236], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 414], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 558], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1424, max= 3946, per=39.56%, avg=2228.17, stdev=873.65, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=3.07%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4024KiB/s (4120kB/s), 402KiB/s-2164KiB/s (412kB/s-2216kB/s), io=20.0MiB (20.0MB), run=3312-5090msec WRITE: bw=5633KiB/s (5768kB/s), 1304KiB/s-2012KiB/s (1335kB/s-2060kB/s), io=28.0MiB (29.4MB), run=3312-5090msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144834: Sat Sep 5 12:10:56 2026 read: IOPS=0, BW=2328KiB/s (2384kB/s)(12.0MiB/5279msec) clat (msec): min=759, max=3579, avg=1749.95, stdev=1586.17 lat (msec): min=759, max=3579, avg=1749.95, stdev=1586.17 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8015, max= 8143, per=100.00%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.50%, ctx=622, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144835: Sat Sep 5 12:10:56 2026 read: IOPS=0, BW=770KiB/s (788kB/s)(4096KiB/5322msec) clat (nsec): min=3591.6M, max=3591.6M, avg=3591611268.00, stdev= 0.00 lat (nsec): min=3591.6M, max=3591.6M, avg=3591613069.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3608], 5.00th=[ 3608], 10.00th=[ 3608], 20.00th=[ 3608], | 30.00th=[ 3608], 40.00th=[ 3608], 50.00th=[ 3608], 60.00th=[ 3608], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1539KiB/s (1576kB/s)(8192KiB/5322msec); 0 zone resets clat (msec): min=449, max=1274, avg=862.08, stdev=583.54 lat (msec): min=449, max=1275, avg=862.43, stdev=583.58 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.93%, ctx=486, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144836: Sat Sep 5 12:10:56 2026 write: IOPS=0, BW=2111KiB/s (2162kB/s)(12.0MiB/5821msec); 0 zone resets clat (msec): min=566, max=4034, avg=1938.84, stdev=1844.02 lat (msec): min=567, max=4036, avg=1939.78, stdev=1844.70 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 7907, max= 8143, per=100.00%, avg=8025.00, stdev=166.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.87%, ctx=86, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Sat Sep 5 12:10:56 2026 write: IOPS=0, BW=2299KiB/s (2354kB/s)(12.0MiB/5345msec); 0 zone resets clat (msec): min=388, max=4258, avg=1736.23, stdev=2186.31 lat (msec): min=388, max=4259, avg=1736.55, stdev=2186.31 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 4245], 80.00th=[ 4245], 90.00th=[ 4245], 95.00th=[ 4245], | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], | 99.99th=[ 4245] bw ( KiB/s): min= 7846, max= 8192, per=100.00%, avg=8019.00, stdev=244.66, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.96%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3079KiB/s (3152kB/s), 770KiB/s-2328KiB/s (788kB/s-2384kB/s), io=16.0MiB (16.8MB), run=5279-5322msec WRITE: bw=5629KiB/s (5764kB/s), 1539KiB/s-2299KiB/s (1576kB/s-2354kB/s), io=32.0MiB (33.6MB), run=5322-5821msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Sat Sep 5 12:10:57 2026 read: IOPS=0, BW=2060KiB/s (2110kB/s)(12.0MiB/5964msec) clat (msec): min=463, max=4090, avg=1977.70, stdev=1886.33 lat (msec): min=463, max=4090, avg=1977.71, stdev=1886.33 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 7787, max= 8078, per=100.00%, avg=7932.50, stdev=205.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.69%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Sat Sep 5 12:10:57 2026 read: IOPS=0, BW=699KiB/s (716kB/s)(4096KiB/5858msec) clat (nsec): min=4386.7M, max=4386.7M, avg=4386701717.00, stdev= 0.00 lat (nsec): min=4386.7M, max=4386.7M, avg=4386702600.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4396], 5.00th=[ 4396], 10.00th=[ 4396], 20.00th=[ 4396], | 30.00th=[ 4396], 40.00th=[ 4396], 50.00th=[ 4396], 60.00th=[ 4396], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1398KiB/s (1432kB/s)(8192KiB/5858msec); 0 zone resets clat (msec): min=594, max=861, avg=728.23, stdev=188.93 lat (msec): min=594, max=863, avg=728.96, stdev=189.69 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.74%, ctx=40, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144841: Sat Sep 5 12:10:57 2026 write: IOPS=0, BW=2185KiB/s (2237kB/s)(12.0MiB/5624msec); 0 zone resets clat (msec): min=528, max=3883, avg=1857.03, stdev=1783.14 lat (msec): min=528, max=3884, avg=1857.45, stdev=1783.22 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 7787, max= 8094, per=100.00%, avg=7940.50, stdev=217.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.67%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144842: Sat Sep 5 12:10:57 2026 write: IOPS=0, BW=2423KiB/s (2481kB/s)(12.0MiB/5072msec); 0 zone resets clat (msec): min=251, max=4389, avg=1664.42, stdev=2360.50 lat (msec): min=252, max=4390, avg=1664.92, stdev=2360.73 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 6291, max= 8143, per=100.00%, avg=7217.00, stdev=1309.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.12%, sys=1.58%, ctx=39, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2747KiB/s (2813kB/s), 699KiB/s-2060KiB/s (716kB/s-2110kB/s), io=16.0MiB (16.8MB), run=5858-5964msec WRITE: bw=5594KiB/s (5728kB/s), 1398KiB/s-2423KiB/s (1432kB/s-2481kB/s), io=32.0MiB (33.6MB), run=5072-5858msec