== sanity test 398b: DIO and buffer IO race ============== 23:52:01 (1788753121) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.06827 s, 16.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181044: Sun Sep 6 23:53:06 2026 read: IOPS=28, BW=112KiB/s (115kB/s)(5992KiB/53427msec) clat (usec): min=47, max=684603, avg=19446.83, stdev=19957.54 lat (usec): min=47, max=684606, avg=19447.71, stdev=19957.61 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 7373], 10.00th=[ 8979], 20.00th=[ 10814], | 30.00th=[ 12649], 40.00th=[ 14746], 50.00th=[ 17433], 60.00th=[ 19792], | 70.00th=[ 22676], 80.00th=[ 26346], 90.00th=[ 31589], 95.00th=[ 36963], | 99.00th=[ 56361], 99.50th=[ 65274], 99.90th=[ 68682], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 64, max= 183, per=25.79%, avg=112.98, stdev=23.10, samples=105 iops : min= 16, max= 45, avg=27.87, stdev= 5.78, samples=105 write: IOPS=29, BW=118KiB/s (121kB/s)(6296KiB/53427msec); 0 zone resets clat (usec): min=772, max=76179, avg=15340.40, stdev=12480.16 lat (usec): min=772, max=76181, avg=15344.58, stdev=12480.12 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1909], 10.00th=[ 2606], 20.00th=[ 3687], | 30.00th=[ 6259], 40.00th=[10028], 50.00th=[12518], 60.00th=[15401], | 70.00th=[19530], 80.00th=[24773], 90.00th=[32637], 95.00th=[39584], | 99.00th=[54264], 99.50th=[64226], 99.90th=[66847], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 32, max= 215, per=25.92%, avg=118.73, stdev=32.27, samples=105 iops : min= 8, max= 53, avg=29.31, stdev= 8.04, samples=105 lat (usec) : 50=0.07%, 100=0.42%, 250=0.59%, 500=0.07%, 1000=0.39% lat (msec) : 2=2.44%, 4=8.33%, 10=15.46%, 20=38.18%, 50=32.42% lat (msec) : 100=1.60%, 750=0.03% cpu : usr=0.13%, sys=21.75%, ctx=8313, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181045: Sun Sep 6 23:53:06 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(5940KiB/54781msec) clat (usec): min=48, max=703296, avg=19667.41, stdev=20871.07 lat (usec): min=49, max=703300, avg=19668.27, stdev=20871.16 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 7242], 10.00th=[ 8848], 20.00th=[ 10945], | 30.00th=[ 12780], 40.00th=[ 14877], 50.00th=[ 16909], 60.00th=[ 19530], | 70.00th=[ 22676], 80.00th=[ 26346], 90.00th=[ 31589], 95.00th=[ 38011], | 99.00th=[ 62653], 99.50th=[ 71828], 99.90th=[115868], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 15, max= 183, per=24.97%, avg=109.35, stdev=29.94, samples=108 iops : min= 3, max= 45, avg=26.95, stdev= 7.47, samples=108 write: IOPS=28, BW=116KiB/s (119kB/s)(6348KiB/54781msec); 0 zone resets clat (usec): min=691, max=78773, avg=16045.87, stdev=13184.53 lat (usec): min=692, max=78774, avg=16047.07, stdev=13184.47 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1991], 10.00th=[ 2671], 20.00th=[ 3720], | 30.00th=[ 6063], 40.00th=[10159], 50.00th=[13304], 60.00th=[16450], | 70.00th=[20317], 80.00th=[26084], 90.00th=[35390], 95.00th=[42206], | 99.00th=[58459], 99.50th=[60556], 99.90th=[69731], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 47, max= 303, per=25.53%, avg=116.92, stdev=37.25, samples=108 iops : min= 11, max= 75, avg=28.84, stdev= 9.32, samples=108 lat (usec) : 50=0.03%, 100=0.20%, 250=0.81%, 750=0.03%, 1000=0.26% lat (msec) : 2=2.44%, 4=8.92%, 10=15.01%, 20=37.70%, 50=32.62% lat (msec) : 100=1.92%, 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=21.40%, ctx=8303, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181046: Sun Sep 6 23:53:06 2026 read: IOPS=27, BW=112KiB/s (114kB/s)(6028KiB/54026msec) clat (usec): min=44, max=89090, avg=19097.90, stdev=10696.93 lat (usec): min=45, max=89090, avg=19098.91, stdev=10697.01 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 6915], 10.00th=[ 8717], 20.00th=[10683], | 30.00th=[12387], 40.00th=[14484], 50.00th=[16712], 60.00th=[19792], | 70.00th=[22938], 80.00th=[26608], 90.00th=[32900], 95.00th=[38011], | 99.00th=[54789], 99.50th=[58983], 99.90th=[73925], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 56, max= 199, per=25.55%, avg=111.90, stdev=26.35, samples=106 iops : min= 14, max= 49, avg=27.59, stdev= 6.62, samples=106 write: IOPS=28, BW=116KiB/s (119kB/s)(6260KiB/54026msec); 0 zone resets clat (usec): min=803, max=741896, avg=16069.84, stdev=22307.70 lat (usec): min=804, max=741897, avg=16071.02, stdev=22307.69 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2040], 10.00th=[ 2606], 20.00th=[ 3818], | 30.00th=[ 6325], 40.00th=[ 9896], 50.00th=[ 12518], 60.00th=[ 15795], | 70.00th=[ 19792], 80.00th=[ 25560], 90.00th=[ 33817], 95.00th=[ 41157], | 99.00th=[ 53740], 99.50th=[ 61604], 99.90th=[ 86508], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 47, max= 239, per=25.34%, avg=116.04, stdev=31.68, samples=106 iops : min= 11, max= 59, avg=28.63, stdev= 7.88, samples=106 lat (usec) : 50=0.07%, 100=0.23%, 250=1.14%, 500=0.03%, 1000=0.39% lat (msec) : 2=2.12%, 4=8.17%, 10=16.41%, 20=37.24%, 50=32.65% lat (msec) : 100=1.53%, 750=0.03% cpu : usr=0.13%, sys=21.38%, ctx=8275, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181047: Sun Sep 6 23:53:06 2026 read: IOPS=28, BW=113KiB/s (116kB/s)(6052KiB/53385msec) clat (usec): min=47, max=100684, avg=18738.69, stdev=10406.48 lat (usec): min=47, max=100685, avg=18739.56, stdev=10406.51 clat percentiles (usec): | 1.00th=[ 116], 5.00th=[ 7373], 10.00th=[ 8717], 20.00th=[ 10683], | 30.00th=[ 12387], 40.00th=[ 14484], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 22676], 80.00th=[ 25560], 90.00th=[ 30540], 95.00th=[ 36439], | 99.00th=[ 53216], 99.50th=[ 60556], 99.90th=[100140], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 56, max= 192, per=26.12%, avg=114.41, stdev=26.04, samples=105 iops : min= 14, max= 48, avg=28.23, stdev= 6.53, samples=105 write: IOPS=29, BW=117KiB/s (120kB/s)(6236KiB/53385msec); 0 zone resets clat (usec): min=655, max=698647, avg=15974.86, stdev=21607.38 lat (usec): min=655, max=698651, avg=15977.03, stdev=21607.20 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1909], 10.00th=[ 2606], 20.00th=[ 3589], | 30.00th=[ 5407], 40.00th=[ 9503], 50.00th=[ 12649], 60.00th=[ 15664], | 70.00th=[ 20055], 80.00th=[ 26346], 90.00th=[ 33817], 95.00th=[ 40633], | 99.00th=[ 53216], 99.50th=[ 69731], 99.90th=[102237], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 40, max= 200, per=25.71%, avg=117.74, stdev=31.85, samples=105 iops : min= 10, max= 50, avg=29.07, stdev= 7.97, samples=105 lat (usec) : 50=0.03%, 100=0.26%, 250=1.04%, 750=0.10%, 1000=0.42% lat (msec) : 2=2.28%, 4=8.89%, 10=16.11%, 20=36.78%, 50=32.85% lat (msec) : 100=1.14%, 250=0.07%, 750=0.03% cpu : usr=0.14%, sys=21.47%, ctx=8118, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=438KiB/s (449kB/s), 108KiB/s-113KiB/s (111kB/s-116kB/s), io=23.4MiB (24.6MB), run=53385-54781msec WRITE: bw=459KiB/s (470kB/s), 116KiB/s-118KiB/s (119kB/s-121kB/s), io=24.6MiB (25.7MB), run=53385-54781msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181039: Sun Sep 6 23:53:16 2026 read: IOPS=23, BW=92.4KiB/s (94.6kB/s)(5992KiB/64840msec) clat (msec): min=3, max=735, avg=17.50, stdev=23.17 lat (msec): min=3, max=735, avg=17.50, stdev=23.17 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 67], 99.50th=[ 74], 99.90th=[ 101], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 31, max= 288, per=25.17%, avg=92.89, stdev=59.96, samples=128 iops : min= 7, max= 72, avg=22.81, stdev=15.03, samples=128 write: IOPS=24, BW=97.1KiB/s (99.4kB/s)(6296KiB/64840msec); 0 zone resets clat (msec): min=5, max=137, avg=24.41, stdev=16.47 lat (msec): min=5, max=137, avg=24.42, stdev=16.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 47], 95.00th=[ 55], | 99.00th=[ 78], 99.50th=[ 91], 99.90th=[ 123], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 24, max= 294, per=25.26%, avg=97.51, stdev=59.22, samples=128 iops : min= 6, max= 73, avg=23.97, stdev=14.83, samples=128 lat (msec) : 4=0.59%, 10=27.25%, 20=33.82%, 50=32.42%, 100=5.76% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.10%, sys=9.41%, ctx=5246, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181040: Sun Sep 6 23:53:16 2026 read: IOPS=22, BW=91.4KiB/s (93.6kB/s)(5940KiB/65003msec) clat (msec): min=3, max=724, avg=17.61, stdev=23.33 lat (msec): min=3, max=724, avg=17.62, stdev=23.33 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 71], 99.50th=[ 77], 99.90th=[ 109], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 16, max= 288, per=24.83%, avg=91.63, stdev=59.97, samples=128 iops : min= 4, max= 72, avg=22.50, stdev=15.01, samples=128 write: IOPS=24, BW=97.7KiB/s (100kB/s)(6348KiB/65003msec); 0 zone resets clat (msec): min=5, max=137, avg=24.36, stdev=15.95 lat (msec): min=5, max=137, avg=24.36, stdev=15.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 47], 95.00th=[ 55], | 99.00th=[ 77], 99.50th=[ 86], 99.90th=[ 112], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 32, max= 272, per=25.30%, avg=97.64, stdev=58.45, samples=128 iops : min= 8, max= 68, avg=24.00, stdev=14.64, samples=128 lat (msec) : 4=0.33%, 10=27.25%, 20=34.77%, 50=32.13%, 100=5.37% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.12%, sys=9.42%, ctx=5291, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181041: Sun Sep 6 23:53:16 2026 read: IOPS=23, BW=92.0KiB/s (95.2kB/s)(6028KiB/64850msec) clat (msec): min=3, max=113, avg=17.26, stdev=14.66 lat (msec): min=3, max=113, avg=17.26, stdev=14.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 71], 99.50th=[ 84], 99.90th=[ 95], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 23, max= 326, per=25.32%, avg=93.44, stdev=58.64, samples=128 iops : min= 5, max= 81, avg=22.95, stdev=14.70, samples=128 write: IOPS=24, BW=96.5KiB/s (98.8kB/s)(6260KiB/64850msec); 0 zone resets clat (msec): min=4, max=726, avg=24.70, stdev=24.70 lat (msec): min=4, max=726, avg=24.70, stdev=24.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 85], 99.50th=[ 104], 99.90th=[ 136], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 23, max= 263, per=25.12%, avg=96.95, stdev=58.71, samples=128 iops : min= 5, max= 65, avg=23.83, stdev=14.70, samples=128 lat (msec) : 4=0.52%, 10=26.30%, 20=36.85%, 50=30.01%, 100=5.99% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.12%, sys=9.55%, ctx=5200, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181042: Sun Sep 6 23:53:16 2026 read: IOPS=23, BW=93.3KiB/s (95.5kB/s)(6052KiB/64898msec) clat (msec): min=3, max=112, avg=17.70, stdev=14.92 lat (msec): min=3, max=112, avg=17.70, stdev=14.92 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 72], 99.50th=[ 88], 99.90th=[ 102], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 8, max= 279, per=25.39%, avg=93.69, stdev=58.46, samples=128 iops : min= 2, max= 69, avg=23.02, stdev=14.67, samples=128 write: IOPS=24, BW=96.1KiB/s (98.4kB/s)(6236KiB/64898msec); 0 zone resets clat (msec): min=5, max=727, avg=24.33, stdev=24.07 lat (msec): min=5, max=727, avg=24.33, stdev=24.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 46], 95.00th=[ 56], | 99.00th=[ 84], 99.50th=[ 100], 99.90th=[ 115], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 23, max= 256, per=24.96%, avg=96.33, stdev=56.92, samples=128 iops : min= 5, max= 64, avg=23.67, stdev=14.26, samples=128 lat (msec) : 4=0.26%, 10=26.20%, 20=35.90%, 50=31.54%, 100=5.83% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.13%, sys=9.43%, ctx=5318, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=369KiB/s (378kB/s), 91.4KiB/s-93.3KiB/s (93.6kB/s-95.5kB/s), io=23.4MiB (24.6MB), run=64840-65003msec WRITE: bw=387KiB/s (396kB/s), 96.1KiB/s-97.7KiB/s (98.4kB/s-100kB/s), io=24.6MiB (25.7MB), run=64840-65003msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181073: Sun Sep 6 23:53:37 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(5920KiB/15920msec) clat (usec): min=86, max=72860, avg=21907.01, stdev=12207.94 lat (usec): min=86, max=72861, avg=21907.98, stdev=12208.02 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 6128], 10.00th=[10159], 20.00th=[12649], | 30.00th=[14746], 40.00th=[17433], 50.00th=[19792], 60.00th=[22676], | 70.00th=[25822], 80.00th=[30016], 90.00th=[36439], 95.00th=[44303], | 99.00th=[65274], 99.50th=[66847], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 224, max= 544, per=24.44%, avg=367.29, stdev=73.88, samples=31 iops : min= 14, max= 34, avg=22.42, stdev= 4.57, samples=31 write: IOPS=25, BW=400KiB/s (410kB/s)(6368KiB/15920msec); 0 zone resets clat (usec): min=1348, max=74759, avg=19500.55, stdev=14241.71 lat (usec): min=1349, max=74761, avg=19502.46, stdev=14241.72 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3490], 10.00th=[ 4490], 20.00th=[ 6652], | 30.00th=[ 9634], 40.00th=[13042], 50.00th=[15664], 60.00th=[19006], | 70.00th=[25297], 80.00th=[31065], 90.00th=[40109], 95.00th=[47449], | 99.00th=[67634], 99.50th=[72877], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 191, max= 608, per=25.17%, avg=398.23, stdev=100.87, samples=31 iops : min= 11, max= 38, avg=24.35, stdev= 6.51, samples=31 lat (usec) : 100=0.65%, 250=1.69% lat (msec) : 2=0.91%, 4=2.86%, 10=14.19%, 20=36.20%, 50=39.97% lat (msec) : 100=3.52% cpu : usr=0.11%, sys=23.70%, ctx=2635, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181075: Sun Sep 6 23:53:37 2026 read: IOPS=23, BW=370KiB/s (379kB/s)(5744KiB/15532msec) clat (usec): min=45, max=65535, avg=22056.85, stdev=11329.22 lat (usec): min=46, max=65536, avg=22057.86, stdev=11329.29 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 7373], 10.00th=[10683], 20.00th=[13435], | 30.00th=[15926], 40.00th=[17695], 50.00th=[20317], 60.00th=[23200], | 70.00th=[26084], 80.00th=[30540], 90.00th=[36439], 95.00th=[43254], | 99.00th=[57410], 99.50th=[60031], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 146, max= 510, per=24.44%, avg=367.30, stdev=86.18, samples=30 iops : min= 9, max= 31, avg=22.40, stdev= 5.26, samples=30 write: IOPS=26, BW=421KiB/s (431kB/s)(6544KiB/15532msec); 0 zone resets clat (usec): min=1325, max=99660, avg=18317.99, stdev=14173.58 lat (usec): min=1326, max=99661, avg=18320.07, stdev=14173.40 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 3490], 10.00th=[ 4359], 20.00th=[ 5473], | 30.00th=[ 8160], 40.00th=[ 11994], 50.00th=[ 14746], 60.00th=[ 18220], | 70.00th=[ 21890], 80.00th=[ 29492], 90.00th=[ 39060], 95.00th=[ 45876], | 99.00th=[ 59507], 99.50th=[ 66323], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 191, max= 672, per=26.21%, avg=414.67, stdev=105.32, samples=30 iops : min= 11, max= 42, avg=25.37, stdev= 6.70, samples=30 lat (usec) : 50=0.13%, 100=0.39%, 250=1.30%, 500=0.13% lat (msec) : 2=0.78%, 4=2.86%, 10=16.93%, 20=34.90%, 50=39.45% lat (msec) : 100=3.12% cpu : usr=0.08%, sys=24.38%, ctx=2540, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181077: Sun Sep 6 23:53:37 2026 read: IOPS=24, BW=393KiB/s (402kB/s)(6256KiB/15929msec) clat (usec): min=57, max=80556, avg=21902.59, stdev=12586.51 lat (usec): min=58, max=80557, avg=21903.54, stdev=12586.55 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 233], 10.00th=[10028], 20.00th=[12387], | 30.00th=[14353], 40.00th=[17695], 50.00th=[20317], 60.00th=[22414], | 70.00th=[26084], 80.00th=[30540], 90.00th=[36963], 95.00th=[45351], | 99.00th=[69731], 99.50th=[73925], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 223, max= 640, per=25.96%, avg=390.13, stdev=92.56, samples=31 iops : min= 13, max= 40, avg=23.84, stdev= 5.91, samples=31 write: IOPS=23, BW=379KiB/s (388kB/s)(6032KiB/15929msec); 0 zone resets clat (usec): min=1458, max=80003, avg=19298.17, stdev=14313.06 lat (usec): min=1460, max=80004, avg=19306.09, stdev=14313.05 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 3752], 10.00th=[ 4621], 20.00th=[ 6456], | 30.00th=[ 9110], 40.00th=[12780], 50.00th=[15401], 60.00th=[19006], | 70.00th=[24249], 80.00th=[31065], 90.00th=[38536], 95.00th=[46924], | 99.00th=[69731], 99.50th=[71828], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 190, max= 576, per=23.22%, avg=367.35, stdev=90.34, samples=31 iops : min= 11, max= 36, avg=22.42, stdev= 5.68, samples=31 lat (usec) : 100=0.78%, 250=1.95%, 500=0.26%, 750=0.13% lat (msec) : 2=0.52%, 4=2.99%, 10=13.93%, 20=34.77%, 50=41.41% lat (msec) : 100=3.26% cpu : usr=0.07%, sys=23.76%, ctx=2578, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181079: Sun Sep 6 23:53:37 2026 read: IOPS=24, BW=387KiB/s (396kB/s)(6032KiB/15602msec) clat (usec): min=46, max=69876, avg=20977.94, stdev=12341.56 lat (usec): min=47, max=69877, avg=20978.88, stdev=12341.53 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 115], 10.00th=[ 8291], 20.00th=[11994], | 30.00th=[14615], 40.00th=[16909], 50.00th=[20055], 60.00th=[22152], | 70.00th=[25560], 80.00th=[29492], 90.00th=[38011], 95.00th=[42206], | 99.00th=[55837], 99.50th=[65799], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 159, max= 640, per=25.69%, avg=386.19, stdev=113.25, samples=31 iops : min= 9, max= 40, avg=23.58, stdev= 7.23, samples=31 write: IOPS=25, BW=401KiB/s (411kB/s)(6256KiB/15602msec); 0 zone resets clat (usec): min=1052, max=69999, avg=19370.95, stdev=14874.60 lat (usec): min=1054, max=70001, avg=19372.81, stdev=14874.60 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 3130], 10.00th=[ 4490], 20.00th=[ 6063], | 30.00th=[ 8717], 40.00th=[11863], 50.00th=[14877], 60.00th=[18744], | 70.00th=[25297], 80.00th=[31589], 90.00th=[41157], 95.00th=[49021], | 99.00th=[65274], 99.50th=[66323], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 224, max= 672, per=25.38%, avg=401.58, stdev=109.05, samples=31 iops : min= 14, max= 42, avg=24.55, stdev= 6.89, samples=31 lat (usec) : 50=0.13%, 100=1.69%, 250=2.86% lat (msec) : 2=0.78%, 4=3.12%, 10=15.23%, 20=32.81%, 50=39.71% lat (msec) : 100=3.65% cpu : usr=0.15%, sys=23.99%, ctx=2541, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1504KiB/s (1540kB/s), 370KiB/s-393KiB/s (379kB/s-402kB/s), io=23.4MiB (24.5MB), run=15532-15929msec WRITE: bw=1582KiB/s (1620kB/s), 379KiB/s-421KiB/s (388kB/s-431kB/s), io=24.6MiB (25.8MB), run=15532-15929msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181072: Sun Sep 6 23:53:40 2026 read: IOPS=19, BW=315KiB/s (322kB/s)(5920KiB/18799msec) clat (msec): min=3, max=119, avg=20.79, stdev=17.90 lat (msec): min=3, max=119, avg=20.79, stdev=17.90 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 32], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 79], 99.50th=[ 92], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 159, max= 896, per=24.04%, avg=306.30, stdev=187.11, samples=37 iops : min= 9, max= 56, avg=18.70, stdev=11.86, samples=37 write: IOPS=21, BW=339KiB/s (347kB/s)(6368KiB/18799msec); 0 zone resets clat (msec): min=7, max=101, avg=27.58, stdev=17.22 lat (msec): min=7, max=101, avg=27.59, stdev=17.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 65], | 99.00th=[ 81], 99.50th=[ 88], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 94, max= 832, per=24.89%, avg=333.57, stdev=170.82, samples=37 iops : min= 5, max= 52, avg=20.38, stdev=10.90, samples=37 lat (msec) : 4=0.13%, 10=18.49%, 20=36.85%, 50=33.72%, 100=10.55% lat (msec) : 250=0.26% cpu : usr=0.11%, sys=9.31%, ctx=1415, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181074: Sun Sep 6 23:53:40 2026 read: IOPS=19, BW=308KiB/s (315kB/s)(5744KiB/18678msec) clat (msec): min=3, max=119, avg=19.25, stdev=15.34 lat (msec): min=3, max=119, avg=19.25, stdev=15.34 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 56], | 99.00th=[ 71], 99.50th=[ 82], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 31, max= 736, per=24.01%, avg=305.89, stdev=156.00, samples=37 iops : min= 1, max= 46, avg=18.68, stdev= 9.96, samples=37 write: IOPS=21, BW=350KiB/s (359kB/s)(6544KiB/18678msec); 0 zone resets clat (msec): min=7, max=106, avg=28.51, stdev=17.89 lat (msec): min=7, max=106, avg=28.52, stdev=17.89 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 90], 99.50th=[ 97], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 190, max= 928, per=26.02%, avg=348.62, stdev=181.40, samples=37 iops : min= 11, max= 58, avg=21.35, stdev=11.53, samples=37 lat (msec) : 4=0.13%, 10=15.89%, 20=40.10%, 50=34.64%, 100=8.85% lat (msec) : 250=0.39% cpu : usr=0.12%, sys=9.53%, ctx=1400, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181076: Sun Sep 6 23:53:40 2026 read: IOPS=20, BW=333KiB/s (341kB/s)(6256KiB/18779msec) clat (msec): min=4, max=106, avg=21.27, stdev=17.80 lat (msec): min=4, max=106, avg=21.27, stdev=17.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 47], 95.00th=[ 63], | 99.00th=[ 79], 99.50th=[ 92], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 159, max= 992, per=25.90%, avg=329.95, stdev=199.17, samples=37 iops : min= 9, max= 62, avg=20.16, stdev=12.61, samples=37 write: IOPS=20, BW=321KiB/s (329kB/s)(6032KiB/18779msec); 0 zone resets clat (usec): min=7176, max=96592, avg=27580.70, stdev=17064.63 lat (usec): min=7178, max=96594, avg=27583.48, stdev=17064.53 clat percentiles (usec): | 1.00th=[ 8094], 5.00th=[ 9765], 10.00th=[11338], 20.00th=[13566], | 30.00th=[15664], 40.00th=[18220], 50.00th=[22414], 60.00th=[27395], | 70.00th=[32113], 80.00th=[41157], 90.00th=[51643], 95.00th=[62129], | 99.00th=[88605], 99.50th=[93848], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 96, max= 800, per=23.38%, avg=313.27, stdev=163.85, samples=37 iops : min= 6, max= 50, avg=19.14, stdev=10.38, samples=37 lat (msec) : 10=18.23%, 20=37.11%, 50=35.03%, 100=9.51%, 250=0.13% cpu : usr=0.10%, sys=9.58%, ctx=1444, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181078: Sun Sep 6 23:53:40 2026 read: IOPS=20, BW=323KiB/s (331kB/s)(6032KiB/18671msec) clat (msec): min=4, max=104, avg=20.78, stdev=17.06 lat (msec): min=4, max=104, avg=20.78, stdev=17.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 61], | 99.00th=[ 78], 99.50th=[ 95], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 95, max= 896, per=25.15%, avg=320.46, stdev=182.33, samples=37 iops : min= 5, max= 56, avg=19.57, stdev=11.57, samples=37 write: IOPS=20, BW=335KiB/s (343kB/s)(6256KiB/18671msec); 0 zone resets clat (msec): min=6, max=106, avg=27.64, stdev=17.46 lat (msec): min=6, max=106, avg=27.64, stdev=17.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 52], 95.00th=[ 63], | 99.00th=[ 97], 99.50th=[ 107], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 159, max= 832, per=24.99%, avg=334.89, stdev=168.15, samples=37 iops : min= 9, max= 52, avg=20.49, stdev=10.67, samples=37 lat (msec) : 10=16.80%, 20=39.71%, 50=33.72%, 100=9.38%, 250=0.39% cpu : usr=0.09%, sys=9.41%, ctx=1391, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1274KiB/s (1305kB/s), 308KiB/s-333KiB/s (315kB/s-341kB/s), io=23.4MiB (24.5MB), run=18671-18799msec WRITE: bw=1340KiB/s (1373kB/s), 321KiB/s-350KiB/s (329kB/s-359kB/s), io=24.6MiB (25.8MB), run=18671-18799msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181087: Sun Sep 6 23:53:51 2026 read: IOPS=1, BW=1395KiB/s (1429kB/s)(7168KiB/5138msec) clat (usec): min=553, max=2413.4k, avg=590729.20, stdev=916021.74 lat (usec): min=554, max=2413.5k, avg=590730.73, stdev=916021.71 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 611], 30.00th=[ 102237], 40.00th=[ 102237], | 50.00th=[ 149947], 60.00th=[ 212861], 70.00th=[ 212861], | 80.00th=[1249903], 90.00th=[2399142], 95.00th=[2399142], | 99.00th=[2399142], 99.50th=[2399142], 99.90th=[2399142], | 99.95th=[2399142], 99.99th=[2399142] bw ( KiB/s): min= 4096, max= 6144, per=100.00%, avg=5120.00, stdev=1448.15, samples=2 iops : min= 4, max= 6, avg= 5.00, stdev= 1.41, samples=2 write: IOPS=0, BW=996KiB/s (1020kB/s)(5120KiB/5138msec); 0 zone resets clat (msec): min=132, max=298, avg=198.17, stdev=68.45 lat (msec): min=132, max=298, avg=198.24, stdev=68.44 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2048, max= 4096, per=58.39%, avg=3072.00, stdev=1448.15, samples=2 iops : min= 2, max= 4, avg= 3.00, stdev= 1.41, samples=2 lat (usec) : 750=16.67% lat (msec) : 250=58.33%, 500=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=31.93%, ctx=1564, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181088: Sun Sep 6 23:53:51 2026 read: IOPS=0, BW=376KiB/s (385kB/s)(2048KiB/5449msec) clat (msec): min=99, max=1564, avg=832.37, stdev=1036.08 lat (msec): min=99, max=1564, avg=832.37, stdev=1036.08 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 2043, max= 2048, per=54.43%, avg=2045.50, stdev= 3.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1879KiB/s (1924kB/s)(10.0MiB/5449msec); 0 zone resets clat (msec): min=84, max=1695, avg=372.70, stdev=478.68 lat (msec): min=84, max=1695, avg=372.78, stdev=478.68 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 86], | 30.00th=[ 123], 40.00th=[ 140], 50.00th=[ 220], 60.00th=[ 309], | 70.00th=[ 334], 80.00th=[ 368], 90.00th=[ 372], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1928, max= 6131, per=69.06%, avg=3633.20, stdev=1732.18, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.79, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 2000=16.67% cpu : usr=0.00%, sys=30.43%, ctx=706, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181089: Sun Sep 6 23:53:51 2026 read: IOPS=1, BW=1227KiB/s (1256kB/s)(6144KiB/5009msec) clat (usec): min=611, max=227115, avg=138315.01, stdev=107582.55 lat (usec): min=612, max=227117, avg=138316.36, stdev=107582.24 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[185598], 50.00th=[185598], 60.00th=[200279], | 70.00th=[217056], 80.00th=[217056], 90.00th=[227541], 95.00th=[227541], | 99.00th=[227541], 99.50th=[227541], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 1984, max= 4096, per=67.66%, avg=2542.75, stdev=1035.91, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1227KiB/s (1256kB/s)(6144KiB/5009msec); 0 zone resets clat (msec): min=126, max=1604, avg=685.07, stdev=617.83 lat (msec): min=126, max=1604, avg=685.13, stdev=617.81 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 535], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1984, max= 3459, per=45.31%, avg=2383.50, stdev=717.59, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=50.00%, 500=8.33%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=25.92%, ctx=521, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181090: Sun Sep 6 23:53:51 2026 read: IOPS=1, BW=1030KiB/s (1055kB/s)(5120KiB/4970msec) clat (usec): min=648, max=170198, avg=98868.28, stdev=80646.17 lat (usec): min=649, max=170199, avg=98869.76, stdev=80646.64 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 652], | 30.00th=[ 22152], 40.00th=[ 22152], 50.00th=[147850], 60.00th=[147850], | 70.00th=[154141], 80.00th=[154141], 90.00th=[170918], 95.00th=[170918], | 99.00th=[170918], 99.50th=[170918], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 2048, max= 5953, per=100.00%, avg=4000.50, stdev=2761.25, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1442KiB/s (1477kB/s)(7168KiB/4970msec); 0 zone resets clat (msec): min=167, max=1467, avg=633.75, stdev=565.10 lat (msec): min=167, max=1467, avg=633.85, stdev=565.08 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 171], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 388], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 1401], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1721, max= 4096, per=56.49%, avg=2972.00, stdev=1297.14, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=16.67% cpu : usr=0.04%, sys=28.32%, ctx=393, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3758KiB/s (3849kB/s), 376KiB/s-1395KiB/s (385kB/s-1429kB/s), io=20.0MiB (20.0MB), run=4970-5449msec WRITE: bw=5262KiB/s (5388kB/s), 996KiB/s-1879KiB/s (1020kB/s-1924kB/s), io=28.0MiB (29.4MB), run=4970-5449msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181092: Sun Sep 6 23:53:51 2026 read: IOPS=1, BW=1297KiB/s (1328kB/s)(7168KiB/5528msec) clat (msec): min=32, max=1665, avg=617.54, stdev=625.01 lat (msec): min=32, max=1665, avg=617.54, stdev=625.01 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 55], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 542], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 1116], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 2048, max= 3676, per=66.33%, avg=2455.00, stdev=814.00, samples=4 iops : min= 2, max= 3, avg= 2.25, stdev= 0.50, samples=4 write: IOPS=0, BW=926KiB/s (948kB/s)(5120KiB/5528msec); 0 zone resets clat (msec): min=43, max=494, avg=212.25, stdev=188.18 lat (msec): min=43, max=494, avg=212.34, stdev=188.19 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 44], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2048, max= 2048, per=39.53%, avg=2048.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 50=16.67%, 100=25.00%, 250=8.33%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=10.11%, ctx=126, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181093: Sun Sep 6 23:53:51 2026 read: IOPS=0, BW=370KiB/s (379kB/s)(2048KiB/5533msec) clat (msec): min=27, max=1620, avg=824.35, stdev=1126.28 lat (msec): min=27, max=1620, avg=824.35, stdev=1126.28 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 28], 10.00th=[ 28], 20.00th=[ 28], | 30.00th=[ 28], 40.00th=[ 28], 50.00th=[ 28], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 2039, max= 2048, per=55.21%, avg=2043.50, stdev= 6.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1851KiB/s (1895kB/s)(10.0MiB/5533msec); 0 zone resets clat (msec): min=39, max=1682, avg=383.07, stdev=487.53 lat (msec): min=39, max=1682, avg=383.16, stdev=487.51 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 54], | 30.00th=[ 102], 40.00th=[ 205], 50.00th=[ 215], 60.00th=[ 257], | 70.00th=[ 313], 80.00th=[ 334], 90.00th=[ 634], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 2048, max= 6144, per=79.06%, avg=4096.00, stdev=2364.83, samples=4 iops : min= 2, max= 6, avg= 4.00, stdev= 2.31, samples=4 lat (msec) : 50=16.67%, 100=8.33%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=11.62%, ctx=159, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181094: Sun Sep 6 23:53:51 2026 read: IOPS=1, BW=1138KiB/s (1165kB/s)(6144KiB/5401msec) clat (msec): min=75, max=360, avg=163.71, stdev=109.88 lat (msec): min=75, max=360, avg=163.71, stdev=109.88 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 142], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1838, max= 4096, per=90.34%, avg=3343.33, stdev=1303.66, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1138KiB/s (1165kB/s)(6144KiB/5401msec); 0 zone resets clat (msec): min=34, max=1665, avg=732.89, stdev=682.60 lat (msec): min=34, max=1665, avg=732.98, stdev=682.59 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 426], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1838, max= 3482, per=45.39%, avg=2351.75, stdev=759.71, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=33.33%, 2000=16.67% cpu : usr=0.00%, sys=7.74%, ctx=124, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181095: Sun Sep 6 23:53:51 2026 read: IOPS=0, BW=946KiB/s (968kB/s)(5120KiB/5414msec) clat (msec): min=46, max=190, avg=101.18, stdev=64.24 lat (msec): min=46, max=190, avg=101.18, stdev=64.24 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 47], | 30.00th=[ 51], 40.00th=[ 51], 50.00th=[ 72], 60.00th=[ 72], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 2048, max= 6144, per=100.00%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1324KiB/s (1356kB/s)(7168KiB/5414msec); 0 zone resets clat (msec): min=117, max=1807, avg=679.84, stdev=676.64 lat (msec): min=117, max=1807, avg=679.92, stdev=676.65 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 186], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 284], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 1452], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1780, max= 4096, per=47.06%, avg=2438.25, stdev=1110.72, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 50=16.67%, 100=8.33%, 250=33.33%, 500=16.67%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.04%, sys=16.00%, ctx=534, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3701KiB/s (3790kB/s), 370KiB/s-1297KiB/s (379kB/s-1328kB/s), io=20.0MiB (20.0MB), run=5401-5533msec WRITE: bw=5182KiB/s (5306kB/s), 926KiB/s-1851KiB/s (948kB/s-1895kB/s), io=28.0MiB (29.4MB), run=5401-5533msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181104: Sun Sep 6 23:54:01 2026 read: IOPS=1, BW=6994KiB/s (7162kB/s)(12.0MiB/1757msec) clat (msec): min=521, max=586, avg=559.40, stdev=33.98 lat (msec): min=521, max=586, avg=559.41, stdev=33.98 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=57.92%, ctx=2920, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181107: Sun Sep 6 23:54:01 2026 read: IOPS=0, BW=1885KiB/s (1930kB/s)(4096KiB/2173msec) clat (nsec): min=517917k, max=517917k, avg=517916998.00, stdev= 0.00 lat (nsec): min=517920k, max=517920k, avg=517919770.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3770KiB/s (3860kB/s)(8192KiB/2173msec); 0 zone resets clat (msec): min=680, max=839, avg=759.77, stdev=112.53 lat (msec): min=680, max=839, avg=760.02, stdev=112.65 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8192, max= 8192, per=70.88%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.91%, ctx=996, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181108: Sun Sep 6 23:54:01 2026 write: IOPS=1, BW=4334KiB/s (4438kB/s)(12.0MiB/2835msec); 0 zone resets clat (msec): min=203, max=1994, avg=940.70, stdev=936.46 lat (msec): min=203, max=1994, avg=941.10, stdev=936.47 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8159, max= 8192, per=70.73%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=16.62%, ctx=97, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181109: Sun Sep 6 23:54:01 2026 write: IOPS=1, BW=5503KiB/s (5635kB/s)(12.0MiB/2233msec); 0 zone resets clat (msec): min=629, max=827, avg=697.64, stdev=112.61 lat (msec): min=630, max=827, avg=698.01, stdev=112.54 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8192, max= 8192, per=70.88%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.56%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7540KiB/s (7721kB/s), 1885KiB/s-6994KiB/s (1930kB/s-7162kB/s), io=16.0MiB (16.8MB), run=1757-2173msec WRITE: bw=11.3MiB/s (11.8MB/s), 3770KiB/s-5503KiB/s (3860kB/s-5635kB/s), io=32.0MiB (33.6MB), run=2173-2835msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181102: Sun Sep 6 23:54:01 2026 read: IOPS=1, BW=6341KiB/s (6493kB/s)(12.0MiB/1938msec) clat (msec): min=197, max=1106, avg=632.94, stdev=455.66 lat (msec): min=197, max=1106, avg=632.94, stdev=455.66 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 5962, max= 8192, per=100.00%, avg=7077.00, stdev=1576.85, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.64%, ctx=87, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181103: Sun Sep 6 23:54:01 2026 read: IOPS=0, BW=1436KiB/s (1470kB/s)(4096KiB/2853msec) clat (nsec): min=758117k, max=758117k, avg=758117002.00, stdev= 0.00 lat (nsec): min=758120k, max=758120k, avg=758119709.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2871KiB/s (2940kB/s)(8192KiB/2853msec); 0 zone resets clat (msec): min=606, max=1459, avg=1032.61, stdev=603.02 lat (msec): min=606, max=1459, avg=1032.94, stdev=603.21 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8192, max= 8192, per=71.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.41%, ctx=101, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181105: Sun Sep 6 23:54:01 2026 write: IOPS=1, BW=4726KiB/s (4840kB/s)(12.0MiB/2600msec); 0 zone resets clat (msec): min=233, max=1789, avg=832.78, stdev=837.57 lat (msec): min=233, max=1790, avg=833.11, stdev=837.54 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8143, max= 8143, per=70.90%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.89%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181106: Sun Sep 6 23:54:01 2026 write: IOPS=1, BW=4961KiB/s (5080kB/s)(12.0MiB/2477msec); 0 zone resets clat (msec): min=308, max=1605, avg=818.70, stdev=691.58 lat (msec): min=308, max=1606, avg=819.18, stdev=691.54 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 6470, max= 8143, per=63.62%, avg=7306.50, stdev=1182.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=18.54%, ctx=88, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5743KiB/s (5881kB/s), 1436KiB/s-6341KiB/s (1470kB/s-6493kB/s), io=16.0MiB (16.8MB), run=1938-2853msec WRITE: bw=11.2MiB/s (11.8MB/s), 2871KiB/s-4961KiB/s (2940kB/s-5080kB/s), io=32.0MiB (33.6MB), run=2477-2853msec