== sanity test 398b: DIO and buffer IO race ============== 21:16:15 (1784942175) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.28472 s, 11.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144946: Fri Jul 24 21:17:56 2026 read: IOPS=16, BW=67.9KiB/s (69.5kB/s)(5992KiB/88303msec) clat (usec): min=33, max=477043, avg=29317.83, stdev=22570.72 lat (usec): min=34, max=477045, avg=29320.58, stdev=22570.32 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 69], 10.00th=[ 10421], 20.00th=[ 15270], | 30.00th=[ 18482], 40.00th=[ 21627], 50.00th=[ 25035], 60.00th=[ 28967], | 70.00th=[ 34866], 80.00th=[ 42730], 90.00th=[ 52691], 95.00th=[ 63701], | 99.00th=[ 98042], 99.50th=[115868], 99.90th=[164627], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 16, max= 134, per=25.01%, avg=67.79, stdev=22.21, samples=174 iops : min= 4, max= 33, avg=16.36, stdev= 5.55, samples=174 write: IOPS=17, BW=71.3KiB/s (73.0kB/s)(6296KiB/88303msec); 0 zone resets clat (usec): min=935, max=189777, avg=27976.96, stdev=26708.49 lat (usec): min=937, max=189778, avg=27979.39, stdev=26708.41 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1385], 10.00th=[ 1975], 20.00th=[ 4293], | 30.00th=[ 7701], 40.00th=[ 15139], 50.00th=[ 22414], 60.00th=[ 28443], | 70.00th=[ 35914], 80.00th=[ 47449], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[125305], 99.50th=[135267], 99.90th=[181404], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 16, max= 159, per=25.06%, avg=71.18, stdev=25.70, samples=174 iops : min= 4, max= 39, avg=17.21, stdev= 6.43, samples=174 lat (usec) : 50=0.49%, 100=2.67%, 250=0.26%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=5.05%, 4=4.43%, 10=8.59%, 20=18.95%, 50=43.95% lat (msec) : 100=13.87%, 250=1.37%, 500=0.03% cpu : usr=0.11%, sys=7.67%, ctx=6910, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144948: Fri Jul 24 21:17:56 2026 read: IOPS=17, BW=68.1KiB/s (69.8kB/s)(5940KiB/87172msec) clat (usec): min=32, max=259293, avg=28314.32, stdev=20464.05 lat (usec): min=32, max=259294, avg=28317.11, stdev=20463.98 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 75], 10.00th=[ 9896], 20.00th=[ 14615], | 30.00th=[ 17957], 40.00th=[ 20841], 50.00th=[ 25035], 60.00th=[ 28705], | 70.00th=[ 33817], 80.00th=[ 40633], 90.00th=[ 51119], 95.00th=[ 60556], | 99.00th=[ 98042], 99.50th=[112722], 99.90th=[235930], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 135, per=24.91%, avg=67.50, stdev=23.82, samples=172 iops : min= 1, max= 33, avg=16.29, stdev= 5.97, samples=172 write: IOPS=18, BW=72.8KiB/s (74.6kB/s)(6348KiB/87172msec); 0 zone resets clat (usec): min=1018, max=470293, avg=28219.46, stdev=28716.49 lat (usec): min=1021, max=470294, avg=28221.05, stdev=28716.48 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 2040], 20.00th=[ 3884], | 30.00th=[ 8094], 40.00th=[ 15926], 50.00th=[ 21890], 60.00th=[ 28443], | 70.00th=[ 36963], 80.00th=[ 47449], 90.00th=[ 62129], 95.00th=[ 76022], | 99.00th=[123208], 99.50th=[135267], 99.90th=[206570], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 16, max= 152, per=25.51%, avg=72.44, stdev=26.27, samples=171 iops : min= 4, max= 38, avg=17.52, stdev= 6.61, samples=171 lat (usec) : 50=0.36%, 100=2.57%, 250=0.46%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.08%, 4=5.63%, 10=7.16%, 20=20.80%, 50=43.03% lat (msec) : 100=13.15%, 250=1.43%, 500=0.07% cpu : usr=0.11%, sys=7.87%, ctx=6927, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144950: Fri Jul 24 21:17:56 2026 read: IOPS=17, BW=70.3KiB/s (71.0kB/s)(6028KiB/85777msec) clat (usec): min=33, max=183656, avg=28281.64, stdev=19604.45 lat (usec): min=33, max=183657, avg=28282.99, stdev=19604.41 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 9765], 20.00th=[ 14615], | 30.00th=[ 17957], 40.00th=[ 20841], 50.00th=[ 23987], 60.00th=[ 27657], | 70.00th=[ 34341], 80.00th=[ 42206], 90.00th=[ 51643], 95.00th=[ 63701], | 99.00th=[ 95945], 99.50th=[107480], 99.90th=[154141], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 7, max= 151, per=25.93%, avg=70.28, stdev=24.03, samples=169 iops : min= 1, max= 37, avg=16.98, stdev= 6.07, samples=169 write: IOPS=18, BW=72.0KiB/s (74.7kB/s)(6260KiB/85777msec); 0 zone resets clat (usec): min=939, max=544604, avg=27359.82, stdev=28845.63 lat (usec): min=941, max=544607, avg=27363.25, stdev=28845.44 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1893], 20.00th=[ 3687], | 30.00th=[ 7439], 40.00th=[ 15008], 50.00th=[ 21365], 60.00th=[ 27657], | 70.00th=[ 36439], 80.00th=[ 45351], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[114820], 99.50th=[130548], 99.90th=[217056], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 15, max= 182, per=25.68%, avg=72.93, stdev=26.09, samples=169 iops : min= 3, max= 45, avg=17.66, stdev= 6.54, samples=169 lat (usec) : 50=0.46%, 100=3.09%, 250=0.33%, 500=0.07%, 1000=0.13% lat (msec) : 2=5.60%, 4=5.05%, 10=7.42%, 20=20.93%, 50=42.42% lat (msec) : 100=13.44%, 250=1.04%, 750=0.03% cpu : usr=0.10%, sys=7.73%, ctx=6810, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Fri Jul 24 21:17:56 2026 read: IOPS=17, BW=68.5KiB/s (70.1kB/s)(6052KiB/88352msec) clat (usec): min=31, max=140723, avg=28400.55, stdev=19191.69 lat (usec): min=31, max=140725, avg=28412.31, stdev=19180.69 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 65], 10.00th=[ 8717], 20.00th=[ 14877], | 30.00th=[ 17695], 40.00th=[ 21103], 50.00th=[ 24773], 60.00th=[ 28967], | 70.00th=[ 34341], 80.00th=[ 41681], 90.00th=[ 52167], 95.00th=[ 62129], | 99.00th=[ 95945], 99.50th=[117965], 99.90th=[137364], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 8, max= 127, per=25.25%, avg=68.43, stdev=22.03, samples=174 iops : min= 2, max= 31, avg=16.52, stdev= 5.53, samples=174 write: IOPS=17, BW=70.6KiB/s (72.3kB/s)(6236KiB/88352msec); 0 zone resets clat (usec): min=907, max=483281, avg=28878.34, stdev=29017.49 lat (usec): min=909, max=483283, avg=28880.43, stdev=29017.60 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1369], 10.00th=[ 1795], 20.00th=[ 4228], | 30.00th=[ 8586], 40.00th=[ 16450], 50.00th=[ 23462], 60.00th=[ 30540], | 70.00th=[ 38011], 80.00th=[ 47973], 90.00th=[ 62653], 95.00th=[ 76022], | 99.00th=[115868], 99.50th=[137364], 99.90th=[291505], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 7, max= 167, per=24.65%, avg=70.00, stdev=25.69, samples=175 iops : min= 1, max= 41, avg=16.91, stdev= 6.47, samples=175 lat (usec) : 50=0.62%, 100=2.73%, 250=0.42%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.70%, 4=4.17%, 10=7.68%, 20=19.40%, 50=44.01% lat (msec) : 100=13.51%, 250=1.27%, 500=0.07% cpu : usr=0.08%, sys=7.63%, ctx=6898, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=272KiB/s (278kB/s), 67.9KiB/s-70.3KiB/s (69.5kB/s-71.0kB/s), io=23.4MiB (24.6MB), run=85777-88352msec WRITE: bw=285KiB/s (291kB/s), 70.6KiB/s-72.0KiB/s (72.3kB/s-74.7kB/s), io=24.6MiB (25.7MB), run=85777-88352msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144945: Fri Jul 24 21:19:11 2026 read: IOPS=9, BW=36.8KiB/s (37.7kB/s)(5992KiB/162815msec) clat (msec): min=4, max=495, avg=25.15, stdev=26.74 lat (msec): min=4, max=495, avg=25.15, stdev=26.74 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 53], 95.00th=[ 74], | 99.00th=[ 123], 99.50th=[ 150], 99.90th=[ 255], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7, max= 136, per=25.80%, avg=37.92, stdev=25.61, samples=310 iops : min= 1, max= 34, avg= 8.95, stdev= 6.52, samples=310 write: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6296KiB/162815msec); 0 zone resets clat (msec): min=20, max=370, avg=79.31, stdev=44.06 lat (msec): min=20, max=370, avg=79.31, stdev=44.06 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 33], 10.00th=[ 38], 20.00th=[ 45], | 30.00th=[ 52], 40.00th=[ 58], 50.00th=[ 65], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 113], 90.00th=[ 142], 95.00th=[ 165], | 99.00th=[ 230], 99.50th=[ 266], 99.90th=[ 347], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 104, per=25.14%, avg=38.46, stdev=19.81, samples=321 iops : min= 1, max= 26, avg= 9.08, stdev= 5.06, samples=321 lat (msec) : 10=10.16%, 20=18.75%, 50=29.00%, 100=28.16%, 250=13.61% lat (msec) : 500=0.33% cpu : usr=0.06%, sys=2.39%, ctx=5727, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144947: Fri Jul 24 21:19:11 2026 read: IOPS=9, BW=36.4KiB/s (37.2kB/s)(5940KiB/163333msec) clat (msec): min=4, max=584, avg=25.02, stdev=27.32 lat (msec): min=4, max=584, avg=25.02, stdev=27.32 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 52], 95.00th=[ 69], | 99.00th=[ 118], 99.50th=[ 165], 99.90th=[ 213], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 120, per=26.04%, avg=38.27, stdev=24.71, samples=304 iops : min= 1, max= 30, avg= 9.03, stdev= 6.25, samples=304 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6348KiB/163333msec); 0 zone resets clat (msec): min=16, max=262, avg=79.33, stdev=43.05 lat (msec): min=16, max=262, avg=79.33, stdev=43.05 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 52], 40.00th=[ 58], 50.00th=[ 67], 60.00th=[ 75], | 70.00th=[ 90], 80.00th=[ 112], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 224], 99.50th=[ 243], 99.90th=[ 255], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 7, max= 96, per=25.19%, avg=38.54, stdev=19.43, samples=323 iops : min= 1, max= 24, avg= 9.10, stdev= 4.98, samples=323 lat (msec) : 10=10.38%, 20=17.64%, 50=29.62%, 100=28.74%, 250=13.38% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=2.33%, ctx=5817, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144949: Fri Jul 24 21:19:11 2026 read: IOPS=9, BW=36.0KiB/s (37.8kB/s)(6028KiB/163112msec) clat (msec): min=3, max=214, avg=25.71, stdev=24.72 lat (msec): min=3, max=214, avg=25.71, stdev=24.72 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 53], 95.00th=[ 69], | 99.00th=[ 128], 99.50th=[ 171], 99.90th=[ 209], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 7, max= 120, per=25.60%, avg=37.63, stdev=24.03, samples=313 iops : min= 1, max= 30, avg= 8.87, stdev= 6.12, samples=313 write: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6260KiB/163112msec); 0 zone resets clat (msec): min=23, max=672, avg=79.26, stdev=46.40 lat (msec): min=23, max=672, avg=79.27, stdev=46.40 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 33], 10.00th=[ 38], 20.00th=[ 44], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 66], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 112], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 224], 99.50th=[ 251], 99.90th=[ 355], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 112, per=24.81%, avg=37.96, stdev=20.53, samples=322 iops : min= 1, max= 28, avg= 8.95, stdev= 5.25, samples=322 lat (msec) : 4=0.03%, 10=9.86%, 20=17.29%, 50=31.90%, 100=26.99% lat (msec) : 250=13.64%, 500=0.26%, 750=0.03% cpu : usr=0.07%, sys=2.31%, ctx=5672, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Fri Jul 24 21:19:11 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6052KiB/162522msec) clat (msec): min=4, max=234, avg=24.63, stdev=23.71 lat (msec): min=4, max=234, avg=24.63, stdev=23.71 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 53], 95.00th=[ 68], | 99.00th=[ 115], 99.50th=[ 165], 99.90th=[ 207], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 7, max= 136, per=26.12%, avg=38.39, stdev=25.66, samples=309 iops : min= 1, max= 34, avg= 9.06, stdev= 6.50, samples=309 write: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6236KiB/162522msec); 0 zone resets clat (msec): min=20, max=609, avg=80.17, stdev=45.92 lat (msec): min=20, max=609, avg=80.17, stdev=45.92 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 33], 10.00th=[ 39], 20.00th=[ 46], | 30.00th=[ 53], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 77], | 70.00th=[ 90], 80.00th=[ 113], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 224], 99.50th=[ 249], 99.90th=[ 313], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 112, per=24.85%, avg=38.03, stdev=19.52, samples=321 iops : min= 1, max= 28, avg= 8.97, stdev= 5.00, samples=321 lat (msec) : 10=10.29%, 20=18.55%, 50=29.00%, 100=28.81%, 250=13.18% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.04%, sys=2.29%, ctx=5731, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (151kB/s), 36.4KiB/s-37.2KiB/s (37.2kB/s-38.1kB/s), io=23.4MiB (24.6MB), run=162522-163333msec WRITE: bw=154KiB/s (158kB/s), 38.4KiB/s-38.9KiB/s (39.3kB/s-39.8kB/s), io=24.6MiB (25.7MB), run=162522-163333msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144991: Fri Jul 24 21:19:34 2026 read: IOPS=20, BW=331KiB/s (339kB/s)(5920KiB/17882msec) clat (usec): min=28, max=136625, avg=23654.80, stdev=19247.37 lat (usec): min=29, max=136627, avg=23656.07, stdev=19247.37 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 247], | 30.00th=[ 14746], 40.00th=[ 17957], 50.00th=[ 21365], 60.00th=[ 25035], | 70.00th=[ 32113], 80.00th=[ 37487], 90.00th=[ 46924], 95.00th=[ 56886], | 99.00th=[ 91751], 99.50th=[102237], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 134, max= 573, per=25.21%, avg=332.80, stdev=91.71, samples=35 iops : min= 8, max= 35, avg=20.23, stdev= 5.75, samples=35 write: IOPS=22, BW=356KiB/s (365kB/s)(6368KiB/17882msec); 0 zone resets clat (usec): min=1397, max=154840, avg=22380.45, stdev=22378.28 lat (usec): min=1399, max=154841, avg=22386.72, stdev=22379.36 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2114], 10.00th=[ 2999], 20.00th=[ 5342], | 30.00th=[ 6980], 40.00th=[ 9372], 50.00th=[ 13829], 60.00th=[ 20055], | 70.00th=[ 28967], 80.00th=[ 40633], 90.00th=[ 51119], 95.00th=[ 61604], | 99.00th=[108528], 99.50th=[116917], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 80, max= 736, per=25.82%, avg=358.63, stdev=143.68, samples=35 iops : min= 5, max= 46, avg=21.86, stdev= 8.99, samples=35 lat (usec) : 50=0.91%, 100=7.29%, 250=1.43%, 500=0.39% lat (msec) : 2=2.47%, 4=5.47%, 10=14.58%, 20=19.79%, 50=38.67% lat (msec) : 100=7.94%, 250=1.04% cpu : usr=0.13%, sys=11.50%, ctx=1652, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144992: Fri Jul 24 21:19:34 2026 read: IOPS=20, BW=322KiB/s (329kB/s)(5744KiB/17856msec) clat (usec): min=38, max=132588, avg=25342.42, stdev=20125.79 lat (usec): min=38, max=132589, avg=25344.26, stdev=20125.46 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 68], 20.00th=[ 478], | 30.00th=[ 15664], 40.00th=[ 19268], 50.00th=[ 23987], 60.00th=[ 28181], | 70.00th=[ 32900], 80.00th=[ 39060], 90.00th=[ 50594], 95.00th=[ 59507], | 99.00th=[ 89654], 99.50th=[119014], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 95, max= 666, per=24.46%, avg=322.91, stdev=118.49, samples=35 iops : min= 5, max= 41, avg=19.60, stdev= 7.43, samples=35 write: IOPS=22, BW=366KiB/s (375kB/s)(6544KiB/17856msec); 0 zone resets clat (usec): min=1521, max=135515, avg=21305.95, stdev=22668.75 lat (usec): min=1523, max=135518, avg=21309.40, stdev=22667.81 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2278], 10.00th=[ 3130], 20.00th=[ 4178], | 30.00th=[ 5735], 40.00th=[ 8356], 50.00th=[ 12125], 60.00th=[ 17957], | 70.00th=[ 26346], 80.00th=[ 35914], 90.00th=[ 52691], 95.00th=[ 67634], | 99.00th=[ 99091], 99.50th=[111674], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 63, max= 574, per=26.43%, avg=367.14, stdev=105.56, samples=35 iops : min= 3, max= 35, avg=22.37, stdev= 6.62, samples=35 lat (usec) : 50=1.30%, 100=5.73%, 250=2.08%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.56%, 4=8.59%, 10=14.84%, 20=17.97%, 50=36.98% lat (msec) : 100=9.77%, 250=0.78% cpu : usr=0.10%, sys=11.58%, ctx=1612, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144993: Fri Jul 24 21:19:34 2026 read: IOPS=21, BW=345KiB/s (353kB/s)(6256KiB/18140msec) clat (usec): min=26, max=123014, avg=24133.35, stdev=20069.48 lat (usec): min=26, max=123015, avg=24134.66, stdev=20069.48 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 135], | 30.00th=[ 15139], 40.00th=[ 19006], 50.00th=[ 22676], 60.00th=[ 26608], | 70.00th=[ 30278], 80.00th=[ 36439], 90.00th=[ 48497], 95.00th=[ 59507], | 99.00th=[ 91751], 99.50th=[112722], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 95, max= 510, per=26.29%, avg=347.09, stdev=108.18, samples=35 iops : min= 5, max= 31, avg=21.14, stdev= 6.76, samples=35 write: IOPS=20, BW=333KiB/s (341kB/s)(6032KiB/18140msec); 0 zone resets clat (usec): min=1292, max=178964, avg=22402.67, stdev=22961.82 lat (usec): min=1294, max=178967, avg=22463.82, stdev=22935.56 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2212], 10.00th=[ 3064], 20.00th=[ 4948], | 30.00th=[ 7373], 40.00th=[ 10159], 50.00th=[ 13960], 60.00th=[ 20841], | 70.00th=[ 26870], 80.00th=[ 37487], 90.00th=[ 49546], 95.00th=[ 72877], | 99.00th=[ 96994], 99.50th=[114820], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 126, max= 544, per=23.81%, avg=330.77, stdev=106.86, samples=35 iops : min= 7, max= 34, avg=20.11, stdev= 6.84, samples=35 lat (usec) : 50=1.04%, 100=7.42%, 250=2.47%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.69%, 4=6.51%, 10=12.37%, 20=18.10%, 50=40.76% lat (msec) : 100=8.59%, 250=0.78% cpu : usr=0.07%, sys=10.74%, ctx=1694, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144994: Fri Jul 24 21:19:34 2026 read: IOPS=21, BW=352KiB/s (360kB/s)(6032KiB/17159msec) clat (usec): min=39, max=181323, avg=24264.32, stdev=20382.87 lat (usec): min=39, max=181324, avg=24265.67, stdev=20382.97 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 145], | 30.00th=[ 15664], 40.00th=[ 19530], 50.00th=[ 22676], 60.00th=[ 25822], | 70.00th=[ 30278], 80.00th=[ 36439], 90.00th=[ 47449], 95.00th=[ 58459], | 99.00th=[ 85459], 99.50th=[145753], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 512, per=26.39%, avg=348.30, stdev=102.41, samples=33 iops : min= 1, max= 32, avg=21.21, stdev= 6.56, samples=33 write: IOPS=22, BW=365KiB/s (373kB/s)(6256KiB/17159msec); 0 zone resets clat (usec): min=1268, max=217828, avg=20054.20, stdev=22774.81 lat (usec): min=1269, max=217830, avg=20059.54, stdev=22776.78 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2245], 10.00th=[ 2737], 20.00th=[ 4146], | 30.00th=[ 5669], 40.00th=[ 7832], 50.00th=[ 11469], 60.00th=[ 17695], | 70.00th=[ 23987], 80.00th=[ 32637], 90.00th=[ 46924], 95.00th=[ 60031], | 99.00th=[116917], 99.50th=[154141], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 127, max= 727, per=26.31%, avg=365.42, stdev=116.20, samples=33 iops : min= 7, max= 45, avg=22.30, stdev= 7.40, samples=33 lat (usec) : 50=1.04%, 100=7.55%, 250=1.56% lat (msec) : 2=1.95%, 4=7.81%, 10=13.93%, 20=18.88%, 50=39.06% lat (msec) : 100=7.29%, 250=0.91% cpu : usr=0.14%, sys=11.65%, ctx=1681, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1320KiB/s (1352kB/s), 322KiB/s-352KiB/s (329kB/s-360kB/s), io=23.4MiB (24.5MB), run=17159-18140msec WRITE: bw=1389KiB/s (1423kB/s), 333KiB/s-366KiB/s (341kB/s-375kB/s), io=24.6MiB (25.8MB), run=17159-18140msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144995: Fri Jul 24 21:19:57 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(5920KiB/41090msec) clat (msec): min=5, max=252, avg=25.16, stdev=27.40 lat (msec): min=5, max=252, avg=25.16, stdev=27.40 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 33], 90.00th=[ 55], 95.00th=[ 82], | 99.00th=[ 140], 99.50th=[ 159], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 31, max= 383, per=25.13%, avg=146.25, stdev=77.60, samples=79 iops : min= 1, max= 23, avg= 8.34, stdev= 4.90, samples=79 write: IOPS=9, BW=155KiB/s (159kB/s)(6368KiB/41090msec); 0 zone resets clat (msec): min=24, max=219, avg=79.72, stdev=33.12 lat (msec): min=24, max=219, avg=79.73, stdev=33.12 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 42], 10.00th=[ 46], 20.00th=[ 54], | 30.00th=[ 59], 40.00th=[ 66], 50.00th=[ 74], 60.00th=[ 81], | 70.00th=[ 89], 80.00th=[ 104], 90.00th=[ 125], 95.00th=[ 148], | 99.00th=[ 203], 99.50th=[ 209], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 31, max= 316, per=25.15%, avg=154.19, stdev=65.31, samples=81 iops : min= 1, max= 19, avg= 8.84, stdev= 4.14, samples=81 lat (msec) : 10=9.90%, 20=21.74%, 50=19.66%, 100=35.68%, 250=12.89% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.59%, ctx=1418, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144996: Fri Jul 24 21:19:57 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(5744KiB/40713msec) clat (msec): min=4, max=274, avg=24.45, stdev=28.66 lat (msec): min=4, max=274, avg=24.45, stdev=28.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 50], 95.00th=[ 74], | 99.00th=[ 171], 99.50th=[ 243], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 377, per=25.44%, avg=148.08, stdev=90.30, samples=76 iops : min= 1, max= 23, avg= 8.47, stdev= 5.70, samples=76 write: IOPS=10, BW=161KiB/s (165kB/s)(6544KiB/40713msec); 0 zone resets clat (msec): min=25, max=243, avg=77.80, stdev=33.23 lat (msec): min=25, max=243, avg=77.81, stdev=33.23 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 41], 10.00th=[ 45], 20.00th=[ 53], | 30.00th=[ 59], 40.00th=[ 65], 50.00th=[ 69], 60.00th=[ 75], | 70.00th=[ 86], 80.00th=[ 100], 90.00th=[ 122], 95.00th=[ 144], | 99.00th=[ 188], 99.50th=[ 230], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 62, max= 287, per=26.17%, avg=160.40, stdev=62.32, samples=80 iops : min= 3, max= 17, avg= 9.24, stdev= 3.92, samples=80 lat (msec) : 10=10.94%, 20=20.18%, 50=20.05%, 100=37.37%, 250=11.33% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.59%, ctx=1447, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144997: Fri Jul 24 21:19:57 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(6256KiB/39123msec) clat (msec): min=5, max=213, avg=23.55, stdev=24.94 lat (msec): min=5, max=213, avg=23.55, stdev=24.94 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 48], 95.00th=[ 71], | 99.00th=[ 142], 99.50th=[ 186], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 510, per=27.97%, avg=162.76, stdev=104.84, samples=76 iops : min= 1, max= 31, avg= 9.39, stdev= 6.60, samples=76 write: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39123msec); 0 zone resets clat (msec): min=26, max=264, avg=79.05, stdev=36.12 lat (msec): min=26, max=264, avg=79.06, stdev=36.12 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 38], 10.00th=[ 46], 20.00th=[ 51], | 30.00th=[ 58], 40.00th=[ 65], 50.00th=[ 71], 60.00th=[ 78], | 70.00th=[ 89], 80.00th=[ 100], 90.00th=[ 125], 95.00th=[ 159], | 99.00th=[ 226], 99.50th=[ 232], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 63, max= 288, per=25.05%, avg=153.56, stdev=63.55, samples=77 iops : min= 3, max= 18, avg= 8.81, stdev= 4.01, samples=77 lat (msec) : 10=10.55%, 20=23.44%, 50=21.88%, 100=33.46%, 250=10.55% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=2.54%, ctx=1387, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144998: Fri Jul 24 21:19:57 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(6032KiB/40825msec) clat (msec): min=5, max=305, avg=25.45, stdev=29.88 lat (msec): min=5, max=305, avg=25.45, stdev=29.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 54], 95.00th=[ 74], | 99.00th=[ 163], 99.50th=[ 275], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 383, per=25.86%, avg=150.50, stdev=79.42, samples=78 iops : min= 1, max= 23, avg= 8.62, stdev= 4.99, samples=78 write: IOPS=9, BW=153KiB/s (157kB/s)(6256KiB/40825msec); 0 zone resets clat (msec): min=25, max=269, avg=79.31, stdev=34.40 lat (msec): min=25, max=269, avg=79.32, stdev=34.40 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 41], 10.00th=[ 44], 20.00th=[ 52], | 30.00th=[ 59], 40.00th=[ 66], 50.00th=[ 73], 60.00th=[ 80], | 70.00th=[ 88], 80.00th=[ 103], 90.00th=[ 125], 95.00th=[ 148], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 285, per=24.96%, avg=152.99, stdev=62.89, samples=80 iops : min= 1, max= 17, avg= 8.78, stdev= 3.95, samples=80 lat (msec) : 10=8.20%, 20=23.31%, 50=20.83%, 100=35.94%, 250=11.33% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=2.64%, ctx=1482, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=583KiB/s (597kB/s), 141KiB/s-160KiB/s (144kB/s-164kB/s), io=23.4MiB (24.5MB), run=39123-41090msec WRITE: bw=613KiB/s (628kB/s), 153KiB/s-161KiB/s (157kB/s-165kB/s), io=24.6MiB (25.8MB), run=39123-41090msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145012: Fri Jul 24 21:20:10 2026 read: IOPS=1, BW=1953KiB/s (2000kB/s)(7168KiB/3670msec) clat (usec): min=700, max=311163, avg=191628.88, stdev=97990.52 lat (usec): min=701, max=311164, avg=191630.40, stdev=97990.44 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[166724], | 30.00th=[173016], 40.00th=[173016], 50.00th=[200279], 60.00th=[242222], | 70.00th=[242222], 80.00th=[248513], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 2043, max= 4096, per=58.14%, avg=2750.00, stdev=967.53, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=1, BW=1395KiB/s (1429kB/s)(5120KiB/3670msec); 0 zone resets clat (msec): min=311, max=599, avg=408.17, stdev=112.13 lat (msec): min=312, max=599, avg=408.42, stdev=112.05 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1818, max= 2048, per=29.90%, avg=1980.00, stdev=109.24, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=14.42%, ctx=255, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145014: Fri Jul 24 21:20:10 2026 read: IOPS=0, BW=473KiB/s (484kB/s)(2048KiB/4329msec) clat (msec): min=203, max=318, avg=261.00, stdev=81.30 lat (msec): min=203, max=318, avg=261.00, stdev=81.30 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1404, max= 2043, per=36.44%, avg=1723.50, stdev=451.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2365KiB/s (2422kB/s)(10.0MiB/4329msec); 0 zone resets clat (msec): min=111, max=741, avg=357.26, stdev=211.07 lat (msec): min=111, max=741, avg=357.37, stdev=211.06 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 184], | 30.00th=[ 194], 40.00th=[ 215], 50.00th=[ 284], 60.00th=[ 334], | 70.00th=[ 351], 80.00th=[ 506], 90.00th=[ 651], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1818, max= 6144, per=52.26%, avg=3461.00, stdev=2014.00, samples=4 iops : min= 1, max= 6, avg= 2.75, stdev= 2.36, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=15.80%, ctx=228, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145016: Fri Jul 24 21:20:10 2026 read: IOPS=1, BW=1976KiB/s (2023kB/s)(6144KiB/3110msec) clat (usec): min=545, max=341788, avg=118643.24, stdev=145109.40 lat (usec): min=546, max=341789, avg=118644.46, stdev=145109.52 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 734], | 30.00th=[ 734], 40.00th=[ 31851], 50.00th=[ 31851], 60.00th=[ 81265], | 70.00th=[254804], 80.00th=[254804], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 2011, max= 3637, per=54.24%, avg=2565.33, stdev=928.27, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1976KiB/s (2023kB/s)(6144KiB/3110msec); 0 zone resets clat (msec): min=181, max=954, avg=364.79, stdev=293.09 lat (msec): min=181, max=954, avg=364.86, stdev=293.10 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 288], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1818, max= 2727, per=33.18%, avg=2197.67, stdev=472.62, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 100=8.33%, 250=16.67%, 500=41.67%, 1000=8.33% cpu : usr=0.03%, sys=16.66%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145018: Fri Jul 24 21:20:10 2026 read: IOPS=1, BW=1906KiB/s (1952kB/s)(5120KiB/2686msec) clat (usec): min=617, max=338672, avg=101279.53, stdev=147697.33 lat (usec): min=619, max=338673, avg=101280.60, stdev=147697.29 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[ 2868], 40.00th=[ 2868], 50.00th=[ 10159], 60.00th=[ 10159], | 70.00th=[154141], 80.00th=[154141], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 2048, max= 6144, per=86.60%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2669KiB/s (2733kB/s)(7168KiB/2686msec); 0 zone resets clat (msec): min=175, max=524, avg=306.08, stdev=124.07 lat (msec): min=175, max=524, avg=306.19, stdev=124.08 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 300], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 397], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2011, max= 4096, per=45.32%, avg=3001.50, stdev=1129.59, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 20=8.33%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=19.89%, ctx=199, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4731KiB/s (4844kB/s), 473KiB/s-1976KiB/s (484kB/s-2023kB/s), io=20.0MiB (20.0MB), run=2686-4329msec WRITE: bw=6623KiB/s (6782kB/s), 1395KiB/s-2669KiB/s (1429kB/s-2733kB/s), io=28.0MiB (29.4MB), run=2686-4329msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145013: Fri Jul 24 21:20:10 2026 read: IOPS=1, BW=2029KiB/s (2078kB/s)(7168KiB/3532msec) clat (msec): min=66, max=326, avg=171.04, stdev=101.46 lat (msec): min=66, max=326, avg=171.04, stdev=101.46 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 87], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 150], 60.00th=[ 155], | 70.00th=[ 155], 80.00th=[ 296], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 3915, max= 5555, per=100.00%, avg=4735.00, stdev=1159.66, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1450KiB/s (1484kB/s)(5120KiB/3532msec); 0 zone resets clat (msec): min=319, max=718, avg=458.79, stdev=152.05 lat (msec): min=319, max=718, avg=458.91, stdev=152.02 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1939, max= 2048, per=30.17%, avg=1987.75, stdev=45.26, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=7.17%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145015: Fri Jul 24 21:20:10 2026 read: IOPS=0, BW=478KiB/s (489kB/s)(2048KiB/4286msec) clat (msec): min=156, max=362, avg=259.30, stdev=145.56 lat (msec): min=156, max=362, avg=259.30, stdev=145.56 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1939, max= 2031, per=42.19%, avg=1985.00, stdev=65.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2389KiB/s (2447kB/s)(10.0MiB/4286msec); 0 zone resets clat (msec): min=149, max=692, avg=364.40, stdev=186.35 lat (msec): min=149, max=693, avg=364.62, stdev=186.55 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 194], | 30.00th=[ 201], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 321], | 70.00th=[ 338], 80.00th=[ 523], 90.00th=[ 625], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1957, max= 4096, per=40.28%, avg=2653.33, stdev=1043.53, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=25.00% cpu : usr=0.00%, sys=6.07%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145017: Fri Jul 24 21:20:10 2026 read: IOPS=1, BW=1480KiB/s (1515kB/s)(6144KiB/4152msec) clat (msec): min=88, max=661, avg=253.27, stdev=210.33 lat (msec): min=88, max=661, avg=253.27, stdev=210.33 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 209], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1950, max= 3878, per=51.87%, avg=2440.25, stdev=958.56, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1480KiB/s (1515kB/s)(6144KiB/4152msec); 0 zone resets clat (msec): min=169, max=655, avg=427.60, stdev=186.14 lat (msec): min=170, max=655, avg=427.71, stdev=186.15 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 472], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1950, max= 3813, per=36.84%, avg=2427.00, stdev=924.15, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=5.37%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145019: Fri Jul 24 21:20:10 2026 read: IOPS=1, BW=1176KiB/s (1205kB/s)(5120KiB/4352msec) clat (msec): min=63, max=565, avg=230.90, stdev=207.89 lat (msec): min=63, max=565, avg=230.90, stdev=207.89 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 136], 60.00th=[ 136], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 3886, max= 4087, per=84.73%, avg=3986.50, stdev=142.13, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1647KiB/s (1687kB/s)(7168KiB/4352msec); 0 zone resets clat (msec): min=142, max=990, avg=451.22, stdev=355.72 lat (msec): min=142, max=990, avg=451.32, stdev=355.73 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 150], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 334], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 894], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1395, max= 3886, per=36.78%, avg=2423.00, stdev=1301.23, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=4.87%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4706KiB/s (4819kB/s), 478KiB/s-2029KiB/s (489kB/s-2078kB/s), io=20.0MiB (20.0MB), run=3532-4352msec WRITE: bw=6588KiB/s (6746kB/s), 1450KiB/s-2389KiB/s (1484kB/s-2447kB/s), io=28.0MiB (29.4MB), run=3532-4352msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145025: Fri Jul 24 21:20:21 2026 read: IOPS=2, BW=8623KiB/s (8830kB/s)(12.0MiB/1425msec) clat (msec): min=203, max=964, avg=462.98, stdev=434.79 lat (msec): min=203, max=964, avg=462.98, stdev=434.78 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min=12564, max=12564, per=100.00%, avg=12564.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.14%, sys=6.74%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145026: Fri Jul 24 21:20:21 2026 read: IOPS=0, BW=1996KiB/s (2044kB/s)(4096KiB/2052msec) clat (nsec): min=362450k, max=362450k, avg=362450233.00, stdev= 0.00 lat (nsec): min=362451k, max=362451k, avg=362451427.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 6872, max= 6872, per=86.07%, avg=6872.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3992KiB/s (4088kB/s)(8192KiB/2052msec); 0 zone resets clat (msec): min=377, max=1309, avg=843.71, stdev=658.64 lat (msec): min=378, max=1309, avg=844.14, stdev=658.62 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8175, max= 8175, per=65.44%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.53%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145027: Fri Jul 24 21:20:21 2026 write: IOPS=1, BW=4685KiB/s (4797kB/s)(12.0MiB/2623msec); 0 zone resets clat (msec): min=581, max=1318, avg=870.18, stdev=393.50 lat (msec): min=582, max=1318, avg=870.68, stdev=393.48 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8175, max= 8175, per=65.44%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.11%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145028: Fri Jul 24 21:20:21 2026 write: IOPS=1, BW=5231KiB/s (5357kB/s)(12.0MiB/2349msec); 0 zone resets clat (msec): min=233, max=1396, avg=722.50, stdev=603.13 lat (msec): min=234, max=1396, avg=723.43, stdev=602.57 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7670, max= 8062, per=62.97%, avg=7866.00, stdev=277.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=6.60%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7984KiB/s (8176kB/s), 1996KiB/s-8623KiB/s (2044kB/s-8830kB/s), io=16.0MiB (16.8MB), run=1425-2052msec WRITE: bw=12.2MiB/s (12.8MB/s), 3992KiB/s-5231KiB/s (4088kB/s-5357kB/s), io=32.0MiB (33.6MB), run=2052-2623msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145030: Fri Jul 24 21:20:22 2026 read: IOPS=1, BW=7216KiB/s (7389kB/s)(12.0MiB/1703msec) clat (msec): min=531, max=602, avg=566.82, stdev=35.38 lat (msec): min=531, max=602, avg=566.82, stdev=35.38 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 6954, max= 7876, per=100.00%, avg=7415.00, stdev=651.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.24%, sys=17.33%, ctx=491, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145031: Fri Jul 24 21:20:22 2026 read: IOPS=0, BW=1625KiB/s (1664kB/s)(4096KiB/2521msec) clat (nsec): min=629763k, max=629763k, avg=629762538.00, stdev= 0.00 lat (nsec): min=629765k, max=629765k, avg=629764578.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 6330, max= 6330, per=97.40%, avg=6330.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3250KiB/s (3327kB/s)(8192KiB/2521msec); 0 zone resets clat (msec): min=288, max=1601, avg=944.85, stdev=928.68 lat (msec): min=288, max=1601, avg=945.25, stdev=928.70 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.27%, ctx=86, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145032: Fri Jul 24 21:20:22 2026 write: IOPS=1, BW=4931KiB/s (5049kB/s)(12.0MiB/2492msec); 0 zone resets clat (msec): min=529, max=1187, avg=829.51, stdev=332.93 lat (msec): min=530, max=1188, avg=830.22, stdev=332.72 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8126, max= 8175, per=62.71%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.14%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145033: Fri Jul 24 21:20:22 2026 write: IOPS=1, BW=6397KiB/s (6550kB/s)(12.0MiB/1921msec); 0 zone resets clat (msec): min=261, max=1174, avg=638.18, stdev=476.87 lat (msec): min=262, max=1175, avg=639.40, stdev=477.07 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8126, max= 8126, per=62.52%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=4.53%, ctx=29, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6499KiB/s (6655kB/s), 1625KiB/s-7216KiB/s (1664kB/s-7389kB/s), io=16.0MiB (16.8MB), run=1703-2521msec WRITE: bw=12.7MiB/s (13.3MB/s), 3250KiB/s-6397KiB/s (3327kB/s-6550kB/s), io=32.0MiB (33.6MB), run=1921-2521msec