== sanity test 398b: DIO and buffer IO race ============== 01:04:11 (1789189451) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.74682 s, 18.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182626: Sat Sep 12 01:05:04 2026 read: IOPS=33, BW=133KiB/s (136kB/s)(5992KiB/45058msec) clat (usec): min=33, max=656959, avg=16272.54, stdev=18520.76 lat (usec): min=34, max=656960, avg=16273.11, stdev=18520.76 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 6325], 10.00th=[ 7439], 20.00th=[ 9110], | 30.00th=[ 10683], 40.00th=[ 12387], 50.00th=[ 14615], 60.00th=[ 16581], | 70.00th=[ 18744], 80.00th=[ 21365], 90.00th=[ 26346], 95.00th=[ 31065], | 99.00th=[ 42206], 99.50th=[ 50594], 99.90th=[ 71828], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 6, max= 255, per=24.88%, avg=132.37, stdev=34.68, samples=89 iops : min= 1, max= 63, avg=32.69, stdev= 8.70, samples=89 write: IOPS=34, BW=140KiB/s (143kB/s)(6296KiB/45058msec); 0 zone resets clat (usec): min=623, max=112024, avg=13019.28, stdev=10467.69 lat (usec): min=624, max=112025, avg=13020.09, stdev=10467.76 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 2147], 10.00th=[ 2573], 20.00th=[ 3294], | 30.00th=[ 5407], 40.00th=[ 8586], 50.00th=[ 10945], 60.00th=[ 13566], | 70.00th=[ 16450], 80.00th=[ 20579], 90.00th=[ 26608], 95.00th=[ 31851], | 99.00th=[ 45351], 99.50th=[ 50594], 99.90th=[ 72877], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 64, max= 231, per=25.13%, avg=139.98, stdev=33.79, samples=88 iops : min= 16, max= 57, avg=34.59, stdev= 8.45, samples=88 lat (usec) : 50=0.03%, 100=0.52%, 250=0.42%, 500=0.07%, 750=0.16% lat (usec) : 1000=0.36% lat (msec) : 2=1.56%, 4=10.68%, 10=22.23%, 20=41.05%, 50=22.40% lat (msec) : 100=0.46%, 250=0.03%, 750=0.03% cpu : usr=0.10%, sys=23.18%, ctx=8570, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182627: Sat Sep 12 01:05:04 2026 read: IOPS=33, BW=133KiB/s (136kB/s)(5940KiB/44719msec) clat (usec): min=25, max=99209, avg=15607.67, stdev=8670.32 lat (usec): min=26, max=99210, avg=15609.06, stdev=8669.79 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 6521], 10.00th=[ 7701], 20.00th=[ 9110], | 30.00th=[10552], 40.00th=[11863], 50.00th=[13829], 60.00th=[16057], | 70.00th=[18220], 80.00th=[20841], 90.00th=[25560], 95.00th=[31327], | 99.00th=[46400], 99.50th=[48497], 99.90th=[83362], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 6, max= 208, per=24.97%, avg=132.82, stdev=32.42, samples=89 iops : min= 1, max= 52, avg=32.80, stdev= 8.21, samples=89 write: IOPS=35, BW=142KiB/s (145kB/s)(6348KiB/44719msec); 0 zone resets clat (usec): min=602, max=651512, avg=13455.51, stdev=19166.21 lat (usec): min=602, max=651513, avg=13456.19, stdev=19166.20 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1909], 10.00th=[ 2507], 20.00th=[ 3228], | 30.00th=[ 5669], 40.00th=[ 8586], 50.00th=[ 10552], 60.00th=[ 12780], | 70.00th=[ 16057], 80.00th=[ 21365], 90.00th=[ 27919], 95.00th=[ 33817], | 99.00th=[ 45351], 99.50th=[ 50070], 99.90th=[ 63701], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 13, max= 287, per=25.49%, avg=141.96, stdev=40.72, samples=89 iops : min= 3, max= 71, avg=35.09, stdev=10.13, samples=89 lat (usec) : 50=0.10%, 100=0.52%, 250=0.52%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.36% lat (msec) : 2=2.34%, 4=10.03%, 10=23.14%, 20=40.33%, 50=22.04% lat (msec) : 100=0.46%, 750=0.03% cpu : usr=0.10%, sys=23.26%, ctx=8466, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182628: Sat Sep 12 01:05:04 2026 read: IOPS=33, BW=136KiB/s (139kB/s)(6028KiB/44339msec) clat (usec): min=47, max=655529, avg=16263.90, stdev=18640.37 lat (usec): min=47, max=655529, avg=16264.54, stdev=18640.38 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 5932], 10.00th=[ 7504], 20.00th=[ 9372], | 30.00th=[ 10814], 40.00th=[ 12125], 50.00th=[ 14222], 60.00th=[ 16319], | 70.00th=[ 19006], 80.00th=[ 21627], 90.00th=[ 26870], 95.00th=[ 31065], | 99.00th=[ 45876], 99.50th=[ 52167], 99.90th=[ 87557], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 6, max= 208, per=25.54%, avg=135.87, stdev=33.72, samples=88 iops : min= 1, max= 52, avg=33.57, stdev= 8.43, samples=88 write: IOPS=35, BW=141KiB/s (145kB/s)(6260KiB/44339msec); 0 zone resets clat (usec): min=643, max=65260, avg=12557.41, stdev=9653.71 lat (usec): min=644, max=65260, avg=12558.13, stdev=9653.72 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 2147], 10.00th=[ 2606], 20.00th=[ 3294], | 30.00th=[ 5276], 40.00th=[ 8291], 50.00th=[10683], 60.00th=[12911], | 70.00th=[15795], 80.00th=[20317], 90.00th=[26084], 95.00th=[31327], | 99.00th=[41157], 99.50th=[44303], 99.90th=[55837], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 20, max= 216, per=25.34%, avg=141.14, stdev=37.19, samples=88 iops : min= 5, max= 54, avg=34.89, stdev= 9.37, samples=88 lat (usec) : 50=0.07%, 100=0.68%, 250=0.62%, 500=0.07%, 750=0.23% lat (usec) : 1000=0.26% lat (msec) : 2=1.56%, 4=10.87%, 10=21.94%, 20=41.02%, 50=22.17% lat (msec) : 100=0.49%, 750=0.03% cpu : usr=0.12%, sys=23.32%, ctx=8546, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182629: Sat Sep 12 01:05:04 2026 read: IOPS=33, BW=134KiB/s (137kB/s)(6052KiB/45128msec) clat (usec): min=33, max=686444, avg=16225.51, stdev=19057.80 lat (usec): min=34, max=686445, avg=16226.07, stdev=19057.81 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 6521], 10.00th=[ 7635], 20.00th=[ 9110], | 30.00th=[ 10683], 40.00th=[ 12518], 50.00th=[ 14484], 60.00th=[ 16712], | 70.00th=[ 19006], 80.00th=[ 21365], 90.00th=[ 25297], 95.00th=[ 29754], | 99.00th=[ 44827], 99.50th=[ 52167], 99.90th=[ 68682], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 6, max= 192, per=25.05%, avg=133.26, stdev=31.63, samples=89 iops : min= 1, max= 48, avg=32.91, stdev= 7.96, samples=89 write: IOPS=34, BW=138KiB/s (142kB/s)(6236KiB/45128msec); 0 zone resets clat (usec): min=610, max=94451, avg=13082.07, stdev=10205.10 lat (usec): min=610, max=94452, avg=13084.66, stdev=10204.64 clat percentiles (usec): | 1.00th=[ 848], 5.00th=[ 1926], 10.00th=[ 2540], 20.00th=[ 3359], | 30.00th=[ 5866], 40.00th=[ 8848], 50.00th=[10945], 60.00th=[13435], | 70.00th=[16450], 80.00th=[21103], 90.00th=[27395], 95.00th=[32375], | 99.00th=[43254], 99.50th=[46924], 99.90th=[64750], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 27, max= 208, per=24.72%, avg=137.71, stdev=34.41, samples=89 iops : min= 6, max= 52, avg=34.02, stdev= 8.65, samples=89 lat (usec) : 50=0.16%, 100=0.29%, 250=0.55%, 750=0.42%, 1000=0.29% lat (msec) : 2=1.99%, 4=9.70%, 10=22.49%, 20=40.40%, 50=23.31% lat (msec) : 100=0.36%, 750=0.03% cpu : usr=0.12%, sys=23.14%, ctx=8653, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=532KiB/s (545kB/s), 133KiB/s-136KiB/s (136kB/s-139kB/s), io=23.4MiB (24.6MB), run=44339-45128msec WRITE: bw=557KiB/s (570kB/s), 138KiB/s-142KiB/s (142kB/s-145kB/s), io=24.6MiB (25.7MB), run=44339-45128msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182631: Sat Sep 12 01:05:10 2026 read: IOPS=29, BW=118KiB/s (121kB/s)(5992KiB/50636msec) clat (msec): min=2, max=660, avg=14.35, stdev=20.59 lat (msec): min=2, max=660, avg=14.35, stdev=20.59 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 40], | 99.00th=[ 55], 99.50th=[ 62], 99.90th=[ 85], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 32, max= 456, per=24.76%, avg=117.37, stdev=91.86, samples=99 iops : min= 8, max= 114, avg=29.07, stdev=23.03, samples=99 write: IOPS=31, BW=124KiB/s (127kB/s)(6296KiB/50636msec); 0 zone resets clat (usec): min=3702, max=89113, avg=18494.09, stdev=13839.02 lat (usec): min=3703, max=89115, avg=18494.89, stdev=13839.12 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 4948], 10.00th=[ 5342], 20.00th=[ 6063], | 30.00th=[ 7242], 40.00th=[10945], 50.00th=[15139], 60.00th=[19268], | 70.00th=[23462], 80.00th=[29230], 90.00th=[36963], 95.00th=[45351], | 99.00th=[64750], 99.50th=[71828], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 48, max= 472, per=24.84%, avg=123.19, stdev=93.84, samples=99 iops : min= 12, max= 118, avg=30.53, stdev=23.54, samples=99 lat (msec) : 4=6.48%, 10=37.50%, 20=25.98%, 50=27.77%, 100=2.25% lat (msec) : 750=0.03% cpu : usr=0.11%, sys=10.45%, ctx=5230, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182632: Sat Sep 12 01:05:10 2026 read: IOPS=29, BW=117KiB/s (120kB/s)(5940KiB/50647msec) clat (msec): min=2, max=693, avg=14.59, stdev=21.74 lat (msec): min=2, max=693, avg=14.59, stdev=21.74 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 40], | 99.00th=[ 61], 99.50th=[ 69], 99.90th=[ 90], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 24, max= 472, per=24.66%, avg=116.89, stdev=96.16, samples=99 iops : min= 6, max= 118, avg=28.95, stdev=24.12, samples=99 write: IOPS=31, BW=125KiB/s (128kB/s)(6348KiB/50647msec); 0 zone resets clat (msec): min=3, max=127, avg=18.24, stdev=13.66 lat (msec): min=3, max=127, avg=18.24, stdev=13.66 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 15], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 38], 95.00th=[ 45], | 99.00th=[ 62], 99.50th=[ 70], 99.90th=[ 85], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 39, max= 448, per=24.87%, avg=123.35, stdev=93.16, samples=99 iops : min= 9, max= 112, avg=30.57, stdev=23.36, samples=99 lat (msec) : 4=7.06%, 10=37.01%, 20=25.52%, 50=27.99%, 100=2.34% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=10.35%, ctx=5059, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182633: Sat Sep 12 01:05:10 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(6028KiB/50605msec) clat (usec): min=2416, max=87810, avg=14021.22, stdev=12232.37 lat (usec): min=2417, max=87811, avg=14021.79, stdev=12232.41 clat percentiles (usec): | 1.00th=[ 2868], 5.00th=[ 3523], 10.00th=[ 3884], 20.00th=[ 4359], | 30.00th=[ 5080], 40.00th=[ 7701], 50.00th=[10290], 60.00th=[12780], | 70.00th=[15664], 80.00th=[22152], 90.00th=[30540], 95.00th=[39584], | 99.00th=[56886], 99.50th=[64750], 99.90th=[78119], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 48, max= 456, per=24.97%, avg=118.34, stdev=93.53, samples=99 iops : min= 12, max= 114, avg=29.31, stdev=23.44, samples=99 write: IOPS=30, BW=124KiB/s (127kB/s)(6260KiB/50605msec); 0 zone resets clat (msec): min=3, max=696, avg=18.81, stdev=21.95 lat (msec): min=3, max=696, avg=18.81, stdev=21.95 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 62], 99.50th=[ 67], 99.90th=[ 128], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 39, max= 440, per=24.74%, avg=122.71, stdev=93.67, samples=99 iops : min= 9, max= 110, avg=30.40, stdev=23.51, samples=99 lat (msec) : 4=6.02%, 10=37.11%, 20=26.50%, 50=27.99%, 100=2.31% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.08%, sys=10.55%, ctx=5077, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182634: Sat Sep 12 01:05:10 2026 read: IOPS=29, BW=120KiB/s (123kB/s)(6052KiB/50494msec) clat (usec): min=2026, max=87853, avg=13735.41, stdev=11792.30 lat (usec): min=2027, max=87854, avg=13735.92, stdev=11792.34 clat percentiles (usec): | 1.00th=[ 3032], 5.00th=[ 3523], 10.00th=[ 3851], 20.00th=[ 4490], | 30.00th=[ 5407], 40.00th=[ 7898], 50.00th=[ 9896], 60.00th=[12125], | 70.00th=[15139], 80.00th=[21627], 90.00th=[31327], 95.00th=[38011], | 99.00th=[53740], 99.50th=[57934], 99.90th=[80217], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 40, max= 440, per=25.24%, avg=119.64, stdev=91.54, samples=99 iops : min= 10, max= 110, avg=29.64, stdev=22.94, samples=99 write: IOPS=30, BW=123KiB/s (126kB/s)(6236KiB/50494msec); 0 zone resets clat (msec): min=3, max=695, avg=19.03, stdev=21.99 lat (msec): min=3, max=695, avg=19.03, stdev=21.99 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 39], 95.00th=[ 45], | 99.00th=[ 64], 99.50th=[ 72], 99.90th=[ 94], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 48, max= 440, per=24.85%, avg=123.27, stdev=92.60, samples=99 iops : min= 12, max= 110, avg=30.55, stdev=23.24, samples=99 lat (msec) : 4=6.41%, 10=37.53%, 20=25.78%, 50=28.16%, 100=2.08% lat (msec) : 750=0.03% cpu : usr=0.12%, sys=10.51%, ctx=5177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=474KiB/s (485kB/s), 117KiB/s-120KiB/s (120kB/s-123kB/s), io=23.4MiB (24.6MB), run=50494-50647msec WRITE: bw=496KiB/s (508kB/s), 123KiB/s-125KiB/s (126kB/s-128kB/s), io=24.6MiB (25.7MB), run=50494-50647msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182653: Sat Sep 12 01:05:27 2026 read: IOPS=30, BW=487KiB/s (499kB/s)(5920KiB/12158msec) clat (usec): min=89, max=59395, avg=16685.42, stdev=7812.26 lat (usec): min=89, max=59396, avg=16686.09, stdev=7812.25 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 7701], 10.00th=[ 8979], 20.00th=[10552], | 30.00th=[12256], 40.00th=[13566], 50.00th=[15401], 60.00th=[17171], | 70.00th=[20317], 80.00th=[22676], 90.00th=[26608], 95.00th=[29754], | 99.00th=[41681], 99.50th=[44827], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 288, max= 638, per=24.88%, avg=486.62, stdev=88.00, samples=24 iops : min= 18, max= 39, avg=29.92, stdev= 5.49, samples=24 write: IOPS=32, BW=524KiB/s (536kB/s)(6368KiB/12158msec); 0 zone resets clat (usec): min=1349, max=63812, avg=14909.41, stdev=9701.57 lat (usec): min=1350, max=63813, avg=14910.42, stdev=9701.54 clat percentiles (usec): | 1.00th=[ 2212], 5.00th=[ 3982], 10.00th=[ 4490], 20.00th=[ 6325], | 30.00th=[ 8586], 40.00th=[10552], 50.00th=[12518], 60.00th=[15270], | 70.00th=[18220], 80.00th=[21890], 90.00th=[28443], 95.00th=[33424], | 99.00th=[47973], 99.50th=[50594], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 256, max= 701, per=25.37%, avg=522.17, stdev=118.47, samples=24 iops : min= 16, max= 43, avg=32.12, stdev= 7.42, samples=24 lat (usec) : 100=0.52%, 250=1.04% lat (msec) : 2=0.39%, 4=2.47%, 10=23.18%, 20=44.27%, 50=27.73% lat (msec) : 100=0.39% cpu : usr=0.04%, sys=26.72%, ctx=2840, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182654: Sat Sep 12 01:05:27 2026 read: IOPS=29, BW=469KiB/s (480kB/s)(5744KiB/12242msec) clat (usec): min=92, max=53191, avg=17061.14, stdev=7968.46 lat (usec): min=92, max=53191, avg=17061.64, stdev=7968.46 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 6259], 10.00th=[ 8291], 20.00th=[11207], | 30.00th=[13042], 40.00th=[14615], 50.00th=[16319], 60.00th=[18220], | 70.00th=[20317], 80.00th=[22676], 90.00th=[26346], 95.00th=[30802], | 99.00th=[38536], 99.50th=[50070], 99.90th=[53216], 99.95th=[53216], | 99.99th=[53216] bw ( KiB/s): min= 286, max= 608, per=23.80%, avg=465.62, stdev=89.04, samples=24 iops : min= 17, max= 38, avg=28.62, stdev= 5.62, samples=24 write: IOPS=33, BW=535KiB/s (547kB/s)(6544KiB/12242msec); 0 zone resets clat (usec): min=1137, max=57920, avg=14890.04, stdev=9961.35 lat (usec): min=1138, max=57921, avg=14890.99, stdev=9961.39 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3687], 10.00th=[ 4228], 20.00th=[ 5407], | 30.00th=[ 8979], 40.00th=[10814], 50.00th=[12911], 60.00th=[15008], | 70.00th=[17957], 80.00th=[22414], 90.00th=[28967], 95.00th=[35914], | 99.00th=[45876], 99.50th=[48497], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 352, max= 733, per=25.71%, avg=529.12, stdev=109.19, samples=24 iops : min= 22, max= 45, avg=32.58, stdev= 6.91, samples=24 lat (usec) : 100=0.52%, 250=1.43% lat (msec) : 2=0.65%, 4=4.04%, 10=20.31%, 20=44.79%, 50=27.86% lat (msec) : 100=0.39% cpu : usr=0.11%, sys=26.65%, ctx=2924, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182655: Sat Sep 12 01:05:27 2026 read: IOPS=32, BW=513KiB/s (526kB/s)(6256KiB/12187msec) clat (usec): min=80, max=55888, avg=16791.81, stdev=8414.33 lat (usec): min=80, max=55888, avg=16792.43, stdev=8414.35 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 128], 10.00th=[ 8094], 20.00th=[10290], | 30.00th=[12125], 40.00th=[14222], 50.00th=[16319], 60.00th=[17957], | 70.00th=[20317], 80.00th=[22938], 90.00th=[26608], 95.00th=[30802], | 99.00th=[41157], 99.50th=[50070], 99.90th=[55837], 99.95th=[55837], | 99.99th=[55837] bw ( KiB/s): min= 382, max= 702, per=26.37%, avg=515.71, stdev=96.34, samples=24 iops : min= 23, max= 43, avg=31.75, stdev= 6.05, samples=24 write: IOPS=30, BW=495KiB/s (507kB/s)(6032KiB/12187msec); 0 zone resets clat (usec): min=1229, max=54117, avg=14795.09, stdev=9901.29 lat (usec): min=1230, max=54118, avg=14796.11, stdev=9901.27 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3687], 10.00th=[ 4228], 20.00th=[ 5473], | 30.00th=[ 8455], 40.00th=[10552], 50.00th=[11994], 60.00th=[14222], | 70.00th=[18744], 80.00th=[22414], 90.00th=[29754], 95.00th=[33817], | 99.00th=[44303], 99.50th=[49546], 99.90th=[54264], 99.95th=[54264], | 99.99th=[54264] bw ( KiB/s): min= 256, max= 768, per=23.91%, avg=492.00, stdev=133.38, samples=24 iops : min= 16, max= 48, avg=30.25, stdev= 8.39, samples=24 lat (usec) : 100=0.91%, 250=1.82% lat (msec) : 2=0.65%, 4=3.12%, 10=20.57%, 20=43.62%, 50=29.04% lat (msec) : 100=0.26% cpu : usr=0.07%, sys=26.22%, ctx=2824, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182656: Sat Sep 12 01:05:27 2026 read: IOPS=31, BW=502KiB/s (514kB/s)(6032KiB/12018msec) clat (usec): min=30, max=44955, avg=16237.68, stdev=8105.51 lat (usec): min=31, max=44955, avg=16238.22, stdev=8105.51 clat percentiles (usec): | 1.00th=[ 84], 5.00th=[ 114], 10.00th=[ 7832], 20.00th=[10028], | 30.00th=[12125], 40.00th=[13829], 50.00th=[15401], 60.00th=[17171], | 70.00th=[20055], 80.00th=[22414], 90.00th=[26084], 95.00th=[30540], | 99.00th=[41157], 99.50th=[43779], 99.90th=[44827], 99.95th=[44827], | 99.99th=[44827] bw ( KiB/s): min= 287, max= 672, per=25.52%, avg=499.09, stdev=70.88, samples=23 iops : min= 17, max= 42, avg=30.70, stdev= 4.63, samples=23 write: IOPS=32, BW=521KiB/s (533kB/s)(6256KiB/12018msec); 0 zone resets clat (usec): min=1117, max=57621, avg=14911.66, stdev=9842.46 lat (usec): min=1118, max=57623, avg=14912.91, stdev=9842.78 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 3752], 10.00th=[ 4228], 20.00th=[ 5211], | 30.00th=[ 7832], 40.00th=[10683], 50.00th=[13042], 60.00th=[15533], | 70.00th=[19006], 80.00th=[23725], 90.00th=[28443], 95.00th=[32113], | 99.00th=[44303], 99.50th=[52691], 99.90th=[57410], 99.95th=[57410], | 99.99th=[57410] bw ( KiB/s): min= 352, max= 704, per=25.43%, avg=523.26, stdev=97.08, samples=23 iops : min= 22, max= 44, avg=32.22, stdev= 6.04, samples=23 lat (usec) : 50=0.13%, 100=1.56%, 250=1.43%, 500=0.13% lat (msec) : 2=0.65%, 4=3.12%, 10=21.35%, 20=42.71%, 50=28.65% lat (msec) : 100=0.26% cpu : usr=0.12%, sys=26.43%, ctx=2749, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1957KiB/s (2004kB/s), 469KiB/s-513KiB/s (480kB/s-526kB/s), io=23.4MiB (24.5MB), run=12018-12242msec WRITE: bw=2058KiB/s (2108kB/s), 495KiB/s-535KiB/s (507kB/s-547kB/s), io=24.6MiB (25.8MB), run=12018-12242msec fio: pid=182658, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=182658: Sat Sep 12 01:05:29 2026 read: IOPS=25, BW=413KiB/s (423kB/s)(5472KiB/13249msec) clat (usec): min=3294, max=62167, avg=16403.17, stdev=11297.09 lat (usec): min=3295, max=62167, avg=16403.77, stdev=11297.11 clat percentiles (usec): | 1.00th=[ 3589], 5.00th=[ 4621], 10.00th=[ 5473], 20.00th=[ 6849], | 30.00th=[ 8586], 40.00th=[10421], 50.00th=[12911], 60.00th=[15926], | 70.00th=[19792], 80.00th=[25560], 90.00th=[34341], 95.00th=[39584], | 99.00th=[51643], 99.50th=[57410], 99.90th=[62129], 99.95th=[62129], | 99.99th=[62129] bw ( KiB/s): min= 222, max= 1120, per=23.40%, avg=407.15, stdev=211.56, samples=26 iops : min= 13, max= 70, avg=24.96, stdev=13.37, samples=26 write: IOPS=28, BW=448KiB/s (459kB/s)(5936KiB/13249msec); 0 zone resets clat (usec): min=5362, max=66579, avg=20388.13, stdev=12407.15 lat (usec): min=5363, max=66580, avg=20389.38, stdev=12407.16 clat percentiles (usec): | 1.00th=[ 5604], 5.00th=[ 6456], 10.00th=[ 7111], 20.00th=[ 9372], | 30.00th=[11731], 40.00th=[14222], 50.00th=[17171], 60.00th=[20579], | 70.00th=[24511], 80.00th=[31589], 90.00th=[38011], 95.00th=[43779], | 99.00th=[56361], 99.50th=[64226], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 255, max= 1248, per=24.16%, avg=443.08, stdev=224.36, samples=26 iops : min= 15, max= 78, avg=27.19, stdev=14.15, samples=26 lat (msec) : 4=0.56%, 10=29.41%, 20=33.89%, 50=33.89%, 100=2.10% cpu : usr=0.04%, sys=11.49%, ctx=1241, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=343,371,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182659: Sat Sep 12 01:05:29 2026 read: IOPS=26, BW=425KiB/s (436kB/s)(5744KiB/13504msec) clat (usec): min=2553, max=51451, avg=15417.72, stdev=10956.04 lat (usec): min=2554, max=51451, avg=15418.50, stdev=10956.03 clat percentiles (usec): | 1.00th=[ 2900], 5.00th=[ 4228], 10.00th=[ 4948], 20.00th=[ 6456], | 30.00th=[ 8291], 40.00th=[10028], 50.00th=[11731], 60.00th=[13435], | 70.00th=[17433], 80.00th=[24511], 90.00th=[33817], 95.00th=[39584], | 99.00th=[45351], 99.50th=[50070], 99.90th=[51643], 99.95th=[51643], | 99.99th=[51643] bw ( KiB/s): min= 192, max= 1024, per=23.30%, avg=405.50, stdev=192.21, samples=26 iops : min= 12, max= 64, avg=24.85, stdev=12.13, samples=26 write: IOPS=30, BW=485KiB/s (496kB/s)(6544KiB/13504msec); 0 zone resets clat (usec): min=3916, max=80766, avg=19292.55, stdev=12434.18 lat (usec): min=3917, max=80768, avg=19294.02, stdev=12433.97 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5932], 10.00th=[ 6980], 20.00th=[ 8586], | 30.00th=[10290], 40.00th=[12649], 50.00th=[15139], 60.00th=[19530], | 70.00th=[24773], 80.00th=[29754], 90.00th=[36963], 95.00th=[42206], | 99.00th=[58459], 99.50th=[63177], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 255, max= 1248, per=24.70%, avg=453.04, stdev=224.87, samples=26 iops : min= 15, max= 78, avg=27.81, stdev=14.20, samples=26 lat (msec) : 4=1.69%, 10=32.03%, 20=34.11%, 50=30.86%, 100=1.30% cpu : usr=0.09%, sys=11.75%, ctx=1379, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182660: Sat Sep 12 01:05:29 2026 read: IOPS=29, BW=464KiB/s (476kB/s)(6256KiB/13469msec) clat (usec): min=2313, max=70779, avg=14668.44, stdev=10773.19 lat (usec): min=2313, max=70779, avg=14669.22, stdev=10773.15 clat percentiles (usec): | 1.00th=[ 3294], 5.00th=[ 4178], 10.00th=[ 4817], 20.00th=[ 6063], | 30.00th=[ 7701], 40.00th=[ 9503], 50.00th=[11207], 60.00th=[13173], | 70.00th=[15926], 80.00th=[21890], 90.00th=[31327], 95.00th=[39060], | 99.00th=[47449], 99.50th=[57410], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 255, max= 1504, per=25.59%, avg=445.35, stdev=266.90, samples=26 iops : min= 15, max= 94, avg=27.35, stdev=16.85, samples=26 write: IOPS=27, BW=448KiB/s (459kB/s)(6032KiB/13469msec); 0 zone resets clat (usec): min=4045, max=82038, avg=20331.68, stdev=12891.63 lat (usec): min=4046, max=82040, avg=20332.99, stdev=12891.66 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5997], 10.00th=[ 6849], 20.00th=[ 8225], | 30.00th=[11207], 40.00th=[13173], 50.00th=[17695], 60.00th=[22152], | 70.00th=[25822], 80.00th=[29754], 90.00th=[38011], 95.00th=[43779], | 99.00th=[60556], 99.50th=[61604], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 224, max= 1184, per=23.00%, avg=421.73, stdev=203.36, samples=26 iops : min= 14, max= 74, avg=25.85, stdev=12.83, samples=26 lat (msec) : 4=1.69%, 10=33.07%, 20=31.90%, 50=31.64%, 100=1.69% cpu : usr=0.07%, sys=11.52%, ctx=1360, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182661: Sat Sep 12 01:05:29 2026 read: IOPS=28, BW=449KiB/s (460kB/s)(6032KiB/13427msec) clat (usec): min=3092, max=65399, avg=15234.49, stdev=11558.80 lat (usec): min=3093, max=65399, avg=15235.17, stdev=11558.77 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 4293], 10.00th=[ 5014], 20.00th=[ 6128], | 30.00th=[ 7767], 40.00th=[ 9110], 50.00th=[10945], 60.00th=[13960], | 70.00th=[17957], 80.00th=[23462], 90.00th=[32375], 95.00th=[39584], | 99.00th=[52167], 99.50th=[62653], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 192, max= 1248, per=24.54%, avg=427.00, stdev=227.27, samples=26 iops : min= 12, max= 78, avg=26.19, stdev=14.36, samples=26 write: IOPS=29, BW=466KiB/s (477kB/s)(6256KiB/13427msec); 0 zone resets clat (usec): min=5019, max=80659, avg=19492.00, stdev=12706.69 lat (usec): min=5020, max=80660, avg=19493.34, stdev=12706.69 clat percentiles (usec): | 1.00th=[ 5604], 5.00th=[ 6390], 10.00th=[ 6980], 20.00th=[ 8455], | 30.00th=[10945], 40.00th=[12911], 50.00th=[15926], 60.00th=[19006], | 70.00th=[23462], 80.00th=[30278], 90.00th=[35914], 95.00th=[43254], | 99.00th=[57934], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 254, max= 1216, per=24.54%, avg=450.12, stdev=209.87, samples=26 iops : min= 15, max= 76, avg=27.62, stdev=13.29, samples=26 lat (msec) : 4=1.56%, 10=34.64%, 20=32.03%, 50=29.17%, 100=2.60% cpu : usr=0.07%, sys=11.79%, ctx=1400, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1741KiB/s (1782kB/s), 413KiB/s-464KiB/s (423kB/s-476kB/s), io=22.0MiB (24.1MB), run=13249-13504msec WRITE: bw=1834KiB/s (1878kB/s), 448KiB/s-485KiB/s (459kB/s-496kB/s), io=24.2MiB (25.4MB), run=13249-13504msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182670: Sat Sep 12 01:05:38 2026 read: IOPS=2, BW=2821KiB/s (2889kB/s)(7168KiB/2541msec) clat (msec): min=57, max=182, avg=100.33, stdev=51.70 lat (msec): min=57, max=182, avg=100.33, stdev=51.70 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 59], | 30.00th=[ 64], 40.00th=[ 64], 50.00th=[ 87], 60.00th=[ 90], | 70.00th=[ 90], 80.00th=[ 165], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1976, max= 5796, per=53.82%, avg=3257.33, stdev=2198.58, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=2015KiB/s (2063kB/s)(5120KiB/2541msec); 0 zone resets clat (msec): min=68, max=579, avg=364.21, stdev=198.11 lat (msec): min=68, max=579, avg=364.28, stdev=198.11 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2000, max= 3908, per=34.87%, avg=2954.00, stdev=1349.16, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=50.00%, 250=16.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=23.19%, ctx=322, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182673: Sat Sep 12 01:05:38 2026 read: IOPS=0, BW=667KiB/s (683kB/s)(2048KiB/3072msec) clat (msec): min=137, max=449, avg=293.69, stdev=220.66 lat (msec): min=137, max=449, avg=293.69, stdev=220.67 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1996, max= 2000, per=33.01%, avg=1998.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3333KiB/s (3413kB/s)(10.0MiB/3072msec); 0 zone resets clat (msec): min=71, max=436, avg=240.04, stdev=106.09 lat (msec): min=71, max=436, avg=240.10, stdev=106.09 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 118], | 30.00th=[ 174], 40.00th=[ 199], 50.00th=[ 247], 60.00th=[ 253], | 70.00th=[ 271], 80.00th=[ 313], 90.00th=[ 321], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1996, max= 3953, per=34.99%, avg=2964.25, stdev=1115.88, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.03%, sys=26.73%, ctx=291, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182674: Sat Sep 12 01:05:38 2026 read: IOPS=1, BW=1816KiB/s (1859kB/s)(6144KiB/3384msec) clat (msec): min=68, max=604, avg=261.04, rand-rw: (groupid=0, jobs=1): err= 0: pid=182668: Sat Sep 12 01:05:38 2026 read: IOPS=3, BW=3102KiB/s (3176kB/s)(7168KiB/2311msec) clat (msec): min=116, max=210, avg=149.40, stdev=33.96 lat (msec): min=116, max=210, avg=149.40, stdev=33.96 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 117], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 150], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 211], | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 1954, max= 5545, per=63.41%, avg=3859.33, stdev=1805.55, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2215KiB/s (2269kB/s)(5120KiB/2311msec); 0 zone resets clat (msec): min=150, max=390, avg=249.22, stdev=93.82 lat (msec): min=150, max=390, avg=249.29, stdev=93.81 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1954, max= 5930, per=38.82%, avg=3307.67, stdev=2271.40, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=83.33%, 500=16.67% cpu : usr=0.00%, sys=52.29%, ctx=1286, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182669: Sat Sep 12 01:05:38 2026 read: IOPS=0, BW=684KiB/s (701kB/s)(2048KiB/2992msec) clat (msec): min=129, max=181, avg=155.44, stdev=36.53 lat (msec): min=129, max=181, avg=155.44, stdev=36.53 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1841, max= 1954, per=31.18%, avg=1897.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3422KiB/s (3505kB/s)(10.0MiB/2992msec); 0 zone resets clat (msec): min=137, max=545, avg=263.37, stdev=141.07 lat (msec): min=137, max=545, avg=263.43, stdev=141.07 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 148], | 30.00th=[ 176], 40.00th=[ 184], 50.00th=[ 192], 60.00th=[ 241], | 70.00th=[ 247], 80.00th=[ 279], 90.00th=[ 489], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 3953, max= 6119, per=55.02%, avg=4688.00, stdev=1239.44, samples=3 iops : min= 3, max= 5, avg= 3.67, stdev= 1.15, samples=3 lat (msec) : 250=75.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=46.64%, ctx=362, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182671: Sat Sep 12 01:05:38 2026 read: IOPS=1, BW=1826KiB/s (1870kB/s)(6144KiB/3365msec) clat (usec): min=468, max=1440.1k, avg=298418.03, stdev=56525 stdev=208.52 4.24 lat (usec): min=468, max=1440.1k, avg=298418.96, stdev=565254.44 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], | 20.00th=[ 523], 30.00th=[ 523], 40.00th=[ 9503], | 50.00th=[ 9503], 60.00th=[ 162530], 70.00th=[ 177210], | 80.00th=[ 177210], 90.00th=[1434452], 95.00th=[1434452], | 99.00th=[1434452], 99.50th=[1434452], 99.90th=[1434452], | 99.95th=[1434452], 99.99th=[1434452] bw ( KiB/s): min= 1954, max= 4079, per=54.69%, avg=3328.67, stdev=1192.16, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1826KiB/s (1870kB/s)(6144KiB/3365msec); 0 zone resets clat (msec): min=130, max=513, avg=256.54, stdev=137.95 lat (msec): min=130, max=513, avg=256.60, stdev=137.95 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 245], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1976, max= 3908, per=34.13%, avg=2908.25, stdev=1043.55, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=35.08%, ctx=758, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182672: Sat Sep 12 01:05:38 2026 read: IOPS=2, BW=2196KiB/s (2248kB/s)(5120KiB/2332msec) clat (usec): min=349, max=319993, avg=95995.36, stdev=142743.47 lat (usec): min=351, max=319994, avg=95996.36, stdev=142743.39 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 449], 40.00th=[ 449], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[158335], 80.00th=[158335], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7816, max= 7816, per=100.00%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3074KiB/s (3148kB/s)(7168KiB/2332msec); 0 zone resets clat (msec): min=127, max=438, avg=256.55, stdev=118.32 lat (msec): min=127, max=438, avg=256.61, stdev=118.33 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 171], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 205], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 380], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1932, max= 3953, per=28.98%, avg=2469.50, stdev=990.08, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=25.00% lat (msec) : 250=41.67%, 500=33.33% cpu : usr=0.09%, sys=44.27%, ctx=202, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6086KiB/s (6232kB/s), 684KiB/s-3102KiB/s (701kB/s-3176kB/s), io=20.0MiB (20.0MB), run=2311-3365msec WRITE: bw=8521KiB/s (8725kB/s), 1826KiB/s-3422KiB/s (1870kB/s-35 lat (msec): min=68, max=604, avg=261.04, stdev=208.52 05kB/s), io=28.0MiB (29.4MB), run=2311-3365msec clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 305], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1954, max= 3992, per=41.18%, avg=2492.50, stdev=1000.47, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1816KiB/s (1859kB/s)(6144KiB/3384msec); 0 zone resets clat (msec): min=103, max=497, avg=289.58, stdev=176.59 lat (msec): min=103, max=497, avg=289.65, stdev=176.59 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 405], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1954, max= 4000, per=28.27%, avg=2394.80, stdev=898.01, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=12.18%, ctx=246, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182675: Sat Sep 12 01:05:38 2026 read: IOPS=1, BW=1724KiB/s (1765kB/s)(5120KiB/2970msec) clat (msec): min=55, max=321, avg=184.46, stdev=129.08 lat (msec): min=55, max=321, avg=184.46, stdev=129.08 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1954, max= 3992, per=49.12%, avg=2973.00, stdev=1441.08, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2413KiB/s (2471kB/s)(7168KiB/2970msec); 0 zone resets clat (msec): min=65, max=517, avg=282.93, stdev=206.10 lat (msec): min=66, max=517, avg=283.00, stdev=206.10 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 91], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 510], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1976, max= 3908, per=31.02%, avg=2628.00, stdev=1108.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=18.52%, ctx=265, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6052KiB/s (6197kB/s), 667KiB/s-2821KiB/s (683kB/s-2889kB/s), io=20.0MiB (20.0MB), run=2541-3384msec WRITE: bw=8473KiB/s (8676kB/s), 1816KiB/s-3333KiB/s (1859kB/s-3413kB/s), io=28.0MiB (29.4MB), run=2541-3384msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182681: Sat Sep 12 01:05:45 2026 read: IOPS=2, BW=9.80MiB/s (10.3MB/s)(12.0MiB/1224msec) clat (msec): min=340, max=473, avg=404.55, stdev=66.43 lat (msec): min=340, max=473, avg=404.55, stdev=66.43 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7831, max= 8062, per=67.76%, avg=7946.50, stdev=163.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=56.29%, ctx=2690, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182682: Sat Sep 12 01:05:45 2026 read: IOPS=0, BW=2932KiB/s (3002kB/s)(4096KiB/1397msec) clat (nsec): min=365499k, max=365499k, avg=365499429.00, stdev= 0.00 lat (nsec): min=365501k, max=365501k, avg=365501168.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7223, max= 7223, per=61.59%, avg=7223.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5864KiB/s (6005kB/s)(8192KiB/1397msec); 0 zone resets clat (msec): min=405, max=595, avg=500.15, stdev=134.54 lat (msec): min=405, max=595, avg=500.40, stdev=134.57 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8062, max= 8062, per=40.10%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=19.13%, ctx=747, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182683: Sat Sep 12 01:05:45 2026 write: IOPS=1, BW=7539KiB/s (7720kB/s)(12.0MiB/1630msec); 0 zone resets clat (msec): min=186, max=945, avg=534.35, stdev=383.40 lat (msec): min=186, max=945, avg=534.61, stdev=383.45 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7249, max= 8175, per=38.36%, avg=7712.00, stdev=654.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.12%, sys=28.48%, ctx=121, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182685: Sat Sep 12 01:05:45 2026 write: IOPS=2, BW=8422KiB/s (8624kB/s)(12.0MiB/1459msec); 0 zone resets clat (msec): min=251, max=896, avg=479.84, stdev=361.48 lat (msec): min=251, max=896, avg=480.12, stdev=361.42 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7892, max= 8062, per=39.68%, avg=7977.00, stdev=120.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.07%, sys=20.16%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.5MiB/s (12.0MB/s), 2932KiB/s-9.80MiB/s (3002kB/s-10.3MB/s), io=16.0MiB (16.8MB), run=1224-1397msec WRITE: bw=19.6MiB/s (20.6MB/s), 5864KiB/s-8422KiB/s (6005kB/s-8624kB/s), io=32.0MiB (33.6MB), run=1397-1630msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182686: Sat Sep 12 01:05:46 2026 read: IOPS=1, BW=6711KiB/s (6872kB/s)(12.0MiB/1831msec) clat (msec): min=68, max=1213, avg=588.90, stdev=579.74 lat (msec): min=68, max=1213, avg=588.90, stdev=579.74 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8175, max= 8175, per=91.36%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.89%, ctx=49, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182687: Sat Sep 12 01:05:46 2026 read: IOPS=0, BW=2414KiB/s (2472kB/s)(4096KiB/1697msec) clat (nsec): min=653205k, max=653205k, avg=653204980.00, stdev= 0.00 lat (nsec): min=653208k, max=653208k, avg=653207712.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8192, max= 8192, per=91.55%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4827KiB/s (4943kB/s)(8192KiB/1697msec); 0 zone resets clat (msec): min=431, max=582, avg=506.92, stdev=106.62 lat (msec): min=431, max=582, avg=507.20, stdev=106.66 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8175, max= 8175, per=42.34%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=15.57%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182688: Sat Sep 12 01:05:46 2026 write: IOPS=1, BW=7314KiB/s (7490kB/s)(12.0MiB/1680msec); 0 zone resets clat (msec): min=119, max=1016, avg=540.73, stdev=450.94 lat (msec): min=119, max=1016, avg=540.98, stdev=451.00 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8175, max= 8175, per=42.34%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.20%, ctx=68, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182689: Sat Sep 12 01:05:46 2026 write: IOPS=1, BW=7762KiB/s (7949kB/s)(12.0MiB/1583msec); 0 zone resets clat (msec): min=424, max=647, avg=502.91, stdev=124.97 lat (msec): min=424, max=647, avg=503.18, stdev=124.98 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7892, max= 8175, per=41.60%, avg=8033.50, stdev=200.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.06%, sys=17.70%, ctx=329, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8948KiB/s (9163kB/s), 2414KiB/s-6711KiB/s (2472kB/s-6872kB/s), io=16.0MiB (16.8MB), run=1697-1831msec WRITE: bw=18.9MiB/s (19.8MB/s), 4827KiB/s-7762KiB/s (4943kB/s-7949kB/s), io=32.0MiB (33.6MB), run=1583-1697msec