== sanity test 398b: DIO and buffer IO race ============== 20:34:43 (1788654883) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.57839 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144872: Sat Sep 5 20:37:09 2026 read: IOPS=11, BW=47.6KiB/s (48.8kB/s)(5992KiB/125840msec) clat (usec): min=23, max=202334, avg=41603.86, stdev=29623.76 lat (usec): min=24, max=202336, avg=41608.22, stdev=29622.07 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 69], 10.00th=[ 105], 20.00th=[ 19530], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[139461], 99.50th=[152044], 99.90th=[191890], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 125, per=25.02%, avg=47.29, stdev=19.69, samples=247 iops : min= 1, max= 31, avg=11.15, stdev= 4.96, samples=247 write: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6296KiB/125840msec); 0 zone resets clat (usec): min=956, max=879705, avg=40018.51, stdev=45458.47 lat (usec): min=958, max=879706, avg=40023.22, stdev=45458.04 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1418], 10.00th=[ 2073], 20.00th=[ 4686], | 30.00th=[ 8979], 40.00th=[ 19792], 50.00th=[ 31065], 60.00th=[ 40109], | 70.00th=[ 51119], 80.00th=[ 66323], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[185598], 99.50th=[206570], 99.90th=[350225], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 116, per=25.08%, avg=49.66, stdev=20.24, samples=247 iops : min= 1, max= 29, avg=11.76, stdev= 5.11, samples=247 lat (usec) : 50=0.16%, 100=4.62%, 250=0.75%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.05%, 4=4.20%, 10=7.23%, 20=8.50%, 50=37.60% lat (msec) : 100=25.91%, 250=5.79%, 500=0.07%, 1000=0.03% cpu : usr=0.10%, sys=5.40%, ctx=6840, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144873: Sat Sep 5 20:37:09 2026 read: IOPS=11, BW=47.1KiB/s (48.3kB/s)(5940KiB/125991msec) clat (usec): min=29, max=287449, avg=40222.66, stdev=29662.42 lat (usec): min=29, max=287451, avg=40224.94, stdev=29663.20 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 139], 20.00th=[ 18482], | 30.00th=[ 24249], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50594], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 91751], | 99.00th=[127402], 99.50th=[152044], 99.90th=[233833], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 134, per=24.78%, avg=46.83, stdev=20.40, samples=247 iops : min= 1, max= 33, avg=11.04, stdev= 5.13, samples=247 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6348KiB/125991msec); 0 zone resets clat (usec): min=1001, max=909271, avg=41384.75, stdev=47428.20 lat (usec): min=1002, max=909273, avg=41393.74, stdev=47423.15 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1450], 10.00th=[ 2442], 20.00th=[ 4883], | 30.00th=[ 8848], 40.00th=[ 18482], 50.00th=[ 30802], 60.00th=[ 42206], | 70.00th=[ 53740], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[177210], 99.50th=[202376], 99.90th=[513803], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 111, per=25.18%, avg=49.86, stdev=19.79, samples=247 iops : min= 1, max= 27, avg=11.81, stdev= 5.01, samples=247 lat (usec) : 50=0.26%, 100=4.13%, 250=0.72%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=4.36%, 4=4.62%, 10=8.04%, 20=9.64%, 50=36.20% lat (msec) : 100=26.14%, 250=5.37%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.35%, ctx=6700, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144874: Sat Sep 5 20:37:09 2026 read: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6028KiB/125109msec) clat (usec): min=31, max=1038.2k, avg=39644.28, stdev=37685.11 lat (usec): min=31, max=1038.2k, avg=39655.46, stdev=37682.56 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 101], | 20.00th=[ 19530], 30.00th=[ 24511], 40.00th=[ 29230], | 50.00th=[ 33817], 60.00th=[ 40109], 70.00th=[ 47973], | 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[ 122160], 99.50th=[ 139461], 99.90th=[ 246416], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 103, per=25.30%, avg=47.82, stdev=19.21, samples=245 iops : min= 1, max= 25, avg=11.29, stdev= 4.86, samples=245 write: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6260KiB/125109msec); 0 zone resets clat (usec): min=1055, max=368252, avg=41421.47, stdev=40331.10 lat (usec): min=1056, max=368254, avg=41423.76, stdev=40331.12 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1418], 10.00th=[ 2180], 20.00th=[ 5014], | 30.00th=[ 9241], 40.00th=[ 20579], 50.00th=[ 32900], 60.00th=[ 42730], | 70.00th=[ 56886], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[116917], | 99.00th=[168821], 99.50th=[191890], 99.90th=[267387], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 126, per=25.16%, avg=49.81, stdev=19.10, samples=244 iops : min= 1, max= 31, avg=11.80, stdev= 4.80, samples=244 lat (usec) : 50=0.46%, 100=4.43%, 250=0.55%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=4.72%, 4=4.00%, 10=7.39%, 20=8.46%, 50=38.74% lat (msec) : 100=24.87%, 250=5.99%, 500=0.07%, 2000=0.03% cpu : usr=0.10%, sys=5.26%, ctx=6712, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144875: Sat Sep 5 20:37:09 2026 read: IOPS=11, BW=47.8KiB/s (48.9kB/s)(6052KiB/126611msec) clat (usec): min=38, max=320455, avg=40104.55, stdev=30691.18 lat (usec): min=39, max=320455, avg=40109.33, stdev=30687.81 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 204], 20.00th=[ 19006], | 30.00th=[ 23462], 40.00th=[ 28181], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 92799], | 99.00th=[133694], 99.50th=[164627], 99.90th=[263193], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 102, per=25.19%, avg=47.62, stdev=18.49, samples=246 iops : min= 1, max= 25, avg=11.24, stdev= 4.66, samples=246 write: IOPS=12, BW=49.3KiB/s (50.4kB/s)(6236KiB/126611msec); 0 zone resets clat (usec): min=945, max=1004.0k, avg=41989.66, stdev=48353.59 lat (usec): min=946, max=1004.0k, avg=41993.85, stdev=48353.08 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1418], 10.00th=[ 2212], | 20.00th=[ 5014], 30.00th=[ 9241], 40.00th=[ 20055], | 50.00th=[ 31589], 60.00th=[ 43254], 70.00th=[ 55313], | 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[ 121111], | 99.00th=[ 170918], 99.50th=[ 193987], 99.90th=[ 557843], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 111, per=24.61%, avg=48.73, stdev=20.49, samples=248 iops : min= 1, max= 27, avg=11.52, stdev= 5.15, samples=248 lat (usec) : 50=0.26%, 100=4.04%, 250=0.68%, 500=0.13%, 1000=0.10% lat (msec) : 2=4.65%, 4=4.17%, 10=7.49%, 20=9.60%, 50=37.01% lat (msec) : 100=25.75%, 250=5.92%, 500=0.13%, 750=0.03%, 2000=0.03% cpu : usr=0.10%, sys=5.31%, ctx=6738, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (194kB/s), 47.1KiB/s-48.2KiB/s (48.3kB/s-49.3kB/s), io=23.4MiB (24.6MB), run=125109-126611msec WRITE: bw=199KiB/s (203kB/s), 49.3KiB/s-50.4KiB/s (50.4kB/s-51.6kB/s), io=24.6MiB (25.7MB), run=125109-126611msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144877: Sat Sep 5 20:39:28 2026 read: IOPS=5, BW=22.9KiB/s (23.4kB/s)(5992KiB/261843msec) clat (msec): min=6, max=982, avg=36.43, stdev=40.81 lat (msec): min=6, max=982, avg=36.44, stdev=40.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 73], 95.00th=[ 97], | 99.00th=[ 178], 99.50th=[ 205], 99.90th=[ 326], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 87, per=27.91%, avg=25.12, stdev=16.77, samples=461 iops : min= 1, max= 21, avg= 5.64, stdev= 4.21, samples=461 write: IOPS=6, BW=24.0KiB/s (24.6kB/s)(6296KiB/261843msec); 0 zone resets clat (msec): min=40, max=578, avg=131.56, stdev=60.11 lat (msec): min=40, max=578, avg=131.56, stdev=60.11 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 106], 50.00th=[ 117], 60.00th=[ 131], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 211], 95.00th=[ 247], | 99.00th=[ 321], 99.50th=[ 372], 99.90th=[ 464], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 56, per=24.90%, avg=23.65, stdev=10.30, samples=513 iops : min= 1, max= 14, avg= 5.27, stdev= 2.63, samples=513 lat (msec) : 10=2.57%, 20=15.49%, 50=21.16%, 100=25.52%, 250=32.62% lat (msec) : 500=2.57%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.27%, ctx=5304, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144878: Sat Sep 5 20:39:28 2026 read: IOPS=5, BW=22.5KiB/s (22.0kB/s)(5940KiB/264574msec) clat (msec): min=5, max=1080, avg=38.07, stdev=46.56 lat (msec): min=5, max=1080, avg=38.07, stdev=46.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 80], 95.00th=[ 106], | 99.00th=[ 182], 99.50th=[ 251], 99.90th=[ 443], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 95, per=27.66%, avg=24.90, stdev=16.79, samples=460 iops : min= 1, max= 23, avg= 5.58, stdev= 4.23, samples=460 write: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6348KiB/264574msec); 0 zone resets clat (msec): min=36, max=392, avg=130.98, stdev=56.96 lat (msec): min=36, max=392, avg=130.98, stdev=56.96 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 178], 90.00th=[ 209], 95.00th=[ 243], | 99.00th=[ 313], 99.50th=[ 338], 99.90th=[ 384], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 48, per=24.89%, avg=23.64, stdev=10.09, samples=517 iops : min= 1, max= 12, avg= 5.26, stdev= 2.58, samples=517 lat (msec) : 10=2.70%, 20=15.20%, 50=20.74%, 100=24.77%, 250=34.41% lat (msec) : 500=2.15%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144879: Sat Sep 5 20:39:28 2026 read: IOPS=5, BW=22.8KiB/s (23.4kB/s)(6028KiB/263840msec) clat (msec): min=6, max=394, avg=37.08, stdev=33.75 lat (msec): min=6, max=394, avg=37.09, stdev=33.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 74], 95.00th=[ 101], | 99.00th=[ 174], 99.50th=[ 199], 99.90th=[ 288], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 103, per=27.10%, avg=24.39, stdev=16.62, samples=477 iops : min= 1, max= 25, avg= 5.46, stdev= 4.18, samples=477 write: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6260KiB/263840msec); 0 zone resets clat (msec): min=39, max=1249, avg=132.77, stdev=66.42 lat (msec): min=39, max=1249, avg=132.78, stdev=66.42 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 211], 95.00th=[ 249], | 99.00th=[ 347], 99.50th=[ 405], 99.90th=[ 485], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 56, per=24.56%, avg=23.33, stdev=10.22, samples=517 iops : min= 1, max= 14, avg= 5.19, stdev= 2.61, samples=517 lat (msec) : 10=2.38%, 20=14.97%, 50=21.39%, 100=25.20%, 250=33.50% lat (msec) : 500=2.54%, 2000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144880: Sat Sep 5 20:39:28 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(6052KiB/258994msec) clat (msec): min=5, max=357, avg=35.66, stdev=33.81 lat (msec): min=5, max=357, avg=35.67, stdev=33.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 78], 95.00th=[ 101], | 99.00th=[ 171], 99.50th=[ 192], 99.90th=[ 330], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 111, per=28.57%, avg=25.72, stdev=17.31, samples=455 iops : min= 1, max= 27, avg= 5.79, stdev= 4.36, samples=455 write: IOPS=6, BW=24.1KiB/s (24.7kB/s)(6236KiB/258994msec); 0 zone resets clat (msec): min=30, max=1243, avg=131.40, stdev=65.76 lat (msec): min=30, max=1243, avg=131.40, stdev=65.76 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 239], | 99.00th=[ 317], 99.50th=[ 418], 99.90th=[ 592], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 55, per=24.84%, avg=23.60, stdev=10.30, samples=509 iops : min= 1, max= 13, avg= 5.25, stdev= 2.63, samples=509 lat (msec) : 10=2.90%, 20=16.54%, 50=21.03%, 100=23.99%, 250=33.24% lat (msec) : 500=2.25%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.20%, ctx=5216, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=90.8KiB/s (92.9kB/s), 22.5KiB/s-23.4KiB/s (22.0kB/s-23.9kB/s), io=23.4MiB (24.6MB), run=258994-264574msec WRITE: bw=95.0KiB/s (97.3kB/s), 23.7KiB/s-24.1KiB/s (24.3kB/s-24.7kB/s), io=24.6MiB (25.7MB), run=258994-264574msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144934: Sat Sep 5 20:40:15 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(5920KiB/37843msec) clat (usec): min=42, max=412710, avg=49931.57, stdev=45626.46 lat (usec): min=43, max=412711, avg=49933.23, stdev=45627.18 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 15270], | 30.00th=[ 27657], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 49546], | 70.00th=[ 61604], 80.00th=[ 79168], 90.00th=[ 99091], 95.00th=[117965], | 99.00th=[270533], 99.50th=[291505], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 31, max= 347, per=24.42%, avg=154.31, stdev=70.20, samples=74 iops : min= 1, max= 21, avg= 8.88, stdev= 4.49, samples=74 write: IOPS=10, BW=168KiB/s (172kB/s)(6368KiB/37843msec); 0 zone resets clat (usec): min=1512, max=345637, avg=48098.61, stdev=52898.41 lat (usec): min=1515, max=345640, avg=48101.74, stdev=52898.32 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1991], 10.00th=[ 3490], 20.00th=[ 7439], | 30.00th=[ 10552], 40.00th=[ 18482], 50.00th=[ 27132], 60.00th=[ 40633], | 70.00th=[ 56361], 80.00th=[ 91751], 90.00th=[127402], 95.00th=[152044], | 99.00th=[238027], 99.50th=[244319], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 30, max= 415, per=25.16%, avg=167.30, stdev=78.76, samples=74 iops : min= 1, max= 25, avg= 9.69, stdev= 4.98, samples=74 lat (usec) : 50=0.52%, 100=5.86%, 250=1.69%, 500=0.26% lat (msec) : 2=2.86%, 4=3.78%, 10=8.98%, 20=8.07%, 50=31.51% lat (msec) : 100=23.57%, 250=12.24%, 500=0.65% cpu : usr=0.07%, sys=4.72%, ctx=1569, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144935: Sat Sep 5 20:40:15 2026 read: IOPS=9, BW=152KiB/s (155kB/s)(5744KiB/37856msec) clat (usec): min=43, max=346063, avg=56112.66, stdev=41677.91 lat (usec): min=43, max=346063, avg=56168.91, stdev=41754.98 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 78], 10.00th=[ 106], 20.00th=[ 26870], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 56361], | 70.00th=[ 67634], 80.00th=[ 85459], 90.00th=[102237], 95.00th=[135267], | 99.00th=[206570], 99.50th=[219153], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 60, max= 352, per=23.86%, avg=150.78, stdev=69.07, samples=74 iops : min= 3, max= 22, avg= 8.64, stdev= 4.38, samples=74 write: IOPS=10, BW=173KiB/s (177kB/s)(6544KiB/37856msec); 0 zone resets clat (usec): min=1559, max=369255, avg=42773.48, stdev=48157.95 lat (usec): min=1562, max=369257, avg=42776.68, stdev=48157.87 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2114], 10.00th=[ 3425], 20.00th=[ 6063], | 30.00th=[ 9634], 40.00th=[ 16450], 50.00th=[ 26608], 60.00th=[ 39584], | 70.00th=[ 56886], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[129500], | 99.00th=[212861], 99.50th=[265290], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 31, max= 411, per=25.87%, avg=172.03, stdev=81.03, samples=74 iops : min= 1, max= 25, avg= 9.99, stdev= 5.11, samples=74 lat (usec) : 50=0.13%, 100=3.91%, 250=0.91% lat (msec) : 2=2.21%, 4=4.30%, 10=10.16%, 20=7.94%, 50=30.47% lat (msec) : 100=29.17%, 250=10.16%, 500=0.65% cpu : usr=0.09%, sys=4.93%, ctx=1598, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144936: Sat Sep 5 20:40:15 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37822msec) clat (usec): min=35, max=364065, avg=56561.61, stdev=45952.64 lat (usec): min=35, max=364067, avg=56568.75, stdev=45946.12 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 68], 10.00th=[ 81], 20.00th=[ 20841], | 30.00th=[ 33817], 40.00th=[ 42730], 50.00th=[ 50594], 60.00th=[ 61604], | 70.00th=[ 73925], 80.00th=[ 83362], 90.00th=[110625], 95.00th=[135267], | 99.00th=[208667], 99.50th=[325059], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 31, max= 383, per=26.03%, avg=164.49, stdev=74.72, samples=74 iops : min= 1, max= 23, avg= 9.50, stdev= 4.70, samples=74 write: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37822msec); 0 zone resets clat (usec): min=1521, max=513234, avg=41103.40, stdev=51713.85 lat (usec): min=1523, max=513237, avg=41106.55, stdev=51713.75 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1942], 10.00th=[ 2966], 20.00th=[ 5604], | 30.00th=[ 8586], 40.00th=[ 13566], 50.00th=[ 24249], 60.00th=[ 34866], | 70.00th=[ 47449], 80.00th=[ 63177], 90.00th=[ 99091], 95.00th=[137364], | 99.00th=[217056], 99.50th=[291505], 99.90th=[513803], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 30, max= 442, per=23.46%, avg=156.00, stdev=85.45, samples=74 iops : min= 1, max= 27, avg= 8.96, stdev= 5.38, samples=74 lat (usec) : 50=0.65%, 100=6.77%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=2.99%, 4=4.04%, 10=9.24%, 20=7.94%, 50=27.34% lat (msec) : 100=28.39%, 250=10.81%, 500=0.52%, 750=0.13% cpu : usr=0.06%, sys=4.45%, ctx=1438, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144937: Sat Sep 5 20:40:15 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36367msec) clat (usec): min=43, max=290172, avg=53627.42, stdev=45655.75 lat (usec): min=43, max=290174, avg=53632.48, stdev=45656.50 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 18482], | 30.00th=[ 30278], 40.00th=[ 38536], 50.00th=[ 46400], 60.00th=[ 52691], | 70.00th=[ 66847], 80.00th=[ 82314], 90.00th=[113771], 95.00th=[141558], | 99.00th=[225444], 99.50th=[254804], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 30, max= 347, per=26.36%, avg=166.57, stdev=80.68, samples=70 iops : min= 1, max= 21, avg= 9.64, stdev= 5.09, samples=70 write: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36367msec); 0 zone resets clat (usec): min=1566, max=375294, avg=40992.77, stdev=48992.91 lat (usec): min=1567, max=375297, avg=41010.66, stdev=48998.69 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1893], 10.00th=[ 2474], 20.00th=[ 5407], | 30.00th=[ 8979], 40.00th=[ 13566], 50.00th=[ 23200], 60.00th=[ 35914], | 70.00th=[ 50070], 80.00th=[ 70779], 90.00th=[102237], 95.00th=[129500], | 99.00th=[244319], 99.50th=[320865], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 31, max= 441, per=25.88%, avg=172.07, stdev=90.72, samples=71 iops : min= 1, max= 27, avg=10.00, stdev= 5.72, samples=71 lat (usec) : 50=0.52%, 100=6.64%, 250=1.04%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=3.91%, 4=3.26%, 10=10.29%, 20=8.20%, 50=27.86% lat (msec) : 100=25.78%, 250=10.94%, 500=0.78% cpu : usr=0.06%, sys=5.04%, ctx=1594, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=633KiB/s (648kB/s), 152KiB/s-166KiB/s (155kB/s-170kB/s), io=23.4MiB (24.5MB), run=36367-37856msec WRITE: bw=666KiB/s (682kB/s), 159KiB/s-173KiB/s (163kB/s-177kB/s), io=24.6MiB (25.8MB), run=36367-37856msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144939: Sat Sep 5 20:41:01 2026 read: IOPS=4, BW=70.9KiB/s (72.6kB/s)(5920KiB/83453msec) clat (msec): min=9, max=406, avg=52.28, stdev=49.92 lat (msec): min=9, max=406, avg=52.28, stdev=49.92 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 68], 90.00th=[ 102], 95.00th=[ 134], | 99.00th=[ 275], 99.50th=[ 334], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 341, per=28.26%, avg=81.11, stdev=52.70, samples=142 iops : min= 1, max= 21, avg= 4.25, stdev= 3.34, samples=142 write: IOPS=4, BW=76.3KiB/s (78.1kB/s)(6368KiB/83453msec); 0 zone resets clat (msec): min=44, max=600, avg=160.87, stdev=82.06 lat (msec): min=44, max=601, avg=160.91, stdev=82.05 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 74], 10.00th=[ 85], 20.00th=[ 103], | 30.00th=[ 113], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 178], 80.00th=[ 207], 90.00th=[ 257], 95.00th=[ 342], | 99.00th=[ 481], 99.50th=[ 527], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 21, max= 191, per=26.48%, avg=79.70, stdev=35.77, samples=156 iops : min= 1, max= 11, avg= 4.14, stdev= 2.22, samples=156 lat (msec) : 10=0.13%, 20=8.98%, 50=23.31%, 100=20.18%, 250=40.76% lat (msec) : 500=6.25%, 750=0.39% cpu : usr=0.04%, sys=1.21%, ctx=1302, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144940: Sat Sep 5 20:41:01 2026 read: IOPS=4, BW=69.3KiB/s (70.9kB/s)(5744KiB/82929msec) clat (msec): min=7, max=646, avg=50.19, stdev=56.38 lat (msec): min=7, max=646, avg=50.19, stdev=56.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 68], 90.00th=[ 106], 95.00th=[ 159], | 99.00th=[ 271], 99.50th=[ 326], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 21, max= 304, per=28.85%, avg=82.80, stdev=54.63, samples=136 iops : min= 1, max= 19, avg= 4.35, stdev= 3.49, samples=136 write: IOPS=4, BW=78.9KiB/s (80.8kB/s)(6544KiB/82929msec); 0 zone resets clat (msec): min=57, max=631, avg=158.48, stdev=79.98 lat (msec): min=57, max=631, avg=158.48, stdev=79.98 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 78], 10.00th=[ 85], 20.00th=[ 97], | 30.00th=[ 113], 40.00th=[ 124], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 180], 80.00th=[ 209], 90.00th=[ 257], 95.00th=[ 309], | 99.00th=[ 451], 99.50th=[ 510], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 29, max= 160, per=27.00%, avg=81.27, stdev=35.07, samples=157 iops : min= 1, max= 10, avg= 4.25, stdev= 2.18, samples=157 lat (msec) : 10=0.78%, 20=10.94%, 50=20.83%, 100=20.31%, 250=40.89% lat (msec) : 500=5.73%, 750=0.52% cpu : usr=0.06%, sys=1.24%, ctx=1356, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Sat Sep 5 20:41:01 2026 read: IOPS=4, BW=78.2KiB/s (80.0kB/s)(6256KiB/80030msec) clat (msec): min=7, max=336, avg=49.64, stdev=46.36 lat (msec): min=7, max=336, avg=49.65, stdev=46.36 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 53], 80.00th=[ 66], 90.00th=[ 104], 95.00th=[ 159], | 99.00th=[ 243], 99.50th=[ 305], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 21, max= 406, per=31.69%, avg=90.95, stdev=65.35, samples=135 iops : min= 1, max= 25, avg= 4.85, stdev= 4.14, samples=135 write: IOPS=4, BW=75.4KiB/s (77.2kB/s)(6032KiB/80030msec); 0 zone resets clat (msec): min=49, max=618, avg=160.54, stdev=79.54 lat (msec): min=49, max=618, avg=160.54, stdev=79.54 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 73], 10.00th=[ 82], 20.00th=[ 97], | 30.00th=[ 110], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 184], 80.00th=[ 220], 90.00th=[ 262], 95.00th=[ 321], | 99.00th=[ 439], 99.50th=[ 489], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 30, max= 159, per=25.80%, avg=77.67, stdev=33.26, samples=151 iops : min= 1, max= 9, avg= 4.03, stdev= 2.08, samples=151 lat (msec) : 10=0.65%, 20=11.33%, 50=22.40%, 100=22.66%, 250=37.11% lat (msec) : 500=5.73%, 750=0.13% cpu : usr=0.04%, sys=1.20%, ctx=1369, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144942: Sat Sep 5 20:41:01 2026 read: IOPS=4, BW=73.2KiB/s (74.9kB/s)(6032KiB/82413msec) clat (msec): min=8, max=615, avg=53.29, stdev=53.86 lat (msec): min=8, max=615, avg=53.30, stdev=53.86 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 56], 80.00th=[ 67], 90.00th=[ 108], 95.00th=[ 140], | 99.00th=[ 251], 99.50th=[ 300], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 30, max= 318, per=28.95%, avg=83.10, stdev=54.45, samples=141 iops : min= 1, max= 19, avg= 4.35, stdev= 3.42, samples=141 write: IOPS=4, BW=75.9KiB/s (77.7kB/s)(6256KiB/82413msec); 0 zone resets clat (msec): min=39, max=628, avg=159.20, stdev=81.63 lat (msec): min=39, max=628, avg=159.20, stdev=81.63 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 77], 10.00th=[ 86], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 211], 90.00th=[ 253], 95.00th=[ 309], | 99.00th=[ 510], 99.50th=[ 600], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 30, max= 191, per=26.08%, avg=78.49, stdev=35.62, samples=156 iops : min= 1, max= 11, avg= 4.07, stdev= 2.26, samples=156 lat (msec) : 10=0.26%, 20=7.55%, 50=23.70%, 100=23.44%, 250=39.06% lat (msec) : 500=5.21%, 750=0.78% cpu : usr=0.04%, sys=1.21%, ctx=1348, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=287KiB/s (294kB/s), 69.3KiB/s-78.2KiB/s (70.9kB/s-80.0kB/s), io=23.4MiB (24.5MB), run=80030-83453msec WRITE: bw=302KiB/s (309kB/s), 75.4KiB/s-78.9KiB/s (77.2kB/s-80.8kB/s), io=24.6MiB (25.8MB), run=80030-83453msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144964: Sat Sep 5 20:41:18 2026 read: IOPS=1, BW=1094KiB/s (1120kB/s)(7168KiB/6554msec) clat (msec): min=70, max=3104, avg=578.00, stdev=1115.21 lat (msec): min=70, max=3104, avg=578.00, stdev=1115.20 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 140], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 182], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 218], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1802, max= 4087, per=87.58%, avg=2354.20, stdev=974.17, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=781KiB/s (800kB/s)(5120KiB/6554msec); 0 zone resets clat (msec): min=200, max=893, avg=457.25, stdev=268.45 lat (msec): min=200, max=893, avg=457.34, stdev=268.46 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1838, max= 4023, per=70.00%, avg=2634.67, stdev=1206.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=9.25%, ctx=687, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144965: Sat Sep 5 20:41:18 2026 read: IOPS=0, BW=269KiB/s (275kB/s)(2048KiB/7617msec) clat (msec): min=207, max=392, avg=300.14, stdev=131.20 lat (msec): min=207, max=392, avg=300.15, stdev=131.20 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1774, max= 1838, per=67.19%, avg=1806.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1344KiB/s (1377kB/s)(10.0MiB/7617msec); 0 zone resets clat (msec): min=147, max=3588, avg=672.50, stdev=1043.90 lat (msec): min=148, max=3589, avg=672.61, stdev=1043.90 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 184], | 30.00th=[ 194], 40.00th=[ 230], 50.00th=[ 257], 60.00th=[ 359], | 70.00th=[ 435], 80.00th=[ 535], 90.00th=[ 802], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 2043, max= 6083, per=100.00%, avg=3971.50, stdev=1656.82, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=8.90%, ctx=226, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144966: Sat Sep 5 20:41:18 2026 read: IOPS=0, BW=959KiB/s (982kB/s)(6144KiB/6408msec) clat (usec): min=603, max=473314, avg=147454.96, stdev=201208.09 lat (usec): min=604, max=473316, avg=147456.15, stdev=201208.35 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 627], | 30.00th=[ 627], 40.00th=[ 906], 50.00th=[ 906], 60.00th=[ 92799], | 70.00th=[316670], 80.00th=[316670], 90.00th=[471860], 95.00th=[471860], | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 1838, max= 4023, per=100.00%, avg=3199.33, stdev=1187.59, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=959KiB/s (982kB/s)(6144KiB/6408msec); 0 zone resets clat (msec): min=142, max=3907, avg=868.52, stdev=1491.16 lat (msec): min=142, max=3908, avg=868.75, stdev=1491.10 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 326], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1838, max= 4023, per=61.67%, avg=2321.20, stdev=955.00, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.29%, ctx=229, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144967: Sat Sep 5 20:41:18 2026 read: IOPS=0, BW=750KiB/s (768kB/s)(5120KiB/6830msec) clat (usec): min=856, max=383661, avg=182440.42, stdev=141320.10 lat (usec): min=857, max=383663, avg=182441.76, stdev=141320.49 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], 20.00th=[ 857], | 30.00th=[113771], 40.00th=[113771], 50.00th=[189793], 60.00th=[189793], | 70.00th=[223347], 80.00th=[223347], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 3737, max= 4023, per=100.00%, avg=3880.00, stdev=202.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1049KiB/s (1075kB/s)(7168KiB/6830msec); 0 zone resets clat (msec): min=246, max=3362, avg=833.26, stdev=1122.47 lat (msec): min=246, max=3362, avg=833.35, stdev=1122.48 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 253], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 506], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 550], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1838, max= 3900, per=59.78%, avg=2250.00, stdev=812.60, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=8.38%, ctx=124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2689KiB/s (2753kB/s), 269KiB/s-1094KiB/s (275kB/s-1120kB/s), io=20.0MiB (20.0MB), run=6408-7617msec WRITE: bw=3764KiB/s (3855kB/s), 781KiB/s-1344KiB/s (800kB/s-1377kB/s), io=28.0MiB (29.4MB), run=6408-7617msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144959: Sat Sep 5 20:41:19 2026 read: IOPS=1, BW=1041KiB/s (1066kB/s)(7168KiB/6883msec) clat (msec): min=69, max=2923, avg=586.28, stdev=1042.82 lat (msec): min=69, max=2923, avg=586.29, stdev=1042.82 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 114], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 502], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2027, max= 4278, per=100.00%, avg=2597.00, stdev=1120.70, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=0, BW=744KiB/s (762kB/s)(5120KiB/6883msec); 0 zone resets clat (msec): min=346, max=708, avg=545.25, stdev=160.91 lat (msec): min=346, max=708, avg=545.41, stdev=160.90 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1976, max= 2043, per=60.79%, avg=2017.00, stdev=28.13, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=25.00%, 750=33.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.44%, ctx=70, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144960: Sat Sep 5 20:41:19 2026 read: IOPS=0, BW=239KiB/s (244kB/s)(2048KiB/8582msec) clat (msec): min=82, max=910, avg=496.46, stdev=585.10 lat (msec): min=82, max=910, avg=496.46, stdev=585.10 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1448, max= 1976, per=72.24%, avg=1712.00, stdev=373.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1193KiB/s (1222kB/s)(10.0MiB/8582msec); 0 zone resets clat (msec): min=129, max=3577, avg=732.51, stdev=1032.28 lat (msec): min=129, max=3577, avg=732.69, stdev=1032.29 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 201], | 30.00th=[ 326], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 359], | 70.00th=[ 409], 80.00th=[ 567], 90.00th=[ 1070], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 2035, max= 4096, per=81.70%, avg=2710.83, stdev=1036.22, samples=6 iops : min= 1, max= 4, avg= 2.00, stdev= 1.26, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.25%, ctx=82, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144961: Sat Sep 5 20:41:19 2026 read: IOPS=0, BW=767KiB/s (785kB/s)(6144KiB/8015msec) clat (msec): min=84, max=1246, avg=358.90, stdev=448.11 lat (msec): min=84, max=1246, avg=358.91, stdev=448.11 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 201], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1976, max= 2048, per=85.08%, avg=2016.40, stdev=28.40, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=767KiB/s (785kB/s)(6144KiB/8015msec); 0 zone resets clat (msec): min=199, max=3806, avg=944.34, stdev=1406.61 lat (msec): min=199, max=3806, avg=945.58, stdev=1406.08 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 393], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1416, max= 2031, per=56.99%, avg=1890.80, stdev=266.43, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.70%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144962: Sat Sep 5 20:41:19 2026 read: IOPS=0, BW=593KiB/s (607kB/s)(5120KiB/8641msec) clat (msec): min=71, max=647, avg=410.59, stdev=214.11 lat (msec): min=71, max=647, avg=410.59, stdev=214.11 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1976, max= 2048, per=85.42%, avg=2024.50, stdev=33.11, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=0, BW=830KiB/s (849kB/s)(7168KiB/8641msec); 0 zone resets clat (msec): min=158, max=4046, avg=922.46, stdev=1450.07 lat (msec): min=158, max=4046, avg=922.61, stdev=1450.04 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 182], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 215], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 1418], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 1426, max= 4000, per=71.55%, avg=2374.00, stdev=1121.39, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.30%, ctx=98, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2370KiB/s (2427kB/s), 239KiB/s-1041KiB/s (244kB/s-1066kB/s), io=20.0MiB (20.0MB), run=6883-8641msec WRITE: bw=3318KiB/s (3398kB/s), 744KiB/s-1193KiB/s (762kB/s-1222kB/s), io=28.0MiB (29.4MB), run=6883-8641msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144976: Sat Sep 5 20:41:37 2026 read: IOPS=0, BW=2722KiB/s (2787kB/s)(12.0MiB/4515msec) clat (msec): min=645, max=3032, avg=1449.03, stdev=1371.33 lat (msec): min=645, max=3032, avg=1449.03, stdev=1371.33 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=10.37%, ctx=278, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144978: Sat Sep 5 20:41:37 2026 read: IOPS=0, BW=671KiB/s (687kB/s)(4096KiB/6101msec) clat (nsec): min=3257.5M, max=3257.5M, avg=3257478217.00, stdev= 0.00 lat (nsec): min=3257.5M, max=3257.5M, avg=3257480775.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3272], 5.00th=[ 3272], 10.00th=[ 3272], 20.00th=[ 3272], | 30.00th=[ 3272], 40.00th=[ 3272], 50.00th=[ 3272], 60.00th=[ 3272], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1343KiB/s (1375kB/s)(8192KiB/6101msec); 0 zone resets clat (msec): min=831, max=1940, avg=1385.93, stdev=784.06 lat (msec): min=836, max=1940, avg=1388.73, stdev=780.93 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1938], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.79%, ctx=503, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144981: Sat Sep 5 20:41:37 2026 write: IOPS=0, BW=1957KiB/s (2004kB/s)(12.0MiB/6280msec); 0 zone resets clat (msec): min=798, max=3981, avg=2049.48, stdev=1697.20 lat (msec): min=799, max=3982, avg=2050.35, stdev=1697.64 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.99%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144982: Sat Sep 5 20:41:37 2026 write: IOPS=0, BW=2326KiB/s (2382kB/s)(12.0MiB/5283msec); 0 zone resets clat (msec): min=516, max=3600, avg=1744.26, stdev=1634.84 lat (msec): min=519, max=3601, avg=1746.44, stdev=1633.91 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.03%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2685KiB/s (2750kB/s), 671KiB/s-2722KiB/s (687kB/s-2787kB/s), io=16.0MiB (16.8MB), run=4515-6101msec WRITE: bw=5218KiB/s (5343kB/s), 1343KiB/s-2326KiB/s (1375kB/s-2382kB/s), io=32.0MiB (33.6MB), run=5283-6280msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144975: Sat Sep 5 20:41:37 2026 read: IOPS=0, BW=2014KiB/s (2062kB/s)(12.0MiB/6102msec) clat (msec): min=760, max=3607, avg=1991.70, stdev=1461.80 lat (msec): min=760, max=3607, avg=1991.70, stdev=1461.80 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.67%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144977: Sat Sep 5 20:41:37 2026 read: IOPS=0, BW=649KiB/s (664kB/s)(4096KiB/6315msec) clat (nsec): min=3440.5M, max=3440.5M, avg=3440453528.00, stdev= 0.00 lat (nsec): min=3440.5M, max=3440.5M, avg=3440456560.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3440], 5.00th=[ 3440], 10.00th=[ 3440], 20.00th=[ 3440], | 30.00th=[ 3440], 40.00th=[ 3440], 50.00th=[ 3440], 60.00th=[ 3440], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1297KiB/s (1328kB/s)(8192KiB/6315msec); 0 zone resets clat (msec): min=511, max=2315, avg=1413.23, stdev=1275.44 lat (msec): min=512, max=2316, avg=1414.22, stdev=1275.37 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 2299], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.76%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144979: Sat Sep 5 20:41:37 2026 write: IOPS=0, BW=1849KiB/s (1893kB/s)(12.0MiB/6646msec); 0 zone resets clat (msec): min=744, max=4838, avg=2196.26, stdev=2292.32 lat (msec): min=745, max=4839, avg=2197.68, stdev=2291.76 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 4866], 80.00th=[ 4866], 90.00th=[ 4866], 95.00th=[ 4866], | 99.00th=[ 4866], 99.50th=[ 4866], 99.90th=[ 4866], 99.95th=[ 4866], | 99.99th=[ 4866] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.03%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144980: Sat Sep 5 20:41:37 2026 write: IOPS=0, BW=2128KiB/s (2179kB/s)(12.0MiB/5774msec); 0 zone resets clat (msec): min=499, max=4484, avg=1910.10, stdev=2233.26 lat (msec): min=500, max=4485, avg=1910.53, stdev=2233.24 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.82%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2594KiB/s (2657kB/s), 649KiB/s-2014KiB/s (664kB/s-2062kB/s), io=16.0MiB (16.8MB), run=6102-6315msec WRITE: bw=4930KiB/s (5049kB/s), 1297KiB/s-2128KiB/s (1328kB/s-2179kB/s), io=32.0MiB (33.6MB), run=5774-6646msec