== sanity test 398b: DIO and buffer IO race ============== 23:51:45 (1787370705) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.04388 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144992: Fri Aug 21 23:54:13 2026 read: IOPS=11, BW=46.4KiB/s (47.5kB/s)(5992KiB/129045msec) clat (usec): min=33, max=1070.7k, avg=42231.51, stdev=40788.21 lat (usec): min=33, max=1070.7k, avg=42235.17, stdev=40788.75 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 68], 10.00th=[ 1369], | 20.00th=[ 19268], 30.00th=[ 24249], 40.00th=[ 30016], | 50.00th=[ 35914], 60.00th=[ 43254], 70.00th=[ 51643], | 80.00th=[ 62653], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[ 147850], 99.50th=[ 173016], 99.90th=[ 304088], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 110, per=25.11%, avg=46.70, stdev=19.37, samples=250 iops : min= 1, max= 27, avg=11.01, stdev= 4.87, samples=250 write: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6296KiB/129045msec); 0 zone resets clat (usec): min=799, max=369323, avg=41383.69, stdev=42410.56 lat (usec): min=801, max=369326, avg=41389.66, stdev=42411.29 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1385], 20.00th=[ 3687], | 30.00th=[ 9765], 40.00th=[ 19268], 50.00th=[ 30802], 60.00th=[ 41157], | 70.00th=[ 55313], 80.00th=[ 72877], 90.00th=[ 96994], 95.00th=[122160], | 99.00th=[185598], 99.50th=[206570], 99.90th=[299893], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 112, per=25.23%, avg=48.95, stdev=21.84, samples=250 iops : min= 1, max= 28, avg=11.59, stdev= 5.53, samples=250 lat (usec) : 50=0.20%, 100=4.13%, 250=0.36%, 500=0.07%, 1000=0.16% lat (msec) : 2=6.80%, 4=3.97%, 10=5.24%, 20=10.25%, 50=36.43% lat (msec) : 100=25.78%, 250=6.45%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=4.88%, ctx=6452, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144993: Fri Aug 21 23:54:13 2026 read: IOPS=11, BW=47.9KiB/s (49.0kB/s)(5940KiB/124013msec) clat (usec): min=30, max=1167.8k, avg=41991.87, stdev=43055.35 lat (usec): min=30, max=1167.8k, avg=41996.47, stdev=43057.07 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 67], 10.00th=[ 8717], | 20.00th=[ 19006], 30.00th=[ 24773], 40.00th=[ 29754], | 50.00th=[ 34866], 60.00th=[ 41681], 70.00th=[ 50070], | 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[ 147850], 99.50th=[ 156238], 99.90th=[ 358613], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 111, per=25.97%, avg=48.30, stdev=21.19, samples=239 iops : min= 1, max= 27, avg=11.42, stdev= 5.35, samples=239 write: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6348KiB/124013msec); 0 zone resets clat (usec): min=759, max=418229, avg=38480.50, stdev=41510.49 lat (usec): min=761, max=418230, avg=38495.62, stdev=41514.30 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1205], 10.00th=[ 1336], 20.00th=[ 3130], | 30.00th=[ 7504], 40.00th=[ 16909], 50.00th=[ 27395], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 66847], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[181404], 99.50th=[225444], 99.90th=[304088], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 7, max= 119, per=26.71%, avg=51.82, stdev=22.15, samples=238 iops : min= 1, max= 29, avg=12.30, stdev= 5.58, samples=238 lat (usec) : 50=0.29%, 100=4.00%, 250=0.20%, 1000=0.29% lat (msec) : 2=7.91%, 4=3.55%, 10=6.05%, 20=10.03%, 50=37.86% lat (msec) : 100=23.27%, 250=6.38%, 500=0.13%, 2000=0.03% cpu : usr=0.07%, sys=4.84%, ctx=6230, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144994: Fri Aug 21 23:54:13 2026 read: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6028KiB/128097msec) clat (usec): min=31, max=1179.3k, avg=42198.71, stdev=44445.34 lat (usec): min=31, max=1179.3k, avg=42202.88, stdev=44445.34 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 11469], | 20.00th=[ 19006], 30.00th=[ 24511], 40.00th=[ 29492], | 50.00th=[ 34866], 60.00th=[ 41681], 70.00th=[ 49546], | 80.00th=[ 60031], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[ 152044], 99.50th=[ 187696], 99.90th=[ 566232], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 127, per=25.33%, avg=47.12, stdev=21.79, samples=249 iops : min= 1, max= 31, avg=11.12, stdev= 5.49, samples=249 write: IOPS=12, BW=48.9KiB/s (50.0kB/s)(6260KiB/128097msec); 0 zone resets clat (usec): min=779, max=450903, avg=40840.23, stdev=43363.14 lat (usec): min=782, max=450905, avg=40843.38, stdev=43362.35 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1418], 20.00th=[ 3752], | 30.00th=[ 8455], 40.00th=[ 19268], 50.00th=[ 29754], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[179307], 99.50th=[242222], 99.90th=[333448], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 111, per=25.12%, avg=48.73, stdev=19.56, samples=250 iops : min= 1, max= 27, avg=11.53, stdev= 4.92, samples=250 lat (usec) : 50=0.29%, 100=3.45%, 250=0.36%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.71%, 4=3.91%, 10=5.99%, 20=10.94%, 50=36.59% lat (msec) : 100=25.03%, 250=6.18%, 500=0.26%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.71%, ctx=6403, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144995: Fri Aug 21 23:54:13 2026 read: IOPS=12, BW=48.1KiB/s (49.3kB/s)(6052KiB/125786msec) clat (usec): min=34, max=238245, avg=40085.14, stdev=29463.68 lat (usec): min=34, max=238248, avg=40088.44, stdev=29470.68 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 67], 10.00th=[ 1778], 20.00th=[ 18744], | 30.00th=[ 23200], 40.00th=[ 27919], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[131597], 99.50th=[152044], 99.90th=[217056], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 103, per=26.15%, avg=48.64, stdev=21.28, samples=243 iops : min= 1, max= 25, avg=11.50, stdev= 5.35, samples=243 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6236KiB/125786msec); 0 zone resets clat (usec): min=709, max=1130.0k, avg=41408.16, stdev=51967.21 lat (usec): min=710, max=1130.0k, avg=41415.63, stdev=51965.19 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1418], | 20.00th=[ 3589], 30.00th=[ 7635], 40.00th=[ 17171], | 50.00th=[ 28967], 60.00th=[ 40109], 70.00th=[ 55313], | 80.00th=[ 72877], 90.00th=[ 98042], 95.00th=[ 119014], | 99.00th=[ 187696], 99.50th=[ 265290], 99.90th=[ 442500], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 120, per=25.50%, avg=49.48, stdev=22.23, samples=246 iops : min= 1, max= 30, avg=11.72, stdev= 5.61, samples=246 lat (usec) : 50=0.52%, 100=4.00%, 250=0.23%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=6.61%, 4=4.23%, 10=6.67%, 20=10.03%, 50=36.26% lat (msec) : 100=24.41%, 250=6.41%, 500=0.26%, 2000=0.03% cpu : usr=0.08%, sys=4.94%, ctx=6290, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (191kB/s), 46.4KiB/s-48.1KiB/s (47.5kB/s-49.3kB/s), io=23.4MiB (24.6MB), run=124013-129045msec WRITE: bw=195KiB/s (199kB/s), 48.8KiB/s-51.2KiB/s (49.0kB/s-52.4kB/s), io=24.6MiB (25.7MB), run=124013-129045msec fio: pid=144997, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=144996: Fri Aug 21 23:56:44 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(5992KiB/280330msec) clat (msec): min=4, max=1084, avg=39.00, stdev=43.12 lat (msec): min=4, max=1084, avg=39.00, stdev=43.12 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 102], | 99.00th=[ 184], 99.50th=[ 220], 99.90th=[ 300], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 92, per=31.27%, avg=24.08, stdev=16.37, samples=480 iops : min= 1, max= 23, avg= 5.37, stdev= 4.12, samples=480 write: IOPS=5, BW=22.5KiB/s (22.0kB/s)(6296KiB/280330msec); 0 zone resets clat (msec): min=25, max=696, avg=140.69, stdev=66.16 lat (msec): min=25, max=696, avg=140.69, stdev=66.16 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 186], 90.00th=[ 232], 95.00th=[ 271], | 99.00th=[ 342], 99.50th=[ 363], 99.90th=[ 592], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 71, per=27.31%, avg=22.12, stdev= 9.95, samples=547 iops : min= 1, max= 17, avg= 4.88, stdev= 2.55, samples=547 lat (msec) : 10=3.16%, 20=12.21%, 50=23.47%, 100=22.59%, 250=34.80% lat (msec) : 500=3.68%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.17%, ctx=5505, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144997: Fri Aug 21 23:56:44 2026 read: IOPS=4, BW=18.3KiB/s (18.8kB/s)(3764KiB/205445msec) clat (msec): min=5, max=1158, avg=45.93, stdev=53.10 lat (msec): min=5, max=1158, avg=45.93, stdev=53.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 96], 95.00th=[ 120], | 99.00th=[ 188], 99.50th=[ 239], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 96, per=27.94%, avg=21.51, stdev=14.62, samples=335 iops : min= 1, max= 24, avg= 4.71, stdev= 3.70, samples=335 write: IOPS=4, BW=19.0KiB/s (20.5kB/s)(4104KiB/205445msec); 0 zone resets clat (msec): min=32, max=683, avg=157.66, stdev=64.15 lat (msec): min=32, max=683, avg=157.66, stdev=64.15 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 77], 10.00th=[ 90], 20.00th=[ 106], | 30.00th=[ 118], 40.00th=[ 132], 50.00th=[ 144], 60.00th=[ 163], | 70.00th=[ 182], 80.00th=[ 205], 90.00th=[ 241], 95.00th=[ 279], | 99.00th=[ 342], 99.50th=[ 359], 99.90th=[ 498], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 55, per=24.21%, avg=19.61, stdev= 7.90, samples=400 iops : min= 1, max= 13, avg= 4.23, stdev= 2.01, samples=400 lat (msec) : 10=1.73%, 20=10.26%, 50=22.46%, 100=16.92%, 250=44.05% lat (msec) : 500=4.42%, 750=0.05%, 2000=0.05% cpu : usr=0.03%, sys=0.98%, ctx=3066, majf=0, minf=22 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=942,1026,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144998: Fri Aug 21 23:56:44 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6028KiB/278200msec) clat (msec): min=5, max=369, avg=40.00, stdev=37.30 lat (msec): min=5, max=369, avg=40.00, stdev=37.30 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 108], | 99.00th=[ 184], 99.50th=[ 236], 99.90th=[ 347], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 103, per=30.28%, avg=23.32, stdev=15.65, samples=497 iops : min= 1, max= 25, avg= 5.18, stdev= 3.94, samples=497 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6260KiB/278200msec); 0 zone resets clat (msec): min=30, max=1156, avg=138.88, stdev=68.66 lat (msec): min=30, max=1156, avg=138.88, stdev=68.66 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 222], 95.00th=[ 259], | 99.00th=[ 351], 99.50th=[ 380], 99.90th=[ 575], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 55, per=27.23%, avg=22.06, stdev=10.04, samples=544 iops : min= 1, max= 13, avg= 4.86, stdev= 2.57, samples=544 lat (msec) : 10=3.09%, 20=11.36%, 50=23.73%, 100=23.63%, 250=35.06% lat (msec) : 500=3.03%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.14%, ctx=5402, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144999: Fri Aug 21 23:56:44 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6052KiB/277503msec) clat (msec): min=4, max=614, avg=38.35, stdev=35.09 lat (msec): min=4, max=614, avg=38.35, stdev=35.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 75], 95.00th=[ 102], | 99.00th=[ 167], 99.50th=[ 203], 99.90th=[ 317], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 112, per=31.85%, avg=24.52, stdev=16.23, samples=476 iops : min= 1, max= 28, avg= 5.48, stdev= 4.12, samples=476 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6236KiB/277503msec); 0 zone resets clat (msec): min=35, max=1382, avg=140.46, stdev=69.74 lat (msec): min=35, max=1382, avg=140.46, stdev=69.74 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 182], 90.00th=[ 224], 95.00th=[ 259], | 99.00th=[ 355], 99.50th=[ 409], 99.90th=[ 502], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 64, per=27.28%, avg=22.10, stdev= 9.57, samples=542 iops : min= 1, max= 16, avg= 4.87, stdev= 2.45, samples=542 lat (msec) : 10=2.90%, 20=12.01%, 50=23.73%, 100=22.40%, 250=35.90% lat (msec) : 500=2.99%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5460, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=77.9KiB/s (79.8kB/s), 18.3KiB/s-21.8KiB/s (18.8kB/s-22.3kB/s), io=21.3MiB (22.4MB), run=205445-280330msec WRITE: bw=81.7KiB/s (83.6kB/s), 19.0KiB/s-22.5KiB/s (20.5kB/s-23.0kB/s), io=22.4MiB (23.4MB), run=205445-280330msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145057: Fri Aug 21 23:57:24 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5920KiB/28333msec) clat (usec): min=37, max=174744, avg=37060.13, stdev=29905.39 lat (usec): min=37, max=174745, avg=37062.07, stdev=29905.06 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 93], | 30.00th=[ 21890], 40.00th=[ 28443], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[128451], 99.50th=[164627], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 64, max= 473, per=25.05%, avg=208.13, stdev=92.76, samples=55 iops : min= 4, max= 29, avg=12.25, stdev= 5.83, samples=55 write: IOPS=14, BW=225KiB/s (230kB/s)(6368KiB/28333msec); 0 zone resets clat (usec): min=1405, max=263185, avg=35255.66, stdev=38687.50 lat (usec): min=1407, max=263187, avg=35258.86, stdev=38687.35 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1729], 10.00th=[ 2089], 20.00th=[ 4883], | 30.00th=[ 8094], 40.00th=[ 14222], 50.00th=[ 23725], 60.00th=[ 32637], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 88605], 95.00th=[105382], | 99.00th=[208667], 99.50th=[246416], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 536, per=26.27%, avg=229.85, stdev=106.18, samples=54 iops : min= 1, max= 33, avg=13.61, stdev= 6.74, samples=54 lat (usec) : 50=1.30%, 100=8.46%, 250=0.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.21%, 4=3.91%, 10=9.24%, 20=8.46%, 50=34.64% lat (msec) : 100=23.05%, 250=4.56%, 500=0.13% cpu : usr=0.08%, sys=5.65%, ctx=1460, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145058: Fri Aug 21 23:57:24 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5744KiB/27915msec) clat (usec): min=34, max=248008, avg=41860.51, stdev=34128.62 lat (usec): min=34, max=248010, avg=41872.65, stdev=34125.30 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 70], 20.00th=[ 594], | 30.00th=[ 23725], 40.00th=[ 31589], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[130548], 99.50th=[175113], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 440, per=24.64%, avg=204.74, stdev=84.44, samples=54 iops : min= 1, max= 27, avg=12.06, stdev= 5.31, samples=54 write: IOPS=14, BW=234KiB/s (240kB/s)(6544KiB/27915msec); 0 zone resets clat (usec): min=1461, max=238589, avg=31034.24, stdev=32475.47 lat (usec): min=1463, max=238592, avg=31036.77, stdev=32475.49 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1860], 10.00th=[ 2245], 20.00th=[ 4621], | 30.00th=[ 7111], 40.00th=[ 12256], 50.00th=[ 20317], 60.00th=[ 29492], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[132645], 99.50th=[141558], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 63, max= 473, per=26.53%, avg=232.13, stdev=88.42, samples=54 iops : min= 3, max= 29, avg=13.76, stdev= 5.62, samples=54 lat (usec) : 50=1.56%, 100=6.77%, 250=0.91%, 750=0.13%, 1000=0.13% lat (msec) : 2=4.56%, 4=5.21%, 10=10.29%, 20=9.11%, 50=32.68% lat (msec) : 100=24.09%, 250=4.56% cpu : usr=0.10%, sys=6.04%, ctx=1498, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145059: Fri Aug 21 23:57:24 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28792msec) clat (usec): min=37, max=177077, avg=37422.74, stdev=32583.39 lat (usec): min=38, max=177079, avg=37432.46, stdev=32579.69 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 50], 10.00th=[ 64], 20.00th=[ 79], | 30.00th=[ 18220], 40.00th=[ 27919], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[173016], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 61, max= 568, per=26.85%, avg=223.16, stdev=113.60, samples=55 iops : min= 3, max= 35, avg=13.20, stdev= 7.20, samples=55 write: IOPS=13, BW=210KiB/s (215kB/s)(6032KiB/28792msec); 0 zone resets clat (usec): min=1170, max=306068, avg=36093.83, stdev=45334.38 lat (usec): min=1172, max=306071, avg=36096.95, stdev=45334.37 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1860], 10.00th=[ 2409], 20.00th=[ 5276], | 30.00th=[ 8586], 40.00th=[ 13304], 50.00th=[ 21103], 60.00th=[ 28967], | 70.00th=[ 38011], 80.00th=[ 60031], 90.00th=[ 88605], 95.00th=[122160], | 99.00th=[227541], 99.50th=[295699], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 492, per=23.64%, avg=206.88, stdev=103.28, samples=56 iops : min= 1, max= 30, avg=12.16, stdev= 6.55, samples=56 lat (usec) : 50=2.60%, 100=8.72%, 250=0.78%, 500=0.26%, 750=0.13% lat (msec) : 2=3.78%, 4=4.17%, 10=9.64%, 20=10.29%, 50=32.03% lat (msec) : 100=21.74%, 250=5.60%, 500=0.26% cpu : usr=0.09%, sys=4.99%, ctx=1445, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145060: Fri Aug 21 23:57:24 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28121msec) clat (usec): min=31, max=225475, avg=39798.34, stdev=35136.30 lat (usec): min=31, max=225477, avg=39800.77, stdev=35135.78 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 99], | 30.00th=[ 21365], 40.00th=[ 29492], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[166724], 99.50th=[217056], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 95, max= 472, per=26.91%, avg=223.64, stdev=75.23, samples=53 iops : min= 5, max= 29, avg=13.23, stdev= 4.78, samples=53 write: IOPS=13, BW=222KiB/s (228kB/s)(6256KiB/28121msec); 0 zone resets clat (usec): min=1229, max=297113, avg=32462.83, stdev=39370.30 lat (usec): min=1231, max=297117, avg=32470.18, stdev=39367.58 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1663], 10.00th=[ 2024], 20.00th=[ 4015], | 30.00th=[ 6783], 40.00th=[ 10290], 50.00th=[ 19268], 60.00th=[ 28705], | 70.00th=[ 40633], 80.00th=[ 55313], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[229639], 99.50th=[291505], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 521, per=25.58%, avg=223.82, stdev=106.86, samples=55 iops : min= 1, max= 32, avg=13.22, stdev= 6.74, samples=55 lat (usec) : 50=1.04%, 100=8.85%, 250=1.43%, 500=0.13% lat (msec) : 2=4.82%, 4=5.21%, 10=9.77%, 20=8.07%, 50=32.94% lat (msec) : 100=23.05%, 250=4.43%, 500=0.26% cpu : usr=0.07%, sys=5.34%, ctx=1439, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=832KiB/s (852kB/s), 206KiB/s-217KiB/s (211kB/s-222kB/s), io=23.4MiB (24.5MB), run=27915-28792msec WRITE: bw=875KiB/s (896kB/s), 210KiB/s-234KiB/s (215kB/s-240kB/s), io=24.6MiB (25.8MB), run=27915-28792msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145053: Fri Aug 21 23:58:05 2026 read: IOPS=5, BW=86.3KiB/s (88.3kB/s)(5920KiB/68632msec) clat (msec): min=6, max=269, avg=36.42, stdev=35.48 lat (msec): min=6, max=269, avg=36.42, stdev=35.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 78], 95.00th=[ 102], | 99.00th=[ 211], 99.50th=[ 259], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 382, per=27.79%, avg=96.71, stdev=64.75, samples=119 iops : min= 1, max= 23, avg= 5.26, stdev= 4.05, samples=119 write: IOPS=5, BW=92.8KiB/s (95.0kB/s)(6368KiB/68632msec); 0 zone resets clat (msec): min=39, max=429, avg=137.53, stdev=57.43 lat (msec): min=39, max=429, avg=137.53, stdev=57.43 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 114], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 213], 95.00th=[ 249], | 99.00th=[ 326], 99.50th=[ 401], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 190, per=25.77%, avg=94.32, stdev=37.63, samples=132 iops : min= 1, max= 11, avg= 5.10, stdev= 2.38, samples=132 lat (msec) : 10=1.56%, 20=15.49%, 50=22.53%, 100=20.31%, 250=37.37% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.10%, ctx=1201, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145054: Fri Aug 21 23:58:05 2026 read: IOPS=5, BW=83.5KiB/s (85.5kB/s)(5744KiB/68803msec) clat (msec): min=6, max=271, avg=37.45, stdev=37.32 lat (msec): min=6, max=271, avg=37.45, stdev=37.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 74], 95.00th=[ 112], | 99.00th=[ 190], 99.50th=[ 224], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 23, max= 255, per=27.14%, avg=94.45, stdev=57.62, samples=120 iops : min= 1, max= 15, avg= 5.12, stdev= 3.59, samples=120 write: IOPS=5, BW=95.1KiB/s (97.4kB/s)(6544KiB/68803msec); 0 zone resets clat (msec): min=53, max=680, avg=134.53, stdev=62.45 lat (msec): min=53, max=680, avg=134.54, stdev=62.45 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 112], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 205], 95.00th=[ 245], | 99.00th=[ 342], 99.50th=[ 414], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 23, max= 190, per=26.07%, avg=95.42, stdev=38.75, samples=135 iops : min= 1, max= 11, avg= 5.18, stdev= 2.48, samples=135 lat (msec) : 10=1.82%, 20=15.23%, 50=21.48%, 100=22.53%, 250=36.85% lat (msec) : 500=1.95%, 750=0.13% cpu : usr=0.04%, sys=1.20%, ctx=1269, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145055: Fri Aug 21 23:58:05 2026 read: IOPS=5, BW=95.1KiB/s (97.4kB/s)(6256KiB/65766msec) clat (msec): min=6, max=397, avg=36.57, stdev=41.23 lat (msec): min=6, max=397, avg=36.57, stdev=41.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 66], 95.00th=[ 108], | 99.00th=[ 253], 99.50th=[ 300], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 31, max= 318, per=29.86%, avg=103.90, stdev=70.56, samples=119 iops : min= 1, max= 19, avg= 5.71, stdev= 4.44, samples=119 write: IOPS=5, BW=91.7KiB/s (93.9kB/s)(6032KiB/65766msec); 0 zone resets clat (msec): min=43, max=394, avg=136.30, stdev=57.98 lat (msec): min=43, max=394, avg=136.31, stdev=57.97 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 176], 90.00th=[ 222], 95.00th=[ 253], | 99.00th=[ 342], 99.50th=[ 368], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 222, per=25.52%, avg=93.41, stdev=36.14, samples=126 iops : min= 1, max= 13, avg= 5.05, stdev= 2.33, samples=126 lat (msec) : 10=2.08%, 20=16.15%, 50=25.13%, 100=19.53%, 250=34.11% lat (msec) : 500=2.99% cpu : usr=0.04%, sys=1.24%, ctx=1316, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145056: Fri Aug 21 23:58:05 2026 read: IOPS=5, BW=88.9KiB/s (91.1kB/s)(6032KiB/67815msec) clat (msec): min=6, max=401, avg=36.17, stdev=37.00 lat (msec): min=6, max=401, avg=36.17, stdev=37.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 46], 90.00th=[ 68], 95.00th=[ 110], | 99.00th=[ 203], 99.50th=[ 213], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 320, per=29.55%, avg=102.83, stdev=63.98, samples=115 iops : min= 1, max= 20, avg= 5.63, stdev= 4.03, samples=115 write: IOPS=5, BW=92.3KiB/s (94.5kB/s)(6256KiB/67815msec); 0 zone resets clat (msec): min=32, max=543, avg=137.80, stdev=63.93 lat (msec): min=32, max=543, avg=137.80, stdev=63.93 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 113], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 176], 90.00th=[ 222], 95.00th=[ 259], | 99.00th=[ 372], 99.50th=[ 409], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 23, max= 191, per=25.36%, avg=92.82, stdev=39.51, samples=133 iops : min= 1, max= 11, avg= 5.01, stdev= 2.48, samples=133 lat (msec) : 10=3.39%, 20=14.06%, 50=23.18%, 100=19.79%, 250=36.46% lat (msec) : 500=2.99%, 750=0.13% cpu : usr=0.04%, sys=1.19%, ctx=1217, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=348KiB/s (356kB/s), 83.5KiB/s-95.1KiB/s (85.5kB/s-97.4kB/s), io=23.4MiB (24.5MB), run=65766-68803msec WRITE: bw=366KiB/s (375kB/s), 91.7KiB/s-95.1KiB/s (93.9kB/s-97.4kB/s), io=24.6MiB (25.8MB), run=65766-68803msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145082: Fri Aug 21 23:58:23 2026 read: IOPS=1, BW=1713KiB/s (1754kB/s)(7168KiB/4185msec) clat (msec): min=128, max=768, avg=286.56, stdev=219.09 lat (msec): min=128, max=768, avg=286.56, stdev=219.08 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 163], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 213], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 292], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1622, max= 4071, per=58.92%, avg=2330.40, stdev=987.55, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1223KiB/s (1253kB/s)(5120KiB/4185msec); 0 zone resets clat (msec): min=285, max=520, avg=374.39, stdev=96.71 lat (msec): min=285, max=520, avg=374.47, stdev=96.71 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1889, max= 2043, per=36.17%, avg=2002.60, stdev=64.44, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.06%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145083: Fri Aug 21 23:58:23 2026 read: IOPS=0, BW=409KiB/s (419kB/s)(2048KiB/5007msec) clat (msec): min=251, max=529, avg=390.55, stdev=196.17 lat (msec): min=251, max=529, avg=390.55, stdev=196.17 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1602, max= 1954, per=44.96%, avg=1778.00, stdev=248.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2045KiB/s (2094kB/s)(10.0MiB/5007msec); 0 zone resets clat (msec): min=104, max=1046, avg=412.64, stdev=315.29 lat (msec): min=104, max=1046, avg=413.01, stdev=315.22 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 148], | 30.00th=[ 253], 40.00th=[ 279], 50.00th=[ 288], 60.00th=[ 334], | 70.00th=[ 338], 80.00th=[ 422], 90.00th=[ 919], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1889, max= 4087, per=41.44%, avg=2294.57, stdev=792.40, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.04%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145085: Fri Aug 21 23:58:23 2026 read: IOPS=1, BW=1223KiB/s (1253kB/s)(6144KiB/5022msec) clat (msec): min=66, max=1208, avg=371.09, stdev=443.25 lat (msec): min=66, max=1208, avg=371.09, stdev=443.25 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 192], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1889, max= 2043, per=50.20%, avg=1985.60, stdev=63.65, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1223KiB/s (1253kB/s)(6144KiB/5022msec); 0 zone resets clat (msec): min=263, max=925, avg=457.71, stdev=244.07 lat (msec): min=263, max=925, avg=458.76, stdev=243.48 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 426], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1551, max= 2043, per=34.43%, avg=1906.60, stdev=208.33, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.49%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145087: Fri Aug 21 23:58:23 2026 read: IOPS=0, BW=989KiB/s (1013kB/s)(5120KiB/5178msec) clat (msec): min=36, max=600, avg=298.09, stdev=222.63 lat (msec): min=36, max=600, avg=298.09, stdev=222.63 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 37], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1954, max= 4087, per=67.90%, avg=2685.33, stdev=1214.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1384KiB/s (1418kB/s)(7168KiB/5178msec); 0 zone resets clat (msec): min=94, max=1201, avg=501.63, stdev=414.56 lat (msec): min=94, max=1201, avg=501.73, stdev=414.57 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 148], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 430], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 860], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1889, max= 2039, per=36.02%, avg=1994.50, stdev=71.11, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.41%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3955KiB/s (4050kB/s), 409KiB/s-1713KiB/s (419kB/s-1754kB/s), io=20.0MiB (20.0MB), run=4185-5178msec WRITE: bw=5537KiB/s (5670kB/s), 1223KiB/s-2045KiB/s (1253kB/s-2094kB/s), io=28.0MiB (29.4MB), run=4185-5178msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145084: Fri Aug 21 23:58:23 2026 read: IOPS=1, BW=1962KiB/s (2009kB/s)(7168KiB/3653msec) clat (msec): min=17, max=359, avg=237.26, stdev=112.98 lat (msec): min=17, max=359, avg=237.26, stdev=112.98 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 190], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 271], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 330], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2011, max= 4096, per=83.65%, avg=3379.33, stdev=1185.46, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1402KiB/s (1435kB/s)(5120KiB/3653msec); 0 zone resets clat (msec): min=164, max=503, avg=310.65, stdev=130.46 lat (msec): min=164, max=503, avg=310.75, stdev=130.46 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2011, max= 4015, per=47.46%, avg=2684.33, stdev=1152.42, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 20=8.33%, 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=10.21%, ctx=196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145086: Fri Aug 21 23:58:23 2026 read: IOPS=0, BW=404KiB/s (414kB/s)(2048KiB/5069msec) clat (usec): min=500, max=235086, avg=117793.31, stdev=165877.19 lat (usec): min=501, max=235088, avg=117795.14, stdev=165877.84 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[235930], | 70.00th=[235930], 80.00th=[235930], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 1424, max= 1996, per=42.33%, avg=1710.00, stdev=404.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2020KiB/s (2069kB/s)(10.0MiB/5069msec); 0 zone resets clat (msec): min=119, max=885, avg=469.46, stdev=300.21 lat (msec): min=119, max=885, avg=469.54, stdev=300.20 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 150], | 30.00th=[ 182], 40.00th=[ 203], 50.00th=[ 351], 60.00th=[ 600], | 70.00th=[ 642], 80.00th=[ 726], 90.00th=[ 835], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1996, max= 5941, per=56.84%, avg=3215.00, stdev=1770.91, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.95, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=8.33%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=8.62%, ctx=115, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145088: Fri Aug 21 23:58:23 2026 read: IOPS=1, BW=1552KiB/s (1590kB/s)(6144KiB/3958msec) clat (usec): min=739, max=248314, avg=114359.86, stdev=124322.93 lat (usec): min=740, max=248316, avg=114361.36, stdev=124323.04 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 2999], | 30.00th=[ 2999], 40.00th=[ 3294], 50.00th=[ 3294], 60.00th=[189793], | 70.00th=[240124], 80.00th=[240124], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 1957, max= 6023, per=82.57%, avg=3335.67, stdev=2327.56, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1552KiB/s (1590kB/s)(6144KiB/3958msec); 0 zone resets clat (msec): min=283, max=1197, avg=473.94, stdev=355.94 lat (msec): min=283, max=1197, avg=474.02, stdev=355.95 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 359], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 3915, max= 4031, per=70.49%, avg=3987.00, stdev=62.86, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 4=16.67%, 250=25.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=7.70%, ctx=107, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145089: Fri Aug 21 23:58:23 2026 read: IOPS=1, BW=1173KiB/s (1201kB/s)(5120KiB/4365msec) clat (usec): min=366, max=216941, avg=80916.68, stdev=110085.17 lat (usec): min=367, max=216941, avg=80917.97, stdev=110084.79 clat percentiles (usec): | 1.00th=[ 367], 5.00th=[ 367], 10.00th=[ 367], 20.00th=[ 367], | 30.00th=[ 486], 40.00th=[ 486], 50.00th=[ 2008], 60.00th=[ 2008], | 70.00th=[185598], 80.00th=[185598], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 3915, max= 3992, per=97.86%, avg=3953.50, stdev=54.45, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1642KiB/s (1682kB/s)(7168KiB/4365msec); 0 zone resets clat (msec): min=126, max=1190, avg=528.91, stdev=404.10 lat (msec): min=126, max=1190, avg=528.99, stdev=404.11 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 140], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 372], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 869], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1957, max= 3992, per=42.50%, avg=2403.80, stdev=888.43, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=16.67% lat (msec) : 4=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=7.10%, ctx=95, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4040KiB/s (4137kB/s), 404KiB/s-1962KiB/s (414kB/s-2009kB/s), io=20.0MiB (20.0MB), run=3653-5069msec WRITE: bw=5656KiB/s (5792kB/s), 1402KiB/s-2020KiB/s (1435kB/s-2069kB/s), io=28.0MiB (29.4MB), run=3653-5069msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145100: Fri Aug 21 23:58:41 2026 read: IOPS=0, BW=3728KiB/s (3818kB/s)(12.0MiB/3296msec) clat (msec): min=914, max=1171, avg=1073.90, stdev=139.10 lat (msec): min=914, max=1171, avg=1073.91, stdev=139.09 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8062, max= 8143, per=100.00%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.17%, ctx=327, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145101: Fri Aug 21 23:58:41 2026 read: IOPS=0, BW=1141KiB/s (1168kB/s)(4096KiB/3590msec) clat (nsec): min=749845k, max=749845k, avg=749845197.00, stdev= 0.00 lat (nsec): min=749848k, max=749848k, avg=749847629.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2282KiB/s (2337kB/s)(8192KiB/3590msec); 0 zone resets clat (msec): min=770, max=1903, avg=1337.12, stdev=801.07 lat (msec): min=772, max=1904, avg=1338.18, stdev=800.22 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 1905], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.79%, ctx=107, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145102: Fri Aug 21 23:58:41 2026 write: IOPS=0, BW=3260KiB/s (3339kB/s)(12.0MiB/3769msec); 0 zone resets clat (msec): min=1138, max=1270, avg=1189.42, stdev=70.84 lat (msec): min=1138, max=1271, avg=1190.04, stdev=71.13 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7984, max= 8175, per=100.00%, avg=8079.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=4.59%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145103: Fri Aug 21 23:58:41 2026 write: IOPS=0, BW=2879KiB/s (2948kB/s)(12.0MiB/4268msec); 0 zone resets clat (msec): min=347, max=2595, avg=1329.72, stdev=1150.47 lat (msec): min=348, max=2595, avg=1330.14, stdev=1150.28 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.81%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4564KiB/s (4673kB/s), 1141KiB/s-3728KiB/s (1168kB/s-3818kB/s), io=16.0MiB (16.8MB), run=3296-3590msec WRITE: bw=7678KiB/s (7862kB/s), 2282KiB/s-3260KiB/s (2337kB/s-3339kB/s), io=32.0MiB (33.6MB), run=3590-4268msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145096: Fri Aug 21 23:58:42 2026 read: IOPS=0, BW=3343KiB/s (3423kB/s)(12.0MiB/3676msec) clat (msec): min=489, max=1455, avg=1124.49, stdev=550.03 lat (msec): min=489, max=1456, avg=1124.49, stdev=550.03 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.67%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145097: Fri Aug 21 23:58:42 2026 read: IOPS=0, BW=958KiB/s (981kB/s)(4096KiB/4276msec) clat (nsec): min=973133k, max=973133k, avg=973133450.00, stdev= 0.00 lat (nsec): min=973136k, max=973136k, avg=973136260.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1916KiB/s (1962kB/s)(8192KiB/4276msec); 0 zone resets clat (msec): min=1479, max=1666, avg=1573.26, stdev=131.97 lat (msec): min=1480, max=1667, avg=1573.99, stdev=131.60 clat percentiles (msec): | 1.00th=[ 1485], 5.00th=[ 1485], 10.00th=[ 1485], 20.00th=[ 1485], | 30.00th=[ 1485], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.01%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145098: Fri Aug 21 23:58:42 2026 write: IOPS=0, BW=2470KiB/s (2529kB/s)(12.0MiB/4975msec); 0 zone resets clat (msec): min=373, max=2956, avg=1609.18, stdev=1295.26 lat (msec): min=373, max=2956, avg=1610.26, stdev=1295.10 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 7907, max= 7968, per=100.00%, avg=7937.50, stdev=43.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.59%, ctx=67, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145099: Fri Aug 21 23:58:42 2026 write: IOPS=0, BW=3472KiB/s (3555kB/s)(12.0MiB/3539msec); 0 zone resets clat (msec): min=393, max=2266, avg=1128.24, stdev=999.28 lat (msec): min=394, max=2266, avg=1128.62, stdev=999.26 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 7861, max= 8175, per=100.00%, avg=8018.00, stdev=222.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.02%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3832KiB/s (3924kB/s), 958KiB/s-3343KiB/s (981kB/s-3423kB/s), io=16.0MiB (16.8MB), run=3676-4276msec WRITE: bw=6587KiB/s (6745kB/s), 1916KiB/s-3472KiB/s (1962kB/s-3555kB/s), io=32.0MiB (33.6MB), run=3539-4975msec