== sanity test 398b: DIO and buffer IO race ============== 22:53:15 (1789786395) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.09084 s, 7.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143958: Fri Sep 18 22:55:52 2026 read: IOPS=11, BW=45.4KiB/s (46.5kB/s)(5992KiB/131846msec) clat (usec): min=38, max=346517, avg=43740.14, stdev=32461.64 lat (usec): min=39, max=346518, avg=43743.41, stdev=32461.55 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 9110], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[164627], 99.50th=[200279], 99.90th=[248513], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 110, per=25.33%, avg=45.09, stdev=19.13, samples=257 iops : min= 1, max= 27, avg=10.61, stdev= 4.83, samples=257 write: IOPS=11, BW=47.8KiB/s (48.9kB/s)(6296KiB/131846msec); 0 zone resets clat (usec): min=846, max=995468, avg=41787.09, stdev=48038.19 lat (usec): min=847, max=995469, avg=41792.51, stdev=48038.81 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1467], 20.00th=[ 4015], | 30.00th=[ 7439], 40.00th=[ 17695], 50.00th=[ 29754], 60.00th=[ 41681], | 70.00th=[ 57410], 80.00th=[ 74974], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[164627], 99.50th=[187696], 99.90th=[283116], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 151, per=25.41%, avg=47.26, stdev=21.74, samples=258 iops : min= 1, max= 37, avg=11.17, stdev= 5.45, samples=258 lat (usec) : 50=0.20%, 100=3.45%, 250=0.68%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=6.84%, 4=3.45%, 10=7.13%, 20=8.11%, 50=35.84% lat (msec) : 100=26.33%, 250=7.49%, 500=0.13%, 1000=0.03% cpu : usr=0.10%, sys=5.31%, ctx=6544, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143959: Fri Sep 18 22:55:52 2026 read: IOPS=11, BW=45.1KiB/s (46.2kB/s)(5940KiB/131794msec) clat (usec): min=38, max=268803, avg=43317.16, stdev=31924.48 lat (usec): min=38, max=268805, avg=43321.07, stdev=31927.60 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 824], 20.00th=[ 20841], | 30.00th=[ 26346], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 84411], 95.00th=[ 98042], | 99.00th=[154141], 99.50th=[189793], 99.90th=[248513], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 111, per=25.35%, avg=45.12, stdev=18.93, samples=256 iops : min= 1, max= 27, avg=10.62, stdev= 4.76, samples=256 write: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6348KiB/131794msec); 0 zone resets clat (usec): min=907, max=1020.6k, avg=42173.67, stdev=48721.52 lat (usec): min=907, max=1020.7k, avg=42179.50, stdev=48721.68 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1778], | 20.00th=[ 4752], 30.00th=[ 8717], 40.00th=[ 17171], | 50.00th=[ 31589], 60.00th=[ 42730], 70.00th=[ 55313], | 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[ 123208], | 99.00th=[ 179307], 99.50th=[ 217056], 99.90th=[ 295699], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 123, per=25.69%, avg=47.78, stdev=20.44, samples=258 iops : min= 1, max= 30, avg=11.29, stdev= 5.14, samples=258 lat (usec) : 50=0.13%, 100=3.97%, 250=0.36%, 500=0.23%, 750=0.10% lat (usec) : 1000=0.26% lat (msec) : 2=5.57%, 4=3.71%, 10=7.88%, 20=8.40%, 50=35.94% lat (msec) : 100=26.20%, 250=7.10%, 500=0.13%, 2000=0.03% cpu : usr=0.10%, sys=5.35%, ctx=6457, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143960: Fri Sep 18 22:55:52 2026 read: IOPS=11, BW=44.8KiB/s (45.8kB/s)(6028KiB/134659msec) clat (usec): min=34, max=1051.6k, avg=43277.44, stdev=41120.91 lat (usec): min=34, max=1051.6k, avg=43280.63, stdev=41121.25 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 10945], | 20.00th=[ 19530], 30.00th=[ 25297], 40.00th=[ 30278], | 50.00th=[ 35914], 60.00th=[ 43254], 70.00th=[ 51643], | 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[ 100140], | 99.00th=[ 156238], 99.50th=[ 187696], 99.90th=[ 270533], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 111, per=24.83%, avg=44.20, stdev=20.71, samples=264 iops : min= 1, max= 27, avg=10.39, stdev= 5.22, samples=264 write: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6260KiB/134659msec); 0 zone resets clat (usec): min=867, max=394862, avg=44009.75, stdev=44320.67 lat (usec): min=868, max=394863, avg=44015.26, stdev=44320.53 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1319], 10.00th=[ 1942], 20.00th=[ 5145], | 30.00th=[ 10028], 40.00th=[ 21365], 50.00th=[ 33424], 60.00th=[ 44303], | 70.00th=[ 57934], 80.00th=[ 74974], 90.00th=[103285], 95.00th=[128451], | 99.00th=[189793], 99.50th=[214959], 99.90th=[346031], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 183, per=24.61%, avg=45.77, stdev=20.24, samples=264 iops : min= 1, max= 45, avg=10.79, stdev= 5.09, samples=264 lat (usec) : 50=0.26%, 100=3.84%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.37%, 4=3.26%, 10=6.80%, 20=9.54%, 50=36.59% lat (msec) : 100=25.85%, 250=7.81%, 500=0.13%, 2000=0.03% cpu : usr=0.10%, sys=5.26%, ctx=6641, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143961: Fri Sep 18 22:55:52 2026 read: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6052KiB/132733msec) clat (usec): min=33, max=1027.1k, avg=44052.92, stdev=41637.48 lat (usec): min=34, max=1027.1k, avg=44074.54, stdev=41641.95 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 180], | 20.00th=[ 19792], 30.00th=[ 25822], 40.00th=[ 30540], | 50.00th=[ 36963], 60.00th=[ 43254], 70.00th=[ 52691], | 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[ 104334], | 99.00th=[ 149947], 99.50th=[ 200279], 99.90th=[ 291505], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 111, per=25.51%, avg=45.41, stdev=20.80, samples=259 iops : min= 1, max= 27, avg=10.69, stdev= 5.24, samples=259 write: IOPS=11, BW=46.0KiB/s (48.1kB/s)(6236KiB/132733msec); 0 zone resets clat (usec): min=730, max=333418, avg=42018.58, stdev=43377.41 lat (usec): min=731, max=333419, avg=42021.92, stdev=43377.51 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 2114], 20.00th=[ 5538], | 30.00th=[ 10159], 40.00th=[ 20055], 50.00th=[ 29230], 60.00th=[ 41681], | 70.00th=[ 55837], 80.00th=[ 72877], 90.00th=[ 98042], 95.00th=[126354], | 99.00th=[189793], 99.50th=[231736], 99.90th=[308282], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 127, per=25.03%, avg=46.56, stdev=19.83, samples=260 iops : min= 1, max= 31, avg=10.98, stdev= 4.99, samples=260 lat (usec) : 50=0.46%, 100=4.10%, 250=0.49%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=5.01%, 4=3.65%, 10=6.93%, 20=9.34%, 50=36.23% lat (msec) : 100=25.88%, 250=7.39%, 500=0.20%, 2000=0.03% cpu : usr=0.09%, sys=5.18%, ctx=6586, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=178KiB/s (183kB/s), 44.8KiB/s-45.6KiB/s (45.8kB/s-46.7kB/s), io=23.4MiB (24.6MB), run=131794-134659msec WRITE: bw=187KiB/s (191kB/s), 46.5KiB/s-48.2KiB/s (47.6kB/s-49.3kB/s), io=24.6MiB (25.7MB), run=131794-134659msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143963: Fri Sep 18 22:58:13 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(5992KiB/274766msec) clat (msec): min=5, max=1143, avg=39.10, stdev=47.47 lat (msec): min=5, max=1143, avg=39.10, stdev=47.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 105], | 99.00th=[ 184], 99.50th=[ 239], 99.90th=[ 477], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 87, per=27.51%, avg=23.93, stdev=16.12, samples=482 iops : min= 1, max= 21, avg= 5.30, stdev= 4.05, samples=482 write: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6296KiB/274766msec); 0 zone resets clat (msec): min=34, max=575, avg=137.23, stdev=64.24 lat (msec): min=34, max=575, avg=137.23, stdev=64.25 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 96], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 163], 80.00th=[ 184], 90.00th=[ 224], 95.00th=[ 257], | 99.00th=[ 338], 99.50th=[ 372], 99.90th=[ 489], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 63, per=24.94%, avg=22.69, stdev=10.63, samples=533 iops : min= 1, max= 15, avg= 4.99, stdev= 2.69, samples=533 lat (msec) : 10=3.35%, 20=13.83%, 50=21.81%, 100=23.80%, 250=34.02% lat (msec) : 500=3.12%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.20%, ctx=5310, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143964: Fri Sep 18 22:58:13 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(5940KiB/274704msec) clat (msec): min=5, max=1078, avg=38.33, stdev=44.03 lat (msec): min=5, max=1078, avg=38.33, stdev=44.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 78], 95.00th=[ 103], | 99.00th=[ 165], 99.50th=[ 209], 99.90th=[ 477], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 104, per=27.87%, avg=24.25, stdev=16.98, samples=471 iops : min= 1, max= 26, avg= 5.38, stdev= 4.29, samples=471 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6348KiB/274704msec); 0 zone resets clat (msec): min=28, max=589, avg=137.13, stdev=64.96 lat (msec): min=28, max=589, avg=137.13, stdev=64.96 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 96], 40.00th=[ 110], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 222], 95.00th=[ 257], | 99.00th=[ 355], 99.50th=[ 376], 99.90th=[ 489], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 55, per=24.79%, avg=22.56, stdev=10.69, samples=540 iops : min= 1, max= 13, avg= 4.96, stdev= 2.71, samples=540 lat (msec) : 10=3.68%, 20=13.87%, 50=20.67%, 100=24.61%, 250=34.21% lat (msec) : 500=2.90%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.20%, ctx=5253, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143965: Fri Sep 18 22:58:13 2026 read: IOPS=5, BW=21.9KiB/s (22.5kB/s)(6028KiB/274697msec) clat (msec): min=4, max=383, avg=39.73, stdev=37.98 lat (msec): min=4, max=383, avg=39.74, stdev=37.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 83], 95.00th=[ 113], | 99.00th=[ 186], 99.50th=[ 228], 99.90th=[ 372], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 87, per=27.47%, avg=23.89, stdev=16.55, samples=485 iops : min= 1, max= 21, avg= 5.30, stdev= 4.17, samples=485 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6260KiB/274697msec); 0 zone resets clat (msec): min=28, max=1284, avg=137.15, stdev=73.66 lat (msec): min=28, max=1284, avg=137.15, stdev=73.66 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 82], | 30.00th=[ 94], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 188], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 368], 99.50th=[ 388], 99.90th=[ 592], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 56, per=24.64%, avg=22.43, stdev=11.37, samples=535 iops : min= 1, max= 14, avg= 4.93, stdev= 2.88, samples=535 lat (msec) : 10=3.74%, 20=12.92%, 50=21.94%, 100=25.33%, 250=32.39% lat (msec) : 500=3.61%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.25%, ctx=5342, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143966: Fri Sep 18 22:58:13 2026 read: IOPS=5, BW=22.3KiB/s (22.9kB/s)(6052KiB/271177msec) clat (msec): min=5, max=411, avg=38.59, stdev=36.95 lat (msec): min=5, max=411, avg=38.60, stdev=36.95 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 107], | 99.00th=[ 167], 99.50th=[ 234], 99.90th=[ 384], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 95, per=28.36%, avg=24.67, stdev=17.11, samples=473 iops : min= 1, max= 23, avg= 5.51, stdev= 4.32, samples=473 write: IOPS=5, BW=22.0KiB/s (23.5kB/s)(6236KiB/271177msec); 0 zone resets clat (msec): min=37, max=1199, avg=136.40, stdev=69.16 lat (msec): min=37, max=1199, avg=136.41, stdev=69.16 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 222], 95.00th=[ 259], | 99.00th=[ 334], 99.50th=[ 401], 99.90th=[ 426], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 63, per=24.79%, avg=22.56, stdev=10.85, samples=531 iops : min= 1, max= 15, avg= 4.97, stdev= 2.74, samples=531 lat (msec) : 10=3.26%, 20=13.64%, 50=21.97%, 100=25.29%, 250=32.62% lat (msec) : 500=3.19%, 2000=0.03% cpu : usr=0.05%, sys=1.25%, ctx=5290, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=87.4KiB/s (89.5kB/s), 21.6KiB/s-22.3KiB/s (22.1kB/s-22.9kB/s), io=23.4MiB (24.6MB), run=271177-274766msec WRITE: bw=91.5KiB/s (93.7kB/s), 22.8KiB/s-23.1KiB/s (23.3kB/s-23.7kB/s), io=24.6MiB (25.7MB), run=271177-274766msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144025: Fri Sep 18 22:58:55 2026 read: IOPS=14, BW=224KiB/s (229kB/s)(5920KiB/26422msec) clat (usec): min=40, max=215622, avg=36630.37, stdev=29994.13 lat (usec): min=40, max=215624, avg=36631.92, stdev=29994.10 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 223], | 30.00th=[ 21890], 40.00th=[ 28181], 50.00th=[ 33162], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 55837], 90.00th=[ 70779], 95.00th=[ 84411], | 99.00th=[137364], 99.50th=[156238], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 471, per=26.39%, avg=224.61, stdev=105.43, samples=51 iops : min= 1, max= 29, avg=13.31, stdev= 6.69, samples=51 write: IOPS=15, BW=241KiB/s (247kB/s)(6368KiB/26422msec); 0 zone resets clat (usec): min=1559, max=287161, avg=31924.76, stdev=39366.63 lat (usec): min=1562, max=287163, avg=31939.02, stdev=39361.93 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1827], 10.00th=[ 2442], 20.00th=[ 4359], | 30.00th=[ 6915], 40.00th=[ 10290], 50.00th=[ 16581], 60.00th=[ 24249], | 70.00th=[ 37487], 80.00th=[ 55313], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[196084], 99.50th=[250610], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 50, max= 476, per=27.15%, avg=243.00, stdev=96.91, samples=51 iops : min= 3, max= 29, avg=14.47, stdev= 6.08, samples=51 lat (usec) : 50=0.65%, 100=8.07%, 250=0.91%, 500=0.13% lat (msec) : 2=3.91%, 4=5.34%, 10=11.46%, 20=11.33%, 50=33.98% lat (msec) : 100=19.66%, 250=4.30%, 500=0.26% cpu : usr=0.11%, sys=6.53%, ctx=1419, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144026: Fri Sep 18 22:58:55 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(5744KiB/28132msec) clat (usec): min=41, max=201850, avg=37198.12, stdev=29449.16 lat (usec): min=41, max=201852, avg=37206.66, stdev=29448.44 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 78], 20.00th=[ 10290], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 84411], | 99.00th=[156238], 99.50th=[187696], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 25, max= 441, per=25.34%, avg=215.65, stdev=93.70, samples=52 iops : min= 1, max= 27, avg=12.75, stdev= 5.95, samples=52 write: IOPS=14, BW=233KiB/s (238kB/s)(6544KiB/28132msec); 0 zone resets clat (usec): min=1337, max=398952, avg=34904.44, stdev=48945.70 lat (usec): min=1339, max=398955, avg=34907.34, stdev=48945.75 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1942], 10.00th=[ 2737], 20.00th=[ 4883], | 30.00th=[ 7504], 40.00th=[ 11863], 50.00th=[ 17433], 60.00th=[ 26608], | 70.00th=[ 38536], 80.00th=[ 52691], 90.00th=[ 82314], 95.00th=[114820], | 99.00th=[235930], 99.50th=[278922], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 31, max= 631, per=26.04%, avg=233.05, stdev=121.41, samples=55 iops : min= 1, max= 39, avg=13.84, stdev= 7.63, samples=55 lat (usec) : 50=0.26%, 100=7.03%, 250=1.30%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.12%, 4=5.34%, 10=11.46%, 20=11.46%, 50=34.64% lat (msec) : 100=20.57%, 250=3.91%, 500=0.52% cpu : usr=0.09%, sys=6.48%, ctx=1433, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144027: Fri Sep 18 22:58:55 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(6256KiB/27844msec) clat (usec): min=34, max=231169, avg=37264.50, stdev=31212.52 lat (usec): min=35, max=231171, avg=37268.81, stdev=31212.24 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 709], | 30.00th=[ 22152], 40.00th=[ 27919], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 57410], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[135267], 99.50th=[200279], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 536, per=26.88%, avg=228.77, stdev=103.93, samples=53 iops : min= 1, max= 33, avg=13.55, stdev= 6.55, samples=53 write: IOPS=13, BW=217KiB/s (222kB/s)(6032KiB/27844msec); 0 zone resets clat (usec): min=1519, max=264454, avg=34151.45, stdev=40493.28 lat (usec): min=1521, max=264457, avg=34154.82, stdev=40492.95 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1860], 10.00th=[ 2474], 20.00th=[ 5276], | 30.00th=[ 7570], 40.00th=[ 11994], 50.00th=[ 20317], 60.00th=[ 31589], | 70.00th=[ 41157], 80.00th=[ 56361], 90.00th=[ 78119], 95.00th=[106431], | 99.00th=[229639], 99.50th=[254804], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 50, max= 662, per=23.88%, avg=213.74, stdev=109.23, samples=54 iops : min= 3, max= 41, avg=12.63, stdev= 6.93, samples=54 lat (usec) : 50=0.78%, 100=7.03%, 250=2.34%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.52%, 4=4.69%, 10=10.16%, 20=9.77%, 50=36.07% lat (msec) : 100=20.57%, 250=4.56%, 500=0.26% cpu : usr=0.09%, sys=6.13%, ctx=1515, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144028: Fri Sep 18 22:58:55 2026 read: IOPS=14, BW=227KiB/s (233kB/s)(6032KiB/26540msec) clat (usec): min=33, max=152104, avg=37456.62, stdev=29167.15 lat (usec): min=33, max=152106, avg=37458.29, stdev=29167.12 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 330], | 30.00th=[ 23200], 40.00th=[ 30016], 50.00th=[ 36439], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 55313], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[129500], 99.50th=[141558], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 63, max= 570, per=27.83%, avg=236.82, stdev=100.94, samples=50 iops : min= 3, max= 35, avg=14.06, stdev= 6.39, samples=50 write: IOPS=14, BW=236KiB/s (241kB/s)(6256KiB/26540msec); 0 zone resets clat (usec): min=1223, max=307084, avg=30617.10, stdev=39017.54 lat (usec): min=1223, max=307088, avg=30619.97, stdev=39017.61 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1909], 10.00th=[ 2671], 20.00th=[ 4817], | 30.00th=[ 6718], 40.00th=[ 8848], 50.00th=[ 15008], 60.00th=[ 23725], | 70.00th=[ 35390], 80.00th=[ 50070], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[164627], 99.50th=[299893], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 448, per=26.45%, avg=236.77, stdev=109.64, samples=52 iops : min= 1, max= 28, avg=14.08, stdev= 6.90, samples=52 lat (usec) : 50=1.17%, 100=8.20%, 250=0.39%, 500=0.26%, 750=0.13% lat (msec) : 2=3.65%, 4=5.08%, 10=13.41%, 20=9.38%, 50=34.51% lat (msec) : 100=19.40%, 250=4.17%, 500=0.26% cpu : usr=0.11%, sys=6.42%, ctx=1426, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=851KiB/s (872kB/s), 204KiB/s-227KiB/s (209kB/s-233kB/s), io=23.4MiB (24.5MB), run=26422-28132msec WRITE: bw=896KiB/s (917kB/s), 217KiB/s-241KiB/s (222kB/s-247kB/s), io=24.6MiB (25.8MB), run=26422-28132msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144021: Fri Sep 18 22:59:38 2026 read: IOPS=5, BW=83.9KiB/s (85.9kB/s)(5920KiB/70584msec) clat (msec): min=6, max=214, avg=37.74, stdev=32.95 lat (msec): min=6, max=214, avg=37.75, stdev=32.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 80], 95.00th=[ 103], | 99.00th=[ 203], 99.50th=[ 205], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 378, per=27.92%, avg=93.24, stdev=55.33, samples=124 iops : min= 1, max= 23, avg= 5.02, stdev= 3.53, samples=124 write: IOPS=5, BW=90.2KiB/s (92.4kB/s)(6368KiB/70584msec); 0 zone resets clat (msec): min=39, max=590, avg=142.06, stdev=63.05 lat (msec): min=39, max=590, avg=142.07, stdev=63.05 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 184], 90.00th=[ 215], 95.00th=[ 247], | 99.00th=[ 368], 99.50th=[ 439], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 31, max= 191, per=25.89%, avg=91.12, stdev=36.63, samples=137 iops : min= 1, max= 11, avg= 4.88, stdev= 2.32, samples=137 lat (msec) : 10=1.17%, 20=14.06%, 50=24.35%, 100=19.53%, 250=38.54% lat (msec) : 500=2.21%, 750=0.13% cpu : usr=0.03%, sys=1.27%, ctx=1259, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144022: Fri Sep 18 22:59:38 2026 read: IOPS=5, BW=80.3KiB/s (82.3kB/s)(5744KiB/71508msec) clat (msec): min=7, max=463, avg=39.11, stdev=46.00 lat (msec): min=7, max=463, avg=39.11, stdev=46.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 79], 95.00th=[ 114], | 99.00th=[ 239], 99.50th=[ 380], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 22, max= 320, per=29.00%, avg=96.85, stdev=63.86, samples=117 iops : min= 1, max= 20, avg= 5.25, stdev= 4.07, samples=117 write: IOPS=5, BW=91.5KiB/s (93.7kB/s)(6544KiB/71508msec); 0 zone resets clat (msec): min=32, max=494, avg=139.81, stdev=59.12 lat (msec): min=33, max=494, avg=139.83, stdev=59.11 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 103], 40.00th=[ 117], 50.00th=[ 131], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 182], 90.00th=[ 218], 95.00th=[ 247], | 99.00th=[ 317], 99.50th=[ 347], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 192, per=26.11%, avg=91.91, stdev=39.83, samples=140 iops : min= 1, max= 12, avg= 4.93, stdev= 2.52, samples=140 lat (msec) : 10=1.82%, 20=16.28%, 50=20.05%, 100=20.83%, 250=38.28% lat (msec) : 500=2.73% cpu : usr=0.05%, sys=1.19%, ctx=1299, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144023: Fri Sep 18 22:59:38 2026 read: IOPS=5, BW=94.3KiB/s (96.6kB/s)(6256KiB/66316msec) clat (msec): min=6, max=384, avg=34.91, stdev=39.03 lat (msec): min=6, max=384, avg=34.92, stdev=39.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 64], 95.00th=[ 100], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 317, per=31.36%, avg=104.73, stdev=71.61, samples=118 iops : min= 1, max= 19, avg= 5.73, stdev= 4.53, samples=118 write: IOPS=5, BW=90.0KiB/s (93.1kB/s)(6032KiB/66316msec); 0 zone resets clat (msec): min=46, max=506, avg=139.07, stdev=63.62 lat (msec): min=46, max=506, avg=139.07, stdev=63.62 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 129], 60.00th=[ 142], | 70.00th=[ 155], 80.00th=[ 184], 90.00th=[ 222], 95.00th=[ 253], | 99.00th=[ 326], 99.50th=[ 502], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 31, max= 191, per=25.94%, avg=91.30, stdev=38.11, samples=129 iops : min= 1, max= 11, avg= 4.89, stdev= 2.43, samples=129 lat (msec) : 10=1.69%, 20=17.84%, 50=23.31%, 100=20.57%, 250=33.72% lat (msec) : 500=2.60%, 750=0.26% cpu : usr=0.05%, sys=1.24%, ctx=1273, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144024: Fri Sep 18 22:59:38 2026 read: IOPS=5, BW=87.6KiB/s (89.7kB/s)(6032KiB/68890msec) clat (msec): min=7, max=227, avg=36.60, stdev=32.08 lat (msec): min=7, max=227, avg=36.60, stdev=32.08 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 101], | 99.00th=[ 199], 99.50th=[ 213], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 31, max= 320, per=29.23%, avg=97.63, stdev=60.43, samples=120 iops : min= 1, max= 20, avg= 5.29, stdev= 3.81, samples=120 write: IOPS=5, BW=90.8KiB/s (92.0kB/s)(6256KiB/68890msec); 0 zone resets clat (msec): min=38, max=498, avg=140.24, stdev=60.86 lat (msec): min=38, max=498, avg=140.25, stdev=60.86 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 79], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 116], 50.00th=[ 129], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 218], 95.00th=[ 247], | 99.00th=[ 338], 99.50th=[ 414], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 30, max= 223, per=26.12%, avg=91.95, stdev=37.91, samples=133 iops : min= 1, max= 13, avg= 4.93, stdev= 2.43, samples=133 lat (msec) : 10=1.30%, 20=15.36%, 50=23.31%, 100=20.05%, 250=37.63% lat (msec) : 500=2.34% cpu : usr=0.05%, sys=1.34%, ctx=1365, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=335KiB/s (343kB/s), 80.3KiB/s-94.3KiB/s (82.3kB/s-96.6kB/s), io=23.4MiB (24.5MB), run=66316-71508msec WRITE: bw=352KiB/s (361kB/s), 90.2KiB/s-91.5KiB/s (92.4kB/s-93.7kB/s), io=24.6MiB (25.8MB), run=66316-71508msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144047: Fri Sep 18 23:00:00 2026 read: IOPS=0, BW=777KiB/s (796kB/s)(7168KiB/9226msec) clat (usec): min=775, max=4925.3k, avg=877928.26, stdev=1787658.33 lat (usec): min=777, max=4925.3k, avg=877930.34, stdev=1787658.25 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], | 20.00th=[ 164627], 30.00th=[ 227541], 40.00th=[ 227541], | 50.00th=[ 246416], 60.00th=[ 254804], 70.00th=[ 254804], | 80.00th=[ 325059], 90.00th=[4932502], 95.00th=[4932502], | 99.00th=[4932502], 99.50th=[4932502], 99.90th=[4932502], | 99.95th=[4932502], 99.99th=[4932502] bw ( KiB/s): min= 1838, max= 3900, per=100.00%, avg=2354.00, stdev=868.26, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=555KiB/s (568kB/s)(5120KiB/9226msec); 0 zone resets clat (msec): min=147, max=2164, avg=599.60, stdev=875.71 lat (msec): min=147, max=2164, avg=599.72, stdev=875.70 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1950, max= 3676, per=82.28%, avg=2556.33, stdev=970.77, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=58.33%, 500=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=5.63%, ctx=468, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144048: Fri Sep 18 23:00:00 2026 read: IOPS=0, BW=285KiB/s (292kB/s)(2048KiB/7179msec) clat (msec): min=6, max=323, avg=164.87, stdev=224.57 lat (msec): min=6, max=323, avg=164.87, stdev=224.57 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 7], 40.00th=[ 7], 50.00th=[ 7], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1835, max= 2007, per=86.57%, avg=1921.00, stdev=121.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1426KiB/s (1461kB/s)(10.0MiB/7179msec); 0 zone resets clat (msec): min=144, max=2877, avg=672.05, stdev=815.88 lat (msec): min=144, max=2877, avg=672.39, stdev=815.77 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 197], | 30.00th=[ 207], 40.00th=[ 266], 50.00th=[ 321], 60.00th=[ 535], | 70.00th=[ 550], 80.00th=[ 667], 90.00th=[ 961], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1921, max= 6131, per=95.82%, avg=2977.00, stdev=1694.92, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 10=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=8.36%, ctx=167, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144049: Fri Sep 18 23:00:00 2026 read: IOPS=0, BW=824KiB/s (843kB/s)(6144KiB/7459msec) clat (msec): min=2, max=4390, avg=856.27, stdev=1745.61 lat (msec): min=2, max=4390, avg=856.27, stdev=1745.61 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 157], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 4071, max= 5807, per=100.00%, avg=4939.00, stdev=1227.54, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=0, BW=824KiB/s (843kB/s)(6144KiB/7459msec); 0 zone resets clat (msec): min=162, max=1065, avg=374.63, stdev=342.75 lat (msec): min=163, max=1065, avg=374.79, stdev=342.68 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 264], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1868, max= 3543, per=75.48%, avg=2345.25, stdev=801.44, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 4=16.67%, 20=8.33%, 250=33.33%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.72%, ctx=585, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144050: Fri Sep 18 23:00:00 2026 read: IOPS=0, BW=756KiB/s (774kB/s)(5120KiB/6774msec) clat (msec): min=3, max=394, avg=193.40, stdev=178.52 lat (msec): min=3, max=394, avg=193.40, stdev=178.52 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 4015, max= 4071, per=100.00%, avg=4043.00, stdev=39.60, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1058KiB/s (1084kB/s)(7168KiB/6774msec); 0 zone resets clat (msec): min=105, max=3392, avg=814.53, stdev=1159.89 lat (msec): min=105, max=3392, avg=814.92, stdev=1159.76 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 241], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 368], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 852], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1865, max= 4087, per=87.76%, avg=2726.60, stdev=1090.64, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 4=8.33%, 10=8.33%, 250=16.67%, 500=50.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.91%, ctx=185, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2220KiB/s (2273kB/s), 285KiB/s-824KiB/s (292kB/s-843kB/s), io=20.0MiB (20.0MB), run=6774-9226msec WRITE: bw=3108KiB/s (3182kB/s), 555KiB/s-1426KiB/s (568kB/s-1461kB/s), io=28.0MiB (29.4MB), run=6774-9226msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144052: Fri Sep 18 23:00:01 2026 read: IOPS=0, BW=715KiB/s (732kB/s)(7168KiB/10024msec) clat (msec): min=120, max=3346, avg=845.63, stdev=1187.34 lat (msec): min=120, max=3346, avg=845.64, stdev=1187.34 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 176], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 257], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 1401], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1309, max= 2039, per=89.80%, avg=1834.60, stdev=303.46, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=511KiB/s (523kB/s)(5120KiB/10024msec); 0 zone resets clat (msec): min=219, max=2417, avg=778.56, stdev=922.23 lat (msec): min=219, max=2419, avg=779.10, stdev=923.13 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1841, max= 3968, per=90.73%, avg=2595.00, stdev=1190.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.70%, ctx=87, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144053: Fri Sep 18 23:00:01 2026 read: IOPS=0, BW=220KiB/s (225kB/s)(2048KiB/9306msec) clat (msec): min=102, max=170, avg=136.64, stdev=47.60 lat (msec): min=102, max=170, avg=136.64, stdev=47.60 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 171], 95.00th=[ 171], | 99.00th=[ 171], 99.50th=[ 171], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 1486, max= 1841, per=81.42%, avg=1663.50, stdev=251.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1100KiB/s (1127kB/s)(10.0MiB/9306msec); 0 zone resets clat (msec): min=247, max=4192, avg=896.61, stdev=1180.08 lat (msec): min=247, max=4192, avg=896.76, stdev=1180.09 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 300], | 30.00th=[ 326], 40.00th=[ 372], 50.00th=[ 451], 60.00th=[ 642], | 70.00th=[ 785], 80.00th=[ 793], 90.00th=[ 869], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 1841, max= 2039, per=68.99%, avg=1973.12, stdev=77.08, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (msec) : 250=25.00%, 500=33.33%, 750=8.33%, 1000=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=2.71%, ctx=80, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144054: Fri Sep 18 23:00:01 2026 read: IOPS=0, BW=745KiB/s (763kB/s)(6144KiB/8245msec) clat (msec): min=104, max=3664, avg=820.59, stdev=1402.25 lat (msec): min=104, max=3664, avg=820.60, stdev=1402.26 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 264], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 1841, max= 3968, per=100.00%, avg=2473.00, stdev=1001.15, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=745KiB/s (763kB/s)(6144KiB/8245msec); 0 zone resets clat (msec): min=224, max=1467, avg=526.62, stdev=465.86 lat (msec): min=224, max=1469, avg=527.01, stdev=466.45 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 388], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1361, max= 2048, per=63.87%, avg=1826.60, stdev=275.33, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.12%, ctx=90, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144055: Fri Sep 18 23:00:01 2026 read: IOPS=0, BW=532KiB/s (545kB/s)(5120KiB/9622msec) clat (msec): min=132, max=580, avg=231.92, stdev=195.42 lat (msec): min=132, max=580, avg=231.92, stdev=195.42 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1855, max= 3938, per=100.00%, avg=2593.67, stdev=1166.12, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=745KiB/s (763kB/s)(7168KiB/9622msec); 0 zone resets clat (msec): min=266, max=4748, avg=1184.83, stdev=1621.98 lat (msec): min=266, max=4748, avg=1184.98, stdev=1622.02 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 326], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 1452], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1961, max= 2019, per=69.76%, avg=1995.17, stdev=26.20, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.59%, ctx=98, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2043KiB/s (2092kB/s), 220KiB/s-745KiB/s (225kB/s-763kB/s), io=20.0MiB (20.0MB), run=8245-10024msec WRITE: bw=2860KiB/s (2929kB/s), 511KiB/s-1100KiB/s (523kB/s-1127kB/s), io=28.0MiB (29.4MB), run=8245-10024msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144064: Fri Sep 18 23:00:18 2026 read: IOPS=0, BW=3689KiB/s (3778kB/s)(12.0MiB/3331msec) clat (msec): min=727, max=1169, avg=1005.53, stdev=241.68 lat (msec): min=727, max=1169, avg=1005.54, stdev=241.68 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7984, max= 8000, per=100.00%, avg=7992.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.43%, ctx=267, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144065: Fri Sep 18 23:00:18 2026 read: IOPS=0, BW=1153KiB/s (1180kB/s)(4096KiB/3554msec) clat (nsec): min=1290.1M, max=1290.1M, avg=1290146592.00, stdev= 0.00 lat (nsec): min=1290.1M, max=1290.1M, avg=1290149832.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2305KiB/s (2360kB/s)(8192KiB/3554msec); 0 zone resets clat (msec): min=661, max=1457, avg=1059.90, stdev=562.81 lat (msec): min=662, max=1458, avg=1060.57, stdev=563.29 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8000, max= 8000, per=86.77%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.95%, ctx=151, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144066: Fri Sep 18 23:00:18 2026 write: IOPS=1, BW=6582KiB/s (6740kB/s)(12.0MiB/1867msec); 0 zone resets clat (msec): min=419, max=729, avg=552.08, stdev=159.53 lat (msec): min=419, max=729, avg=553.35, stdev=159.20 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 5760, max= 8175, per=75.57%, avg=6967.50, stdev=1707.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=5.47%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144067: Fri Sep 18 23:00:18 2026 write: IOPS=1, BW=4359KiB/s (4464kB/s)(12.0MiB/2819msec); 0 zone resets clat (msec): min=668, max=1174, avg=924.94, stdev=253.24 lat (msec): min=668, max=1175, avg=925.95, stdev=253.76 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 5520, max= 8175, per=74.27%, avg=6847.50, stdev=1877.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.69%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4610KiB/s (4721kB/s), 1153KiB/s-3689KiB/s (1180kB/s-3778kB/s), io=16.0MiB (16.8MB), run=3331-3554msec WRITE: bw=9220KiB/s (9441kB/s), 2305KiB/s-6582KiB/s (2360kB/s-6740kB/s), io=32.0MiB (33.6MB), run=1867-3554msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144068: Fri Sep 18 23:00:20 2026 read: IOPS=0, BW=3599KiB/s (3686kB/s)(12.0MiB/3414msec) clat (msec): min=240, max=1631, avg=1109.96, stdev=757.58 lat (msec): min=240, max=1631, avg=1109.96, stdev=757.58 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7876, max= 8126, per=100.00%, avg=8001.00, stdev=176.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.16%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144069: Fri Sep 18 23:00:20 2026 read: IOPS=0, BW=1088KiB/s (1114kB/s)(4096KiB/3766msec) clat (nsec): min=1398.3M, max=1398.3M, avg=1398265497.00, stdev= 0.00 lat (nsec): min=1398.3M, max=1398.3M, avg=1398269070.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2175KiB/s (2227kB/s)(8192KiB/3766msec); 0 zone resets clat (msec): min=874, max=1158, avg=1016.61, stdev=201.01 lat (msec): min=875, max=1161, avg=1018.32, stdev=202.59 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.11%, sys=2.84%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144070: Fri Sep 18 23:00:20 2026 write: IOPS=0, BW=2808KiB/s (2875kB/s)(12.0MiB/4376msec); 0 zone resets clat (msec): min=316, max=2420, avg=1354.23, stdev=1052.22 lat (msec): min=317, max=2421, avg=1354.81, stdev=1052.17 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.31%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144071: Fri Sep 18 23:00:20 2026 write: IOPS=0, BW=3863KiB/s (3956kB/s)(12.0MiB/3181msec); 0 zone resets clat (msec): min=385, max=1774, avg=931.08, stdev=740.41 lat (msec): min=386, max=1774, avg=931.52, stdev=740.41 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.00%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4351KiB/s (4455kB/s), 1088KiB/s-3599KiB/s (1114kB/s-3686kB/s), io=16.0MiB (16.8MB), run=3414-3766msec WRITE: bw=7488KiB/s (7668kB/s), 2175KiB/s-3863KiB/s (2227kB/s-3956kB/s), io=32.0MiB (33.6MB), run=3181-4376msec