== sanity test 398b: DIO and buffer IO race ============== 09:08:40 (1787663320) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.77063 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146126: Tue Aug 25 09:11:21 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(5992KiB/143903msec) clat (usec): min=25, max=636860, avg=46818.47, stdev=38118.53 lat (usec): min=26, max=636861, avg=46823.96, stdev=38121.90 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 110], 20.00th=[ 20841], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 57934], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[173016], 99.50th=[196084], 99.90th=[256902], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 120, per=24.92%, avg=41.37, stdev=18.26, samples=282 iops : min= 1, max= 30, avg= 9.69, stdev= 4.57, samples=282 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6296KiB/143903msec); 0 zone resets clat (usec): min=1130, max=495151, avg=46494.67, stdev=48113.40 lat (usec): min=1131, max=495153, avg=46500.51, stdev=48117.36 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1549], 10.00th=[ 2442], 20.00th=[ 5342], | 30.00th=[ 9241], 40.00th=[ 20579], 50.00th=[ 33162], 60.00th=[ 46924], | 70.00th=[ 63177], 80.00th=[ 81265], 90.00th=[108528], 95.00th=[135267], | 99.00th=[202376], 99.50th=[238027], 99.90th=[329253], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 160, per=24.88%, avg=43.29, stdev=20.69, samples=283 iops : min= 1, max= 40, avg=10.18, stdev= 5.23, samples=283 lat (usec) : 50=0.52%, 100=4.23%, 250=0.65%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.10% lat (msec) : 2=4.39%, 4=3.74%, 10=8.07%, 20=7.62%, 50=32.78% lat (msec) : 100=27.64%, 250=9.70%, 500=0.26%, 750=0.03% cpu : usr=0.06%, sys=5.08%, ctx=6735, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146127: Tue Aug 25 09:11:21 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(5940KiB/143559msec) clat (usec): min=32, max=359360, avg=47700.48, stdev=35695.30 lat (usec): min=33, max=359362, avg=47701.86, stdev=35695.28 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 72], 10.00th=[ 996], 20.00th=[ 22414], | 30.00th=[ 28181], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 89654], 95.00th=[105382], | 99.00th=[152044], 99.50th=[187696], 99.90th=[350225], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 112, per=24.86%, avg=41.26, stdev=18.01, samples=280 iops : min= 1, max= 28, avg= 9.66, stdev= 4.53, samples=280 write: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6348KiB/143559msec); 0 zone resets clat (usec): min=884, max=780864, avg=45474.98, stdev=50084.92 lat (usec): min=885, max=780866, avg=45492.01, stdev=50101.33 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1434], 10.00th=[ 2024], 20.00th=[ 4621], | 30.00th=[ 10028], 40.00th=[ 20055], 50.00th=[ 33817], 60.00th=[ 45876], | 70.00th=[ 60031], 80.00th=[ 79168], 90.00th=[105382], 95.00th=[128451], | 99.00th=[193987], 99.50th=[258999], 99.90th=[467665], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 116, per=25.22%, avg=43.89, stdev=20.18, samples=281 iops : min= 1, max= 29, avg=10.32, stdev= 5.08, samples=281 lat (usec) : 50=0.23%, 100=3.61%, 250=0.72%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=5.08%, 4=4.26%, 10=6.25%, 20=8.33%, 50=33.43% lat (msec) : 100=28.78%, 250=8.53%, 500=0.39%, 1000=0.03% cpu : usr=0.06%, sys=5.21%, ctx=6792, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146128: Tue Aug 25 09:11:21 2026 read: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6028KiB/144354msec) clat (usec): min=20, max=316489, avg=46491.56, stdev=35162.85 lat (usec): min=20, max=316490, avg=46505.40, stdev=35159.91 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 206], 20.00th=[ 21627], | 30.00th=[ 27132], 40.00th=[ 33424], 50.00th=[ 39584], 60.00th=[ 47449], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[106431], | 99.00th=[158335], 99.50th=[189793], 99.90th=[312476], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 128, per=25.08%, avg=41.63, stdev=17.87, samples=282 iops : min= 1, max= 32, avg= 9.76, stdev= 4.49, samples=282 write: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6260KiB/144354msec); 0 zone resets clat (usec): min=1018, max=728223, avg=47093.36, stdev=50066.41 lat (usec): min=1019, max=728224, avg=47096.01, stdev=50066.99 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1565], 10.00th=[ 2638], 20.00th=[ 5669], | 30.00th=[ 10552], 40.00th=[ 22938], 50.00th=[ 35914], 60.00th=[ 47973], | 70.00th=[ 62129], 80.00th=[ 80217], 90.00th=[109577], 95.00th=[131597], | 99.00th=[214959], 99.50th=[238027], 99.90th=[488637], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 136, per=24.65%, avg=42.89, stdev=18.72, samples=284 iops : min= 1, max= 34, avg=10.07, stdev= 4.72, samples=284 lat (usec) : 50=0.42%, 100=3.97%, 250=0.62%, 500=0.26%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=3.94%, 4=3.78%, 10=7.45%, 20=7.32%, 50=34.38% lat (msec) : 100=27.93%, 250=9.44%, 500=0.33%, 750=0.03% cpu : usr=0.07%, sys=4.97%, ctx=6744, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146129: Tue Aug 25 09:11:21 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6052KiB/141097msec) clat (usec): min=32, max=629101, avg=44955.38, stdev=36598.08 lat (usec): min=32, max=629101, avg=44957.91, stdev=36598.08 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 64], 10.00th=[ 101], 20.00th=[ 20579], | 30.00th=[ 27395], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[158335], 99.50th=[185598], 99.90th=[333448], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 102, per=26.05%, avg=43.25, stdev=17.25, samples=272 iops : min= 1, max= 25, avg=10.16, stdev= 4.34, samples=272 write: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6236KiB/141097msec); 0 zone resets clat (usec): min=1143, max=677606, avg=46547.81, stdev=49183.09 lat (usec): min=1144, max=677607, avg=46550.64, stdev=49183.49 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1467], 10.00th=[ 2147], 20.00th=[ 5473], | 30.00th=[ 10814], 40.00th=[ 20317], 50.00th=[ 34341], 60.00th=[ 47973], | 70.00th=[ 61080], 80.00th=[ 81265], 90.00th=[108528], 95.00th=[137364], | 99.00th=[196084], 99.50th=[231736], 99.90th=[346031], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 102, per=25.11%, avg=43.70, stdev=17.63, samples=277 iops : min= 1, max= 25, avg=10.27, stdev= 4.45, samples=277 lat (usec) : 50=0.55%, 100=4.30%, 250=0.62%, 750=0.07%, 1000=0.03% lat (msec) : 2=5.01%, 4=3.58%, 10=6.41%, 20=8.89%, 50=34.11% lat (msec) : 100=27.08%, 250=9.02%, 500=0.26%, 750=0.07% cpu : usr=0.07%, sys=5.27%, ctx=6550, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 41.4KiB/s-42.9KiB/s (42.4kB/s-43.9kB/s), io=23.4MiB (24.6MB), run=141097-144354msec WRITE: bw=174KiB/s (178kB/s), 43.4KiB/s-44.2KiB/s (44.4kB/s-45.3kB/s), io=24.6MiB (25.7MB), run=141097-144354msec fio: pid=146135, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146132: Tue Aug 25 09:13:27 2026 read: IOPS=5, BW=22.4KiB/s (22.9kB/s)(5992KiB/267820msec) clat (msec): min=5, max=821, avg=37.82, stdev=44.84 lat (msec): min=5, max=821, avg=37.82, stdev=44.84 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 36], 80.00th=[ 53], 90.00th=[ 87], 95.00th=[ 122], | 99.00th=[ 192], 99.50th=[ 268], 99.90th=[ 405], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 104, per=32.13%, avg=24.74, stdev=17.56, samples=468 iops : min= 1, max= 26, avg= 5.56, stdev= 4.45, samples=468 write: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6296KiB/267820msec); 0 zone resets clat (msec): min=32, max=503, avg=134.05, stdev=72.23 lat (msec): min=32, max=503, avg=134.06, stdev=72.23 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 111], 60.00th=[ 129], | 70.00th=[ 150], 80.00th=[ 182], 90.00th=[ 239], 95.00th=[ 279], | 99.00th=[ 388], 99.50th=[ 418], 99.90th=[ 498], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 55, per=29.10%, avg=23.28, stdev=11.98, samples=521 iops : min= 1, max= 13, avg= 5.19, stdev= 3.07, samples=521 lat (msec) : 10=3.19%, 20=18.36%, 50=17.58%, 100=27.02%, 250=29.43% lat (msec) : 500=4.36%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.37%, ctx=5554, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146133: Tue Aug 25 09:13:27 2026 read: IOPS=5, BW=22.1KiB/s (22.6kB/s)(5940KiB/269208msec) clat (msec): min=6, max=711, avg=36.62, stdev=42.74 lat (msec): min=6, max=715, avg=36.62, stdev=42.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 49], 90.00th=[ 86], 95.00th=[ 112], | 99.00th=[ 184], 99.50th=[ 271], 99.90th=[ 405], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 95, per=32.95%, avg=25.37, stdev=17.48, samples=453 iops : min= 1, max= 23, avg= 5.72, stdev= 4.42, samples=453 write: IOPS=5, BW=23.6KiB/s (24.1kB/s)(6348KiB/269208msec); 0 zone resets clat (msec): min=40, max=577, avg=135.26, stdev=72.57 lat (msec): min=40, max=577, avg=135.27, stdev=72.57 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 114], 60.00th=[ 131], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 388], 99.50th=[ 418], 99.90th=[ 542], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 64, per=28.91%, avg=23.13, stdev=12.21, samples=529 iops : min= 1, max= 16, avg= 5.15, stdev= 3.12, samples=529 lat (msec) : 10=3.06%, 20=18.23%, 50=18.13%, 100=26.33%, 250=29.95% lat (msec) : 500=4.17%, 750=0.13% cpu : usr=0.04%, sys=1.39%, ctx=5527, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146134: Tue Aug 25 09:13:27 2026 read: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6028KiB/267261msec) clat (msec): min=6, max=404, avg=37.17, stdev=39.37 lat (msec): min=6, max=404, avg=37.18, stdev=39.37 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 54], 90.00th=[ 86], 95.00th=[ 114], | 99.00th=[ 190], 99.50th=[ 228], 99.90th=[ 397], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 103, per=31.99%, avg=24.63, stdev=17.14, samples=473 iops : min= 1, max= 25, avg= 5.53, stdev= 4.33, samples=473 write: IOPS=5, BW=23.4KiB/s (23.0kB/s)(6260KiB/267261msec); 0 zone resets clat (msec): min=39, max=859, avg=134.85, stdev=76.44 lat (msec): min=39, max=859, avg=134.86, stdev=76.44 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 150], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 284], | 99.00th=[ 397], 99.50th=[ 456], 99.90th=[ 743], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 48, per=29.06%, avg=23.25, stdev=12.04, samples=519 iops : min= 1, max= 12, avg= 5.18, stdev= 3.08, samples=519 lat (msec) : 10=2.51%, 20=19.34%, 50=17.42%, 100=27.08%, 250=29.33% lat (msec) : 500=4.20%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.43%, ctx=5590, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146135: Tue Aug 25 09:13:27 2026 read: IOPS=4, BW=16.1KiB/s (16.5kB/s)(2772KiB/172011msec) clat (msec): min=7, max=405, avg=59.47, stdev=49.47 lat (msec): min=7, max=405, avg=59.47, stdev=49.47 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 35], 50.00th=[ 44], 60.00th=[ 57], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 128], 95.00th=[ 150], | 99.00th=[ 211], 99.50th=[ 279], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 80, per=25.44%, avg=19.59, stdev=12.83, samples=269 iops : min= 1, max= 20, avg= 4.21, stdev= 3.25, samples=269 write: IOPS=4, BW=16.8KiB/s (17.2kB/s)(2888KiB/172011msec); 0 zone resets clat (msec): min=32, max=917, avg=181.04, stdev=87.38 lat (msec): min=32, max=917, avg=181.05, stdev=87.38 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 108], | 30.00th=[ 129], 40.00th=[ 144], 50.00th=[ 167], 60.00th=[ 190], | 70.00th=[ 215], 80.00th=[ 247], 90.00th=[ 292], 95.00th=[ 326], | 99.00th=[ 426], 99.50th=[ 506], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 47, per=20.66%, avg=16.52, stdev= 8.68, samples=330 iops : min= 1, max= 11, avg= 3.45, stdev= 2.22, samples=330 lat (msec) : 10=0.92%, 20=9.18%, 50=16.60%, 100=21.89%, 250=41.38% lat (msec) : 500=9.68%, 750=0.21%, 1000=0.07% cpu : usr=0.03%, sys=1.06%, ctx=2102, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=694,722,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=77.0KiB/s (78.9kB/s), 16.1KiB/s-22.6KiB/s (16.5kB/s-23.1kB/s), io=20.2MiB (21.2MB), run=172011-269208msec WRITE: bw=80.9KiB/s (82.9kB/s), 16.8KiB/s-23.6KiB/s (17.2kB/s-24.1kB/s), io=21.3MiB (22.3MB), run=172011-269208msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146202: Tue Aug 25 09:14:15 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(5920KiB/38838msec) clat (usec): min=32, max=301574, avg=50664.12, stdev=44459.98 lat (usec): min=32, max=301575, avg=50665.37, stdev=44459.96 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 98], | 30.00th=[ 26346], 40.00th=[ 35914], 50.00th=[ 44827], 60.00th=[ 54264], | 70.00th=[ 66323], 80.00th=[ 80217], 90.00th=[113771], 95.00th=[143655], | 99.00th=[168821], 99.50th=[185598], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 473, per=25.32%, avg=155.95, stdev=78.63, samples=73 iops : min= 1, max= 29, avg= 8.96, stdev= 5.01, samples=73 write: IOPS=10, BW=164KiB/s (168kB/s)(6368KiB/38838msec); 0 zone resets clat (usec): min=1464, max=376830, avg=49704.18, stdev=54988.29 lat (usec): min=1466, max=376832, avg=49706.48, stdev=54988.46 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2024], 10.00th=[ 3163], 20.00th=[ 6390], | 30.00th=[ 12518], 40.00th=[ 20317], 50.00th=[ 28705], 60.00th=[ 44827], | 70.00th=[ 64750], 80.00th=[ 84411], 90.00th=[123208], 95.00th=[162530], | 99.00th=[263193], 99.50th=[295699], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 21, max= 410, per=25.39%, avg=164.55, stdev=80.21, samples=75 iops : min= 1, max= 25, avg= 9.51, stdev= 5.04, samples=75 lat (usec) : 50=1.30%, 100=8.59%, 250=0.91%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=4.43%, 10=6.51%, 20=7.94%, 50=26.69% lat (msec) : 100=27.34%, 250=12.63%, 500=0.78% cpu : usr=0.06%, sys=4.74%, ctx=1494, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146203: Tue Aug 25 09:14:15 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(5744KiB/37085msec) clat (usec): min=39, max=234777, avg=56046.04, stdev=44810.37 lat (usec): min=39, max=234778, avg=56056.77, stdev=44799.50 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 78], 20.00th=[ 19530], | 30.00th=[ 33424], 40.00th=[ 41157], 50.00th=[ 46924], 60.00th=[ 58459], | 70.00th=[ 71828], 80.00th=[ 89654], 90.00th=[109577], 95.00th=[137364], | 99.00th=[204473], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 349, per=25.22%, avg=155.36, stdev=67.02, samples=72 iops : min= 1, max= 21, avg= 8.94, stdev= 4.25, samples=72 write: IOPS=11, BW=176KiB/s (181kB/s)(6544KiB/37085msec); 0 zone resets clat (usec): min=1685, max=233157, avg=40993.75, stdev=44604.34 lat (usec): min=1687, max=233157, avg=40996.38, stdev=44604.05 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1926], 10.00th=[ 2474], 20.00th=[ 5800], | 30.00th=[ 10159], 40.00th=[ 14746], 50.00th=[ 23200], 60.00th=[ 35390], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[107480], 95.00th=[135267], | 99.00th=[191890], 99.50th=[206570], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 415, per=27.19%, avg=176.17, stdev=89.22, samples=72 iops : min= 1, max= 25, avg=10.25, stdev= 5.62, samples=72 lat (usec) : 50=0.52%, 100=6.51%, 250=0.91% lat (msec) : 2=3.39%, 4=4.69%, 10=8.20%, 20=10.68%, 50=25.52% lat (msec) : 100=27.08%, 250=12.50% cpu : usr=0.07%, sys=4.84%, ctx=1567, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146204: Tue Aug 25 09:14:15 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37818msec) clat (usec): min=36, max=284302, avg=52207.63, stdev=47805.43 lat (usec): min=36, max=284304, avg=52230.16, stdev=47818.09 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 122], | 30.00th=[ 27657], 40.00th=[ 36439], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 64750], 80.00th=[ 79168], 90.00th=[114820], 95.00th=[145753], | 99.00th=[206570], 99.50th=[270533], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 381, per=27.07%, avg=166.78, stdev=77.99, samples=73 iops : min= 1, max= 23, avg= 9.66, stdev= 4.89, samples=73 write: IOPS=9, BW=160KiB/s (163kB/s)(6032KiB/37818msec); 0 zone resets clat (usec): min=1632, max=337108, avg=45186.46, stdev=49075.86 lat (usec): min=1633, max=337110, avg=45195.01, stdev=49079.37 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2040], 10.00th=[ 3458], 20.00th=[ 7767], | 30.00th=[ 12911], 40.00th=[ 17957], 50.00th=[ 25822], 60.00th=[ 38011], | 70.00th=[ 58983], 80.00th=[ 80217], 90.00th=[106431], 95.00th=[158335], | 99.00th=[221250], 99.50th=[248513], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 30, max= 350, per=24.71%, avg=160.15, stdev=70.06, samples=72 iops : min= 1, max= 21, avg= 9.24, stdev= 4.42, samples=72 lat (usec) : 50=1.17%, 100=8.72%, 250=1.17%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.34%, 4=3.39%, 10=6.90%, 20=8.85%, 50=27.86% lat (msec) : 100=26.69%, 250=12.11%, 500=0.39% cpu : usr=0.04%, sys=5.10%, ctx=1577, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146205: Tue Aug 25 09:14:15 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36804msec) clat (usec): min=28, max=302077, avg=51418.24, stdev=44533.69 lat (usec): min=28, max=302078, avg=51419.54, stdev=44533.72 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 95], | 30.00th=[ 26870], 40.00th=[ 36963], 50.00th=[ 46400], 60.00th=[ 55313], | 70.00th=[ 68682], 80.00th=[ 83362], 90.00th=[112722], 95.00th=[131597], | 99.00th=[191890], 99.50th=[235930], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 319, per=27.12%, avg=167.06, stdev=70.30, samples=70 iops : min= 1, max= 19, avg= 9.66, stdev= 4.45, samples=70 write: IOPS=10, BW=170KiB/s (174kB/s)(6256KiB/36804msec); 0 zone resets clat (usec): min=1559, max=346862, avg=43536.27, stdev=48392.01 lat (usec): min=1560, max=346865, avg=43551.88, stdev=48396.58 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1975], 10.00th=[ 2409], 20.00th=[ 5669], | 30.00th=[ 9765], 40.00th=[ 15533], 50.00th=[ 25822], 60.00th=[ 38536], | 70.00th=[ 55313], 80.00th=[ 79168], 90.00th=[112722], 95.00th=[141558], | 99.00th=[210764], 99.50th=[225444], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 30, max= 380, per=26.51%, avg=171.76, stdev=67.74, samples=71 iops : min= 1, max= 23, avg= 9.96, stdev= 4.24, samples=71 lat (usec) : 50=1.69%, 100=8.46%, 250=0.39%, 500=0.52%, 750=0.26% lat (msec) : 2=2.73%, 4=5.60%, 10=7.55%, 20=8.98%, 50=24.48% lat (msec) : 100=26.43%, 250=12.63%, 500=0.26% cpu : usr=0.06%, sys=4.86%, ctx=1444, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=617KiB/s (632kB/s), 152KiB/s-165KiB/s (156kB/s-169kB/s), io=23.4MiB (24.5MB), run=36804-38838msec WRITE: bw=649KiB/s (664kB/s), 160KiB/s-176KiB/s (163kB/s-181kB/s), io=24.6MiB (25.8MB), run=36804-38838msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146198: Tue Aug 25 09:14:59 2026 read: IOPS=4, BW=71.5KiB/s (73.3kB/s)(5920KiB/82755msec) clat (msec): min=7, max=391, avg=54.54, stdev=59.91 lat (msec): min=7, max=391, avg=54.54, stdev=59.91 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 64], 90.00th=[ 108], 95.00th=[ 169], | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 254, per=28.45%, avg=82.23, stdev=50.78, samples=140 iops : min= 1, max= 15, avg= 4.36, stdev= 3.28, samples=140 write: IOPS=4, BW=76.9KiB/s (78.8kB/s)(6368KiB/82755msec); 0 zone resets clat (msec): min=34, max=527, avg=156.38, stdev=87.81 lat (msec): min=34, max=527, avg=156.38, stdev=87.81 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 66], 10.00th=[ 72], 20.00th=[ 92], | 30.00th=[ 107], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 201], 90.00th=[ 275], 95.00th=[ 355], | 99.00th=[ 506], 99.50th=[ 523], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 30, max= 221, per=26.43%, avg=80.34, stdev=40.27, samples=155 iops : min= 1, max= 13, avg= 4.23, stdev= 2.59, samples=155 lat (msec) : 10=0.26%, 20=7.55%, 50=26.69%, 100=21.74%, 250=36.20% lat (msec) : 500=7.03%, 750=0.52% cpu : usr=0.03%, sys=1.35%, ctx=1428, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146199: Tue Aug 25 09:14:59 2026 read: IOPS=4, BW=69.7KiB/s (71.4kB/s)(5744KiB/82410msec) clat (msec): min=6, max=351, avg=51.26, stdev=49.58 lat (msec): min=6, max=351, avg=51.27, stdev=49.58 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 120], 95.00th=[ 148], | 99.00th=[ 262], 99.50th=[ 309], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 28, max= 317, per=30.51%, avg=88.17, stdev=59.06, samples=127 iops : min= 1, max= 19, avg= 4.74, stdev= 3.74, samples=127 write: IOPS=4, BW=79.4KiB/s (81.3kB/s)(6544KiB/82410msec); 0 zone resets clat (msec): min=37, max=596, avg=155.91, stdev=94.20 lat (msec): min=37, max=596, avg=155.92, stdev=94.20 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 103], 40.00th=[ 114], 50.00th=[ 131], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 205], 90.00th=[ 271], 95.00th=[ 363], | 99.00th=[ 502], 99.50th=[ 550], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 28, max= 191, per=27.00%, avg=82.08, stdev=40.38, samples=156 iops : min= 1, max= 11, avg= 4.34, stdev= 2.59, samples=156 lat (msec) : 10=0.52%, 20=9.11%, 50=24.48%, 100=21.74%, 250=36.33% lat (msec) : 500=7.03%, 750=0.78% cpu : usr=0.03%, sys=1.36%, ctx=1437, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146200: Tue Aug 25 09:14:59 2026 read: IOPS=4, BW=78.4KiB/s (80.3kB/s)(6256KiB/79777msec) clat (msec): min=8, max=322, avg=48.59, stdev=42.59 lat (msec): min=8, max=322, avg=48.60, stdev=42.59 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 52], 80.00th=[ 61], 90.00th=[ 101], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 317], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 346, per=31.61%, avg=91.36, stdev=61.32, samples=135 iops : min= 1, max= 21, avg= 4.93, stdev= 3.90, samples=135 write: IOPS=4, BW=75.6KiB/s (77.4kB/s)(6032KiB/79777msec); 0 zone resets clat (msec): min=42, max=630, avg=161.02, stdev=95.77 lat (msec): min=42, max=630, avg=161.03, stdev=95.76 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 93], | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 153], | 70.00th=[ 182], 80.00th=[ 224], 90.00th=[ 279], 95.00th=[ 351], | 99.00th=[ 550], 99.50th=[ 625], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 30, max= 191, per=26.02%, avg=79.09, stdev=38.37, samples=149 iops : min= 1, max= 11, avg= 4.15, stdev= 2.47, samples=149 lat (msec) : 10=0.65%, 20=9.24%, 50=25.26%, 100=24.22%, 250=33.20% lat (msec) : 500=6.77%, 750=0.65% cpu : usr=0.04%, sys=1.40%, ctx=1523, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146201: Tue Aug 25 09:14:59 2026 read: IOPS=4, BW=73.6KiB/s (75.3kB/s)(6032KiB/82010msec) clat (msec): min=8, max=445, avg=53.29, stdev=53.39 lat (msec): min=8, max=445, avg=53.30, stdev=53.39 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 102], 95.00th=[ 159], | 99.00th=[ 284], 99.50th=[ 317], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 411, per=30.02%, avg=86.76, stdev=64.48, samples=136 iops : min= 1, max= 25, avg= 4.64, stdev= 4.07, samples=136 write: IOPS=4, BW=76.3KiB/s (78.1kB/s)(6256KiB/82010msec); 0 zone resets clat (msec): min=35, max=532, avg=157.94, stdev=87.08 lat (msec): min=35, max=532, avg=157.94, stdev=87.08 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 211], 90.00th=[ 296], 95.00th=[ 342], | 99.00th=[ 435], 99.50th=[ 456], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 30, max= 223, per=25.99%, avg=79.01, stdev=40.91, samples=156 iops : min= 1, max= 13, avg= 4.15, stdev= 2.65, samples=156 lat (msec) : 10=0.39%, 20=8.98%, 50=23.70%, 100=23.05%, 250=36.07% lat (msec) : 500=7.68%, 750=0.13% cpu : usr=0.02%, sys=1.45%, ctx=1531, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=289KiB/s (296kB/s), 69.7KiB/s-78.4KiB/s (71.4kB/s-80.3kB/s), io=23.4MiB (24.5MB), run=79777-82755msec WRITE: bw=305KiB/s (312kB/s), 75.6KiB/s-79.4KiB/s (77.4kB/s-81.3kB/s), io=24.6MiB (25.8MB), run=79777-82755msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146222: Tue Aug 25 09:15:13 2026 read: IOPS=1, BW=1416KiB/s (1450kB/s)(7168KiB/5063msec) clat (usec): min=556, max=3218.2k, avg=594059.81, stdev=1162722.15 lat (usec): min=558, max=3218.2k, avg=594061.14, stdev=1162722.15 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 660], 30.00th=[ 196084], 40.00th=[ 196084], | 50.00th=[ 225444], 60.00th=[ 227541], 70.00th=[ 227541], | 80.00th=[ 287310], 90.00th=[3204449], 95.00th=[3204449], | 99.00th=[3204449], 99.50th=[3204449], 99.90th=[3204449], | 99.95th=[3204449], 99.99th=[3204449] bw ( KiB/s): min= 1892, max= 4096, per=63.57%, avg=2521.00, stdev=1052.57, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=0, BW=1011KiB/s (1036kB/s)(5120KiB/5063msec); 0 zone resets clat (msec): min=60, max=359, avg=158.73, stdev=122.47 lat (msec): min=60, max=359, avg=158.80, stdev=122.47 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 103], 60.00th=[ 103], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2048, max= 2048, per=36.88%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (usec) : 750=16.67% lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.93%, ctx=446, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146223: Tue Aug 25 09:15:13 2026 read: IOPS=0, BW=407KiB/s (417kB/s)(2048KiB/5035msec) clat (usec): min=810, max=277835, avg=139323.26, stdev=195886.27 lat (usec): min=812, max=277838, avg=139325.21, stdev=195886.84 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 807], | 30.00th=[ 807], 40.00th=[ 807], 50.00th=[ 807], 60.00th=[278922], | 70.00th=[278922], 80.00th=[278922], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1935, max= 2000, per=49.61%, avg=1967.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2034KiB/s (2083kB/s)(10.0MiB/5035msec); 0 zone resets clat (msec): min=102, max=2085, avg=463.55, stdev=596.62 lat (msec): min=102, max=2085, avg=463.63, stdev=596.60 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 111], | 30.00th=[ 120], 40.00th=[ 174], 50.00th=[ 211], 60.00th=[ 330], | 70.00th=[ 376], 80.00th=[ 518], 90.00th=[ 609], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 2027, max= 6000, per=58.32%, avg=3238.60, stdev=1781.08, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.12%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146224: Tue Aug 25 09:15:13 2026 read: IOPS=1, BW=1190KiB/s (1219kB/s)(6144KiB/5163msec) clat (usec): min=564, max=307743, avg=164446.81, stdev=98954.97 lat (usec): min=565, max=307744, avg=164448.28, stdev=98955.00 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[145753], | 30.00th=[145753], 40.00th=[158335], 50.00th=[158335], 60.00th=[175113], | 70.00th=[198181], 80.00th=[198181], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 2000, max= 6083, per=85.15%, avg=3377.00, stdev=2343.59, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1190KiB/s (1219kB/s)(6144KiB/5163msec); 0 zone resets clat (msec): min=114, max=2007, avg=666.50, stdev=738.68 lat (msec): min=114, max=2007, avg=666.59, stdev=738.65 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 523], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 2043, max= 4055, per=54.20%, avg=3009.75, stdev=1115.38, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=8.33%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.85%, ctx=157, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146225: Tue Aug 25 09:15:13 2026 read: IOPS=0, BW=1023KiB/s (1048kB/s)(5120KiB/5005msec) clat (usec): min=528, max=348307, avg=149455.25, stdev=154515.55 lat (usec): min=529, max=348308, avg=149456.36, stdev=154515.55 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 1139], 40.00th=[ 1139], 50.00th=[139461], 60.00th=[139461], | 70.00th=[256902], 80.00th=[256902], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1432KiB/s (1467kB/s)(7168KiB/5005msec); 0 zone resets clat (msec): min=174, max=1942, avg=605.28, stdev=628.17 lat (msec): min=174, max=1942, avg=605.36, stdev=628.15 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 207], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 368], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 802], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1921, max= 2048, per=36.33%, avg=2017.40, stdev=54.57, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=9.45%, ctx=147, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3967KiB/s (4062kB/s), 407KiB/s-1416KiB/s (417kB/s-1450kB/s), io=20.0MiB (20.0MB), run=5005-5163msec WRITE: bw=5553KiB/s (5687kB/s), 1011KiB/s-2034KiB/s (1036kB/s-2083kB/s), io=28.0MiB (29.4MB), run=5005-5163msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146227: Tue Aug 25 09:15:14 2026 read: IOPS=1, BW=1237KiB/s (1267kB/s)(7168KiB/5795msec) clat (msec): min=47, max=2545, avg=572.85, stdev=924.89 lat (msec): min=47, max=2545, avg=572.86, stdev=924.89 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 55], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 136], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 936], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1374, max= 4087, per=66.87%, avg=2363.25, stdev=1185.98, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=884KiB/s (905kB/s)(5120KiB/5795msec); 0 zone resets clat (msec): min=124, max=569, avg=329.12, stdev=161.14 lat (msec): min=124, max=569, avg=329.25, stdev=161.12 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1996, max= 2043, per=40.82%, avg=2019.33, stdev=23.50, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.64%, ctx=244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146228: Tue Aug 25 09:15:14 2026 read: IOPS=0, BW=373KiB/s (382kB/s)(2048KiB/5487msec) clat (msec): min=60, max=196, avg=128.47, stdev=96.14 lat (msec): min=60, max=196, avg=128.47, stdev=96.14 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 61], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1444, max= 2048, per=49.41%, avg=1746.00, stdev=427.09, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1866KiB/s (1911kB/s)(10.0MiB/5487msec); 0 zone resets clat (msec): min=99, max=1983, avg=482.82, stdev=569.16 lat (msec): min=99, max=1983, avg=482.91, stdev=569.16 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 102], | 30.00th=[ 169], 40.00th=[ 197], 50.00th=[ 209], 60.00th=[ 257], | 70.00th=[ 523], 80.00th=[ 567], 90.00th=[ 718], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1996, max= 6144, per=65.71%, avg=3250.80, stdev=1842.26, samples=5 iops : min= 1, max= 6, avg= 2.60, stdev= 2.07, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=4.67%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146229: Tue Aug 25 09:15:14 2026 read: IOPS=1, BW=1146KiB/s (1173kB/s)(6144KiB/5363msec) clat (msec): min=83, max=250, avg=146.26, stdev=75.50 lat (msec): min=83, max=250, avg=146.26, stdev=75.50 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 88], | 30.00th=[ 88], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 116], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 4096, max= 4096, per=100.00%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1146KiB/s (1173kB/s)(6144KiB/5363msec); 0 zone resets clat (msec): min=129, max=2079, avg=726.94, stdev=747.89 lat (msec): min=129, max=2079, avg=727.01, stdev=747.89 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 659], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 1973, max= 4096, per=51.20%, avg=2533.00, stdev=1042.45, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.64%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146230: Tue Aug 25 09:15:14 2026 read: IOPS=0, BW=898KiB/s (919kB/s)(5120KiB/5702msec) clat (usec): min=67743, max=98752, avg=85327.06, stdev=13249.56 lat (usec): min=67744, max=98754, avg=85328.30, stdev=13249.58 clat percentiles (usec): | 1.00th=[67634], 5.00th=[67634], 10.00th=[67634], 20.00th=[67634], | 30.00th=[76022], 40.00th=[76022], 50.00th=[87557], 60.00th=[87557], | 70.00th=[95945], 80.00th=[95945], 90.00th=[99091], 95.00th=[99091], | 99.00th=[99091], 99.50th=[99091], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1257KiB/s (1287kB/s)(7168KiB/5702msec); 0 zone resets clat (msec): min=188, max=2199, avg=734.70, stdev=716.49 lat (msec): min=188, max=2200, avg=734.78, stdev=716.48 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 236], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 567], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 1083], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 2015, max= 4096, per=49.55%, avg=2451.00, stdev=919.69, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 100=41.67%, 250=16.67%, 500=8.33%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.86%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3534KiB/s (3619kB/s), 373KiB/s-1237KiB/s (382kB/s-1267kB/s), io=20.0MiB (20.0MB), run=5363-5795msec WRITE: bw=4948KiB/s (5066kB/s), 884KiB/s-1866KiB/s (905kB/s-1911kB/s), io=28.0MiB (29.4MB), run=5363-5795msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146238: Tue Aug 25 09:15:30 2026 read: IOPS=1, BW=6522KiB/s (6679kB/s)(12.0MiB/1884msec) clat (msec): min=545, max=598, avg=568.69, stdev=27.01 lat (msec): min=545, max=598, avg=568.69, stdev=27.01 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.05%, sys=19.65%, ctx=317, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146239: Tue Aug 25 09:15:30 2026 read: IOPS=0, BW=590KiB/s (604kB/s)(4096KiB/6945msec) clat (nsec): min=3384.9M, max=3384.9M, avg=3384945981.00, stdev= 0.00 lat (nsec): min=3384.9M, max=3384.9M, avg=3384949516.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3373], 5.00th=[ 3373], 10.00th=[ 3373], 20.00th=[ 3373], | 30.00th=[ 3373], 40.00th=[ 3373], 50.00th=[ 3373], 60.00th=[ 3373], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1180KiB/s (1208kB/s)(8192KiB/6945msec); 0 zone resets clat (msec): min=436, max=2935, avg=1685.95, stdev=1767.48 lat (msec): min=436, max=2938, avg=1687.49, stdev=1769.28 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 2937], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=3.47%, ctx=501, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146240: Tue Aug 25 09:15:30 2026 write: IOPS=0, BW=1667KiB/s (1707kB/s)(12.0MiB/7373msec); 0 zone resets clat (msec): min=390, max=4170, avg=2394.66, stdev=1900.69 lat (msec): min=390, max=4173, avg=2395.63, stdev=1901.63 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 2635], 50.00th=[ 2635], 60.00th=[ 2635], | 70.00th=[ 4178], 80.00th=[ 4178], 90.00th=[ 4178], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 8047, max= 8126, per=100.00%, avg=8086.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.03%, sys=1.61%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146241: Tue Aug 25 09:15:30 2026 write: IOPS=0, BW=2191KiB/s (2243kB/s)(12.0MiB/5609msec); 0 zone resets clat (msec): min=237, max=4710, avg=1837.56, stdev=2493.61 lat (msec): min=237, max=4711, avg=1838.53, stdev=2493.41 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 4732], 80.00th=[ 4732], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.07%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2359KiB/s (2416kB/s), 590KiB/s-6522KiB/s (604kB/s-6679kB/s), io=16.0MiB (16.8MB), run=1884-6945msec WRITE: bw=4444KiB/s (4551kB/s), 1180KiB/s-2191KiB/s (1208kB/s-2243kB/s), io=32.0MiB (33.6MB), run=5609-7373msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146242: Tue Aug 25 09:15:31 2026 read: IOPS=0, BW=1630KiB/s (1669kB/s)(12.0MiB/7539msec) clat (msec): min=365, max=4340, avg=2394.29, stdev=1988.88 lat (msec): min=365, max=4340, avg=2394.30, stdev=1988.88 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 2467], 50.00th=[ 2467], 60.00th=[ 2467], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 8000, max= 8126, per=100.00%, avg=8063.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.39%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146243: Tue Aug 25 09:15:31 2026 read: IOPS=0, BW=561KiB/s (575kB/s)(4096KiB/7299msec) clat (nsec): min=4261.7M, max=4261.7M, avg=4261715375.00, stdev= 0.00 lat (nsec): min=4261.7M, max=4261.7M, avg=4261718565.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4279], 5.00th=[ 4279], 10.00th=[ 4279], 20.00th=[ 4279], | 30.00th=[ 4279], 40.00th=[ 4279], 50.00th=[ 4279], 60.00th=[ 4279], | 70.00th=[ 4279], 80.00th=[ 4279], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1122KiB/s (1149kB/s)(8192KiB/7299msec); 0 zone resets clat (msec): min=270, max=2579, avg=1424.57, stdev=1632.77 lat (msec): min=270, max=2579, avg=1424.83, stdev=1632.87 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 2567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.48%, ctx=44, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146244: Tue Aug 25 09:15:31 2026 write: IOPS=0, BW=1816KiB/s (1859kB/s)(12.0MiB/6767msec); 0 zone resets clat (msec): min=422, max=3863, avg=2226.64, stdev=1726.60 lat (msec): min=423, max=3864, avg=2226.98, stdev=1726.60 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 2400], 50.00th=[ 2400], 60.00th=[ 2400], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 7984, max= 8000, per=100.00%, avg=7992.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.07%, sys=2.57%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146245: Tue Aug 25 09:15:31 2026 write: IOPS=0, BW=2019KiB/s (2068kB/s)(12.0MiB/6085msec); 0 zone resets clat (msec): min=285, max=5240, avg=1945.39, stdev=2853.27 lat (msec): min=285, max=5240, avg=1945.74, stdev=2853.31 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 5269], 80.00th=[ 5269], 90.00th=[ 5269], 95.00th=[ 5269], | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], | 99.99th=[ 5269] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=1.78%, ctx=44, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2173KiB/s (2225kB/s), 561KiB/s-1630KiB/s (575kB/s-1669kB/s), io=16.0MiB (16.8MB), run=7299-7539msec WRITE: bw=4489KiB/s (4597kB/s), 1122KiB/s-2019KiB/s (1149kB/s-2068kB/s), io=32.0MiB (33.6MB), run=6085-7299msec