== sanity test 398b: DIO and buffer IO race ============== 07:39:41 (1787139581) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.37227 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144845: Wed Aug 19 07:42:35 2026 read: IOPS=9, BW=39.3KiB/s (40.3kB/s)(5992KiB/152365msec) clat (usec): min=32, max=777610, avg=49687.74, stdev=43388.05 lat (usec): min=32, max=777612, avg=49689.14, stdev=43388.09 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 221], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 59507], 80.00th=[ 73925], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[189793], 99.50th=[267387], 99.90th=[350225], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 5, max= 95, per=25.44%, avg=39.69, stdev=17.66, samples=293 iops : min= 1, max= 23, avg= 9.27, stdev= 4.43, samples=293 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6296KiB/152365msec); 0 zone resets clat (usec): min=1084, max=859599, avg=49243.18, stdev=53395.80 lat (usec): min=1084, max=859601, avg=49249.29, stdev=53396.52 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1401], 10.00th=[ 2180], 20.00th=[ 5538], | 30.00th=[ 10159], 40.00th=[ 21627], 50.00th=[ 37487], 60.00th=[ 51643], | 70.00th=[ 67634], 80.00th=[ 85459], 90.00th=[110625], 95.00th=[137364], | 99.00th=[223347], 99.50th=[274727], 99.90th=[371196], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 111, per=25.32%, avg=41.26, stdev=18.56, samples=296 iops : min= 1, max= 27, avg= 9.67, stdev= 4.68, samples=296 lat (usec) : 50=0.62%, 100=3.87%, 250=0.49%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.88%, 4=3.48%, 10=7.16%, 20=7.62%, 50=31.80% lat (msec) : 100=28.97%, 250=10.42%, 500=0.55%, 1000=0.07% cpu : usr=0.07%, sys=4.52%, ctx=6591, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144846: Wed Aug 19 07:42:35 2026 read: IOPS=9, BW=39.2KiB/s (40.2kB/s)(5940KiB/151476msec) clat (usec): min=33, max=386387, avg=47786.54, stdev=38744.57 lat (usec): min=33, max=386389, avg=47787.85, stdev=38744.56 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 81], 20.00th=[ 21103], | 30.00th=[ 27395], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 46924], | 70.00th=[ 57934], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[116917], | 99.00th=[185598], 99.50th=[217056], 99.90th=[325059], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 5, max= 95, per=25.15%, avg=39.23, stdev=19.33, samples=293 iops : min= 1, max= 23, avg= 9.15, stdev= 4.85, samples=293 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6348KiB/151476msec); 0 zone resets clat (usec): min=1178, max=785173, avg=50497.93, stdev=55606.84 lat (usec): min=1179, max=785174, avg=50501.67, stdev=55606.37 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1385], 10.00th=[ 2073], 20.00th=[ 5407], | 30.00th=[ 10814], 40.00th=[ 22938], 50.00th=[ 38011], 60.00th=[ 50070], | 70.00th=[ 64226], 80.00th=[ 85459], 90.00th=[119014], 95.00th=[149947], | 99.00th=[229639], 99.50th=[263193], 99.90th=[509608], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 119, per=25.52%, avg=41.60, stdev=19.17, samples=295 iops : min= 1, max= 29, avg= 9.75, stdev= 4.83, samples=295 lat (usec) : 50=0.65%, 100=4.52%, 250=0.49%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.01%, 4=3.35%, 10=6.71%, 20=7.52%, 50=32.78% lat (msec) : 100=26.92%, 250=11.46%, 500=0.33%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=4.53%, ctx=6422, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144847: Wed Aug 19 07:42:35 2026 read: IOPS=9, BW=39.2KiB/s (40.2kB/s)(6028KiB/153644msec) clat (usec): min=33, max=392064, avg=47646.09, stdev=38149.08 lat (usec): min=34, max=392067, avg=47661.86, stdev=38153.01 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 110], 20.00th=[ 20579], | 30.00th=[ 27919], 40.00th=[ 33817], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[181404], 99.50th=[200279], 99.90th=[387974], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 95, per=25.36%, avg=39.56, stdev=19.15, samples=296 iops : min= 1, max= 23, avg= 9.24, stdev= 4.82, samples=296 write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6260KiB/153644msec); 0 zone resets clat (usec): min=1169, max=912019, avg=52016.39, stdev=60197.83 lat (usec): min=1171, max=912020, avg=52023.66, stdev=60196.22 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1385], 10.00th=[ 2409], 20.00th=[ 5800], | 30.00th=[ 10945], 40.00th=[ 23462], 50.00th=[ 38536], 60.00th=[ 51643], | 70.00th=[ 66847], 80.00th=[ 86508], 90.00th=[119014], 95.00th=[156238], | 99.00th=[227541], 99.50th=[263193], 99.90th=[884999], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 5, max= 119, per=24.88%, avg=40.55, stdev=18.44, samples=300 iops : min= 1, max= 29, avg= 9.49, stdev= 4.62, samples=300 lat (usec) : 50=0.46%, 100=4.39%, 250=0.42%, 500=0.03%, 750=0.16% lat (usec) : 1000=0.13% lat (msec) : 2=4.62%, 4=3.39%, 10=6.97%, 20=7.68%, 50=31.93% lat (msec) : 100=28.45%, 250=10.94%, 500=0.36%, 1000=0.07% cpu : usr=0.08%, sys=4.55%, ctx=6511, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144848: Wed Aug 19 07:42:35 2026 read: IOPS=10, BW=40.5KiB/s (41.4kB/s)(6052KiB/149514msec) clat (usec): min=29, max=830187, avg=46194.11, stdev=41640.66 lat (usec): min=30, max=830188, avg=46196.04, stdev=41640.59 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 72], 20.00th=[ 19268], | 30.00th=[ 26870], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[164627], 99.50th=[208667], 99.90th=[341836], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 101, per=26.25%, avg=40.94, stdev=19.36, samples=288 iops : min= 1, max= 25, avg= 9.58, stdev= 4.88, samples=288 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6236KiB/149514msec); 0 zone resets clat (usec): min=1055, max=1211.0k, avg=50832.60, stdev=60738.67 lat (usec): min=1056, max=1211.0k, avg=50835.43, stdev=60738.56 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1975], | 20.00th=[ 4883], 30.00th=[ 9765], 40.00th=[ 19530], | 50.00th=[ 34341], 60.00th=[ 50070], 70.00th=[ 66847], | 80.00th=[ 88605], 90.00th=[ 123208], 95.00th=[ 156238], | 99.00th=[ 225444], 99.50th=[ 274727], 99.90th=[ 421528], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 107, per=25.80%, avg=42.06, stdev=19.42, samples=289 iops : min= 1, max= 26, avg= 9.87, stdev= 4.88, samples=289 lat (usec) : 50=0.91%, 100=5.11%, 250=0.26%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.24%, 4=3.78%, 10=6.67%, 20=8.46%, 50=31.15% lat (msec) : 100=26.56%, 250=11.20%, 500=0.39%, 1000=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.61%, ctx=6561, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (160kB/s), 39.2KiB/s-40.5KiB/s (40.2kB/s-41.4kB/s), io=23.4MiB (24.6MB), run=149514-153644msec WRITE: bw=164KiB/s (168kB/s), 40.7KiB/s-41.9KiB/s (41.7kB/s-42.9kB/s), io=24.6MiB (25.7MB), run=149514-153644msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144849: Wed Aug 19 07:45:23 2026 read: IOPS=4, BW=18.7KiB/s (19.2kB/s)(5992KiB/320308msec) clat (msec): min=6, max=799, avg=40.05, stdev=47.95 lat (msec): min=6, max=799, avg=40.05, stdev=47.95 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 88], 95.00th=[ 127], | 99.00th=[ 228], 99.50th=[ 268], 99.90th=[ 550], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 88, per=29.78%, avg=22.03, stdev=15.44, samples=523 iops : min= 1, max= 22, avg= 4.87, stdev= 3.91, samples=523 write: IOPS=4, BW=19.7KiB/s (20.1kB/s)(6296KiB/320308msec); 0 zone resets clat (msec): min=36, max=917, avg=165.23, stdev=85.18 lat (msec): min=36, max=917, avg=165.23, stdev=85.18 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 73], 10.00th=[ 86], 20.00th=[ 101], | 30.00th=[ 112], 40.00th=[ 127], 50.00th=[ 144], 60.00th=[ 163], | 70.00th=[ 188], 80.00th=[ 220], 90.00th=[ 279], 95.00th=[ 326], | 99.00th=[ 460], 99.50th=[ 542], 99.90th=[ 567], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 55, per=24.83%, avg=19.37, stdev= 9.56, samples=621 iops : min= 1, max= 13, avg= 4.19, stdev= 2.46, samples=621 lat (msec) : 10=2.02%, 20=15.85%, 50=21.13%, 100=16.02%, 250=37.24% lat (msec) : 500=7.39%, 750=0.29%, 1000=0.07% cpu : usr=0.04%, sys=1.13%, ctx=5272, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144850: Wed Aug 19 07:45:23 2026 read: IOPS=4, BW=18.6KiB/s (19.0kB/s)(5940KiB/319575msec) clat (msec): min=6, max=936, avg=40.30, stdev=51.31 lat (msec): min=6, max=936, avg=40.30, stdev=51.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 89], 95.00th=[ 124], | 99.00th=[ 224], 99.50th=[ 305], 99.90th=[ 542], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 96, per=30.70%, avg=22.72, stdev=15.60, samples=503 iops : min= 1, max= 24, avg= 5.05, stdev= 3.95, samples=503 write: IOPS=4, BW=19.9KiB/s (20.3kB/s)(6348KiB/319575msec); 0 zone resets clat (msec): min=41, max=715, avg=163.46, stdev=86.42 lat (msec): min=41, max=715, avg=163.46, stdev=86.42 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 83], 20.00th=[ 99], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 182], 80.00th=[ 218], 90.00th=[ 279], 95.00th=[ 338], | 99.00th=[ 472], 99.50th=[ 542], 99.90th=[ 617], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 48, per=25.41%, avg=19.82, stdev= 9.57, samples=612 iops : min= 1, max= 12, avg= 4.31, stdev= 2.46, samples=612 lat (msec) : 10=2.47%, 20=15.95%, 50=19.92%, 100=17.22%, 250=36.95% lat (msec) : 500=6.97%, 750=0.49%, 1000=0.03% cpu : usr=0.03%, sys=1.12%, ctx=5224, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144851: Wed Aug 19 07:45:23 2026 read: IOPS=4, BW=18.8KiB/s (19.2kB/s)(6028KiB/321369msec) clat (msec): min=6, max=523, avg=41.51, stdev=46.31 lat (msec): min=6, max=523, avg=41.51, stdev=46.31 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 56], 90.00th=[ 94], 95.00th=[ 129], | 99.00th=[ 230], 99.50th=[ 268], 99.90th=[ 502], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 93, per=29.34%, avg=21.71, stdev=15.02, samples=533 iops : min= 1, max= 23, avg= 4.79, stdev= 3.80, samples=533 write: IOPS=4, BW=19.5KiB/s (19.9kB/s)(6260KiB/321369msec); 0 zone resets clat (msec): min=40, max=1075, avg=165.17, stdev=89.01 lat (msec): min=40, max=1075, avg=165.18, stdev=89.01 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 72], 10.00th=[ 84], 20.00th=[ 101], | 30.00th=[ 114], 40.00th=[ 128], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 182], 80.00th=[ 220], 90.00th=[ 279], 95.00th=[ 334], | 99.00th=[ 456], 99.50th=[ 510], 99.90th=[ 919], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 55, per=25.11%, avg=19.59, stdev= 9.56, samples=611 iops : min= 1, max= 13, avg= 4.25, stdev= 2.45, samples=611 lat (msec) : 10=2.05%, 20=15.43%, 50=21.06%, 100=16.60%, 250=37.21% lat (msec) : 500=7.26%, 750=0.33%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5136, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144852: Wed Aug 19 07:45:23 2026 read: IOPS=4, BW=19.0KiB/s (19.5kB/s)(6052KiB/317840msec) clat (msec): min=7, max=415, avg=39.59, stdev=41.23 lat (msec): min=7, max=415, avg=39.60, stdev=41.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 53], 90.00th=[ 87], 95.00th=[ 122], | 99.00th=[ 194], 99.50th=[ 253], 99.90th=[ 393], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 87, per=30.57%, avg=22.62, stdev=15.27, samples=515 iops : min= 1, max= 21, avg= 5.02, stdev= 3.87, samples=515 write: IOPS=4, BW=19.6KiB/s (20.1kB/s)(6236KiB/317840msec); 0 zone resets clat (msec): min=36, max=1198, avg=165.24, stdev=90.47 lat (msec): min=36, max=1198, avg=165.25, stdev=90.47 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 140], 60.00th=[ 163], | 70.00th=[ 186], 80.00th=[ 224], 90.00th=[ 288], 95.00th=[ 347], | 99.00th=[ 464], 99.50th=[ 542], 99.90th=[ 642], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 48, per=24.94%, avg=19.45, stdev= 9.78, samples=613 iops : min= 1, max= 12, avg= 4.22, stdev= 2.51, samples=613 lat (msec) : 10=1.76%, 20=15.04%, 50=22.33%, 100=17.71%, 250=35.74% lat (msec) : 500=7.03%, 750=0.36%, 2000=0.03% cpu : usr=0.04%, sys=1.14%, ctx=5203, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=74.7KiB/s (76.5kB/s), 18.6KiB/s-19.0KiB/s (19.0kB/s-19.5kB/s), io=23.4MiB (24.6MB), run=317840-321369msec WRITE: bw=78.2KiB/s (80.1kB/s), 19.5KiB/s-19.9KiB/s (19.9kB/s-20.3kB/s), io=24.6MiB (25.7MB), run=317840-321369msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144916: Wed Aug 19 07:46:04 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(5920KiB/30626msec) clat (usec): min=37, max=294850, avg=40734.05, stdev=35809.88 lat (usec): min=38, max=294850, avg=40735.57, stdev=35809.84 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 131], | 30.00th=[ 25035], 40.00th=[ 31851], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[160433], 99.50th=[183501], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 63, max= 414, per=25.23%, avg=192.23, stdev=80.22, samples=60 iops : min= 3, max= 25, avg=11.25, stdev= 5.08, samples=60 write: IOPS=12, BW=208KiB/s (213kB/s)(6368KiB/30626msec); 0 zone resets clat (usec): min=1819, max=211009, avg=38088.80, stdev=38101.36 lat (usec): min=1821, max=211012, avg=38100.27, stdev=38099.32 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 25], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 66], 90.00th=[ 90], 95.00th=[ 120], | 99.00th=[ 161], 99.50th=[ 192], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 30, max= 382, per=25.99%, avg=208.17, stdev=86.96, samples=60 iops : min= 1, max= 23, avg=12.25, stdev= 5.53, samples=60 lat (usec) : 50=0.78%, 100=7.42%, 250=2.86%, 500=0.39%, 750=0.13% lat (msec) : 2=0.13%, 4=2.99%, 10=12.37%, 20=9.38%, 50=32.94% lat (msec) : 100=24.35%, 250=6.12%, 500=0.13% cpu : usr=0.10%, sys=6.53%, ctx=1712, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144917: Wed Aug 19 07:46:04 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5744KiB/31427msec) clat (usec): min=40, max=282717, avg=43791.84, stdev=36258.17 lat (usec): min=40, max=282717, avg=43793.48, stdev=36258.04 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 69], 10.00th=[ 83], 20.00th=[ 930], | 30.00th=[ 26608], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 83362], 95.00th=[ 95945], | 99.00th=[183501], 99.50th=[225444], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 30, max= 411, per=24.42%, avg=186.10, stdev=82.65, samples=61 iops : min= 1, max= 25, avg=10.85, stdev= 5.23, samples=61 write: IOPS=13, BW=208KiB/s (213kB/s)(6544KiB/31427msec); 0 zone resets clat (usec): min=1754, max=189577, avg=37982.70, stdev=39740.84 lat (usec): min=1758, max=189579, avg=37991.49, stdev=39740.65 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 14], 50.00th=[ 23], 60.00th=[ 36], | 70.00th=[ 47], 80.00th=[ 68], 90.00th=[ 94], 95.00th=[ 118], | 99.00th=[ 178], 99.50th=[ 186], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 411, per=25.99%, avg=208.16, stdev=85.96, samples=62 iops : min= 1, max= 25, avg=12.24, stdev= 5.43, samples=62 lat (usec) : 50=1.04%, 100=5.47%, 250=1.95%, 500=0.39%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=3.65%, 10=13.41%, 20=8.46%, 50=30.86% lat (msec) : 100=26.82%, 250=6.51%, 500=0.13% cpu : usr=0.09%, sys=6.35%, ctx=1723, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Wed Aug 19 07:46:04 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30472msec) clat (usec): min=44, max=275882, avg=42969.73, stdev=33877.11 lat (usec): min=45, max=275882, avg=42971.25, stdev=33877.15 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 72], 10.00th=[ 91], 20.00th=[ 4424], | 30.00th=[ 26084], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 56886], 80.00th=[ 66847], 90.00th=[ 82314], 95.00th=[ 93848], | 99.00th=[141558], 99.50th=[200279], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 94, max= 347, per=27.49%, avg=209.49, stdev=62.63, samples=59 iops : min= 5, max= 21, avg=12.34, stdev= 3.97, samples=59 write: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30472msec); 0 zone resets clat (usec): min=1672, max=208000, avg=35104.23, stdev=33571.96 lat (usec): min=1673, max=208003, avg=35144.69, stdev=33557.70 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 3425], 10.00th=[ 4686], 20.00th=[ 7832], | 30.00th=[ 10814], 40.00th=[ 17695], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 58983], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[160433], 99.50th=[202376], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 349, per=24.55%, avg=196.67, stdev=83.91, samples=60 iops : min= 1, max= 21, avg=11.52, stdev= 5.30, samples=60 lat (usec) : 50=0.65%, 100=5.86%, 250=2.60%, 500=0.39%, 750=0.39% lat (msec) : 2=0.91%, 4=2.73%, 10=10.42%, 20=10.16%, 50=33.20% lat (msec) : 100=28.78%, 250=3.78%, 500=0.13% cpu : usr=0.08%, sys=6.75%, ctx=1768, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144921: Wed Aug 19 07:46:04 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6032KiB/29950msec) clat (usec): min=37, max=197235, avg=41625.78, stdev=34223.86 lat (usec): min=37, max=197236, avg=41627.53, stdev=34223.55 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 69], 10.00th=[ 81], 20.00th=[ 221], | 30.00th=[ 24511], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[185598], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 448, per=27.18%, avg=207.09, stdev=86.31, samples=57 iops : min= 1, max= 28, avg=12.18, stdev= 5.47, samples=57 write: IOPS=13, BW=209KiB/s (214kB/s)(6256KiB/29950msec); 0 zone resets clat (usec): min=1701, max=235014, avg=35306.77, stdev=38623.63 lat (usec): min=1704, max=235018, avg=35321.89, stdev=38625.08 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 21], 60.00th=[ 30], | 70.00th=[ 41], 80.00th=[ 63], 90.00th=[ 86], 95.00th=[ 111], | 99.00th=[ 188], 99.50th=[ 201], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 30, max= 409, per=26.08%, avg=208.90, stdev=94.57, samples=59 iops : min= 1, max= 25, avg=12.31, stdev= 6.03, samples=59 lat (usec) : 50=0.52%, 100=7.16%, 250=2.60%, 500=0.78%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=0.52%, 4=3.91%, 10=13.15%, 20=9.11%, 50=30.08% lat (msec) : 100=26.04%, 250=5.60% cpu : usr=0.09%, sys=6.63%, ctx=1704, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=762KiB/s (780kB/s), 183KiB/s-205KiB/s (187kB/s-210kB/s), io=23.4MiB (24.5MB), run=29950-31427msec WRITE: bw=802KiB/s (821kB/s), 198KiB/s-209KiB/s (203kB/s-214kB/s), io=24.6MiB (25.8MB), run=29950-31427msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144914: Wed Aug 19 07:46:43 2026 read: IOPS=5, BW=85.1KiB/s (87.1kB/s)(5920KiB/69572msec) clat (msec): min=9, max=349, avg=41.92, stdev=40.27 lat (msec): min=9, max=349, avg=41.92, stdev=40.27 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 81], 95.00th=[ 122], | 99.00th=[ 211], 99.50th=[ 251], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 286, per=26.63%, avg=90.80, stdev=56.57, samples=128 iops : min= 1, max= 17, avg= 4.89, stdev= 3.64, samples=128 write: IOPS=5, BW=91.5KiB/s (93.7kB/s)(6368KiB/69572msec); 0 zone resets clat (msec): min=44, max=426, avg=135.21, stdev=60.37 lat (msec): min=44, max=426, avg=135.22, stdev=60.37 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 153], 80.00th=[ 171], 90.00th=[ 211], 95.00th=[ 241], | 99.00th=[ 380], 99.50th=[ 401], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 192, per=25.44%, avg=91.09, stdev=42.09, samples=137 iops : min= 1, max= 12, avg= 4.91, stdev= 2.71, samples=137 lat (msec) : 10=0.13%, 20=13.41%, 50=23.44%, 100=23.96%, 250=36.72% lat (msec) : 500=2.34% cpu : usr=0.05%, sys=1.56%, ctx=1255, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144915: Wed Aug 19 07:46:43 2026 read: IOPS=5, BW=81.8KiB/s (83.8kB/s)(5744KiB/70198msec) clat (msec): min=8, max=247, avg=39.86, stdev=34.63 lat (msec): min=8, max=247, avg=39.86, stdev=34.63 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 80], 95.00th=[ 120], | 99.00th=[ 190], 99.50th=[ 203], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 30, max= 352, per=28.18%, avg=96.10, stdev=62.13, samples=118 iops : min= 1, max= 22, avg= 5.24, stdev= 4.01, samples=118 write: IOPS=5, BW=93.2KiB/s (95.5kB/s)(6544KiB/70198msec); 0 zone resets clat (msec): min=47, max=447, avg=136.45, stdev=60.63 lat (msec): min=47, max=447, avg=136.45, stdev=60.63 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 124], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 268], | 99.00th=[ 347], 99.50th=[ 401], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 192, per=25.91%, avg=92.77, stdev=39.21, samples=139 iops : min= 1, max= 12, avg= 5.01, stdev= 2.53, samples=139 lat (msec) : 10=0.65%, 20=12.50%, 50=23.96%, 100=22.27%, 250=37.63% lat (msec) : 500=2.99% cpu : usr=0.05%, sys=1.55%, ctx=1302, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Wed Aug 19 07:46:43 2026 read: IOPS=5, BW=93.2KiB/s (95.4kB/s)(6256KiB/67127msec) clat (msec): min=8, max=249, avg=39.62, stdev=35.62 lat (msec): min=8, max=249, avg=39.63, stdev=35.62 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 54], 90.00th=[ 85], 95.00th=[ 123], | 99.00th=[ 184], 99.50th=[ 207], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 316, per=29.23%, avg=99.67, stdev=64.86, samples=124 iops : min= 1, max= 19, avg= 5.44, stdev= 4.11, samples=124 write: IOPS=5, BW=89.9KiB/s (92.0kB/s)(6032KiB/67127msec); 0 zone resets clat (msec): min=47, max=395, avg=136.49, stdev=58.64 lat (msec): min=47, max=395, avg=136.50, stdev=58.64 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 77], 20.00th=[ 88], | 30.00th=[ 102], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 174], 90.00th=[ 222], 95.00th=[ 251], | 99.00th=[ 321], 99.50th=[ 342], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 31, max= 192, per=25.12%, avg=89.93, stdev=39.48, samples=132 iops : min= 1, max= 12, avg= 4.83, stdev= 2.57, samples=132 lat (msec) : 10=0.26%, 20=14.45%, 50=25.65%, 100=21.48%, 250=35.55% lat (msec) : 500=2.60% cpu : usr=0.05%, sys=1.63%, ctx=1421, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Wed Aug 19 07:46:43 2026 read: IOPS=5, BW=86.3KiB/s (88.4kB/s)(6032KiB/69873msec) clat (msec): min=8, max=290, avg=42.90, stdev=42.77 lat (msec): min=8, max=290, avg=42.91, stdev=42.77 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 90], 95.00th=[ 132], | 99.00th=[ 236], 99.50th=[ 271], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 320, per=28.42%, avg=96.91, stdev=62.52, samples=121 iops : min= 1, max= 20, avg= 5.27, stdev= 4.00, samples=121 write: IOPS=5, BW=89.5KiB/s (91.7kB/s)(6256KiB/69873msec); 0 zone resets clat (msec): min=37, max=409, avg=136.46, stdev=56.77 lat (msec): min=37, max=409, avg=136.46, stdev=56.77 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 101], 40.00th=[ 113], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 182], 90.00th=[ 215], 95.00th=[ 243], | 99.00th=[ 321], 99.50th=[ 334], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 30, max= 191, per=25.19%, avg=90.17, stdev=40.12, samples=136 iops : min= 1, max= 11, avg= 4.85, stdev= 2.59, samples=136 lat (msec) : 10=0.78%, 20=11.59%, 50=25.91%, 100=22.01%, 250=36.98% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.68%, ctx=1457, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=341KiB/s (349kB/s), 81.8KiB/s-93.2KiB/s (83.8kB/s-95.4kB/s), io=23.4MiB (24.5MB), run=67127-70198msec WRITE: bw=359KiB/s (368kB/s), 89.5KiB/s-93.2KiB/s (91.7kB/s-95.5kB/s), io=24.6MiB (25.8MB), run=67127-70198msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144947: Wed Aug 19 07:46:59 2026 read: IOPS=1, BW=1139KiB/s (1166kB/s)(7168KiB/6295msec) clat (usec): min=625, max=2309.2k, avg=640516.72, stdev=954524.57 lat (usec): min=626, max=2309.2k, avg=640518.19, stdev=954524.84 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], | 20.00th=[ 693], 30.00th=[ 129500], 40.00th=[ 129500], | 50.00th=[ 129500], 60.00th=[ 202376], 70.00th=[ 202376], | 80.00th=[1719665], 90.00th=[2298479], 95.00th=[2298479], | 99.00th=[2298479], 99.50th=[2298479], 99.90th=[2298479], | 99.95th=[2298479], 99.99th=[2298479] bw ( KiB/s): min= 2027, max= 4039, per=93.11%, avg=3029.00, stdev=1147.87, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=813KiB/s (833kB/s)(5120KiB/6295msec); 0 zone resets clat (msec): min=243, max=407, avg=353.17, stdev=64.98 lat (msec): min=244, max=407, avg=353.24, stdev=65.00 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1954, max= 4055, per=55.20%, avg=2513.75, stdev=1028.14, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=33.33%, 500=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.83%, ctx=508, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144948: Wed Aug 19 07:46:59 2026 read: IOPS=0, BW=338KiB/s (346kB/s)(2048KiB/6067msec) clat (msec): min=148, max=234, avg=191.62, stdev=61.31 lat (msec): min=148, max=234, avg=191.62, stdev=61.31 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 2043, max= 2048, per=62.88%, avg=2045.50, stdev= 3.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1688KiB/s (1728kB/s)(10.0MiB/6067msec); 0 zone resets clat (msec): min=152, max=2206, avg=536.83, stdev=616.60 lat (msec): min=152, max=2206, avg=536.97, stdev=616.57 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 199], | 30.00th=[ 228], 40.00th=[ 245], 50.00th=[ 251], 60.00th=[ 321], | 70.00th=[ 405], 80.00th=[ 651], 90.00th=[ 709], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 2003, max= 4087, per=70.83%, avg=3225.60, stdev=1100.34, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=10.76%, ctx=137, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144949: Wed Aug 19 07:46:59 2026 read: IOPS=1, BW=1093KiB/s (1119kB/s)(6144KiB/5621msec) clat (usec): min=615, max=388969, avg=159585.60, stdev=184333.95 lat (usec): min=617, max=388970, avg=159586.97, stdev=184333.64 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 1237], | 30.00th=[ 1237], 40.00th=[ 1713], 50.00th=[ 1713], 60.00th=[206570], | 70.00th=[358613], 80.00th=[358613], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 1954, max= 4087, per=100.00%, avg=3349.33, stdev=1209.06, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1093KiB/s (1119kB/s)(6144KiB/5621msec); 0 zone resets clat (msec): min=170, max=2409, avg=753.00, stdev=856.50 lat (msec): min=170, max=2409, avg=753.55, stdev=856.25 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 384], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 2003, max= 2048, per=44.44%, avg=2024.00, stdev=21.33, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 250=16.67%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.97%, ctx=167, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144950: Wed Aug 19 07:46:59 2026 read: IOPS=0, BW=973KiB/s (996kB/s)(5120KiB/5264msec) clat (usec): min=626, max=239702, avg=88778.95, stdev=120636.90 lat (usec): min=627, max=239703, avg=88780.26, stdev=120637.10 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 627], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 1745], 60.00th=[ 1745], | 70.00th=[200279], 80.00th=[200279], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 2043, max= 6011, per=100.00%, avg=4027.00, stdev=2805.80, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1362KiB/s (1394kB/s)(7168KiB/5264msec); 0 zone resets clat (msec): min=210, max=2158, avg=649.21, stdev=694.31 lat (msec): min=210, max=2158, avg=649.31, stdev=694.28 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 284], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 372], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 818], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 2003, max= 4087, per=53.68%, avg=2444.80, stdev=918.20, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 250=25.00%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=11.59%, ctx=167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3253KiB/s (3331kB/s), 338KiB/s-1139KiB/s (346kB/s-1166kB/s), io=20.0MiB (20.0MB), run=5264-6295msec WRITE: bw=4555KiB/s (4664kB/s), 813KiB/s-1688KiB/s (833kB/s-1728kB/s), io=28.0MiB (29.4MB), run=5264-6295msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Wed Aug 19 07:47:00 2026 read: IOPS=0, BW=1003KiB/s (1027kB/s)(7168KiB/7144msec) clat (msec): min=49, max=1758, avg=788.94, stdev=730.97 lat (msec): min=49, max=1758, avg=788.95, stdev=730.97 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 75], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 609], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1502], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1896, max= 2043, per=69.62%, avg=1995.40, stdev=59.74, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=717KiB/s (734kB/s)(5120KiB/7144msec); 0 zone resets clat (msec): min=147, max=346, avg=213.95, stdev=80.91 lat (msec): min=147, max=346, avg=214.12, stdev=81.01 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1984, max= 4055, per=75.24%, avg=3019.50, stdev=1464.42, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=8.33%, 750=8.33% lat (msec) : 2000=25.00% cpu : usr=0.00%, sys=2.51%, ctx=74, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Wed Aug 19 07:47:00 2026 read: IOPS=0, BW=312KiB/s (319kB/s)(2048KiB/6573msec) clat (msec): min=155, max=570, avg=363.20, stdev=293.52 lat (msec): min=155, max=570, avg=363.21, stdev=293.52 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1984, max= 2039, per=70.18%, avg=2011.50, stdev=38.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1558KiB/s (1595kB/s)(10.0MiB/6573msec); 0 zone resets clat (msec): min=163, max=2764, avg=563.90, stdev=780.63 lat (msec): min=163, max=2764, avg=564.03, stdev=780.61 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 215], | 30.00th=[ 230], 40.00th=[ 257], 50.00th=[ 309], 60.00th=[ 380], | 70.00th=[ 405], 80.00th=[ 409], 90.00th=[ 506], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1984, max= 4087, per=66.23%, avg=2658.00, stdev=997.26, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.59%, ctx=93, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144953: Wed Aug 19 07:47:00 2026 read: IOPS=0, BW=962KiB/s (985kB/s)(6144KiB/6385msec) clat (msec): min=100, max=285, avg=166.80, stdev=69.90 lat (msec): min=100, max=285, avg=166.80, stdev=69.90 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 142], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1896, max= 4087, per=87.32%, avg=2502.50, stdev=1058.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=962KiB/s (985kB/s)(6144KiB/6385msec); 0 zone resets clat (msec): min=133, max=2529, avg=834.58, stdev=867.36 lat (msec): min=133, max=2529, avg=834.70, stdev=867.36 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 676], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1896, max= 4087, per=60.34%, avg=2421.60, stdev=933.12, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.94%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144954: Wed Aug 19 07:47:00 2026 read: IOPS=0, BW=755KiB/s (773kB/s)(5120KiB/6782msec) clat (msec): min=64, max=581, avg=234.17, stdev=203.88 lat (msec): min=64, max=581, avg=234.18, stdev=203.88 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1896, max= 4007, per=91.73%, avg=2629.00, stdev=1194.19, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1057KiB/s (1082kB/s)(7168KiB/6782msec); 0 zone resets clat (msec): min=214, max=2516, avg=745.14, stdev=811.02 lat (msec): min=215, max=2516, avg=745.22, stdev=811.01 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 234], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 575], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 776], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2003, max= 2043, per=50.67%, avg=2033.40, stdev=17.11, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.26%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2867KiB/s (2936kB/s), 312KiB/s-1003KiB/s (319kB/s-1027kB/s), io=20.0MiB (20.0MB), run=6385-7144msec WRITE: bw=4013KiB/s (4110kB/s), 717KiB/s-1558KiB/s (734kB/s-1595kB/s), io=28.0MiB (29.4MB), run=6385-7144msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144965: Wed Aug 19 07:47:15 2026 read: IOPS=1, BW=4125KiB/s (4224kB/s)(12.0MiB/2979msec) clat (msec): min=808, max=1033, avg=889.65, stdev=124.62 lat (msec): min=808, max=1033, avg=889.65, stdev=124.62 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8062, max= 8126, per=100.00%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.28%, ctx=263, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144966: Wed Aug 19 07:47:15 2026 read: IOPS=0, BW=1245KiB/s (1275kB/s)(4096KiB/3290msec) clat (nsec): min=765176k, max=765176k, avg=765175760.00, stdev= 0.00 lat (nsec): min=765179k, max=765179k, avg=765179240.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2490KiB/s (2550kB/s)(8192KiB/3290msec); 0 zone resets clat (msec): min=726, max=1492, avg=1109.57, stdev=542.00 lat (msec): min=727, max=1493, avg=1110.33, stdev=541.95 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8062, max= 8062, per=92.22%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.32%, ctx=168, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144969: Wed Aug 19 07:47:15 2026 write: IOPS=0, BW=3568KiB/s (3654kB/s)(12.0MiB/3444msec); 0 zone resets clat (msec): min=479, max=1684, avg=1114.98, stdev=605.23 lat (msec): min=480, max=1685, avg=1115.40, stdev=605.09 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8062, max= 8143, per=92.68%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.23%, ctx=38, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144970: Wed Aug 19 07:47:15 2026 write: IOPS=0, BW=3279KiB/s (3357kB/s)(12.0MiB/3748msec); 0 zone resets clat (msec): min=292, max=2677, avg=1143.42, stdev=1331.30 lat (msec): min=295, max=2678, avg=1144.54, stdev=1330.69 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 8126, max= 8159, per=93.14%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.83%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4980KiB/s (5099kB/s), 1245KiB/s-4125KiB/s (1275kB/s-4224kB/s), io=16.0MiB (16.8MB), run=2979-3290msec WRITE: bw=8743KiB/s (8953kB/s), 2490KiB/s-3568KiB/s (2550kB/s-3654kB/s), io=32.0MiB (33.6MB), run=3290-3748msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144963: Wed Aug 19 07:47:15 2026 read: IOPS=0, BW=3997KiB/s (4093kB/s)(12.0MiB/3074msec) clat (msec): min=467, max=1377, avg=995.43, stdev=472.07 lat (msec): min=467, max=1377, avg=995.43, stdev=472.07 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.84%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144964: Wed Aug 19 07:47:15 2026 read: IOPS=0, BW=1047KiB/s (1072kB/s)(4096KiB/3913msec) clat (nsec): min=1751.4M, max=1751.4M, avg=1751410360.00, stdev= 0.00 lat (nsec): min=1751.4M, max=1751.4M, avg=1751413735.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1754], 5.00th=[ 1754], 10.00th=[ 1754], 20.00th=[ 1754], | 30.00th=[ 1754], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2094KiB/s (2144kB/s)(8192KiB/3913msec); 0 zone resets clat (msec): min=543, max=1252, avg=897.54, stdev=501.31 lat (msec): min=543, max=1252, avg=897.95, stdev=501.37 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8143, max= 8143, per=97.24%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.99%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144967: Wed Aug 19 07:47:15 2026 write: IOPS=2, BW=8504KiB/s (8708kB/s)(12.0MiB/1445msec); 0 zone resets clat (msec): min=363, max=498, avg=447.15, stdev=73.03 lat (msec): min=364, max=499, avg=447.62, stdev=73.05 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7922, max= 8159, per=96.02%, avg=8040.50, stdev=167.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.07%, sys=11.29%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144968: Wed Aug 19 07:47:15 2026 write: IOPS=1, BW=4640KiB/s (4752kB/s)(12.0MiB/2648msec); 0 zone resets clat (msec): min=378, max=1074, avg=838.91, stdev=399.17 lat (msec): min=379, max=1078, avg=841.05, stdev=399.41 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7599, max= 8094, per=93.70%, avg=7846.50, stdev=350.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.08%, sys=7.25%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4187KiB/s (4288kB/s), 1047KiB/s-3997KiB/s (1072kB/s-4093kB/s), io=16.0MiB (16.8MB), run=3074-3913msec WRITE: bw=8374KiB/s (8575kB/s), 2094KiB/s-8504KiB/s (2144kB/s-8708kB/s), io=32.0MiB (33.6MB), run=1445-3913msec