== sanity test 398b: DIO and buffer IO race ============== 15:01:53 (1787857313) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.37537 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144195: Thu Aug 27 15:05:22 2026 read: IOPS=7, BW=31.5KiB/s (32.3kB/s)(5992KiB/190060msec) clat (usec): min=33, max=429106, avg=45341.37, stdev=36066.39 lat (usec): min=33, max=429106, avg=45347.56, stdev=36065.62 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 338], 20.00th=[ 20055], | 30.00th=[ 26084], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[158335], 99.50th=[187696], 99.90th=[379585], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 119, per=34.30%, avg=42.88, stdev=19.68, samples=272 iops : min= 1, max= 29, avg=10.07, stdev= 4.98, samples=272 write: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6296KiB/190060msec); 0 zone resets clat (usec): min=662, max=51755k, avg=77232.03, stdev=1304212.11 lat (usec): min=663, max=51755k, avg=77234.09, stdev=1304212.10 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1287], 10.00th=[ 1762], | 20.00th=[ 4686], 30.00th=[ 9241], 40.00th=[ 20841], | 50.00th=[ 32637], 60.00th=[ 45351], 70.00th=[ 58459], | 80.00th=[ 77071], 90.00th=[ 103285], 95.00th=[ 130548], | 99.00th=[ 200279], 99.50th=[ 240124], 99.90th=[ 421528], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 117, per=34.24%, avg=44.86, stdev=20.02, samples=273 iops : min= 1, max= 29, avg=10.57, stdev= 5.06, samples=273 lat (usec) : 50=0.59%, 100=3.87%, 250=0.39%, 500=0.26%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=5.50%, 4=3.71%, 10=6.77%, 20=8.46%, 50=34.67% lat (msec) : 100=26.73%, 250=8.53%, 500=0.29%, >=2000=0.03% cpu : usr=0.07%, sys=3.45%, ctx=6508, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144197: Thu Aug 27 15:05:22 2026 read: IOPS=7, BW=31.1KiB/s (31.8kB/s)(5940KiB/191069msec) clat (usec): min=30, max=471817, avg=45379.96, stdev=37281.31 lat (usec): min=31, max=471819, avg=45385.17, stdev=37281.36 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 239], 20.00th=[ 20055], | 30.00th=[ 26608], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 54789], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[109577], | 99.00th=[166724], 99.50th=[202376], 99.90th=[400557], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 111, per=34.14%, avg=42.67, stdev=18.99, samples=271 iops : min= 1, max= 27, avg=10.02, stdev= 4.77, samples=271 write: IOPS=8, BW=33.2KiB/s (34.0kB/s)(6348KiB/191069msec); 0 zone resets clat (usec): min=916, max=51698k, avg=77491.71, stdev=1297407.73 lat (usec): min=917, max=51698k, avg=77496.42, stdev=1297407.59 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 1631], | 20.00th=[ 4146], 30.00th=[ 9241], 40.00th=[ 21627], | 50.00th=[ 35390], 60.00th=[ 46924], 70.00th=[ 60031], | 80.00th=[ 77071], 90.00th=[ 104334], 95.00th=[ 132645], | 99.00th=[ 198181], 99.50th=[ 270533], 99.90th=[ 329253], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 142, per=34.52%, avg=45.22, stdev=21.27, samples=273 iops : min= 1, max= 35, avg=10.65, stdev= 5.36, samples=273 lat (usec) : 50=0.39%, 100=3.91%, 250=0.55%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=6.05%, 4=4.07%, 10=6.15%, 20=8.20%, 50=34.28% lat (msec) : 100=27.05%, 250=8.63%, 500=0.36%, >=2000=0.03% cpu : usr=0.06%, sys=3.34%, ctx=6426, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144199: Thu Aug 27 15:05:22 2026 read: IOPS=7, BW=31.6KiB/s (32.4kB/s)(6028KiB/190747msec) clat (usec): min=32, max=462172, avg=44794.84, stdev=36413.67 lat (usec): min=33, max=462172, avg=44798.57, stdev=36413.40 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 99], 20.00th=[ 19792], | 30.00th=[ 26084], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 45351], | 70.00th=[ 55837], 80.00th=[ 66847], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[152044], 99.50th=[198181], 99.90th=[358613], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 102, per=34.44%, avg=43.06, stdev=19.45, samples=272 iops : min= 1, max= 25, avg=10.12, stdev= 4.94, samples=272 write: IOPS=8, BW=32.8KiB/s (33.6kB/s)(6260KiB/190747msec); 0 zone resets clat (usec): min=891, max=51838k, avg=78337.10, stdev=1310096.00 lat (usec): min=892, max=51838k, avg=78340.10, stdev=1310095.96 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1549], | 20.00th=[ 4080], 30.00th=[ 8717], 40.00th=[ 20841], | 50.00th=[ 33817], 60.00th=[ 47449], 70.00th=[ 58983], | 80.00th=[ 77071], 90.00th=[ 104334], 95.00th=[ 139461], | 99.00th=[ 200279], 99.50th=[ 248513], 99.90th=[ 549454], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 111, per=33.86%, avg=44.36, stdev=20.17, samples=274 iops : min= 1, max= 27, avg=10.44, stdev= 5.08, samples=274 lat (usec) : 50=0.65%, 100=4.30%, 250=0.39%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.61%, 4=3.42%, 10=6.25%, 20=8.01%, 50=33.92% lat (msec) : 100=27.38%, 250=8.43%, 500=0.29%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.22%, ctx=6383, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144202: Thu Aug 27 15:05:22 2026 read: IOPS=7, BW=31.0KiB/s (32.8kB/s)(6052KiB/189175msec) clat (usec): min=34, max=282526, avg=44147.63, stdev=32718.66 lat (usec): min=34, max=282528, avg=44153.13, stdev=32718.11 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 79], 20.00th=[ 20317], | 30.00th=[ 26346], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[152044], 99.50th=[173016], 99.90th=[242222], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 103, per=35.45%, avg=44.32, stdev=19.32, samples=266 iops : min= 1, max= 25, avg=10.44, stdev= 4.89, samples=266 write: IOPS=8, BW=32.0KiB/s (33.8kB/s)(6236KiB/189175msec); 0 zone resets clat (usec): min=997, max=51858k, avg=78138.19, stdev=1313135.69 lat (usec): min=998, max=51858k, avg=78143.06, stdev=1313135.66 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1647], | 20.00th=[ 4293], 30.00th=[ 8848], 40.00th=[ 19268], | 50.00th=[ 33424], 60.00th=[ 44827], 70.00th=[ 60031], | 80.00th=[ 79168], 90.00th=[ 106431], 95.00th=[ 135267], | 99.00th=[ 187696], 99.50th=[ 244319], 99.90th=[ 708838], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 135, per=34.57%, avg=45.29, stdev=20.72, samples=268 iops : min= 1, max= 33, avg=10.68, stdev= 5.24, samples=268 lat (usec) : 50=0.94%, 100=4.20%, 250=0.42%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.92%, 4=3.94%, 10=7.03%, 20=7.52%, 50=33.92% lat (msec) : 100=26.95%, 250=8.82%, 500=0.13%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.33%, ctx=6464, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=126KiB/s (129kB/s), 31.1KiB/s-31.0KiB/s (31.8kB/s-32.8kB/s), io=23.4MiB (24.6MB), run=189175-191069msec WRITE: bw=132KiB/s (135kB/s), 32.8KiB/s-33.2KiB/s (33.6kB/s-34.0kB/s), io=24.6MiB (25.7MB), run=189175-191069msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144196: Thu Aug 27 15:07:45 2026 read: IOPS=4, BW=17.9KiB/s (18.3kB/s)(5992KiB/334562msec) clat (msec): min=5, max=521, avg=37.82, stdev=40.24 lat (msec): min=5, max=521, avg=37.82, stdev=40.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 86], 95.00th=[ 115], | 99.00th=[ 201], 99.50th=[ 226], 99.90th=[ 451], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 88, per=33.74%, avg=23.96, stdev=16.68, samples=481 iops : min= 1, max= 22, avg= 5.35, stdev= 4.23, samples=481 write: IOPS=4, BW=18.8KiB/s (19.3kB/s)(6296KiB/334562msec); 0 zone resets clat (msec): min=36, max=51997, avg=176.20, stdev=1308.83 lat (msec): min=36, max=51997, avg=176.22, stdev=1308.83 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 192], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 359], 99.50th=[ 422], 99.90th=[ 584], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 55, per=29.15%, avg=21.86, stdev=10.23, samples=551 iops : min= 1, max= 13, avg= 4.82, stdev= 2.60, samples=551 lat (msec) : 10=2.51%, 20=17.35%, 50=19.21%, 100=21.35%, 250=35.25% lat (msec) : 500=4.20%, 750=0.10%, >=2000=0.03% cpu : usr=0.04%, sys=0.90%, ctx=5100, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144198: Thu Aug 27 15:07:45 2026 read: IOPS=4, BW=17.8KiB/s (18.2kB/s)(5940KiB/334241msec) clat (msec): min=4, max=473, avg=36.06, stdev=38.63 lat (msec): min=4, max=473, avg=36.06, stdev=38.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 81], 95.00th=[ 111], | 99.00th=[ 190], 99.50th=[ 228], 99.90th=[ 451], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 111, per=33.95%, avg=24.11, stdev=17.12, samples=475 iops : min= 1, max= 27, avg= 5.38, stdev= 4.31, samples=475 write: IOPS=4, BW=18.0KiB/s (19.4kB/s)(6348KiB/334241msec); 0 zone resets clat (msec): min=37, max=51951, avg=176.51, stdev=1302.32 lat (msec): min=37, max=51951, avg=176.52, stdev=1302.32 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 194], 90.00th=[ 241], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 388], 99.90th=[ 518], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 47, per=29.38%, avg=22.04, stdev=10.09, samples=553 iops : min= 1, max= 11, avg= 4.86, stdev= 2.57, samples=553 lat (msec) : 10=3.19%, 20=16.76%, 50=20.02%, 100=20.64%, 250=34.86% lat (msec) : 500=4.43%, 750=0.07%, >=2000=0.03% cpu : usr=0.04%, sys=0.88%, ctx=5069, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144200: Thu Aug 27 15:07:45 2026 read: IOPS=4, BW=18.1KiB/s (18.5kB/s)(6028KiB/333779msec) clat (msec): min=5, max=51160, avg=72.06, stdev=1317.50 lat (msec): min=5, max=51160, avg=72.06, stdev=1317.50 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 89], 95.00th=[ 121], | 99.00th=[ 197], 99.50th=[ 236], 99.90th=[ 456], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 103, per=33.71%, avg=23.94, stdev=16.30, samples=485 iops : min= 1, max= 25, avg= 5.34, stdev= 4.09, samples=485 write: IOPS=4, BW=18.8KiB/s (19.2kB/s)(6260KiB/333779msec); 0 zone resets clat (msec): min=32, max=601, avg=143.57, stdev=71.06 lat (msec): min=32, max=601, avg=143.57, stdev=71.06 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 236], 95.00th=[ 288], | 99.00th=[ 393], 99.50th=[ 435], 99.90th=[ 575], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 55, per=29.23%, avg=21.92, stdev=10.30, samples=548 iops : min= 1, max= 13, avg= 4.83, stdev= 2.63, samples=548 lat (msec) : 10=2.90%, 20=16.76%, 50=19.53%, 100=21.22%, 250=35.45% lat (msec) : 500=3.97%, 750=0.13%, >=2000=0.03% cpu : usr=0.04%, sys=0.89%, ctx=5024, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144201: Thu Aug 27 15:07:45 2026 read: IOPS=4, BW=18.3KiB/s (18.7kB/s)(6052KiB/331467msec) clat (msec): min=5, max=51520, avg=70.52, stdev=1324.10 lat (msec): min=5, max=51520, avg=70.52, stdev=1324.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 116], | 99.00th=[ 180], 99.50th=[ 226], 99.90th=[ 447], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 111, per=34.66%, avg=24.61, stdev=17.44, samples=474 iops : min= 1, max= 27, avg= 5.51, stdev= 4.39, samples=474 write: IOPS=4, BW=18.8KiB/s (19.3kB/s)(6236KiB/331467msec); 0 zone resets clat (msec): min=38, max=693, avg=143.82, stdev=72.28 lat (msec): min=38, max=693, avg=143.82, stdev=72.29 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 127], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 236], 95.00th=[ 288], | 99.00th=[ 376], 99.50th=[ 418], 99.90th=[ 592], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 64, per=29.32%, avg=21.99, stdev=10.43, samples=544 iops : min= 1, max= 16, avg= 4.85, stdev= 2.66, samples=544 lat (msec) : 10=3.16%, 20=17.15%, 50=19.30%, 100=22.43%, 250=34.08% lat (msec) : 500=3.71%, 750=0.13%, >=2000=0.03% cpu : usr=0.04%, sys=0.90%, ctx=5097, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=71.8KiB/s (73.5kB/s), 17.8KiB/s-18.3KiB/s (18.2kB/s-18.7kB/s), io=23.4MiB (24.6MB), run=331467-334562msec WRITE: bw=75.1KiB/s (76.9kB/s), 18.8KiB/s-18.0KiB/s (19.2kB/s-19.4kB/s), io=24.6MiB (25.7MB), run=331467-334562msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144270: Thu Aug 27 15:08:27 2026 read: IOPS=12, BW=195KiB/s (199kB/s)(5920KiB/30404msec) clat (usec): min=32, max=566559, avg=41614.89, stdev=46871.65 lat (usec): min=32, max=566560, avg=41619.28, stdev=46873.17 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 71], | 30.00th=[ 19006], 40.00th=[ 28181], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 51643], 80.00th=[ 63701], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[202376], 99.50th=[231736], 99.90th=[566232], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 32, max= 603, per=25.02%, avg=193.64, stdev=103.77, samples=58 iops : min= 2, max= 37, avg=11.38, stdev= 6.50, samples=58 write: IOPS=13, BW=209KiB/s (214kB/s)(6368KiB/30404msec); 0 zone resets clat (usec): min=1376, max=360577, avg=36809.45, stdev=44159.77 lat (usec): min=1378, max=360580, avg=36815.11, stdev=44160.90 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1614], 10.00th=[ 1942], 20.00th=[ 4555], | 30.00th=[ 6980], 40.00th=[ 11207], 50.00th=[ 19792], 60.00th=[ 31327], | 70.00th=[ 47449], 80.00th=[ 63701], 90.00th=[ 91751], 95.00th=[108528], | 99.00th=[219153], 99.50th=[244319], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 447, per=25.82%, avg=210.17, stdev=90.04, samples=58 iops : min= 1, max= 27, avg=12.43, stdev= 5.70, samples=58 lat (usec) : 50=2.34%, 100=9.51%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=5.60%, 4=4.56%, 10=9.38%, 20=9.24%, 50=28.91% lat (msec) : 100=22.01%, 250=7.68%, 500=0.13%, 750=0.13% cpu : usr=0.09%, sys=5.18%, ctx=1339, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144271: Thu Aug 27 15:08:27 2026 read: IOPS=11, BW=189KiB/s (193kB/s)(5744KiB/30466msec) clat (usec): min=38, max=274574, avg=42794.45, stdev=36641.31 lat (usec): min=38, max=274575, avg=42795.82, stdev=36641.20 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 85], | 30.00th=[ 23987], 40.00th=[ 32900], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[160433], 99.50th=[238027], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 45, max= 430, per=24.22%, avg=187.44, stdev=77.68, samples=59 iops : min= 2, max= 26, avg=10.98, stdev= 4.85, samples=59 write: IOPS=13, BW=215KiB/s (220kB/s)(6544KiB/30466msec); 0 zone resets clat (usec): min=1431, max=273784, avg=36754.35, stdev=43157.68 lat (usec): min=1433, max=273787, avg=36756.86, stdev=43157.71 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1745], 10.00th=[ 2212], 20.00th=[ 4752], | 30.00th=[ 6783], 40.00th=[ 11731], 50.00th=[ 20317], 60.00th=[ 29754], | 70.00th=[ 44827], 80.00th=[ 64750], 90.00th=[101188], 95.00th=[121111], | 99.00th=[198181], 99.50th=[221250], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 30, max= 416, per=26.09%, avg=212.37, stdev=90.10, samples=59 iops : min= 1, max= 26, avg=12.56, stdev= 5.74, samples=59 lat (usec) : 50=1.04%, 100=9.24%, 250=0.26%, 750=0.13%, 1000=0.26% lat (msec) : 2=5.08%, 4=3.52%, 10=11.59%, 20=7.94%, 50=27.73% lat (msec) : 100=25.39%, 250=7.55%, 500=0.26% cpu : usr=0.09%, sys=4.67%, ctx=1314, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144273: Thu Aug 27 15:08:27 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30937msec) clat (usec): min=37, max=337067, avg=39100.56, stdev=35928.51 lat (usec): min=37, max=337068, avg=39101.86, stdev=35928.58 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 52], 10.00th=[ 59], 20.00th=[ 86], | 30.00th=[ 20579], 40.00th=[ 30016], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 52691], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[139461], 99.50th=[158335], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 63, max= 447, per=26.86%, avg=207.90, stdev=90.20, samples=59 iops : min= 3, max= 27, avg=12.29, stdev= 5.69, samples=59 write: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30937msec); 0 zone resets clat (usec): min=1077, max=425271, avg=40500.75, stdev=51517.91 lat (usec): min=1077, max=425273, avg=40507.24, stdev=51516.74 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1614], 10.00th=[ 1844], 20.00th=[ 3523], | 30.00th=[ 7373], 40.00th=[ 11076], 50.00th=[ 24511], 60.00th=[ 37487], | 70.00th=[ 50594], 80.00th=[ 66847], 90.00th=[ 99091], 95.00th=[132645], | 99.00th=[278922], 99.50th=[354419], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 22, max= 473, per=23.75%, avg=193.35, stdev=96.16, samples=60 iops : min= 1, max= 29, avg=11.38, stdev= 6.05, samples=60 lat (usec) : 50=2.34%, 100=8.72%, 250=1.43%, 500=0.26%, 1000=0.13% lat (msec) : 2=6.51%, 4=4.69%, 10=8.46%, 20=6.51%, 50=29.04% lat (msec) : 100=24.61%, 250=6.64%, 500=0.65% cpu : usr=0.06%, sys=4.62%, ctx=1363, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144275: Thu Aug 27 15:08:27 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(6032KiB/30612msec) clat (usec): min=32, max=349168, avg=42456.79, stdev=41271.14 lat (usec): min=32, max=349169, avg=42458.01, stdev=41271.16 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 79], | 30.00th=[ 21365], 40.00th=[ 30016], 50.00th=[ 37487], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[113771], | 99.00th=[179307], 99.50th=[250610], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 22, max= 445, per=25.73%, avg=199.17, stdev=83.43, samples=58 iops : min= 1, max= 27, avg=11.74, stdev= 5.19, samples=58 write: IOPS=12, BW=204KiB/s (209kB/s)(6256KiB/30612msec); 0 zone resets clat (usec): min=1406, max=377046, avg=36459.80, stdev=45114.53 lat (usec): min=1408, max=377049, avg=36473.32, stdev=45126.73 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1680], 10.00th=[ 2024], 20.00th=[ 4817], | 30.00th=[ 7635], 40.00th=[ 11600], 50.00th=[ 20055], 60.00th=[ 30540], | 70.00th=[ 43779], 80.00th=[ 58983], 90.00th=[ 90702], 95.00th=[116917], | 99.00th=[238027], 99.50th=[246416], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 31, max= 367, per=24.95%, avg=203.10, stdev=78.79, samples=59 iops : min= 1, max= 22, avg=11.98, stdev= 4.95, samples=59 lat (usec) : 50=1.95%, 100=8.85%, 250=1.30%, 750=0.26% lat (msec) : 2=5.08%, 4=4.04%, 10=9.90%, 20=8.07%, 50=31.12% lat (msec) : 100=21.48%, 250=7.55%, 500=0.39% cpu : usr=0.08%, sys=4.80%, ctx=1308, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=774KiB/s (793kB/s), 189KiB/s-202KiB/s (193kB/s-207kB/s), io=23.4MiB (24.5MB), run=30404-30937msec WRITE: bw=815KiB/s (834kB/s), 195KiB/s-215KiB/s (200kB/s-220kB/s), io=24.6MiB (25.8MB), run=30404-30937msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144272: Thu Aug 27 15:09:12 2026 read: IOPS=4, BW=78.4KiB/s (80.3kB/s)(5920KiB/75535msec) clat (msec): min=8, max=295, avg=39.06, stdev=37.91 lat (msec): min=8, max=295, avg=39.06, stdev=37.91 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 77], 95.00th=[ 110], | 99.00th=[ 222], 99.50th=[ 239], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 320, per=29.71%, avg=93.59, stdev=56.34, samples=124 iops : min= 1, max= 20, avg= 5.07, stdev= 3.59, samples=124 write: IOPS=5, BW=84.3KiB/s (86.3kB/s)(6368KiB/75535msec); 0 zone resets clat (msec): min=48, max=636, avg=152.77, stdev=84.44 lat (msec): min=48, max=636, avg=152.77, stdev=84.44 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 72], 10.00th=[ 81], 20.00th=[ 93], | 30.00th=[ 108], 40.00th=[ 118], 50.00th=[ 130], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 194], 90.00th=[ 259], 95.00th=[ 309], | 99.00th=[ 535], 99.50th=[ 609], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 22, max= 192, per=25.62%, avg=85.05, stdev=39.34, samples=147 iops : min= 1, max= 12, avg= 4.53, stdev= 2.54, samples=147 lat (msec) : 10=0.91%, 20=13.93%, 50=24.09%, 100=18.88%, 250=36.20% lat (msec) : 500=5.34%, 750=0.65% cpu : usr=0.05%, sys=1.15%, ctx=1246, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144274: Thu Aug 27 15:09:12 2026 read: IOPS=4, BW=75.8KiB/s (77.6kB/s)(5744KiB/75812msec) clat (msec): min=8, max=225, avg=41.75, stdev=37.44 lat (msec): min=8, max=225, avg=41.75, stdev=37.44 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 59], 90.00th=[ 101], 95.00th=[ 125], | 99.00th=[ 182], 99.50th=[ 213], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 22, max= 319, per=28.80%, avg=90.73, stdev=60.28, samples=123 iops : min= 1, max= 19, avg= 4.91, stdev= 3.78, samples=123 write: IOPS=5, BW=86.3KiB/s (88.4kB/s)(6544KiB/75812msec); 0 zone resets clat (msec): min=46, max=475, avg=148.40, stdev=77.51 lat (msec): min=46, max=475, avg=148.41, stdev=77.51 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 79], 20.00th=[ 92], | 30.00th=[ 105], 40.00th=[ 114], 50.00th=[ 126], 60.00th=[ 142], | 70.00th=[ 161], 80.00th=[ 194], 90.00th=[ 255], 95.00th=[ 300], | 99.00th=[ 460], 99.50th=[ 468], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 191, per=26.10%, avg=86.65, stdev=40.33, samples=147 iops : min= 1, max= 11, avg= 4.63, stdev= 2.61, samples=147 lat (msec) : 10=1.04%, 20=12.11%, 50=22.92%, 100=20.70%, 250=37.76% lat (msec) : 500=5.47% cpu : usr=0.04%, sys=1.19%, ctx=1279, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144276: Thu Aug 27 15:09:12 2026 read: IOPS=5, BW=85.3KiB/s (87.3kB/s)(6256KiB/73359msec) clat (msec): min=7, max=256, avg=39.10, stdev=37.36 lat (msec): min=7, max=256, avg=39.10, stdev=37.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 74], 95.00th=[ 117], | 99.00th=[ 205], 99.50th=[ 251], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 30, max= 320, per=30.82%, avg=97.08, stdev=66.06, samples=127 iops : min= 1, max= 20, avg= 5.30, stdev= 4.19, samples=127 write: IOPS=5, BW=82.2KiB/s (84.2kB/s)(6032KiB/73359msec); 0 zone resets clat (msec): min=45, max=623, avg=153.39, stdev=77.56 lat (msec): min=45, max=623, avg=153.40, stdev=77.56 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 82], 20.00th=[ 94], | 30.00th=[ 108], 40.00th=[ 118], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 174], 80.00th=[ 199], 90.00th=[ 257], 95.00th=[ 292], | 99.00th=[ 422], 99.50th=[ 550], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 30, max= 160, per=24.70%, avg=82.01, stdev=36.59, samples=143 iops : min= 1, max= 10, avg= 4.34, stdev= 2.36, samples=143 lat (msec) : 10=1.43%, 20=14.45%, 50=25.00%, 100=18.36%, 250=34.90% lat (msec) : 500=5.60%, 750=0.26% cpu : usr=0.04%, sys=1.15%, ctx=1282, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144277: Thu Aug 27 15:09:12 2026 read: IOPS=5, BW=80.1KiB/s (81.0kB/s)(6032KiB/75337msec) clat (msec): min=6, max=326, avg=40.87, stdev=39.80 lat (msec): min=6, max=326, avg=40.87, stdev=39.80 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 222], 99.50th=[ 268], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 319, per=28.63%, avg=90.18, stdev=56.76, samples=130 iops : min= 1, max= 19, avg= 4.85, stdev= 3.62, samples=130 write: IOPS=5, BW=83.0KiB/s (85.0kB/s)(6256KiB/75337msec); 0 zone resets clat (msec): min=48, max=497, avg=152.33, stdev=73.15 lat (msec): min=48, max=497, avg=152.34, stdev=73.14 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 74], 10.00th=[ 83], 20.00th=[ 95], | 30.00th=[ 109], 40.00th=[ 123], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 197], 90.00th=[ 247], 95.00th=[ 300], | 99.00th=[ 393], 99.50th=[ 472], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 22, max= 160, per=25.10%, avg=83.34, stdev=37.95, samples=147 iops : min= 1, max= 10, avg= 4.41, stdev= 2.45, samples=147 lat (msec) : 10=1.17%, 20=11.46%, 50=26.30%, 100=19.27%, 250=36.59% lat (msec) : 500=5.21% cpu : usr=0.04%, sys=1.02%, ctx=1162, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=316KiB/s (324kB/s), 75.8KiB/s-85.3KiB/s (77.6kB/s-87.3kB/s), io=23.4MiB (24.5MB), run=73359-75812msec WRITE: bw=332KiB/s (340kB/s), 82.2KiB/s-86.3KiB/s (84.2kB/s-88.4kB/s), io=24.6MiB (25.8MB), run=73359-75812msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144295: Thu Aug 27 15:09:29 2026 read: IOPS=1, BW=1960KiB/s (2007kB/s)(7168KiB/3657msec) clat (usec): min=610, max=465228, avg=204788.33, stdev=168036.80 lat (usec): min=611, max=465229, avg=204790.11, stdev=168036.80 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 807], | 30.00th=[149947], 40.00th=[149947], 50.00th=[238027], 60.00th=[283116], | 70.00th=[283116], 80.00th=[295699], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 1454, max= 4007, per=64.60%, avg=2383.75, stdev=1116.53, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1400KiB/s (1434kB/s)(5120KiB/3657msec); 0 zone resets clat (msec): min=118, max=817, avg=382.38, stdev=269.93 lat (msec): min=118, max=817, avg=382.45, stdev=269.91 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2003, max= 6059, per=78.01%, avg=4031.00, stdev=2868.03, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.11%, sys=12.91%, ctx=148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144296: Thu Aug 27 15:09:29 2026 read: IOPS=0, BW=373KiB/s (382kB/s)(2048KiB/5485msec) clat (msec): min=190, max=316, avg=253.74, stdev=88.83 lat (msec): min=190, max=316, avg=253.74, stdev=88.83 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1452, max= 1957, per=46.19%, avg=1704.50, stdev=357.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1867KiB/s (1912kB/s)(10.0MiB/5485msec); 0 zone resets clat (msec): min=91, max=1692, avg=492.73, stdev=438.68 lat (msec): min=92, max=1692, avg=493.19, stdev=438.56 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 259], | 30.00th=[ 351], 40.00th=[ 355], 50.00th=[ 363], 60.00th=[ 393], | 70.00th=[ 414], 80.00th=[ 464], 90.00th=[ 550], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1452, max= 4023, per=48.22%, avg=2491.29, stdev=1035.44, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 100=8.33%, 250=8.33%, 500=66.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.61%, ctx=137, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144297: Thu Aug 27 15:09:29 2026 read: IOPS=1, BW=1384KiB/s (1418kB/s)(6144KiB/4438msec) clat (msec): min=179, max=334, avg=274.20, stdev=59.73 lat (msec): min=179, max=334, avg=274.21, stdev=59.73 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 309], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1957, max= 2039, per=54.44%, avg=2009.00, stdev=31.87, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1384KiB/s (1418kB/s)(6144KiB/4438msec); 0 zone resets clat (msec): min=112, max=826, avg=413.18, stdev=246.76 lat (msec): min=112, max=826, avg=413.27, stdev=246.75 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 468], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1456, max= 4079, per=44.90%, avg=2320.00, stdev=1013.46, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=66.67%, 1000=8.33% cpu : usr=0.07%, sys=11.29%, ctx=180, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144298: Thu Aug 27 15:09:29 2026 read: IOPS=0, BW=923KiB/s (945kB/s)(5120KiB/5549msec) clat (usec): min=632, max=564832, avg=219441.95, stdev=236980.93 lat (usec): min=634, max=564833, avg=219443.48, stdev=236980.77 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 1029], 40.00th=[ 1029], 50.00th=[212861], 60.00th=[212861], | 70.00th=[316670], 80.00th=[316670], 90.00th=[566232], 95.00th=[566232], | 99.00th=[566232], 99.50th=[566232], 99.90th=[566232], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 2019, max= 4079, per=73.40%, avg=2708.33, stdev=1187.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1292KiB/s (1323kB/s)(7168KiB/5549msec); 0 zone resets clat (msec): min=201, max=909, avg=615.47, stdev=226.27 lat (msec): min=201, max=909, avg=615.58, stdev=226.28 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 481], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 634], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 743], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1957, max= 3930, per=45.13%, avg=2331.83, stdev=783.50, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=16.67%, 750=41.67%, 1000=8.33% cpu : usr=0.02%, sys=7.07%, ctx=123, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3691KiB/s (3779kB/s), 373KiB/s-1960KiB/s (382kB/s-2007kB/s), io=20.0MiB (20.0MB), run=3657-5549msec WRITE: bw=5167KiB/s (5291kB/s), 1292KiB/s-1867KiB/s (1323kB/s-1912kB/s), io=28.0MiB (29.4MB), run=3657-5549msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144299: Thu Aug 27 15:09:29 2026 read: IOPS=1, BW=1172KiB/s (1201kB/s)(7168KiB/6114msec) clat (msec): min=87, max=1575, avg=456.18, stdev=555.19 lat (msec): min=87, max=1575, avg=456.18, stdev=555.18 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 153], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 810], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1617, max= 4055, per=72.66%, avg=2433.50, stdev=1098.50, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=837KiB/s (858kB/s)(5120KiB/6114msec); 0 zone resets clat (msec): min=201, max=1647, avg=572.39, stdev=609.63 lat (msec): min=201, max=1647, avg=572.47, stdev=609.63 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1928, max= 2039, per=42.67%, avg=2000.67, stdev=62.96, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.27%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144300: Thu Aug 27 15:09:29 2026 read: IOPS=0, BW=337KiB/s (345kB/s)(2048KiB/6072msec) clat (msec): min=137, max=186, avg=162.07, stdev=34.55 lat (msec): min=137, max=186, avg=162.07, stdev=34.55 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 1715, max= 2035, per=55.99%, avg=1875.00, stdev=226.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1686KiB/s (1727kB/s)(10.0MiB/6072msec); 0 zone resets clat (msec): min=222, max=1687, avg=560.77, stdev=462.78 lat (msec): min=222, max=1687, avg=560.88, stdev=462.80 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 262], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 326], 60.00th=[ 368], | 70.00th=[ 397], 80.00th=[ 718], 90.00th=[ 1003], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 2023, max= 4071, per=57.12%, avg=2678.50, stdev=997.70, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.05%, sys=2.88%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144301: Thu Aug 27 15:09:29 2026 read: IOPS=1, BW=1030KiB/s (1054kB/s)(6144KiB/5967msec) clat (msec): min=91, max=404, avg=246.66, stdev=132.86 lat (msec): min=91, max=404, avg=246.66, stdev=132.86 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 245], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2023, max= 4079, per=76.02%, avg=2546.00, stdev=1022.04, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1030KiB/s (1054kB/s)(6144KiB/5967msec); 0 zone resets clat (msec): min=349, max=1092, avg=705.32, stdev=287.75 lat (msec): min=349, max=1092, avg=705.54, stdev=287.66 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 852], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 2023, max= 2043, per=43.40%, avg=2035.00, stdev= 7.48, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=2.55%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144302: Thu Aug 27 15:09:29 2026 read: IOPS=1, BW=1046KiB/s (1072kB/s)(5120KiB/4893msec) clat (msec): min=77, max=649, avg=329.94, stdev=211.48 lat (msec): min=77, max=649, avg=329.94, stdev=211.48 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1928, max= 2043, per=59.94%, avg=2007.25, stdev=53.47, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1465KiB/s (1500kB/s)(7168KiB/4893msec); 0 zone resets clat (msec): min=219, max=974, avg=454.04, stdev=302.31 lat (msec): min=219, max=974, avg=454.18, stdev=302.28 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 230], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 309], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 793], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1471, max= 4079, per=62.10%, avg=2912.00, stdev=1354.00, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=3.23%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3350KiB/s (3430kB/s), 337KiB/s-1172KiB/s (345kB/s-1201kB/s), io=20.0MiB (20.0MB), run=4893-6114msec WRITE: bw=4690KiB/s (4802kB/s), 837KiB/s-1686KiB/s (858kB/s-1727kB/s), io=28.0MiB (29.4MB), run=4893-6114msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144309: Thu Aug 27 15:09:46 2026 read: IOPS=0, BW=2868KiB/s (2937kB/s)(12.0MiB/4285msec) clat (msec): min=1144, max=1805, avg=1367.85, stdev=378.95 lat (msec): min=1144, max=1805, avg=1367.85, stdev=378.95 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=6.16%, ctx=244, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144310: Thu Aug 27 15:09:46 2026 read: IOPS=0, BW=813KiB/s (833kB/s)(4096KiB/5037msec) clat (nsec): min=1768.7M, max=1768.7M, avg=1768742946.00, stdev= 0.00 lat (nsec): min=1768.7M, max=1768.7M, avg=1768746107.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1770], 5.00th=[ 1770], 10.00th=[ 1770], 20.00th=[ 1770], | 30.00th=[ 1770], 40.00th=[ 1770], 50.00th=[ 1770], 60.00th=[ 1770], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1626KiB/s (1665kB/s)(8192KiB/5037msec); 0 zone resets clat (msec): min=692, max=2373, avg=1532.82, stdev=1188.32 lat (msec): min=692, max=2376, avg=1534.76, stdev=1190.59 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 2366], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=3.24%, ctx=118, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144311: Thu Aug 27 15:09:46 2026 write: IOPS=0, BW=3923KiB/s (4018kB/s)(12.0MiB/3132msec); 0 zone resets clat (msec): min=872, max=1180, avg=1013.01, stdev=155.74 lat (msec): min=872, max=1180, avg=1013.82, stdev=155.65 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7757, max= 7892, per=100.00%, avg=7824.50, stdev=95.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.00%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144312: Thu Aug 27 15:09:46 2026 write: IOPS=0, BW=3519KiB/s (3603kB/s)(12.0MiB/3492msec); 0 zone resets clat (msec): min=513, max=2131, avg=1144.88, stdev=865.28 lat (msec): min=517, max=2131, avg=1146.59, stdev=863.91 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 5483, max= 8062, per=100.00%, avg=6772.50, stdev=1823.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.43%, ctx=42, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3253KiB/s (3331kB/s), 813KiB/s-2868KiB/s (833kB/s-2937kB/s), io=16.0MiB (16.8MB), run=4285-5037msec WRITE: bw=6505KiB/s (6662kB/s), 1626KiB/s-3923KiB/s (1665kB/s-4018kB/s), io=32.0MiB (33.6MB), run=3132-5037msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144314: Thu Aug 27 15:09:47 2026 read: IOPS=0, BW=2706KiB/s (2771kB/s)(12.0MiB/4541msec) clat (msec): min=1036, max=1852, avg=1511.95, stdev=424.62 lat (msec): min=1036, max=1852, avg=1511.96, stdev=424.62 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 7984, max= 8078, per=100.00%, avg=8031.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.11%, ctx=31, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144315: Thu Aug 27 15:09:47 2026 read: IOPS=0, BW=923KiB/s (945kB/s)(4096KiB/4437msec) clat (nsec): min=1980.2M, max=1980.2M, avg=1980158095.00, stdev= 0.00 lat (nsec): min=1980.2M, max=1980.2M, avg=1980159713.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1989], 5.00th=[ 1989], 10.00th=[ 1989], 20.00th=[ 1989], | 30.00th=[ 1989], 40.00th=[ 1989], 50.00th=[ 1989], 60.00th=[ 1989], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1846KiB/s (1891kB/s)(8192KiB/4437msec); 0 zone resets clat (msec): min=791, max=1662, avg=1227.19, stdev=616.19 lat (msec): min=791, max=1663, avg=1227.53, stdev=616.14 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.02%, sys=2.86%, ctx=45, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144316: Thu Aug 27 15:09:47 2026 write: IOPS=0, BW=2806KiB/s (2873kB/s)(12.0MiB/4379msec); 0 zone resets clat (msec): min=961, max=1877, avg=1447.43, stdev=460.88 lat (msec): min=961, max=1881, avg=1449.07, stdev=462.39 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 7892, max= 8078, per=100.00%, avg=7985.00, stdev=131.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.70%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144317: Thu Aug 27 15:09:47 2026 write: IOPS=0, BW=3867KiB/s (3959kB/s)(12.0MiB/3178msec); 0 zone resets clat (msec): min=548, max=1921, avg=1058.64, stdev=751.64 lat (msec): min=548, max=1922, avg=1059.00, stdev=751.62 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 7937, max= 8175, per=100.00%, avg=8056.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.09%, sys=3.02%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3608KiB/s (3695kB/s), 923KiB/s-2706KiB/s (945kB/s-2771kB/s), io=16.0MiB (16.8MB), run=4437-4541msec WRITE: bw=7385KiB/s (7562kB/s), 1846KiB/s-3867KiB/s (1891kB/s-3959kB/s), io=32.0MiB (33.6MB), run=3178-4437msec