== sanity test 398b: DIO and buffer IO race ============== 04:08:26 (1787386106) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.82996 s, 6.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Sat Aug 22 04:11:31 2026 read: IOPS=9, BW=37.1KiB/s (38.0kB/s)(5992KiB/161462msec) clat (usec): min=33, max=960129, avg=55788.35, stdev=47125.34 lat (usec): min=34, max=960133, avg=55797.23, stdev=47121.84 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 76], 10.00th=[ 17433], 20.00th=[ 27132], | 30.00th=[ 34341], 40.00th=[ 40109], 50.00th=[ 47973], 60.00th=[ 56361], | 70.00th=[ 64750], 80.00th=[ 79168], 90.00th=[100140], 95.00th=[123208], | 99.00th=[221250], 99.50th=[278922], 99.90th=[425722], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 80, per=25.03%, avg=37.04, stdev=16.94, samples=313 iops : min= 1, max= 20, avg= 8.58, stdev= 4.28, samples=313 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6296KiB/161462msec); 0 zone resets clat (usec): min=1103, max=387171, avg=49070.58, stdev=47213.74 lat (usec): min=1105, max=387172, avg=49073.42, stdev=47214.43 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1614], 10.00th=[ 2507], 20.00th=[ 6325], | 30.00th=[ 13304], 40.00th=[ 25822], 50.00th=[ 38536], 60.00th=[ 51119], | 70.00th=[ 65274], 80.00th=[ 84411], 90.00th=[110625], 95.00th=[137364], | 99.00th=[210764], 99.50th=[233833], 99.90th=[354419], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 143, per=24.94%, avg=38.66, stdev=18.98, samples=315 iops : min= 1, max= 35, avg= 8.98, stdev= 4.77, samples=315 lat (usec) : 50=0.26%, 100=2.70%, 250=0.55%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.13%, 4=3.06%, 10=6.51%, 20=6.90%, 50=31.77% lat (msec) : 100=32.42%, 250=11.10%, 500=0.42%, 1000=0.03% cpu : usr=0.09%, sys=4.78%, ctx=6919, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Sat Aug 22 04:11:31 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(5940KiB/157239msec) clat (usec): min=43, max=452479, avg=53750.92, stdev=39722.69 lat (usec): min=43, max=452481, avg=53759.02, stdev=39721.83 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 78], 10.00th=[ 18744], 20.00th=[ 27132], | 30.00th=[ 33424], 40.00th=[ 39584], 50.00th=[ 46400], 60.00th=[ 54789], | 70.00th=[ 64226], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[208667], 99.50th=[252707], 99.90th=[438305], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 5, max= 95, per=25.42%, avg=37.62, stdev=16.85, samples=306 iops : min= 1, max= 23, avg= 8.73, stdev= 4.24, samples=306 write: IOPS=10, BW=40.4KiB/s (41.3kB/s)(6348KiB/157239msec); 0 zone resets clat (usec): min=964, max=925947, avg=48394.02, stdev=54850.82 lat (usec): min=967, max=925949, avg=48400.57, stdev=54848.49 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1565], 10.00th=[ 2442], 20.00th=[ 6259], | 30.00th=[ 11731], 40.00th=[ 23200], 50.00th=[ 35914], 60.00th=[ 46924], | 70.00th=[ 61604], 80.00th=[ 81265], 90.00th=[109577], 95.00th=[141558], | 99.00th=[217056], 99.50th=[265290], 99.90th=[633340], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 94, per=26.23%, avg=40.66, stdev=18.33, samples=303 iops : min= 1, max= 23, avg= 9.49, stdev= 4.61, samples=303 lat (usec) : 50=0.10%, 100=3.03%, 250=0.36%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.52%, 4=2.90%, 10=6.77%, 20=7.45%, 50=33.20% lat (msec) : 100=31.28%, 250=9.70%, 500=0.55%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.68%, ctx=6694, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Sat Aug 22 04:11:31 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6028KiB/159334msec) clat (usec): min=37, max=486118, avg=52460.73, stdev=38292.43 lat (usec): min=37, max=486119, avg=52464.19, stdev=38291.55 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 15664], 20.00th=[ 25560], | 30.00th=[ 32637], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 63701], 80.00th=[ 76022], 90.00th=[ 99091], 95.00th=[123208], | 99.00th=[173016], 99.50th=[202376], 99.90th=[329253], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 7, max= 103, per=25.60%, avg=37.89, stdev=17.83, samples=308 iops : min= 1, max= 25, avg= 8.80, stdev= 4.51, samples=308 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6260KiB/159334msec); 0 zone resets clat (usec): min=1205, max=1249.5k, avg=50899.40, stdev=59797.49 lat (usec): min=1206, max=1249.5k, avg=50906.34, stdev=59795.85 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1582], 10.00th=[ 2474], | 20.00th=[ 6718], 30.00th=[ 13698], 40.00th=[ 25560], | 50.00th=[ 36963], 60.00th=[ 50594], 70.00th=[ 66847], | 80.00th=[ 83362], 90.00th=[ 110625], 95.00th=[ 139461], | 99.00th=[ 242222], 99.50th=[ 299893], 99.90th=[ 467665], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 103, per=25.32%, avg=39.25, stdev=18.33, samples=309 iops : min= 1, max= 25, avg= 9.14, stdev= 4.62, samples=309 lat (usec) : 50=0.26%, 100=3.12%, 250=0.36%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.56%, 4=2.83%, 10=6.18%, 20=7.23%, 50=33.82% lat (msec) : 100=30.01%, 250=10.90%, 500=0.59%, 2000=0.03% cpu : usr=0.08%, sys=4.62%, ctx=6748, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144921: Sat Aug 22 04:11:31 2026 read: IOPS=9, BW=37.9KiB/s (38.8kB/s)(6052KiB/159844msec) clat (usec): min=34, max=1094.8k, avg=54279.45, stdev=47305.49 lat (usec): min=34, max=1094.8k, avg=54285.55, stdev=47309.13 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 16909], | 20.00th=[ 26346], 30.00th=[ 32113], 40.00th=[ 39060], | 50.00th=[ 46400], 60.00th=[ 55313], 70.00th=[ 65274], | 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[ 117965], | 99.00th=[ 191890], 99.50th=[ 252707], 99.90th=[ 371196], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 87, per=25.97%, avg=38.44, stdev=17.29, samples=305 iops : min= 1, max= 21, avg= 8.93, stdev= 4.35, samples=305 write: IOPS=9, BW=39.0KiB/s (39.9kB/s)(6236KiB/159844msec); 0 zone resets clat (usec): min=1231, max=610618, avg=49485.94, stdev=51265.55 lat (usec): min=1232, max=610621, avg=49491.54, stdev=51266.80 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1663], 10.00th=[ 2933], 20.00th=[ 6521], | 30.00th=[ 13173], 40.00th=[ 23987], 50.00th=[ 35914], 60.00th=[ 50594], | 70.00th=[ 64226], 80.00th=[ 81265], 90.00th=[114820], 95.00th=[147850], | 99.00th=[223347], 99.50th=[254804], 99.90th=[333448], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 122, per=25.05%, avg=38.83, stdev=18.79, samples=310 iops : min= 1, max= 30, avg= 9.03, stdev= 4.73, samples=310 lat (usec) : 50=0.23%, 100=3.12%, 250=0.42%, 500=0.10%, 750=0.03% lat (msec) : 2=3.61%, 4=3.26%, 10=6.71%, 20=7.06%, 50=32.58% lat (msec) : 100=31.41%, 250=10.87%, 500=0.52%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.63%, ctx=6727, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (152kB/s), 37.1KiB/s-37.9KiB/s (38.0kB/s-38.8kB/s), io=23.4MiB (24.6MB), run=157239-161462msec WRITE: bw=156KiB/s (159kB/s), 38.0KiB/s-40.4KiB/s (39.9kB/s-41.3kB/s), io=24.6MiB (25.7MB), run=157239-161462msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144922: Sat Aug 22 04:13:37 2026 read: IOPS=5, BW=20.8KiB/s (21.3kB/s)(5992KiB/287436msec) clat (msec): min=6, max=975, avg=42.57, stdev=50.50 lat (msec): min=6, max=975, avg=42.58, stdev=50.50 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 58], 90.00th=[ 102], 95.00th=[ 136], | 99.00th=[ 226], 99.50th=[ 279], 99.90th=[ 443], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 80, per=28.43%, avg=23.60, stdev=16.44, samples=487 iops : min= 1, max= 20, avg= 5.22, stdev= 4.14, samples=487 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6296KiB/287436msec); 0 zone resets clat (msec): min=34, max=755, avg=141.93, stdev=78.88 lat (msec): min=34, max=755, avg=141.93, stdev=78.88 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 105], 50.00th=[ 120], 60.00th=[ 140], | 70.00th=[ 165], 80.00th=[ 194], 90.00th=[ 243], 95.00th=[ 288], | 99.00th=[ 418], 99.50th=[ 472], 99.90th=[ 651], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 55, per=25.17%, avg=21.90, stdev=11.46, samples=549 iops : min= 1, max= 13, avg= 4.79, stdev= 2.90, samples=549 lat (msec) : 10=1.99%, 20=15.36%, 50=21.03%, 100=24.67%, 250=32.13% lat (msec) : 500=4.69%, 750=0.07%, 1000=0.07% cpu : usr=0.04%, sys=1.35%, ctx=5123, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144923: Sat Aug 22 04:13:37 2026 read: IOPS=5, BW=20.7KiB/s (21.2kB/s)(5940KiB/286783msec) clat (msec): min=6, max=1125, avg=42.49, stdev=53.04 lat (msec): min=6, max=1125, avg=42.49, stdev=53.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 59], 90.00th=[ 100], 95.00th=[ 130], | 99.00th=[ 234], 99.50th=[ 249], 99.90th=[ 443], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 87, per=29.02%, avg=24.09, stdev=16.29, samples=474 iops : min= 1, max= 21, avg= 5.34, stdev= 4.09, samples=474 write: IOPS=5, BW=22.1KiB/s (22.7kB/s)(6348KiB/286783msec); 0 zone resets clat (msec): min=29, max=729, avg=140.75, stdev=78.95 lat (msec): min=29, max=729, avg=140.76, stdev=78.94 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 190], 90.00th=[ 239], 95.00th=[ 296], | 99.00th=[ 418], 99.50th=[ 489], 99.90th=[ 667], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 63, per=25.18%, avg=21.91, stdev=11.43, samples=554 iops : min= 1, max= 15, avg= 4.80, stdev= 2.90, samples=554 lat (msec) : 10=2.73%, 20=15.63%, 50=19.63%, 100=24.02%, 250=33.43% lat (msec) : 500=4.36%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.34%, ctx=5097, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144924: Sat Aug 22 04:13:37 2026 read: IOPS=5, BW=21.0KiB/s (21.6kB/s)(6028KiB/286382msec) clat (msec): min=5, max=535, avg=43.18, stdev=47.56 lat (msec): min=5, max=535, avg=43.18, stdev=47.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 61], 90.00th=[ 100], 95.00th=[ 131], | 99.00th=[ 245], 99.50th=[ 288], 99.90th=[ 447], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 7, max= 119, per=28.34%, avg=23.52, stdev=16.56, samples=492 iops : min= 1, max= 29, avg= 5.21, stdev= 4.17, samples=492 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6260KiB/286382msec); 0 zone resets clat (msec): min=27, max=1247, avg=141.27, stdev=83.29 lat (msec): min=27, max=1247, avg=141.27, stdev=83.29 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 249], 95.00th=[ 296], | 99.00th=[ 430], 99.50th=[ 477], 99.90th=[ 709], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 56, per=25.20%, avg=21.92, stdev=11.69, samples=546 iops : min= 1, max= 14, avg= 4.80, stdev= 2.95, samples=546 lat (msec) : 10=2.28%, 20=15.43%, 50=19.99%, 100=25.42%, 250=31.51% lat (msec) : 500=5.14%, 750=0.20%, 2000=0.03% cpu : usr=0.05%, sys=1.37%, ctx=5233, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144925: Sat Aug 22 04:13:37 2026 read: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6052KiB/284624msec) clat (msec): min=6, max=548, avg=41.60, stdev=47.39 lat (msec): min=6, max=548, avg=41.60, stdev=47.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 96], 95.00th=[ 132], | 99.00th=[ 232], 99.50th=[ 271], 99.90th=[ 451], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 79, per=29.20%, avg=24.24, stdev=16.74, samples=480 iops : min= 1, max= 19, avg= 5.39, stdev= 4.22, samples=480 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6236KiB/284624msec); 0 zone resets clat (msec): min=36, max=1356, avg=142.07, stdev=83.37 lat (msec): min=36, max=1356, avg=142.07, stdev=83.37 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 118], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 245], 95.00th=[ 296], | 99.00th=[ 422], 99.50th=[ 464], 99.90th=[ 584], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 63, per=25.22%, avg=21.94, stdev=11.51, samples=544 iops : min= 1, max= 15, avg= 4.81, stdev= 2.91, samples=544 lat (msec) : 10=2.34%, 20=15.82%, 50=20.77%, 100=24.51%, 250=31.35% lat (msec) : 500=5.01%, 750=0.16%, 2000=0.03% cpu : usr=0.05%, sys=1.39%, ctx=5280, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=83.5KiB/s (85.5kB/s), 20.7KiB/s-21.3KiB/s (21.2kB/s-21.8kB/s), io=23.4MiB (24.6MB), run=284624-287436msec WRITE: bw=87.5KiB/s (89.6kB/s), 21.9KiB/s-22.1KiB/s (22.4kB/s-22.7kB/s), io=24.6MiB (25.7MB), run=284624-287436msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144982: Sat Aug 22 04:14:18 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5920KiB/28857msec) clat (usec): min=36, max=200700, avg=42619.00, stdev=34118.93 lat (usec): min=36, max=200703, avg=42651.49, stdev=34089.42 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 128], | 30.00th=[ 24773], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[154141], 99.50th=[187696], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 94, max= 352, per=26.14%, avg=206.52, stdev=63.11, samples=56 iops : min= 5, max= 22, avg=12.13, stdev= 4.02, samples=56 write: IOPS=13, BW=221KiB/s (226kB/s)(6368KiB/28857msec); 0 zone resets clat (usec): min=1868, max=221493, avg=32438.23, stdev=35721.74 lat (usec): min=1871, max=221495, avg=32448.23, stdev=35726.62 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2442], 10.00th=[ 3654], 20.00th=[ 5276], | 30.00th=[ 8291], 40.00th=[ 10683], 50.00th=[ 16581], 60.00th=[ 30540], | 70.00th=[ 40633], 80.00th=[ 54789], 90.00th=[ 82314], 95.00th=[106431], | 99.00th=[154141], 99.50th=[212861], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 524, per=26.75%, avg=222.32, stdev=91.85, samples=56 iops : min= 1, max= 32, avg=13.11, stdev= 5.77, samples=56 lat (usec) : 50=0.78%, 100=8.33%, 250=0.91%, 500=0.39%, 750=0.13% lat (msec) : 2=0.78%, 4=5.86%, 10=12.76%, 20=8.59%, 50=31.12% lat (msec) : 100=24.48%, 250=5.86% cpu : usr=0.10%, sys=6.26%, ctx=1518, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144983: Sat Aug 22 04:14:18 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5744KiB/29388msec) clat (usec): min=32, max=192479, avg=41389.87, stdev=32591.23 lat (usec): min=32, max=192480, avg=41391.48, stdev=32591.19 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 79], 20.00th=[ 255], | 30.00th=[ 25035], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 47449], | 70.00th=[ 56361], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[100140], | 99.00th=[130548], 99.50th=[147850], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 411, per=24.47%, avg=193.30, stdev=84.70, samples=57 iops : min= 1, max= 25, avg=11.30, stdev= 5.39, samples=57 write: IOPS=13, BW=223KiB/s (228kB/s)(6544KiB/29388msec); 0 zone resets clat (usec): min=1612, max=209074, avg=35260.39, stdev=34158.09 lat (usec): min=1614, max=209076, avg=35264.17, stdev=34158.37 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2442], 10.00th=[ 3916], 20.00th=[ 6587], | 30.00th=[ 10290], 40.00th=[ 14877], 50.00th=[ 24511], 60.00th=[ 35390], | 70.00th=[ 45876], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[158335], 99.50th=[164627], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 63, max= 400, per=26.17%, avg=217.44, stdev=85.52, samples=57 iops : min= 3, max= 25, avg=12.81, stdev= 5.39, samples=57 lat (usec) : 50=0.91%, 100=6.25%, 250=2.08%, 500=0.52%, 1000=0.26% lat (msec) : 2=1.30%, 4=4.30%, 10=10.55%, 20=8.85%, 50=33.33% lat (msec) : 100=26.43%, 250=5.21% cpu : usr=0.09%, sys=6.21%, ctx=1543, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144984: Sat Aug 22 04:14:18 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29690msec) clat (usec): min=34, max=152044, avg=40644.76, stdev=32855.07 lat (usec): min=34, max=152045, avg=40646.39, stdev=32855.06 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 108], | 30.00th=[ 23725], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 54789], 80.00th=[ 66323], 90.00th=[ 88605], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[149947], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 31, max= 474, per=26.48%, avg=209.16, stdev=90.55, samples=58 iops : min= 1, max= 29, avg=12.29, stdev= 5.72, samples=58 write: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29690msec); 0 zone resets clat (usec): min=1665, max=237627, avg=36187.73, stdev=35599.15 lat (usec): min=1665, max=237630, avg=36194.66, stdev=35598.61 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2147], 10.00th=[ 3261], 20.00th=[ 5669], | 30.00th=[ 9765], 40.00th=[ 14484], 50.00th=[ 25560], 60.00th=[ 36439], | 70.00th=[ 48497], 80.00th=[ 63177], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[147850], 99.50th=[217056], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 63, max= 411, per=23.91%, avg=198.72, stdev=69.69, samples=58 iops : min= 3, max= 25, avg=11.64, stdev= 4.37, samples=58 lat (usec) : 50=0.91%, 100=9.24%, 250=1.30%, 500=0.26%, 750=0.13% lat (msec) : 2=1.69%, 4=4.95%, 10=8.85%, 20=9.24%, 50=31.64% lat (msec) : 100=26.82%, 250=4.95% cpu : usr=0.09%, sys=6.12%, ctx=1567, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144985: Sat Aug 22 04:14:18 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(6032KiB/30290msec) clat (usec): min=38, max=172087, avg=41276.03, stdev=32593.92 lat (usec): min=38, max=172088, avg=41277.69, stdev=32593.91 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 184], | 30.00th=[ 25035], 40.00th=[ 32375], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 66323], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[154141], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 411, per=24.94%, avg=197.05, stdev=72.59, samples=59 iops : min= 1, max= 25, avg=11.53, stdev= 4.57, samples=59 write: IOPS=12, BW=207KiB/s (211kB/s)(6256KiB/30291msec); 0 zone resets clat (usec): min=1578, max=344893, avg=37224.41, stdev=44320.33 lat (usec): min=1580, max=344897, avg=37227.49, stdev=44320.35 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2343], 10.00th=[ 3195], 20.00th=[ 5997], | 30.00th=[ 8717], 40.00th=[ 12518], 50.00th=[ 21365], 60.00th=[ 32900], | 70.00th=[ 43779], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[119014], | 99.00th=[217056], 99.50th=[238027], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 60, max= 401, per=24.53%, avg=203.86, stdev=75.16, samples=59 iops : min= 3, max= 25, avg=11.97, stdev= 4.76, samples=59 lat (usec) : 50=0.78%, 100=7.81%, 250=1.30%, 500=0.65% lat (msec) : 2=1.95%, 4=4.69%, 10=11.59%, 20=8.72%, 50=32.42% lat (msec) : 100=24.22%, 250=5.73%, 500=0.13% cpu : usr=0.10%, sys=5.95%, ctx=1501, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=791KiB/s (810kB/s), 195KiB/s-211KiB/s (200kB/s-216kB/s), io=23.4MiB (24.5MB), run=28857-30290msec WRITE: bw=832KiB/s (852kB/s), 203KiB/s-223KiB/s (208kB/s-228kB/s), io=24.6MiB (25.8MB), run=28857-30291msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144987: Sat Aug 22 04:14:53 2026 read: IOPS=5, BW=93.8KiB/s (96.1kB/s)(5920KiB/63105msec) clat (msec): min=8, max=541, avg=39.26, stdev=46.92 lat (msec): min=8, max=541, avg=39.26, stdev=46.92 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 77], 95.00th=[ 130], | 99.00th=[ 257], 99.50th=[ 259], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 319, per=27.09%, avg=99.97, stdev=63.38, samples=116 iops : min= 1, max= 19, avg= 5.45, stdev= 4.01, samples=116 write: IOPS=6, BW=101KiB/s (103kB/s)(6368KiB/63105msec); 0 zone resets clat (msec): min=37, max=414, avg=121.76, stdev=61.78 lat (msec): min=37, max=414, avg=121.77, stdev=61.78 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 93], 50.00th=[ 106], 60.00th=[ 117], | 70.00th=[ 133], 80.00th=[ 161], 90.00th=[ 213], 95.00th=[ 253], | 99.00th=[ 363], 99.50th=[ 372], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 22, max= 223, per=26.79%, avg=103.95, stdev=48.89, samples=120 iops : min= 1, max= 13, avg= 5.68, stdev= 3.12, samples=120 lat (msec) : 10=1.56%, 20=16.28%, 50=22.14%, 100=28.13%, 250=28.78% lat (msec) : 500=2.99%, 750=0.13% cpu : usr=0.07%, sys=1.63%, ctx=1365, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144988: Sat Aug 22 04:14:53 2026 read: IOPS=5, BW=88.7KiB/s (90.8kB/s)(5744KiB/64789msec) clat (msec): min=6, max=246, avg=37.87, stdev=36.74 lat (msec): min=6, max=246, avg=37.88, stdev=36.74 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 80], 95.00th=[ 111], | 99.00th=[ 205], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 23, max= 320, per=27.36%, avg=100.97, stdev=70.10, samples=111 iops : min= 1, max= 20, avg= 5.50, stdev= 4.43, samples=111 write: IOPS=6, BW=101KiB/s (103kB/s)(6544KiB/64789msec); 0 zone resets clat (msec): min=44, max=371, avg=124.93, stdev=64.95 lat (msec): min=44, max=371, avg=124.93, stdev=64.95 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 85], 40.00th=[ 93], 50.00th=[ 103], 60.00th=[ 120], | 70.00th=[ 138], 80.00th=[ 163], 90.00th=[ 228], 95.00th=[ 275], | 99.00th=[ 334], 99.50th=[ 347], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 192, per=26.29%, avg=101.99, stdev=47.17, samples=125 iops : min= 1, max= 12, avg= 5.56, stdev= 3.02, samples=125 lat (msec) : 10=2.08%, 20=14.84%, 50=22.14%, 100=29.56%, 250=28.13% lat (msec) : 500=3.26% cpu : usr=0.05%, sys=1.70%, ctx=1399, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144989: Sat Aug 22 04:14:53 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(6256KiB/62156msec) clat (msec): min=6, max=301, avg=36.80, stdev=37.80 lat (msec): min=6, max=301, avg=36.80, stdev=37.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 86], 95.00th=[ 120], | 99.00th=[ 190], 99.50th=[ 241], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 479, per=30.17%, avg=111.32, stdev=82.41, samples=111 iops : min= 1, max= 29, avg= 6.15, stdev= 5.20, samples=111 write: IOPS=6, BW=97.0KiB/s (99.4kB/s)(6032KiB/62156msec); 0 zone resets clat (msec): min=41, max=459, avg=126.51, stdev=66.83 lat (msec): min=41, max=459, avg=126.52, stdev=66.83 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 77], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 106], 60.00th=[ 123], | 70.00th=[ 138], 80.00th=[ 171], 90.00th=[ 224], 95.00th=[ 257], | 99.00th=[ 359], 99.50th=[ 418], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 30, max= 192, per=25.27%, avg=98.04, stdev=45.20, samples=120 iops : min= 1, max= 12, avg= 5.32, stdev= 2.90, samples=120 lat (msec) : 10=2.34%, 20=16.15%, 50=23.96%, 100=26.69%, 250=28.13% lat (msec) : 500=2.73% cpu : usr=0.05%, sys=1.64%, ctx=1282, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144990: Sat Aug 22 04:14:53 2026 read: IOPS=5, BW=93.8KiB/s (96.0kB/s)(6032KiB/64312msec) clat (msec): min=8, max=436, avg=39.85, stdev=46.81 lat (msec): min=8, max=436, avg=39.85, stdev=46.81 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 95], 95.00th=[ 124], | 99.00th=[ 224], 99.50th=[ 347], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 349, per=28.88%, avg=106.58, stdev=66.76, samples=110 iops : min= 1, max= 21, avg= 5.86, stdev= 4.26, samples=110 write: IOPS=6, BW=97.3KiB/s (99.6kB/s)(6256KiB/64312msec); 0 zone resets clat (msec): min=28, max=480, avg=125.90, stdev=72.90 lat (msec): min=28, max=480, avg=125.91, stdev=72.91 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 118], | 70.00th=[ 136], 80.00th=[ 163], 90.00th=[ 220], 95.00th=[ 275], | 99.00th=[ 409], 99.50th=[ 439], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 23, max= 254, per=25.40%, avg=98.56, stdev=50.28, samples=124 iops : min= 1, max= 15, avg= 5.34, stdev= 3.19, samples=124 lat (msec) : 10=0.91%, 20=17.84%, 50=22.66%, 100=26.30%, 250=28.26% lat (msec) : 500=4.04% cpu : usr=0.05%, sys=1.53%, ctx=1300, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=370KiB/s (379kB/s), 88.7KiB/s-101KiB/s (90.8kB/s-103kB/s), io=23.4MiB (24.5MB), run=62156-64789msec WRITE: bw=389KiB/s (398kB/s), 97.0KiB/s-101KiB/s (99.4kB/s-103kB/s), io=24.6MiB (25.8MB), run=62156-64789msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145006: Sat Aug 22 04:15:12 2026 read: IOPS=1, BW=1108KiB/s (1135kB/s)(7168KiB/6467msec) clat (usec): min=1076, max=311136, avg=223024.67, stdev=107424.81 lat (usec): min=1077, max=311138, avg=223026.28, stdev=107424.70 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1074], 10.00th=[ 1074], 20.00th=[189793], | 30.00th=[212861], 40.00th=[212861], 50.00th=[267387], 60.00th=[274727], | 70.00th=[274727], 80.00th=[299893], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 1943, max= 4096, per=95.91%, avg=2770.00, stdev=1003.78, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=0, BW=792KiB/s (811kB/s)(5120KiB/6467msec); 0 zone resets clat (msec): min=216, max=3550, avg=968.36, stdev=1445.70 lat (msec): min=217, max=3550, avg=968.53, stdev=1445.66 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1943, max= 2048, per=49.70%, avg=2009.25, stdev=48.54, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 250=25.00%, 500=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.57%, ctx=167, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145007: Sat Aug 22 04:15:12 2026 read: IOPS=0, BW=294KiB/s (302kB/s)(2048KiB/6955msec) clat (msec): min=155, max=256, avg=206.27, stdev=71.73 lat (msec): min=155, max=256, avg=206.28, stdev=71.73 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 2007, max= 2019, per=69.70%, avg=2013.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1472KiB/s (1508kB/s)(10.0MiB/6955msec); 0 zone resets clat (msec): min=113, max=3547, avg=648.99, stdev=1039.98 lat (msec): min=114, max=3547, avg=649.23, stdev=1039.94 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 128], | 30.00th=[ 163], 40.00th=[ 236], 50.00th=[ 305], 60.00th=[ 313], | 70.00th=[ 393], 80.00th=[ 460], 90.00th=[ 835], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 2039, max= 4096, per=90.14%, avg=3644.20, stdev=898.58, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.10, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.84%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145008: Sat Aug 22 04:15:12 2026 read: IOPS=0, BW=964KiB/s (987kB/s)(6144KiB/6375msec) clat (usec): min=493, max=3770.9k, avg=747519.76, stdev=1490754.85 lat (usec): min=494, max=3770.9k, avg=747521.21, stdev=1490754.99 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], | 20.00th=[ 553], 30.00th=[ 553], 40.00th=[ 34866], | 50.00th=[ 34866], 60.00th=[ 258999], 70.00th=[ 421528], | 80.00th=[ 421528], 90.00th=[3774874], 95.00th=[3774874], | 99.00th=[3774874], 99.50th=[3774874], 99.90th=[3774874], | 99.95th=[3774874], 99.99th=[3774874] bw ( KiB/s): min= 2011, max= 4096, per=100.00%, avg=3331.00, stdev=1147.97, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=964KiB/s (987kB/s)(6144KiB/6375msec); 0 zone resets clat (msec): min=124, max=581, avg=297.72, stdev=169.33 lat (msec): min=124, max=581, avg=298.04, stdev=169.35 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 305], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1943, max= 2790, per=54.29%, avg=2194.75, stdev=398.96, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.15%, ctx=596, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145009: Sat Aug 22 04:15:12 2026 read: IOPS=0, BW=722KiB/s (739kB/s)(5120KiB/7091msec) clat (usec): min=506, max=3656.7k, avg=920593.86, stdev=1553232.52 lat (usec): min=507, max=3656.8k, avg=920595.45, stdev=1553232.46 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], | 20.00th=[ 506], 30.00th=[ 1598], 40.00th=[ 1598], | 50.00th=[ 283116], 60.00th=[ 283116], 70.00th=[ 658506], | 80.00th=[ 658506], 90.00th=[3640656], 95.00th=[3640656], | 99.00th=[3640656], 99.50th=[3640656], 99.90th=[3640656], | 99.95th=[3640656], 99.99th=[3640656] bw ( KiB/s): min= 2048, max= 5829, per=100.00%, avg=3938.50, stdev=2673.57, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=0, BW=1011KiB/s (1035kB/s)(7168KiB/7091msec); 0 zone resets clat (msec): min=175, max=607, avg=336.66, stdev=157.47 lat (msec): min=175, max=607, avg=337.01, stdev=157.39 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 188], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 300], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 485], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1389, max= 4096, per=59.16%, avg=2391.75, stdev=1177.01, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.08%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2888KiB/s (2957kB/s), 294KiB/s-1108KiB/s (302kB/s-1135kB/s), io=20.0MiB (20.0MB), run=6375-7091msec WRITE: bw=4043KiB/s (4140kB/s), 792KiB/s-1472KiB/s (811kB/s-1508kB/s), io=28.0MiB (29.4MB), run=6375-7091msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145011: Sat Aug 22 04:15:13 2026 read: IOPS=0, BW=911KiB/s (932kB/s)(7168KiB/7872msec) clat (msec): min=79, max=784, avg=282.50, stdev=240.23 lat (msec): min=79, max=784, avg=282.50, stdev=240.23 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 134], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 190], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 347], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1793, max= 4087, per=100.00%, avg=2992.50, stdev=1266.72, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=650KiB/s (666kB/s)(5120KiB/7872msec); 0 zone resets clat (msec): min=242, max=4335, avg=1172.55, stdev=1772.80 lat (msec): min=242, max=4336, avg=1172.64, stdev=1772.80 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 2003, max= 3976, per=77.37%, avg=2674.00, stdev=1127.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.72%, ctx=92, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145012: Sat Aug 22 04:15:13 2026 read: IOPS=0, BW=247KiB/s (253kB/s)(2048KiB/8294msec) clat (msec): min=70, max=302, avg=186.76, stdev=163.98 lat (msec): min=70, max=302, avg=186.76, stdev=163.98 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 71], 50.00th=[ 71], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1765, max= 1988, per=76.00%, avg=1876.50, stdev=157.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1235KiB/s (1264kB/s)(10.0MiB/8294msec); 0 zone resets clat (msec): min=188, max=4482, avg=778.75, stdev=1316.89 lat (msec): min=188, max=4482, avg=778.89, stdev=1316.89 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 205], | 30.00th=[ 268], 40.00th=[ 279], 50.00th=[ 330], 60.00th=[ 355], | 70.00th=[ 368], 80.00th=[ 414], 90.00th=[ 902], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1988, max= 4096, per=88.00%, avg=3041.33, stdev=1117.18, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.05%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145013: Sat Aug 22 04:15:13 2026 read: IOPS=0, BW=813KiB/s (832kB/s)(6144KiB/7561msec) clat (msec): min=81, max=4052, avg=768.82, stdev=1608.72 lat (msec): min=81, max=4052, avg=768.82, stdev=1608.72 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 127], | 70.00th=[ 131], 80.00th=[ 131], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 3976, max= 4096, per=100.00%, avg=4036.00, stdev=84.85, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=0, BW=813KiB/s (832kB/s)(6144KiB/7561msec); 0 zone resets clat (msec): min=160, max=842, avg=481.38, stdev=256.66 lat (msec): min=161, max=842, avg=481.51, stdev=256.66 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 617], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2007, max= 2048, per=58.72%, avg=2029.25, stdev=19.50, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.33%, ctx=90, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145014: Sat Aug 22 04:15:13 2026 read: IOPS=0, BW=639KiB/s (654kB/s)(5120KiB/8015msec) clat (msec): min=75, max=261, avg=170.34, stdev=70.25 lat (msec): min=75, max=261, avg=170.34, stdev=70.25 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 2003, max= 3976, per=100.00%, avg=2671.33, stdev=1129.99, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=894KiB/s (916kB/s)(7168KiB/8015msec); 0 zone resets clat (msec): min=191, max=4583, avg=1013.72, stdev=1587.71 lat (msec): min=191, max=4584, avg=1014.36, stdev=1587.50 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 266], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 468], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 818], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 1848, max= 4007, per=69.31%, avg=2395.20, stdev=904.87, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=1.56%, ctx=61, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2469KiB/s (2529kB/s), 247KiB/s-911KiB/s (253kB/s-932kB/s), io=20.0MiB (20.0MB), run=7561-8294msec WRITE: bw=3457KiB/s (3540kB/s), 650KiB/s-1235KiB/s (666kB/s-1264kB/s), io=28.0MiB (29.4MB), run=7561-8294msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145023: Sat Aug 22 04:15:26 2026 read: IOPS=1, BW=5832KiB/s (5972kB/s)(12.0MiB/2107msec) clat (msec): min=483, max=967, avg=678.48, stdev=255.52 lat (msec): min=483, max=967, avg=678.48, stdev=255.52 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 6253, max= 8192, per=92.89%, avg=7222.50, stdev=1371.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=4.61%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145024: Sat Aug 22 04:15:26 2026 read: IOPS=0, BW=2323KiB/s (2379kB/s)(4096KiB/1763msec) clat (nsec): min=326174k, max=326174k, avg=326174096.00, stdev= 0.00 lat (nsec): min=326176k, max=326176k, avg=326176279.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 6140, max= 6140, per=78.97%, avg=6140.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4647KiB/s (4758kB/s)(8192KiB/1763msec); 0 zone resets clat (msec): min=400, max=1001, avg=701.16, stdev=424.72 lat (msec): min=401, max=1002, avg=701.62, stdev=424.95 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8192, max= 8192, per=76.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.62%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145025: Sat Aug 22 04:15:26 2026 write: IOPS=0, BW=4012KiB/s (4108kB/s)(12.0MiB/3063msec); 0 zone resets clat (msec): min=643, max=1471, avg=997.43, stdev=427.28 lat (msec): min=643, max=1472, avg=998.27, stdev=427.05 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7846, max= 8192, per=74.96%, avg=8019.00, stdev=244.66, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.89%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145026: Sat Aug 22 04:15:26 2026 write: IOPS=1, BW=5840KiB/s (5980kB/s)(12.0MiB/2104msec); 0 zone resets clat (msec): min=349, max=1247, avg=692.74, stdev=485.00 lat (msec): min=349, max=1248, avg=693.95, stdev=484.61 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 5649, max= 8192, per=64.69%, avg=6920.50, stdev=1798.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.10%, sys=8.08%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7776KiB/s (7963kB/s), 2323KiB/s-5832KiB/s (2379kB/s-5972kB/s), io=16.0MiB (16.8MB), run=1763-2107msec WRITE: bw=10.4MiB/s (10.0MB/s), 4012KiB/s-5840KiB/s (4108kB/s-5980kB/s), io=32.0MiB (33.6MB), run=1763-3063msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145028: Sat Aug 22 04:15:28 2026 read: IOPS=1, BW=4755KiB/s (4870kB/s)(12.0MiB/2584msec) clat (msec): min=821, max=889, avg=859.52, stdev=34.49 lat (msec): min=821, max=889, avg=859.53, stdev=34.49 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8015, max= 8143, per=100.00%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.01%, ctx=238, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145029: Sat Aug 22 04:15:28 2026 read: IOPS=0, BW=1459KiB/s (1494kB/s)(4096KiB/2807msec) clat (nsec): min=768065k, max=768065k, avg=768065113.00, stdev= 0.00 lat (nsec): min=768067k, max=768067k, avg=768066643.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2918KiB/s (2988kB/s)(8192KiB/2807msec); 0 zone resets clat (msec): min=641, max=1393, avg=1017.40, stdev=531.85 lat (msec): min=642, max=1393, avg=1018.03, stdev=531.63 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7984, max= 7984, per=80.12%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.78%, ctx=113, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145030: Sat Aug 22 04:15:28 2026 write: IOPS=0, BW=3737KiB/s (3827kB/s)(12.0MiB/3288msec); 0 zone resets clat (msec): min=272, max=1620, avg=1094.76, stdev=721.06 lat (msec): min=273, max=1621, avg=1095.26, stdev=720.93 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7984, max= 8175, per=81.08%, avg=8079.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.41%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145031: Sat Aug 22 04:15:28 2026 write: IOPS=1, BW=4746KiB/s (4860kB/s)(12.0MiB/2589msec); 0 zone resets clat (msec): min=436, max=1422, avg=861.32, stdev=507.06 lat (msec): min=436, max=1424, avg=862.61, stdev=507.42 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 5475, max= 7831, per=66.76%, avg=6653.00, stdev=1665.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.44%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5837KiB/s (5977kB/s), 1459KiB/s-4755KiB/s (1494kB/s-4870kB/s), io=16.0MiB (16.8MB), run=2584-2807msec WRITE: bw=9966KiB/s (10.2MB/s), 2918KiB/s-4746KiB/s (2988kB/s-4860kB/s), io=32.0MiB (33.6MB), run=2589-3288msec