== sanity test 398b: DIO and buffer IO race ============== 03:39:04 (1787384344) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.28337 s, 9.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145569: Sat Aug 22 03:41:42 2026 read: IOPS=10, BW=42.7KiB/s (43.8kB/s)(5992KiB/140194msec) clat (usec): min=33, max=547958, avg=47540.35, stdev=37266.61 lat (usec): min=34, max=547959, avg=47550.61, stdev=37259.91 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 8586], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 86508], 95.00th=[102237], | 99.00th=[175113], 99.50th=[210764], 99.90th=[450888], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 111, per=24.99%, avg=42.73, stdev=16.94, samples=272 iops : min= 1, max= 27, avg=10.01, stdev= 4.28, samples=272 write: IOPS=11, BW=44.9KiB/s (45.0kB/s)(6296KiB/140194msec); 0 zone resets clat (usec): min=1102, max=936575, avg=43500.62, stdev=46216.61 lat (usec): min=1103, max=936576, avg=43506.51, stdev=46221.23 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1647], 10.00th=[ 2933], 20.00th=[ 6194], | 30.00th=[ 11338], 40.00th=[ 22152], 50.00th=[ 33424], 60.00th=[ 45351], | 70.00th=[ 57410], 80.00th=[ 73925], 90.00th=[100140], 95.00th=[120062], | 99.00th=[164627], 99.50th=[191890], 99.90th=[283116], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 146, per=24.81%, avg=44.41, stdev=19.83, samples=275 iops : min= 1, max= 36, avg=10.43, stdev= 4.98, samples=275 lat (usec) : 50=0.29%, 100=3.68%, 250=0.42%, 500=0.07%, 750=0.10% lat (msec) : 2=3.42%, 4=3.94%, 10=7.45%, 20=7.98%, 50=35.42% lat (msec) : 100=29.36%, 250=7.58%, 500=0.23%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.42%, ctx=7009, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145570: Sat Aug 22 03:41:42 2026 read: IOPS=10, BW=42.8KiB/s (43.8kB/s)(5940KiB/138739msec) clat (usec): min=34, max=1042.0k, avg=47509.89, stdev=41044.53 lat (usec): min=34, max=1042.0k, avg=47512.16, stdev=41044.58 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 74], 10.00th=[ 11863], | 20.00th=[ 23462], 30.00th=[ 30016], 40.00th=[ 36439], | 50.00th=[ 41681], 60.00th=[ 50070], 70.00th=[ 58459], | 80.00th=[ 69731], 90.00th=[ 84411], 95.00th=[ 101188], | 99.00th=[ 135267], 99.50th=[ 204473], 99.90th=[ 299893], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 7, max= 102, per=24.97%, avg=42.69, stdev=17.34, samples=270 iops : min= 1, max= 25, avg=10.00, stdev= 4.37, samples=270 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6348KiB/138739msec); 0 zone resets clat (usec): min=1132, max=516858, avg=42645.98, stdev=43768.08 lat (usec): min=1134, max=516861, avg=42654.71, stdev=43766.04 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1647], 10.00th=[ 2442], 20.00th=[ 5604], | 30.00th=[ 10290], 40.00th=[ 19268], 50.00th=[ 30802], 60.00th=[ 42730], | 70.00th=[ 56361], 80.00th=[ 73925], 90.00th=[ 99091], 95.00th=[123208], | 99.00th=[183501], 99.50th=[196084], 99.90th=[325059], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 102, per=25.34%, avg=45.35, stdev=19.15, samples=271 iops : min= 1, max= 25, avg=10.67, stdev= 4.80, samples=271 lat (usec) : 50=0.23%, 100=3.29%, 250=0.62%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=4.13%, 4=3.87%, 10=7.62%, 20=8.43%, 50=34.21% lat (msec) : 100=29.95%, 250=7.10%, 500=0.26%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.33%, ctx=6944, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145571: Sat Aug 22 03:41:42 2026 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(6028KiB/136992msec) clat (usec): min=32, max=1104.3k, avg=46949.27, stdev=42242.55 lat (usec): min=33, max=1104.3k, avg=46951.67, stdev=42241.94 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 73], 10.00th=[ 13042], | 20.00th=[ 23200], 30.00th=[ 29230], 40.00th=[ 34341], | 50.00th=[ 41157], 60.00th=[ 47973], 70.00th=[ 55837], | 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[ 101188], | 99.00th=[ 156238], 99.50th=[ 214959], 99.90th=[ 291505], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 101, per=25.54%, avg=43.67, stdev=16.98, samples=269 iops : min= 1, max= 25, avg=10.25, stdev= 4.26, samples=269 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6260KiB/136992msec); 0 zone resets clat (usec): min=1083, max=645909, avg=42007.45, stdev=44118.59 lat (usec): min=1085, max=645911, avg=42017.58, stdev=44123.17 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1614], 10.00th=[ 2671], 20.00th=[ 5866], | 30.00th=[ 10814], 40.00th=[ 20841], 50.00th=[ 31327], 60.00th=[ 42206], | 70.00th=[ 55313], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[183501], 99.50th=[212861], 99.90th=[379585], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 106, per=25.41%, avg=45.49, stdev=17.83, samples=268 iops : min= 1, max= 26, avg=10.71, stdev= 4.48, samples=268 lat (usec) : 50=0.33%, 100=3.39%, 250=0.46%, 500=0.10%, 750=0.10% lat (msec) : 2=3.81%, 4=3.71%, 10=7.32%, 20=8.07%, 50=36.98% lat (msec) : 100=28.81%, 250=6.67%, 500=0.20%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=5.29%, ctx=6864, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145572: Sat Aug 22 03:41:42 2026 read: IOPS=10, BW=43.4KiB/s (44.5kB/s)(6052KiB/139327msec) clat (usec): min=37, max=1090.6k, avg=46799.18, stdev=43456.21 lat (usec): min=37, max=1090.6k, avg=46802.04, stdev=43456.38 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 660], | 20.00th=[ 22414], 30.00th=[ 27919], 40.00th=[ 34866], | 50.00th=[ 40109], 60.00th=[ 46924], 70.00th=[ 56886], | 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[ 103285], | 99.00th=[ 164627], 99.50th=[ 221250], 99.90th=[ 333448], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 102, per=25.24%, avg=43.17, stdev=18.05, samples=272 iops : min= 1, max= 25, avg=10.11, stdev= 4.55, samples=272 write: IOPS=11, BW=44.8KiB/s (45.8kB/s)(6236KiB/139327msec); 0 zone resets clat (usec): min=1136, max=303117, avg=43626.19, stdev=41023.43 lat (usec): min=1136, max=303120, avg=43630.18, stdev=41023.01 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1680], 10.00th=[ 2606], 20.00th=[ 5800], | 30.00th=[ 11207], 40.00th=[ 24249], 50.00th=[ 35390], 60.00th=[ 45351], | 70.00th=[ 57410], 80.00th=[ 74974], 90.00th=[100140], 95.00th=[122160], | 99.00th=[177210], 99.50th=[200279], 99.90th=[274727], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 94, per=24.80%, avg=44.39, stdev=17.58, samples=272 iops : min= 1, max= 23, avg=10.43, stdev= 4.42, samples=272 lat (usec) : 50=0.29%, 100=4.07%, 250=0.33%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=3.65%, 4=3.81%, 10=7.00%, 20=7.36%, 50=36.69% lat (msec) : 100=28.81%, 250=7.49%, 500=0.20%, 2000=0.03% cpu : usr=0.08%, sys=5.15%, ctx=6892, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.7KiB/s-44.0KiB/s (43.8kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=136992-140194msec WRITE: bw=179KiB/s (184kB/s), 44.8KiB/s-45.8KiB/s (45.8kB/s-46.9kB/s), io=24.6MiB (25.7MB), run=136992-140194msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145574: Sat Aug 22 03:43:59 2026 read: IOPS=5, BW=21.6KiB/s (22.2kB/s)(5992KiB/276834msec) clat (msec): min=6, max=1131, avg=38.75, stdev=47.14 lat (msec): min=6, max=1131, avg=38.75, stdev=47.14 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 114], | 99.00th=[ 190], 99.50th=[ 222], 99.90th=[ 485], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 87, per=27.99%, avg=24.07, stdev=16.22, samples=480 iops : min= 1, max= 21, avg= 5.38, stdev= 4.10, samples=480 write: IOPS=5, BW=22.7KiB/s (23.3kB/s)(6296KiB/276834msec); 0 zone resets clat (msec): min=46, max=615, avg=138.88, stdev=62.39 lat (msec): min=46, max=615, avg=138.89, stdev=62.39 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 100], 40.00th=[ 110], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 224], 95.00th=[ 255], | 99.00th=[ 330], 99.50th=[ 376], 99.90th=[ 584], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 47, per=24.78%, avg=22.30, stdev= 9.91, samples=542 iops : min= 1, max= 11, avg= 4.93, stdev= 2.53, samples=542 lat (msec) : 10=1.73%, 20=16.11%, 50=20.64%, 100=23.11%, 250=35.29% lat (msec) : 500=3.03%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.41%, ctx=5167, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145575: Sat Aug 22 03:43:59 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(5940KiB/277352msec) clat (msec): min=6, max=1080, avg=37.85, stdev=46.23 lat (msec): min=6, max=1080, avg=37.85, stdev=46.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 82], 95.00th=[ 106], | 99.00th=[ 188], 99.50th=[ 203], 99.90th=[ 550], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 87, per=28.63%, avg=24.63, stdev=15.89, samples=465 iops : min= 1, max= 21, avg= 5.52, stdev= 4.03, samples=465 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6348KiB/277352msec); 0 zone resets clat (msec): min=37, max=694, avg=139.25, stdev=63.30 lat (msec): min=37, max=694, avg=139.25, stdev=63.30 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 186], 90.00th=[ 224], 95.00th=[ 257], | 99.00th=[ 334], 99.50th=[ 372], 99.90th=[ 584], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 47, per=24.94%, avg=22.45, stdev=10.05, samples=543 iops : min= 1, max= 11, avg= 4.96, stdev= 2.56, samples=543 lat (msec) : 10=2.05%, 20=16.02%, 50=20.83%, 100=22.56%, 250=35.45% lat (msec) : 500=2.93%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.35%, ctx=5238, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145576: Sat Aug 22 03:43:59 2026 read: IOPS=5, BW=21.7KiB/s (22.3kB/s)(6028KiB/277323msec) clat (msec): min=6, max=443, avg=38.98, stdev=37.68 lat (msec): min=6, max=443, avg=38.98, stdev=37.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 56], 90.00th=[ 88], 95.00th=[ 115], | 99.00th=[ 171], 99.50th=[ 230], 99.90th=[ 313], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 94, per=27.25%, avg=23.44, stdev=16.11, samples=495 iops : min= 1, max= 23, avg= 5.22, stdev= 4.08, samples=495 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6260KiB/277323msec); 0 zone resets clat (msec): min=36, max=1223, avg=139.54, stdev=69.56 lat (msec): min=36, max=1223, avg=139.55, stdev=69.56 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 138], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 220], 95.00th=[ 251], | 99.00th=[ 347], 99.50th=[ 409], 99.90th=[ 701], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 54, per=24.87%, avg=22.39, stdev=10.12, samples=537 iops : min= 1, max= 13, avg= 4.95, stdev= 2.57, samples=537 lat (msec) : 10=1.82%, 20=15.79%, 50=20.80%, 100=22.27%, 250=36.56% lat (msec) : 500=2.60%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.41%, ctx=5205, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145577: Sat Aug 22 03:43:59 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6052KiB/277617msec) clat (msec): min=5, max=660, avg=38.83, stdev=42.25 lat (msec): min=5, max=660, avg=38.83, stdev=42.25 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 84], 95.00th=[ 116], | 99.00th=[ 197], 99.50th=[ 224], 99.90th=[ 435], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 103, per=28.06%, avg=24.13, stdev=16.45, samples=484 iops : min= 1, max= 25, avg= 5.39, stdev= 4.16, samples=484 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6236KiB/277617msec); 0 zone resets clat (msec): min=42, max=1215, avg=140.25, stdev=67.06 lat (msec): min=42, max=1215, avg=140.25, stdev=67.06 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 67], 10.00th=[ 75], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 125], 60.00th=[ 142], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 222], 95.00th=[ 264], | 99.00th=[ 330], 99.50th=[ 372], 99.90th=[ 567], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 48, per=24.59%, avg=22.13, stdev= 9.93, samples=542 iops : min= 1, max= 12, avg= 4.88, stdev= 2.53, samples=542 lat (msec) : 10=1.60%, 20=16.18%, 50=21.58%, 100=21.00%, 250=36.33% lat (msec) : 500=3.22%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.42%, ctx=5325, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.5KiB/s (88.6kB/s), 21.4KiB/s-21.8KiB/s (21.9kB/s-22.3kB/s), io=23.4MiB (24.6MB), run=276834-277617msec WRITE: bw=90.6KiB/s (92.7kB/s), 22.5KiB/s-22.9KiB/s (23.0kB/s-23.4kB/s), io=24.6MiB (25.7MB), run=276834-277617msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145634: Sat Aug 22 03:44:43 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(5920KiB/31902msec) clat (usec): min=38, max=198373, avg=41765.38, stdev=31058.78 lat (usec): min=39, max=198375, avg=41774.06, stdev=31060.95 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 63], 10.00th=[ 75], 20.00th=[ 7701], | 30.00th=[ 27395], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 55313], 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[127402], 99.50th=[156238], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 412, per=25.89%, avg=184.89, stdev=79.47, samples=62 iops : min= 1, max= 25, avg=10.77, stdev= 4.99, samples=62 write: IOPS=12, BW=200KiB/s (204kB/s)(6368KiB/31902msec); 0 zone resets clat (usec): min=1824, max=405647, avg=40326.73, stdev=46290.27 lat (usec): min=1827, max=405649, avg=40350.32, stdev=46280.54 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2606], 10.00th=[ 3523], 20.00th=[ 6456], | 30.00th=[ 9765], 40.00th=[ 15533], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 98042], 95.00th=[119014], | 99.00th=[223347], 99.50th=[320865], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 21, max= 380, per=26.61%, avg=199.84, stdev=88.88, samples=62 iops : min= 1, max= 23, avg=11.74, stdev= 5.60, samples=62 lat (usec) : 50=1.04%, 100=6.64%, 250=1.17%, 500=0.39% lat (msec) : 2=0.65%, 4=5.47%, 10=10.03%, 20=7.68%, 50=33.20% lat (msec) : 100=26.43%, 250=7.03%, 500=0.26% cpu : usr=0.06%, sys=6.16%, ctx=1608, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145637: Sat Aug 22 03:44:43 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5744KiB/33231msec) clat (usec): min=40, max=327450, avg=49131.22, stdev=37659.37 lat (usec): min=41, max=327452, avg=49132.74, stdev=37659.46 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 100], 20.00th=[ 23987], | 30.00th=[ 33817], 40.00th=[ 39060], 50.00th=[ 44827], 60.00th=[ 51119], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[114820], | 99.00th=[173016], 99.50th=[223347], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 21, max= 319, per=24.34%, avg=173.75, stdev=73.39, samples=65 iops : min= 1, max= 19, avg=10.08, stdev= 4.62, samples=65 write: IOPS=12, BW=197KiB/s (202kB/s)(6544KiB/33231msec); 0 zone resets clat (usec): min=1790, max=336296, avg=37052.69, stdev=41292.74 lat (usec): min=1793, max=336299, avg=37055.79, stdev=41293.87 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2245], 10.00th=[ 3916], 20.00th=[ 6718], | 30.00th=[ 10159], 40.00th=[ 16057], 50.00th=[ 23987], 60.00th=[ 32375], | 70.00th=[ 43779], 80.00th=[ 62129], 90.00th=[ 89654], 95.00th=[116917], | 99.00th=[193987], 99.50th=[240124], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 536, per=26.29%, avg=197.43, stdev=93.59, samples=65 iops : min= 1, max= 33, avg=11.57, stdev= 5.87, samples=65 lat (usec) : 50=0.26%, 100=4.43%, 250=1.04%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.69%, 4=3.91%, 10=10.55%, 20=9.38%, 50=35.94% lat (msec) : 100=24.87%, 250=7.29%, 500=0.26% cpu : usr=0.09%, sys=6.27%, ctx=1753, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145638: Sat Aug 22 03:44:43 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31742msec) clat (usec): min=39, max=167815, avg=43459.38, stdev=31265.67 lat (usec): min=40, max=167817, avg=43464.46, stdev=31272.57 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 65], 10.00th=[ 79], 20.00th=[ 20841], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[137364], 99.50th=[145753], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 377, per=27.63%, avg=197.31, stdev=72.19, samples=62 iops : min= 1, max= 23, avg=11.56, stdev= 4.56, samples=62 write: IOPS=11, BW=190KiB/s (195kB/s)(6032KiB/31742msec); 0 zone resets clat (usec): min=1654, max=340145, avg=38702.26, stdev=40126.15 lat (usec): min=1657, max=340151, avg=38705.82, stdev=40126.06 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2540], 10.00th=[ 4424], 20.00th=[ 7701], | 30.00th=[ 10945], 40.00th=[ 16450], 50.00th=[ 27919], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[183501], 99.50th=[240124], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 411, per=25.15%, avg=188.87, stdev=78.81, samples=62 iops : min= 1, max= 25, avg=11.03, stdev= 4.99, samples=62 lat (usec) : 50=0.78%, 100=5.99%, 250=2.08%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.17%, 4=3.91%, 10=8.20%, 20=8.72%, 50=35.29% lat (msec) : 100=27.99%, 250=5.34%, 500=0.13% cpu : usr=0.09%, sys=6.00%, ctx=1629, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145639: Sat Aug 22 03:44:43 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(6032KiB/33526msec) clat (usec): min=35, max=452346, avg=48473.30, stdev=43803.53 lat (usec): min=35, max=452348, avg=48474.90, stdev=43803.50 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 68], 10.00th=[ 84], 20.00th=[ 21365], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 51119], | 70.00th=[ 58459], 80.00th=[ 70779], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[217056], 99.50th=[329253], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 31, max= 373, per=26.26%, avg=187.48, stdev=70.78, samples=62 iops : min= 1, max= 23, avg=10.92, stdev= 4.47, samples=62 write: IOPS=11, BW=187KiB/s (191kB/s)(6256KiB/33526msec); 0 zone resets clat (usec): min=1766, max=277650, avg=38150.87, stdev=41563.27 lat (usec): min=1767, max=277653, avg=38155.11, stdev=41563.25 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 3228], 10.00th=[ 4490], 20.00th=[ 6980], | 30.00th=[ 9634], 40.00th=[ 15270], 50.00th=[ 24511], 60.00th=[ 36439], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 90702], 95.00th=[113771], | 99.00th=[231736], 99.50th=[270533], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 379, per=24.57%, avg=184.54, stdev=72.15, samples=65 iops : min= 1, max= 23, avg=10.77, stdev= 4.55, samples=65 lat (usec) : 50=0.13%, 100=5.86%, 250=1.17%, 500=0.26%, 1000=0.26% lat (msec) : 2=0.78%, 4=3.78%, 10=11.72%, 20=8.07%, 50=34.11% lat (msec) : 100=26.69%, 250=6.64%, 500=0.52% cpu : usr=0.11%, sys=5.86%, ctx=1708, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=714KiB/s (732kB/s), 173KiB/s-197KiB/s (177kB/s-202kB/s), io=23.4MiB (24.5MB), run=31742-33526msec WRITE: bw=752KiB/s (770kB/s), 187KiB/s-200KiB/s (191kB/s-204kB/s), io=24.6MiB (25.8MB), run=31742-33526msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145632: Sat Aug 22 03:45:26 2026 read: IOPS=4, BW=78.3KiB/s (80.1kB/s)(5920KiB/75638msec) clat (msec): min=6, max=256, avg=42.16, stdev=38.87 lat (msec): min=6, max=256, avg=42.17, stdev=38.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 94], 95.00th=[ 138], | 99.00th=[ 184], 99.50th=[ 203], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 30, max= 285, per=28.38%, avg=88.54, stdev=55.40, samples=130 iops : min= 1, max= 17, avg= 4.72, stdev= 3.54, samples=130 write: IOPS=5, BW=84.2KiB/s (86.2kB/s)(6368KiB/75638msec); 0 zone resets clat (msec): min=39, max=649, avg=150.03, stdev=68.43 lat (msec): min=39, max=649, avg=150.04, stdev=68.43 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 99], | 30.00th=[ 109], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 405], 99.50th=[ 468], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 30, max= 160, per=26.31%, avg=86.29, stdev=35.75, samples=144 iops : min= 1, max= 10, avg= 4.58, stdev= 2.29, samples=144 lat (msec) : 10=0.91%, 20=12.37%, 50=24.09%, 100=17.84%, 250=41.02% lat (msec) : 500=3.65%, 750=0.13% cpu : usr=0.05%, sys=1.54%, ctx=1347, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145633: Sat Aug 22 03:45:26 2026 read: IOPS=4, BW=74.9KiB/s (76.7kB/s)(5744KiB/76683msec) clat (msec): min=7, max=380, avg=44.98, stdev=48.08 lat (msec): min=7, max=380, avg=44.98, stdev=48.08 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 90], 95.00th=[ 142], | 99.00th=[ 271], 99.50th=[ 309], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 352, per=27.42%, avg=85.56, stdev=61.17, samples=131 iops : min= 1, max= 22, avg= 4.54, stdev= 3.88, samples=131 write: IOPS=5, BW=85.3KiB/s (87.4kB/s)(6544KiB/76683msec); 0 zone resets clat (msec): min=48, max=463, avg=147.75, stdev=63.07 lat (msec): min=48, max=463, avg=147.76, stdev=63.07 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 94], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 138], 60.00th=[ 148], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 224], 95.00th=[ 279], | 99.00th=[ 363], 99.50th=[ 384], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 160, per=26.50%, avg=86.92, stdev=33.73, samples=147 iops : min= 1, max= 10, avg= 4.63, stdev= 2.18, samples=147 lat (msec) : 10=0.39%, 20=10.42%, 50=25.13%, 100=19.01%, 250=40.36% lat (msec) : 500=4.69% cpu : usr=0.03%, sys=1.51%, ctx=1327, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145635: Sat Aug 22 03:45:26 2026 read: IOPS=5, BW=84.2KiB/s (86.3kB/s)(6256KiB/74273msec) clat (msec): min=7, max=304, avg=43.03, stdev=42.23 lat (msec): min=7, max=304, avg=43.04, stdev=42.23 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 59], 90.00th=[ 91], 95.00th=[ 127], | 99.00th=[ 224], 99.50th=[ 300], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 311, per=29.94%, avg=93.40, stdev=60.26, samples=132 iops : min= 1, max= 19, avg= 5.03, stdev= 3.83, samples=132 write: IOPS=5, BW=81.2KiB/s (83.2kB/s)(6032KiB/74273msec); 0 zone resets clat (msec): min=41, max=457, avg=151.50, stdev=63.93 lat (msec): min=41, max=457, avg=151.50, stdev=63.94 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 73], 10.00th=[ 86], 20.00th=[ 100], | 30.00th=[ 113], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 192], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 372], 99.50th=[ 439], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 30, max= 160, per=24.92%, avg=81.75, stdev=31.78, samples=145 iops : min= 1, max= 10, avg= 4.29, stdev= 2.03, samples=145 lat (msec) : 10=0.52%, 20=12.63%, 50=26.69%, 100=17.19%, 250=38.80% lat (msec) : 500=4.17% cpu : usr=0.05%, sys=1.56%, ctx=1391, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145636: Sat Aug 22 03:45:26 2026 read: IOPS=4, BW=78.9KiB/s (80.8kB/s)(6032KiB/76416msec) clat (msec): min=7, max=286, avg=39.99, stdev=36.38 lat (msec): min=7, max=286, avg=39.99, stdev=36.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 55], 90.00th=[ 86], 95.00th=[ 110], | 99.00th=[ 205], 99.50th=[ 268], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 319, per=29.49%, avg=92.01, stdev=60.82, samples=128 iops : min= 1, max= 19, avg= 4.94, stdev= 3.88, samples=128 write: IOPS=5, BW=81.9KiB/s (83.8kB/s)(6256KiB/76416msec); 0 zone resets clat (msec): min=43, max=484, avg=156.05, stdev=67.86 lat (msec): min=43, max=484, avg=156.05, stdev=67.86 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 80], 10.00th=[ 90], 20.00th=[ 100], | 30.00th=[ 116], 40.00th=[ 127], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 176], 80.00th=[ 201], 90.00th=[ 257], 95.00th=[ 292], | 99.00th=[ 414], 99.50th=[ 422], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 30, max= 160, per=24.83%, avg=81.43, stdev=35.04, samples=151 iops : min= 1, max= 10, avg= 4.28, stdev= 2.25, samples=151 lat (msec) : 10=0.78%, 20=13.15%, 50=24.48%, 100=17.97%, 250=37.76% lat (msec) : 500=5.86% cpu : usr=0.04%, sys=1.46%, ctx=1382, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=312KiB/s (320kB/s), 74.9KiB/s-84.2KiB/s (76.7kB/s-86.3kB/s), io=23.4MiB (24.5MB), run=74273-76683msec WRITE: bw=329KiB/s (337kB/s), 81.2KiB/s-85.3KiB/s (83.2kB/s-87.4kB/s), io=24.6MiB (25.8MB), run=74273-76683msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145670: Sat Aug 22 03:45:44 2026 read: IOPS=0, BW=1022KiB/s (1046kB/s)(7168KiB/7014msec) clat (usec): min=703, max=4459.7k, avg=793165.94, stdev=1619400.67 lat (usec): min=705, max=4459.7k, avg=793167.45, stdev=1619400.58 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], | 20.00th=[ 147850], 30.00th=[ 193987], 40.00th=[ 193987], | 50.00th=[ 219153], 60.00th=[ 244319], 70.00th=[ 244319], | 80.00th=[ 287310], 90.00th=[4462740], 95.00th=[4462740], | 99.00th=[4462740], 99.50th=[4462740], 99.90th=[4462740], | 99.95th=[4462740], 99.99th=[4462740] bw ( KiB/s): min= 1450, max= 4087, per=79.74%, avg=2327.60, stdev=1015.51, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=730KiB/s (747kB/s)(5120KiB/7014msec); 0 zone resets clat (msec): min=141, max=466, avg=232.74, stdev=133.73 lat (msec): min=141, max=466, avg=232.89, stdev=133.73 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2023, max= 4071, per=66.36%, avg=2712.33, stdev=1176.68, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=9.20%, ctx=538, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145671: Sat Aug 22 03:45:44 2026 read: IOPS=0, BW=300KiB/s (307kB/s)(2048KiB/6826msec) clat (usec): min=512, max=293597, avg=147055.25, stdev=207242.31 lat (usec): min=514, max=293613, avg=147063.94, stdev=207252.70 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 515], 60.00th=[291505], | 70.00th=[291505], 80.00th=[291505], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 1422, max= 2031, per=59.15%, avg=1726.50, stdev=430.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1500KiB/s (1536kB/s)(10.0MiB/6826msec); 0 zone resets clat (msec): min=189, max=2676, avg=637.15, stdev=748.25 lat (msec): min=189, max=2676, avg=637.37, stdev=748.19 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 213], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 363], 60.00th=[ 380], | 70.00th=[ 414], 80.00th=[ 468], 90.00th=[ 969], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 2000, max= 4063, per=62.84%, avg=2568.29, stdev=947.81, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=58.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=8.53%, ctx=205, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145672: Sat Aug 22 03:45:44 2026 read: IOPS=0, BW=956KiB/s (979kB/s)(6144KiB/6424msec) clat (usec): min=392, max=327036, avg=84938.67, stdev=138127.54 lat (usec): min=393, max=327038, avg=84939.83, stdev=138127.72 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 392], 10.00th=[ 392], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 758], 50.00th=[ 758], 60.00th=[ 2769], | 70.00th=[177210], 80.00th=[177210], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 2035, max= 8000, per=100.00%, avg=5017.50, stdev=4217.89, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=0, BW=956KiB/s (979kB/s)(6144KiB/6424msec); 0 zone resets clat (msec): min=149, max=3454, avg=935.20, stdev=1318.07 lat (msec): min=149, max=3454, avg=935.25, stdev=1318.07 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 241], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 1921, max= 2876, per=54.02%, avg=2208.00, stdev=447.88, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.55%, ctx=116, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145673: Sat Aug 22 03:45:44 2026 read: IOPS=0, BW=822KiB/s (842kB/s)(5120KiB/6228msec) clat (usec): min=894, max=288254, avg=181429.16, stdev=111751.56 lat (usec): min=895, max=288255, avg=181430.28, stdev=111751.50 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 898], | 30.00th=[156238], 40.00th=[156238], 50.00th=[217056], 60.00th=[217056], | 70.00th=[244319], 80.00th=[244319], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 1921, max= 6000, per=100.00%, avg=3960.50, stdev=2884.29, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1151KiB/s (1179kB/s)(7168KiB/6228msec); 0 zone resets clat (msec): min=214, max=2998, avg=750.07, stdev=1021.66 lat (msec): min=215, max=2998, avg=750.16, stdev=1021.64 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 232], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 279], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 919], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1398, max= 4087, per=70.06%, avg=2863.25, stdev=1406.37, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.62%, ctx=154, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2920KiB/s (2990kB/s), 300KiB/s-1022KiB/s (307kB/s-1046kB/s), io=20.0MiB (20.0MB), run=6228-7014msec WRITE: bw=4088KiB/s (4186kB/s), 730KiB/s-1500KiB/s (747kB/s-1536kB/s), io=28.0MiB (29.4MB), run=6228-7014msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145665: Sat Aug 22 03:45:44 2026 read: IOPS=1, BW=1873KiB/s (1918kB/s)(7168KiB/3827msec) clat (msec): min=111, max=665, avg=268.36, stdev=189.38 lat (msec): min=111, max=665, avg=268.36, stdev=189.38 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 129], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 218], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 330], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1965, max= 4087, per=88.56%, avg=2415.80, stdev=934.69, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1338KiB/s (1370kB/s)(5120KiB/3827msec); 0 zone resets clat (msec): min=252, max=565, avg=358.39, stdev=122.45 lat (msec): min=252, max=565, avg=359.32, stdev=121.90 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1965, max= 2043, per=52.89%, avg=2020.50, stdev=37.43, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.08%, sys=4.81%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145666: Sat Aug 22 03:45:44 2026 read: IOPS=0, BW=300KiB/s (307kB/s)(2048KiB/6830msec) clat (msec): min=113, max=138, avg=125.85, stdev=17.51 lat (msec): min=113, max=138, avg=125.85, stdev=17.51 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 138], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 138], 95.00th=[ 138], | 99.00th=[ 138], 99.50th=[ 138], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 1939, max= 2043, per=72.98%, avg=1991.00, stdev=73.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1499KiB/s (1535kB/s)(10.0MiB/6830msec); 0 zone resets clat (msec): min=163, max=2545, avg=640.28, stdev=707.56 lat (msec): min=163, max=2545, avg=640.54, stdev=707.49 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 209], | 30.00th=[ 330], 40.00th=[ 342], 50.00th=[ 384], 60.00th=[ 443], | 70.00th=[ 472], 80.00th=[ 514], 90.00th=[ 1003], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1939, max= 4087, per=68.01%, avg=2598.14, stdev=1015.13, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.59%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145667: Sat Aug 22 03:45:44 2026 read: IOPS=0, BW=819KiB/s (838kB/s)(6144KiB/7505msec) clat (msec): min=62, max=672, avg=303.12, stdev=249.84 lat (msec): min=62, max=672, avg=303.12, stdev=249.84 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 313], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1965, max= 2039, per=73.99%, avg=2018.50, stdev=35.87, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=819KiB/s (838kB/s)(6144KiB/7505msec); 0 zone resets clat (msec): min=124, max=2867, avg=930.88, stdev=1037.85 lat (msec): min=124, max=2867, avg=930.96, stdev=1037.84 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 760], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1957, max= 2043, per=52.76%, avg=2015.50, stdev=39.95, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=16.67%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=2.41%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145668: Sat Aug 22 03:45:44 2026 read: IOPS=0, BW=733KiB/s (750kB/s)(5120KiB/6989msec) clat (msec): min=134, max=770, avg=319.96, stdev=257.46 lat (msec): min=134, max=770, avg=319.96, stdev=257.46 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2043, max= 6071, per=100.00%, avg=4057.00, stdev=2848.23, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1026KiB/s (1050kB/s)(7168KiB/6989msec); 0 zone resets clat (msec): min=172, max=3301, avg=763.77, stdev=1124.68 lat (msec): min=172, max=3301, avg=763.87, stdev=1124.66 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 243], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 368], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 535], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 2043, max= 3886, per=63.16%, avg=2412.60, stdev=823.66, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.03%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2729KiB/s (2794kB/s), 300KiB/s-1873KiB/s (307kB/s-1918kB/s), io=20.0MiB (20.0MB), run=3827-7505msec WRITE: bw=3820KiB/s (3912kB/s), 819KiB/s-1499KiB/s (838kB/s-1535kB/s), io=28.0MiB (29.4MB), run=3827-7505msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145682: Sat Aug 22 03:46:00 2026 read: IOPS=1, BW=4483KiB/s (4591kB/s)(12.0MiB/2741msec) clat (msec): min=758, max=996, avg=885.25, stdev=120.19 lat (msec): min=758, max=996, avg=885.25, stdev=120.19 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=12.85%, ctx=343, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145684: Sat Aug 22 03:46:00 2026 read: IOPS=0, BW=1103KiB/s (1130kB/s)(4096KiB/3712msec) clat (nsec): min=786805k, max=786805k, avg=786804592.00, stdev= 0.00 lat (nsec): min=786806k, max=786806k, avg=786805817.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2207KiB/s (2260kB/s)(8192KiB/3712msec); 0 zone resets clat (msec): min=616, max=2147, avg=1382.25, stdev=1082.43 lat (msec): min=617, max=2147, avg=1382.74, stdev=1081.98 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.26%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145685: Sat Aug 22 03:46:00 2026 write: IOPS=0, BW=2802KiB/s (2869kB/s)(12.0MiB/4386msec); 0 zone resets clat (msec): min=320, max=2246, avg=1376.37, stdev=976.26 lat (msec): min=321, max=2247, avg=1376.71, stdev=976.33 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1569], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8078, max= 8126, per=100.00%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.19%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145688: Sat Aug 22 03:46:00 2026 write: IOPS=0, BW=4020KiB/s (4116kB/s)(12.0MiB/3057msec); 0 zone resets clat (msec): min=354, max=2135, avg=982.74, stdev=1000.08 lat (msec): min=354, max=2136, avg=983.06, stdev=1000.06 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 5688, max= 8192, per=92.89%, avg=6940.00, stdev=1770.60, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.86%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4414KiB/s (4520kB/s), 1103KiB/s-4483KiB/s (1130kB/s-4591kB/s), io=16.0MiB (16.8MB), run=2741-3712msec WRITE: bw=7471KiB/s (7650kB/s), 2207KiB/s-4020KiB/s (2260kB/s-4116kB/s), io=32.0MiB (33.6MB), run=3057-4386msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145683: Sat Aug 22 03:46:01 2026 read: IOPS=1, BW=4144KiB/s (4244kB/s)(12.0MiB/2965msec) clat (msec): min=894, max=962, avg=920.31, stdev=36.54 lat (msec): min=894, max=962, avg=920.32, stdev=36.54 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8015, max= 8192, per=100.00%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.07%, sys=5.33%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145686: Sat Aug 22 03:46:01 2026 read: IOPS=0, BW=888KiB/s (909kB/s)(4096KiB/4615msec) clat (nsec): min=2357.2M, max=2357.2M, avg=2357161077.00, stdev= 0.00 lat (nsec): min=2357.2M, max=2357.2M, avg=2357162066.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2366], 5.00th=[ 2366], 10.00th=[ 2366], 20.00th=[ 2366], | 30.00th=[ 2366], 40.00th=[ 2366], 50.00th=[ 2366], 60.00th=[ 2366], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1775KiB/s (1818kB/s)(8192KiB/4615msec); 0 zone resets clat (msec): min=757, max=1420, avg=1088.63, stdev=468.93 lat (msec): min=757, max=1420, avg=1089.15, stdev=468.80 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.84%, ctx=38, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145687: Sat Aug 22 03:46:01 2026 write: IOPS=0, BW=2630KiB/s (2693kB/s)(12.0MiB/4672msec); 0 zone resets clat (msec): min=382, max=2274, avg=1519.45, stdev=1002.14 lat (msec): min=382, max=2274, avg=1520.17, stdev=1002.33 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1905], 50.00th=[ 1905], 60.00th=[ 1905], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8015, max= 8094, per=100.00%, avg=8054.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.68%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145689: Sat Aug 22 03:46:01 2026 write: IOPS=0, BW=3386KiB/s (3467kB/s)(12.0MiB/3629msec); 0 zone resets clat (msec): min=355, max=2403, avg=1158.62, stdev=1092.77 lat (msec): min=355, max=2403, avg=1159.43, stdev=1092.51 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.42%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3550KiB/s (3635kB/s), 888KiB/s-4144KiB/s (909kB/s-4244kB/s), io=16.0MiB (16.8MB), run=2965-4615msec WRITE: bw=7014KiB/s (7182kB/s), 1775KiB/s-3386KiB/s (1818kB/s-3467kB/s), io=32.0MiB (33.6MB), run=3629-4672msec