== sanity test 398b: DIO and buffer IO race ============== 12:52:55 (1784047975) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.60286 s, 6.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145249: Tue Jul 14 12:56:21 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(5992KiB/184362msec) clat (usec): min=32, max=50657k, avg=77645.79, stdev=1308150.31 lat (usec): min=32, max=50657k, avg=77647.29, stdev=1308150.33 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 85], | 20.00th=[ 20055], 30.00th=[ 25822], 40.00th=[ 32113], | 50.00th=[ 37487], 60.00th=[ 44827], 70.00th=[ 53740], | 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[ 101188], | 99.00th=[ 162530], 99.50th=[ 193987], 99.90th=[ 541066], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 96, per=34.61%, avg=44.30, stdev=18.83, samples=263 iops : min= 1, max= 24, avg=10.47, stdev= 4.76, samples=263 write: IOPS=8, BW=34.1KiB/s (34.0kB/s)(6296KiB/184362msec); 0 zone resets clat (usec): min=1111, max=463280, avg=43149.84, stdev=44194.77 lat (usec): min=1113, max=463282, avg=43151.54, stdev=44194.75 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1385], 10.00th=[ 1778], 20.00th=[ 4752], | 30.00th=[ 9634], 40.00th=[ 20055], 50.00th=[ 32637], 60.00th=[ 43779], | 70.00th=[ 59507], 80.00th=[ 74974], 90.00th=[ 98042], 95.00th=[126354], | 99.00th=[183501], 99.50th=[214959], 99.90th=[379585], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 5, max= 103, per=35.06%, avg=46.98, stdev=19.78, samples=261 iops : min= 1, max= 25, avg=11.13, stdev= 4.97, samples=261 lat (usec) : 50=0.78%, 100=4.30%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.63%, 4=3.65%, 10=6.67%, 20=8.69%, 50=35.12% lat (msec) : 100=27.38%, 250=7.29%, 500=0.10%, 750=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.84%, ctx=6510, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145250: Tue Jul 14 12:56:21 2026 read: IOPS=7, BW=31.0KiB/s (32.8kB/s)(5940KiB/185652msec) clat (usec): min=32, max=736978, avg=43947.91, stdev=36658.94 lat (usec): min=32, max=736980, avg=43956.90, stdev=36656.31 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 701], 20.00th=[ 20841], | 30.00th=[ 26608], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[154141], 99.50th=[168821], 99.90th=[316670], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 5, max= 95, per=34.30%, avg=43.90, stdev=18.89, samples=264 iops : min= 1, max= 23, avg=10.36, stdev= 4.75, samples=264 write: IOPS=8, BW=34.2KiB/s (35.0kB/s)(6348KiB/185652msec); 0 zone resets clat (usec): min=1051, max=50738k, avg=75739.41, stdev=1273316.55 lat (usec): min=1052, max=50738k, avg=75745.85, stdev=1273316.60 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1401], 10.00th=[ 1876], | 20.00th=[ 5080], 30.00th=[ 10814], 40.00th=[ 20579], | 50.00th=[ 31851], 60.00th=[ 43779], 70.00th=[ 57934], | 80.00th=[ 74974], 90.00th=[ 101188], 95.00th=[ 128451], | 99.00th=[ 196084], 99.50th=[ 244319], 99.90th=[ 350225], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 5, max= 111, per=34.92%, avg=46.79, stdev=19.57, samples=265 iops : min= 1, max= 27, avg=11.08, stdev= 4.95, samples=265 lat (usec) : 50=0.55%, 100=3.71%, 250=0.49%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.50%, 4=2.90%, 10=7.03%, 20=9.21%, 50=36.49% lat (msec) : 100=26.20%, 250=7.49%, 500=0.23%, 750=0.03%, >=2000=0.03% cpu : usr=0.06%, sys=3.70%, ctx=6453, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145251: Tue Jul 14 12:56:21 2026 read: IOPS=8, BW=32.4KiB/s (33.1kB/s)(6028KiB/186299msec) clat (usec): min=36, max=50673k, avg=76792.38, stdev=1304611.67 lat (usec): min=37, max=50673k, avg=76795.77, stdev=1304611.61 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 570], | 20.00th=[ 21103], 30.00th=[ 26608], 40.00th=[ 32113], | 50.00th=[ 38011], 60.00th=[ 44827], 70.00th=[ 53740], | 80.00th=[ 65274], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[ 126354], 99.50th=[ 166724], 99.90th=[ 557843], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 111, per=34.47%, avg=44.12, stdev=19.89, samples=266 iops : min= 1, max= 27, avg=10.42, stdev= 5.02, samples=266 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6260KiB/186299msec); 0 zone resets clat (usec): min=1172, max=391491, avg=44983.82, stdev=47757.08 lat (usec): min=1173, max=391494, avg=44987.20, stdev=47758.78 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1401], 10.00th=[ 2073], 20.00th=[ 5342], | 30.00th=[ 9896], 40.00th=[ 19530], 50.00th=[ 33817], 60.00th=[ 46400], | 70.00th=[ 58459], 80.00th=[ 73925], 90.00th=[104334], 95.00th=[131597], | 99.00th=[231736], 99.50th=[265290], 99.90th=[367002], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 127, per=33.93%, avg=45.46, stdev=21.20, samples=268 iops : min= 1, max= 31, avg=10.76, stdev= 5.35, samples=268 lat (usec) : 50=0.59%, 100=3.91%, 250=0.26%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.01%, 4=3.39%, 10=7.16%, 20=9.05%, 50=35.32% lat (msec) : 100=27.25%, 250=7.39%, 500=0.36%, 750=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.72%, ctx=6440, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145252: Tue Jul 14 12:56:21 2026 read: IOPS=8, BW=32.8KiB/s (33.6kB/s)(6052KiB/184453msec) clat (usec): min=35, max=435197, avg=43063.64, stdev=33785.58 lat (usec): min=35, max=435198, avg=43066.64, stdev=33785.82 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 237], 20.00th=[ 20055], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 63701], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[152044], 99.50th=[170918], 99.90th=[354419], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 117, per=35.41%, avg=45.32, stdev=19.02, samples=260 iops : min= 1, max= 29, avg=10.72, stdev= 4.81, samples=260 write: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6236KiB/184453msec); 0 zone resets clat (usec): min=1144, max=50772k, avg=76413.14, stdev=1285574.20 lat (usec): min=1145, max=50772k, avg=76425.19, stdev=1285573.72 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1434], 10.00th=[ 2057], | 20.00th=[ 5407], 30.00th=[ 9896], 40.00th=[ 20317], | 50.00th=[ 32113], 60.00th=[ 43779], 70.00th=[ 57410], | 80.00th=[ 76022], 90.00th=[ 106431], 95.00th=[ 133694], | 99.00th=[ 187696], 99.50th=[ 221250], 99.90th=[ 471860], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 131, per=34.40%, avg=46.10, stdev=20.21, samples=263 iops : min= 1, max= 32, avg=10.90, stdev= 5.09, samples=263 lat (usec) : 50=0.39%, 100=3.84%, 250=0.72%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.98%, 4=3.52%, 10=7.13%, 20=9.34%, 50=37.04% lat (msec) : 100=24.41%, 250=8.27%, 500=0.20%, >=2000=0.03% cpu : usr=0.06%, sys=3.81%, ctx=6467, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (132kB/s), 31.0KiB/s-32.8KiB/s (32.8kB/s-33.6kB/s), io=23.4MiB (24.6MB), run=184362-186299msec WRITE: bw=135KiB/s (138kB/s), 33.6KiB/s-34.2KiB/s (34.4kB/s-35.0kB/s), io=24.6MiB (25.7MB), run=184362-186299msec fio: pid=145243, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145243: Tue Jul 14 12:58:56 2026 read: IOPS=3, BW=14.7KiB/s (15.0kB/s)(3876KiB/264074msec) clat (msec): min=6, max=1239, avg=47.09, stdev=57.88 lat (msec): min=6, max=1239, avg=47.09, stdev=57.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 103], 95.00th=[ 132], | 99.00th=[ 213], 99.50th=[ 271], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 78, per=33.60%, avg=21.17, stdev=14.85, samples=351 iops : min= 1, max= 19, avg= 4.64, stdev= 3.76, samples=351 write: IOPS=3, BW=15.5KiB/s (15.9kB/s)(4100KiB/264074msec); 0 zone resets clat (msec): min=37, max=50901, avg=212.73, stdev=1586.60 lat (msec): min=37, max=50901, avg=212.73, stdev=1586.60 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 100], | 30.00th=[ 114], 40.00th=[ 132], 50.00th=[ 153], 60.00th=[ 169], | 70.00th=[ 192], 80.00th=[ 222], 90.00th=[ 264], 95.00th=[ 296], | 99.00th=[ 401], 99.50th=[ 430], 99.90th=[ 735], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 47, per=28.33%, avg=18.98, stdev= 9.19, samples=412 iops : min= 1, max= 11, avg= 4.09, stdev= 2.35, samples=412 lat (msec) : 10=2.36%, 20=12.93%, 50=18.85%, 100=20.25%, 250=38.50% lat (msec) : 500=6.87%, 750=0.10%, 2000=0.05%, >=2000=0.05% cpu : usr=0.02%, sys=0.95%, ctx=3246, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=970,1025,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145244: Tue Jul 14 12:58:56 2026 read: IOPS=4, BW=17.4KiB/s (17.8kB/s)(5940KiB/342162msec) clat (msec): min=5, max=1027, avg=40.38, stdev=43.45 lat (msec): min=5, max=1027, avg=40.38, stdev=43.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 80], 95.00th=[ 105], | 99.00th=[ 205], 99.50th=[ 239], 99.90th=[ 368], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 87, per=37.04%, avg=23.33, stdev=15.62, samples=490 iops : min= 1, max= 21, avg= 5.21, stdev= 3.95, samples=490 write: IOPS=4, BW=18.6KiB/s (18.0kB/s)(6348KiB/342162msec); 0 zone resets clat (msec): min=39, max=50903, avg=177.54, stdev=1276.18 lat (msec): min=39, max=50903, avg=177.54, stdev=1276.18 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 199], 90.00th=[ 241], 95.00th=[ 284], | 99.00th=[ 376], 99.50th=[ 439], 99.90th=[ 558], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 48, per=32.03%, avg=21.46, stdev=10.11, samples=568 iops : min= 1, max= 12, avg= 4.73, stdev= 2.60, samples=568 lat (msec) : 10=2.05%, 20=11.69%, 50=24.25%, 100=23.57%, 250=33.82% lat (msec) : 500=4.43%, 750=0.13%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=1.13%, ctx=5789, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145245: Tue Jul 14 12:58:56 2026 read: IOPS=4, BW=17.7KiB/s (18.2kB/s)(6028KiB/339997msec) clat (msec): min=5, max=50392, avg=73.78, stdev=1297.55 lat (msec): min=5, max=50392, avg=73.79, stdev=1297.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 80], 95.00th=[ 111], | 99.00th=[ 178], 99.50th=[ 253], 99.90th=[ 380], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 87, per=36.82%, avg=23.20, stdev=15.65, samples=501 iops : min= 1, max= 21, avg= 5.17, stdev= 3.96, samples=501 write: IOPS=4, BW=18.4KiB/s (18.9kB/s)(6260KiB/339997msec); 0 zone resets clat (msec): min=29, max=1098, avg=145.94, stdev=72.78 lat (msec): min=29, max=1098, avg=145.94, stdev=72.79 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 116], 50.00th=[ 130], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 197], 90.00th=[ 239], 95.00th=[ 279], | 99.00th=[ 380], 99.50th=[ 409], 99.90th=[ 558], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 55, per=31.47%, avg=21.08, stdev= 9.90, samples=570 iops : min= 1, max= 13, avg= 4.64, stdev= 2.55, samples=570 lat (msec) : 10=1.89%, 20=12.17%, 50=23.96%, 100=22.72%, 250=34.86% lat (msec) : 500=4.30%, 750=0.03%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=1.18%, ctx=5765, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145246: Tue Jul 14 12:58:56 2026 read: IOPS=4, BW=17.8KiB/s (18.2kB/s)(6052KiB/339700msec) clat (msec): min=5, max=50550, avg=73.63, stdev=1299.09 lat (msec): min=5, max=50550, avg=73.63, stdev=1299.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 115], | 99.00th=[ 203], 99.50th=[ 251], 99.90th=[ 321], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 95, per=38.20%, avg=24.07, stdev=16.21, samples=485 iops : min= 1, max= 23, avg= 5.39, stdev= 4.10, samples=485 write: IOPS=4, BW=18.4KiB/s (18.8kB/s)(6236KiB/339700msec); 0 zone resets clat (msec): min=41, max=1161, avg=146.16, stdev=75.37 lat (msec): min=41, max=1161, avg=146.16, stdev=75.37 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 114], 50.00th=[ 129], 60.00th=[ 146], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 243], 95.00th=[ 284], | 99.00th=[ 380], 99.50th=[ 409], 99.90th=[ 743], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 48, per=31.50%, avg=21.10, stdev=10.14, samples=567 iops : min= 1, max= 12, avg= 4.64, stdev= 2.61, samples=567 lat (msec) : 10=2.44%, 20=11.95%, 50=24.38%, 100=22.49%, 250=33.89% lat (msec) : 500=4.72%, 750=0.07%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=1.16%, ctx=5836, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=63.0KiB/s (65.5kB/s), 14.7KiB/s-17.8KiB/s (15.0kB/s-18.2kB/s), io=21.4MiB (22.4MB), run=264074-342162msec WRITE: bw=67.1KiB/s (68.7kB/s), 15.5KiB/s-18.6KiB/s (15.9kB/s-18.0kB/s), io=22.4MiB (23.5MB), run=264074-342162msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145320: Tue Jul 14 12:59:35 2026 read: IOPS=14, BW=225KiB/s (231kB/s)(5920KiB/26267msec) clat (usec): min=29, max=152784, avg=34686.43, stdev=27930.34 lat (usec): min=29, max=152785, avg=34697.47, stdev=27918.73 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 94], | 30.00th=[ 20579], 40.00th=[ 26346], 50.00th=[ 32637], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[112722], 99.50th=[152044], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 93, max= 440, per=27.12%, avg=223.76, stdev=82.24, samples=51 iops : min= 5, max= 27, avg=13.27, stdev= 5.17, samples=51 write: IOPS=15, BW=242KiB/s (248kB/s)(6368KiB/26267msec); 0 zone resets clat (usec): min=1465, max=178207, avg=32716.11, stdev=33198.01 lat (usec): min=1467, max=178209, avg=32721.20, stdev=33198.92 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2024], 10.00th=[ 3228], 20.00th=[ 5800], | 30.00th=[ 8717], 40.00th=[ 13435], 50.00th=[ 22938], 60.00th=[ 32375], | 70.00th=[ 41681], 80.00th=[ 56361], 90.00th=[ 76022], 95.00th=[ 98042], | 99.00th=[156238], 99.50th=[168821], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 45, max= 476, per=28.02%, avg=243.20, stdev=85.78, samples=51 iops : min= 2, max= 29, avg=14.47, stdev= 5.37, samples=51 lat (usec) : 50=1.69%, 100=7.94%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=2.73%, 4=4.56%, 10=10.16%, 20=9.90%, 50=37.63% lat (msec) : 100=20.83%, 250=3.52% cpu : usr=0.08%, sys=7.22%, ctx=1506, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145322: Tue Jul 14 12:59:35 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(5744KiB/29025msec) clat (usec): min=35, max=141962, avg=35497.59, stdev=28928.64 lat (usec): min=36, max=141963, avg=35498.83, stdev=28928.68 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 81], | 30.00th=[ 19792], 40.00th=[ 25560], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 88605], | 99.00th=[112722], 99.50th=[141558], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 22, max= 502, per=24.42%, avg=201.47, stdev=108.76, samples=55 iops : min= 1, max= 31, avg=11.85, stdev= 6.83, samples=55 write: IOPS=14, BW=225KiB/s (231kB/s)(6544KiB/29025msec); 0 zone resets clat (usec): min=1539, max=285845, avg=38987.86, stdev=46195.38 lat (usec): min=1541, max=285847, avg=38997.21, stdev=46193.86 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2114], 10.00th=[ 3818], 20.00th=[ 6456], | 30.00th=[ 9241], 40.00th=[ 14484], 50.00th=[ 21365], 60.00th=[ 30540], | 70.00th=[ 46924], 80.00th=[ 65274], 90.00th=[ 94897], 95.00th=[132645], | 99.00th=[217056], 99.50th=[246416], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 63, max= 540, per=25.69%, avg=222.98, stdev=104.64, samples=56 iops : min= 3, max= 33, avg=13.21, stdev= 6.55, samples=56 lat (usec) : 50=1.30%, 100=8.72%, 250=0.52%, 500=0.13% lat (msec) : 2=2.34%, 4=3.65%, 10=10.94%, 20=12.37%, 50=32.55% lat (msec) : 100=21.48%, 250=5.73%, 500=0.26% cpu : usr=0.09%, sys=6.24%, ctx=1566, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145324: Tue Jul 14 12:59:35 2026 read: IOPS=14, BW=238KiB/s (244kB/s)(6256KiB/26250msec) clat (usec): min=40, max=343625, avg=36551.01, stdev=33079.21 lat (usec): min=40, max=343627, avg=36552.31, stdev=33079.24 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 260], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 32637], 60.00th=[ 39060], | 70.00th=[ 45351], 80.00th=[ 55837], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[122160], 99.50th=[252707], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 61, max= 502, per=28.99%, avg=239.14, stdev=87.88, samples=51 iops : min= 3, max= 31, avg=14.24, stdev= 5.54, samples=51 write: IOPS=14, BW=230KiB/s (235kB/s)(6032KiB/26250msec); 0 zone resets clat (usec): min=1438, max=244293, avg=31432.47, stdev=33606.61 lat (usec): min=1439, max=244294, avg=31453.39, stdev=33596.37 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2008], 10.00th=[ 3130], 20.00th=[ 5145], | 30.00th=[ 8029], 40.00th=[ 12518], 50.00th=[ 21365], 60.00th=[ 27919], | 70.00th=[ 38536], 80.00th=[ 54789], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[147850], 99.50th=[212861], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 31, max= 446, per=26.16%, avg=227.06, stdev=93.37, samples=51 iops : min= 1, max= 27, avg=13.47, stdev= 5.87, samples=51 lat (usec) : 50=1.04%, 100=8.46%, 250=0.65%, 500=0.13%, 750=0.26% lat (msec) : 2=2.34%, 4=5.34%, 10=9.90%, 20=9.11%, 50=38.67% lat (msec) : 100=20.57%, 250=3.26%, 500=0.26% cpu : usr=0.06%, sys=7.03%, ctx=1531, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145325: Tue Jul 14 12:59:35 2026 read: IOPS=14, BW=231KiB/s (237kB/s)(6032KiB/26096msec) clat (usec): min=35, max=215853, avg=36501.29, stdev=30875.07 lat (usec): min=35, max=215854, avg=36504.80, stdev=30874.63 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 109], | 30.00th=[ 22414], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 45876], 80.00th=[ 54264], 90.00th=[ 68682], 95.00th=[ 90702], | 99.00th=[149947], 99.50th=[204473], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 63, max= 604, per=28.07%, avg=231.57, stdev=90.76, samples=51 iops : min= 3, max= 37, avg=13.76, stdev= 5.71, samples=51 write: IOPS=14, BW=240KiB/s (245kB/s)(6256KiB/26096msec); 0 zone resets clat (usec): min=1602, max=186931, avg=30931.32, stdev=31192.51 lat (usec): min=1604, max=186933, avg=30933.96, stdev=31192.23 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2008], 10.00th=[ 2868], 20.00th=[ 5342], | 30.00th=[ 8291], 40.00th=[ 13435], 50.00th=[ 21365], 60.00th=[ 27919], | 70.00th=[ 38536], 80.00th=[ 51119], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[145753], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 61, max= 508, per=27.71%, avg=240.53, stdev=83.09, samples=51 iops : min= 3, max= 31, avg=14.29, stdev= 5.22, samples=51 lat (usec) : 50=1.17%, 100=8.46%, 250=0.52% lat (msec) : 2=2.60%, 4=5.21%, 10=10.16%, 20=8.85%, 50=40.62% lat (msec) : 100=18.75%, 250=3.65% cpu : usr=0.05%, sys=6.82%, ctx=1468, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=825KiB/s (845kB/s), 198KiB/s-238KiB/s (203kB/s-244kB/s), io=23.4MiB (24.5MB), run=26096-29025msec WRITE: bw=868KiB/s (889kB/s), 225KiB/s-242KiB/s (231kB/s-248kB/s), io=24.6MiB (25.8MB), run=26096-29025msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145318: Tue Jul 14 13:00:15 2026 read: IOPS=5, BW=85.8KiB/s (87.9kB/s)(5920KiB/68996msec) clat (msec): min=7, max=224, avg=38.12, stdev=32.01 lat (msec): min=7, max=224, avg=38.12, stdev=32.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 77], 95.00th=[ 114], | 99.00th=[ 161], 99.50th=[ 178], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 30, max= 287, per=27.35%, avg=94.37, stdev=55.56, samples=123 iops : min= 1, max= 17, avg= 5.09, stdev= 3.51, samples=123 write: IOPS=5, BW=92.3KiB/s (94.5kB/s)(6368KiB/68996msec); 0 zone resets clat (msec): min=29, max=397, avg=137.51, stdev=50.57 lat (msec): min=29, max=397, avg=137.52, stdev=50.57 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 69], 10.00th=[ 78], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 146], | 70.00th=[ 161], 80.00th=[ 176], 90.00th=[ 203], 95.00th=[ 230], | 99.00th=[ 288], 99.50th=[ 338], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 160, per=25.34%, avg=91.74, stdev=33.54, samples=136 iops : min= 1, max= 10, avg= 4.92, stdev= 2.18, samples=136 lat (msec) : 10=2.34%, 20=12.50%, 50=23.44%, 100=19.01%, 250=41.41% lat (msec) : 500=1.30% cpu : usr=0.03%, sys=1.55%, ctx=1329, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145319: Tue Jul 14 13:00:15 2026 read: IOPS=5, BW=82.7KiB/s (84.7kB/s)(5744KiB/69425msec) clat (msec): min=5, max=224, avg=36.07, stdev=29.76 lat (msec): min=5, max=224, avg=36.07, stdev=29.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 74], 95.00th=[ 96], | 99.00th=[ 171], 99.50th=[ 209], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 30, max= 319, per=27.07%, avg=93.38, stdev=58.25, samples=120 iops : min= 1, max= 19, avg= 5.02, stdev= 3.69, samples=120 write: IOPS=5, BW=94.3KiB/s (96.5kB/s)(6544KiB/69425msec); 0 zone resets clat (msec): min=47, max=368, avg=137.70, stdev=53.26 lat (msec): min=47, max=368, avg=137.71, stdev=53.26 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 91], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 132], 60.00th=[ 146], | 70.00th=[ 161], 80.00th=[ 182], 90.00th=[ 205], 95.00th=[ 230], | 99.00th=[ 296], 99.50th=[ 321], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 191, per=25.96%, avg=93.99, stdev=35.09, samples=136 iops : min= 1, max= 11, avg= 5.07, stdev= 2.27, samples=136 lat (msec) : 10=1.43%, 20=14.32%, 50=23.44%, 100=20.05%, 250=38.80% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.42%, ctx=1313, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145321: Tue Jul 14 13:00:15 2026 read: IOPS=5, BW=93.6KiB/s (95.8kB/s)(6256KiB/66853msec) clat (msec): min=7, max=329, avg=37.41, stdev=35.33 lat (msec): min=7, max=329, avg=37.41, stdev=35.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 49], 90.00th=[ 80], 95.00th=[ 106], | 99.00th=[ 205], 99.50th=[ 236], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 316, per=29.35%, avg=101.27, stdev=63.81, samples=122 iops : min= 1, max= 19, avg= 5.52, stdev= 4.02, samples=122 write: IOPS=5, BW=90.2KiB/s (92.4kB/s)(6032KiB/66853msec); 0 zone resets clat (msec): min=36, max=354, avg=137.41, stdev=55.17 lat (msec): min=36, max=354, avg=137.41, stdev=55.17 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 80], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 116], 50.00th=[ 129], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 174], 90.00th=[ 211], 95.00th=[ 255], | 99.00th=[ 338], 99.50th=[ 351], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 190, per=24.95%, avg=90.31, stdev=33.95, samples=131 iops : min= 1, max= 11, avg= 4.82, stdev= 2.16, samples=131 lat (msec) : 10=1.95%, 20=14.84%, 50=24.61%, 100=20.83%, 250=35.16% lat (msec) : 500=2.60% cpu : usr=0.05%, sys=1.44%, ctx=1305, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145323: Tue Jul 14 13:00:15 2026 read: IOPS=5, BW=89.0KiB/s (91.2kB/s)(6032KiB/67755msec) clat (msec): min=6, max=331, avg=35.87, stdev=32.25 lat (msec): min=6, max=331, avg=35.87, stdev=32.25 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 71], 95.00th=[ 91], | 99.00th=[ 176], 99.50th=[ 205], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 288, per=29.67%, avg=102.37, stdev=57.78, samples=115 iops : min= 1, max= 18, avg= 5.60, stdev= 3.68, samples=115 write: IOPS=5, BW=92.3KiB/s (94.5kB/s)(6256KiB/67755msec); 0 zone resets clat (msec): min=31, max=387, avg=138.57, stdev=55.61 lat (msec): min=31, max=387, avg=138.57, stdev=55.61 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 106], 40.00th=[ 120], 50.00th=[ 132], 60.00th=[ 142], | 70.00th=[ 155], 80.00th=[ 174], 90.00th=[ 209], 95.00th=[ 255], | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 30, max= 190, per=25.37%, avg=91.84, stdev=32.87, samples=134 iops : min= 1, max= 11, avg= 4.93, stdev= 2.13, samples=134 lat (msec) : 10=1.82%, 20=13.41%, 50=24.48%, 100=21.09%, 250=36.46% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.46%, ctx=1308, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=345KiB/s (353kB/s), 82.7KiB/s-93.6KiB/s (84.7kB/s-95.8kB/s), io=23.4MiB (24.5MB), run=66853-69425msec WRITE: bw=363KiB/s (372kB/s), 90.2KiB/s-94.3KiB/s (92.4kB/s-96.5kB/s), io=24.6MiB (25.8MB), run=66853-69425msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145350: Tue Jul 14 13:00:34 2026 read: IOPS=1, BW=1482KiB/s (1517kB/s)(7168KiB/4837msec) clat (msec): min=146, max=1646, avg=452.86, stdev=530.98 lat (msec): min=146, max=1646, avg=452.86, stdev=530.98 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 194], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 292], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 355], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1570, max= 4023, per=67.52%, avg=2320.60, stdev=970.16, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1059KiB/s (1084kB/s)(5120KiB/4837msec); 0 zone resets clat (msec): min=168, max=700, avg=324.25, stdev=216.00 lat (msec): min=168, max=700, avg=324.34, stdev=216.00 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1976, max= 4071, per=52.37%, avg=2520.25, stdev=1034.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.71%, ctx=482, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145351: Tue Jul 14 13:00:34 2026 read: IOPS=0, BW=344KiB/s (352kB/s)(2048KiB/5958msec) clat (msec): min=15, max=239, avg=127.38, stdev=158.87 lat (msec): min=15, max=239, avg=127.38, stdev=158.87 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 16], 10.00th=[ 16], 20.00th=[ 16], | 30.00th=[ 16], 40.00th=[ 16], 50.00th=[ 16], 60.00th=[ 241], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 1542, max= 2003, per=51.57%, avg=1772.50, stdev=325.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1719KiB/s (1760kB/s)(10.0MiB/5958msec); 0 zone resets clat (msec): min=126, max=2006, avg=558.85, stdev=701.20 lat (msec): min=126, max=2006, avg=558.96, stdev=701.19 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 148], | 30.00th=[ 178], 40.00th=[ 209], 50.00th=[ 234], 60.00th=[ 279], | 70.00th=[ 296], 80.00th=[ 363], 90.00th=[ 1754], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 2027, max= 6023, per=93.21%, avg=4485.50, stdev=1879.33, samples=4 iops : min= 1, max= 5, avg= 3.50, stdev= 1.91, samples=4 lat (msec) : 20=8.33%, 250=50.00%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=9.08%, ctx=169, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145352: Tue Jul 14 13:00:34 2026 read: IOPS=1, BW=1394KiB/s (1427kB/s)(6144KiB/4408msec) clat (usec): min=677, max=353428, avg=131652.25, stdev=136430.63 lat (usec): min=679, max=353430, avg=131653.88, stdev=136430.58 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 1909], | 30.00th=[ 1909], 40.00th=[ 66847], 50.00th=[ 66847], 60.00th=[173016], | 70.00th=[193987], 80.00th=[193987], 90.00th=[354419], 95.00th=[354419], | 99.00th=[354419], 99.50th=[354419], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 2035, max= 6023, per=97.96%, avg=3367.00, stdev=2300.17, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1394KiB/s (1427kB/s)(6144KiB/4408msec); 0 zone resets clat (msec): min=121, max=1805, avg=585.80, stdev=617.88 lat (msec): min=121, max=1805, avg=585.91, stdev=617.87 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 498], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 2043, max= 4071, per=70.16%, avg=3376.33, stdev=1155.04, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=7.26%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145353: Tue Jul 14 13:00:34 2026 read: IOPS=1, BW=1129KiB/s (1156kB/s)(5120KiB/4534msec) clat (usec): min=692, max=543322, avg=218162.70, stdev=228692.85 lat (usec): min=693, max=543322, avg=218163.90, stdev=228692.61 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 906], 40.00th=[ 906], 50.00th=[233833], 60.00th=[233833], | 70.00th=[312476], 80.00th=[312476], 90.00th=[541066], 95.00th=[541066], | 99.00th=[541066], 99.50th=[541066], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 2007, max= 4071, per=78.76%, avg=2707.00, stdev=1181.40, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1581KiB/s (1619kB/s)(7168KiB/4534msec); 0 zone resets clat (msec): min=145, max=1637, avg=477.95, stdev=537.10 lat (msec): min=145, max=1637, avg=478.14, stdev=537.07 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 165], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 228], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 617], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 2007, max= 4055, per=52.64%, avg=2533.00, stdev=1014.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=10.92%, ctx=151, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3437KiB/s (3520kB/s), 344KiB/s-1482KiB/s (352kB/s-1517kB/s), io=20.0MiB (20.0MB), run=4408-5958msec WRITE: bw=4812KiB/s (4928kB/s), 1059KiB/s-1719KiB/s (1084kB/s-1760kB/s), io=28.0MiB (29.4MB), run=4408-5958msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145355: Tue Jul 14 13:00:35 2026 read: IOPS=0, BW=1023KiB/s (1047kB/s)(7168KiB/7010msec) clat (msec): min=54, max=2635, avg=803.08, stdev=941.64 lat (msec): min=54, max=2635, avg=803.09, stdev=941.64 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 159], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 481], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 1519], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1965, max= 2043, per=69.20%, avg=2021.33, stdev=29.78, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=730KiB/s (748kB/s)(5120KiB/7010msec); 0 zone resets clat (msec): min=167, max=361, avg=263.68, stdev=76.40 lat (msec): min=167, max=361, avg=263.77, stdev=76.40 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2039, max= 4039, per=66.19%, avg=2707.00, stdev=1153.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.60%, ctx=50, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145356: Tue Jul 14 13:00:35 2026 read: IOPS=0, BW=305KiB/s (312kB/s)(2048KiB/6712msec) clat (msec): min=137, max=472, avg=305.41, stdev=236.82 lat (msec): min=137, max=472, avg=305.41, stdev=236.82 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2043, max= 2048, per=70.03%, avg=2045.50, stdev= 3.54, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1526KiB/s (1562kB/s)(10.0MiB/6712msec); 0 zone resets clat (msec): min=166, max=2055, avg=601.58, stdev=563.53 lat (msec): min=166, max=2056, avg=601.69, stdev=563.62 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 197], | 30.00th=[ 243], 40.00th=[ 321], 50.00th=[ 368], 60.00th=[ 477], | 70.00th=[ 558], 80.00th=[ 726], 90.00th=[ 902], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 2000, max= 6083, per=73.90%, avg=3022.67, stdev=1691.32, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.83%, ctx=103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145357: Tue Jul 14 13:00:35 2026 read: IOPS=0, BW=942KiB/s (965kB/s)(6144KiB/6523msec) clat (msec): min=95, max=404, avg=205.18, stdev=106.08 lat (msec): min=95, max=404, avg=205.18, stdev=106.08 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 199], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2027, max= 4031, per=100.00%, avg=3319.33, stdev=1121.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=942KiB/s (965kB/s)(6144KiB/6523msec); 0 zone resets clat (msec): min=160, max=3133, avg=863.96, stdev=1126.82 lat (msec): min=160, max=3133, avg=864.28, stdev=1126.69 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 600], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1950, max= 4096, per=61.50%, avg=2515.25, stdev=1054.30, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.03%, sys=2.22%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145358: Tue Jul 14 13:00:35 2026 read: IOPS=0, BW=747KiB/s (765kB/s)(5120KiB/6850msec) clat (msec): min=128, max=509, avg=321.35, stdev=171.05 lat (msec): min=128, max=509, avg=321.35, stdev=171.05 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1965, max= 2043, per=68.86%, avg=2011.50, stdev=33.00, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1046KiB/s (1072kB/s)(7168KiB/6850msec); 0 zone resets clat (msec): min=198, max=2369, avg=741.20, stdev=773.57 lat (msec): min=198, max=2369, avg=741.30, stdev=773.58 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 215], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 472], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 944], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1946, max= 4039, per=59.24%, avg=2423.00, stdev=904.36, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.48%, ctx=106, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2922KiB/s (2992kB/s), 305KiB/s-1023KiB/s (312kB/s-1047kB/s), io=20.0MiB (20.0MB), run=6523-7010msec WRITE: bw=4090KiB/s (4188kB/s), 730KiB/s-1526KiB/s (748kB/s-1562kB/s), io=28.0MiB (29.4MB), run=6523-7010msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145365: Tue Jul 14 13:00:50 2026 read: IOPS=0, BW=4004KiB/s (4100kB/s)(12.0MiB/3069msec) clat (msec): min=904, max=1171, avg=1003.55, stdev=146.47 lat (msec): min=904, max=1171, avg=1003.55, stdev=146.47 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8062, max= 8175, per=100.00%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.10%, ctx=286, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145366: Tue Jul 14 13:00:50 2026 read: IOPS=0, BW=1215KiB/s (1245kB/s)(4096KiB/3370msec) clat (nsec): min=870335k, max=870335k, avg=870334614.00, stdev= 0.00 lat (nsec): min=870337k, max=870337k, avg=870336892.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2431KiB/s (2489kB/s)(8192KiB/3370msec); 0 zone resets clat (msec): min=524, max=1887, avg=1205.63, stdev=963.72 lat (msec): min=524, max=1887, avg=1206.12, stdev=963.58 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 1888], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8126, max= 8126, per=83.58%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.92%, ctx=251, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145367: Tue Jul 14 13:00:50 2026 write: IOPS=1, BW=5274KiB/s (5400kB/s)(12.0MiB/2330msec); 0 zone resets clat (msec): min=535, max=1003, avg=754.78, stdev=235.64 lat (msec): min=539, max=1004, avg=756.99, stdev=234.07 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8000, max= 8062, per=82.60%, avg=8031.00, stdev=43.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.13%, sys=4.64%, ctx=38, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145368: Tue Jul 14 13:00:50 2026 write: IOPS=1, BW=4688KiB/s (4801kB/s)(12.0MiB/2621msec); 0 zone resets clat (msec): min=347, max=1579, avg=857.78, stdev=642.98 lat (msec): min=347, max=1581, avg=859.20, stdev=643.74 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7984, max= 8192, per=83.18%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.53%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4862KiB/s (4978kB/s), 1215KiB/s-4004KiB/s (1245kB/s-4100kB/s), io=16.0MiB (16.8MB), run=3069-3370msec WRITE: bw=9723KiB/s (9957kB/s), 2431KiB/s-5274KiB/s (2489kB/s-5400kB/s), io=32.0MiB (33.6MB), run=2330-3370msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145370: Tue Jul 14 13:00:51 2026 read: IOPS=1, BW=4417KiB/s (4523kB/s)(12.0MiB/2782msec) clat (msec): min=273, max=1453, avg=870.67, stdev=590.38 lat (msec): min=273, max=1453, avg=870.67, stdev=590.38 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 6390, max= 8143, per=100.00%, avg=7266.50, stdev=1239.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.06%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145371: Tue Jul 14 13:00:51 2026 read: IOPS=0, BW=1256KiB/s (1286kB/s)(4096KiB/3261msec) clat (nsec): min=984676k, max=984676k, avg=984675835.00, stdev= 0.00 lat (nsec): min=984678k, max=984678k, avg=984678035.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2512KiB/s (2572kB/s)(8192KiB/3261msec); 0 zone resets clat (msec): min=1064, max=1208, avg=1136.21, stdev=101.92 lat (msec): min=1065, max=1208, avg=1136.87, stdev=101.44 clat percentiles (msec): | 1.00th=[ 1062], 5.00th=[ 1062], 10.00th=[ 1062], 20.00th=[ 1062], | 30.00th=[ 1062], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8143, max= 8143, per=83.63%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.69%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145372: Tue Jul 14 13:00:51 2026 write: IOPS=0, BW=3652KiB/s (3739kB/s)(12.0MiB/3365msec); 0 zone resets clat (msec): min=355, max=2169, avg=1086.36, stdev=956.93 lat (msec): min=355, max=2170, avg=1087.09, stdev=957.20 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8047, max= 8175, per=83.30%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.89%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145373: Tue Jul 14 13:00:51 2026 write: IOPS=0, BW=4055KiB/s (4153kB/s)(12.0MiB/3030msec); 0 zone resets clat (msec): min=309, max=1905, avg=978.12, stdev=828.76 lat (msec): min=316, max=1905, avg=980.70, stdev=826.17 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8047, max= 8047, per=82.64%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.71%, ctx=31, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5024KiB/s (5145kB/s), 1256KiB/s-4417KiB/s (1286kB/s-4523kB/s), io=16.0MiB (16.8MB), run=2782-3261msec WRITE: bw=9738KiB/s (9972kB/s), 2512KiB/s-4055KiB/s (2572kB/s-4153kB/s), io=32.0MiB (33.6MB), run=3030-3365msec