== sanity test 398b: DIO and buffer IO race ============== 22:15:26 (1787796926) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.56706 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144591: Wed Aug 26 22:17:52 2026 read: IOPS=12, BW=48.8KiB/s (49.0kB/s)(5992KiB/122802msec) clat (usec): min=36, max=977051, avg=39307.81, stdev=37334.20 lat (usec): min=36, max=977052, avg=39314.75, stdev=37331.17 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 97], 20.00th=[ 17695], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 48497], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[126354], 99.50th=[143655], 99.90th=[202376], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 127, per=25.57%, avg=48.59, stdev=21.85, samples=240 iops : min= 1, max= 31, avg=11.50, stdev= 5.49, samples=240 write: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6296KiB/122802msec); 0 zone resets clat (usec): min=896, max=476447, avg=40309.44, stdev=42139.61 lat (usec): min=898, max=476448, avg=40311.28, stdev=42139.50 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1762], 20.00th=[ 4113], | 30.00th=[ 8029], 40.00th=[ 19530], 50.00th=[ 30016], 60.00th=[ 42206], | 70.00th=[ 53740], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[115868], | 99.00th=[160433], 99.50th=[204473], 99.90th=[371196], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 134, per=25.70%, avg=51.14, stdev=21.89, samples=240 iops : min= 1, max= 33, avg=12.13, stdev= 5.51, samples=240 lat (usec) : 50=0.49%, 100=4.49%, 250=0.23%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.96%, 4=4.17%, 10=7.19%, 20=10.35%, 50=36.46% lat (msec) : 100=24.48%, 250=5.73%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=4.99%, ctx=6520, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144592: Wed Aug 26 22:17:52 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(5940KiB/124421msec) clat (usec): min=34, max=923338, avg=39857.13, stdev=38572.54 lat (usec): min=34, max=923338, avg=39866.20, stdev=38589.33 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 167], 20.00th=[ 17171], | 30.00th=[ 23200], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 47973], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[149947], 99.50th=[164627], 99.90th=[375391], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 118, per=24.93%, avg=47.37, stdev=21.02, samples=245 iops : min= 1, max= 29, avg=11.19, stdev= 5.30, samples=245 write: IOPS=12, BW=51.0KiB/s (52.2kB/s)(6348KiB/124421msec); 0 zone resets clat (usec): min=1033, max=365260, avg=40816.96, stdev=42265.65 lat (usec): min=1033, max=365262, avg=40822.93, stdev=42264.57 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1237], 10.00th=[ 1565], 20.00th=[ 3818], | 30.00th=[ 8225], 40.00th=[ 19006], 50.00th=[ 30540], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[120062], | 99.00th=[187696], 99.50th=[217056], 99.90th=[291505], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 166, per=25.47%, avg=50.69, stdev=23.20, samples=245 iops : min= 1, max= 41, avg=12.02, stdev= 5.84, samples=245 lat (usec) : 50=0.59%, 100=3.94%, 250=0.36%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=6.67%, 4=4.23%, 10=6.61%, 20=10.45%, 50=36.65% lat (msec) : 100=24.06%, 250=6.02%, 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=4.74%, ctx=6467, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144593: Wed Aug 26 22:17:52 2026 read: IOPS=11, BW=47.9KiB/s (49.0kB/s)(6028KiB/125927msec) clat (usec): min=31, max=924523, avg=40948.37, stdev=38894.47 lat (usec): min=31, max=924524, avg=40950.83, stdev=38893.85 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 151], 20.00th=[ 18220], | 30.00th=[ 22938], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 98042], | 99.00th=[162530], 99.50th=[183501], 99.90th=[299893], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=47.52, stdev=22.11, samples=248 iops : min= 1, max= 27, avg=11.22, stdev= 5.54, samples=248 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6260KiB/125927msec); 0 zone resets clat (usec): min=997, max=405709, avg=40767.95, stdev=43023.94 lat (usec): min=998, max=405710, avg=40773.06, stdev=43021.44 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1582], 20.00th=[ 3589], | 30.00th=[ 8160], 40.00th=[ 19006], 50.00th=[ 30802], 60.00th=[ 42206], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[122160], | 99.00th=[187696], 99.50th=[214959], 99.90th=[333448], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 127, per=24.87%, avg=49.49, stdev=21.96, samples=247 iops : min= 1, max= 31, avg=11.71, stdev= 5.51, samples=247 lat (usec) : 50=0.49%, 100=4.00%, 250=0.52%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.28%, 4=4.49%, 10=5.73%, 20=10.55%, 50=36.75% lat (msec) : 100=24.48%, 250=6.41%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=5.11%, ctx=6562, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144594: Wed Aug 26 22:17:52 2026 read: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6052KiB/125052msec) clat (usec): min=32, max=216714, avg=38177.56, stdev=28609.22 lat (usec): min=33, max=216716, avg=38180.62, stdev=28609.42 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 117], 20.00th=[ 17433], | 30.00th=[ 22676], 40.00th=[ 27657], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[135267], 99.50th=[158335], 99.90th=[200279], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 111, per=25.62%, avg=48.69, stdev=21.42, samples=243 iops : min= 1, max= 27, avg=11.52, stdev= 5.40, samples=243 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6236KiB/125052msec); 0 zone resets clat (usec): min=1014, max=918498, avg=42867.13, stdev=50164.10 lat (usec): min=1015, max=918499, avg=42874.30, stdev=50167.49 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1254], 10.00th=[ 1696], 20.00th=[ 4359], | 30.00th=[ 8291], 40.00th=[ 18482], 50.00th=[ 29754], 60.00th=[ 42730], | 70.00th=[ 55837], 80.00th=[ 71828], 90.00th=[100140], 95.00th=[126354], | 99.00th=[200279], 99.50th=[244319], 99.90th=[312476], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 119, per=24.76%, avg=49.27, stdev=21.57, samples=247 iops : min= 1, max= 29, avg=11.66, stdev= 5.40, samples=247 lat (usec) : 50=0.72%, 100=3.97%, 250=0.65%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.15%, 4=3.29%, 10=7.26%, 20=11.36%, 50=36.13% lat (msec) : 100=23.67%, 250=6.48%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=4.90%, ctx=6502, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=191KiB/s (195kB/s), 47.7KiB/s-48.8KiB/s (48.9kB/s-49.0kB/s), io=23.4MiB (24.6MB), run=122802-125927msec WRITE: bw=200KiB/s (204kB/s), 49.7KiB/s-51.3KiB/s (50.9kB/s-52.5kB/s), io=24.6MiB (25.7MB), run=122802-125927msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144596: Wed Aug 26 22:20:15 2026 read: IOPS=5, BW=22.4KiB/s (22.9kB/s)(5992KiB/267889msec) clat (msec): min=5, max=999, avg=34.35, stdev=43.07 lat (msec): min=5, max=999, avg=34.35, stdev=43.07 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 99], | 99.00th=[ 167], 99.50th=[ 226], 99.90th=[ 397], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 95, per=28.13%, avg=25.03, stdev=16.87, samples=461 iops : min= 1, max= 23, avg= 5.60, stdev= 4.23, samples=461 write: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6296KiB/267889msec); 0 zone resets clat (msec): min=36, max=508, avg=137.41, stdev=60.49 lat (msec): min=36, max=508, avg=137.41, stdev=60.49 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 218], 95.00th=[ 251], | 99.00th=[ 321], 99.50th=[ 393], 99.90th=[ 481], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 55, per=24.80%, avg=23.06, stdev= 9.91, samples=524 iops : min= 1, max= 13, avg= 5.11, stdev= 2.53, samples=524 lat (msec) : 10=3.22%, 20=18.03%, 50=19.66%, 100=20.80%, 250=35.48% lat (msec) : 500=2.73%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5163, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144597: Wed Aug 26 22:20:15 2026 read: IOPS=5, BW=22.2KiB/s (22.8kB/s)(5940KiB/267201msec) clat (msec): min=5, max=1084, avg=33.50, stdev=43.75 lat (msec): min=5, max=1084, avg=33.50, stdev=43.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 93], | 99.00th=[ 144], 99.50th=[ 184], 99.90th=[ 550], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 111, per=28.45%, avg=25.32, stdev=16.93, samples=453 iops : min= 1, max= 27, avg= 5.68, stdev= 4.26, samples=453 write: IOPS=5, BW=23.8KiB/s (24.3kB/s)(6348KiB/267201msec); 0 zone resets clat (msec): min=39, max=520, avg=136.93, stdev=63.71 lat (msec): min=39, max=520, avg=136.93, stdev=63.71 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 222], 95.00th=[ 266], | 99.00th=[ 342], 99.50th=[ 405], 99.90th=[ 502], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 55, per=25.18%, avg=23.42, stdev= 9.81, samples=522 iops : min= 1, max= 13, avg= 5.20, stdev= 2.49, samples=522 lat (msec) : 10=3.42%, 20=17.84%, 50=19.43%, 100=21.91%, 250=33.79% lat (msec) : 500=3.48%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.06%, ctx=4986, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144598: Wed Aug 26 22:20:15 2026 read: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6028KiB/268237msec) clat (msec): min=5, max=543, avg=35.35, stdev=39.91 lat (msec): min=5, max=543, avg=35.36, stdev=39.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 74], 95.00th=[ 107], | 99.00th=[ 174], 99.50th=[ 226], 99.90th=[ 409], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 96, per=27.73%, avg=24.68, stdev=15.88, samples=471 iops : min= 1, max= 24, avg= 5.52, stdev= 4.01, samples=471 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6260KiB/268237msec); 0 zone resets clat (msec): min=33, max=1283, avg=137.27, stdev=67.50 lat (msec): min=33, max=1283, avg=137.27, stdev=67.50 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 213], 95.00th=[ 255], | 99.00th=[ 330], 99.50th=[ 393], 99.90th=[ 550], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 48, per=24.90%, avg=23.16, stdev=10.20, samples=520 iops : min= 1, max= 12, avg= 5.14, stdev= 2.59, samples=520 lat (msec) : 10=3.42%, 20=18.03%, 50=18.91%, 100=21.84%, 250=34.80% lat (msec) : 500=2.90%, 750=0.07%, 2000=0.03% cpu : usr=0.03%, sys=1.06%, ctx=4994, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144599: Wed Aug 26 22:20:15 2026 read: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6052KiB/267152msec) clat (msec): min=5, max=335, avg=33.94, stdev=35.18 lat (msec): min=5, max=335, avg=33.94, stdev=35.18 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 73], 95.00th=[ 103], | 99.00th=[ 169], 99.50th=[ 230], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 119, per=28.43%, avg=25.31, stdev=17.45, samples=462 iops : min= 1, max= 29, avg= 5.68, stdev= 4.40, samples=462 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6236KiB/267152msec); 0 zone resets clat (msec): min=35, max=1197, avg=138.34, stdev=68.20 lat (msec): min=35, max=1197, avg=138.34, stdev=68.20 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 226], 95.00th=[ 259], | 99.00th=[ 347], 99.50th=[ 405], 99.90th=[ 506], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 48, per=24.76%, avg=23.03, stdev= 9.92, samples=521 iops : min= 1, max= 12, avg= 5.10, stdev= 2.53, samples=521 lat (msec) : 10=3.55%, 20=18.49%, 50=18.68%, 100=22.66%, 250=33.43% lat (msec) : 500=3.12%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5022, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.5KiB/s (91.7kB/s), 22.2KiB/s-22.7KiB/s (22.8kB/s-23.2kB/s), io=23.4MiB (24.6MB), run=267152-268237msec WRITE: bw=93.7KiB/s (95.0kB/s), 23.3KiB/s-23.8KiB/s (23.9kB/s-24.3kB/s), io=24.6MiB (25.7MB), run=267152-268237msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144653: Wed Aug 26 22:20:52 2026 read: IOPS=14, BW=236KiB/s (241kB/s)(5920KiB/25119msec) clat (usec): min=35, max=208328, avg=34722.62, stdev=32514.57 lat (usec): min=35, max=208330, avg=34724.26, stdev=32514.40 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 73], | 30.00th=[ 15926], 40.00th=[ 24773], 50.00th=[ 30016], 60.00th=[ 36439], | 70.00th=[ 45351], 80.00th=[ 55837], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[154141], 99.50th=[193987], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 93, max= 512, per=25.09%, avg=235.37, stdev=91.16, samples=49 iops : min= 5, max= 32, avg=14.06, stdev= 5.75, samples=49 write: IOPS=15, BW=254KiB/s (260kB/s)(6368KiB/25119msec); 0 zone resets clat (usec): min=1345, max=201185, avg=30045.33, stdev=31765.06 lat (usec): min=1346, max=201185, avg=30047.61, stdev=31765.01 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1729], 10.00th=[ 2212], 20.00th=[ 4490], | 30.00th=[ 7570], 40.00th=[ 10945], 50.00th=[ 18220], 60.00th=[ 28443], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 72877], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[164627], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 63, max= 440, per=25.81%, avg=254.76, stdev=90.29, samples=49 iops : min= 3, max= 27, avg=15.29, stdev= 5.76, samples=49 lat (usec) : 50=1.30%, 100=10.29%, 250=0.65%, 1000=0.13% lat (msec) : 2=4.43%, 4=5.21%, 10=9.77%, 20=11.07%, 50=32.42% lat (msec) : 100=20.83%, 250=3.91% cpu : usr=0.10%, sys=5.65%, ctx=1333, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144654: Wed Aug 26 22:20:52 2026 read: IOPS=14, BW=225KiB/s (231kB/s)(5744KiB/25508msec) clat (usec): min=35, max=200404, avg=37053.94, stdev=28963.10 lat (usec): min=35, max=200406, avg=37055.30, stdev=28963.14 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 709], | 30.00th=[ 22938], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[135267], 99.50th=[152044], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 46, max= 379, per=24.09%, avg=225.94, stdev=74.53, samples=49 iops : min= 2, max= 23, avg=13.45, stdev= 4.75, samples=49 write: IOPS=16, BW=257KiB/s (263kB/s)(6544KiB/25508msec); 0 zone resets clat (usec): min=1388, max=255069, avg=29591.06, stdev=33302.22 lat (usec): min=1389, max=255071, avg=29602.82, stdev=33316.24 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1729], 10.00th=[ 1909], 20.00th=[ 4015], | 30.00th=[ 6587], 40.00th=[ 10683], 50.00th=[ 16450], 60.00th=[ 24249], | 70.00th=[ 37487], 80.00th=[ 51643], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[143655], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 63, max= 477, per=25.73%, avg=253.96, stdev=97.76, samples=49 iops : min= 3, max= 29, avg=15.24, stdev= 6.28, samples=49 lat (usec) : 50=1.30%, 100=7.29%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=6.38%, 4=4.56%, 10=10.29%, 20=10.81%, 50=34.64% lat (msec) : 100=20.57%, 250=3.26%, 500=0.13% cpu : usr=0.06%, sys=6.16%, ctx=1450, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144655: Wed Aug 26 22:20:52 2026 read: IOPS=15, BW=253KiB/s (259kB/s)(6256KiB/24729msec) clat (usec): min=31, max=170333, avg=35281.57, stdev=27609.77 lat (usec): min=32, max=170336, avg=35283.01, stdev=27609.75 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 88], | 30.00th=[ 22414], 40.00th=[ 27657], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 69731], 95.00th=[ 78119], | 99.00th=[121111], 99.50th=[135267], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 94, max= 569, per=27.14%, avg=254.58, stdev=86.11, samples=48 iops : min= 5, max= 35, avg=15.27, stdev= 5.46, samples=48 write: IOPS=15, BW=244KiB/s (250kB/s)(6032KiB/24729msec); 0 zone resets clat (usec): min=1395, max=285282, avg=28261.06, stdev=32533.60 lat (usec): min=1398, max=285285, avg=28263.58, stdev=32533.73 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1745], 10.00th=[ 2057], 20.00th=[ 4178], | 30.00th=[ 6849], 40.00th=[ 9896], 50.00th=[ 15270], 60.00th=[ 26084], | 70.00th=[ 34341], 80.00th=[ 48497], 90.00th=[ 70779], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[154141], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 63, max= 448, per=24.44%, avg=241.27, stdev=84.89, samples=48 iops : min= 3, max= 28, avg=14.42, stdev= 5.39, samples=48 lat (usec) : 50=1.30%, 100=9.38%, 250=0.91%, 500=0.26%, 750=0.13% lat (msec) : 2=4.69%, 4=5.08%, 10=10.55%, 20=9.24%, 50=35.55% lat (msec) : 100=20.18%, 250=2.60%, 500=0.13% cpu : usr=0.08%, sys=5.87%, ctx=1415, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144656: Wed Aug 26 22:20:52 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(6032KiB/23935msec) clat (usec): min=34, max=275786, avg=33750.16, stdev=33225.48 lat (usec): min=34, max=275787, avg=33751.43, stdev=33225.49 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 52], 10.00th=[ 60], 20.00th=[ 73], | 30.00th=[ 15139], 40.00th=[ 25035], 50.00th=[ 30540], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 54264], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[164627], 99.50th=[208667], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 96, max= 477, per=26.83%, avg=251.70, stdev=88.73, samples=46 iops : min= 6, max= 29, avg=15.07, stdev= 5.53, samples=46 write: IOPS=16, BW=261KiB/s (268kB/s)(6256KiB/23935msec); 0 zone resets clat (usec): min=1304, max=191141, avg=28011.44, stdev=30443.78 lat (usec): min=1305, max=191143, avg=28013.72, stdev=30443.80 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1696], 10.00th=[ 1926], 20.00th=[ 3949], | 30.00th=[ 5800], 40.00th=[ 9634], 50.00th=[ 17171], 60.00th=[ 26084], | 70.00th=[ 35390], 80.00th=[ 50070], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[137364], 99.50th=[158335], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 94, max= 508, per=26.55%, avg=262.02, stdev=93.81, samples=46 iops : min= 5, max= 31, avg=15.74, stdev= 5.88, samples=46 lat (usec) : 50=2.21%, 100=9.90%, 250=1.17%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=5.47%, 4=5.34%, 10=10.42%, 20=8.59%, 50=34.38% lat (msec) : 100=18.75%, 250=3.12%, 500=0.13% cpu : usr=0.10%, sys=5.99%, ctx=1328, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=939KiB/s (962kB/s), 225KiB/s-253KiB/s (231kB/s-259kB/s), io=23.4MiB (24.5MB), run=23935-25508msec WRITE: bw=988KiB/s (1012kB/s), 244KiB/s-261KiB/s (250kB/s-268kB/s), io=24.6MiB (25.8MB), run=23935-25508msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144658: Wed Aug 26 22:21:32 2026 read: IOPS=5, BW=92.2KiB/s (94.4kB/s)(5920KiB/64185msec) clat (msec): min=8, max=366, avg=34.92, stdev=36.72 lat (msec): min=8, max=366, avg=34.92, stdev=36.72 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 71], 95.00th=[ 105], | 99.00th=[ 188], 99.50th=[ 197], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 382, per=27.10%, avg=99.17, stdev=64.93, samples=116 iops : min= 1, max= 23, avg= 5.44, stdev= 4.12, samples=116 write: IOPS=6, BW=99.2KiB/s (102kB/s)(6368KiB/64185msec); 0 zone resets clat (msec): min=45, max=324, avg=128.71, stdev=51.45 lat (msec): min=45, max=324, avg=128.71, stdev=51.45 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 69], 10.00th=[ 77], 20.00th=[ 85], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 201], 95.00th=[ 253], | 99.00th=[ 292], 99.50th=[ 300], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 23, max= 190, per=25.67%, avg=98.82, stdev=38.85, samples=126 iops : min= 1, max= 11, avg= 5.42, stdev= 2.53, samples=126 lat (msec) : 10=1.30%, 20=18.36%, 50=20.44%, 100=22.79%, 250=34.38% lat (msec) : 500=2.73% cpu : usr=0.03%, sys=1.24%, ctx=1315, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144659: Wed Aug 26 22:21:32 2026 read: IOPS=5, BW=87.9KiB/s (90.0kB/s)(5744KiB/65342msec) clat (msec): min=6, max=296, avg=34.83, stdev=36.69 lat (msec): min=6, max=296, avg=34.83, stdev=36.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 69], 95.00th=[ 101], | 99.00th=[ 184], 99.50th=[ 255], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 23, max= 351, per=26.67%, avg=97.59, stdev=64.44, samples=116 iops : min= 1, max= 21, avg= 5.35, stdev= 4.10, samples=116 write: IOPS=6, BW=100KiB/s (103kB/s)(6544KiB/65342msec); 0 zone resets clat (msec): min=44, max=352, avg=129.02, stdev=50.96 lat (msec): min=44, max=352, avg=129.03, stdev=50.96 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 132], | 70.00th=[ 144], 80.00th=[ 161], 90.00th=[ 188], 95.00th=[ 241], | 99.00th=[ 305], 99.50th=[ 321], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 160, per=26.08%, avg=100.42, stdev=37.30, samples=128 iops : min= 1, max= 10, avg= 5.52, stdev= 2.43, samples=128 lat (msec) : 10=1.69%, 20=16.80%, 50=20.70%, 100=22.40%, 250=36.07% lat (msec) : 500=2.34% cpu : usr=0.04%, sys=1.15%, ctx=1258, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144660: Wed Aug 26 22:21:32 2026 read: IOPS=6, BW=99.8KiB/s (102kB/s)(6256KiB/62657msec) clat (msec): min=6, max=235, avg=33.05, stdev=32.29 lat (msec): min=6, max=235, avg=33.05, stdev=32.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 62], 95.00th=[ 96], | 99.00th=[ 199], 99.50th=[ 230], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 342, per=29.56%, avg=108.18, stdev=70.66, samples=114 iops : min= 1, max= 21, avg= 6.01, stdev= 4.49, samples=114 write: IOPS=6, BW=96.3KiB/s (98.6kB/s)(6032KiB/62657msec); 0 zone resets clat (msec): min=39, max=373, avg=131.77, stdev=56.18 lat (msec): min=39, max=373, avg=131.77, stdev=56.18 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 100], 40.00th=[ 109], 50.00th=[ 118], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 201], 95.00th=[ 243], | 99.00th=[ 342], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 190, per=25.07%, avg=96.51, stdev=36.81, samples=122 iops : min= 1, max= 11, avg= 5.28, stdev= 2.40, samples=122 lat (msec) : 10=2.21%, 20=17.97%, 50=23.18%, 100=20.70%, 250=33.98% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.15%, ctx=1291, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144661: Wed Aug 26 22:21:32 2026 read: IOPS=5, BW=93.6KiB/s (95.9kB/s)(6032KiB/64434msec) clat (msec): min=7, max=378, avg=36.05, stdev=41.40 lat (msec): min=7, max=378, avg=36.05, stdev=41.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 43], 90.00th=[ 69], 95.00th=[ 109], | 99.00th=[ 201], 99.50th=[ 355], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 320, per=27.86%, avg=101.97, stdev=63.27, samples=115 iops : min= 1, max= 20, avg= 5.62, stdev= 4.04, samples=115 write: IOPS=6, BW=97.1KiB/s (99.4kB/s)(6256KiB/64434msec); 0 zone resets clat (msec): min=42, max=391, avg=129.85, stdev=51.40 lat (msec): min=42, max=391, avg=129.85, stdev=51.40 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 90], | 30.00th=[ 100], 40.00th=[ 107], 50.00th=[ 121], 60.00th=[ 130], | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 220], | 99.00th=[ 321], 99.50th=[ 326], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 191, per=25.06%, avg=96.50, stdev=39.40, samples=127 iops : min= 1, max= 11, avg= 5.28, stdev= 2.53, samples=127 lat (msec) : 10=1.43%, 20=17.84%, 50=22.40%, 100=20.96%, 250=35.29% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.12%, ctx=1253, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=367KiB/s (375kB/s), 87.9KiB/s-99.8KiB/s (90.0kB/s-102kB/s), io=23.4MiB (24.5MB), run=62657-65342msec WRITE: bw=386KiB/s (395kB/s), 96.3KiB/s-100KiB/s (98.6kB/s-103kB/s), io=24.6MiB (25.8MB), run=62657-65342msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144682: Wed Aug 26 22:21:57 2026 read: IOPS=0, BW=579KiB/s (593kB/s)(7168KiB/12381msec) clat (usec): min=416, max=5039.7k, avg=1519937.53, stdev=1958922.88 lat (usec): min=417, max=5039.7k, avg=1519938.86, stdev=1958923.22 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], | 20.00th=[ 502], 30.00th=[ 758], 40.00th=[ 758], | 50.00th=[ 375391], 60.00th=[2533360], 70.00th=[2533360], | 80.00th=[2667578], 90.00th=[5066720], 95.00th=[5066720], | 99.00th=[5066720], 99.50th=[5066720], 99.90th=[5066720], | 99.95th=[5066720], 99.99th=[5066720] bw ( KiB/s): min= 2011, max= 6131, per=100.00%, avg=3056.25, stdev=2049.89, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=0, BW=414KiB/s (423kB/s)(5120KiB/12381msec); 0 zone resets clat (msec): min=237, max=427, avg=319.41, stdev=70.47 lat (msec): min=237, max=427, avg=319.91, stdev=70.42 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2043, max= 4023, per=100.00%, avg=2704.67, stdev=1141.71, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 250=8.33%, 500=41.67%, >=2000=25.00% cpu : usr=0.04%, sys=4.83%, ctx=1231, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144683: Wed Aug 26 22:21:57 2026 read: IOPS=0, BW=155KiB/s (158kB/s)(2048KiB/13235msec) clat (usec): min=873, max=525628, avg=263251.12, stdev=371057.59 lat (usec): min=874, max=525631, avg=263253.06, stdev=371058.63 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 873], 10.00th=[ 873], 20.00th=[ 873], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[ 873], 60.00th=[526386], | 70.00th=[526386], 80.00th=[526386], 90.00th=[526386], 95.00th=[526386], | 99.00th=[526386], 99.50th=[526386], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 2011, max= 2023, per=100.00%, avg=2017.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=774KiB/s (792kB/s)(10.0MiB/13235msec); 0 zone resets clat (msec): min=269, max=5191, avg=1226.52, stdev=1674.83 lat (msec): min=269, max=5191, avg=1226.62, stdev=1674.85 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 275], | 30.00th=[ 313], 40.00th=[ 376], 50.00th=[ 443], 60.00th=[ 523], | 70.00th=[ 527], 80.00th=[ 1011], 90.00th=[ 3339], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 1924, max= 4055, per=100.00%, avg=2261.38, stdev=725.76, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (usec) : 1000=8.33% lat (msec) : 500=41.67%, 750=25.00%, 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=4.31%, ctx=154, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144684: Wed Aug 26 22:21:57 2026 read: IOPS=0, BW=482KiB/s (493kB/s)(6144KiB/12759msec) clat (usec): min=497, max=521014, avg=253273.55, stdev=176974.57 lat (usec): min=498, max=521015, avg=253274.80, stdev=176974.50 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[185598], | 30.00th=[185598], 40.00th=[214959], 50.00th=[214959], 60.00th=[223347], | 70.00th=[371196], 80.00th=[371196], 90.00th=[522191], 95.00th=[522191], | 99.00th=[522191], 99.50th=[522191], 99.90th=[522191], 99.95th=[522191], | 99.99th=[522191] bw ( KiB/s): min= 2048, max= 4087, per=100.00%, avg=3375.67, stdev=1150.77, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=0, BW=482KiB/s (493kB/s)(6144KiB/12759msec); 0 zone resets clat (msec): min=135, max=5882, avg=1792.95, stdev=2374.93 lat (msec): min=135, max=5882, avg=1793.07, stdev=2374.89 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 609], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 5873], 95.00th=[ 5873], | 99.00th=[ 5873], 99.50th=[ 5873], 99.90th=[ 5873], 99.95th=[ 5873], | 99.99th=[ 5873] bw ( KiB/s): min= 1921, max= 2048, per=92.81%, avg=2010.17, stdev=47.11, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 500=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=3.60%, ctx=247, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144685: Wed Aug 26 22:21:57 2026 read: IOPS=0, BW=426KiB/s (436kB/s)(5120KiB/12030msec) clat (usec): min=580, max=336183, avg=188442.32, stdev=131466.63 lat (usec): min=581, max=336184, avg=188443.61, stdev=131466.61 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[139461], 40.00th=[139461], 50.00th=[181404], 60.00th=[181404], | 70.00th=[287310], 80.00th=[287310], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 1992, max= 6131, per=100.00%, avg=4061.50, stdev=2926.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=596KiB/s (610kB/s)(7168KiB/12030msec); 0 zone resets clat (msec): min=239, max=5575, avg=1542.62, stdev=2113.22 lat (msec): min=239, max=5575, avg=1542.69, stdev=2113.20 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 380], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 3406], 90.00th=[ 5604], 95.00th=[ 5604], | 99.00th=[ 5604], 99.50th=[ 5604], 99.90th=[ 5604], 99.95th=[ 5604], | 99.99th=[ 5604] bw ( KiB/s): min= 1519, max= 4096, per=100.00%, avg=2261.50, stdev=918.80, samples=6 iops : min= 1, max= 4, avg= 1.50, stdev= 1.22, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, >=2000=16.67% cpu : usr=0.01%, sys=4.00%, ctx=138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1547KiB/s (1585kB/s), 155KiB/s-579KiB/s (158kB/s-593kB/s), io=20.0MiB (20.0MB), run=12030-13235msec WRITE: bw=2166KiB/s (2218kB/s), 414KiB/s-774KiB/s (423kB/s-792kB/s), io=28.0MiB (29.4MB), run=12030-13235msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144678: Wed Aug 26 22:21:58 2026 read: IOPS=0, BW=511KiB/s (524kB/s)(7168KiB/14021msec) clat (msec): min=57, max=4541, avg=1553.97, stdev=1845.45 lat (msec): min=57, max=4541, avg=1553.98, stdev=1845.45 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 95], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 305], 60.00th=[ 2668], | 70.00th=[ 2668], 80.00th=[ 3071], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1988, max= 4071, per=100.00%, avg=2536.50, stdev=1023.34, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=365KiB/s (374kB/s)(5120KiB/14021msec); 0 zone resets clat (msec): min=173, max=1457, avg=545.98, stdev=523.01 lat (msec): min=173, max=1457, avg=546.10, stdev=523.02 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 2007, max= 3984, per=100.00%, avg=2670.00, stdev=1137.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 2000=8.33%, >=2000=25.00% cpu : usr=0.00%, sys=1.32%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144679: Wed Aug 26 22:21:58 2026 read: IOPS=0, BW=156KiB/s (160kB/s)(2048KiB/13122msec) clat (msec): min=84, max=181, avg=132.87, stdev=68.84 lat (msec): min=84, max=181, avg=132.87, stdev=68.84 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 85], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1460, max= 1969, per=100.00%, avg=1714.50, stdev=359.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=780KiB/s (799kB/s)(10.0MiB/13122msec); 0 zone resets clat (msec): min=317, max=5602, avg=1275.36, stdev=1778.52 lat (msec): min=317, max=5602, avg=1275.45, stdev=1778.52 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 330], | 30.00th=[ 376], 40.00th=[ 380], 50.00th=[ 393], 60.00th=[ 493], | 70.00th=[ 651], 80.00th=[ 852], 90.00th=[ 3373], 95.00th=[ 5604], | 99.00th=[ 5604], 99.50th=[ 5604], 99.90th=[ 5604], 99.95th=[ 5604], | 99.99th=[ 5604] bw ( KiB/s): min= 1976, max= 3992, per=100.00%, avg=2267.00, stdev=697.45, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 100=8.33%, 250=8.33%, 500=50.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=1.08%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144680: Wed Aug 26 22:21:58 2026 read: IOPS=0, BW=454KiB/s (465kB/s)(6144KiB/13540msec) clat (msec): min=144, max=453, avg=277.16, stdev=116.04 lat (msec): min=144, max=453, avg=277.17, stdev=116.04 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 305], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1988, max= 4047, per=100.00%, avg=2515.25, stdev=1021.25, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=454KiB/s (465kB/s)(6144KiB/13540msec); 0 zone resets clat (msec): min=378, max=5775, avg=1944.09, stdev=2352.51 lat (msec): min=378, max=5775, avg=1944.17, stdev=2352.51 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 558], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 5805], 95.00th=[ 5805], | 99.00th=[ 5805], 99.50th=[ 5805], 99.90th=[ 5805], 99.95th=[ 5805], | 99.99th=[ 5805] bw ( KiB/s): min= 1709, max= 2043, per=96.22%, avg=1966.83, stdev=127.83, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.03%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144681: Wed Aug 26 22:21:58 2026 read: IOPS=0, BW=397KiB/s (407kB/s)(5120KiB/12883msec) clat (msec): min=72, max=336, avg=214.49, stdev=123.97 lat (msec): min=72, max=336, avg=214.49, stdev=123.97 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 3976, max= 3976, per=100.00%, avg=3976.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=556KiB/s (570kB/s)(7168KiB/12883msec); 0 zone resets clat (msec): min=269, max=5598, avg=1680.52, stdev=2131.24 lat (msec): min=269, max=5598, avg=1680.62, stdev=2131.23 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 388], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 514], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 3809], 90.00th=[ 5604], 95.00th=[ 5604], | 99.00th=[ 5604], 99.50th=[ 5604], 99.90th=[ 5604], 99.95th=[ 5604], | 99.99th=[ 5604] bw ( KiB/s): min= 1729, max= 2043, per=96.27%, avg=1967.83, stdev=121.25, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=16.67%, 500=50.00%, 750=8.33%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.16%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1461KiB/s (1496kB/s), 156KiB/s-511KiB/s (160kB/s-524kB/s), io=20.0MiB (20.0MB), run=12883-14021msec WRITE: bw=2045KiB/s (2094kB/s), 365KiB/s-780KiB/s (374kB/s-799kB/s), io=28.0MiB (29.4MB), run=12883-14021msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144693: Wed Aug 26 22:22:11 2026 read: IOPS=1, BW=6083KiB/s (6229kB/s)(12.0MiB/2020msec) clat (msec): min=372, max=954, avg=646.02, stdev=292.79 lat (msec): min=372, max=954, avg=646.02, stdev=292.78 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 6543, max= 8159, per=90.64%, avg=7351.00, stdev=1142.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.05%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144694: Wed Aug 26 22:22:11 2026 read: IOPS=0, BW=2773KiB/s (2840kB/s)(4096KiB/1477msec) clat (nsec): min=222903k, max=222903k, avg=222903024.00, stdev= 0.00 lat (nsec): min=222906k, max=222906k, avg=222905926.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 224], 95.00th=[ 224], | 99.00th=[ 224], 99.50th=[ 224], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 6014, max= 6014, per=74.16%, avg=6014.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5546KiB/s (5679kB/s)(8192KiB/1477msec); 0 zone resets clat (msec): min=440, max=758, avg=599.79, stdev=225.08 lat (msec): min=441, max=759, avg=600.53, stdev=225.37 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8159, max= 8159, per=61.83%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.23%, ctx=55, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144695: Wed Aug 26 22:22:11 2026 write: IOPS=1, BW=4949KiB/s (5068kB/s)(12.0MiB/2483msec); 0 zone resets clat (msec): min=312, max=1336, avg=805.62, stdev=512.97 lat (msec): min=312, max=1338, avg=810.84, stdev=513.14 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8159, max= 8159, per=61.83%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.79%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144696: Wed Aug 26 22:22:11 2026 write: IOPS=2, BW=8308KiB/s (8508kB/s)(12.0MiB/1479msec); 0 zone resets clat (msec): min=327, max=635, avg=465.18, stdev=156.67 lat (msec): min=329, max=636, avg=466.31, stdev=155.83 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7816, max= 8175, per=60.59%, avg=7995.50, stdev=253.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.34%, sys=9.20%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8111KiB/s (8306kB/s), 2773KiB/s-6083KiB/s (2840kB/s-6229kB/s), io=16.0MiB (16.8MB), run=1477-2020msec WRITE: bw=12.9MiB/s (13.5MB/s), 4949KiB/s-8308KiB/s (5068kB/s-8508kB/s), io=32.0MiB (33.6MB), run=1477-2483msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144698: Wed Aug 26 22:22:13 2026 read: IOPS=1, BW=5916KiB/s (6058kB/s)(12.0MiB/2077msec) clat (msec): min=663, max=710, avg=690.34, stdev=24.39 lat (msec): min=663, max=710, avg=690.35, stdev=24.39 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 5634, max= 8192, per=100.00%, avg=6913.00, stdev=1808.78, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=14.93%, ctx=309, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144699: Wed Aug 26 22:22:13 2026 read: IOPS=0, BW=1628KiB/s (1667kB/s)(4096KiB/2516msec) clat (nsec): min=815002k, max=815002k, avg=815002381.00, stdev= 0.00 lat (nsec): min=815005k, max=815005k, avg=815004757.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3256KiB/s (3334kB/s)(8192KiB/2516msec); 0 zone resets clat (msec): min=367, max=1327, avg=847.98, stdev=678.80 lat (msec): min=368, max=1328, avg=848.37, stdev=678.88 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8175, max= 8175, per=65.52%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.79%, ctx=161, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144700: Wed Aug 26 22:22:13 2026 write: IOPS=1, BW=4679KiB/s (4792kB/s)(12.0MiB/2626msec); 0 zone resets clat (msec): min=408, max=1182, avg=873.87, stdev=409.96 lat (msec): min=409, max=1185, avg=874.94, stdev=410.65 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8175, max= 8175, per=65.52%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=8.65%, ctx=103, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144701: Wed Aug 26 22:22:13 2026 write: IOPS=1, BW=5824KiB/s (5963kB/s)(12.0MiB/2110msec); 0 zone resets clat (msec): min=312, max=1394, avg=702.51, stdev=600.60 lat (msec): min=313, max=1394, avg=702.94, stdev=600.58 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 6131, max= 6131, per=49.13%, avg=6131.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.19%, sys=6.31%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6512KiB/s (6668kB/s), 1628KiB/s-5916KiB/s (1667kB/s-6058kB/s), io=16.0MiB (16.8MB), run=2077-2516msec WRITE: bw=12.2MiB/s (12.8MB/s), 3256KiB/s-5824KiB/s (3334kB/s-5963kB/s), io=32.0MiB (33.6MB), run=2110-2626msec