== sanity test 398b: DIO and buffer IO race ============== 13:34:53 (1774892093) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.66356 s, 18.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182829: Mon Mar 30 13:35:52 2026 read: IOPS=29, BW=120KiB/s (122kB/s)(5992KiB/50116msec) clat (usec): min=194, max=77639, avg=17744.47, stdev=9553.62 lat (usec): min=194, max=77639, avg=17745.07, stdev=9553.68 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 7177], 10.00th=[ 8717], 20.00th=[10421], | 30.00th=[11994], 40.00th=[13960], 50.00th=[15795], 60.00th=[17957], | 70.00th=[20317], 80.00th=[23725], 90.00th=[29230], 95.00th=[36439], | 99.00th=[52167], 99.50th=[57410], 99.90th=[66847], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 19, max= 192, per=24.88%, avg=119.17, stdev=36.09, samples=99 iops : min= 4, max= 48, avg=29.46, stdev= 9.10, samples=99 write: IOPS=31, BW=126KiB/s (129kB/s)(6296KiB/50116msec); 0 zone resets clat (usec): min=732, max=609955, avg=14878.30, stdev=18485.24 lat (usec): min=733, max=609956, avg=14879.11, stdev=18485.31 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2671], 10.00th=[ 3130], 20.00th=[ 4293], | 30.00th=[ 7308], 40.00th=[ 9896], 50.00th=[ 12125], 60.00th=[ 15008], | 70.00th=[ 18482], 80.00th=[ 22414], 90.00th=[ 29754], 95.00th=[ 35390], | 99.00th=[ 49546], 99.50th=[ 54264], 99.90th=[ 85459], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 56, max= 200, per=25.16%, avg=126.07, stdev=34.74, samples=98 iops : min= 14, max= 50, avg=31.19, stdev= 8.80, samples=98 lat (usec) : 250=0.03%, 500=0.29%, 750=0.59%, 1000=0.29% lat (msec) : 2=0.91%, 4=8.43%, 10=19.21%, 20=42.06%, 50=27.18% lat (msec) : 100=0.98%, 750=0.03% cpu : usr=0.11%, sys=25.84%, ctx=10165, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182830: Mon Mar 30 13:35:52 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(5940KiB/49986msec) clat (usec): min=221, max=93027, avg=18020.99, stdev=9555.23 lat (usec): min=221, max=93027, avg=18021.61, stdev=9555.30 clat percentiles (usec): | 1.00th=[ 717], 5.00th=[ 7439], 10.00th=[ 8586], 20.00th=[10421], | 30.00th=[12256], 40.00th=[14091], 50.00th=[16188], 60.00th=[18482], | 70.00th=[20841], 80.00th=[23725], 90.00th=[29492], 95.00th=[35390], | 99.00th=[52167], 99.50th=[55313], 99.90th=[73925], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 6, max= 192, per=24.75%, avg=118.56, stdev=33.86, samples=99 iops : min= 1, max= 48, avg=29.31, stdev= 8.54, samples=99 write: IOPS=31, BW=127KiB/s (130kB/s)(6348KiB/49986msec); 0 zone resets clat (usec): min=647, max=608952, avg=14562.89, stdev=18324.89 lat (usec): min=648, max=608953, avg=14563.87, stdev=18324.99 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2737], 10.00th=[ 3130], 20.00th=[ 4228], | 30.00th=[ 6652], 40.00th=[ 9503], 50.00th=[ 11863], 60.00th=[ 14615], | 70.00th=[ 17957], 80.00th=[ 22676], 90.00th=[ 28967], 95.00th=[ 34341], | 99.00th=[ 50594], 99.50th=[ 55837], 99.90th=[ 64750], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 6, max= 223, per=25.21%, avg=126.30, stdev=39.38, samples=99 iops : min= 1, max= 55, avg=31.25, stdev= 9.93, samples=99 lat (usec) : 250=0.03%, 500=0.16%, 750=0.42%, 1000=0.29% lat (msec) : 2=0.78%, 4=8.95%, 10=19.50%, 20=40.43%, 50=28.22% lat (msec) : 100=1.17%, 750=0.03% cpu : usr=0.11%, sys=26.11%, ctx=10208, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182831: Mon Mar 30 13:35:52 2026 read: IOPS=30, BW=123KiB/s (126kB/s)(6028KiB/49108msec) clat (usec): min=244, max=70155, avg=17525.61, stdev=9137.56 lat (usec): min=246, max=70156, avg=17526.59, stdev=9137.57 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 7308], 10.00th=[ 8586], 20.00th=[10159], | 30.00th=[11863], 40.00th=[13829], 50.00th=[15795], 60.00th=[18220], | 70.00th=[20579], 80.00th=[23200], 90.00th=[28967], 95.00th=[35390], | 99.00th=[47449], 99.50th=[54789], 99.90th=[64226], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 63, max= 192, per=25.84%, avg=123.77, stdev=33.57, samples=96 iops : min= 15, max= 48, avg=30.61, stdev= 8.50, samples=96 write: IOPS=31, BW=127KiB/s (131kB/s)(6260KiB/49108msec); 0 zone resets clat (usec): min=664, max=623957, avg=14428.08, stdev=18590.54 lat (usec): min=665, max=623959, avg=14428.92, stdev=18590.61 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2671], 10.00th=[ 3130], 20.00th=[ 4228], | 30.00th=[ 6915], 40.00th=[ 9503], 50.00th=[ 11600], 60.00th=[ 14353], | 70.00th=[ 17957], 80.00th=[ 21890], 90.00th=[ 28705], 95.00th=[ 33817], | 99.00th=[ 48497], 99.50th=[ 52167], 99.90th=[ 65274], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 39, max= 216, per=25.60%, avg=128.27, stdev=32.79, samples=96 iops : min= 9, max= 54, avg=31.74, stdev= 8.24, samples=96 lat (usec) : 250=0.03%, 500=0.23%, 750=0.68%, 1000=0.55% lat (msec) : 2=0.81%, 4=8.59%, 10=19.79%, 20=40.82%, 50=27.64% lat (msec) : 100=0.81%, 750=0.03% cpu : usr=0.13%, sys=26.47%, ctx=9956, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182832: Mon Mar 30 13:35:52 2026 read: IOPS=30, BW=121KiB/s (124kB/s)(6052KiB/50006msec) clat (usec): min=205, max=82545, avg=17992.24, stdev=9053.63 lat (usec): min=206, max=82546, avg=17993.07, stdev=9053.63 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 7504], 10.00th=[ 8717], 20.00th=[10290], | 30.00th=[12387], 40.00th=[14353], 50.00th=[16712], 60.00th=[18744], | 70.00th=[21365], 80.00th=[24773], 90.00th=[29492], 95.00th=[34866], | 99.00th=[44303], 99.50th=[51643], 99.90th=[70779], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 47, max= 224, per=25.43%, avg=121.83, stdev=31.32, samples=98 iops : min= 11, max= 56, avg=30.13, stdev= 7.94, samples=98 write: IOPS=31, BW=125KiB/s (128kB/s)(6236KiB/50006msec); 0 zone resets clat (usec): min=765, max=626296, avg=14533.82, stdev=18832.14 lat (usec): min=765, max=626298, avg=14534.64, stdev=18832.20 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2704], 10.00th=[ 3064], 20.00th=[ 4228], | 30.00th=[ 7046], 40.00th=[ 9503], 50.00th=[ 11600], 60.00th=[ 14222], | 70.00th=[ 17433], 80.00th=[ 22152], 90.00th=[ 29754], 95.00th=[ 35390], | 99.00th=[ 49546], 99.50th=[ 56886], 99.90th=[ 77071], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 56, max= 224, per=25.09%, avg=125.72, stdev=37.68, samples=98 iops : min= 14, max= 56, avg=31.11, stdev= 9.48, samples=98 lat (usec) : 250=0.03%, 500=0.29%, 750=0.46%, 1000=0.33% lat (msec) : 2=0.98%, 4=8.76%, 10=19.50%, 20=39.55%, 50=29.30% lat (msec) : 100=0.78%, 750=0.03% cpu : usr=0.09%, sys=26.19%, ctx=10125, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=479KiB/s (491kB/s), 119KiB/s-123KiB/s (122kB/s-126kB/s), io=23.4MiB (24.6MB), run=49108-50116msec WRITE: bw=502KiB/s (514kB/s), 125KiB/s-127KiB/s (128kB/s-131kB/s), io=24.6MiB (25.7MB), run=49108-50116msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182824: Mon Mar 30 13:35:58 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(5992KiB/56060msec) clat (msec): min=2, max=620, avg=16.96, stdev=20.23 lat (msec): min=2, max=620, avg=16.96, stdev=20.23 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 35], 95.00th=[ 43], | 99.00th=[ 60], 99.50th=[ 70], 99.90th=[ 106], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 32, max= 376, per=25.24%, avg=107.54, stdev=75.72, samples=110 iops : min= 8, max= 94, avg=26.59, stdev=19.04, samples=110 write: IOPS=28, BW=112KiB/s (115kB/s)(6296KiB/56060msec); 0 zone resets clat (usec): min=3489, max=83045, avg=19359.13, stdev=13337.28 lat (usec): min=3489, max=83046, avg=19360.03, stdev=13337.32 clat percentiles (usec): | 1.00th=[ 4817], 5.00th=[ 5407], 10.00th=[ 6063], 20.00th=[ 7111], | 30.00th=[ 9896], 40.00th=[12780], 50.00th=[16188], 60.00th=[19792], | 70.00th=[23987], 80.00th=[29492], 90.00th=[37487], 95.00th=[44827], | 99.00th=[67634], 99.50th=[73925], 99.90th=[80217], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 15, max= 424, per=25.32%, avg=112.91, stdev=78.37, samples=110 iops : min= 3, max= 106, avg=27.94, stdev=19.70, samples=110 lat (msec) : 4=1.33%, 10=32.32%, 20=32.65%, 50=30.89%, 100=2.73% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=14.98%, ctx=6630, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182825: Mon Mar 30 13:35:58 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(5940KiB/56335msec) clat (msec): min=2, max=615, avg=16.99, stdev=20.34 lat (msec): min=2, max=615, avg=16.99, stdev=20.34 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 42], | 99.00th=[ 64], 99.50th=[ 71], 99.90th=[ 106], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 31, max= 384, per=24.88%, avg=105.99, stdev=79.02, samples=111 iops : min= 7, max= 96, avg=26.21, stdev=19.86, samples=111 write: IOPS=28, BW=113KiB/s (115kB/s)(6348KiB/56335msec); 0 zone resets clat (usec): min=3127, max=92757, avg=19482.18, stdev=13653.67 lat (usec): min=3127, max=92758, avg=19483.03, stdev=13653.77 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5342], 10.00th=[ 5932], 20.00th=[ 6980], | 30.00th=[ 9241], 40.00th=[12649], 50.00th=[16188], 60.00th=[20055], | 70.00th=[25035], 80.00th=[29754], 90.00th=[37487], 95.00th=[45351], | 99.00th=[65274], 99.50th=[70779], 99.90th=[87557], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 39, max= 424, per=25.33%, avg=112.98, stdev=78.35, samples=111 iops : min= 9, max= 106, avg=27.95, stdev=19.70, samples=111 lat (msec) : 4=1.92%, 10=33.50%, 20=29.30%, 50=32.55%, 100=2.67% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=14.74%, ctx=6632, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182826: Mon Mar 30 13:35:58 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(6028KiB/56208msec) clat (usec): min=2772, max=95377, avg=15946.05, stdev=11944.59 lat (usec): min=2773, max=95378, avg=15946.70, stdev=11944.61 clat percentiles (usec): | 1.00th=[ 3720], 5.00th=[ 4490], 10.00th=[ 4817], 20.00th=[ 5604], | 30.00th=[ 7504], 40.00th=[10159], 50.00th=[12518], 60.00th=[15533], | 70.00th=[18744], 80.00th=[24249], 90.00th=[32637], 95.00th=[40109], | 99.00th=[53740], 99.50th=[65799], 99.90th=[81265], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 31, max= 400, per=25.28%, avg=107.68, stdev=78.78, samples=110 iops : min= 7, max= 100, avg=26.63, stdev=19.80, samples=110 write: IOPS=27, BW=111KiB/s (114kB/s)(6260KiB/56208msec); 0 zone resets clat (msec): min=3, max=624, avg=20.44, stdev=20.60 lat (msec): min=3, max=624, avg=20.44, stdev=20.60 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 68], 99.50th=[ 75], 99.90th=[ 92], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 39, max= 360, per=24.99%, avg=111.45, stdev=73.59, samples=110 iops : min= 9, max= 90, avg=27.57, stdev=18.50, samples=110 lat (msec) : 4=0.98%, 10=33.50%, 20=30.44%, 50=32.52%, 100=2.54% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=14.94%, ctx=6618, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182827: Mon Mar 30 13:35:58 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(6052KiB/56230msec) clat (usec): min=2821, max=86689, avg=16346.03, stdev=12590.95 lat (usec): min=2821, max=86690, avg=16346.59, stdev=12591.02 clat percentiles (usec): | 1.00th=[ 3654], 5.00th=[ 4424], 10.00th=[ 4817], 20.00th=[ 5538], | 30.00th=[ 7832], 40.00th=[10421], 50.00th=[12518], 60.00th=[15401], | 70.00th=[18744], 80.00th=[24773], 90.00th=[34866], 95.00th=[42730], | 99.00th=[57934], 99.50th=[65274], 99.90th=[83362], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 23, max= 392, per=25.26%, avg=107.61, stdev=75.71, samples=110 iops : min= 5, max= 98, avg=26.61, stdev=19.04, samples=110 write: IOPS=27, BW=111KiB/s (114kB/s)(6236KiB/56230msec); 0 zone resets clat (msec): min=4, max=624, avg=20.09, stdev=20.50 lat (msec): min=4, max=624, avg=20.09, stdev=20.50 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 30], 90.00th=[ 40], 95.00th=[ 46], | 99.00th=[ 64], 99.50th=[ 73], 99.90th=[ 93], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 39, max= 392, per=24.96%, avg=111.31, stdev=77.84, samples=110 iops : min= 9, max= 98, avg=27.54, stdev=19.58, samples=110 lat (msec) : 4=1.07%, 10=33.07%, 20=31.41%, 50=31.67%, 100=2.73% lat (msec) : 750=0.03% cpu : usr=0.07%, sys=14.87%, ctx=6551, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=426KiB/s (436kB/s), 105KiB/s-108KiB/s (108kB/s-110kB/s), io=23.4MiB (24.6MB), run=56060-56335msec WRITE: bw=446KiB/s (457kB/s), 111KiB/s-113KiB/s (114kB/s-115kB/s), io=24.6MiB (25.7MB), run=56060-56335msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182858: Mon Mar 30 13:36:18 2026 read: IOPS=24, BW=389KiB/s (399kB/s)(5920KiB/15204msec) clat (usec): min=124, max=59602, avg=20577.98, stdev=11302.34 lat (usec): min=124, max=59603, avg=20578.60, stdev=11302.40 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 6783], 10.00th=[ 9241], 20.00th=[11731], | 30.00th=[14484], 40.00th=[16712], 50.00th=[18482], 60.00th=[20579], | 70.00th=[23462], 80.00th=[28705], 90.00th=[35390], 95.00th=[42730], | 99.00th=[58983], 99.50th=[59507], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 223, max= 608, per=24.86%, avg=388.87, stdev=118.13, samples=30 iops : min= 13, max= 38, avg=23.80, stdev= 7.46, samples=30 write: IOPS=26, BW=419KiB/s (429kB/s)(6368KiB/15204msec); 0 zone resets clat (usec): min=1336, max=70432, avg=18948.09, stdev=12099.95 lat (usec): min=1337, max=70435, avg=18951.08, stdev=12100.80 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 4490], 10.00th=[ 5407], 20.00th=[ 8455], | 30.00th=[11207], 40.00th=[13698], 50.00th=[16319], 60.00th=[19792], | 70.00th=[23200], 80.00th=[28443], 90.00th=[35390], 95.00th=[42206], | 99.00th=[56886], 99.50th=[66323], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 160, max= 672, per=25.50%, avg=419.43, stdev=132.51, samples=30 iops : min= 10, max= 42, avg=25.70, stdev= 8.34, samples=30 lat (usec) : 250=0.13%, 500=0.65%, 750=0.91%, 1000=0.13% lat (msec) : 2=0.65%, 4=0.91%, 10=17.06%, 20=38.41%, 50=38.80% lat (msec) : 100=2.34% cpu : usr=0.06%, sys=27.96%, ctx=3212, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182859: Mon Mar 30 13:36:18 2026 read: IOPS=24, BW=389KiB/s (399kB/s)(5744KiB/14758msec) clat (usec): min=133, max=60158, avg=20722.16, stdev=10729.87 lat (usec): min=133, max=60159, avg=20722.77, stdev=10729.93 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 701], 10.00th=[ 9241], 20.00th=[12780], | 30.00th=[15401], 40.00th=[17171], 50.00th=[19268], 60.00th=[22152], | 70.00th=[24511], 80.00th=[28181], 90.00th=[34341], 95.00th=[40633], | 99.00th=[55837], 99.50th=[57934], 99.90th=[60031], 99.95th=[60031], | 99.99th=[60031] bw ( KiB/s): min= 190, max= 606, per=24.77%, avg=387.41, stdev=102.86, samples=29 iops : min= 11, max= 37, avg=23.69, stdev= 6.48, samples=29 write: IOPS=27, BW=443KiB/s (454kB/s)(6544KiB/14758msec); 0 zone resets clat (usec): min=1505, max=86694, avg=17840.08, stdev=12181.35 lat (usec): min=1507, max=86697, avg=17841.82, stdev=12181.73 clat percentiles (usec): | 1.00th=[ 2769], 5.00th=[ 4228], 10.00th=[ 4948], 20.00th=[ 7570], | 30.00th=[10028], 40.00th=[12125], 50.00th=[15139], 60.00th=[17957], | 70.00th=[21365], 80.00th=[27395], 90.00th=[35390], 95.00th=[41157], | 99.00th=[55313], 99.50th=[58459], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 191, max= 702, per=26.81%, avg=441.10, stdev=123.24, samples=29 iops : min= 11, max= 43, avg=27.07, stdev= 7.68, samples=29 lat (usec) : 250=0.13%, 500=0.52%, 750=1.82%, 1000=0.13% lat (msec) : 2=0.78%, 4=1.43%, 10=17.06%, 20=38.67%, 50=37.50% lat (msec) : 100=1.95% cpu : usr=0.08%, sys=28.85%, ctx=3203, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182860: Mon Mar 30 13:36:18 2026 read: IOPS=25, BW=409KiB/s (418kB/s)(6256KiB/15314msec) clat (usec): min=474, max=75687, avg=20300.06, stdev=10673.23 lat (usec): min=475, max=75688, avg=20300.74, stdev=10673.28 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 1090], 10.00th=[10159], 20.00th=[12649], | 30.00th=[14746], 40.00th=[16581], 50.00th=[18482], 60.00th=[20579], | 70.00th=[23987], 80.00th=[27395], 90.00th=[34341], 95.00th=[40633], | 99.00th=[51119], 99.50th=[71828], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 192, max= 640, per=26.31%, avg=411.50, stdev=132.42, samples=30 iops : min= 12, max= 40, avg=25.23, stdev= 8.23, samples=30 write: IOPS=24, BW=394KiB/s (403kB/s)(6032KiB/15314msec); 0 zone resets clat (usec): min=1347, max=84493, avg=19400.88, stdev=12028.22 lat (usec): min=1348, max=84495, avg=19402.08, stdev=12028.27 clat percentiles (usec): | 1.00th=[ 3359], 5.00th=[ 4686], 10.00th=[ 5735], 20.00th=[ 9241], | 30.00th=[11469], 40.00th=[14091], 50.00th=[17433], 60.00th=[19530], | 70.00th=[23462], 80.00th=[28443], 90.00th=[36963], 95.00th=[40633], | 99.00th=[52691], 99.50th=[57934], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 222, max= 640, per=23.77%, avg=391.03, stdev=114.32, samples=30 iops : min= 13, max= 40, avg=23.93, stdev= 7.30, samples=30 lat (usec) : 500=0.26%, 750=1.30%, 1000=0.78% lat (msec) : 2=0.65%, 4=1.04%, 10=11.98%, 20=43.62%, 50=39.19% lat (msec) : 100=1.17% cpu : usr=0.10%, sys=28.12%, ctx=3294, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182861: Mon Mar 30 13:36:18 2026 read: IOPS=24, BW=394KiB/s (404kB/s)(6032KiB/15294msec) clat (usec): min=366, max=81002, avg=21069.73, stdev=12251.01 lat (usec): min=367, max=81003, avg=21070.38, stdev=12251.05 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 775], 10.00th=[ 9241], 20.00th=[12780], | 30.00th=[15008], 40.00th=[17171], 50.00th=[19268], 60.00th=[22152], | 70.00th=[24773], 80.00th=[28443], 90.00th=[34341], 95.00th=[41157], | 99.00th=[65274], 99.50th=[73925], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 190, max= 640, per=25.12%, avg=392.80, stdev=121.73, samples=30 iops : min= 11, max= 40, avg=24.07, stdev= 7.70, samples=30 write: IOPS=25, BW=409KiB/s (419kB/s)(6256KiB/15294msec); 0 zone resets clat (usec): min=1174, max=71177, avg=18552.54, stdev=12175.35 lat (usec): min=1175, max=71179, avg=18553.77, stdev=12175.48 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 4359], 10.00th=[ 5145], 20.00th=[ 7832], | 30.00th=[11207], 40.00th=[12911], 50.00th=[15533], 60.00th=[18744], | 70.00th=[22152], 80.00th=[27657], 90.00th=[36963], 95.00th=[43254], | 99.00th=[58459], 99.50th=[60031], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 192, max= 640, per=25.02%, avg=411.63, stdev=109.54, samples=30 iops : min= 12, max= 40, avg=25.23, stdev= 6.91, samples=30 lat (usec) : 500=0.91%, 750=1.43%, 1000=0.52% lat (msec) : 2=0.91%, 4=1.30%, 10=14.32%, 20=38.54%, 50=39.19% lat (msec) : 100=2.86% cpu : usr=0.04%, sys=28.35%, ctx=3203, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1564KiB/s (1602kB/s), 389KiB/s-409KiB/s (399kB/s-418kB/s), io=23.4MiB (24.5MB), run=14758-15314msec WRITE: bw=1646KiB/s (1685kB/s), 394KiB/s-443KiB/s (403kB/s-454kB/s), io=24.6MiB (25.8MB), run=14758-15314msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182854: Mon Mar 30 13:36:20 2026 read: IOPS=21, BW=351KiB/s (360kB/s)(5920KiB/16861msec) clat (usec): min=3730, max=80774, avg=19930.80, stdev=13831.48 lat (usec): min=3730, max=80775, avg=19931.76, stdev=13831.35 clat percentiles (usec): | 1.00th=[ 4555], 5.00th=[ 5800], 10.00th=[ 6521], 20.00th=[ 9372], | 30.00th=[10945], 40.00th=[12649], 50.00th=[14746], 60.00th=[18220], | 70.00th=[23200], 80.00th=[31851], 90.00th=[40109], 95.00th=[47973], | 99.00th=[61080], 99.50th=[73925], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 159, max= 926, per=24.07%, avg=340.85, stdev=168.15, samples=33 iops : min= 9, max= 57, avg=20.58, stdev=10.62, samples=33 write: IOPS=23, BW=378KiB/s (387kB/s)(6368KiB/16861msec); 0 zone resets clat (usec): min=5370, max=86710, avg=23598.67, stdev=14566.88 lat (usec): min=5371, max=86711, avg=23600.26, stdev=14566.78 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 7439], 10.00th=[ 9110], 20.00th=[11076], | 30.00th=[13566], 40.00th=[16188], 50.00th=[20317], 60.00th=[23987], | 70.00th=[28705], 80.00th=[33424], 90.00th=[44827], 95.00th=[51643], | 99.00th=[70779], 99.50th=[82314], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 160, max= 990, per=24.92%, avg=371.24, stdev=180.00, samples=33 iops : min= 10, max= 61, avg=22.48, stdev=11.28, samples=33 lat (msec) : 4=0.26%, 10=19.14%, 20=36.72%, 50=38.80%, 100=5.08% cpu : usr=0.10%, sys=15.30%, ctx=1959, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182855: Mon Mar 30 13:36:20 2026 read: IOPS=21, BW=345KiB/s (353kB/s)(5744KiB/16658msec) clat (usec): min=4696, max=80430, avg=20200.05, stdev=14382.86 lat (usec): min=4696, max=80430, avg=20200.65, stdev=14382.86 clat percentiles (usec): | 1.00th=[ 5014], 5.00th=[ 6521], 10.00th=[ 7439], 20.00th=[ 9503], | 30.00th=[11207], 40.00th=[13173], 50.00th=[15533], 60.00th=[17957], | 70.00th=[22152], 80.00th=[28181], 90.00th=[42206], 95.00th=[50070], | 99.00th=[70779], 99.50th=[73925], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 95, max= 928, per=23.31%, avg=330.00, stdev=143.26, samples=32 iops : min= 5, max= 58, avg=19.91, stdev= 9.04, samples=32 write: IOPS=24, BW=393KiB/s (402kB/s)(6544KiB/16658msec); 0 zone resets clat (usec): min=5295, max=76818, avg=22907.72, stdev=13329.47 lat (usec): min=5296, max=76820, avg=22909.06, stdev=13329.53 clat percentiles (usec): | 1.00th=[ 6325], 5.00th=[ 7767], 10.00th=[ 8717], 20.00th=[11207], | 30.00th=[13042], 40.00th=[16712], 50.00th=[19792], 60.00th=[23725], | 70.00th=[28967], 80.00th=[33817], 90.00th=[41681], 95.00th=[46924], | 99.00th=[63701], 99.50th=[65274], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 159, max= 960, per=24.81%, avg=369.66, stdev=156.26, samples=32 iops : min= 9, max= 60, avg=22.38, stdev= 9.89, samples=32 lat (msec) : 10=19.01%, 20=38.54%, 50=37.11%, 100=5.34% cpu : usr=0.09%, sys=15.62%, ctx=1922, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182856: Mon Mar 30 13:36:20 2026 read: IOPS=23, BW=370KiB/s (379kB/s)(6256KiB/16908msec) clat (usec): min=3247, max=94756, avg=19951.49, stdev=14787.84 lat (usec): min=3248, max=94757, avg=19952.22, stdev=14787.89 clat percentiles (usec): | 1.00th=[ 3884], 5.00th=[ 5800], 10.00th=[ 6849], 20.00th=[ 8094], | 30.00th=[10028], 40.00th=[11600], 50.00th=[14353], 60.00th=[18744], | 70.00th=[24249], 80.00th=[30802], 90.00th=[41157], 95.00th=[50594], | 99.00th=[72877], 99.50th=[84411], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 95, max= 1277, per=25.65%, avg=363.15, stdev=228.69, samples=33 iops : min= 5, max= 79, avg=21.97, stdev=14.38, samples=33 write: IOPS=22, BW=357KiB/s (365kB/s)(6032KiB/16908msec); 0 zone resets clat (usec): min=3844, max=78110, avg=23830.67, stdev=14610.61 lat (usec): min=3845, max=78111, avg=23832.12, stdev=14610.64 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 7177], 10.00th=[ 8455], 20.00th=[11076], | 30.00th=[13435], 40.00th=[16909], 50.00th=[20317], 60.00th=[23725], | 70.00th=[30016], 80.00th=[36439], 90.00th=[45351], 95.00th=[52691], | 99.00th=[64750], 99.50th=[77071], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 94, max= 832, per=22.76%, avg=339.18, stdev=151.85, samples=33 iops : min= 5, max= 52, avg=20.48, stdev= 9.55, samples=33 lat (msec) : 4=0.78%, 10=22.40%, 20=33.72%, 50=37.50%, 100=5.60% cpu : usr=0.08%, sys=15.12%, ctx=2011, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182857: Mon Mar 30 13:36:20 2026 read: IOPS=22, BW=358KiB/s (367kB/s)(6032KiB/16828msec) clat (msec): min=3, max=108, avg=19.56, stdev=14.48 lat (msec): min=3, max=108, avg=19.56, stdev=14.48 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 71], 99.50th=[ 81], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 94, max= 1085, per=24.75%, avg=350.42, stdev=201.76, samples=33 iops : min= 5, max= 67, avg=21.18, stdev=12.67, samples=33 write: IOPS=23, BW=372KiB/s (381kB/s)(6256KiB/16828msec); 0 zone resets clat (usec): min=4940, max=81441, avg=24131.68, stdev=14265.42 lat (usec): min=4941, max=81442, avg=24133.12, stdev=14265.53 clat percentiles (usec): | 1.00th=[ 6521], 5.00th=[ 7635], 10.00th=[ 8979], 20.00th=[11600], | 30.00th=[13960], 40.00th=[17957], 50.00th=[20579], 60.00th=[24773], | 70.00th=[29230], 80.00th=[34341], 90.00th=[44303], 95.00th=[52691], | 99.00th=[67634], 99.50th=[72877], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 191, max= 958, per=24.55%, avg=365.73, stdev=167.13, samples=33 iops : min= 11, max= 59, avg=22.12, stdev=10.53, samples=33 lat (msec) : 4=0.13%, 10=20.18%, 20=36.46%, 50=37.76%, 100=5.34% lat (msec) : 250=0.13% cpu : usr=0.10%, sys=15.44%, ctx=1902, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1417KiB/s (1451kB/s), 345KiB/s-370KiB/s (353kB/s-379kB/s), io=23.4MiB (24.5MB), run=16658-16908msec WRITE: bw=1490KiB/s (1526kB/s), 357KiB/s-393KiB/s (365kB/s-402kB/s), io=24.6MiB (25.8MB), run=16658-16908msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182868: Mon Mar 30 13:36:30 2026 read: IOPS=3, BW=3340KiB/s (3420kB/s)(7168KiB/2146msec) clat (msec): min=49, max=360, avg=159.55, stdev=132.93 lat (msec): min=49, max=360, avg=159.56, stdev=132.93 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 58], | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 84], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 326], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1903, max= 5128, per=64.93%, avg=3709.00, stdev=1646.96, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=2, BW=2386KiB/s (2443kB/s)(5120KiB/2146msec); 0 zone resets clat (msec): min=64, max=509, avg=203.44, stdev=176.83 lat (msec): min=64, max=509, avg=203.51, stdev=176.82 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1709, max= 6131, per=40.61%, avg=3247.67, stdev=2498.92, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=33.33%, 500=16.67%, 750=8.33% cpu : usr=0.09%, sys=19.30%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182869: Mon Mar 30 13:36:30 2026 read: IOPS=0, BW=629KiB/s (644kB/s)(2048KiB/3257msec) clat (usec): min=47809, max=54542, avg=51175.85, stdev=4761.07 lat (usec): min=47810, max=54543, avg=51176.97, stdev=4760.51 clat percentiles (usec): | 1.00th=[47973], 5.00th=[47973], 10.00th=[47973], 20.00th=[47973], | 30.00th=[47973], 40.00th=[47973], 50.00th=[47973], 60.00th=[54789], | 70.00th=[54789], 80.00th=[54789], 90.00th=[54789], 95.00th=[54789], | 99.00th=[54789], 99.50th=[54789], 99.90th=[54789], 99.95th=[54789], | 99.99th=[54789] bw ( KiB/s): min= 1709, max= 2043, per=32.84%, avg=1876.00, stdev=236.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3144KiB/s (3219kB/s)(10.0MiB/3257msec); 0 zone resets clat (msec): min=62, max=989, avg=313.14, stdev=270.84 lat (msec): min=62, max=989, avg=313.20, stdev=270.84 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 136], 40.00th=[ 186], 50.00th=[ 249], 60.00th=[ 251], | 70.00th=[ 355], 80.00th=[ 368], 90.00th=[ 464], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1709, max= 6144, per=45.01%, avg=3599.60, stdev=2288.18, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.49, samples=5 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=33.33%, 1000=8.33% cpu : usr=0.03%, sys=23.71%, ctx=183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182870: Mon Mar 30 13:36:30 2026 read: IOPS=1, BW=1714KiB/s (1755kB/s)(6144KiB/3585msec) clat (msec): min=35, max=422, avg=176.62, stdev=131.98 lat (msec): min=35, max=422, avg=176.63, stdev=131.98 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 153], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2043, max= 4039, per=47.44%, avg=2710.00, stdev=1150.95, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1714KiB/s (1755kB/s)(6144KiB/3585msec); 0 zone resets clat (msec): min=53, max=1461, avg=415.94, stdev=525.19 lat (msec): min=53, max=1461, avg=416.01, stdev=525.19 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 247], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 2019, max= 3419, per=31.20%, avg=2495.33, stdev=800.05, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.03%, sys=13.39%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182871: Mon Mar 30 13:36:30 2026 read: IOPS=1, BW=1550KiB/s (1587kB/s)(5120KiB/3303msec) clat (msec): min=72, max=916, avg=320.90, stdev=342.45 lat (msec): min=72, max=916, avg=320.90, stdev=342.45 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 2048, max= 6131, per=71.59%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2170KiB/s (2222kB/s)(7168KiB/3303msec); 0 zone resets clat (msec): min=86, max=508, avg=235.90, stdev=164.24 lat (msec): min=86, max=508, avg=235.97, stdev=164.23 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 90], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 197], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 418], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1903, max= 5128, per=41.16%, avg=3291.50, stdev=1579.01, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=16.93%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5713KiB/s (5850kB/s), 629KiB/s-3340KiB/s (644kB/s-3420kB/s), io=20.0MiB (20.0MB), run=2146-3585msec WRITE: bw=7998KiB/s (8190kB/s), 1714KiB/s-3144KiB/s (1755kB/s-3219kB/s), io=28.0MiB (29.4MB), run=2146-3585msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182873: Mon Mar 30 13:36:30 2026 read: IOPS=3, BW=3294KiB/s (3373kB/s)(7168KiB/2176msec) clat (usec): min=1395, max=263291, avg=149747.18, stdev=84236.84 lat (usec): min=1396, max=263292, avg=149759.05, stdev=84236.63 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 90702], | 30.00th=[149947], 40.00th=[149947], 50.00th=[166724], 60.00th=[166724], | 70.00th=[166724], 80.00th=[210764], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 2048, max= 5137, per=61.12%, avg=3720.33, stdev=1560.29, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2353KiB/s (2409kB/s)(5120KiB/2176msec); 0 zone resets clat (msec): min=108, max=343, avg=209.08, stdev=98.97 lat (msec): min=108, max=344, avg=209.11, stdev=98.96 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1988, max= 4096, per=31.80%, avg=2710.67, stdev=1200.11, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 2=8.33%, 100=8.33%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=57.84%, ctx=529, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182874: Mon Mar 30 13:36:30 2026 read: IOPS=0, BW=609KiB/s (623kB/s)(2048KiB/3364msec) clat (msec): min=108, max=137, avg=122.94, stdev=20.28 lat (msec): min=108, max=137, avg=122.95, stdev=20.28 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 138], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 138], 95.00th=[ 138], | 99.00th=[ 138], 99.50th=[ 138], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 1741, max= 2048, per=31.12%, avg=1894.50, stdev=217.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=3044KiB/s (3117kB/s)(10.0MiB/3364msec); 0 zone resets clat (msec): min=139, max=981, avg=307.75, stdev=245.06 lat (msec): min=139, max=981, avg=307.81, stdev=245.05 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 150], | 30.00th=[ 186], 40.00th=[ 199], 50.00th=[ 262], 60.00th=[ 266], | 70.00th=[ 271], 80.00th=[ 288], 90.00th=[ 342], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1741, max= 5965, per=37.23%, avg=3173.00, stdev=1814.47, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.52, samples=5 lat (msec) : 250=50.00%, 500=41.67%, 1000=8.33% cpu : usr=0.15%, sys=49.72%, ctx=379, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182875: Mon Mar 30 13:36:30 2026 read: IOPS=1, BW=1864KiB/s (1909kB/s)(6144KiB/3296msec) clat (usec): min=858, max=1116.2k, avg=209854.81, stdev=447439.33 lat (usec): min=859, max=1116.2k, avg=209855.74, stdev=447439.37 clat percentiles (usec): | 1.00th=[ 857], 5.00th=[ 857], 10.00th=[ 857], | 20.00th=[ 914], 30.00th=[ 914], 40.00th=[ 947], | 50.00th=[ 947], 60.00th=[ 1037], 70.00th=[ 139461], | 80.00th=[ 139461], 90.00th=[1115685], 95.00th=[1115685], | 99.00th=[1115685], 99.50th=[1115685], 99.90th=[1115685], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 3976, max= 4096, per=66.31%, avg=4036.00, stdev=84.85, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1864KiB/s (1909kB/s)(6144KiB/3296msec); 0 zone resets clat (msec): min=96, max=524, avg=323.40, stdev=177.58 lat (msec): min=96, max=524, avg=323.45, stdev=177.58 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 351], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1988, max= 3413, per=27.86%, avg=2374.25, stdev=693.08, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 1000=25.00% lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=16.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=33.29%, ctx=506, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182876: Mon Mar 30 13:36:30 2026 read: IOPS=1, BW=1602KiB/s (1640kB/s)(5120KiB/3196msec) clat (usec): min=819, max=611209, avg=182540.41, stdev=272037.40 lat (usec): min=819, max=611210, avg=182541.24, stdev=272037.38 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], 20.00th=[ 824], | 30.00th=[ 1029], 40.00th=[ 1029], 50.00th=[ 1237], 60.00th=[ 1237], | 70.00th=[299893], 80.00th=[299893], 90.00th=[608175], 95.00th=[608175], | 99.00th=[608175], 99.50th=[608175], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 2048, max= 6144, per=67.29%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2243KiB/s (2297kB/s)(7168KiB/3196msec); 0 zone resets clat (msec): min=110, max=525, avg=321.44, stdev=140.67 lat (msec): min=110, max=525, avg=321.49, stdev=140.68 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 205], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 342], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 447], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1686, max= 6144, per=40.81%, avg=3478.50, stdev=2075.32, samples=4 iops : min= 1, max= 6, avg= 3.00, stdev= 2.45, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=16.67%, 250=16.67%, 500=41.67%, 750=16.67% cpu : usr=0.06%, sys=36.28%, ctx=199, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6088KiB/s (6234kB/s), 609KiB/s-3294KiB/s (623kB/s-3373kB/s), io=20.0MiB (20.0MB), run=2176-3364msec WRITE: bw=8523KiB/s (8728kB/s), 1864KiB/s-3044KiB/s (1909kB/s-3117kB/s), io=28.0MiB (29.4MB), run=2176-3364msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182887: Mon Mar 30 13:36:37 2026 read: IOPS=1, BW=7782KiB/s (7969kB/s)(12.0MiB/1579msec) clat (msec): min=256, max=784, avg=520.06, stdev=263.93 lat (msec): min=256, max=784, avg=520.06, stdev=263.93 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7846, max= 7846, per=75.62%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=14.45%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182888: Mon Mar 30 13:36:37 2026 read: IOPS=0, BW=2762KiB/s (2828kB/s)(4096KiB/1483msec) clat (nsec): min=916421k, max=916421k, avg=916420660.00, stdev= 0.00 lat (nsec): min=916423k, max=916423k, avg=916422555.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7846, max= 7846, per=75.62%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5524KiB/s (5657kB/s)(8192KiB/1483msec); 0 zone resets clat (msec): min=167, max=378, avg=273.20, stdev=149.53 lat (msec): min=167, max=379, avg=273.45, stdev=149.52 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.80%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182889: Mon Mar 30 13:36:37 2026 write: IOPS=2, BW=8325KiB/s (8525kB/s)(12.0MiB/1476msec); 0 zone resets clat (msec): min=236, max=697, avg=482.22, stdev=231.72 lat (msec): min=237, max=697, avg=482.47, stdev=231.72 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 5542, max= 7846, per=30.71%, avg=6694.00, stdev=1629.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=24.41%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182890: Mon Mar 30 13:36:37 2026 write: IOPS=1, BW=8176KiB/s (8372kB/s)(12.0MiB/1503msec); 0 zone resets clat (msec): min=332, max=700, avg=493.19, stdev=188.48 lat (msec): min=332, max=700, avg=493.42, stdev=188.40 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 5809, max= 7846, per=31.32%, avg=6827.50, stdev=1440.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=24.17%, ctx=146, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.1MiB/s (10.6MB/s), 2762KiB/s-7782KiB/s (2828kB/s-7969kB/s), io=16.0MiB (16.8MB), run=1483-1579msec WRITE: bw=21.3MiB/s (22.3MB/s), 5524KiB/s-8325KiB/s (5657kB/s-8525kB/s), io=32.0MiB (33.6MB), run=1476-1503msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182882: Mon Mar 30 13:36:38 2026 read: IOPS=2, BW=8783KiB/s (8994kB/s)(12.0MiB/1399msec) clat (msec): min=391, max=525, avg=444.92, stdev=70.56 lat (msec): min=391, max=525, avg=444.92, stdev=70.56 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7861, max= 8192, per=68.54%, avg=8026.50, stdev=234.05, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=48.78%, ctx=2235, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182883: Mon Mar 30 13:36:38 2026 read: IOPS=0, BW=3096KiB/s (3170kB/s)(4096KiB/1323msec) clat (nsec): min=418835k, max=418835k, avg=418834663.00, stdev= 0.00 lat (nsec): min=418837k, max=418837k, avg=418837303.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7801, max= 7801, per=66.61%, avg=7801.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6192KiB/s (6341kB/s)(8192KiB/1323msec); 0 zone resets clat (msec): min=401, max=434, avg=417.67, stdev=23.24 lat (msec): min=401, max=434, avg=418.01, stdev=23.15 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 8192, max= 8192, per=46.45%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.08%, sys=32.15%, ctx=802, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182884: Mon Mar 30 13:36:38 2026 write: IOPS=1, BW=6614KiB/s (6772kB/s)(12.0MiB/1858msec); 0 zone resets clat (msec): min=65, max=1454, avg=597.03, stdev=749.62 lat (msec): min=65, max=1454, avg=597.30, stdev=749.64 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8192, max= 8192, per=46.45%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=18.58%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182885: Mon Mar 30 13:36:38 2026 write: IOPS=2, BW=9281KiB/s (9504kB/s)(12.0MiB/1324msec); 0 zone resets clat (msec): min=147, max=937, avg=418.78, stdev=449.72 lat (msec): min=147, max=938, avg=419.05, stdev=449.71 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min=15633, max=15633, per=88.64%, avg=15633.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.00%, sys=20.86%, ctx=95, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.4MiB/s (11.0MB/s), 3096KiB/s-8783KiB/s (3170kB/s-8994kB/s), io=16.0MiB (16.8MB), run=1323-1399msec WRITE: bw=17.2MiB/s (18.1MB/s), 6192KiB/s-9281KiB/s (6341kB/s-9504kB/s), io=32.0MiB (33.6MB), run=1323-1858msec