== sanity test 398b: DIO and buffer IO race ============== 21:10:18 (1786756218) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.53154 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178250: Fri Aug 14 21:12:52 2026 read: IOPS=11, BW=44.0KiB/s (46.1kB/s)(5992KiB/133205msec) clat (usec): min=41, max=819711, avg=48270.16, stdev=36479.40 lat (usec): min=41, max=819712, avg=48272.54, stdev=36479.94 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11338], 10.00th=[ 18220], 20.00th=[ 23987], | 30.00th=[ 30016], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[149947], 99.50th=[177210], 99.90th=[223347], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 103, per=25.19%, avg=44.83, stdev=18.86, samples=261 iops : min= 1, max= 25, avg=10.53, stdev= 4.75, samples=261 write: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6296KiB/133205msec); 0 zone resets clat (usec): min=970, max=318494, avg=38438.73, stdev=39696.79 lat (usec): min=971, max=318495, avg=38445.29, stdev=39694.63 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1532], 10.00th=[ 2114], 20.00th=[ 4490], | 30.00th=[ 9634], 40.00th=[ 19792], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 47449], 80.00th=[ 64226], 90.00th=[ 89654], 95.00th=[116917], | 99.00th=[177210], 99.50th=[202376], 99.90th=[278922], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 120, per=25.33%, avg=47.11, stdev=21.59, samples=261 iops : min= 1, max= 30, avg=11.10, stdev= 5.44, samples=261 lat (usec) : 50=0.13%, 100=1.69%, 250=0.16%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.82%, 4=4.43%, 10=6.64%, 20=8.92%, 50=40.27% lat (msec) : 100=25.91%, 250=6.80%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=4.82%, ctx=6699, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178251: Fri Aug 14 21:12:52 2026 read: IOPS=11, BW=44.2KiB/s (45.2kB/s)(5940KiB/134440msec) clat (usec): min=44, max=381979, avg=49003.71, stdev=34701.67 lat (usec): min=45, max=381981, avg=49005.11, stdev=34701.77 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 13829], 10.00th=[ 19268], 20.00th=[ 25035], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[177210], 99.50th=[208667], 99.90th=[358613], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 5, max= 110, per=24.78%, avg=44.10, stdev=19.30, samples=263 iops : min= 1, max= 27, avg=10.35, stdev= 4.86, samples=263 write: IOPS=11, BW=47.2KiB/s (48.4kB/s)(6348KiB/134440msec); 0 zone resets clat (usec): min=769, max=752670, avg=38602.05, stdev=41988.42 lat (usec): min=770, max=752672, avg=38604.46, stdev=41988.64 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1516], 10.00th=[ 2024], 20.00th=[ 4948], | 30.00th=[ 9896], 40.00th=[ 20841], 50.00th=[ 28443], 60.00th=[ 36439], | 70.00th=[ 47973], 80.00th=[ 64226], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[166724], 99.50th=[181404], 99.90th=[252707], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 103, per=25.24%, avg=46.95, stdev=21.59, samples=264 iops : min= 1, max= 25, avg=11.07, stdev= 5.45, samples=264 lat (usec) : 50=0.03%, 100=1.43%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.01%, 4=3.58%, 10=7.00%, 20=8.11%, 50=41.41% lat (msec) : 100=25.85%, 250=7.10%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=4.91%, ctx=6722, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178254: Fri Aug 14 21:12:52 2026 read: IOPS=11, BW=44.8KiB/s (45.8kB/s)(6028KiB/134641msec) clat (usec): min=44, max=401075, avg=50407.90, stdev=35243.41 lat (usec): min=45, max=401078, avg=50411.68, stdev=35243.98 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 14484], 10.00th=[ 19006], 20.00th=[ 25560], | 30.00th=[ 30540], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 58983], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[175113], 99.50th=[212861], 99.90th=[354419], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 111, per=24.95%, avg=44.41, stdev=18.41, samples=264 iops : min= 1, max= 27, avg=10.43, stdev= 4.64, samples=264 write: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6260KiB/134641msec); 0 zone resets clat (usec): min=953, max=797859, avg=37229.44, stdev=43683.75 lat (usec): min=954, max=797860, avg=37231.94, stdev=43684.09 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1516], 10.00th=[ 1926], 20.00th=[ 4359], | 30.00th=[ 8225], 40.00th=[ 17695], 50.00th=[ 25822], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 63701], 90.00th=[ 86508], 95.00th=[113771], | 99.00th=[170918], 99.50th=[210764], 99.90th=[358613], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 127, per=24.87%, avg=46.25, stdev=22.05, samples=263 iops : min= 1, max= 31, avg=10.89, stdev= 5.56, samples=263 lat (usec) : 50=0.07%, 100=1.46%, 250=0.20%, 1000=0.10% lat (msec) : 2=5.24%, 4=4.43%, 10=7.29%, 20=8.40%, 50=39.06% lat (msec) : 100=26.66%, 250=6.80%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=4.71%, ctx=6592, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178255: Fri Aug 14 21:12:52 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6052KiB/131133msec) clat (usec): min=35, max=869355, avg=48572.05, stdev=37699.49 lat (usec): min=35, max=869356, avg=48576.30, stdev=37696.93 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 13435], 10.00th=[ 19530], 20.00th=[ 25035], | 30.00th=[ 30802], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 47973], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[156238], 99.50th=[187696], 99.90th=[308282], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 103, per=25.85%, avg=46.02, stdev=18.44, samples=257 iops : min= 1, max= 25, avg=10.83, stdev= 4.66, samples=257 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6236KiB/131133msec); 0 zone resets clat (usec): min=792, max=322267, avg=36697.47, stdev=39045.82 lat (usec): min=793, max=322270, avg=36701.44, stdev=39049.69 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1500], 10.00th=[ 1926], 20.00th=[ 4228], | 30.00th=[ 8029], 40.00th=[ 17433], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[173016], 99.50th=[196084], 99.90th=[308282], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=47.21, stdev=21.03, samples=258 iops : min= 1, max= 25, avg=11.14, stdev= 5.30, samples=258 lat (usec) : 50=0.13%, 100=1.33%, 250=0.16%, 500=0.13%, 1000=0.20% lat (msec) : 2=5.01%, 4=4.56%, 10=6.84%, 20=8.69%, 50=41.21% lat (msec) : 100=25.46%, 250=6.02%, 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=4.89%, ctx=6556, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=178KiB/s (183kB/s), 44.2KiB/s-46.2KiB/s (45.2kB/s-47.3kB/s), io=23.4MiB (24.6MB), run=131133-134641msec WRITE: bw=187KiB/s (191kB/s), 46.5KiB/s-47.6KiB/s (47.6kB/s-48.7kB/s), io=24.6MiB (25.7MB), run=131133-134641msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178248: Fri Aug 14 21:13:35 2026 read: IOPS=8, BW=33.8KiB/s (34.6kB/s)(5992KiB/177470msec) clat (msec): min=5, max=807, avg=47.52, stdev=48.11 lat (msec): min=5, max=807, avg=47.52, stdev=48.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 103], 95.00th=[ 138], | 99.00th=[ 224], 99.50th=[ 275], 99.90th=[ 342], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 143, per=25.81%, avg=34.59, stdev=24.54, samples=336 iops : min= 1, max= 35, avg= 7.99, stdev= 6.18, samples=336 write: IOPS=8, BW=35.5KiB/s (36.3kB/s)(6296KiB/177470msec); 0 zone resets clat (msec): min=10, max=458, avg=67.31, stdev=48.77 lat (msec): min=10, max=458, avg=67.31, stdev=48.77 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 100], 90.00th=[ 129], 95.00th=[ 161], | 99.00th=[ 243], 99.50th=[ 268], 99.90th=[ 401], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 136, per=24.95%, avg=35.18, stdev=23.36, samples=347 iops : min= 1, max= 34, avg= 8.13, stdev= 5.88, samples=347 lat (msec) : 10=1.82%, 20=13.18%, 50=43.62%, 100=26.20%, 250=14.45% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.07%, sys=2.00%, ctx=4981, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178249: Fri Aug 14 21:13:35 2026 read: IOPS=8, BW=33.5KiB/s (34.3kB/s)(5940KiB/177308msec) clat (msec): min=5, max=893, avg=46.26, stdev=48.57 lat (msec): min=5, max=893, avg=46.26, stdev=48.57 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 102], 95.00th=[ 131], | 99.00th=[ 220], 99.50th=[ 275], 99.90th=[ 393], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 135, per=25.64%, avg=34.35, stdev=24.52, samples=336 iops : min= 1, max= 33, avg= 7.93, stdev= 6.15, samples=336 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6348KiB/177308msec); 0 zone resets clat (msec): min=8, max=449, avg=68.19, stdev=48.58 lat (msec): min=8, max=449, avg=68.19, stdev=48.58 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 80], 80.00th=[ 103], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 234], 99.50th=[ 275], 99.90th=[ 435], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 143, per=25.35%, avg=35.74, stdev=22.87, samples=345 iops : min= 1, max= 35, avg= 8.28, stdev= 5.77, samples=345 lat (msec) : 10=1.50%, 20=13.41%, 50=44.24%, 100=25.36%, 250=14.78% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.06%, sys=1.97%, ctx=4930, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178252: Fri Aug 14 21:13:35 2026 read: IOPS=8, BW=33.9KiB/s (34.7kB/s)(6028KiB/177892msec) clat (msec): min=5, max=389, avg=47.63, stdev=43.49 lat (msec): min=5, max=389, avg=47.63, stdev=43.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 105], 95.00th=[ 136], | 99.00th=[ 209], 99.50th=[ 271], 99.90th=[ 347], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 151, per=25.74%, avg=34.49, stdev=23.05, samples=338 iops : min= 1, max= 37, avg= 7.96, stdev= 5.81, samples=338 write: IOPS=8, BW=35.2KiB/s (36.0kB/s)(6260KiB/177892msec); 0 zone resets clat (msec): min=11, max=964, avg=67.56, stdev=53.32 lat (msec): min=11, max=964, avg=67.57, stdev=53.31 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 99], 90.00th=[ 130], 95.00th=[ 163], | 99.00th=[ 239], 99.50th=[ 279], 99.90th=[ 414], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 112, per=24.65%, avg=34.75, stdev=22.61, samples=348 iops : min= 1, max= 28, avg= 8.03, stdev= 5.70, samples=348 lat (msec) : 10=1.56%, 20=13.25%, 50=44.17%, 100=25.88%, 250=14.45% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.06%, sys=2.06%, ctx=4953, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178253: Fri Aug 14 21:13:35 2026 read: IOPS=8, BW=34.2KiB/s (35.0kB/s)(6052KiB/177042msec) clat (msec): min=5, max=310, avg=45.56, stdev=40.91 lat (msec): min=5, max=310, avg=45.56, stdev=40.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 49], 80.00th=[ 66], 90.00th=[ 101], 95.00th=[ 131], | 99.00th=[ 197], 99.50th=[ 241], 99.90th=[ 309], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 159, per=26.58%, avg=35.61, stdev=25.20, samples=331 iops : min= 1, max= 39, avg= 8.24, stdev= 6.35, samples=331 write: IOPS=8, BW=35.2KiB/s (36.1kB/s)(6236KiB/177042msec); 0 zone resets clat (msec): min=10, max=979, avg=69.13, stdev=56.91 lat (msec): min=10, max=979, avg=69.14, stdev=56.91 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 80], 80.00th=[ 99], 90.00th=[ 134], 95.00th=[ 169], | 99.00th=[ 275], 99.50th=[ 313], 99.90th=[ 477], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 112, per=24.81%, avg=34.99, stdev=22.29, samples=347 iops : min= 1, max= 28, avg= 8.09, stdev= 5.61, samples=347 lat (msec) : 10=1.69%, 20=13.05%, 50=44.27%, 100=26.37%, 250=13.77% lat (msec) : 500=0.81%, 1000=0.03% cpu : usr=0.07%, sys=2.03%, ctx=4920, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=135KiB/s (138kB/s), 33.5KiB/s-34.2KiB/s (34.3kB/s-35.0kB/s), io=23.4MiB (24.6MB), run=177042-177892msec WRITE: bw=141KiB/s (145kB/s), 35.2KiB/s-35.8KiB/s (36.0kB/s-36.7kB/s), io=24.6MiB (25.7MB), run=177042-177892msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178302: Fri Aug 14 21:14:29 2026 read: IOPS=8, BW=139KiB/s (143kB/s)(5920KiB/42538msec) clat (usec): min=44, max=315303, avg=63884.37, stdev=41559.53 lat (usec): min=45, max=315304, avg=63895.92, stdev=41555.86 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 115], 10.00th=[ 24773], 20.00th=[ 35390], | 30.00th=[ 40633], 40.00th=[ 47449], 50.00th=[ 54789], 60.00th=[ 63701], | 70.00th=[ 74974], 80.00th=[ 90702], 90.00th=[116917], 95.00th=[135267], | 99.00th=[210764], 99.50th=[242222], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 30, max= 351, per=24.99%, avg=138.93, stdev=59.68, samples=83 iops : min= 1, max= 21, avg= 7.86, stdev= 3.78, samples=83 write: IOPS=9, BW=150KiB/s (153kB/s)(6368KiB/42538msec); 0 zone resets clat (usec): min=1662, max=223326, avg=46938.69, stdev=44231.29 lat (usec): min=1664, max=223329, avg=46992.72, stdev=44236.69 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 10], | 30.00th=[ 15], 40.00th=[ 22], 50.00th=[ 34], 60.00th=[ 44], | 70.00th=[ 59], 80.00th=[ 82], 90.00th=[ 115], 95.00th=[ 144], | 99.00th=[ 188], 99.50th=[ 197], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 349, per=25.61%, avg=149.83, stdev=69.01, samples=83 iops : min= 1, max= 21, avg= 8.55, stdev= 4.37, samples=83 lat (usec) : 50=0.13%, 100=2.08%, 250=0.52% lat (msec) : 2=0.39%, 4=2.34%, 10=8.33%, 20=8.59%, 50=31.90% lat (msec) : 100=32.03%, 250=13.54%, 500=0.13% cpu : usr=0.08%, sys=4.77%, ctx=1867, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178303: Fri Aug 14 21:14:29 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(5744KiB/42979msec) clat (usec): min=52, max=228806, avg=63321.42, stdev=33764.95 lat (usec): min=52, max=228808, avg=63322.92, stdev=33764.98 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 265], 10.00th=[ 26608], 20.00th=[ 36963], | 30.00th=[ 45876], 40.00th=[ 51643], 50.00th=[ 59507], 60.00th=[ 68682], | 70.00th=[ 76022], 80.00th=[ 85459], 90.00th=[109577], 95.00th=[125305], | 99.00th=[158335], 99.50th=[221250], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 21, max= 347, per=24.46%, avg=135.98, stdev=62.99, samples=83 iops : min= 1, max= 21, avg= 7.67, stdev= 3.95, samples=83 write: IOPS=9, BW=152KiB/s (156kB/s)(6544KiB/42979msec); 0 zone resets clat (usec): min=1673, max=238907, avg=48458.38, stdev=46780.05 lat (usec): min=1675, max=238910, avg=48461.32, stdev=46780.07 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 2311], 10.00th=[ 4015], 20.00th=[ 7635], | 30.00th=[ 13304], 40.00th=[ 22414], 50.00th=[ 37487], 60.00th=[ 48497], | 70.00th=[ 60556], 80.00th=[ 82314], 90.00th=[113771], 95.00th=[141558], | 99.00th=[196084], 99.50th=[225444], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 416, per=26.00%, avg=152.07, stdev=72.20, samples=84 iops : min= 1, max= 26, avg= 8.69, stdev= 4.59, samples=84 lat (usec) : 100=1.82%, 250=0.39%, 500=0.13% lat (msec) : 2=0.65%, 4=4.69%, 10=7.55%, 20=7.16%, 50=27.99% lat (msec) : 100=36.07%, 250=13.54% cpu : usr=0.07%, sys=4.82%, ctx=1838, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178304: Fri Aug 14 21:14:29 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6256KiB/43073msec) clat (usec): min=48, max=253722, avg=64161.34, stdev=41994.33 lat (usec): min=49, max=253724, avg=64162.95, stdev=41994.31 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 87], 10.00th=[ 21890], 20.00th=[ 34866], | 30.00th=[ 41157], 40.00th=[ 50070], 50.00th=[ 58459], 60.00th=[ 65274], | 70.00th=[ 76022], 80.00th=[ 88605], 90.00th=[114820], 95.00th=[137364], | 99.00th=[235930], 99.50th=[246416], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 283, per=26.48%, avg=147.22, stdev=58.20, samples=83 iops : min= 1, max= 17, avg= 8.39, stdev= 3.70, samples=83 write: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43073msec); 0 zone resets clat (usec): min=1780, max=246074, avg=47008.28, stdev=43547.33 lat (usec): min=1783, max=246078, avg=47044.41, stdev=43564.40 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 15], 40.00th=[ 26], 50.00th=[ 35], 60.00th=[ 47], | 70.00th=[ 63], 80.00th=[ 78], 90.00th=[ 106], 95.00th=[ 142], | 99.00th=[ 188], 99.50th=[ 201], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 319, per=23.90%, avg=139.82, stdev=73.17, samples=83 iops : min= 1, max= 19, avg= 7.93, stdev= 4.65, samples=83 lat (usec) : 50=0.13%, 100=3.12%, 250=0.13%, 1000=0.26% lat (msec) : 2=0.26%, 4=3.26%, 10=8.20%, 20=6.25%, 50=29.04% lat (msec) : 100=36.46%, 250=12.76%, 500=0.13% cpu : usr=0.07%, sys=4.76%, ctx=1875, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178305: Fri Aug 14 21:14:29 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6032KiB/41490msec) clat (usec): min=46, max=266205, avg=58849.17, stdev=42113.39 lat (usec): min=46, max=266206, avg=58851.25, stdev=42113.99 clat percentiles (usec): | 1.00th=[ 68], 5.00th=[ 78], 10.00th=[ 123], 20.00th=[ 28705], | 30.00th=[ 39060], 40.00th=[ 45351], 50.00th=[ 51643], 60.00th=[ 58459], | 70.00th=[ 70779], 80.00th=[ 85459], 90.00th=[112722], 95.00th=[137364], | 99.00th=[202376], 99.50th=[263193], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 286, per=26.28%, avg=146.12, stdev=54.87, samples=80 iops : min= 1, max= 17, avg= 8.32, stdev= 3.50, samples=80 write: IOPS=9, BW=151KiB/s (154kB/s)(6256KiB/41490msec); 0 zone resets clat (usec): min=1361, max=288665, avg=49157.09, stdev=48739.28 lat (usec): min=1363, max=288668, avg=49161.31, stdev=48739.90 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2442], 10.00th=[ 4948], 20.00th=[ 8455], | 30.00th=[ 15139], 40.00th=[ 25297], 50.00th=[ 34341], 60.00th=[ 46924], | 70.00th=[ 62129], 80.00th=[ 79168], 90.00th=[113771], 95.00th=[152044], | 99.00th=[210764], 99.50th=[278922], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 314, per=26.10%, avg=152.66, stdev=74.26, samples=80 iops : min= 1, max= 19, avg= 8.73, stdev= 4.69, samples=80 lat (usec) : 50=0.13%, 100=4.30%, 250=1.04%, 750=0.13% lat (msec) : 2=0.91%, 4=4.04%, 10=7.29%, 20=6.38%, 50=30.34% lat (msec) : 100=31.25%, 250=13.67%, 500=0.52% cpu : usr=0.07%, sys=4.81%, ctx=1776, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=556KiB/s (569kB/s), 134KiB/s-145KiB/s (137kB/s-149kB/s), io=23.4MiB (24.5MB), run=41490-43073msec WRITE: bw=585KiB/s (599kB/s), 140KiB/s-152KiB/s (143kB/s-156kB/s), io=24.6MiB (25.8MB), run=41490-43073msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178306: Fri Aug 14 21:14:41 2026 read: IOPS=6, BW=107KiB/s (110kB/s)(5920KiB/55246msec) clat (msec): min=9, max=258, avg=60.81, stdev=50.89 lat (msec): min=9, max=258, avg=60.81, stdev=50.89 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 64], 80.00th=[ 97], 90.00th=[ 142], 95.00th=[ 176], | 99.00th=[ 232], 99.50th=[ 249], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 30, max= 415, per=25.74%, avg=110.70, stdev=73.94, samples=103 iops : min= 1, max= 25, avg= 6.08, stdev= 4.66, samples=103 write: IOPS=7, BW=115KiB/s (118kB/s)(6368KiB/55246msec); 0 zone resets clat (msec): min=17, max=371, avg=81.85, stdev=55.53 lat (msec): min=17, max=371, avg=81.85, stdev=55.53 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 96], 80.00th=[ 116], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 330], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 22, max= 347, per=25.85%, avg=116.85, stdev=65.05, samples=106 iops : min= 1, max= 21, avg= 6.47, stdev= 4.09, samples=106 lat (msec) : 10=0.13%, 20=7.03%, 50=40.76%, 100=28.13%, 250=23.05% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.59%, ctx=1197, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178307: Fri Aug 14 21:14:41 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(5744KiB/55551msec) clat (msec): min=7, max=348, avg=55.98, stdev=51.25 lat (msec): min=7, max=348, avg=55.98, stdev=51.25 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 74], 90.00th=[ 114], 95.00th=[ 176], | 99.00th=[ 255], 99.50th=[ 292], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 22, max= 320, per=25.93%, avg=111.50, stdev=73.65, samples=100 iops : min= 1, max= 20, avg= 6.12, stdev= 4.63, samples=100 write: IOPS=7, BW=118KiB/s (121kB/s)(6544KiB/55551msec); 0 zone resets clat (msec): min=13, max=366, avg=85.69, stdev=60.59 lat (msec): min=13, max=366, avg=85.77, stdev=60.69 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 66], 60.00th=[ 78], | 70.00th=[ 99], 80.00th=[ 132], 90.00th=[ 167], 95.00th=[ 209], | 99.00th=[ 284], 99.50th=[ 363], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 22, max= 378, per=25.78%, avg=116.50, stdev=73.98, samples=109 iops : min= 1, max= 23, avg= 6.45, stdev= 4.68, samples=109 lat (msec) : 10=0.52%, 20=6.77%, 50=41.28%, 100=29.56%, 250=20.18% lat (msec) : 500=1.69% cpu : usr=0.07%, sys=1.78%, ctx=1238, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178308: Fri Aug 14 21:14:41 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54837msec) clat (msec): min=6, max=329, avg=58.63, stdev=52.35 lat (msec): min=6, max=329, avg=58.64, stdev=52.36 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 86], 90.00th=[ 128], 95.00th=[ 165], | 99.00th=[ 271], 99.50th=[ 296], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 412, per=27.24%, avg=117.11, stdev=74.93, samples=105 iops : min= 1, max= 25, avg= 6.50, stdev= 4.72, samples=105 write: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54837msec); 0 zone resets clat (msec): min=18, max=352, avg=83.69, stdev=55.52 lat (msec): min=18, max=352, avg=83.70, stdev=55.52 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 48], 40.00th=[ 56], 50.00th=[ 66], 60.00th=[ 78], | 70.00th=[ 96], 80.00th=[ 125], 90.00th=[ 171], 95.00th=[ 192], | 99.00th=[ 266], 99.50th=[ 338], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 30, max= 347, per=24.92%, avg=112.63, stdev=68.53, samples=105 iops : min= 1, max= 21, avg= 6.20, stdev= 4.33, samples=105 lat (msec) : 10=0.39%, 20=6.51%, 50=41.02%, 100=29.56%, 250=21.22% lat (msec) : 500=1.30% cpu : usr=0.04%, sys=1.78%, ctx=1221, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178309: Fri Aug 14 21:14:41 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55692msec) clat (msec): min=7, max=320, avg=62.93, stdev=56.13 lat (msec): min=7, max=320, avg=62.94, stdev=56.13 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 53], | 70.00th=[ 69], 80.00th=[ 94], 90.00th=[ 159], 95.00th=[ 184], | 99.00th=[ 255], 99.50th=[ 292], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 352, per=25.55%, avg=109.88, stdev=73.91, samples=105 iops : min= 1, max= 22, avg= 6.03, stdev= 4.68, samples=105 write: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55692msec); 0 zone resets clat (msec): min=15, max=281, avg=80.89, stdev=53.50 lat (msec): min=15, max=281, avg=80.91, stdev=53.51 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 78], | 70.00th=[ 95], 80.00th=[ 118], 90.00th=[ 157], 95.00th=[ 197], | 99.00th=[ 262], 99.50th=[ 279], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 316, per=24.53%, avg=110.88, stdev=71.90, samples=108 iops : min= 1, max= 19, avg= 6.09, stdev= 4.55, samples=108 lat (msec) : 10=0.65%, 20=9.38%, 50=36.20%, 100=30.99%, 250=21.74% lat (msec) : 500=1.04% cpu : usr=0.06%, sys=1.73%, ctx=1264, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=430KiB/s (440kB/s), 103KiB/s-114KiB/s (106kB/s-117kB/s), io=23.4MiB (24.5MB), run=54837-55692msec WRITE: bw=452KiB/s (463kB/s), 110KiB/s-118KiB/s (113kB/s-121kB/s), io=24.6MiB (25.8MB), run=54837-55692msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178324: Fri Aug 14 21:15:02 2026 read: IOPS=2, BW=2583KiB/s (2645kB/s)(7168KiB/2775msec) clat (msec): min=63, max=337, avg=165.40, stdev=103.08 lat (msec): min=63, max=337, avg=165.40, stdev=103.08 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 78], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 126], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 268], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2023, max= 6491, per=100.00%, avg=3519.00, stdev=2573.85, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=1, BW=1845KiB/s (1889kB/s)(5120KiB/2775msec); 0 zone resets clat (msec): min=91, max=582, avg=296.65, stdev=260.96 lat (msec): min=91, max=582, avg=296.91, stdev=260.87 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 123], 60.00th=[ 123], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1622, max= 4087, per=52.21%, avg=2439.75, stdev=1114.49, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=7.14%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178325: Fri Aug 14 21:15:02 2026 read: IOPS=0, BW=334KiB/s (342kB/s)(2048KiB/6135msec) clat (msec): min=135, max=411, avg=273.59, stdev=195.02 lat (msec): min=135, max=411, avg=273.59, stdev=195.02 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1605, max= 1805, per=51.08%, avg=1705.00, stdev=141.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1669KiB/s (1709kB/s)(10.0MiB/6135msec); 0 zone resets clat (msec): min=93, max=2615, avg=556.56, stdev=769.32 lat (msec): min=93, max=2616, avg=556.74, stdev=769.49 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 118], | 30.00th=[ 136], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 264], | 70.00th=[ 418], 80.00th=[ 776], 90.00th=[ 793], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1805, max= 4815, per=62.11%, avg=2902.60, stdev=1366.95, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=4.24%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178326: Fri Aug 14 21:15:02 2026 read: IOPS=1, BW=1313KiB/s (1344kB/s)(6144KiB/4681msec) clat (msec): min=97, max=317, avg=174.93, stdev=76.00 lat (msec): min=97, max=317, avg=174.93, stdev=76.00 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 157], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1969, max= 4063, per=100.00%, avg=3359.67, stdev=1204.38, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1313KiB/s (1344kB/s)(6144KiB/4681msec); 0 zone resets clat (msec): min=117, max=2384, avg=581.51, stdev=888.95 lat (msec): min=117, max=2388, avg=582.32, stdev=890.53 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 262], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1969, max= 4946, per=63.81%, avg=2982.00, stdev=1701.16, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.69%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178327: Fri Aug 14 21:15:02 2026 read: IOPS=0, BW=1021KiB/s (1045kB/s)(5120KiB/5015msec) clat (msec): min=128, max=651, avg=248.43, stdev=226.03 lat (msec): min=128, max=651, avg=248.43, stdev=226.03 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 4039, max= 4087, per=100.00%, avg=4063.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1429KiB/s (1464kB/s)(7168KiB/5015msec); 0 zone resets clat (msec): min=182, max=2124, avg=519.83, stdev=722.90 lat (msec): min=182, max=2124, avg=520.72, stdev=722.93 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 190], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 584], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 2023, max= 3611, per=57.97%, avg=2708.75, stdev=807.55, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=75.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.13%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3338KiB/s (3418kB/s), 334KiB/s-2583KiB/s (342kB/s-2645kB/s), io=20.0MiB (20.0MB), run=2775-6135msec WRITE: bw=4674KiB/s (4786kB/s), 1313KiB/s-1845KiB/s (1344kB/s-1889kB/s), io=28.0MiB (29.4MB), run=2775-6135msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178329: Fri Aug 14 21:15:03 2026 read: IOPS=1, BW=1423KiB/s (1457kB/s)(7168KiB/5037msec) clat (usec): min=593, max=2759.2k, avg=526413.92, stdev=987584.82 lat (usec): min=594, max=2759.2k, avg=526415.43, stdev=987584.75 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], | 20.00th=[ 132645], 30.00th=[ 154141], 40.00th=[ 154141], | 50.00th=[ 196084], 60.00th=[ 204473], 70.00th=[ 204473], | 80.00th=[ 240124], 90.00th=[2768241], 95.00th=[2768241], | 99.00th=[2768241], 99.50th=[2768241], 99.90th=[2768241], | 99.95th=[2768241], 99.99th=[2768241] bw ( KiB/s): min= 1756, max= 4087, per=69.38%, avg=2469.25, stdev=1085.51, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=1016KiB/s (1041kB/s)(5120KiB/5037msec); 0 zone resets clat (msec): min=185, max=375, avg=269.34, stdev=75.60 lat (msec): min=186, max=375, avg=269.70, stdev=75.24 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2023, max= 4087, per=54.55%, avg=2717.67, stdev=1185.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=10.62%, ctx=436, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178330: Fri Aug 14 21:15:03 2026 read: IOPS=0, BW=358KiB/s (367kB/s)(2048KiB/5716msec) clat (msec): min=190, max=225, avg=208.16, stdev=24.38 lat (msec): min=190, max=225, avg=208.16, stdev=24.38 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 1818, max= 2043, per=54.24%, avg=1930.50, stdev=159.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1791KiB/s (1834kB/s)(10.0MiB/5716msec); 0 zone resets clat (msec): min=96, max=2815, avg=529.34, stdev=814.42 lat (msec): min=96, max=2815, avg=529.49, stdev=814.45 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 129], | 30.00th=[ 131], 40.00th=[ 182], 50.00th=[ 288], 60.00th=[ 388], | 70.00th=[ 414], 80.00th=[ 422], 90.00th=[ 430], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 2023, max= 6059, per=73.01%, avg=3637.60, stdev=1682.73, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, >=2000=8.33% cpu : usr=0.03%, sys=10.88%, ctx=120, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178331: Fri Aug 14 21:15:03 2026 read: IOPS=1, BW=1178KiB/s (1206kB/s)(6144KiB/5215msec) clat (usec): min=642, max=323884, avg=108809.92, stdev=131785.01 lat (usec): min=644, max=323884, avg=108811.27, stdev=131784.74 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 840], | 30.00th=[ 840], 40.00th=[ 2024], 50.00th=[ 2024], 60.00th=[160433], | 70.00th=[164627], 80.00th=[164627], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 2023, max= 6071, per=94.94%, avg=3379.00, stdev=2331.36, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1178KiB/s (1206kB/s)(6144KiB/5215msec); 0 zone resets clat (msec): min=179, max=2642, avg=758.01, stdev=936.63 lat (msec): min=179, max=2642, avg=758.16, stdev=936.68 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 477], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1712, max= 2043, per=39.41%, avg=1963.40, stdev=141.85, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=7.63%, ctx=116, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178332: Fri Aug 14 21:15:03 2026 read: IOPS=0, BW=890KiB/s (911kB/s)(5120KiB/5754msec) clat (usec): min=590, max=106465, avg=34493.14, stdev=48014.85 lat (usec): min=591, max=106467, avg=34494.40, stdev=48015.01 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 594], | 30.00th=[ 1713], 40.00th=[ 1713], 50.00th=[ 1827], 60.00th=[ 1827], | 70.00th=[ 62129], 80.00th=[ 62129], 90.00th=[106431], 95.00th=[106431], | 99.00th=[106431], 99.50th=[106431], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1246KiB/s (1276kB/s)(7168KiB/5754msec); 0 zone resets clat (msec): min=112, max=2990, avg=796.60, stdev=1022.79 lat (msec): min=112, max=2991, avg=796.73, stdev=1022.82 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 142], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 393], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 936], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1996, max= 4047, per=60.74%, avg=3026.25, stdev=1174.10, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 100=8.33%, 250=33.33%, 500=8.33%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.77%, ctx=121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3559KiB/s (3645kB/s), 358KiB/s-1423KiB/s (367kB/s-1457kB/s), io=20.0MiB (20.0MB), run=5037-5754msec WRITE: bw=4983KiB/s (5103kB/s), 1016KiB/s-1791KiB/s (1041kB/s-1834kB/s), io=28.0MiB (29.4MB), run=5037-5754msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178340: Fri Aug 14 21:15:19 2026 read: IOPS=1, BW=4264KiB/s (4366kB/s)(12.0MiB/2882msec) clat (msec): min=844, max=942, avg=895.44, stdev=49.40 lat (msec): min=844, max=942, avg=895.45, stdev=49.41 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.59%, ctx=277, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178341: Fri Aug 14 21:15:19 2026 read: IOPS=0, BW=1453KiB/s (1488kB/s)(4096KiB/2819msec) clat (nsec): min=918788k, max=918788k, avg=918788085.00, stdev= 0.00 lat (nsec): min=918792k, max=918792k, avg=918792417.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2906KiB/s (2976kB/s)(8192KiB/2819msec); 0 zone resets clat (msec): min=661, max=862, avg=762.00, stdev=141.65 lat (msec): min=667, max=863, avg=765.17, stdev=138.48 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8078, max= 8078, per=83.13%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=6.42%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178342: Fri Aug 14 21:15:19 2026 write: IOPS=0, BW=3644KiB/s (3732kB/s)(12.0MiB/3372msec); 0 zone resets clat (msec): min=250, max=1610, avg=1045.21, stdev=708.44 lat (msec): min=251, max=1613, avg=1047.36, stdev=709.43 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8062, max= 8078, per=83.05%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.03%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178343: Fri Aug 14 21:15:19 2026 write: IOPS=0, BW=3995KiB/s (4091kB/s)(12.0MiB/3076msec); 0 zone resets clat (msec): min=314, max=2142, avg=929.85, stdev=1050.05 lat (msec): min=314, max=2144, avg=931.25, stdev=1050.35 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 6390, max= 8159, per=74.86%, avg=7274.50, stdev=1250.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.16%, sys=3.80%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5685KiB/s (5821kB/s), 1453KiB/s-4264KiB/s (1488kB/s-4366kB/s), io=16.0MiB (16.8MB), run=2819-2882msec WRITE: bw=9718KiB/s (9951kB/s), 2906KiB/s-3995KiB/s (2976kB/s-4091kB/s), io=32.0MiB (33.6MB), run=2819-3372msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178344: Fri Aug 14 21:15:20 2026 read: IOPS=0, BW=3265KiB/s (3344kB/s)(12.0MiB/3763msec) clat (msec): min=269, max=2173, avg=1170.43, stdev=956.13 lat (msec): min=269, max=2173, avg=1170.44, stdev=956.13 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7968, max= 8110, per=100.00%, avg=8039.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.98%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178345: Fri Aug 14 21:15:20 2026 read: IOPS=0, BW=1247KiB/s (1276kB/s)(4096KiB/3286msec) clat (nsec): min=1141.8M, max=1141.8M, avg=1141751643.00, stdev= 0.00 lat (nsec): min=1141.8M, max=1141.8M, avg=1141754450.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2493KiB/s (2553kB/s)(8192KiB/3286msec); 0 zone resets clat (msec): min=829, max=1190, avg=1009.81, stdev=254.97 lat (msec): min=832, max=1190, avg=1011.31, stdev=253.22 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8110, max= 8110, per=94.38%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.95%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178346: Fri Aug 14 21:15:20 2026 write: IOPS=0, BW=3223KiB/s (3300kB/s)(12.0MiB/3813msec); 0 zone resets clat (msec): min=339, max=2361, avg=1237.92, stdev=1029.38 lat (msec): min=340, max=2361, avg=1238.41, stdev=1029.34 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8015, max= 8110, per=93.83%, avg=8062.50, stdev=67.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.94%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178347: Fri Aug 14 21:15:20 2026 write: IOPS=0, BW=3921KiB/s (4015kB/s)(12.0MiB/3134msec); 0 zone resets clat (msec): min=258, max=2165, avg=1018.29, stdev=1010.71 lat (msec): min=259, max=2176, avg=1024.01, stdev=1015.79 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min=16221, max=16221, per=100.00%, avg=16221.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=4.02%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4354KiB/s (4458kB/s), 1247KiB/s-3265KiB/s (1276kB/s-3344kB/s), io=16.0MiB (16.8MB), run=3286-3763msec WRITE: bw=8594KiB/s (8800kB/s), 2493KiB/s-3921KiB/s (2553kB/s-4015kB/s), io=32.0MiB (33.6MB), run=3134-3813msec