== sanity test 398b: DIO and buffer IO race ============== 12:34:00 (1780331640) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.3774 s, 11.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184568: Mon Jun 1 12:36:08 2026 read: IOPS=13, BW=52.0KiB/s (54.2kB/s)(5992KiB/113122msec) clat (usec): min=41, max=824183, avg=42723.56, stdev=33613.32 lat (usec): min=41, max=824184, avg=42725.19, stdev=33613.18 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11469], 10.00th=[ 15926], 20.00th=[ 21627], | 30.00th=[ 26084], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 89654], | 99.00th=[135267], 99.50th=[154141], 99.90th=[246416], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 103, per=24.83%, avg=52.65, stdev=19.74, samples=222 iops : min= 1, max= 25, avg=12.50, stdev= 4.99, samples=222 write: IOPS=13, BW=55.7KiB/s (56.0kB/s)(6296KiB/113122msec); 0 zone resets clat (usec): min=1088, max=213123, avg=30967.97, stdev=31737.47 lat (usec): min=1089, max=213123, avg=30971.94, stdev=31737.95 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1516], 10.00th=[ 2245], 20.00th=[ 3949], | 30.00th=[ 6718], 40.00th=[ 13566], 50.00th=[ 22414], 60.00th=[ 29754], | 70.00th=[ 40109], 80.00th=[ 53216], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[137364], 99.50th=[147850], 99.90th=[204473], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 15, max= 119, per=24.92%, avg=55.32, stdev=22.75, samples=222 iops : min= 3, max= 29, avg=13.19, stdev= 5.72, samples=222 lat (usec) : 50=0.20%, 100=1.27%, 250=0.20%, 500=0.07%, 750=0.07% lat (msec) : 2=4.43%, 4=6.15%, 10=8.07%, 20=11.62%, 50=42.02% lat (msec) : 100=22.20%, 250=3.68%, 1000=0.03% cpu : usr=0.08%, sys=6.22%, ctx=6830, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184569: Mon Jun 1 12:36:08 2026 read: IOPS=13, BW=52.5KiB/s (53.8kB/s)(5940KiB/113155msec) clat (usec): min=33, max=243591, avg=41604.58, stdev=26365.51 lat (usec): min=33, max=243592, avg=41611.14, stdev=26378.08 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10421], 10.00th=[ 15664], 20.00th=[ 20841], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 58983], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[130548], 99.50th=[143655], 99.90th=[185598], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 119, per=24.62%, avg=52.19, stdev=20.02, samples=222 iops : min= 1, max= 29, avg=12.40, stdev= 5.04, samples=222 write: IOPS=14, BW=56.1KiB/s (57.4kB/s)(6348KiB/113155msec); 0 zone resets clat (usec): min=1045, max=766993, avg=32124.62, stdev=37378.78 lat (usec): min=1046, max=766994, avg=32127.37, stdev=37378.82 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1450], 10.00th=[ 2180], 20.00th=[ 4080], | 30.00th=[ 6980], 40.00th=[ 13960], 50.00th=[ 23200], 60.00th=[ 31065], | 70.00th=[ 40633], 80.00th=[ 53216], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[156238], 99.50th=[168821], 99.90th=[212861], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 8, max= 143, per=25.07%, avg=55.66, stdev=23.22, samples=222 iops : min= 2, max= 35, avg=13.27, stdev= 5.82, samples=222 lat (usec) : 50=0.33%, 100=1.33%, 250=0.13%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.72%, 4=5.57%, 10=8.66%, 20=11.46%, 50=41.60% lat (msec) : 100=22.14%, 250=3.97%, 1000=0.03% cpu : usr=0.08%, sys=6.22%, ctx=6868, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184570: Mon Jun 1 12:36:08 2026 read: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6028KiB/111988msec) clat (usec): min=34, max=238648, avg=40683.79, stdev=26733.88 lat (usec): min=34, max=238650, avg=40685.62, stdev=26733.32 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 8979], 10.00th=[ 15795], 20.00th=[ 20579], | 30.00th=[ 25297], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[131597], 99.50th=[152044], 99.90th=[231736], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 110, per=25.24%, avg=53.51, stdev=19.95, samples=220 iops : min= 1, max= 27, avg=12.73, stdev= 5.02, samples=220 write: IOPS=13, BW=55.9KiB/s (57.2kB/s)(6260KiB/111988msec); 0 zone resets clat (usec): min=1125, max=783682, avg=32122.44, stdev=36717.84 lat (usec): min=1126, max=783683, avg=32128.28, stdev=36717.89 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1467], 10.00th=[ 2311], 20.00th=[ 4424], | 30.00th=[ 7504], 40.00th=[ 15270], 50.00th=[ 23462], 60.00th=[ 30540], | 70.00th=[ 40109], 80.00th=[ 55313], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[137364], 99.50th=[149947], 99.90th=[198181], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 119, per=25.06%, avg=55.63, stdev=22.75, samples=220 iops : min= 1, max= 29, avg=13.25, stdev= 5.71, samples=220 lat (usec) : 50=0.26%, 100=1.43%, 250=0.33%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.17%, 4=5.24%, 10=8.37%, 20=12.70%, 50=41.80% lat (msec) : 100=22.01%, 250=3.52%, 1000=0.03% cpu : usr=0.07%, sys=6.22%, ctx=6749, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184571: Mon Jun 1 12:36:08 2026 read: IOPS=13, BW=53.7KiB/s (55.0kB/s)(6052KiB/112622msec) clat (usec): min=33, max=244747, avg=40722.18, stdev=26004.27 lat (usec): min=33, max=244749, avg=40730.54, stdev=26000.41 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11338], 10.00th=[ 15533], 20.00th=[ 20579], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 48497], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[131597], 99.50th=[147850], 99.90th=[225444], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 119, per=25.17%, avg=53.36, stdev=20.45, samples=221 iops : min= 1, max= 29, avg=12.69, stdev= 5.15, samples=221 write: IOPS=13, BW=55.4KiB/s (56.7kB/s)(6236KiB/112622msec); 0 zone resets clat (usec): min=1107, max=764518, avg=32452.80, stdev=36700.56 lat (usec): min=1109, max=764519, avg=32458.96, stdev=36708.67 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 2147], 20.00th=[ 3982], | 30.00th=[ 7308], 40.00th=[ 15270], 50.00th=[ 23725], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 55837], 90.00th=[ 73925], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[160433], 99.90th=[198181], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 135, per=24.75%, avg=54.94, stdev=22.34, samples=221 iops : min= 1, max= 33, avg=13.10, stdev= 5.63, samples=221 lat (usec) : 50=0.36%, 100=1.11%, 250=0.20%, 500=0.07% lat (msec) : 2=4.56%, 4=5.73%, 10=7.36%, 20=12.96%, 50=42.29% lat (msec) : 100=21.88%, 250=3.48%, 1000=0.03% cpu : usr=0.09%, sys=6.24%, ctx=6887, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=212KiB/s (217kB/s), 52.5KiB/s-53.8KiB/s (53.8kB/s-55.1kB/s), io=23.4MiB (24.6MB), run=111988-113155msec WRITE: bw=222KiB/s (228kB/s), 55.4KiB/s-56.1KiB/s (56.7kB/s-57.4kB/s), io=24.6MiB (25.7MB), run=111988-113155msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184573: Mon Jun 1 12:36:48 2026 read: IOPS=9, BW=39.4KiB/s (40.3kB/s)(5992KiB/152095msec) clat (msec): min=6, max=851, avg=39.88, stdev=38.56 lat (msec): min=6, max=851, avg=39.88, stdev=38.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 86], 95.00th=[ 111], | 99.00th=[ 161], 99.50th=[ 171], 99.90th=[ 251], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7, max= 150, per=25.26%, avg=39.66, stdev=25.51, samples=295 iops : min= 1, max= 37, avg= 9.26, stdev= 6.41, samples=295 write: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6296KiB/152095msec); 0 zone resets clat (msec): min=9, max=455, avg=58.58, stdev=42.11 lat (msec): min=9, max=455, avg=58.58, stdev=42.11 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 83], 90.00th=[ 112], 95.00th=[ 140], | 99.00th=[ 218], 99.50th=[ 241], 99.90th=[ 338], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 111, per=24.99%, avg=41.24, stdev=22.88, samples=298 iops : min= 1, max= 27, avg= 9.66, stdev= 5.76, samples=298 lat (msec) : 10=1.56%, 20=16.44%, 50=48.08%, 100=24.22%, 250=9.44% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.05%, sys=2.41%, ctx=5090, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184574: Mon Jun 1 12:36:48 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(5940KiB/151925msec) clat (msec): min=5, max=857, avg=38.59, stdev=38.62 lat (msec): min=5, max=857, avg=38.59, stdev=38.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 106], | 99.00th=[ 171], 99.50th=[ 194], 99.90th=[ 218], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 135, per=25.01%, avg=39.26, stdev=25.56, samples=294 iops : min= 1, max= 33, avg= 9.16, stdev= 6.42, samples=294 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6348KiB/151925msec); 0 zone resets clat (msec): min=9, max=446, avg=59.52, stdev=41.50 lat (msec): min=9, max=446, avg=59.52, stdev=41.50 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 86], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 199], 99.50th=[ 232], 99.90th=[ 338], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 118, per=25.07%, avg=41.36, stdev=23.33, samples=298 iops : min= 1, max= 29, avg= 9.69, stdev= 5.88, samples=298 lat (msec) : 10=1.86%, 20=16.80%, 50=46.61%, 100=24.32%, 250=10.16% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=2.36%, ctx=5031, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184575: Mon Jun 1 12:36:48 2026 read: IOPS=9, BW=39.8KiB/s (40.8kB/s)(6028KiB/151470msec) clat (msec): min=6, max=204, avg=40.68, stdev=34.27 lat (msec): min=6, max=204, avg=40.69, stdev=34.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 60], 90.00th=[ 88], 95.00th=[ 116], | 99.00th=[ 171], 99.50th=[ 182], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 7, max= 142, per=25.47%, avg=39.99, stdev=24.98, samples=293 iops : min= 1, max= 35, avg= 9.35, stdev= 6.29, samples=293 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6260KiB/151470msec); 0 zone resets clat (msec): min=9, max=834, avg=57.49, stdev=44.82 lat (msec): min=9, max=834, avg=57.50, stdev=44.82 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 81], 90.00th=[ 112], 95.00th=[ 138], | 99.00th=[ 209], 99.50th=[ 241], 99.90th=[ 372], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 127, per=24.73%, avg=40.80, stdev=24.38, samples=298 iops : min= 1, max= 31, avg= 9.55, stdev= 6.14, samples=298 lat (msec) : 10=1.46%, 20=15.59%, 50=49.32%, 100=23.34%, 250=10.09% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.06%, sys=2.47%, ctx=4957, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184576: Mon Jun 1 12:36:48 2026 read: IOPS=9, BW=39.8KiB/s (40.8kB/s)(6052KiB/152038msec) clat (msec): min=5, max=250, avg=39.26, stdev=33.13 lat (msec): min=5, max=250, avg=39.26, stdev=33.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 110], | 99.00th=[ 163], 99.50th=[ 178], 99.90th=[ 232], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 7, max= 159, per=25.71%, avg=40.37, stdev=25.46, samples=293 iops : min= 1, max= 39, avg= 9.44, stdev= 6.41, samples=293 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6236KiB/152038msec); 0 zone resets clat (msec): min=10, max=873, avg=59.33, stdev=44.90 lat (msec): min=10, max=873, avg=59.33, stdev=44.90 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 110], 95.00th=[ 138], | 99.00th=[ 215], 99.50th=[ 243], 99.90th=[ 372], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 103, per=24.69%, avg=40.74, stdev=22.42, samples=299 iops : min= 1, max= 25, avg= 9.54, stdev= 5.65, samples=299 lat (msec) : 10=1.79%, 20=14.91%, 50=49.02%, 100=23.96%, 250=10.16% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=2.42%, ctx=5115, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (162kB/s), 39.1KiB/s-39.8KiB/s (40.0kB/s-40.8kB/s), io=23.4MiB (24.6MB), run=151470-152095msec WRITE: bw=165KiB/s (169kB/s), 41.0KiB/s-41.8KiB/s (42.0kB/s-42.8kB/s), io=24.6MiB (25.7MB), run=151470-152095msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184612: Mon Jun 1 12:37:25 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(5920KiB/27049msec) clat (usec): min=50, max=204539, avg=39660.29, stdev=26723.09 lat (usec): min=51, max=204540, avg=39662.24, stdev=26723.94 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 70], 10.00th=[ 14746], 20.00th=[ 22414], | 30.00th=[ 26084], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 40633], | 70.00th=[ 46400], 80.00th=[ 54789], 90.00th=[ 66847], 95.00th=[ 88605], | 99.00th=[143655], 99.50th=[181404], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 384, per=24.71%, avg=217.49, stdev=77.74, samples=53 iops : min= 1, max= 24, avg=12.89, stdev= 4.94, samples=53 write: IOPS=14, BW=235KiB/s (241kB/s)(6368KiB/27049msec); 0 zone resets clat (usec): min=1679, max=210338, avg=30736.25, stdev=30074.76 lat (usec): min=1680, max=210341, avg=30740.72, stdev=30075.48 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2638], 10.00th=[ 3556], 20.00th=[ 5800], | 30.00th=[ 9241], 40.00th=[ 14877], 50.00th=[ 21627], 60.00th=[ 29492], | 70.00th=[ 38536], 80.00th=[ 50594], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[141558], 99.50th=[164627], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 64, max= 438, per=25.39%, avg=234.89, stdev=81.32, samples=53 iops : min= 4, max= 27, avg=13.98, stdev= 5.11, samples=53 lat (usec) : 100=3.52%, 250=0.39%, 500=0.13% lat (msec) : 2=0.78%, 4=4.95%, 10=11.07%, 20=12.11%, 50=44.40% lat (msec) : 100=19.66%, 250=2.99% cpu : usr=0.07%, sys=7.86%, ctx=1855, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184613: Mon Jun 1 12:37:25 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5744KiB/27076msec) clat (usec): min=50, max=167966, avg=38917.67, stdev=24735.74 lat (usec): min=51, max=167967, avg=38921.50, stdev=24736.58 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 103], 10.00th=[ 16057], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[116917], 99.50th=[166724], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 381, per=23.88%, avg=210.13, stdev=87.48, samples=53 iops : min= 1, max= 23, avg=12.42, stdev= 5.50, samples=53 write: IOPS=15, BW=242KiB/s (247kB/s)(6544KiB/27076msec); 0 zone resets clat (usec): min=1510, max=242153, avg=31858.62, stdev=31908.06 lat (usec): min=1511, max=242155, avg=31867.12, stdev=31903.95 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2278], 10.00th=[ 3294], 20.00th=[ 5604], | 30.00th=[ 9110], 40.00th=[ 15926], 50.00th=[ 22414], 60.00th=[ 30802], | 70.00th=[ 39060], 80.00th=[ 53216], 90.00th=[ 71828], 95.00th=[ 92799], | 99.00th=[128451], 99.50th=[162530], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 95, max= 448, per=25.69%, avg=237.62, stdev=87.01, samples=53 iops : min= 5, max= 28, avg=14.17, stdev= 5.50, samples=53 lat (usec) : 100=2.21%, 250=0.78%, 750=0.13% lat (msec) : 2=2.08%, 4=5.08%, 10=10.03%, 20=12.24%, 50=43.75% lat (msec) : 100=20.57%, 250=3.12% cpu : usr=0.06%, sys=7.35%, ctx=1785, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184614: Mon Jun 1 12:37:25 2026 read: IOPS=14, BW=230KiB/s (235kB/s)(6256KiB/27216msec) clat (usec): min=45, max=218038, avg=38149.52, stdev=25907.85 lat (usec): min=46, max=218039, avg=38150.94, stdev=25907.73 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 13829], 20.00th=[ 21365], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 46400], 80.00th=[ 54264], 90.00th=[ 64750], 95.00th=[ 78119], | 99.00th=[156238], 99.50th=[170918], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 95, max= 478, per=26.08%, avg=229.53, stdev=83.15, samples=53 iops : min= 5, max= 29, avg=13.64, stdev= 5.21, samples=53 write: IOPS=13, BW=222KiB/s (227kB/s)(6032KiB/27216msec); 0 zone resets clat (usec): min=1695, max=173209, avg=32187.19, stdev=30264.72 lat (usec): min=1697, max=173212, avg=32192.54, stdev=30262.99 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2737], 10.00th=[ 3916], 20.00th=[ 6063], | 30.00th=[ 9896], 40.00th=[ 16319], 50.00th=[ 23200], 60.00th=[ 30278], | 70.00th=[ 41157], 80.00th=[ 54789], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[127402], 99.50th=[168821], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 63, max= 442, per=23.58%, avg=218.09, stdev=83.15, samples=53 iops : min= 3, max= 27, avg=12.92, stdev= 5.21, samples=53 lat (usec) : 50=0.13%, 100=3.52%, 250=0.65%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.91%, 4=4.17%, 10=10.03%, 20=12.11%, 50=44.01% lat (msec) : 100=21.35%, 250=2.86% cpu : usr=0.12%, sys=7.77%, ctx=1883, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184615: Mon Jun 1 12:37:25 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26963msec) clat (usec): min=49, max=186969, avg=39509.31, stdev=28358.43 lat (usec): min=49, max=186970, avg=39512.32, stdev=28358.27 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 112], 20.00th=[ 20317], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[141558], 99.50th=[185598], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 116, max= 379, per=25.29%, avg=222.51, stdev=66.34, samples=53 iops : min= 7, max= 23, avg=13.21, stdev= 4.23, samples=53 write: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26963msec); 0 zone resets clat (usec): min=1711, max=227964, avg=30503.03, stdev=31709.86 lat (usec): min=1712, max=227966, avg=30505.24, stdev=31709.87 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 2671], 10.00th=[ 3884], 20.00th=[ 5669], | 30.00th=[ 8979], 40.00th=[ 12911], 50.00th=[ 20055], 60.00th=[ 26346], | 70.00th=[ 36439], 80.00th=[ 53216], 90.00th=[ 73925], 95.00th=[ 93848], | 99.00th=[131597], 99.50th=[219153], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 62, max= 383, per=25.16%, avg=232.70, stdev=77.38, samples=53 iops : min= 3, max= 23, avg=13.85, stdev= 4.81, samples=53 lat (usec) : 50=0.13%, 100=4.43%, 250=0.78%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=5.21%, 10=10.81%, 20=12.50%, 50=39.84% lat (msec) : 100=21.88%, 250=3.39% cpu : usr=0.10%, sys=7.59%, ctx=1781, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=880KiB/s (901kB/s), 212KiB/s-230KiB/s (217kB/s-235kB/s), io=23.4MiB (24.5MB), run=26963-27216msec WRITE: bw=926KiB/s (948kB/s), 222KiB/s-242KiB/s (227kB/s-247kB/s), io=24.6MiB (25.8MB), run=26963-27216msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184617: Mon Jun 1 12:37:34 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(5920KiB/36474msec) clat (msec): min=7, max=305, avg=39.09, stdev=32.00 lat (msec): min=7, max=305, avg=39.10, stdev=32.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 153], 99.50th=[ 167], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 448, per=24.60%, avg=160.62, stdev=93.50, samples=72 iops : min= 1, max= 28, avg= 9.21, stdev= 5.92, samples=72 write: IOPS=10, BW=175KiB/s (179kB/s)(6368KiB/36474msec); 0 zone resets clat (msec): min=14, max=260, avg=55.19, stdev=38.04 lat (msec): min=14, max=260, avg=55.19, stdev=38.04 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 108], 95.00th=[ 138], | 99.00th=[ 190], 99.50th=[ 197], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 446, per=25.25%, avg=173.47, stdev=90.72, samples=72 iops : min= 1, max= 27, avg=10.01, stdev= 5.71, samples=72 lat (msec) : 10=0.91%, 20=16.28%, 50=50.91%, 100=22.53%, 250=9.11% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=3.03%, ctx=1414, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184618: Mon Jun 1 12:37:34 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(5744KiB/35926msec) clat (msec): min=6, max=212, avg=38.77, stdev=31.82 lat (msec): min=6, max=212, avg=38.77, stdev=31.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 110], | 99.00th=[ 142], 99.50th=[ 167], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 512, per=24.76%, avg=161.66, stdev=99.84, samples=70 iops : min= 1, max= 32, avg= 9.27, stdev= 6.27, samples=70 write: IOPS=11, BW=182KiB/s (187kB/s)(6544KiB/35926msec); 0 zone resets clat (msec): min=13, max=300, avg=53.70, stdev=35.35 lat (msec): min=13, max=300, avg=53.70, stdev=35.35 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 75], 90.00th=[ 100], 95.00th=[ 120], | 99.00th=[ 167], 99.50th=[ 192], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 480, per=26.44%, avg=181.62, stdev=97.54, samples=71 iops : min= 1, max= 30, avg=10.52, stdev= 6.12, samples=71 lat (msec) : 10=1.17%, 20=15.89%, 50=49.35%, 100=25.13%, 250=8.20% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=2.89%, ctx=1315, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184619: Mon Jun 1 12:37:34 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(6256KiB/36019msec) clat (msec): min=8, max=249, avg=39.21, stdev=34.74 lat (msec): min=8, max=249, avg=39.21, stdev=34.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 190], 99.50th=[ 209], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 30, max= 510, per=26.66%, avg=174.11, stdev=112.64, samples=71 iops : min= 1, max= 31, avg=10.04, stdev= 7.07, samples=71 write: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36019msec); 0 zone resets clat (msec): min=10, max=260, avg=54.73, stdev=34.68 lat (msec): min=10, max=260, avg=54.74, stdev=34.67 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 64], 80.00th=[ 79], 90.00th=[ 102], 95.00th=[ 120], | 99.00th=[ 165], 99.50th=[ 218], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 448, per=24.22%, avg=166.42, stdev=90.19, samples=71 iops : min= 1, max= 28, avg= 9.56, stdev= 5.72, samples=71 lat (msec) : 10=1.56%, 20=16.41%, 50=48.83%, 100=24.35%, 250=8.72% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=3.02%, ctx=1407, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184620: Mon Jun 1 12:37:34 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6032KiB/36677msec) clat (msec): min=5, max=230, avg=40.96, stdev=35.47 lat (msec): min=5, max=230, avg=40.96, stdev=35.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 92], 95.00th=[ 117], | 99.00th=[ 176], 99.50th=[ 211], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 447, per=24.79%, avg=161.89, stdev=90.39, samples=72 iops : min= 1, max= 27, avg= 9.29, stdev= 5.69, samples=72 write: IOPS=10, BW=171KiB/s (175kB/s)(6256KiB/36677msec); 0 zone resets clat (msec): min=13, max=300, avg=54.18, stdev=38.02 lat (msec): min=13, max=300, avg=54.18, stdev=38.02 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 106], 95.00th=[ 127], | 99.00th=[ 186], 99.50th=[ 239], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 512, per=24.46%, avg=168.01, stdev=100.76, samples=72 iops : min= 1, max= 32, avg= 9.68, stdev= 6.38, samples=72 lat (msec) : 10=2.21%, 20=14.97%, 50=51.56%, 100=20.57%, 250=10.55% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.74%, ctx=1356, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=653KiB/s (669kB/s), 160KiB/s-174KiB/s (164kB/s-178kB/s), io=23.4MiB (24.5MB), run=35926-36677msec WRITE: bw=687KiB/s (704kB/s), 167KiB/s-182KiB/s (171kB/s-187kB/s), io=24.6MiB (25.8MB), run=35926-36677msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184632: Mon Jun 1 12:37:48 2026 read: IOPS=2, BW=2258KiB/s (2312kB/s)(7168KiB/3175msec) clat (usec): min=602, max=464300, avg=154528.36, stdev=170490.59 lat (usec): min=603, max=464302, avg=154529.70, stdev=170490.67 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 668], | 30.00th=[ 2704], 40.00th=[ 2704], 50.00th=[189793], 60.00th=[202376], | 70.00th=[202376], 80.00th=[221250], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 1899, max= 5953, per=59.30%, avg=2979.75, stdev=1983.22, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=1, BW=1613KiB/s (1651kB/s)(5120KiB/3175msec); 0 zone resets clat (msec): min=160, max=561, avg=331.03, stdev=148.01 lat (msec): min=160, max=561, avg=331.35, stdev=148.06 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1899, max= 4039, per=37.53%, avg=2640.67, stdev=1211.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=17.52%, ctx=129, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184633: Mon Jun 1 12:37:48 2026 read: IOPS=0, BW=503KiB/s (515kB/s)(2048KiB/4075msec) clat (msec): min=5, max=250, avg=127.79, stdev=172.94 lat (msec): min=5, max=250, avg=127.79, stdev=172.94 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 1899, max= 1928, per=38.08%, avg=1913.50, stdev=20.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2513KiB/s (2573kB/s)(10.0MiB/4075msec); 0 zone resets clat (msec): min=99, max=793, avg=371.12, stdev=237.79 lat (msec): min=99, max=793, avg=371.28, stdev=237.74 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 118], | 30.00th=[ 127], 40.00th=[ 230], 50.00th=[ 262], 60.00th=[ 456], | 70.00th=[ 489], 80.00th=[ 558], 90.00th=[ 584], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1899, max= 4023, per=33.14%, avg=2332.00, stdev=830.02, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 10=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.02%, sys=18.85%, ctx=165, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184634: Mon Jun 1 12:37:48 2026 read: IOPS=1, BW=1932KiB/s (1978kB/s)(6144KiB/3180msec) clat (usec): min=381, max=216738, avg=88620.47, stdev=99939.84 lat (usec): min=381, max=216739, avg=88621.56, stdev=99940.02 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 635], 50.00th=[ 635], 60.00th=[135267], | 70.00th=[179307], 80.00th=[179307], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 1899, max= 4096, per=66.56%, avg=3344.67, stdev=1252.31, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1932KiB/s (1978kB/s)(6144KiB/3180msec); 0 zone resets clat (msec): min=157, max=1288, avg=431.44, stdev=424.63 lat (msec): min=157, max=1288, avg=431.51, stdev=424.64 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 300], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 2019, max= 3799, per=41.04%, avg=2887.25, stdev=987.03, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=18.91%, ctx=183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184635: Mon Jun 1 12:37:48 2026 read: IOPS=1, BW=1913KiB/s (1959kB/s)(5120KiB/2676msec) clat (usec): min=660, max=361555, avg=188138.43, stdev=132614.16 lat (usec): min=662, max=361556, avg=188139.66, stdev=132614.16 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[135267], 40.00th=[135267], 50.00th=[219153], 60.00th=[219153], | 70.00th=[225444], 80.00th=[225444], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 4039, max= 4071, per=80.70%, avg=4055.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2679KiB/s (2743kB/s)(7168KiB/2676msec); 0 zone resets clat (msec): min=174, max=284, avg=224.78, stdev=41.19 lat (msec): min=174, max=284, avg=224.88, stdev=41.20 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 182], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 241], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 255], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 2763, max= 4039, per=50.88%, avg=3580.00, stdev=709.34, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=26.06%, ctx=239, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5026KiB/s (5146kB/s), 503KiB/s-2258KiB/s (515kB/s-2312kB/s), io=20.0MiB (20.0MB), run=2676-4075msec WRITE: bw=7036KiB/s (7205kB/s), 1613KiB/s-2679KiB/s (1651kB/s-2743kB/s), io=28.0MiB (29.4MB), run=2676-4075msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184636: Mon Jun 1 12:37:48 2026 read: IOPS=1, BW=2016KiB/s (2065kB/s)(7168KiB/3555msec) clat (msec): min=93, max=984, avg=278.64, stdev=315.35 lat (msec): min=93, max=984, avg=278.64, stdev=315.35 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 103], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 186], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 234], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1475, max= 4087, per=62.01%, avg=2835.75, stdev=1338.35, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1440KiB/s (1475kB/s)(5120KiB/3555msec); 0 zone resets clat (msec): min=139, max=467, avg=283.19, stdev=128.73 lat (msec): min=139, max=467, avg=283.30, stdev=128.77 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1903, max= 3842, per=40.55%, avg=2596.00, stdev=1081.34, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=7.96%, ctx=152, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184637: Mon Jun 1 12:37:48 2026 read: IOPS=0, BW=460KiB/s (471kB/s)(2048KiB/4457msec) clat (msec): min=64, max=652, avg=358.53, stdev=416.35 lat (msec): min=64, max=652, avg=358.53, stdev=416.35 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 65], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2039, max= 2048, per=44.69%, avg=2043.50, stdev= 6.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2298KiB/s (2353kB/s)(10.0MiB/4457msec); 0 zone resets clat (msec): min=108, max=751, avg=365.40, stdev=241.32 lat (msec): min=108, max=751, avg=365.49, stdev=241.33 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 127], | 30.00th=[ 171], 40.00th=[ 230], 50.00th=[ 259], 60.00th=[ 262], | 70.00th=[ 464], 80.00th=[ 584], 90.00th=[ 709], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1921, max= 6119, per=56.41%, avg=3611.40, stdev=1725.64, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=7.23%, ctx=113, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184638: Mon Jun 1 12:37:48 2026 read: IOPS=1, BW=1372KiB/s (1405kB/s)(6144KiB/4478msec) clat (msec): min=93, max=462, avg=214.28, stdev=151.49 lat (msec): min=93, max=462, avg=214.28, stdev=151.49 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 2048, max= 4079, per=72.40%, avg=3311.00, stdev=1102.27, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1372KiB/s (1405kB/s)(6144KiB/4478msec); 0 zone resets clat (msec): min=105, max=1371, avg=520.78, stdev=477.07 lat (msec): min=105, max=1372, avg=521.02, stdev=477.25 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 558], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1921, max= 4079, per=37.57%, avg=2405.20, stdev=937.43, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=4.11%, ctx=82, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184639: Mon Jun 1 12:37:48 2026 read: IOPS=1, BW=1199KiB/s (1228kB/s)(5120KiB/4269msec) clat (msec): min=65, max=127, avg=105.10, stdev=24.90 lat (msec): min=65, max=127, avg=105.10, stdev=24.90 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 109], 60.00th=[ 109], | 70.00th=[ 125], 80.00th=[ 125], 90.00th=[ 129], 95.00th=[ 129], | 99.00th=[ 129], 99.50th=[ 129], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1679KiB/s (1719kB/s)(7168KiB/4269msec); 0 zone resets clat (msec): min=81, max=1718, avg=509.44, stdev=571.57 lat (msec): min=81, max=1718, avg=509.55, stdev=571.57 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 91], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 305], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 609], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1903, max= 2048, per=30.89%, avg=1977.75, stdev=76.36, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=5.46%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4573KiB/s (4683kB/s), 460KiB/s-2016KiB/s (471kB/s-2065kB/s), io=20.0MiB (20.0MB), run=3555-4478msec WRITE: bw=6403KiB/s (6557kB/s), 1372KiB/s-2298KiB/s (1405kB/s-2353kB/s), io=28.0MiB (29.4MB), run=3555-4478msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184646: Mon Jun 1 12:38:00 2026 read: IOPS=1, BW=5702KiB/s (5839kB/s)(12.0MiB/2155msec) clat (msec): min=608, max=723, avg=678.23, stdev=61.04 lat (msec): min=608, max=723, avg=678.23, stdev=61.04 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7846, max= 8175, per=100.00%, avg=8010.50, stdev=232.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=19.78%, ctx=248, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184647: Mon Jun 1 12:38:00 2026 read: IOPS=0, BW=1592KiB/s (1630kB/s)(4096KiB/2573msec) clat (nsec): min=767289k, max=767289k, avg=767289360.00, stdev= 0.00 lat (nsec): min=767292k, max=767292k, avg=767292257.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3184KiB/s (3260kB/s)(8192KiB/2573msec); 0 zone resets clat (msec): min=566, max=1198, avg=882.82, stdev=446.94 lat (msec): min=567, max=1199, avg=883.33, stdev=447.10 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7846, max= 7846, per=61.61%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=7.27%, ctx=132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184648: Mon Jun 1 12:38:00 2026 write: IOPS=1, BW=5322KiB/s (5450kB/s)(12.0MiB/2309msec); 0 zone resets clat (msec): min=495, max=894, avg=759.89, stdev=228.99 lat (msec): min=496, max=895, avg=760.98, stdev=229.49 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8062, max= 8175, per=63.75%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=9.36%, ctx=87, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184649: Mon Jun 1 12:38:00 2026 write: IOPS=1, BW=5626KiB/s (5761kB/s)(12.0MiB/2184msec); 0 zone resets clat (msec): min=258, max=1303, avg=700.62, stdev=540.70 lat (msec): min=258, max=1303, avg=701.11, stdev=540.43 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.41%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6368KiB/s (6520kB/s), 1592KiB/s-5702KiB/s (1630kB/s-5839kB/s), io=16.0MiB (16.8MB), run=2155-2573msec WRITE: bw=12.4MiB/s (13.0MB/s), 3184KiB/s-5626KiB/s (3260kB/s-5761kB/s), io=32.0MiB (33.6MB), run=2184-2573msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184651: Mon Jun 1 12:38:01 2026 read: IOPS=1, BW=4874KiB/s (4991kB/s)(12.0MiB/2521msec) clat (msec): min=185, max=1145, avg=793.10, stdev=528.23 lat (msec): min=185, max=1145, avg=793.10, stdev=528.23 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.44%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184652: Mon Jun 1 12:38:01 2026 read: IOPS=0, BW=1481KiB/s (1516kB/s)(4096KiB/2766msec) clat (nsec): min=957714k, max=957714k, avg=957713786.00, stdev= 0.00 lat (nsec): min=957716k, max=957716k, avg=957716278.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2962KiB/s (3033kB/s)(8192KiB/2766msec); 0 zone resets clat (msec): min=724, max=1029, avg=877.10, stdev=216.23 lat (msec): min=724, max=1030, avg=877.54, stdev=216.13 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8078, max= 8078, per=68.19%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.74%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184653: Mon Jun 1 12:38:01 2026 write: IOPS=1, BW=4524KiB/s (4633kB/s)(12.0MiB/2716msec); 0 zone resets clat (msec): min=201, max=1386, avg=853.37, stdev=601.44 lat (msec): min=201, max=1388, avg=854.18, stdev=601.99 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=69.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.05%, ctx=33, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184654: Mon Jun 1 12:38:01 2026 write: IOPS=1, BW=5578KiB/s (5712kB/s)(12.0MiB/2203msec); 0 zone resets clat (msec): min=196, max=1414, avg=684.68, stdev=643.54 lat (msec): min=197, max=1414, avg=685.17, stdev=643.32 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 5557, max= 5557, per=46.91%, avg=5557.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.35%, ctx=94, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5923KiB/s (6066kB/s), 1481KiB/s-4874KiB/s (1516kB/s-4991kB/s), io=16.0MiB (16.8MB), run=2521-2766msec WRITE: bw=11.6MiB/s (12.1MB/s), 2962KiB/s-5578KiB/s (3033kB/s-5712kB/s), io=32.0MiB (33.6MB), run=2203-2766msec