== sanity test 398b: DIO and buffer IO race ============== 13:29:40 (1780334980) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.86722 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145722: Mon Jun 1 13:31:53 2026 read: IOPS=13, BW=53.6KiB/s (54.9kB/s)(5992KiB/111700msec) clat (usec): min=33, max=688083, avg=37123.98, stdev=32298.50 lat (usec): min=33, max=688086, avg=37125.86, stdev=32299.55 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 9634], 20.00th=[ 18482], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 32637], 60.00th=[ 37487], | 70.00th=[ 44303], 80.00th=[ 52167], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[123208], 99.50th=[164627], 99.90th=[354419], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 126, per=25.56%, avg=53.92, stdev=21.55, samples=218 iops : min= 1, max= 31, avg=12.84, stdev= 5.40, samples=218 write: IOPS=14, BW=56.4KiB/s (57.7kB/s)(6296KiB/111700msec); 0 zone resets clat (usec): min=1126, max=436104, avg=35341.18, stdev=38434.29 lat (usec): min=1127, max=436106, avg=35343.09, stdev=38434.20 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1893], 20.00th=[ 4359], | 30.00th=[ 8225], 40.00th=[ 16909], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 58983], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[152044], 99.50th=[198181], 99.90th=[371196], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 174, per=25.50%, avg=56.35, stdev=23.05, samples=219 iops : min= 1, max= 43, avg=13.44, stdev= 5.80, samples=219 lat (usec) : 50=0.55%, 100=3.19%, 250=0.46%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.50%, 4=4.04%, 10=8.04%, 20=11.95%, 50=41.41% lat (msec) : 100=20.90%, 250=3.52%, 500=0.23%, 750=0.03% cpu : usr=0.09%, sys=5.73%, ctx=6708, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145723: Mon Jun 1 13:31:53 2026 read: IOPS=13, BW=53.0KiB/s (55.3kB/s)(5940KiB/110035msec) clat (usec): min=35, max=923186, avg=37105.84, stdev=35204.98 lat (usec): min=35, max=923190, avg=37109.13, stdev=35205.32 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 73], 10.00th=[ 12518], 20.00th=[ 18220], | 30.00th=[ 22414], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 36439], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 66323], 95.00th=[ 80217], | 99.00th=[133694], 99.50th=[156238], 99.90th=[274727], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 112, per=25.70%, avg=54.22, stdev=21.12, samples=214 iops : min= 1, max= 28, avg=12.91, stdev= 5.28, samples=214 write: IOPS=14, BW=57.7KiB/s (59.1kB/s)(6348KiB/110035msec); 0 zone resets clat (usec): min=1162, max=213547, avg=34354.79, stdev=33012.52 lat (usec): min=1164, max=213549, avg=34358.20, stdev=33012.99 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1418], 10.00th=[ 2024], 20.00th=[ 4293], | 30.00th=[ 8225], 40.00th=[ 18220], 50.00th=[ 27919], 60.00th=[ 35390], | 70.00th=[ 44827], 80.00th=[ 60031], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[147850], 99.50th=[170918], 99.90th=[206570], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 118, per=26.04%, avg=57.56, stdev=20.95, samples=215 iops : min= 1, max= 29, avg=13.75, stdev= 5.27, samples=215 lat (usec) : 50=0.39%, 100=2.64%, 250=0.42%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.14%, 4=4.43%, 10=7.45%, 20=12.60%, 50=42.19% lat (msec) : 100=20.96%, 250=3.48%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.70%, ctx=6759, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145724: Mon Jun 1 13:31:53 2026 read: IOPS=13, BW=54.8KiB/s (56.1kB/s)(6028KiB/109967msec) clat (usec): min=33, max=756012, avg=36726.10, stdev=32803.11 lat (usec): min=34, max=756015, avg=36727.39, stdev=32803.13 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 11469], 20.00th=[ 18220], | 30.00th=[ 22676], 40.00th=[ 26608], 50.00th=[ 30802], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 66323], 95.00th=[ 81265], | 99.00th=[135267], 99.50th=[154141], 99.90th=[341836], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 6, max= 119, per=25.75%, avg=54.34, stdev=21.98, samples=217 iops : min= 1, max= 29, avg=12.94, stdev= 5.49, samples=217 write: IOPS=14, BW=56.9KiB/s (58.3kB/s)(6260KiB/109967msec); 0 zone resets clat (usec): min=1087, max=293259, avg=34697.50, stdev=33843.43 lat (usec): min=1089, max=293261, avg=34700.10, stdev=33842.83 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 1893], 20.00th=[ 4686], | 30.00th=[ 8848], 40.00th=[ 18482], 50.00th=[ 26870], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[168821], 99.90th=[287310], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 127, per=25.53%, avg=56.41, stdev=21.37, samples=217 iops : min= 1, max= 31, avg=13.47, stdev= 5.35, samples=217 lat (usec) : 50=0.42%, 100=3.06%, 250=0.46%, 500=0.07%, 750=0.07% lat (msec) : 2=5.34%, 4=3.91%, 10=7.42%, 20=12.08%, 50=42.87% lat (msec) : 100=21.06%, 250=3.09%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=5.72%, ctx=6851, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145725: Mon Jun 1 13:31:53 2026 read: IOPS=13, BW=53.3KiB/s (54.5kB/s)(6052KiB/113621msec) clat (usec): min=31, max=385883, avg=35664.98, stdev=27883.64 lat (usec): min=31, max=385884, avg=35669.28, stdev=27880.97 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 334], 20.00th=[ 17171], | 30.00th=[ 21365], 40.00th=[ 25297], 50.00th=[ 30016], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[131597], 99.50th=[160433], 99.90th=[221250], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 127, per=25.63%, avg=54.09, stdev=22.41, samples=218 iops : min= 1, max= 31, avg=12.88, stdev= 5.62, samples=218 write: IOPS=13, BW=54.9KiB/s (56.2kB/s)(6236KiB/113621msec); 0 zone resets clat (usec): min=1174, max=1067.6k, avg=37978.33, stdev=45682.88 lat (usec): min=1175, max=1067.6k, avg=37985.09, stdev=45681.13 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1418], 10.00th=[ 1893], | 20.00th=[ 4883], 30.00th=[ 9896], 40.00th=[ 18220], | 50.00th=[ 28181], 60.00th=[ 37487], 70.00th=[ 49546], | 80.00th=[ 62653], 90.00th=[ 85459], 95.00th=[ 107480], | 99.00th=[ 168821], 99.50th=[ 204473], 99.90th=[ 312476], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 165, per=24.87%, avg=54.97, stdev=22.14, samples=221 iops : min= 1, max= 41, avg=13.10, stdev= 5.56, samples=221 lat (usec) : 50=0.52%, 100=4.04%, 250=0.33%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.37%, 4=3.45%, 10=6.93%, 20=12.86%, 50=39.97% lat (msec) : 100=21.88%, 250=4.26%, 500=0.13%, 2000=0.03% cpu : usr=0.09%, sys=5.65%, ctx=6834, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=211KiB/s (216kB/s), 53.3KiB/s-54.8KiB/s (54.5kB/s-56.1kB/s), io=23.4MiB (24.6MB), run=109967-113621msec WRITE: bw=221KiB/s (227kB/s), 54.9KiB/s-57.7KiB/s (56.2kB/s-59.1kB/s), io=24.6MiB (25.7MB), run=109967-113621msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145717: Mon Jun 1 13:33:49 2026 read: IOPS=6, BW=26.4KiB/s (27.0kB/s)(5992KiB/227248msec) clat (msec): min=5, max=777, avg=30.03, stdev=37.07 lat (msec): min=5, max=777, avg=30.03, stdev=37.07 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 64], 95.00th=[ 88], | 99.00th=[ 146], 99.50th=[ 236], 99.90th=[ 368], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 104, per=27.54%, avg=28.65, stdev=19.18, samples=406 iops : min= 1, max= 26, avg= 6.56, stdev= 4.83, samples=406 write: IOPS=6, BW=27.7KiB/s (28.4kB/s)(6296KiB/227248msec); 0 zone resets clat (msec): min=43, max=464, avg=115.52, stdev=54.49 lat (msec): min=43, max=464, avg=115.53, stdev=54.49 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 73], | 30.00th=[ 82], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 114], | 70.00th=[ 131], 80.00th=[ 150], 90.00th=[ 184], 95.00th=[ 228], | 99.00th=[ 305], 99.50th=[ 338], 99.90th=[ 460], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 64, per=25.08%, avg=27.34, stdev=12.03, samples=446 iops : min= 1, max= 16, avg= 6.24, stdev= 3.09, samples=446 lat (msec) : 10=4.72%, 20=21.58%, 50=16.11%, 100=29.75%, 250=26.17% lat (msec) : 500=1.63%, 1000=0.03% cpu : usr=0.04%, sys=1.53%, ctx=5287, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145718: Mon Jun 1 13:33:49 2026 read: IOPS=6, BW=25.9KiB/s (26.5kB/s)(5940KiB/229139msec) clat (msec): min=5, max=1032, avg=30.32, stdev=41.81 lat (msec): min=5, max=1032, avg=30.33, stdev=41.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 39], 90.00th=[ 65], 95.00th=[ 92], | 99.00th=[ 163], 99.50th=[ 257], 99.90th=[ 359], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 95, per=27.50%, avg=28.60, stdev=18.96, samples=403 iops : min= 1, max= 23, avg= 6.56, stdev= 4.78, samples=403 write: IOPS=6, BW=27.7KiB/s (28.4kB/s)(6348KiB/229139msec); 0 zone resets clat (msec): min=33, max=549, avg=115.73, stdev=55.28 lat (msec): min=33, max=549, avg=115.73, stdev=55.28 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 83], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 113], | 70.00th=[ 130], 80.00th=[ 153], 90.00th=[ 188], 95.00th=[ 220], | 99.00th=[ 309], 99.50th=[ 347], 99.90th=[ 472], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 62, per=25.04%, avg=27.30, stdev=12.13, samples=450 iops : min= 1, max= 15, avg= 6.23, stdev= 3.11, samples=450 lat (msec) : 10=4.72%, 20=22.53%, 50=15.43%, 100=29.23%, 250=26.27% lat (msec) : 500=1.76%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.43%, ctx=5214, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145719: Mon Jun 1 13:33:49 2026 read: IOPS=6, BW=26.5KiB/s (27.2kB/s)(6028KiB/227251msec) clat (msec): min=5, max=375, avg=30.77, stdev=32.84 lat (msec): min=5, max=375, avg=30.77, stdev=32.84 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 68], 95.00th=[ 94], | 99.00th=[ 163], 99.50th=[ 190], 99.90th=[ 330], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 103, per=26.87%, avg=27.94, stdev=18.30, samples=419 iops : min= 1, max= 25, avg= 6.39, stdev= 4.61, samples=419 write: IOPS=6, BW=27.5KiB/s (28.2kB/s)(6260KiB/227251msec); 0 zone resets clat (msec): min=37, max=1069, avg=115.31, stdev=57.84 lat (msec): min=37, max=1069, avg=115.31, stdev=57.84 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 92], 50.00th=[ 101], 60.00th=[ 112], | 70.00th=[ 127], 80.00th=[ 150], 90.00th=[ 186], 95.00th=[ 218], | 99.00th=[ 300], 99.50th=[ 359], 99.90th=[ 464], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 56, per=24.88%, avg=27.11, stdev=12.22, samples=447 iops : min= 1, max= 14, avg= 6.18, stdev= 3.13, samples=447 lat (msec) : 10=4.13%, 20=22.46%, 50=15.53%, 100=30.21%, 250=26.17% lat (msec) : 500=1.46%, 2000=0.03% cpu : usr=0.05%, sys=1.52%, ctx=5222, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145720: Mon Jun 1 13:33:49 2026 read: IOPS=6, BW=26.6KiB/s (27.2kB/s)(6052KiB/227648msec) clat (msec): min=5, max=368, avg=29.94, stdev=31.06 lat (msec): min=5, max=368, avg=29.94, stdev=31.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 43], 90.00th=[ 66], 95.00th=[ 91], | 99.00th=[ 153], 99.50th=[ 188], 99.90th=[ 317], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 111, per=28.20%, avg=29.33, stdev=20.01, samples=401 iops : min= 1, max= 27, avg= 6.74, stdev= 5.07, samples=401 write: IOPS=6, BW=27.4KiB/s (28.1kB/s)(6236KiB/227648msec); 0 zone resets clat (msec): min=36, max=1169, avg=116.69, stdev=60.07 lat (msec): min=36, max=1169, avg=116.69, stdev=60.06 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 73], | 30.00th=[ 83], 40.00th=[ 91], 50.00th=[ 103], 60.00th=[ 113], | 70.00th=[ 130], 80.00th=[ 153], 90.00th=[ 194], 95.00th=[ 228], | 99.00th=[ 296], 99.50th=[ 326], 99.90th=[ 388], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 56, per=24.78%, avg=27.01, stdev=12.12, samples=447 iops : min= 1, max= 14, avg= 6.15, stdev= 3.11, samples=447 lat (msec) : 10=4.85%, 20=21.88%, 50=15.76%, 100=28.97%, 250=26.79% lat (msec) : 500=1.73%, 2000=0.03% cpu : usr=0.05%, sys=1.51%, ctx=5342, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=105KiB/s (107kB/s), 25.9KiB/s-26.6KiB/s (26.5kB/s-27.2kB/s), io=23.4MiB (24.6MB), run=227248-229139msec WRITE: bw=110KiB/s (112kB/s), 27.4KiB/s-27.7KiB/s (28.1kB/s-28.4kB/s), io=24.6MiB (25.7MB), run=227248-229139msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145775: Mon Jun 1 13:34:26 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(5920KiB/28201msec) clat (usec): min=36, max=234070, avg=40098.46, stdev=34131.45 lat (usec): min=36, max=234072, avg=40099.99, stdev=34131.45 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 265], | 30.00th=[ 24511], 40.00th=[ 31327], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 51643], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[183501], 99.50th=[196084], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 94, max= 383, per=24.45%, avg=207.60, stdev=65.74, samples=55 iops : min= 5, max= 23, avg=12.22, stdev= 4.12, samples=55 write: IOPS=14, BW=226KiB/s (231kB/s)(6368KiB/28201msec); 0 zone resets clat (usec): min=1563, max=273591, avg=32937.78, stdev=35911.86 lat (usec): min=1566, max=273594, avg=32944.59, stdev=35918.30 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1926], 10.00th=[ 2442], 20.00th=[ 5145], | 30.00th=[ 7635], 40.00th=[ 10683], 50.00th=[ 21103], 60.00th=[ 31327], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[158335], 99.50th=[181404], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 29, max= 384, per=25.25%, avg=225.49, stdev=92.14, samples=55 iops : min= 1, max= 24, avg=13.35, stdev= 5.82, samples=55 lat (usec) : 50=1.17%, 100=7.42%, 250=0.91%, 500=0.26% lat (msec) : 2=3.26%, 4=4.95%, 10=12.63%, 20=6.51%, 50=34.90% lat (msec) : 100=22.79%, 250=5.08%, 500=0.13% cpu : usr=0.08%, sys=5.91%, ctx=1559, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145776: Mon Jun 1 13:34:26 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(5744KiB/27208msec) clat (usec): min=39, max=139373, avg=36024.92, stdev=29599.98 lat (usec): min=40, max=139375, avg=36030.29, stdev=29598.32 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 97], | 30.00th=[ 22414], 40.00th=[ 27395], 50.00th=[ 33817], 60.00th=[ 38536], | 70.00th=[ 45876], 80.00th=[ 57934], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[119014], 99.50th=[139461], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 29, max= 409, per=25.21%, avg=214.06, stdev=88.47, samples=52 iops : min= 1, max= 25, avg=12.63, stdev= 5.63, samples=52 write: IOPS=15, BW=241KiB/s (246kB/s)(6544KiB/27208msec); 0 zone resets clat (usec): min=1529, max=356154, avg=34337.12, stdev=39291.74 lat (usec): min=1531, max=356157, avg=34346.37, stdev=39300.22 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2024], 10.00th=[ 2999], 20.00th=[ 5735], | 30.00th=[ 8848], 40.00th=[ 12649], 50.00th=[ 20317], 60.00th=[ 29492], | 70.00th=[ 41157], 80.00th=[ 60556], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[164627], 99.50th=[170918], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 29, max= 498, per=26.64%, avg=237.89, stdev=97.58, samples=53 iops : min= 1, max= 31, avg=14.15, stdev= 6.17, samples=53 lat (usec) : 50=1.04%, 100=8.33%, 250=1.17%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=5.60%, 10=10.29%, 20=10.55%, 50=34.90% lat (msec) : 100=20.83%, 250=4.30%, 500=0.13% cpu : usr=0.07%, sys=6.29%, ctx=1514, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145779: Mon Jun 1 13:34:26 2026 read: IOPS=14, BW=240KiB/s (246kB/s)(6256KiB/26075msec) clat (usec): min=39, max=266238, avg=37420.90, stdev=31224.45 lat (usec): min=39, max=266239, avg=37425.81, stdev=31224.01 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 139], | 30.00th=[ 23462], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 41681], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[149947], 99.50th=[196084], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 94, max= 447, per=28.45%, avg=241.55, stdev=80.39, samples=51 iops : min= 5, max= 27, avg=14.39, stdev= 5.14, samples=51 write: IOPS=14, BW=231KiB/s (237kB/s)(6032KiB/26075msec); 0 zone resets clat (usec): min=1496, max=155376, avg=30058.21, stdev=31215.92 lat (usec): min=1498, max=155378, avg=30060.57, stdev=31215.91 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2114], 10.00th=[ 2933], 20.00th=[ 4752], | 30.00th=[ 6915], 40.00th=[ 10683], 50.00th=[ 19268], 60.00th=[ 28705], | 70.00th=[ 42206], 80.00th=[ 52167], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[137364], 99.50th=[154141], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 95, max= 505, per=25.63%, avg=228.88, stdev=100.74, samples=51 iops : min= 5, max= 31, avg=13.59, stdev= 6.39, samples=51 lat (usec) : 50=0.78%, 100=8.85%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=1.95%, 4=6.38%, 10=11.07%, 20=7.94%, 50=37.24% lat (msec) : 100=21.22%, 250=3.39%, 500=0.13% cpu : usr=0.07%, sys=6.21%, ctx=1520, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145780: Mon Jun 1 13:34:26 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28072msec) clat (usec): min=31, max=289329, avg=37687.02, stdev=36017.50 lat (usec): min=31, max=289330, avg=37689.93, stdev=36018.35 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 123], | 30.00th=[ 20055], 40.00th=[ 26870], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 47973], 80.00th=[ 59507], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[160433], 99.50th=[233833], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 94, max= 382, per=25.46%, avg=216.19, stdev=77.05, samples=54 iops : min= 5, max= 23, avg=12.76, stdev= 4.85, samples=54 write: IOPS=13, BW=223KiB/s (228kB/s)(6256KiB/28072msec); 0 zone resets clat (usec): min=1447, max=245429, avg=34732.18, stdev=37767.90 lat (usec): min=1448, max=245431, avg=34734.52, stdev=37767.86 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1942], 10.00th=[ 2999], 20.00th=[ 5014], | 30.00th=[ 8586], 40.00th=[ 13042], 50.00th=[ 22676], 60.00th=[ 31851], | 70.00th=[ 44303], 80.00th=[ 58983], 90.00th=[ 82314], 95.00th=[107480], | 99.00th=[198181], 99.50th=[221250], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 60, max= 435, per=24.86%, avg=221.96, stdev=90.79, samples=55 iops : min= 3, max= 27, avg=13.13, stdev= 5.78, samples=55 lat (usec) : 50=1.69%, 100=7.42%, 250=1.69%, 500=0.78%, 750=0.26% lat (msec) : 2=3.26%, 4=4.82%, 10=10.55%, 20=7.94%, 50=34.77% lat (msec) : 100=21.09%, 250=5.60%, 500=0.13% cpu : usr=0.06%, sys=6.25%, ctx=1483, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=849KiB/s (870kB/s), 210KiB/s-240KiB/s (215kB/s-246kB/s), io=23.4MiB (24.5MB), run=26075-28201msec WRITE: bw=894KiB/s (915kB/s), 223KiB/s-241KiB/s (228kB/s-246kB/s), io=24.6MiB (25.8MB), run=26075-28201msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145777: Mon Jun 1 13:35:08 2026 read: IOPS=5, BW=85.7KiB/s (87.8kB/s)(5920KiB/69077msec) clat (msec): min=7, max=371, avg=39.88, stdev=39.83 lat (msec): min=7, max=371, avg=39.88, stdev=39.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 114], | 99.00th=[ 230], 99.50th=[ 305], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 288, per=27.27%, avg=93.82, stdev=56.69, samples=123 iops : min= 1, max= 18, avg= 5.11, stdev= 3.60, samples=123 write: IOPS=5, BW=92.2KiB/s (94.4kB/s)(6368KiB/69077msec); 0 zone resets clat (msec): min=49, max=410, avg=135.82, stdev=56.39 lat (msec): min=49, max=410, avg=135.83, stdev=56.39 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 174], 90.00th=[ 207], 95.00th=[ 234], | 99.00th=[ 359], 99.50th=[ 384], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 30, max= 191, per=25.70%, avg=93.04, stdev=36.96, samples=134 iops : min= 1, max= 11, avg= 5.06, stdev= 2.36, samples=134 lat (msec) : 10=1.43%, 20=12.63%, 50=23.57%, 100=22.40%, 250=37.63% lat (msec) : 500=2.34% cpu : usr=0.02%, sys=1.44%, ctx=1325, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145778: Mon Jun 1 13:35:08 2026 read: IOPS=5, BW=82.5KiB/s (84.5kB/s)(5744KiB/69595msec) clat (msec): min=8, max=375, avg=40.88, stdev=38.95 lat (msec): min=8, max=375, avg=40.88, stdev=38.95 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 91], 95.00th=[ 112], | 99.00th=[ 194], 99.50th=[ 226], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 30, max= 351, per=27.98%, avg=96.25, stdev=56.60, samples=118 iops : min= 1, max= 21, avg= 5.27, stdev= 3.55, samples=118 write: IOPS=5, BW=94.0KiB/s (96.3kB/s)(6544KiB/69595msec); 0 zone resets clat (msec): min=44, max=418, avg=133.81, stdev=52.22 lat (msec): min=44, max=418, avg=133.81, stdev=52.22 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 70], 10.00th=[ 81], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 114], 50.00th=[ 124], 60.00th=[ 136], | 70.00th=[ 148], 80.00th=[ 167], 90.00th=[ 203], 95.00th=[ 230], | 99.00th=[ 313], 99.50th=[ 330], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 191, per=26.41%, avg=95.62, stdev=35.49, samples=135 iops : min= 1, max= 11, avg= 5.24, stdev= 2.30, samples=135 lat (msec) : 10=0.78%, 20=12.89%, 50=22.27%, 100=21.09%, 250=41.15% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.41%, ctx=1428, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145781: Mon Jun 1 13:35:08 2026 read: IOPS=5, BW=94.9KiB/s (97.1kB/s)(6256KiB/65946msec) clat (msec): min=7, max=268, avg=35.58, stdev=29.00 lat (msec): min=7, max=268, avg=35.58, stdev=29.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 70], 95.00th=[ 90], | 99.00th=[ 148], 99.50th=[ 174], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 349, per=30.49%, avg=104.90, stdev=71.19, samples=118 iops : min= 1, max= 21, avg= 5.80, stdev= 4.54, samples=118 write: IOPS=5, BW=91.5KiB/s (93.7kB/s)(6032KiB/65946msec); 0 zone resets clat (msec): min=46, max=495, avg=137.22, stdev=61.87 lat (msec): min=46, max=495, avg=137.23, stdev=61.87 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 69], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 125], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 222], 95.00th=[ 259], | 99.00th=[ 359], 99.50th=[ 388], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 30, max= 191, per=25.05%, avg=90.68, stdev=36.84, samples=130 iops : min= 1, max= 11, avg= 4.89, stdev= 2.36, samples=130 lat (msec) : 10=1.82%, 20=13.28%, 50=26.04%, 100=23.05%, 250=32.55% lat (msec) : 500=3.26% cpu : usr=0.04%, sys=1.38%, ctx=1430, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145782: Mon Jun 1 13:35:08 2026 read: IOPS=5, BW=88.9KiB/s (91.1kB/s)(6032KiB/67823msec) clat (msec): min=7, max=196, avg=38.15, stdev=31.62 lat (msec): min=7, max=196, avg=38.15, stdev=31.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 77], 95.00th=[ 110], | 99.00th=[ 163], 99.50th=[ 188], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 30, max= 314, per=28.34%, avg=97.49, stdev=61.69, samples=121 iops : min= 1, max= 19, avg= 5.35, stdev= 3.89, samples=121 write: IOPS=5, BW=92.2KiB/s (94.5kB/s)(6256KiB/67823msec); 0 zone resets clat (msec): min=50, max=494, avg=136.42, stdev=55.82 lat (msec): min=50, max=494, avg=136.42, stdev=55.82 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 72], 10.00th=[ 81], 20.00th=[ 93], | 30.00th=[ 107], 40.00th=[ 115], 50.00th=[ 127], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 174], 90.00th=[ 201], 95.00th=[ 236], | 99.00th=[ 321], 99.50th=[ 384], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 31, max= 160, per=25.35%, avg=91.78, stdev=34.81, samples=134 iops : min= 1, max= 10, avg= 4.99, stdev= 2.24, samples=134 lat (msec) : 10=1.04%, 20=14.84%, 50=22.14%, 100=21.61%, 250=38.28% lat (msec) : 500=2.08% cpu : usr=0.03%, sys=1.46%, ctx=1384, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=344KiB/s (352kB/s), 82.5KiB/s-94.9KiB/s (84.5kB/s-97.1kB/s), io=23.4MiB (24.5MB), run=65946-69595msec WRITE: bw=362KiB/s (371kB/s), 91.5KiB/s-94.0KiB/s (93.7kB/s-96.3kB/s), io=24.6MiB (25.8MB), run=65946-69595msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145807: Mon Jun 1 13:35:27 2026 read: IOPS=0, BW=1016KiB/s (1040kB/s)(7168KiB/7056msec) clat (msec): min=188, max=2752, avg=674.67, stdev=926.08 lat (msec): min=188, max=2752, avg=674.67, stdev=926.08 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 222], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 313], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 584], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1787, max= 4015, per=82.05%, avg=2381.00, stdev=919.84, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=0, BW=726KiB/s (743kB/s)(5120KiB/7056msec); 0 zone resets clat (msec): min=177, max=851, avg=399.11, stdev=260.53 lat (msec): min=177, max=851, avg=399.21, stdev=260.56 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1787, max= 4039, per=60.79%, avg=2470.00, stdev=1052.10, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.61%, ctx=528, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145808: Mon Jun 1 13:35:27 2026 read: IOPS=0, BW=305KiB/s (313kB/s)(2048KiB/6709msec) clat (usec): min=912, max=249390, avg=125151.72, stdev=175700.30 lat (usec): min=914, max=249393, avg=125153.86, stdev=175701.31 clat percentiles (usec): | 1.00th=[ 914], 5.00th=[ 914], 10.00th=[ 914], 20.00th=[ 914], | 30.00th=[ 914], 40.00th=[ 914], 50.00th=[ 914], 60.00th=[248513], | 70.00th=[248513], 80.00th=[248513], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 1370, max= 2027, per=58.53%, avg=1698.50, stdev=464.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1526KiB/s (1563kB/s)(10.0MiB/6709msec); 0 zone resets clat (msec): min=107, max=3282, avg=621.04, stdev=949.33 lat (msec): min=107, max=3282, avg=621.40, stdev=949.23 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 207], | 30.00th=[ 249], 40.00th=[ 266], 50.00th=[ 300], 60.00th=[ 313], | 70.00th=[ 355], 80.00th=[ 405], 90.00th=[ 726], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 3574, max= 4096, per=96.85%, avg=3935.00, stdev=242.93, samples=4 iops : min= 3, max= 4, avg= 3.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.29%, ctx=189, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145809: Mon Jun 1 13:35:27 2026 read: IOPS=0, BW=961KiB/s (984kB/s)(6144KiB/6396msec) clat (usec): min=522, max=638731, avg=237091.96, stdev=279668.60 lat (usec): min=523, max=638732, avg=237093.38, stdev=279668.50 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 947], | 30.00th=[ 947], 40.00th=[ 2442], 50.00th=[ 2442], 60.00th=[299893], | 70.00th=[480248], 80.00th=[480248], 90.00th=[641729], 95.00th=[641729], | 99.00th=[641729], 99.50th=[641729], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 2027, max= 4096, per=100.00%, avg=3379.33, stdev=1171.86, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=961KiB/s (984kB/s)(6144KiB/6396msec); 0 zone resets clat (msec): min=166, max=3363, avg=815.99, stdev=1252.42 lat (msec): min=166, max=3363, avg=816.07, stdev=1252.43 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 368], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1787, max= 2763, per=52.77%, avg=2144.00, stdev=426.23, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.33%, ctx=174, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145810: Mon Jun 1 13:35:27 2026 read: IOPS=0, BW=854KiB/s (875kB/s)(5120KiB/5994msec) clat (msec): min=2, max=313, avg=124.27, stdev=142.87 lat (msec): min=2, max=313, avg=124.27, stdev=142.87 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 66], 60.00th=[ 66], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2048, max= 6059, per=100.00%, avg=4053.50, stdev=2836.21, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1196KiB/s (1225kB/s)(7168KiB/5994msec); 0 zone resets clat (msec): min=98, max=3202, avg=740.85, stdev=1098.82 lat (msec): min=98, max=3202, avg=741.18, stdev=1098.70 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 192], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 634], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1396, max= 4055, per=68.13%, avg=2768.25, stdev=1252.57, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 4=16.67%, 100=16.67%, 250=16.67%, 500=33.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.89%, ctx=141, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2902KiB/s (2972kB/s), 305KiB/s-1016KiB/s (313kB/s-1040kB/s), io=20.0MiB (20.0MB), run=5994-7056msec WRITE: bw=4063KiB/s (4161kB/s), 726KiB/s-1526KiB/s (743kB/s-1563kB/s), io=28.0MiB (29.4MB), run=5994-7056msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145812: Mon Jun 1 13:35:29 2026 read: IOPS=1, BW=1101KiB/s (1128kB/s)(7168KiB/6510msec) clat (msec): min=132, max=2773, avg=663.99, stdev=963.71 lat (msec): min=132, max=2773, avg=663.99, stdev=963.71 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 161], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 860], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1875, max= 4096, per=94.28%, avg=2408.00, stdev=945.81, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=786KiB/s (805kB/s)(5120KiB/6510msec); 0 zone resets clat (msec): min=205, max=900, avg=355.89, stdev=304.96 lat (msec): min=206, max=901, avg=355.97, stdev=304.94 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2015, max= 4007, per=75.22%, avg=2690.00, stdev=1140.67, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=58.33%, 500=16.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.63%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145813: Mon Jun 1 13:35:29 2026 read: IOPS=0, BW=255KiB/s (262kB/s)(2048KiB/8016msec) clat (msec): min=142, max=159, avg=150.87, stdev=11.77 lat (msec): min=142, max=159, avg=150.87, stdev=11.77 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 2007, max= 2048, per=79.39%, avg=2027.50, stdev=28.99, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1277KiB/s (1308kB/s)(10.0MiB/8016msec); 0 zone resets clat (msec): min=141, max=3463, avg=706.55, stdev=990.83 lat (msec): min=141, max=3463, avg=706.74, stdev=990.77 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 228], | 30.00th=[ 251], 40.00th=[ 300], 50.00th=[ 372], 60.00th=[ 388], | 70.00th=[ 397], 80.00th=[ 743], 90.00th=[ 776], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1675, max= 4096, per=70.82%, avg=2532.57, stdev=1060.56, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=3.19%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145814: Mon Jun 1 13:35:29 2026 read: IOPS=0, BW=784KiB/s (803kB/s)(6144KiB/7835msec) clat (msec): min=87, max=882, avg=334.63, stdev=308.19 lat (msec): min=87, max=882, avg=334.63, stdev=308.19 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 245], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1678, max= 2027, per=76.38%, avg=1950.80, stdev=152.79, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=784KiB/s (803kB/s)(6144KiB/7835msec); 0 zone resets clat (msec): min=183, max=3652, avg=875.27, stdev=1368.51 lat (msec): min=183, max=3652, avg=875.38, stdev=1368.51 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 355], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 2003, max= 4055, per=68.03%, avg=2432.60, stdev=907.09, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.02%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145815: Mon Jun 1 13:35:29 2026 read: IOPS=0, BW=654KiB/s (669kB/s)(5120KiB/7832msec) clat (msec): min=95, max=820, avg=306.65, stdev=294.06 lat (msec): min=95, max=820, avg=306.66, stdev=294.06 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1675, max= 4015, per=100.00%, avg=2569.67, stdev=1263.46, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=915KiB/s (937kB/s)(7168KiB/7832msec); 0 zone resets clat (msec): min=254, max=3480, avg=860.18, stdev=1174.10 lat (msec): min=254, max=3480, avg=860.27, stdev=1174.12 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 266], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 317], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 743], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1892, max= 4055, per=67.39%, avg=2409.80, stdev=921.81, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.22%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2555KiB/s (2616kB/s), 255KiB/s-1101KiB/s (262kB/s-1128kB/s), io=20.0MiB (20.0MB), run=6510-8016msec WRITE: bw=3577KiB/s (3663kB/s), 784KiB/s-1277KiB/s (803kB/s-1308kB/s), io=28.0MiB (29.4MB), run=6510-8016msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145827: Mon Jun 1 13:35:44 2026 read: IOPS=1, BW=5874KiB/s (6015kB/s)(12.0MiB/2092msec) clat (msec): min=534, max=719, avg=643.48, stdev=96.59 lat (msec): min=534, max=719, avg=643.48, stdev=96.59 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 5618, max= 8126, per=100.00%, avg=6872.00, stdev=1773.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=14.30%, ctx=289, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145828: Mon Jun 1 13:35:44 2026 read: IOPS=0, BW=1234KiB/s (1264kB/s)(4096KiB/3318msec) clat (nsec): min=649003k, max=649003k, avg=649002893.00, stdev= 0.00 lat (nsec): min=649005k, max=649005k, avg=649005468.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 5565, max= 5565, per=100.00%, avg=5565.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2469KiB/s (2528kB/s)(8192KiB/3318msec); 0 zone resets clat (msec): min=880, max=1733, avg=1307.29, stdev=603.15 lat (msec): min=881, max=1736, avg=1309.08, stdev=605.06 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8126, max= 8126, per=82.29%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.86%, ctx=107, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145829: Mon Jun 1 13:35:44 2026 write: IOPS=0, BW=3777KiB/s (3868kB/s)(12.0MiB/3253msec); 0 zone resets clat (msec): min=354, max=1463, avg=1071.07, stdev=621.78 lat (msec): min=354, max=1464, avg=1071.47, stdev=621.81 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8126, max= 8126, per=82.29%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.18%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145830: Mon Jun 1 13:35:44 2026 write: IOPS=1, BW=4533KiB/s (4641kB/s)(12.0MiB/2711msec); 0 zone resets clat (msec): min=524, max=1083, avg=888.51, stdev=315.77 lat (msec): min=526, max=1084, avg=889.44, stdev=314.89 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7757, max= 8047, per=80.02%, avg=7902.00, stdev=205.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.84%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4938KiB/s (5056kB/s), 1234KiB/s-5874KiB/s (1264kB/s-6015kB/s), io=16.0MiB (16.8MB), run=2092-3318msec WRITE: bw=9876KiB/s (10.1MB/s), 2469KiB/s-4533KiB/s (2528kB/s-4641kB/s), io=32.0MiB (33.6MB), run=2711-3318msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145823: Mon Jun 1 13:35:45 2026 read: IOPS=1, BW=5196KiB/s (5320kB/s)(12.0MiB/2365msec) clat (msec): min=372, max=1019, avg=744.68, stdev=334.62 lat (msec): min=372, max=1019, avg=744.69, stdev=334.62 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.72%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145824: Mon Jun 1 13:35:45 2026 read: IOPS=0, BW=1045KiB/s (1070kB/s)(4096KiB/3920msec) clat (nsec): min=710706k, max=710706k, avg=710705661.00, stdev= 0.00 lat (nsec): min=710708k, max=710708k, avg=710708466.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2090KiB/s (2140kB/s)(8192KiB/3920msec); 0 zone resets clat (msec): min=1114, max=1927, avg=1521.27, stdev=574.63 lat (msec): min=1115, max=1928, avg=1521.69, stdev=574.62 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1921], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8192, max= 8192, per=98.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.52%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145825: Mon Jun 1 13:35:45 2026 write: IOPS=0, BW=3224KiB/s (3301kB/s)(12.0MiB/3812msec); 0 zone resets clat (msec): min=275, max=1758, avg=1208.07, stdev=811.69 lat (msec): min=276, max=1765, avg=1210.93, stdev=814.09 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8110, max= 8192, per=97.51%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.10%, sys=2.81%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145826: Mon Jun 1 13:35:45 2026 write: IOPS=1, BW=5713KiB/s (5850kB/s)(12.0MiB/2151msec); 0 zone resets clat (msec): min=481, max=852, avg=662.23, stdev=186.07 lat (msec): min=481, max=853, avg=662.61, stdev=186.04 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8126, max= 8159, per=97.41%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.42%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4180KiB/s (4280kB/s), 1045KiB/s-5196KiB/s (1070kB/s-5320kB/s), io=16.0MiB (16.8MB), run=2365-3920msec WRITE: bw=8359KiB/s (8560kB/s), 2090KiB/s-5713KiB/s (2140kB/s-5850kB/s), io=32.0MiB (33.6MB), run=2151-3920msec