== sanity test 398b: DIO and buffer IO race ============== 10:31:19 (1782225079) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.19103 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178585: Tue Jun 23 10:34:01 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5992KiB/140757msec) clat (usec): min=52, max=824318, avg=51796.71, stdev=40015.77 lat (usec): min=53, max=824320, avg=51800.41, stdev=40014.62 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12256], 10.00th=[ 19006], 20.00th=[ 25822], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 43254], 60.00th=[ 52167], | 70.00th=[ 61604], 80.00th=[ 73925], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[175113], 99.50th=[196084], 99.90th=[375391], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 104, per=24.97%, avg=42.20, stdev=18.45, samples=276 iops : min= 1, max= 26, avg= 9.88, stdev= 4.64, samples=276 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6296KiB/140757msec); 0 zone resets clat (usec): min=1176, max=276599, avg=40014.75, stdev=41274.79 lat (usec): min=1178, max=276600, avg=40020.57, stdev=41276.25 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1565], 10.00th=[ 2311], 20.00th=[ 5145], | 30.00th=[ 8979], 40.00th=[ 18220], 50.00th=[ 28967], 60.00th=[ 38011], | 70.00th=[ 50594], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[126354], | 99.00th=[179307], 99.50th=[198181], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 157, per=25.12%, avg=44.46, stdev=22.17, samples=275 iops : min= 1, max= 39, avg=10.45, stdev= 5.59, samples=275 lat (usec) : 100=1.46%, 250=0.36%, 500=0.07%, 750=0.07% lat (msec) : 2=4.23%, 4=4.13%, 10=8.01%, 20=8.66%, 50=36.88% lat (msec) : 100=27.73%, 250=8.11%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=5.30%, ctx=6782, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178586: Tue Jun 23 10:34:01 2026 read: IOPS=10, BW=42.4KiB/s (43.4kB/s)(5940KiB/140154msec) clat (usec): min=33, max=840047, avg=52260.90, stdev=40804.95 lat (usec): min=33, max=840048, avg=52264.92, stdev=40803.93 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12911], 10.00th=[ 19530], 20.00th=[ 25560], | 30.00th=[ 31065], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 61080], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[189793], 99.50th=[246416], 99.90th=[291505], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 102, per=24.83%, avg=41.96, stdev=18.04, samples=275 iops : min= 1, max= 25, avg= 9.82, stdev= 4.53, samples=275 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6348KiB/140154msec); 0 zone resets clat (usec): min=1150, max=280340, avg=39245.51, stdev=39449.55 lat (usec): min=1152, max=280340, avg=39250.99, stdev=39446.54 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1450], 10.00th=[ 2376], 20.00th=[ 4817], | 30.00th=[ 9372], 40.00th=[ 18220], 50.00th=[ 29754], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[164627], 99.50th=[217056], 99.90th=[256902], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 126, per=25.39%, avg=44.94, stdev=20.79, samples=274 iops : min= 1, max= 31, avg=10.57, stdev= 5.24, samples=274 lat (usec) : 50=0.16%, 100=1.30%, 250=0.10%, 1000=0.03% lat (msec) : 2=4.52%, 4=4.46%, 10=7.23%, 20=8.56%, 50=37.14% lat (msec) : 100=28.68%, 250=7.58%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=5.36%, ctx=6850, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178587: Tue Jun 23 10:34:01 2026 read: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6028KiB/139004msec) clat (usec): min=37, max=337269, avg=50602.51, stdev=34128.99 lat (usec): min=37, max=337270, avg=50606.24, stdev=34128.29 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 137], 10.00th=[ 17957], 20.00th=[ 25297], | 30.00th=[ 31327], 40.00th=[ 38011], 50.00th=[ 44827], 60.00th=[ 51119], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[164627], 99.50th=[200279], 99.90th=[248513], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 103, per=25.64%, avg=43.33, stdev=19.20, samples=271 iops : min= 1, max= 25, avg=10.16, stdev= 4.82, samples=271 write: IOPS=11, BW=45.0KiB/s (46.1kB/s)(6260KiB/139004msec); 0 zone resets clat (usec): min=1171, max=883419, avg=39948.71, stdev=47862.04 lat (usec): min=1172, max=883421, avg=39953.21, stdev=47862.59 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 2147], 20.00th=[ 4555], | 30.00th=[ 8029], 40.00th=[ 15270], 50.00th=[ 26346], 60.00th=[ 35914], | 70.00th=[ 50070], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[120062], | 99.00th=[196084], 99.50th=[231736], 99.90th=[312476], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 127, per=25.21%, avg=44.63, stdev=21.78, samples=273 iops : min= 1, max= 31, avg=10.49, stdev= 5.49, samples=273 lat (usec) : 50=0.36%, 100=1.86%, 250=0.29%, 750=0.03%, 1000=0.03% lat (msec) : 2=4.72%, 4=4.75%, 10=7.65%, 20=8.95%, 50=35.29% lat (msec) : 100=27.93%, 250=7.91%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=5.34%, ctx=6712, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178588: Tue Jun 23 10:34:01 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6052KiB/141814msec) clat (usec): min=44, max=299832, avg=50879.36, stdev=34700.93 lat (usec): min=45, max=299834, avg=50883.54, stdev=34701.36 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 9503], 10.00th=[ 18220], 20.00th=[ 25560], | 30.00th=[ 30802], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 51119], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[175113], 99.50th=[208667], 99.90th=[291505], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 119, per=25.11%, avg=42.43, stdev=18.28, samples=276 iops : min= 1, max= 29, avg= 9.94, stdev= 4.61, samples=276 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6236KiB/141814msec); 0 zone resets clat (usec): min=1093, max=883816, avg=41467.95, stdev=47880.79 lat (usec): min=1093, max=883819, avg=41469.64, stdev=47880.83 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1532], 10.00th=[ 2540], 20.00th=[ 5669], | 30.00th=[ 10421], 40.00th=[ 19792], 50.00th=[ 28443], 60.00th=[ 39060], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[100140], 95.00th=[128451], | 99.00th=[196084], 99.50th=[248513], 99.90th=[350225], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 128, per=24.56%, avg=43.47, stdev=21.32, samples=278 iops : min= 1, max= 32, avg=10.20, stdev= 5.37, samples=278 lat (usec) : 50=0.16%, 100=1.82%, 250=0.20%, 500=0.13%, 750=0.03% lat (msec) : 2=4.20%, 4=3.55%, 10=7.03%, 20=8.92%, 50=37.92% lat (msec) : 100=27.41%, 250=8.27%, 500=0.33%, 1000=0.03% cpu : usr=0.08%, sys=5.26%, ctx=6798, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=169KiB/s (173kB/s), 42.4KiB/s-43.4KiB/s (43.4kB/s-44.4kB/s), io=23.4MiB (24.6MB), run=139004-141814msec WRITE: bw=177KiB/s (182kB/s), 43.0KiB/s-45.3KiB/s (45.0kB/s-46.4kB/s), io=24.6MiB (25.7MB), run=139004-141814msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178580: Tue Jun 23 10:34:46 2026 read: IOPS=8, BW=32.1KiB/s (32.8kB/s)(5992KiB/186916msec) clat (msec): min=6, max=900, avg=49.71, stdev=52.08 lat (msec): min=6, max=900, avg=49.71, stdev=52.08 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 112], 95.00th=[ 146], | 99.00th=[ 257], 99.50th=[ 271], 99.90th=[ 481], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 119, per=25.88%, avg=32.87, stdev=24.06, samples=354 iops : min= 1, max= 29, avg= 7.55, stdev= 6.04, samples=354 write: IOPS=8, BW=33.7KiB/s (34.5kB/s)(6296KiB/186916msec); 0 zone resets clat (msec): min=11, max=391, avg=71.20, stdev=51.84 lat (msec): min=11, max=391, avg=71.20, stdev=51.84 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 68], | 70.00th=[ 84], 80.00th=[ 104], 90.00th=[ 142], 95.00th=[ 176], | 99.00th=[ 257], 99.50th=[ 305], 99.90th=[ 355], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 119, per=25.47%, avg=33.88, stdev=22.53, samples=361 iops : min= 1, max= 29, avg= 7.80, stdev= 5.68, samples=361 lat (msec) : 10=1.01%, 20=12.96%, 50=43.07%, 100=26.53%, 250=15.43% lat (msec) : 500=0.98%, 1000=0.03% cpu : usr=0.06%, sys=2.11%, ctx=5220, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178581: Tue Jun 23 10:34:46 2026 read: IOPS=7, BW=31.7KiB/s (32.5kB/s)(5940KiB/187135msec) clat (msec): min=6, max=932, avg=47.25, stdev=47.59 lat (msec): min=6, max=932, avg=47.25, stdev=47.59 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 108], 95.00th=[ 142], | 99.00th=[ 197], 99.50th=[ 236], 99.90th=[ 305], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 125, per=25.91%, avg=32.91, stdev=23.99, samples=350 iops : min= 1, max= 31, avg= 7.55, stdev= 6.02, samples=350 write: IOPS=8, BW=33.9KiB/s (34.7kB/s)(6348KiB/187135msec); 0 zone resets clat (msec): min=13, max=458, avg=73.45, stdev=54.93 lat (msec): min=13, max=458, avg=73.46, stdev=54.93 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 56], 60.00th=[ 69], | 70.00th=[ 83], 80.00th=[ 107], 90.00th=[ 144], 95.00th=[ 184], | 99.00th=[ 264], 99.50th=[ 317], 99.90th=[ 439], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 103, per=25.50%, avg=33.91, stdev=21.83, samples=363 iops : min= 1, max= 25, avg= 7.81, stdev= 5.50, samples=363 lat (msec) : 10=1.04%, 20=13.51%, 50=42.48%, 100=26.11%, 250=16.02% lat (msec) : 500=0.81%, 1000=0.03% cpu : usr=0.06%, sys=2.09%, ctx=5274, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178582: Tue Jun 23 10:34:46 2026 read: IOPS=8, BW=32.1KiB/s (32.9kB/s)(6028KiB/187699msec) clat (msec): min=6, max=408, avg=50.81, stdev=47.83 lat (msec): min=6, max=408, avg=50.82, stdev=47.83 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 73], 90.00th=[ 115], 95.00th=[ 150], | 99.00th=[ 239], 99.50th=[ 268], 99.90th=[ 355], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 127, per=25.80%, avg=32.76, stdev=23.02, samples=356 iops : min= 1, max= 31, avg= 7.52, stdev= 5.80, samples=356 write: IOPS=8, BW=33.4KiB/s (34.2kB/s)(6260KiB/187699msec); 0 zone resets clat (msec): min=12, max=954, avg=70.76, stdev=57.24 lat (msec): min=12, max=954, avg=70.76, stdev=57.24 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 63], | 70.00th=[ 81], 80.00th=[ 102], 90.00th=[ 136], 95.00th=[ 176], | 99.00th=[ 271], 99.50th=[ 330], 99.90th=[ 468], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 111, per=25.41%, avg=33.79, stdev=22.76, samples=359 iops : min= 1, max= 27, avg= 7.78, stdev= 5.72, samples=359 lat (msec) : 10=1.07%, 20=12.37%, 50=43.75%, 100=26.11%, 250=15.66% lat (msec) : 500=1.01%, 1000=0.03% cpu : usr=0.05%, sys=2.07%, ctx=5084, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178583: Tue Jun 23 10:34:46 2026 read: IOPS=8, BW=32.8KiB/s (33.6kB/s)(6052KiB/184267msec) clat (msec): min=5, max=488, avg=49.11, stdev=46.81 lat (msec): min=5, max=488, avg=49.11, stdev=46.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 107], 95.00th=[ 146], | 99.00th=[ 232], 99.50th=[ 264], 99.90th=[ 409], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 142, per=26.98%, avg=34.27, stdev=23.78, samples=343 iops : min= 1, max= 35, avg= 7.90, stdev= 5.99, samples=343 write: IOPS=8, BW=33.8KiB/s (34.7kB/s)(6236KiB/184267msec); 0 zone resets clat (msec): min=11, max=963, avg=70.26, stdev=55.27 lat (msec): min=11, max=963, avg=70.26, stdev=55.27 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 105], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 249], 99.50th=[ 305], 99.90th=[ 489], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 119, per=25.30%, avg=33.64, stdev=22.25, samples=359 iops : min= 1, max= 29, avg= 7.74, stdev= 5.60, samples=359 lat (msec) : 10=1.24%, 20=12.34%, 50=44.73%, 100=24.84%, 250=16.11% lat (msec) : 500=0.72%, 1000=0.03% cpu : usr=0.05%, sys=2.20%, ctx=5294, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (131kB/s), 31.7KiB/s-32.8KiB/s (32.5kB/s-33.6kB/s), io=23.4MiB (24.6MB), run=184267-187699msec WRITE: bw=134KiB/s (137kB/s), 33.4KiB/s-33.9KiB/s (34.2kB/s-34.7kB/s), io=24.6MiB (25.7MB), run=184267-187699msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178640: Tue Jun 23 10:35:33 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(5920KiB/33806msec) clat (usec): min=36, max=262013, avg=50402.89, stdev=35620.91 lat (usec): min=37, max=262014, avg=50408.28, stdev=35618.92 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 67], 10.00th=[ 16712], 20.00th=[ 25560], | 30.00th=[ 32637], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[214959], 99.50th=[225444], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 349, per=25.11%, avg=171.48, stdev=69.94, samples=66 iops : min= 1, max= 21, avg= 9.89, stdev= 4.39, samples=66 write: IOPS=11, BW=188KiB/s (193kB/s)(6368KiB/33806msec); 0 zone resets clat (usec): min=1679, max=218266, avg=37778.93, stdev=36672.97 lat (usec): min=1682, max=218268, avg=37781.28, stdev=36673.01 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2540], 10.00th=[ 3851], 20.00th=[ 6980], | 30.00th=[ 11207], 40.00th=[ 18220], 50.00th=[ 28181], 60.00th=[ 36439], | 70.00th=[ 46924], 80.00th=[ 64750], 90.00th=[ 86508], 95.00th=[117965], | 99.00th=[158335], 99.50th=[185598], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 31, max= 411, per=25.93%, avg=186.41, stdev=74.35, samples=66 iops : min= 1, max= 25, avg=10.83, stdev= 4.73, samples=66 lat (usec) : 50=0.52%, 100=3.52%, 250=0.26% lat (msec) : 2=1.30%, 4=4.17%, 10=8.33%, 20=9.38%, 50=37.24% lat (msec) : 100=28.26%, 250=6.90%, 500=0.13% cpu : usr=0.09%, sys=6.08%, ctx=1774, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178641: Tue Jun 23 10:35:33 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5744KiB/33666msec) clat (usec): min=37, max=221120, avg=47364.77, stdev=35269.89 lat (usec): min=37, max=221121, avg=47366.98, stdev=35269.41 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 65], 10.00th=[ 97], 20.00th=[ 24249], | 30.00th=[ 29230], 40.00th=[ 35914], 50.00th=[ 40109], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 70779], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[179307], 99.50th=[214959], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 28, max= 348, per=25.31%, avg=172.88, stdev=70.38, samples=65 iops : min= 1, max= 21, avg= 9.98, stdev= 4.42, samples=65 write: IOPS=12, BW=194KiB/s (199kB/s)(6544KiB/33666msec); 0 zone resets clat (usec): min=1708, max=313174, avg=39906.32, stdev=39428.95 lat (usec): min=1710, max=313177, avg=39931.96, stdev=39410.27 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2311], 10.00th=[ 4228], 20.00th=[ 7504], | 30.00th=[ 11731], 40.00th=[ 21890], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 46924], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[168821], 99.50th=[175113], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 414, per=27.15%, avg=195.24, stdev=85.80, samples=66 iops : min= 1, max= 25, avg=11.39, stdev= 5.39, samples=66 lat (usec) : 50=0.65%, 100=4.04%, 250=0.78%, 500=0.13% lat (msec) : 2=1.82%, 4=3.39%, 10=8.59%, 20=7.94%, 50=39.06% lat (msec) : 100=26.95%, 250=6.51%, 500=0.13% cpu : usr=0.06%, sys=6.13%, ctx=1728, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178642: Tue Jun 23 10:35:33 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(6256KiB/35029msec) clat (usec): min=45, max=231383, avg=50331.51, stdev=34975.81 lat (usec): min=46, max=231385, avg=50332.95, stdev=34975.75 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 10159], 20.00th=[ 24773], | 30.00th=[ 32637], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 52167], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[110625], | 99.00th=[187696], 99.50th=[193987], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 380, per=26.04%, avg=177.84, stdev=75.77, samples=69 iops : min= 1, max= 23, avg=10.30, stdev= 4.80, samples=69 write: IOPS=10, BW=172KiB/s (176kB/s)(6032KiB/35029msec); 0 zone resets clat (usec): min=1692, max=188580, avg=40010.79, stdev=37362.64 lat (usec): min=1692, max=188582, avg=40017.25, stdev=37360.37 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2089], 10.00th=[ 3359], 20.00th=[ 6849], | 30.00th=[ 11994], 40.00th=[ 19792], 50.00th=[ 30278], 60.00th=[ 41681], | 70.00th=[ 52691], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[160433], 99.50th=[185598], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 374, per=23.44%, avg=168.57, stdev=71.03, samples=69 iops : min= 3, max= 23, avg= 9.72, stdev= 4.49, samples=69 lat (usec) : 50=0.13%, 100=4.04%, 250=0.52%, 500=0.13% lat (msec) : 2=2.21%, 4=4.17%, 10=6.90%, 20=9.11%, 50=35.03% lat (msec) : 100=30.21%, 250=7.55% cpu : usr=0.06%, sys=6.27%, ctx=1803, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178643: Tue Jun 23 10:35:33 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(6032KiB/33393msec) clat (usec): min=43, max=277374, avg=49518.38, stdev=38001.69 lat (usec): min=43, max=277376, avg=49519.73, stdev=38001.65 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 67], 10.00th=[ 133], 20.00th=[ 21890], | 30.00th=[ 29754], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 50594], | 70.00th=[ 62653], 80.00th=[ 71828], 90.00th=[ 95945], 95.00th=[114820], | 99.00th=[196084], 99.50th=[248513], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 411, per=26.82%, avg=183.18, stdev=64.31, samples=65 iops : min= 1, max= 25, avg=10.63, stdev= 4.03, samples=65 write: IOPS=11, BW=187KiB/s (192kB/s)(6256KiB/33393msec); 0 zone resets clat (usec): min=1451, max=193823, avg=36526.67, stdev=35324.71 lat (usec): min=1454, max=193824, avg=36529.98, stdev=35324.29 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2507], 10.00th=[ 3523], 20.00th=[ 6980], | 30.00th=[ 10683], 40.00th=[ 16909], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 48497], 80.00th=[ 63177], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[170918], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 447, per=26.09%, avg=187.56, stdev=81.63, samples=66 iops : min= 1, max= 27, avg=10.91, stdev= 5.12, samples=66 lat (usec) : 50=0.26%, 100=4.30%, 250=0.91%, 1000=0.13% lat (msec) : 2=1.17%, 4=5.08%, 10=8.20%, 20=11.59%, 50=34.38% lat (msec) : 100=26.95%, 250=6.90%, 500=0.13% cpu : usr=0.08%, sys=6.26%, ctx=1727, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=684KiB/s (700kB/s), 171KiB/s-181KiB/s (175kB/s-185kB/s), io=23.4MiB (24.5MB), run=33393-35029msec WRITE: bw=719KiB/s (737kB/s), 172KiB/s-194KiB/s (176kB/s-199kB/s), io=24.6MiB (25.8MB), run=33393-35029msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178636: Tue Jun 23 10:35:47 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(5920KiB/49178msec) clat (msec): min=9, max=263, avg=52.58, stdev=42.41 lat (msec): min=9, max=263, avg=52.59, stdev=42.42 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 78], 90.00th=[ 112], 95.00th=[ 133], | 99.00th=[ 222], 99.50th=[ 257], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 350, per=25.08%, avg=122.14, stdev=71.73, samples=95 iops : min= 1, max= 21, avg= 6.84, stdev= 4.53, samples=95 write: IOPS=8, BW=129KiB/s (133kB/s)(6368KiB/49178msec); 0 zone resets clat (msec): min=18, max=439, avg=74.19, stdev=46.98 lat (msec): min=18, max=439, avg=74.20, stdev=46.98 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 52], 50.00th=[ 60], 60.00th=[ 71], | 70.00th=[ 86], 80.00th=[ 103], 90.00th=[ 133], 95.00th=[ 167], | 99.00th=[ 243], 99.50th=[ 275], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 30, max= 350, per=25.43%, avg=130.21, stdev=65.80, samples=96 iops : min= 1, max= 21, avg= 7.35, stdev= 4.16, samples=96 lat (msec) : 10=0.13%, 20=7.68%, 50=42.45%, 100=31.51%, 250=17.45% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=2.22%, ctx=1367, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178637: Tue Jun 23 10:35:47 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(5744KiB/48738msec) clat (msec): min=9, max=221, avg=48.10, stdev=35.37 lat (msec): min=9, max=221, avg=48.11, stdev=35.37 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 34], 50.00th=[ 38], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 67], 90.00th=[ 94], 95.00th=[ 123], | 99.00th=[ 184], 99.50th=[ 192], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 28, max= 341, per=25.79%, avg=125.60, stdev=76.60, samples=90 iops : min= 1, max= 21, avg= 7.07, stdev= 4.85, samples=90 write: IOPS=8, BW=134KiB/s (137kB/s)(6544KiB/48738msec); 0 zone resets clat (msec): min=18, max=330, avg=76.32, stdev=49.33 lat (msec): min=18, max=330, avg=76.32, stdev=49.33 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 72], | 70.00th=[ 86], 80.00th=[ 108], 90.00th=[ 138], 95.00th=[ 186], | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 348, per=26.15%, avg=133.86, stdev=66.27, samples=96 iops : min= 1, max= 21, avg= 7.58, stdev= 4.18, samples=96 lat (msec) : 10=0.65%, 20=6.90%, 50=43.88%, 100=31.90%, 250=16.02% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=2.25%, ctx=1340, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178638: Tue Jun 23 10:35:47 2026 read: IOPS=7, BW=127KiB/s (131kB/s)(6256KiB/49082msec) clat (msec): min=6, max=353, avg=54.34, stdev=44.30 lat (msec): min=6, max=353, avg=54.34, stdev=44.30 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 61], 80.00th=[ 81], 90.00th=[ 113], 95.00th=[ 159], | 99.00th=[ 197], 99.50th=[ 234], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 350, per=27.04%, avg=131.69, stdev=76.41, samples=93 iops : min= 1, max= 21, avg= 7.44, stdev= 4.84, samples=93 write: IOPS=7, BW=123KiB/s (126kB/s)(6032KiB/49082msec); 0 zone resets clat (msec): min=22, max=259, avg=73.62, stdev=42.82 lat (msec): min=22, max=259, avg=73.63, stdev=42.82 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 71], | 70.00th=[ 86], 80.00th=[ 110], 90.00th=[ 134], 95.00th=[ 159], | 99.00th=[ 203], 99.50th=[ 243], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 310, per=24.31%, avg=124.47, stdev=62.42, samples=93 iops : min= 1, max= 19, avg= 7.00, stdev= 3.94, samples=93 lat (msec) : 10=0.39%, 20=5.86%, 50=46.48%, 100=29.17%, 250=17.84% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.19%, ctx=1343, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178639: Tue Jun 23 10:35:47 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48678msec) clat (msec): min=10, max=207, avg=51.07, stdev=37.84 lat (msec): min=10, max=207, avg=51.08, stdev=37.83 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 110], 95.00th=[ 138], | 99.00th=[ 180], 99.50th=[ 192], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 319, per=26.58%, avg=129.45, stdev=68.29, samples=91 iops : min= 1, max= 19, avg= 7.31, stdev= 4.32, samples=91 write: IOPS=8, BW=129KiB/s (132kB/s)(6256KiB/48678msec); 0 zone resets clat (msec): min=14, max=434, avg=74.57, stdev=47.73 lat (msec): min=14, max=434, avg=74.58, stdev=47.73 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 42], | 30.00th=[ 48], 40.00th=[ 54], 50.00th=[ 61], 60.00th=[ 69], | 70.00th=[ 84], 80.00th=[ 102], 90.00th=[ 132], 95.00th=[ 159], | 99.00th=[ 257], 99.50th=[ 342], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 31, max= 350, per=25.05%, avg=128.24, stdev=67.74, samples=96 iops : min= 1, max= 21, avg= 7.23, stdev= 4.25, samples=96 lat (msec) : 20=7.03%, 50=41.80%, 100=35.16%, 250=15.36%, 500=0.65% cpu : usr=0.05%, sys=2.25%, ctx=1307, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=487KiB/s (499kB/s), 118KiB/s-127KiB/s (121kB/s-131kB/s), io=23.4MiB (24.5MB), run=48678-49178msec WRITE: bw=512KiB/s (525kB/s), 123KiB/s-134KiB/s (126kB/s-137kB/s), io=24.6MiB (25.8MB), run=48678-49178msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178655: Tue Jun 23 10:36:03 2026 read: IOPS=1, BW=1686KiB/s (1727kB/s)(7168KiB/4251msec) clat (msec): min=128, max=589, avg=342.53, stdev=169.85 lat (msec): min=128, max=589, avg=342.53, stdev=169.85 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 169], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 405], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 451], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1961, max= 3923, per=65.06%, avg=2473.00, stdev=967.21, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1204KiB/s (1233kB/s)(5120KiB/4251msec); 0 zone resets clat (msec): min=149, max=535, avg=363.03, stdev=158.24 lat (msec): min=149, max=537, avg=363.41, stdev=158.65 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1841, max= 4047, per=46.48%, avg=2473.00, stdev=1052.61, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=3.34%, ctx=75, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178656: Tue Jun 23 10:36:03 2026 read: IOPS=0, BW=383KiB/s (392kB/s)(2048KiB/5353msec) clat (msec): min=135, max=752, avg=444.33, stdev=436.21 lat (msec): min=135, max=752, avg=444.33, stdev=436.21 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1444, max= 1841, per=43.21%, avg=1642.50, stdev=280.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1913KiB/s (1959kB/s)(10.0MiB/5353msec); 0 zone resets clat (msec): min=142, max=1023, avg=442.18, stdev=295.60 lat (msec): min=142, max=1023, avg=442.33, stdev=295.57 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 201], | 30.00th=[ 207], 40.00th=[ 232], 50.00th=[ 313], 60.00th=[ 338], | 70.00th=[ 498], 80.00th=[ 726], 90.00th=[ 743], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1444, max= 4071, per=47.12%, avg=2507.14, stdev=1082.05, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.31%, ctx=98, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178657: Tue Jun 23 10:36:03 2026 read: IOPS=1, BW=1140KiB/s (1168kB/s)(6144KiB/5388msec) clat (msec): min=127, max=832, avg=477.32, stdev=286.65 lat (msec): min=127, max=832, avg=477.32, stdev=286.65 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 502], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1841, max= 2023, per=51.49%, avg=1957.00, stdev=81.54, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1140KiB/s (1168kB/s)(6144KiB/5388msec); 0 zone resets clat (msec): min=163, max=795, avg=397.81, stdev=220.13 lat (msec): min=163, max=795, avg=397.96, stdev=220.11 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 359], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1961, max= 2635, per=40.75%, avg=2168.50, stdev=313.18, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=25.00% cpu : usr=0.00%, sys=3.29%, ctx=81, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178658: Tue Jun 23 10:36:03 2026 read: IOPS=1, BW=1088KiB/s (1114kB/s)(5120KiB/4705msec) clat (msec): min=190, max=577, avg=401.26, stdev=152.14 lat (msec): min=190, max=577, avg=401.27, stdev=152.14 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 3923, max= 3946, per=100.00%, avg=3934.50, stdev=16.26, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1523KiB/s (1560kB/s)(7168KiB/4705msec); 0 zone resets clat (msec): min=152, max=805, avg=372.58, stdev=240.39 lat (msec): min=152, max=805, avg=372.70, stdev=240.40 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 190], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 251], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 584], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1841, max= 4007, per=55.63%, avg=2960.25, stdev=1183.22, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=33.33%, 500=33.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=4.29%, ctx=107, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3801KiB/s (3892kB/s), 383KiB/s-1686KiB/s (392kB/s-1727kB/s), io=20.0MiB (20.0MB), run=4251-5388msec WRITE: bw=5321KiB/s (5449kB/s), 1140KiB/s-1913KiB/s (1168kB/s-1959kB/s), io=28.0MiB (29.4MB), run=4251-5388msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178660: Tue Jun 23 10:36:03 2026 read: IOPS=1, BW=1806KiB/s (1849kB/s)(7168KiB/3969msec) clat (usec): min=633, max=365930, avg=223460.72, stdev=143374.94 lat (usec): min=635, max=365931, avg=223462.33, stdev=143375.24 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 44827], | 30.00th=[252707], 40.00th=[252707], 50.00th=[270533], 60.00th=[287310], | 70.00th=[287310], 80.00th=[341836], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 1910, max= 4047, per=63.22%, avg=2406.80, stdev=918.29, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1290KiB/s (1321kB/s)(5120KiB/3969msec); 0 zone resets clat (msec): min=279, max=509, avg=411.35, stdev=98.04 lat (msec): min=279, max=509, avg=411.43, stdev=98.04 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1910, max= 3778, per=48.20%, avg=2569.00, stdev=1048.44, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 500=75.00%, 750=8.33% cpu : usr=0.00%, sys=12.47%, ctx=219, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178661: Tue Jun 23 10:36:03 2026 read: IOPS=0, BW=381KiB/s (390kB/s)(2048KiB/5379msec) clat (msec): min=195, max=255, avg=225.64, stdev=42.86 lat (msec): min=195, max=255, avg=225.64, stdev=42.87 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1426, max= 1872, per=43.31%, avg=1649.00, stdev=315.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1904KiB/s (1949kB/s)(10.0MiB/5379msec); 0 zone resets clat (msec): min=161, max=762, avg=475.34, stdev=224.86 lat (msec): min=164, max=763, avg=475.73, stdev=224.44 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 230], | 30.00th=[ 245], 40.00th=[ 305], 50.00th=[ 502], 60.00th=[ 558], | 70.00th=[ 575], 80.00th=[ 659], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1872, max= 4079, per=42.24%, avg=2251.62, stdev=740.57, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=12.37%, ctx=180, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178662: Tue Jun 23 10:36:03 2026 read: IOPS=1, BW=1551KiB/s (1588kB/s)(6144KiB/3961msec) clat (usec): min=508, max=367174, avg=230257.77, stdev=176848.92 lat (usec): min=510, max=367176, avg=230259.25, stdev=176848.92 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 4490], | 30.00th=[ 4490], 40.00th=[333448], 50.00th=[333448], 60.00th=[337642], | 70.00th=[341836], 80.00th=[341836], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 1872, max= 4071, per=86.92%, avg=3309.00, stdev=1245.24, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1551KiB/s (1588kB/s)(6144KiB/3961msec); 0 zone resets clat (msec): min=173, max=616, avg=372.60, stdev=175.34 lat (msec): min=173, max=616, avg=372.75, stdev=175.33 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 363], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1872, max= 4047, per=44.53%, avg=2373.40, stdev=937.68, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=8.33%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=11.09%, ctx=148, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178663: Tue Jun 23 10:36:03 2026 read: IOPS=1, BW=1089KiB/s (1115kB/s)(5120KiB/4703msec) clat (usec): min=501, max=491227, avg=215446.51, stdev=211967.47 lat (usec): min=502, max=491229, avg=215447.71, stdev=211967.63 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 1663], 40.00th=[ 1663], 50.00th=[287310], 60.00th=[287310], | 70.00th=[295699], 80.00th=[295699], 90.00th=[492831], 95.00th=[492831], | 99.00th=[492831], 99.50th=[492831], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 3820, max= 4000, per=100.00%, avg=3910.00, stdev=127.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1524KiB/s (1561kB/s)(7168KiB/4703msec); 0 zone resets clat (msec): min=158, max=792, avg=503.22, stdev=251.89 lat (msec): min=158, max=792, avg=503.31, stdev=251.89 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 288], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 493], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 751], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1889, max= 3908, per=43.40%, avg=2313.00, stdev=783.23, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=10.40%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3807KiB/s (3899kB/s), 381KiB/s-1806KiB/s (390kB/s-1849kB/s), io=20.0MiB (20.0MB), run=3961-5379msec WRITE: bw=5330KiB/s (5458kB/s), 1290KiB/s-1904KiB/s (1321kB/s-1949kB/s), io=28.0MiB (29.4MB), run=3961-5379msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178671: Tue Jun 23 10:36:19 2026 read: IOPS=0, BW=4077KiB/s (4175kB/s)(12.0MiB/3014msec) clat (msec): min=828, max=1075, avg=959.16, stdev=124.07 lat (msec): min=828, max=1075, avg=959.16, stdev=124.07 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7787, max= 7922, per=100.00%, avg=7854.50, stdev=95.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=12.78%, ctx=271, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178672: Tue Jun 23 10:36:19 2026 read: IOPS=0, BW=1070KiB/s (1095kB/s)(4096KiB/3829msec) clat (nsec): min=1070.5M, max=1070.5M, avg=1070486339.00, stdev= 0.00 lat (nsec): min=1070.5M, max=1070.5M, avg=1070489183.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2139KiB/s (2191kB/s)(8192KiB/3829msec); 0 zone resets clat (msec): min=1018, max=1489, avg=1253.89, stdev=332.57 lat (msec): min=1019, max=1489, avg=1254.23, stdev=332.57 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7937, max= 7937, per=92.75%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=4.10%, ctx=183, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178673: Tue Jun 23 10:36:19 2026 write: IOPS=1, BW=4376KiB/s (4481kB/s)(12.0MiB/2808msec); 0 zone resets clat (msec): min=560, max=1295, avg=866.46, stdev=382.66 lat (msec): min=560, max=1295, avg=866.98, stdev=382.59 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7670, max= 8159, per=92.49%, avg=7914.50, stdev=345.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.20%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178675: Tue Jun 23 10:36:19 2026 write: IOPS=0, BW=3900KiB/s (3993kB/s)(12.0MiB/3151msec); 0 zone resets clat (msec): min=399, max=2035, avg=967.51, stdev=925.38 lat (msec): min=399, max=2035, avg=967.84, stdev=925.36 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 7670, max= 8110, per=92.21%, avg=7890.00, stdev=311.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.33%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4279KiB/s (4382kB/s), 1070KiB/s-4077KiB/s (1095kB/s-4175kB/s), io=16.0MiB (16.8MB), run=3014-3829msec WRITE: bw=8558KiB/s (8763kB/s), 2139KiB/s-4376KiB/s (2191kB/s-4481kB/s), io=32.0MiB (33.6MB), run=2808-3829msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178674: Tue Jun 23 10:36:20 2026 read: IOPS=0, BW=3093KiB/s (3167kB/s)(12.0MiB/3973msec) clat (msec): min=502, max=1574, avg=1205.11, stdev=608.64 lat (msec): min=502, max=1574, avg=1205.11, stdev=608.64 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.82%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178676: Tue Jun 23 10:36:20 2026 read: IOPS=0, BW=954KiB/s (977kB/s)(4096KiB/4292msec) clat (nsec): min=2117.4M, max=2117.4M, avg=2117424506.00, stdev= 0.00 lat (nsec): min=2117.4M, max=2117.4M, avg=2117427472.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2123], 5.00th=[ 2123], 10.00th=[ 2123], 20.00th=[ 2123], | 30.00th=[ 2123], 40.00th=[ 2123], 50.00th=[ 2123], 60.00th=[ 2123], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1909KiB/s (1954kB/s)(8192KiB/4292msec); 0 zone resets clat (msec): min=957, max=1074, avg=1016.08, stdev=83.20 lat (msec): min=963, max=1076, avg=1019.71, stdev=79.70 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.47%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178677: Tue Jun 23 10:36:20 2026 write: IOPS=0, BW=2653KiB/s (2717kB/s)(12.0MiB/4632msec); 0 zone resets clat (msec): min=259, max=3265, avg=1454.55, stdev=1595.12 lat (msec): min=259, max=3267, avg=1455.49, stdev=1596.03 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.52%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178678: Tue Jun 23 10:36:20 2026 write: IOPS=0, BW=3033KiB/s (3106kB/s)(12.0MiB/4051msec); 0 zone resets clat (msec): min=350, max=2645, avg=1302.51, stdev=1196.25 lat (msec): min=351, max=2647, avg=1303.80, stdev=1197.11 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=2.86%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3817KiB/s (3909kB/s), 954KiB/s-3093KiB/s (977kB/s-3167kB/s), io=16.0MiB (16.8MB), run=3973-4292msec WRITE: bw=7074KiB/s (7244kB/s), 1909KiB/s-3033KiB/s (1954kB/s-3106kB/s), io=32.0MiB (33.6MB), run=4051-4632msec