== sanity test 398b: DIO and buffer IO race ============== 03:43:10 (1785397390) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.86949 s, 6.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178847: Thu Jul 30 03:46:28 2026 read: IOPS=8, BW=34.8KiB/s (35.7kB/s)(5992KiB/172005msec) clat (usec): min=42, max=1062.5k, avg=63621.40, stdev=47626.11 lat (usec): min=42, max=1062.5k, avg=63623.02, stdev=47626.13 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 15795], 10.00th=[ 22676], | 20.00th=[ 31851], 30.00th=[ 40109], 40.00th=[ 47973], | 50.00th=[ 56361], 60.00th=[ 65799], 70.00th=[ 74974], | 80.00th=[ 87557], 90.00th=[ 108528], 95.00th=[ 133694], | 99.00th=[ 223347], 99.50th=[ 242222], 99.90th=[ 299893], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 7, max= 111, per=25.12%, avg=34.92, stdev=16.10, samples=332 iops : min= 1, max= 27, avg= 8.06, stdev= 4.06, samples=332 write: IOPS=9, BW=36.6KiB/s (37.5kB/s)(6296KiB/172005msec); 0 zone resets clat (usec): min=1029, max=342573, avg=48392.32, stdev=49176.26 lat (usec): min=1030, max=342575, avg=48397.79, stdev=49173.30 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1287], 10.00th=[ 2278], 20.00th=[ 6128], | 30.00th=[ 11731], 40.00th=[ 22676], 50.00th=[ 33817], 60.00th=[ 46400], | 70.00th=[ 62129], 80.00th=[ 85459], 90.00th=[117965], 95.00th=[143655], | 99.00th=[217056], 99.50th=[231736], 99.90th=[304088], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 110, per=25.15%, avg=36.47, stdev=17.66, samples=334 iops : min= 1, max= 27, avg= 8.46, stdev= 4.47, samples=334 lat (usec) : 50=0.59%, 100=1.17%, 250=0.07%, 500=0.03%, 750=0.03% lat (msec) : 2=4.79%, 4=2.83%, 10=6.54%, 20=6.90%, 50=30.08% lat (msec) : 100=33.11%, 250=13.51%, 500=0.33%, 2000=0.03% cpu : usr=0.04%, sys=3.11%, ctx=6194, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178848: Thu Jul 30 03:46:28 2026 read: IOPS=8, BW=34.0KiB/s (35.8kB/s)(5940KiB/169849msec) clat (usec): min=42, max=934608, avg=64572.76, stdev=48330.78 lat (usec): min=43, max=934611, avg=64575.97, stdev=48329.61 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 17171], 10.00th=[ 23987], 20.00th=[ 32900], | 30.00th=[ 39584], 40.00th=[ 46924], 50.00th=[ 55313], 60.00th=[ 64750], | 70.00th=[ 74974], 80.00th=[ 89654], 90.00th=[110625], 95.00th=[139461], | 99.00th=[225444], 99.50th=[291505], 99.90th=[400557], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 86, per=25.06%, avg=34.84, stdev=15.40, samples=330 iops : min= 1, max= 21, avg= 8.04, stdev= 3.90, samples=330 write: IOPS=9, BW=37.4KiB/s (38.3kB/s)(6348KiB/169849msec); 0 zone resets clat (usec): min=996, max=343587, avg=46283.56, stdev=48934.04 lat (usec): min=997, max=343588, avg=46287.31, stdev=48933.25 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 1762], 20.00th=[ 5014], | 30.00th=[ 9372], 40.00th=[ 19006], 50.00th=[ 32900], 60.00th=[ 45351], | 70.00th=[ 59507], 80.00th=[ 80217], 90.00th=[113771], 95.00th=[139461], | 99.00th=[208667], 99.50th=[246416], 99.90th=[320865], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 111, per=25.62%, avg=37.15, stdev=18.70, samples=330 iops : min= 1, max= 27, avg= 8.63, stdev= 4.70, samples=330 lat (usec) : 50=0.33%, 100=0.78%, 250=0.03%, 1000=0.07% lat (msec) : 2=5.63%, 4=3.16%, 10=7.45%, 20=6.84%, 50=30.21% lat (msec) : 100=31.90%, 250=13.05%, 500=0.52%, 1000=0.03% cpu : usr=0.04%, sys=3.05%, ctx=6194, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178849: Thu Jul 30 03:46:28 2026 read: IOPS=8, BW=34.9KiB/s (35.8kB/s)(6028KiB/172622msec) clat (usec): min=37, max=377563, avg=62983.46, stdev=41786.08 lat (usec): min=37, max=377565, avg=62985.34, stdev=41785.62 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 12649], 10.00th=[ 21627], 20.00th=[ 30802], | 30.00th=[ 38011], 40.00th=[ 45876], 50.00th=[ 54264], 60.00th=[ 64226], | 70.00th=[ 77071], 80.00th=[ 93848], 90.00th=[116917], 95.00th=[137364], | 99.00th=[191890], 99.50th=[231736], 99.90th=[308282], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 80, per=25.07%, avg=34.84, stdev=15.30, samples=335 iops : min= 1, max= 20, avg= 8.05, stdev= 3.86, samples=335 write: IOPS=9, BW=36.3KiB/s (37.1kB/s)(6260KiB/172622msec); 0 zone resets clat (usec): min=1001, max=947448, avg=49287.10, stdev=54986.08 lat (usec): min=1002, max=947451, avg=49292.79, stdev=54985.21 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 2376], 20.00th=[ 5604], | 30.00th=[ 11994], 40.00th=[ 23462], 50.00th=[ 34341], 60.00th=[ 44827], | 70.00th=[ 62653], 80.00th=[ 84411], 90.00th=[120062], 95.00th=[149947], | 99.00th=[227541], 99.50th=[252707], 99.90th=[299893], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 103, per=24.97%, avg=36.21, stdev=18.46, samples=335 iops : min= 1, max= 25, avg= 8.39, stdev= 4.66, samples=335 lat (usec) : 50=0.85%, 100=1.11%, 250=0.07%, 500=0.03% lat (msec) : 2=4.75%, 4=2.99%, 10=6.64%, 20=6.41%, 50=31.35% lat (msec) : 100=30.40%, 250=14.81%, 500=0.55%, 1000=0.03% cpu : usr=0.04%, sys=3.14%, ctx=6328, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178850: Thu Jul 30 03:46:28 2026 read: IOPS=8, BW=35.0KiB/s (36.9kB/s)(6052KiB/168136msec) clat (usec): min=35, max=349862, avg=61170.01, stdev=39736.75 lat (usec): min=35, max=349862, avg=61173.62, stdev=39739.40 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 17171], 10.00th=[ 23200], 20.00th=[ 31589], | 30.00th=[ 39060], 40.00th=[ 45351], 50.00th=[ 52691], 60.00th=[ 61080], | 70.00th=[ 72877], 80.00th=[ 86508], 90.00th=[108528], 95.00th=[128451], | 99.00th=[206570], 99.50th=[248513], 99.90th=[346031], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 95, per=25.82%, avg=35.89, stdev=15.82, samples=327 iops : min= 1, max= 23, avg= 8.31, stdev= 4.00, samples=327 write: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6236KiB/168136msec); 0 zone resets clat (usec): min=937, max=975526, avg=48152.30, stdev=55518.45 lat (usec): min=938, max=975535, avg=48154.02, stdev=55518.36 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 2024], 20.00th=[ 5145], | 30.00th=[ 9503], 40.00th=[ 19530], 50.00th=[ 32113], 60.00th=[ 44827], | 70.00th=[ 61604], 80.00th=[ 85459], 90.00th=[122160], 95.00th=[145753], | 99.00th=[217056], 99.50th=[252707], 99.90th=[379585], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 111, per=25.54%, avg=37.03, stdev=17.40, samples=327 iops : min= 1, max= 27, avg= 8.59, stdev= 4.38, samples=327 lat (usec) : 50=0.39%, 100=1.14%, 500=0.07%, 1000=0.10% lat (msec) : 2=5.01%, 4=2.80%, 10=8.01%, 20=6.58%, 50=30.63% lat (msec) : 100=31.02%, 250=13.74%, 500=0.49%, 1000=0.03% cpu : usr=0.03%, sys=3.14%, ctx=6175, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=139KiB/s (142kB/s), 34.8KiB/s-35.0KiB/s (35.7kB/s-36.9kB/s), io=23.4MiB (24.6MB), run=168136-172622msec WRITE: bw=146KiB/s (149kB/s), 36.3KiB/s-37.4KiB/s (37.1kB/s-38.3kB/s), io=24.6MiB (25.7MB), run=168136-172622msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178842: Thu Jul 30 03:47:21 2026 read: IOPS=6, BW=26.5KiB/s (27.1kB/s)(5992KiB/226412msec) clat (msec): min=5, max=1131, avg=61.09, stdev=60.37 lat (msec): min=5, max=1131, avg=61.09, stdev=60.37 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 68], 80.00th=[ 88], 90.00th=[ 129], 95.00th=[ 182], | 99.00th=[ 249], 99.50th=[ 284], 99.90th=[ 592], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 126, per=26.21%, avg=27.78, stdev=19.37, samples=415 iops : min= 1, max= 31, avg= 6.26, stdev= 4.87, samples=415 write: IOPS=6, BW=27.8KiB/s (28.5kB/s)(6296KiB/226412msec); 0 zone resets clat (msec): min=12, max=419, avg=85.38, stdev=62.63 lat (msec): min=12, max=419, avg=85.39, stdev=62.63 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 38], | 30.00th=[ 47], 40.00th=[ 55], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 100], 80.00th=[ 126], 90.00th=[ 171], 95.00th=[ 207], | 99.00th=[ 313], 99.50th=[ 368], 99.90th=[ 397], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 103, per=25.53%, avg=28.34, stdev=17.81, samples=427 iops : min= 1, max= 25, avg= 6.40, stdev= 4.47, samples=427 lat (msec) : 10=0.98%, 20=7.26%, 50=37.79%, 100=31.18%, 250=20.90% lat (msec) : 500=1.82%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.31%, ctx=4649, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178843: Thu Jul 30 03:47:21 2026 read: IOPS=6, BW=26.3KiB/s (26.9kB/s)(5940KiB/226255msec) clat (msec): min=5, max=983, avg=60.54, stdev=60.44 lat (msec): min=5, max=983, avg=60.54, stdev=60.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 65], 80.00th=[ 89], 90.00th=[ 136], 95.00th=[ 171], | 99.00th=[ 255], 99.50th=[ 300], 99.90th=[ 584], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 127, per=26.72%, avg=28.33, stdev=19.43, samples=405 iops : min= 1, max= 31, avg= 6.40, stdev= 4.88, samples=405 write: IOPS=7, BW=28.1KiB/s (28.7kB/s)(6348KiB/226255msec); 0 zone resets clat (msec): min=11, max=437, avg=85.61, stdev=59.85 lat (msec): min=11, max=437, avg=85.61, stdev=59.85 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 68], 60.00th=[ 83], | 70.00th=[ 101], 80.00th=[ 124], 90.00th=[ 167], 95.00th=[ 199], | 99.00th=[ 305], 99.50th=[ 351], 99.90th=[ 388], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 103, per=25.17%, avg=27.94, stdev=17.65, samples=438 iops : min= 1, max= 25, avg= 6.30, stdev= 4.43, samples=438 lat (msec) : 10=1.01%, 20=7.49%, 50=38.25%, 100=29.36%, 250=22.27% lat (msec) : 500=1.53%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=4724, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178844: Thu Jul 30 03:47:21 2026 read: IOPS=6, BW=27.0KiB/s (27.7kB/s)(6028KiB/222950msec) clat (msec): min=5, max=426, avg=59.59, stdev=55.82 lat (msec): min=5, max=426, avg=59.59, stdev=55.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 87], 90.00th=[ 136], 95.00th=[ 176], | 99.00th=[ 292], 99.50th=[ 317], 99.90th=[ 422], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 126, per=26.46%, avg=28.04, stdev=19.46, samples=414 iops : min= 1, max= 31, avg= 6.33, stdev= 4.90, samples=414 write: IOPS=7, BW=28.1KiB/s (28.8kB/s)(6260KiB/222950msec); 0 zone resets clat (msec): min=11, max=1031, avg=84.77, stdev=63.73 lat (msec): min=11, max=1031, avg=84.77, stdev=63.73 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 79], | 70.00th=[ 97], 80.00th=[ 126], 90.00th=[ 163], 95.00th=[ 203], | 99.00th=[ 300], 99.50th=[ 321], 99.90th=[ 531], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 126, per=25.57%, avg=28.38, stdev=17.89, samples=425 iops : min= 1, max= 31, avg= 6.42, stdev= 4.50, samples=425 lat (msec) : 10=1.11%, 20=7.94%, 50=38.25%, 100=29.85%, 250=21.03% lat (msec) : 500=1.76%, 750=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.28%, ctx=4611, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178846: Thu Jul 30 03:47:21 2026 read: IOPS=6, BW=26.0KiB/s (27.6kB/s)(6052KiB/224343msec) clat (msec): min=5, max=548, avg=61.00, stdev=55.26 lat (msec): min=5, max=548, avg=61.01, stdev=55.26 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 89], 90.00th=[ 136], 95.00th=[ 180], | 99.00th=[ 253], 99.50th=[ 275], 99.90th=[ 531], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 117, per=26.33%, avg=27.91, stdev=18.89, samples=418 iops : min= 1, max= 29, avg= 6.30, stdev= 4.75, samples=418 write: IOPS=6, BW=27.8KiB/s (28.5kB/s)(6236KiB/224343msec); 0 zone resets clat (msec): min=10, max=889, avg=84.28, stdev=61.17 lat (msec): min=10, max=889, avg=84.29, stdev=61.17 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 66], 60.00th=[ 81], | 70.00th=[ 100], 80.00th=[ 125], 90.00th=[ 163], 95.00th=[ 194], | 99.00th=[ 296], 99.50th=[ 338], 99.90th=[ 527], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 111, per=25.18%, avg=27.95, stdev=17.97, samples=430 iops : min= 1, max= 27, avg= 6.31, stdev= 4.52, samples=430 lat (msec) : 10=1.04%, 20=7.78%, 50=37.14%, 100=30.73%, 250=21.84% lat (msec) : 500=1.33%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.31%, ctx=4614, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=106KiB/s (109kB/s), 26.3KiB/s-27.0KiB/s (26.9kB/s-27.7kB/s), io=23.4MiB (24.6MB), run=222950-226412msec WRITE: bw=111KiB/s (114kB/s), 27.8KiB/s-28.1KiB/s (28.5kB/s-28.8kB/s), io=24.6MiB (25.7MB), run=222950-226412msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178901: Thu Jul 30 03:48:37 2026 read: IOPS=6, BW=98.1KiB/s (100kB/s)(5920KiB/60352msec) clat (usec): min=27, max=509786, avg=87666.44, stdev=68320.04 lat (usec): min=27, max=509788, avg=87667.66, stdev=68319.96 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 60], 10.00th=[ 9110], 20.00th=[ 39060], | 30.00th=[ 52167], 40.00th=[ 62129], 50.00th=[ 70779], 60.00th=[ 86508], | 70.00th=[106431], 80.00th=[123208], 90.00th=[173016], 95.00th=[212861], | 99.00th=[329253], 99.50th=[354419], 99.90th=[509608], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 27, max= 379, per=24.79%, avg=97.92, stdev=55.83, samples=115 iops : min= 1, max= 23, avg= 5.29, stdev= 3.52, samples=115 write: IOPS=6, BW=106KiB/s (108kB/s)(6368KiB/60352msec); 0 zone resets clat (usec): min=1612, max=458037, avg=69362.54, stdev=71966.66 lat (usec): min=1614, max=458038, avg=69365.39, stdev=71967.26 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1975], 10.00th=[ 5735], 20.00th=[ 9896], | 30.00th=[ 17433], 40.00th=[ 27657], 50.00th=[ 45876], 60.00th=[ 66847], | 70.00th=[ 88605], 80.00th=[127402], 90.00th=[166724], 95.00th=[204473], | 99.00th=[329253], 99.50th=[387974], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 27, max= 305, per=26.93%, avg=111.78, stdev=63.00, samples=109 iops : min= 1, max= 19, avg= 6.19, stdev= 4.03, samples=109 lat (usec) : 50=1.04%, 100=2.99%, 250=0.26%, 750=0.13% lat (msec) : 2=2.60%, 4=1.04%, 10=7.29%, 20=6.51%, 50=18.62% lat (msec) : 100=30.08%, 250=26.82%, 500=2.47%, 750=0.13% cpu : usr=0.03%, sys=2.70%, ctx=1605, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178902: Thu Jul 30 03:48:37 2026 read: IOPS=5, BW=95.2KiB/s (97.5kB/s)(5744KiB/60354msec) clat (usec): min=38, max=368009, avg=90528.73, stdev=69755.20 lat (usec): min=38, max=368009, avg=90539.56, stdev=69748.95 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 19268], 20.00th=[ 38536], | 30.00th=[ 50070], 40.00th=[ 61604], 50.00th=[ 74974], 60.00th=[ 88605], | 70.00th=[107480], 80.00th=[135267], 90.00th=[183501], 95.00th=[231736], | 99.00th=[350225], 99.50th=[358613], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 30, max= 255, per=24.62%, avg=97.25, stdev=51.60, samples=113 iops : min= 1, max= 15, avg= 5.27, stdev= 3.29, samples=113 write: IOPS=6, BW=108KiB/s (111kB/s)(6544KiB/60354msec); 0 zone resets clat (usec): min=1503, max=444234, avg=67371.17, stdev=73471.88 lat (usec): min=1507, max=444236, avg=67388.33, stdev=73485.64 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2474], 10.00th=[ 6259], 20.00th=[ 12387], | 30.00th=[ 17171], 40.00th=[ 28967], 50.00th=[ 44827], 60.00th=[ 58459], | 70.00th=[ 78119], 80.00th=[108528], 90.00th=[164627], 95.00th=[217056], | 99.00th=[341836], 99.50th=[354419], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 28, max= 379, per=26.76%, avg=111.04, stdev=65.49, samples=113 iops : min= 1, max= 23, avg= 6.13, stdev= 4.16, samples=113 lat (usec) : 50=0.39%, 100=2.99%, 250=0.13%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.34%, 4=1.04%, 10=5.47%, 20=9.64%, 50=20.57% lat (msec) : 100=29.82%, 250=23.83%, 500=3.52% cpu : usr=0.04%, sys=2.89%, ctx=1578, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178903: Thu Jul 30 03:48:37 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(6256KiB/60633msec) clat (usec): min=31, max=382929, avg=90390.10, stdev=63917.02 lat (usec): min=31, max=382930, avg=90392.69, stdev=63915.40 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 71], 10.00th=[ 17957], 20.00th=[ 40633], | 30.00th=[ 53216], 40.00th=[ 65799], 50.00th=[ 82314], 60.00th=[ 94897], | 70.00th=[109577], 80.00th=[135267], 90.00th=[170918], 95.00th=[206570], | 99.00th=[329253], 99.50th=[362808], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 30, max= 256, per=27.18%, avg=107.36, stdev=50.82, samples=113 iops : min= 1, max= 16, avg= 5.91, stdev= 3.25, samples=113 write: IOPS=6, BW=99.5KiB/s (102kB/s)(6032KiB/60633msec); 0 zone resets clat (usec): min=1208, max=434466, avg=66286.71, stdev=70747.78 lat (usec): min=1210, max=434468, avg=66288.71, stdev=70747.82 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2180], 10.00th=[ 5145], 20.00th=[ 9765], | 30.00th=[ 17171], 40.00th=[ 29492], 50.00th=[ 43254], 60.00th=[ 62653], | 70.00th=[ 82314], 80.00th=[110625], 90.00th=[164627], 95.00th=[202376], | 99.00th=[337642], 99.50th=[362808], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 28, max= 255, per=24.42%, avg=101.33, stdev=57.43, samples=113 iops : min= 1, max= 15, avg= 5.53, stdev= 3.67, samples=113 lat (usec) : 50=0.91%, 100=3.39%, 250=0.13%, 500=0.13% lat (msec) : 2=2.21%, 4=1.56%, 10=6.64%, 20=6.38%, 50=19.40% lat (msec) : 100=28.91%, 250=27.99%, 500=2.34% cpu : usr=0.02%, sys=2.59%, ctx=1616, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178904: Thu Jul 30 03:48:37 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(6032KiB/59474msec) clat (usec): min=42, max=527189, avg=89628.40, stdev=66482.35 lat (usec): min=43, max=527190, avg=89629.62, stdev=66482.32 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 25560], 20.00th=[ 41681], | 30.00th=[ 53740], 40.00th=[ 63701], 50.00th=[ 77071], 60.00th=[ 88605], | 70.00th=[108528], 80.00th=[130548], 90.00th=[160433], 95.00th=[214959], | 99.00th=[333448], 99.50th=[367002], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 27, max= 285, per=26.71%, avg=105.51, stdev=54.91, samples=111 iops : min= 1, max= 17, avg= 5.78, stdev= 3.48, samples=111 write: IOPS=6, BW=105KiB/s (108kB/s)(6256KiB/59474msec); 0 zone resets clat (usec): min=1388, max=444298, avg=65470.96, stdev=73861.32 lat (usec): min=1390, max=444300, avg=65472.88, stdev=73861.46 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1958], 10.00th=[ 4686], 20.00th=[ 10421], | 30.00th=[ 17171], 40.00th=[ 27657], 50.00th=[ 40633], 60.00th=[ 55837], | 70.00th=[ 78119], 80.00th=[106431], 90.00th=[160433], 95.00th=[214959], | 99.00th=[320865], 99.50th=[434111], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 27, max= 390, per=26.65%, avg=110.59, stdev=68.64, samples=110 iops : min= 1, max= 24, avg= 6.10, stdev= 4.37, samples=110 lat (usec) : 50=0.65%, 100=2.34%, 250=0.26%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=1.69%, 10=5.21%, 20=8.20%, 50=19.92% lat (msec) : 100=30.47%, 250=24.48%, 500=3.12%, 750=0.13% cpu : usr=0.03%, sys=2.73%, ctx=1604, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=395KiB/s (405kB/s), 95.2KiB/s-103KiB/s (97.5kB/s-106kB/s), io=23.4MiB (24.5MB), run=59474-60633msec WRITE: bw=416KiB/s (426kB/s), 99.5KiB/s-108KiB/s (102kB/s-111kB/s), io=24.6MiB (25.8MB), run=59474-60633msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178906: Thu Jul 30 03:48:52 2026 read: IOPS=5, BW=80.1KiB/s (82.0kB/s)(5920KiB/73897msec) clat (msec): min=7, max=550, avg=82.72, stdev=91.19 lat (msec): min=7, max=550, avg=82.75, stdev=91.20 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 62], | 70.00th=[ 85], 80.00th=[ 120], 90.00th=[ 182], 95.00th=[ 279], | 99.00th=[ 485], 99.50th=[ 527], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 28, max= 381, per=27.03%, avg=87.57, stdev=69.53, samples=129 iops : min= 1, max= 23, avg= 4.60, stdev= 4.37, samples=129 write: IOPS=5, BW=86.2KiB/s (88.2kB/s)(6368KiB/73897msec); 0 zone resets clat (msec): min=12, max=519, avg=108.42, stdev=90.24 lat (msec): min=12, max=519, avg=108.42, stdev=90.24 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 45], 40.00th=[ 59], 50.00th=[ 79], 60.00th=[ 101], | 70.00th=[ 136], 80.00th=[ 174], 90.00th=[ 236], 95.00th=[ 296], | 99.00th=[ 409], 99.50th=[ 460], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 29, max= 351, per=27.68%, avg=94.38, stdev=74.79, samples=130 iops : min= 1, max= 21, avg= 5.02, stdev= 4.69, samples=130 lat (msec) : 10=0.39%, 20=7.94%, 50=34.64%, 100=23.96%, 250=26.04% lat (msec) : 500=6.64%, 750=0.39% cpu : usr=0.02%, sys=1.03%, ctx=1177, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178907: Thu Jul 30 03:48:52 2026 read: IOPS=4, BW=77.8KiB/s (79.7kB/s)(5744KiB/73820msec) clat (msec): min=7, max=525, avg=80.38, stdev=90.16 lat (msec): min=7, max=525, avg=80.38, stdev=90.16 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 62], | 70.00th=[ 88], 80.00th=[ 115], 90.00th=[ 180], 95.00th=[ 264], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 24, max= 415, per=28.08%, avg=90.98, stdev=73.69, samples=122 iops : min= 1, max= 25, avg= 4.81, stdev= 4.62, samples=122 write: IOPS=5, BW=88.6KiB/s (90.8kB/s)(6544KiB/73820msec); 0 zone resets clat (msec): min=13, max=487, avg=109.49, stdev=95.24 lat (msec): min=13, max=487, avg=109.49, stdev=95.24 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 70], 60.00th=[ 90], | 70.00th=[ 129], 80.00th=[ 184], 90.00th=[ 262], 95.00th=[ 313], | 99.00th=[ 422], 99.50th=[ 443], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 24, max= 381, per=27.63%, avg=94.21, stdev=76.63, samples=134 iops : min= 1, max= 23, avg= 5.02, stdev= 4.81, samples=134 lat (msec) : 10=0.52%, 20=7.81%, 50=35.03%, 100=25.39%, 250=22.40% lat (msec) : 500=8.72%, 750=0.13% cpu : usr=0.02%, sys=1.04%, ctx=1220, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178908: Thu Jul 30 03:48:52 2026 read: IOPS=5, BW=84.8KiB/s (86.8kB/s)(6256KiB/73765msec) clat (msec): min=5, max=452, avg=79.50, stdev=81.44 lat (msec): min=5, max=452, avg=79.50, stdev=81.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 37], 50.00th=[ 50], 60.00th=[ 64], | 70.00th=[ 84], 80.00th=[ 121], 90.00th=[ 194], 95.00th=[ 266], | 99.00th=[ 401], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 29, max= 415, per=29.53%, avg=95.67, stdev=82.62, samples=128 iops : min= 1, max= 25, avg= 5.10, stdev= 5.20, samples=128 write: IOPS=5, BW=81.8KiB/s (83.7kB/s)(6032KiB/73765msec); 0 zone resets clat (msec): min=17, max=542, avg=112.85, stdev=98.09 lat (msec): min=17, max=542, avg=112.85, stdev=98.09 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 31], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 62], 50.00th=[ 80], 60.00th=[ 97], | 70.00th=[ 124], 80.00th=[ 178], 90.00th=[ 257], 95.00th=[ 321], | 99.00th=[ 468], 99.50th=[ 535], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 28, max= 349, per=25.90%, avg=88.31, stdev=67.47, samples=131 iops : min= 1, max= 21, avg= 4.64, stdev= 4.24, samples=131 lat (msec) : 10=0.78%, 20=8.72%, 50=32.16%, 100=26.43%, 250=23.57% lat (msec) : 500=8.07%, 750=0.26% cpu : usr=0.03%, sys=1.00%, ctx=1184, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178909: Thu Jul 30 03:48:52 2026 read: IOPS=5, BW=81.9KiB/s (83.8kB/s)(6032KiB/73674msec) clat (msec): min=8, max=468, avg=83.63, stdev=85.76 lat (msec): min=8, max=468, avg=83.63, stdev=85.76 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 37], 50.00th=[ 51], 60.00th=[ 67], | 70.00th=[ 97], 80.00th=[ 131], 90.00th=[ 218], 95.00th=[ 275], | 99.00th=[ 376], 99.50th=[ 456], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 28, max= 381, per=30.85%, avg=99.96, stdev=75.67, samples=117 iops : min= 1, max= 23, avg= 5.38, stdev= 4.76, samples=117 write: IOPS=5, BW=84.9KiB/s (86.0kB/s)(6256KiB/73674msec); 0 zone resets clat (msec): min=16, max=503, avg=107.52, stdev=95.09 lat (msec): min=16, max=503, avg=107.52, stdev=95.09 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 56], 50.00th=[ 70], 60.00th=[ 90], | 70.00th=[ 117], 80.00th=[ 167], 90.00th=[ 239], 95.00th=[ 309], | 99.00th=[ 464], 99.50th=[ 481], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 28, max= 351, per=27.95%, avg=95.30, stdev=75.07, samples=128 iops : min= 1, max= 21, avg= 5.09, stdev= 4.71, samples=128 lat (msec) : 10=0.39%, 20=6.90%, 50=35.42%, 100=24.61%, 250=24.61% lat (msec) : 500=7.94%, 750=0.13% cpu : usr=0.02%, sys=0.98%, ctx=1195, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=324KiB/s (332kB/s), 77.8KiB/s-84.8KiB/s (79.7kB/s-86.8kB/s), io=23.4MiB (24.5MB), run=73674-73897msec WRITE: bw=341KiB/s (349kB/s), 81.8KiB/s-88.6KiB/s (83.7kB/s-90.8kB/s), io=24.6MiB (25.8MB), run=73674-73897msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178927: Thu Jul 30 03:49:15 2026 read: IOPS=1, BW=1036KiB/s (1061kB/s)(7168KiB/6916msec) clat (msec): min=3, max=3723, avg=661.68, stdev=1356.12 lat (msec): min=3, max=3723, avg=661.68, stdev=1356.12 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 178], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 342], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1638, max= 4071, per=99.55%, avg=2342.40, stdev=980.37, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=740KiB/s (758kB/s)(5120KiB/6916msec); 0 zone resets clat (msec): min=122, max=793, avg=455.19, stdev=308.49 lat (msec): min=123, max=793, avg=455.43, stdev=308.27 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1976, max= 4087, per=82.03%, avg=2702.00, stdev=1199.91, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=16.67%, 250=25.00%, 500=33.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.55%, ctx=507, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178928: Thu Jul 30 03:49:15 2026 read: IOPS=0, BW=235KiB/s (241kB/s)(2048KiB/8703msec) clat (msec): min=157, max=436, avg=296.92, stdev=197.13 lat (msec): min=157, max=436, avg=296.92, stdev=197.13 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 439], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1481, max= 2043, per=74.88%, avg=1762.00, stdev=397.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1177KiB/s (1205kB/s)(10.0MiB/8703msec); 0 zone resets clat (msec): min=175, max=4325, avg=805.93, stdev=1250.25 lat (msec): min=175, max=4325, avg=806.48, stdev=1250.18 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 292], | 30.00th=[ 300], 40.00th=[ 338], 50.00th=[ 372], 60.00th=[ 393], | 70.00th=[ 418], 80.00th=[ 634], 90.00th=[ 818], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 1917, max= 3938, per=77.12%, avg=2540.43, stdev=921.11, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.52%, ctx=194, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178929: Thu Jul 30 03:49:15 2026 read: IOPS=0, BW=825KiB/s (845kB/s)(6144KiB/7449msec) clat (usec): min=337, max=278765, avg=53861.75, stdev=110763.46 lat (usec): min=337, max=278766, avg=53862.61, stdev=110763.53 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 437], | 30.00th=[ 437], 40.00th=[ 465], 50.00th=[ 465], 60.00th=[ 14222], | 70.00th=[ 28967], 80.00th=[ 28967], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 2043, max= 4071, per=100.00%, avg=3316.33, stdev=1109.03, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=825KiB/s (845kB/s)(6144KiB/7449msec); 0 zone resets clat (msec): min=270, max=4358, avg=1184.85, stdev=1570.06 lat (msec): min=270, max=4358, avg=1184.92, stdev=1570.08 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 600], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 1612, max= 4071, per=73.19%, avg=2410.75, stdev=1121.53, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=25.00% lat (msec) : 20=8.33%, 50=8.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.79%, ctx=104, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178930: Thu Jul 30 03:49:15 2026 read: IOPS=0, BW=671KiB/s (687kB/s)(5120KiB/7629msec) clat (usec): min=486, max=306223, avg=139314.27, stdev=136353.77 lat (usec): min=487, max=306224, avg=139315.27, stdev=136353.95 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[164627], 60.00th=[164627], | 70.00th=[225444], 80.00th=[225444], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=0, BW=940KiB/s (962kB/s)(7168KiB/7629msec); 0 zone resets clat (msec): min=225, max=4041, avg=988.79, stdev=1390.63 lat (msec): min=225, max=4041, avg=988.84, stdev=1390.64 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 359], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 1250], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 1633, max= 3835, per=70.36%, avg=2317.80, stdev=866.29, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.65%, ctx=135, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2353KiB/s (2410kB/s), 235KiB/s-1036KiB/s (241kB/s-1061kB/s), io=20.0MiB (20.0MB), run=6916-8703msec WRITE: bw=3294KiB/s (3374kB/s), 740KiB/s-1177KiB/s (758kB/s-1205kB/s), io=28.0MiB (29.4MB), run=6916-8703msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178932: Thu Jul 30 03:49:16 2026 read: IOPS=0, BW=782KiB/s (801kB/s)(7168KiB/9166msec) clat (msec): min=97, max=3477, avg=1082.32, stdev=1226.72 lat (msec): min=97, max=3477, avg=1082.32, stdev=1226.72 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 163], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 709], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 1888], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1762, max= 4071, per=100.00%, avg=2473.75, stdev=1072.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=559KiB/s (572kB/s)(5120KiB/9166msec); 0 zone resets clat (msec): min=158, max=471, avg=268.32, stdev=132.29 lat (msec): min=158, max=471, avg=268.40, stdev=132.28 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1762, max= 4079, per=84.43%, avg=2604.67, stdev=1281.16, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.90%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178933: Thu Jul 30 03:49:16 2026 read: IOPS=0, BW=233KiB/s (239kB/s)(2048KiB/8789msec) clat (msec): min=105, max=465, avg=285.52, stdev=255.21 lat (msec): min=105, max=465, avg=285.52, stdev=255.21 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2023, max= 2035, per=92.06%, avg=2029.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1165KiB/s (1193kB/s)(10.0MiB/8789msec); 0 zone resets clat (msec): min=115, max=4731, avg=821.34, stdev=1394.69 lat (msec): min=115, max=4731, avg=821.52, stdev=1394.64 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 142], | 30.00th=[ 159], 40.00th=[ 245], 50.00th=[ 359], 60.00th=[ 376], | 70.00th=[ 592], 80.00th=[ 684], 90.00th=[ 810], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 1932, max= 6119, per=98.22%, avg=3030.17, stdev=1729.86, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.33%, ctx=71, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178934: Thu Jul 30 03:49:16 2026 read: IOPS=0, BW=684KiB/s (701kB/s)(6144KiB/8976msec) clat (msec): min=72, max=884, avg=380.30, stdev=332.33 lat (msec): min=72, max=884, avg=380.30, stdev=332.33 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 347], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1932, max= 3946, per=100.00%, avg=2490.00, stdev=972.03, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=684KiB/s (701kB/s)(6144KiB/8976msec); 0 zone resets clat (msec): min=110, max=4529, avg=1114.16, stdev=1692.95 lat (msec): min=110, max=4530, avg=1114.33, stdev=1692.93 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 693], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 2035, max= 4023, per=82.11%, avg=2533.00, stdev=993.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.04%, ctx=60, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178935: Thu Jul 30 03:49:16 2026 read: IOPS=0, BW=551KiB/s (564kB/s)(5120KiB/9291msec) clat (msec): min=70, max=1148, avg=396.10, stdev=439.58 lat (msec): min=70, max=1148, avg=396.10, stdev=439.58 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2039, max= 3946, per=100.00%, avg=2676.00, stdev=1099.85, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=771KiB/s (790kB/s)(7168KiB/9291msec); 0 zone resets clat (msec): min=144, max=4507, avg=1018.67, stdev=1563.20 lat (msec): min=144, max=4507, avg=1018.76, stdev=1563.20 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 157], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 592], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 835], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1932, max= 2043, per=65.00%, avg=2005.25, stdev=50.69, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.44%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2204KiB/s (2257kB/s), 233KiB/s-782KiB/s (239kB/s-801kB/s), io=20.0MiB (20.0MB), run=8789-9291msec WRITE: bw=3086KiB/s (3160kB/s), 559KiB/s-1165KiB/s (572kB/s-1193kB/s), io=28.0MiB (29.4MB), run=8789-9291msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178942: Thu Jul 30 03:49:37 2026 read: IOPS=0, BW=2516KiB/s (2576kB/s)(12.0MiB/4884msec) clat (msec): min=378, max=2739, avg=1580.23, stdev=1181.40 lat (msec): min=378, max=2739, avg=1580.24, stdev=1181.40 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.18%, sys=2.42%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178943: Thu Jul 30 03:49:37 2026 read: IOPS=0, BW=1623KiB/s (1662kB/s)(4096KiB/2523msec) clat (nsec): min=549862k, max=549862k, avg=549861955.00, stdev= 0.00 lat (nsec): min=549865k, max=549865k, avg=549864524.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3247KiB/s (3325kB/s)(8192KiB/2523msec); 0 zone resets clat (msec): min=808, max=1140, avg=974.78, stdev=234.61 lat (msec): min=809, max=1141, avg=975.03, stdev=234.78 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.33%, ctx=35, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178944: Thu Jul 30 03:49:37 2026 write: IOPS=0, BW=2403KiB/s (2461kB/s)(12.0MiB/5113msec); 0 zone resets clat (msec): min=381, max=2530, avg=1670.76, stdev=1137.11 lat (msec): min=381, max=2531, avg=1671.12, stdev=1137.08 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 2106], 50.00th=[ 2106], 60.00th=[ 2106], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.41%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178945: Thu Jul 30 03:49:37 2026 write: IOPS=0, BW=2973KiB/s (3044kB/s)(12.0MiB/4133msec); 0 zone resets clat (msec): min=381, max=3227, avg=1346.15, stdev=1629.70 lat (msec): min=381, max=3227, avg=1346.41, stdev=1629.59 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 7074, max= 8094, per=100.00%, avg=7584.00, stdev=721.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=2.47%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3355KiB/s (3435kB/s), 1623KiB/s-2516KiB/s (1662kB/s-2576kB/s), io=16.0MiB (16.8MB), run=2523-4884msec WRITE: bw=6409KiB/s (6563kB/s), 2403KiB/s-3247KiB/s (2461kB/s-3325kB/s), io=32.0MiB (33.6MB), run=2523-5113msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178947: Thu Jul 30 03:49:38 2026 read: IOPS=0, BW=3599KiB/s (3686kB/s)(12.0MiB/3414msec) clat (msec): min=1042, max=1221, avg=1136.31, stdev=89.89 lat (msec): min=1042, max=1221, avg=1136.31, stdev=89.89 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8047, max= 8143, per=100.00%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=8.44%, ctx=239, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178948: Thu Jul 30 03:49:38 2026 read: IOPS=0, BW=936KiB/s (959kB/s)(4096KiB/4375msec) clat (nsec): min=1146.9M, max=1146.9M, avg=1146912028.00, stdev= 0.00 lat (nsec): min=1146.9M, max=1146.9M, avg=1146913319.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1872KiB/s (1917kB/s)(8192KiB/4375msec); 0 zone resets clat (msec): min=1361, max=1850, avg=1605.87, stdev=345.60 lat (msec): min=1361, max=1851, avg=1606.63, stdev=346.37 clat percentiles (msec): | 1.00th=[ 1368], 5.00th=[ 1368], 10.00th=[ 1368], 20.00th=[ 1368], | 30.00th=[ 1368], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.09%, sys=2.24%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178949: Thu Jul 30 03:49:38 2026 write: IOPS=0, BW=2616KiB/s (2678kB/s)(12.0MiB/4698msec); 0 zone resets clat (msec): min=252, max=2910, avg=1564.06, stdev=1329.45 lat (msec): min=252, max=2911, avg=1565.01, stdev=1329.38 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.60%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178950: Thu Jul 30 03:49:38 2026 write: IOPS=0, BW=3323KiB/s (3403kB/s)(12.0MiB/3698msec); 0 zone resets clat (msec): min=297, max=1866, avg=1231.95, stdev=826.43 lat (msec): min=297, max=1866, avg=1232.23, stdev=826.42 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.86%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3745KiB/s (3835kB/s), 936KiB/s-3599KiB/s (959kB/s-3686kB/s), io=16.0MiB (16.8MB), run=3414-4375msec WRITE: bw=6975KiB/s (7142kB/s), 1872KiB/s-3323KiB/s (1917kB/s-3403kB/s), io=32.0MiB (33.6MB), run=3698-4698msec