== sanity test 398b: DIO and buffer IO race ============== 08:40:56 (1790944856) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.94747 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144828: Fri Oct 2 08:44:22 2026 read: IOPS=8, BW=32.9KiB/s (33.7kB/s)(5992KiB/181935msec) clat (usec): min=35, max=253088, avg=42071.50, stdev=31729.22 lat (usec): min=36, max=253089, avg=42075.71, stdev=31729.09 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 92], 20.00th=[ 17957], | 30.00th=[ 24249], 40.00th=[ 30016], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 52691], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[160433], 99.90th=[242222], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 103, per=35.80%, avg=45.83, stdev=20.69, samples=255 iops : min= 1, max= 25, avg=10.78, stdev= 5.23, samples=255 write: IOPS=8, BW=34.6KiB/s (35.4kB/s)(6296KiB/181935msec); 0 zone resets clat (usec): min=944, max=51900k, avg=75411.94, stdev=1307800.73 lat (usec): min=946, max=51900k, avg=75417.53, stdev=1307800.68 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1303], 10.00th=[ 1713], | 20.00th=[ 4555], 30.00th=[ 8717], 40.00th=[ 19006], | 50.00th=[ 32113], 60.00th=[ 43779], 70.00th=[ 57934], | 80.00th=[ 74974], 90.00th=[ 101188], 95.00th=[ 121111], | 99.00th=[ 185598], 99.50th=[ 235930], 99.90th=[ 295699], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 135, per=35.66%, avg=47.78, stdev=20.93, samples=257 iops : min= 1, max= 33, avg=11.27, stdev= 5.29, samples=257 lat (usec) : 50=0.36%, 100=4.62%, 250=0.49%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.25%, 4=3.55%, 10=7.16%, 20=9.41%, 50=34.02% lat (msec) : 100=26.40%, 250=7.42%, 500=0.16%, >=2000=0.03% cpu : usr=0.06%, sys=3.81%, ctx=6593, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144829: Fri Oct 2 08:44:22 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(5940KiB/184020msec) clat (usec): min=26, max=234300, avg=43162.28, stdev=32726.68 lat (usec): min=26, max=234301, avg=43170.15, stdev=32719.88 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 96], 20.00th=[ 19792], | 30.00th=[ 25822], 40.00th=[ 30802], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[160433], 99.50th=[181404], 99.90th=[225444], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 6, max= 95, per=34.92%, avg=44.69, stdev=19.38, samples=259 iops : min= 1, max= 23, avg=10.50, stdev= 4.88, samples=259 write: IOPS=8, BW=34.5KiB/s (35.3kB/s)(6348KiB/184020msec); 0 zone resets clat (usec): min=942, max=51955k, avg=75423.94, stdev=1303877.64 lat (usec): min=942, max=51955k, avg=75427.97, stdev=1303877.54 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 1893], | 20.00th=[ 4948], 30.00th=[ 9634], 40.00th=[ 19530], | 50.00th=[ 30540], 60.00th=[ 44827], 70.00th=[ 57410], | 80.00th=[ 73925], 90.00th=[ 96994], 95.00th=[ 121111], | 99.00th=[ 193987], 99.50th=[ 225444], 99.90th=[ 541066], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 110, per=35.28%, avg=47.28, stdev=19.86, samples=261 iops : min= 1, max= 27, avg=11.15, stdev= 5.01, samples=261 lat (usec) : 50=0.33%, 100=4.75%, 250=0.65%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.37%, 4=3.42%, 10=7.23%, 20=9.02%, 50=34.38% lat (msec) : 100=27.44%, 250=7.16%, 500=0.07%, 750=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=3.89%, ctx=6712, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144830: Fri Oct 2 08:44:22 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(6028KiB/185474msec) clat (usec): min=34, max=226543, avg=42282.83, stdev=31473.13 lat (usec): min=34, max=226544, avg=42284.42, stdev=31473.08 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 127], 20.00th=[ 18744], | 30.00th=[ 25035], 40.00th=[ 30016], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 52691], 80.00th=[ 65274], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[141558], 99.50th=[154141], 99.90th=[212861], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 7, max= 111, per=34.91%, avg=44.69, stdev=18.95, samples=263 iops : min= 1, max= 27, avg=10.50, stdev= 4.76, samples=263 write: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6260KiB/185474msec); 0 zone resets clat (usec): min=972, max=51734k, avg=77656.40, stdev=1307361.18 lat (usec): min=973, max=51734k, avg=77658.59, stdev=1307361.19 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1319], 10.00th=[ 2073], | 20.00th=[ 5211], 30.00th=[ 10159], 40.00th=[ 22152], | 50.00th=[ 34341], 60.00th=[ 45876], 70.00th=[ 59507], | 80.00th=[ 78119], 90.00th=[ 102237], 95.00th=[ 127402], | 99.00th=[ 198181], 99.50th=[ 240124], 99.90th=[ 337642], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 119, per=34.61%, avg=46.38, stdev=18.84, samples=263 iops : min= 1, max= 29, avg=10.92, stdev= 4.75, samples=263 lat (usec) : 50=0.26%, 100=4.39%, 250=0.68%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=4.95%, 4=3.74%, 10=6.71%, 20=8.85%, 50=35.48% lat (msec) : 100=26.43%, 250=7.88%, 500=0.13%, >=2000=0.03% cpu : usr=0.06%, sys=3.91%, ctx=6588, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144831: Fri Oct 2 08:44:22 2026 read: IOPS=8, BW=32.4KiB/s (33.2kB/s)(6052KiB/186882msec) clat (usec): min=33, max=294297, avg=42907.54, stdev=33105.51 lat (usec): min=34, max=294298, avg=42909.07, stdev=33105.46 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 89], 20.00th=[ 18482], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 65799], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[139461], 99.50th=[154141], 99.90th=[270533], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 110, per=34.54%, avg=44.21, stdev=20.23, samples=267 iops : min= 1, max= 27, avg=10.38, stdev= 5.07, samples=267 write: IOPS=8, BW=33.4KiB/s (34.2kB/s)(6236KiB/186882msec); 0 zone resets clat (usec): min=974, max=51882k, avg=77947.08, stdev=1313610.08 lat (usec): min=974, max=51882k, avg=77969.88, stdev=1313609.49 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 2147], | 20.00th=[ 5014], 30.00th=[ 10421], 40.00th=[ 23462], | 50.00th=[ 34341], 60.00th=[ 44827], 70.00th=[ 58983], | 80.00th=[ 76022], 90.00th=[ 100140], 95.00th=[ 130548], | 99.00th=[ 187696], 99.50th=[ 235930], 99.90th=[ 404751], | 99.95th=[17112761], 99.99th=[17112761] bw ( KiB/s): min= 7, max= 95, per=33.95%, avg=45.49, stdev=17.62, samples=267 iops : min= 1, max= 23, avg=10.70, stdev= 4.44, samples=267 lat (usec) : 50=0.46%, 100=5.05%, 250=0.52%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.79%, 4=3.91%, 10=6.74%, 20=8.07%, 50=35.45% lat (msec) : 100=26.40%, 250=8.01%, 500=0.23%, >=2000=0.03% cpu : usr=0.06%, sys=3.89%, ctx=6704, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (132kB/s), 32.3KiB/s-32.9KiB/s (33.1kB/s-33.7kB/s), io=23.4MiB (24.6MB), run=181935-186882msec WRITE: bw=135KiB/s (138kB/s), 33.4KiB/s-34.6KiB/s (34.2kB/s-35.4kB/s), io=24.6MiB (25.7MB), run=181935-186882msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144823: Fri Oct 2 08:46:41 2026 read: IOPS=4, BW=18.5KiB/s (18.9kB/s)(5992KiB/324701msec) clat (msec): min=5, max=805, avg=35.06, stdev=40.33 lat (msec): min=5, max=805, avg=35.06, stdev=40.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 50], 90.00th=[ 79], 95.00th=[ 112], | 99.00th=[ 169], 99.50th=[ 228], 99.90th=[ 300], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 80, per=33.74%, avg=24.63, stdev=16.74, samples=468 iops : min= 1, max= 20, avg= 5.49, stdev= 4.21, samples=468 write: IOPS=4, BW=19.4KiB/s (19.9kB/s)(6296KiB/324701msec); 0 zone resets clat (msec): min=34, max=52155, avg=172.67, stdev=1312.82 lat (msec): min=34, max=52155, avg=172.67, stdev=1312.82 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 372], 99.50th=[ 422], 99.90th=[ 575], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 55, per=29.74%, avg=22.60, stdev=10.55, samples=534 iops : min= 1, max= 13, avg= 4.98, stdev= 2.68, samples=534 lat (msec) : 10=4.56%, 20=18.00%, 50=16.99%, 100=22.82%, 250=33.92% lat (msec) : 500=3.55%, 750=0.10%, 1000=0.03%, >=2000=0.03% cpu : usr=0.04%, sys=0.97%, ctx=5161, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144824: Fri Oct 2 08:46:41 2026 read: IOPS=4, BW=18.2KiB/s (18.6kB/s)(5940KiB/327076msec) clat (msec): min=5, max=51771, avg=69.74, stdev=1343.13 lat (msec): min=5, max=51771, avg=69.74, stdev=1343.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 52], 90.00th=[ 80], 95.00th=[ 106], | 99.00th=[ 188], 99.50th=[ 209], 99.90th=[ 609], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 95, per=34.12%, avg=24.91, stdev=16.43, samples=459 iops : min= 1, max= 23, avg= 5.56, stdev= 4.15, samples=459 write: IOPS=4, BW=19.4KiB/s (19.9kB/s)(6348KiB/327076msec); 0 zone resets clat (msec): min=35, max=555, avg=140.59, stdev=69.47 lat (msec): min=35, max=555, avg=140.59, stdev=69.47 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 161], 80.00th=[ 188], 90.00th=[ 234], 95.00th=[ 284], | 99.00th=[ 376], 99.50th=[ 435], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 71, per=29.86%, avg=22.70, stdev=11.07, samples=537 iops : min= 1, max= 17, avg= 5.01, stdev= 2.82, samples=537 lat (msec) : 10=4.85%, 20=17.87%, 50=16.37%, 100=22.95%, 250=33.72% lat (msec) : 500=4.10%, 750=0.10%, >=2000=0.03% cpu : usr=0.04%, sys=0.98%, ctx=5131, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144825: Fri Oct 2 08:46:41 2026 read: IOPS=4, BW=18.6KiB/s (19.1kB/s)(6028KiB/323875msec) clat (msec): min=5, max=451, avg=36.57, stdev=38.67 lat (msec): min=5, max=451, avg=36.57, stdev=38.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 112], | 99.00th=[ 182], 99.50th=[ 205], 99.90th=[ 422], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 120, per=33.06%, avg=24.13, stdev=17.57, samples=480 iops : min= 1, max= 30, avg= 5.37, stdev= 4.43, samples=480 write: IOPS=4, BW=19.3KiB/s (19.8kB/s)(6260KiB/323875msec); 0 zone resets clat (msec): min=40, max=51853, avg=171.47, stdev=1308.99 lat (msec): min=40, max=51853, avg=171.47, stdev=1308.99 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 224], 95.00th=[ 264], | 99.00th=[ 376], 99.50th=[ 430], 99.90th=[ 718], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 47, per=29.91%, avg=22.73, stdev=10.57, samples=528 iops : min= 1, max= 11, avg= 5.02, stdev= 2.68, samples=528 lat (msec) : 10=3.87%, 20=18.78%, 50=16.05%, 100=23.76%, 250=34.08% lat (msec) : 500=3.35%, 750=0.07%, >=2000=0.03% cpu : usr=0.04%, sys=0.96%, ctx=5058, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144826: Fri Oct 2 08:46:41 2026 read: IOPS=4, BW=18.7KiB/s (19.2kB/s)(6052KiB/322909msec) clat (msec): min=5, max=439, avg=35.30, stdev=38.48 lat (msec): min=5, max=439, avg=35.30, stdev=38.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 83], 95.00th=[ 109], | 99.00th=[ 190], 99.50th=[ 255], 99.90th=[ 351], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 88, per=34.66%, avg=25.30, stdev=17.40, samples=462 iops : min= 1, max= 22, avg= 5.66, stdev= 4.39, samples=462 write: IOPS=4, BW=19.3KiB/s (19.8kB/s)(6236KiB/322909msec); 0 zone resets clat (msec): min=35, max=52072, avg=172.63, stdev=1317.10 lat (msec): min=35, max=52072, avg=172.63, stdev=1317.10 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 230], 95.00th=[ 266], | 99.00th=[ 376], 99.50th=[ 435], 99.90th=[ 827], 99.95th=[17113], | 99.99th=[17113] bw ( KiB/s): min= 7, max= 48, per=29.64%, avg=22.53, stdev=10.63, samples=532 iops : min= 1, max= 12, avg= 4.96, stdev= 2.71, samples=532 lat (msec) : 10=4.79%, 20=18.03%, 50=17.12%, 100=22.43%, 250=33.72% lat (msec) : 500=3.78%, 750=0.07%, 1000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=1.01%, ctx=5292, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=73.4KiB/s (75.2kB/s), 18.2KiB/s-18.7KiB/s (18.6kB/s-19.2kB/s), io=23.4MiB (24.6MB), run=322909-327076msec WRITE: bw=76.9KiB/s (78.7kB/s), 19.3KiB/s-19.4KiB/s (19.8kB/s-19.9kB/s), io=24.6MiB (25.7MB), run=322909-327076msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144900: Fri Oct 2 08:47:19 2026 read: IOPS=15, BW=241KiB/s (247kB/s)(5920KiB/24543msec) clat (usec): min=32, max=184871, avg=34510.15, stdev=25613.97 lat (usec): min=32, max=184872, avg=34511.37, stdev=25614.20 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 15401], | 30.00th=[ 22414], 40.00th=[ 26608], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[ 98042], 99.50th=[143655], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 475, per=25.03%, avg=239.50, stdev=79.88, samples=48 iops : min= 1, max= 29, avg=14.23, stdev= 5.05, samples=48 write: IOPS=16, BW=259KiB/s (266kB/s)(6368KiB/24543msec); 0 zone resets clat (usec): min=1408, max=268735, avg=29400.69, stdev=35669.58 lat (usec): min=1409, max=268738, avg=29409.85, stdev=35666.31 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1795], 10.00th=[ 2737], 20.00th=[ 4621], | 30.00th=[ 6325], 40.00th=[ 9896], 50.00th=[ 16057], 60.00th=[ 25297], | 70.00th=[ 34866], 80.00th=[ 49021], 90.00th=[ 69731], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[252707], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 124, max= 412, per=25.77%, avg=259.50, stdev=78.45, samples=48 iops : min= 7, max= 25, avg=15.48, stdev= 4.95, samples=48 lat (usec) : 50=0.78%, 100=6.12%, 250=0.65%, 500=0.39%, 750=0.26% lat (msec) : 2=3.52%, 4=4.56%, 10=13.28%, 20=10.03%, 50=39.19% lat (msec) : 100=18.49%, 250=2.47%, 500=0.26% cpu : usr=0.09%, sys=6.94%, ctx=1499, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144901: Fri Oct 2 08:47:19 2026 read: IOPS=14, BW=230KiB/s (235kB/s)(5744KiB/25023msec) clat (usec): min=45, max=368830, avg=36766.82, stdev=31576.50 lat (usec): min=46, max=368832, avg=36768.14, stdev=31576.44 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 102], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 27657], 50.00th=[ 32113], 60.00th=[ 39060], | 70.00th=[ 43779], 80.00th=[ 51643], 90.00th=[ 62129], 95.00th=[ 81265], | 99.00th=[129500], 99.50th=[206570], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 46, max= 383, per=24.00%, avg=229.69, stdev=87.86, samples=49 iops : min= 2, max= 23, avg=13.59, stdev= 5.59, samples=49 write: IOPS=16, BW=262KiB/s (268kB/s)(6544KiB/25023msec); 0 zone resets clat (usec): min=1512, max=247298, avg=28741.58, stdev=32519.64 lat (usec): min=1514, max=247301, avg=28750.52, stdev=32525.27 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2180], 10.00th=[ 2835], 20.00th=[ 4817], | 30.00th=[ 7504], 40.00th=[ 10814], 50.00th=[ 16712], 60.00th=[ 25560], | 70.00th=[ 33817], 80.00th=[ 48497], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[127402], 99.50th=[214959], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 63, max= 569, per=25.96%, avg=261.39, stdev=121.81, samples=49 iops : min= 3, max= 35, avg=15.61, stdev= 7.69, samples=49 lat (usec) : 50=0.13%, 100=4.43%, 250=0.52%, 500=0.26%, 750=0.13% lat (msec) : 2=2.34%, 4=6.51%, 10=11.46%, 20=13.67%, 50=40.10% lat (msec) : 100=17.19%, 250=3.12%, 500=0.13% cpu : usr=0.12%, sys=7.07%, ctx=1522, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144902: Fri Oct 2 08:47:19 2026 read: IOPS=16, BW=262KiB/s (268kB/s)(6256KiB/23867msec) clat (usec): min=38, max=181096, avg=33163.60, stdev=26221.05 lat (usec): min=38, max=181096, avg=33165.18, stdev=26221.04 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 71], 20.00th=[ 9896], | 30.00th=[ 20055], 40.00th=[ 26084], 50.00th=[ 30540], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 63701], 95.00th=[ 73925], | 99.00th=[124257], 99.50th=[162530], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 95, max= 559, per=27.73%, avg=265.39, stdev=91.79, samples=46 iops : min= 5, max= 34, avg=15.85, stdev= 5.78, samples=46 write: IOPS=15, BW=253KiB/s (259kB/s)(6032KiB/23867msec); 0 zone resets clat (usec): min=1517, max=195764, avg=28766.52, stdev=30356.10 lat (usec): min=1518, max=195767, avg=28772.13, stdev=30353.61 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1811], 10.00th=[ 2376], 20.00th=[ 4424], | 30.00th=[ 7570], 40.00th=[ 10552], 50.00th=[ 18220], 60.00th=[ 27919], | 70.00th=[ 36963], 80.00th=[ 50594], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[185598], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 63, max= 415, per=25.08%, avg=252.52, stdev=85.85, samples=46 iops : min= 3, max= 25, avg=15.04, stdev= 5.41, samples=46 lat (usec) : 50=1.17%, 100=6.64%, 250=1.04%, 500=0.39%, 750=0.26% lat (msec) : 2=3.91%, 4=5.34%, 10=10.29%, 20=11.85%, 50=38.02% lat (msec) : 100=19.14%, 250=1.95% cpu : usr=0.10%, sys=6.88%, ctx=1467, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144903: Fri Oct 2 08:47:19 2026 read: IOPS=15, BW=245KiB/s (251kB/s)(6032KiB/24615msec) clat (usec): min=41, max=403076, avg=34755.91, stdev=32778.83 lat (usec): min=42, max=403078, avg=34757.07, stdev=32778.84 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 1172], | 30.00th=[ 20055], 40.00th=[ 26346], 50.00th=[ 31851], 60.00th=[ 39584], | 70.00th=[ 46400], 80.00th=[ 53740], 90.00th=[ 64750], 95.00th=[ 78119], | 99.00th=[130548], 99.50th=[173016], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 63, max= 448, per=25.44%, avg=243.48, stdev=97.22, samples=48 iops : min= 3, max= 28, avg=14.46, stdev= 6.14, samples=48 write: IOPS=15, BW=254KiB/s (260kB/s)(6256KiB/24615msec); 0 zone resets clat (usec): min=1496, max=286582, avg=29314.40, stdev=33029.02 lat (usec): min=1498, max=286585, avg=29319.94, stdev=33030.56 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1795], 10.00th=[ 2704], 20.00th=[ 4359], | 30.00th=[ 6325], 40.00th=[ 11338], 50.00th=[ 17957], 60.00th=[ 25822], | 70.00th=[ 36963], 80.00th=[ 52691], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[152044], 99.50th=[206570], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 62, max= 479, per=25.21%, avg=253.90, stdev=96.38, samples=48 iops : min= 3, max= 29, avg=15.10, stdev= 6.06, samples=48 lat (usec) : 50=0.78%, 100=8.07%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=3.78%, 4=6.12%, 10=10.42%, 20=11.72%, 50=34.38% lat (msec) : 100=20.70%, 250=2.86%, 500=0.26% cpu : usr=0.10%, sys=7.11%, ctx=1510, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=957KiB/s (980kB/s), 230KiB/s-262KiB/s (235kB/s-268kB/s), io=23.4MiB (24.5MB), run=23867-25023msec WRITE: bw=1007KiB/s (1031kB/s), 253KiB/s-262KiB/s (259kB/s-268kB/s), io=24.6MiB (25.8MB), run=23867-25023msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144895: Fri Oct 2 08:47:57 2026 read: IOPS=5, BW=92.9KiB/s (95.1kB/s)(5920KiB/63737msec) clat (msec): min=6, max=243, avg=36.50, stdev=31.18 lat (msec): min=6, max=243, avg=36.51, stdev=31.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 66], 95.00th=[ 107], | 99.00th=[ 153], 99.50th=[ 222], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 375, per=27.03%, avg=101.35, stdev=56.01, samples=115 iops : min= 1, max= 23, avg= 5.57, stdev= 3.57, samples=115 write: IOPS=6, BW=99.9KiB/s (102kB/s)(6368KiB/63737msec); 0 zone resets clat (msec): min=48, max=423, avg=126.04, stdev=55.90 lat (msec): min=48, max=423, avg=126.05, stdev=55.90 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 93], 40.00th=[ 106], 50.00th=[ 114], 60.00th=[ 126], | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 192], 95.00th=[ 222], | 99.00th=[ 363], 99.50th=[ 409], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 31, max= 192, per=25.42%, avg=100.17, stdev=40.42, samples=125 iops : min= 1, max= 12, avg= 5.49, stdev= 2.60, samples=125 lat (msec) : 10=1.43%, 20=13.54%, 50=25.65%, 100=23.44%, 250=33.98% lat (msec) : 500=1.95% cpu : usr=0.05%, sys=1.47%, ctx=1481, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144896: Fri Oct 2 08:47:57 2026 read: IOPS=5, BW=89.9KiB/s (92.1kB/s)(5744KiB/63867msec) clat (msec): min=6, max=267, avg=34.79, stdev=31.18 lat (msec): min=6, max=267, avg=34.79, stdev=31.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 62], 95.00th=[ 94], | 99.00th=[ 176], 99.50th=[ 211], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 23, max= 319, per=26.99%, avg=101.20, stdev=62.83, samples=112 iops : min= 1, max= 19, avg= 5.57, stdev= 3.98, samples=112 write: IOPS=6, BW=102KiB/s (105kB/s)(6544KiB/63867msec); 0 zone resets clat (msec): min=39, max=488, avg=125.12, stdev=51.30 lat (msec): min=39, max=488, avg=125.15, stdev=51.30 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 67], 10.00th=[ 75], 20.00th=[ 87], | 30.00th=[ 96], 40.00th=[ 106], 50.00th=[ 115], 60.00th=[ 125], | 70.00th=[ 136], 80.00th=[ 159], 90.00th=[ 188], 95.00th=[ 230], | 99.00th=[ 279], 99.50th=[ 326], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 31, max= 191, per=25.87%, avg=101.94, stdev=36.53, samples=126 iops : min= 1, max= 11, avg= 5.60, stdev= 2.34, samples=126 lat (msec) : 10=1.69%, 20=12.89%, 50=24.74%, 100=23.44%, 250=35.42% lat (msec) : 500=1.82% cpu : usr=0.05%, sys=1.45%, ctx=1389, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144897: Fri Oct 2 08:47:57 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(6256KiB/61569msec) clat (msec): min=5, max=313, avg=36.86, stdev=36.97 lat (msec): min=5, max=313, avg=36.86, stdev=36.97 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 110], | 99.00th=[ 226], 99.50th=[ 243], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 319, per=28.62%, avg=107.33, stdev=72.07, samples=115 iops : min= 1, max= 19, avg= 5.94, stdev= 4.54, samples=115 write: IOPS=6, BW=97.0KiB/s (100kB/s)(6032KiB/61569msec); 0 zone resets clat (msec): min=44, max=346, avg=124.56, stdev=48.24 lat (msec): min=44, max=346, avg=124.56, stdev=48.24 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 130], | 70.00th=[ 140], 80.00th=[ 157], 90.00th=[ 186], 95.00th=[ 224], | 99.00th=[ 284], 99.50th=[ 326], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 160, per=24.95%, avg=98.31, stdev=34.65, samples=120 iops : min= 1, max= 10, avg= 5.37, stdev= 2.21, samples=120 lat (msec) : 10=2.86%, 20=15.49%, 50=23.96%, 100=22.92%, 250=33.59% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.45%, ctx=1393, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144898: Fri Oct 2 08:47:57 2026 read: IOPS=5, BW=94.6KiB/s (96.9kB/s)(6032KiB/63744msec) clat (msec): min=5, max=266, avg=35.39, stdev=33.24 lat (msec): min=5, max=266, avg=35.39, stdev=33.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 72], 95.00th=[ 111], | 99.00th=[ 161], 99.50th=[ 226], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 313, per=26.90%, avg=100.88, stdev=68.19, samples=117 iops : min= 1, max= 19, avg= 5.54, stdev= 4.33, samples=117 write: IOPS=6, BW=98.1KiB/s (100kB/s)(6256KiB/63744msec); 0 zone resets clat (msec): min=40, max=537, avg=128.43, stdev=55.02 lat (msec): min=40, max=537, avg=128.43, stdev=55.02 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 107], 50.00th=[ 118], 60.00th=[ 129], | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 192], 95.00th=[ 218], | 99.00th=[ 326], 99.50th=[ 397], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 31, max= 190, per=25.24%, avg=99.46, stdev=38.04, samples=124 iops : min= 1, max= 11, avg= 5.44, stdev= 2.42, samples=124 lat (msec) : 10=2.47%, 20=14.71%, 50=24.09%, 100=22.01%, 250=35.03% lat (msec) : 500=1.56%, 750=0.13% cpu : usr=0.05%, sys=1.34%, ctx=1413, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=375KiB/s (384kB/s), 89.9KiB/s-102KiB/s (92.1kB/s-104kB/s), io=23.4MiB (24.5MB), run=61569-63867msec WRITE: bw=395KiB/s (404kB/s), 97.0KiB/s-102KiB/s (100kB/s-105kB/s), io=24.6MiB (25.8MB), run=61569-63867msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144923: Fri Oct 2 08:48:14 2026 read: IOPS=1, BW=1338KiB/s (1370kB/s)(7168KiB/5358msec) clat (usec): min=1433, max=2202.0k, avg=460051.38, stdev=771950.16 lat (usec): min=1434, max=2202.0k, avg=460053.30, stdev=771950.34 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1434], 10.00th=[ 1434], | 20.00th=[ 175113], 30.00th=[ 196084], 40.00th=[ 196084], | 50.00th=[ 212861], 60.00th=[ 214959], 70.00th=[ 214959], | 80.00th=[ 219153], 90.00th=[2197816], 95.00th=[2197816], | 99.00th=[2197816], 99.50th=[2197816], 99.90th=[2197816], | 99.95th=[2197816], 99.99th=[2197816] bw ( KiB/s): min= 1771, max= 4096, per=70.79%, avg=2367.20, stdev=971.65, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=956KiB/s (979kB/s)(5120KiB/5358msec); 0 zone resets clat (msec): min=216, max=538, avg=388.01, stdev=121.38 lat (msec): min=216, max=542, avg=389.40, stdev=122.54 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1976, max= 2048, per=43.31%, avg=2027.50, stdev=34.41, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.83%, ctx=426, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144924: Fri Oct 2 08:48:14 2026 read: IOPS=0, BW=334KiB/s (342kB/s)(2048KiB/6124msec) clat (msec): min=254, max=260, avg=257.48, stdev= 4.11 lat (msec): min=254, max=260, avg=257.48, stdev= 4.11 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1759, max= 2043, per=56.85%, avg=1901.00, stdev=200.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1672KiB/s (1712kB/s)(10.0MiB/6124msec); 0 zone resets clat (msec): min=138, max=2535, avg=553.67, stdev=715.15 lat (msec): min=139, max=2535, avg=553.96, stdev=715.13 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 161], | 30.00th=[ 211], 40.00th=[ 226], 50.00th=[ 262], 60.00th=[ 418], | 70.00th=[ 464], 80.00th=[ 489], 90.00th=[ 634], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1872, max= 4071, per=49.98%, avg=2339.33, stdev=850.86, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.90%, ctx=160, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144925: Fri Oct 2 08:48:14 2026 read: IOPS=1, BW=1107KiB/s (1133kB/s)(6144KiB/5552msec) clat (usec): min=1884, max=342819, avg=182468.15, stdev=137033.21 lat (usec): min=1886, max=342820, avg=182469.47, stdev=137033.01 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 1893], 10.00th=[ 1893], 20.00th=[ 72877], | 30.00th=[ 72877], 40.00th=[117965], 50.00th=[117965], 60.00th=[263193], | 70.00th=[295699], 80.00th=[295699], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 1976, max= 4087, per=75.91%, avg=2538.50, stdev=1032.86, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1107KiB/s (1133kB/s)(6144KiB/5552msec); 0 zone resets clat (msec): min=178, max=2716, avg=686.04, stdev=1003.50 lat (msec): min=178, max=2716, avg=686.13, stdev=1003.50 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 232], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1793, max= 2048, per=42.55%, avg=1991.60, stdev=111.20, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=10.07%, ctx=176, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144926: Fri Oct 2 08:48:14 2026 read: IOPS=0, BW=905KiB/s (927kB/s)(5120KiB/5657msec) clat (usec): min=509, max=436582, avg=191713.17, stdev=202205.08 lat (usec): min=510, max=436583, avg=191714.72, stdev=202204.72 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 865], 40.00th=[ 865], 50.00th=[158335], 60.00th=[158335], | 70.00th=[362808], 80.00th=[362808], 90.00th=[438305], 95.00th=[438305], | 99.00th=[438305], 99.50th=[438305], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 2043, max= 5930, per=100.00%, avg=3986.50, stdev=2748.52, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1267KiB/s (1298kB/s)(7168KiB/5657msec); 0 zone resets clat (msec): min=128, max=2754, avg=636.60, stdev=952.39 lat (msec): min=128, max=2754, avg=636.69, stdev=952.39 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 140], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 296], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 667], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 2031, max= 4087, per=63.58%, avg=2976.25, stdev=1093.57, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=9.58%, ctx=150, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3344KiB/s (3424kB/s), 334KiB/s-1338KiB/s (342kB/s-1370kB/s), io=20.0MiB (20.0MB), run=5358-6124msec WRITE: bw=4682KiB/s (4794kB/s), 956KiB/s-1672KiB/s (979kB/s-1712kB/s), io=28.0MiB (29.4MB), run=5358-6124msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Fri Oct 2 08:48:15 2026 read: IOPS=1, BW=1424KiB/s (1458kB/s)(7168KiB/5033msec) clat (msec): min=80, max=2192, avg=486.99, stdev=757.13 lat (msec): min=80, max=2192, avg=486.99, stdev=757.13 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 117], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 279], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 292], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1692, max= 4007, per=79.66%, avg=2361.00, stdev=932.13, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=1017KiB/s (1042kB/s)(5120KiB/5033msec); 0 zone resets clat (msec): min=218, max=412, avg=282.24, stdev=78.07 lat (msec): min=218, max=412, avg=282.32, stdev=78.04 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2019, max= 4071, per=65.37%, avg=2712.67, stdev=1176.44, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=3.76%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Fri Oct 2 08:48:15 2026 read: IOPS=0, BW=300KiB/s (307kB/s)(2048KiB/6836msec) clat (msec): min=151, max=612, avg=381.66, stdev=326.03 lat (msec): min=151, max=612, avg=381.67, stdev=326.03 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1607, max= 1954, per=60.07%, avg=1780.50, stdev=245.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1498KiB/s (1534kB/s)(10.0MiB/6836msec); 0 zone resets clat (msec): min=175, max=2419, avg=584.07, stdev=669.69 lat (msec): min=176, max=2419, avg=584.21, stdev=669.69 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 190], | 30.00th=[ 215], 40.00th=[ 264], 50.00th=[ 347], 60.00th=[ 447], | 70.00th=[ 510], 80.00th=[ 542], 90.00th=[ 735], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1988, max= 4055, per=62.67%, avg=2601.00, stdev=988.04, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.89%, ctx=85, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144921: Fri Oct 2 08:48:15 2026 read: IOPS=1, BW=1138KiB/s (1166kB/s)(6144KiB/5397msec) clat (msec): min=109, max=375, avg=227.92, stdev=88.93 lat (msec): min=109, max=375, avg=227.93, stdev=88.93 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 224], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1954, max= 4071, per=100.00%, avg=3344.00, stdev=1204.20, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1138KiB/s (1166kB/s)(6144KiB/5397msec); 0 zone resets clat (msec): min=192, max=2371, avg=660.25, stdev=847.03 lat (msec): min=192, max=2371, avg=660.45, stdev=846.98 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 426], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1592, max= 2048, per=46.94%, avg=1947.83, stdev=177.57, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=50.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.52%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144922: Fri Oct 2 08:48:15 2026 read: IOPS=0, BW=741KiB/s (759kB/s)(5120KiB/6908msec) clat (msec): min=130, max=678, avg=435.26, stdev=264.72 lat (msec): min=130, max=678, avg=435.26, stdev=264.72 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2003, max= 3976, per=90.27%, avg=2675.67, stdev=1126.35, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1038KiB/s (1063kB/s)(7168KiB/6908msec); 0 zone resets clat (msec): min=166, max=2523, avg=630.95, stdev=845.84 lat (msec): min=166, max=2523, avg=631.07, stdev=845.82 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 199], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 288], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 523], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2003, max= 4071, per=73.20%, avg=3038.00, stdev=1174.50, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=41.67%, 500=16.67%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.30%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2965KiB/s (3036kB/s), 300KiB/s-1424KiB/s (307kB/s-1458kB/s), io=20.0MiB (20.0MB), run=5033-6908msec WRITE: bw=4151KiB/s (4250kB/s), 1017KiB/s-1498KiB/s (1042kB/s-1534kB/s), io=28.0MiB (29.4MB), run=5033-6908msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144938: Fri Oct 2 08:48:29 2026 read: IOPS=1, BW=4153KiB/s (4252kB/s)(12.0MiB/2959msec) clat (msec): min=894, max=913, avg=903.02, stdev= 9.88 lat (msec): min=894, max=913, avg=903.02, stdev= 9.88 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7953, max= 8159, per=100.00%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=17.31%, ctx=403, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144939: Fri Oct 2 08:48:29 2026 read: IOPS=0, BW=1286KiB/s (1317kB/s)(4096KiB/3185msec) clat (nsec): min=910427k, max=910427k, avg=910426969.00, stdev= 0.00 lat (nsec): min=910430k, max=910430k, avg=910429789.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2572KiB/s (2634kB/s)(8192KiB/3185msec); 0 zone resets clat (msec): min=911, max=1147, avg=1029.30, stdev=167.00 lat (msec): min=912, max=1147, avg=1029.93, stdev=166.65 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7953, max= 7953, per=84.35%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.03%, sys=4.71%, ctx=127, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144940: Fri Oct 2 08:48:29 2026 write: IOPS=0, BW=3820KiB/s (3911kB/s)(12.0MiB/3217msec); 0 zone resets clat (msec): min=505, max=1764, avg=1001.82, stdev=670.52 lat (msec): min=507, max=1765, avg=1002.80, stdev=670.02 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7953, max= 7984, per=84.51%, avg=7968.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.03%, sys=7.87%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Fri Oct 2 08:48:29 2026 write: IOPS=0, BW=3536KiB/s (3621kB/s)(12.0MiB/3475msec); 0 zone resets clat (msec): min=760, max=1748, avg=1136.67, stdev=534.37 lat (msec): min=761, max=1748, avg=1137.08, stdev=534.32 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8031, max= 8159, per=85.85%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.17%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5144KiB/s (5268kB/s), 1286KiB/s-4153KiB/s (1317kB/s-4252kB/s), io=16.0MiB (16.8MB), run=2959-3185msec WRITE: bw=9430KiB/s (9656kB/s), 2572KiB/s-3820KiB/s (2634kB/s-3911kB/s), io=32.0MiB (33.6MB), run=3185-3475msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144934: Fri Oct 2 08:48:30 2026 read: IOPS=2, BW=9394KiB/s (9620kB/s)(12.0MiB/1308msec) clat (msec): min=261, max=710, avg=418.29, stdev=253.41 lat (msec): min=261, max=710, avg=418.30, stdev=253.41 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min=11787, max=11787, per=100.00%, avg=11787.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=10.56%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144935: Fri Oct 2 08:48:30 2026 read: IOPS=0, BW=1043KiB/s (1068kB/s)(4096KiB/3929msec) clat (nsec): min=1262.1M, max=1262.1M, avg=1262113027.00, stdev= 0.00 lat (nsec): min=1262.1M, max=1262.1M, avg=1262114752.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2085KiB/s (2135kB/s)(8192KiB/3929msec); 0 zone resets clat (msec): min=1031, max=1555, avg=1293.71, stdev=370.19 lat (msec): min=1032, max=1558, avg=1295.44, stdev=371.81 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8143, max= 8143, per=99.75%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.39%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144936: Fri Oct 2 08:48:30 2026 write: IOPS=0, BW=3061KiB/s (3135kB/s)(12.0MiB/4014msec); 0 zone resets clat (msec): min=340, max=2755, avg=1284.01, stdev=1291.00 lat (msec): min=341, max=2757, avg=1284.99, stdev=1292.04 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 8159, max= 8159, per=99.95%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.39%, ctx=88, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144937: Fri Oct 2 08:48:30 2026 write: IOPS=0, BW=3642KiB/s (3729kB/s)(12.0MiB/3374msec); 0 zone resets clat (msec): min=383, max=2232, avg=1077.94, stdev=1006.92 lat (msec): min=383, max=2233, avg=1078.31, stdev=1006.93 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 7757, max= 8094, per=97.09%, avg=7925.50, stdev=238.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.81%, ctx=86, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4170KiB/s (4270kB/s), 1043KiB/s-9394KiB/s (1068kB/s-9620kB/s), io=16.0MiB (16.8MB), run=1308-3929msec WRITE: bw=8163KiB/s (8359kB/s), 2085KiB/s-3642KiB/s (2135kB/s-3729kB/s), io=32.0MiB (33.6MB), run=3374-4014msec