== sanity test 398b: DIO and buffer IO race ============== 04:41:14 (1785400874) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.25398 s, 6.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144620: Thu Jul 30 04:45:12 2026 read: IOPS=7, BW=28.4KiB/s (29.1kB/s)(5992KiB/210855msec) clat (usec): min=27, max=2033.9k, avg=69047.48, stdev=83786.22 lat (usec): min=27, max=2033.9k, avg=69053.45, stdev=83785.83 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 13173], | 20.00th=[ 28967], 30.00th=[ 37487], 40.00th=[ 45876], | 50.00th=[ 55313], 60.00th=[ 65799], 70.00th=[ 79168], | 80.00th=[ 98042], 90.00th=[ 128451], 95.00th=[ 160433], | 99.00th=[ 244319], 99.50th=[ 471860], 99.90th=[1182794], | 99.95th=[2038432], 99.99th=[2038432] bw ( KiB/s): min= 4, max= 95, per=26.59%, avg=30.04, stdev=16.94, samples=383 iops : min= 1, max= 23, avg= 6.85, stdev= 4.27, samples=383 write: IOPS=7, BW=29.9KiB/s (30.6kB/s)(6296KiB/210855msec); 0 zone resets clat (usec): min=1037, max=1003.2k, avg=67800.83, stdev=77639.51 lat (usec): min=1038, max=1003.2k, avg=67807.38, stdev=77642.42 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1549], | 20.00th=[ 8848], 30.00th=[ 16450], 40.00th=[ 31065], | 50.00th=[ 45876], 60.00th=[ 62653], 70.00th=[ 84411], | 80.00th=[ 111674], 90.00th=[ 156238], 95.00th=[ 202376], | 99.00th=[ 367002], 99.50th=[ 413139], 99.90th=[ 616563], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 6, max= 95, per=25.69%, avg=30.57, stdev=17.14, samples=395 iops : min= 1, max= 23, avg= 6.98, stdev= 4.33, samples=395 lat (usec) : 50=0.46%, 100=3.78%, 250=0.23%, 500=0.07% lat (msec) : 2=5.70%, 4=1.40%, 10=4.33%, 20=7.58%, 50=25.07% lat (msec) : 100=29.49%, 250=19.82%, 500=1.79%, 750=0.13%, 1000=0.07% lat (msec) : 2000=0.07%, >=2000=0.03% cpu : usr=0.05%, sys=3.72%, ctx=6383, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144622: Thu Jul 30 04:45:12 2026 read: IOPS=7, BW=28.6KiB/s (29.3kB/s)(5940KiB/207329msec) clat (usec): min=33, max=2111.3k, avg=68452.35, stdev=80131.79 lat (usec): min=33, max=2111.3k, avg=68459.43, stdev=80130.04 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 15139], | 20.00th=[ 28705], 30.00th=[ 38011], 40.00th=[ 44827], | 50.00th=[ 53740], 60.00th=[ 65274], 70.00th=[ 79168], | 80.00th=[ 98042], 90.00th=[ 127402], 95.00th=[ 160433], | 99.00th=[ 299893], 99.50th=[ 438305], 99.90th=[ 725615], | 99.95th=[2105541], 99.99th=[2105541] bw ( KiB/s): min= 4, max= 79, per=26.28%, avg=29.69, stdev=16.02, samples=384 iops : min= 1, max= 19, avg= 6.75, stdev= 4.04, samples=384 write: IOPS=7, BW=30.6KiB/s (31.4kB/s)(6348KiB/207329msec); 0 zone resets clat (usec): min=989, max=1005.7k, avg=66012.61, stdev=79264.86 lat (usec): min=990, max=1005.7k, avg=66014.57, stdev=79264.55 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1303], 10.00th=[ 1467], | 20.00th=[ 7111], 30.00th=[ 14222], 40.00th=[ 26870], | 50.00th=[ 44303], 60.00th=[ 61080], 70.00th=[ 80217], | 80.00th=[ 108528], 90.00th=[ 160433], 95.00th=[ 206570], | 99.00th=[ 371196], 99.50th=[ 471860], 99.90th=[ 792724], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 102, per=26.39%, avg=31.40, stdev=17.06, samples=389 iops : min= 1, max= 25, avg= 7.18, stdev= 4.30, samples=389 lat (usec) : 50=0.46%, 100=3.65%, 250=0.20%, 1000=0.16% lat (msec) : 2=6.25%, 4=1.33%, 10=5.21%, 20=6.64%, 50=26.24% lat (msec) : 100=29.13%, 250=18.68%, 500=1.76%, 750=0.20%, 1000=0.03% lat (msec) : 2000=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=4.04%, ctx=6274, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144625: Thu Jul 30 04:45:12 2026 read: IOPS=7, BW=28.9KiB/s (29.6kB/s)(6028KiB/208888msec) clat (usec): min=28, max=1189.6k, avg=67780.73, stdev=65625.69 lat (usec): min=28, max=1189.6k, avg=67782.14, stdev=65625.66 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 14877], | 20.00th=[ 29754], 30.00th=[ 38011], 40.00th=[ 45876], | 50.00th=[ 54789], 60.00th=[ 65799], 70.00th=[ 78119], | 80.00th=[ 95945], 90.00th=[ 130548], 95.00th=[ 164627], | 99.00th=[ 278922], 99.50th=[ 308282], 99.90th=[ 868221], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 4, max= 86, per=26.44%, avg=29.87, stdev=17.59, samples=386 iops : min= 1, max= 21, avg= 6.81, stdev= 4.44, samples=386 write: IOPS=7, BW=29.0KiB/s (30.7kB/s)(6260KiB/208888msec); 0 zone resets clat (usec): min=1006, max=2324.1k, avg=67721.31, stdev=92913.33 lat (usec): min=1006, max=2324.1k, avg=67723.97, stdev=92912.96 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1467], | 20.00th=[ 6652], 30.00th=[ 14615], 40.00th=[ 29754], | 50.00th=[ 46400], 60.00th=[ 63177], 70.00th=[ 82314], | 80.00th=[ 111674], 90.00th=[ 158335], 95.00th=[ 200279], | 99.00th=[ 333448], 99.50th=[ 404751], 99.90th=[ 792724], | 99.95th=[2332034], 99.99th=[2332034] bw ( KiB/s): min= 4, max= 86, per=25.81%, avg=30.72, stdev=15.65, samples=390 iops : min= 1, max= 21, avg= 7.01, stdev= 3.94, samples=390 lat (usec) : 50=0.68%, 100=3.39%, 250=0.20%, 500=0.07%, 1000=0.03% lat (msec) : 2=6.32%, 4=1.56%, 10=5.08%, 20=5.96%, 50=25.33% lat (msec) : 100=30.18%, 250=19.21%, 500=1.79%, 750=0.10%, 1000=0.07% lat (msec) : 2000=0.03%, >=2000=0.03% cpu : usr=0.07%, sys=3.62%, ctx=6185, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144626: Thu Jul 30 04:45:12 2026 read: IOPS=7, BW=28.9KiB/s (29.6kB/s)(6052KiB/209596msec) clat (usec): min=32, max=1653.0k, avg=68100.85, stdev=68985.50 lat (usec): min=32, max=1653.0k, avg=68109.08, stdev=68989.10 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 10290], | 20.00th=[ 27919], 30.00th=[ 37487], 40.00th=[ 46400], | 50.00th=[ 55837], 60.00th=[ 67634], 70.00th=[ 81265], | 80.00th=[ 96994], 90.00th=[ 130548], 95.00th=[ 164627], | 99.00th=[ 267387], 99.50th=[ 320865], 99.90th=[ 574620], | 99.95th=[1652556], 99.99th=[1652556] bw ( KiB/s): min= 6, max= 87, per=27.20%, avg=30.74, stdev=16.23, samples=379 iops : min= 1, max= 21, avg= 7.01, stdev= 4.07, samples=379 write: IOPS=7, BW=29.8KiB/s (30.5kB/s)(6236KiB/209596msec); 0 zone resets clat (usec): min=1100, max=2467.7k, avg=67801.06, stdev=99207.65 lat (usec): min=1102, max=2467.7k, avg=67808.93, stdev=99214.02 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1483], | 20.00th=[ 7111], 30.00th=[ 13566], 40.00th=[ 27657], | 50.00th=[ 44303], 60.00th=[ 61080], 70.00th=[ 82314], | 80.00th=[ 110625], 90.00th=[ 162530], 95.00th=[ 208667], | 99.00th=[ 350225], 99.50th=[ 517997], 99.90th=[ 859833], | 99.95th=[2466251], 99.99th=[2466251] bw ( KiB/s): min= 5, max= 102, per=26.12%, avg=31.09, stdev=17.47, samples=385 iops : min= 1, max= 25, avg= 7.11, stdev= 4.40, samples=385 lat (usec) : 50=0.72%, 100=3.55%, 250=0.26%, 500=0.03%, 1000=0.07% lat (msec) : 2=6.18%, 4=1.40%, 10=5.37%, 20=6.84%, 50=23.96% lat (msec) : 100=30.53%, 250=19.24%, 500=1.50%, 750=0.26%, 1000=0.03% lat (msec) : 2000=0.03%, >=2000=0.03% cpu : usr=0.05%, sys=3.66%, ctx=6229, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=114KiB/s (117kB/s), 28.4KiB/s-28.9KiB/s (29.1kB/s-29.6kB/s), io=23.4MiB (24.6MB), run=207329-210855msec WRITE: bw=119KiB/s (122kB/s), 29.8KiB/s-30.6KiB/s (30.5kB/s-31.4kB/s), io=24.6MiB (25.7MB), run=207329-210855msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144619: Thu Jul 30 04:48:41 2026 read: IOPS=3, BW=14.3KiB/s (14.6kB/s)(5992KiB/419706msec) clat (msec): min=5, max=2134, avg=56.26, stdev=86.66 lat (msec): min=5, max=2134, avg=56.27, stdev=86.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 72], 90.00th=[ 123], 95.00th=[ 178], | 99.00th=[ 342], 99.50th=[ 493], 99.90th=[ 827], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 7, max= 79, per=32.80%, avg=18.70, stdev=13.54, samples=607 iops : min= 1, max= 19, avg= 4.02, stdev= 3.42, samples=607 write: IOPS=3, BW=15.0KiB/s (15.4kB/s)(6296KiB/419706msec); 0 zone resets clat (msec): min=24, max=1931, avg=212.66, stdev=129.67 lat (msec): min=24, max=1931, avg=212.67, stdev=129.67 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 74], 10.00th=[ 99], 20.00th=[ 122], | 30.00th=[ 142], 40.00th=[ 161], 50.00th=[ 184], 60.00th=[ 205], | 70.00th=[ 243], 80.00th=[ 288], 90.00th=[ 359], 95.00th=[ 439], | 99.00th=[ 651], 99.50th=[ 785], 99.90th=[ 1200], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 5, max= 63, per=26.22%, avg=15.47, stdev= 8.09, samples=765 iops : min= 1, max= 15, avg= 3.20, stdev= 2.08, samples=765 lat (msec) : 10=1.99%, 20=10.16%, 50=21.81%, 100=13.93%, 250=36.98% lat (msec) : 500=13.61%, 750=1.14%, 1000=0.23%, 2000=0.13%, >=2000=0.03% cpu : usr=0.03%, sys=0.91%, ctx=5017, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144621: Thu Jul 30 04:48:41 2026 read: IOPS=3, BW=14.2KiB/s (14.5kB/s)(5940KiB/418696msec) clat (msec): min=5, max=2149, avg=55.38, stdev=86.32 lat (msec): min=5, max=2149, avg=55.38, stdev=86.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 72], 90.00th=[ 116], 95.00th=[ 169], | 99.00th=[ 342], 99.50th=[ 443], 99.90th=[ 844], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7, max= 94, per=33.10%, avg=18.87, stdev=13.77, samples=599 iops : min= 1, max= 23, avg= 4.07, stdev= 3.47, samples=599 write: IOPS=3, BW=15.2KiB/s (15.5kB/s)(6348KiB/418696msec); 0 zone resets clat (msec): min=37, max=1276, avg=211.57, stdev=127.22 lat (msec): min=37, max=1276, avg=211.57, stdev=127.22 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 82], 10.00th=[ 97], 20.00th=[ 123], | 30.00th=[ 140], 40.00th=[ 163], 50.00th=[ 184], 60.00th=[ 209], | 70.00th=[ 234], 80.00th=[ 275], 90.00th=[ 351], 95.00th=[ 435], | 99.00th=[ 701], 99.50th=[ 852], 99.90th=[ 1250], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 5, max= 47, per=26.87%, avg=15.85, stdev= 8.01, samples=756 iops : min= 1, max= 11, avg= 3.30, stdev= 2.06, samples=756 lat (msec) : 10=1.50%, 20=10.22%, 50=22.36%, 100=13.87%, 250=37.43% lat (msec) : 500=12.86%, 750=1.24%, 1000=0.29%, 2000=0.20%, >=2000=0.03% cpu : usr=0.03%, sys=0.89%, ctx=5065, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144623: Thu Jul 30 04:48:41 2026 read: IOPS=3, BW=14.4KiB/s (14.8kB/s)(6028KiB/417674msec) clat (msec): min=4, max=795, avg=56.55, stdev=69.50 lat (msec): min=4, max=795, avg=56.55, stdev=69.50 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 80], 90.00th=[ 128], 95.00th=[ 174], | 99.00th=[ 326], 99.50th=[ 498], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 5, max= 80, per=32.68%, avg=18.63, stdev=13.42, samples=616 iops : min= 1, max= 20, avg= 4.00, stdev= 3.39, samples=616 write: IOPS=3, BW=14.0KiB/s (15.3kB/s)(6260KiB/417674msec); 0 zone resets clat (msec): min=35, max=2283, avg=211.98, stdev=127.77 lat (msec): min=35, max=2283, avg=211.98, stdev=127.77 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 85], 10.00th=[ 100], 20.00th=[ 124], | 30.00th=[ 144], 40.00th=[ 167], 50.00th=[ 188], 60.00th=[ 207], | 70.00th=[ 241], 80.00th=[ 279], 90.00th=[ 347], 95.00th=[ 426], | 99.00th=[ 617], 99.50th=[ 718], 99.90th=[ 1284], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 5, max= 48, per=26.10%, avg=15.40, stdev= 7.73, samples=766 iops : min= 1, max= 12, avg= 3.19, stdev= 1.99, samples=766 lat (msec) : 10=1.56%, 20=10.03%, 50=21.55%, 100=14.26%, 250=37.83% lat (msec) : 500=13.22%, 750=1.30%, 1000=0.13%, 2000=0.10%, >=2000=0.03% cpu : usr=0.02%, sys=0.89%, ctx=4994, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144624: Thu Jul 30 04:48:41 2026 read: IOPS=3, BW=14.6KiB/s (14.0kB/s)(6052KiB/413281msec) clat (msec): min=6, max=1767, avg=53.07, stdev=71.21 lat (msec): min=6, max=1767, avg=53.07, stdev=71.21 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 73], 90.00th=[ 116], 95.00th=[ 161], | 99.00th=[ 288], 99.50th=[ 351], 99.90th=[ 659], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7, max= 87, per=33.70%, avg=19.21, stdev=13.73, samples=601 iops : min= 1, max= 21, avg= 4.14, stdev= 3.48, samples=601 write: IOPS=3, BW=15.1KiB/s (15.5kB/s)(6236KiB/413281msec); 0 zone resets clat (msec): min=31, max=2494, avg=213.11, stdev=138.39 lat (msec): min=31, max=2494, avg=213.12, stdev=138.39 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 84], 10.00th=[ 99], 20.00th=[ 124], | 30.00th=[ 142], 40.00th=[ 163], 50.00th=[ 188], 60.00th=[ 209], | 70.00th=[ 239], 80.00th=[ 279], 90.00th=[ 342], 95.00th=[ 426], | 99.00th=[ 667], 99.50th=[ 953], 99.90th=[ 1368], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 5, max= 56, per=26.48%, avg=15.62, stdev= 7.83, samples=754 iops : min= 1, max= 14, avg= 3.24, stdev= 2.02, samples=754 lat (msec) : 10=1.53%, 20=10.51%, 50=22.33%, 100=13.83%, 250=37.50% lat (msec) : 500=12.76%, 750=1.20%, 1000=0.07%, 2000=0.23%, >=2000=0.03% cpu : usr=0.03%, sys=0.93%, ctx=5016, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=57.2KiB/s (58.6kB/s), 14.2KiB/s-14.6KiB/s (14.5kB/s-14.0kB/s), io=23.4MiB (24.6MB), run=413281-419706msec WRITE: bw=59.9KiB/s (61.3kB/s), 14.0KiB/s-15.2KiB/s (15.3kB/s-15.5kB/s), io=24.6MiB (25.7MB), run=413281-419706msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144704: Thu Jul 30 04:49:36 2026 read: IOPS=9, BW=146KiB/s (149kB/s)(5920KiB/40681msec) clat (usec): min=35, max=251356, avg=55207.79, stdev=45129.45 lat (usec): min=35, max=251357, avg=55208.94, stdev=45129.53 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 52], 10.00th=[ 56], 20.00th=[ 75], | 30.00th=[ 32637], 40.00th=[ 43254], 50.00th=[ 54264], 60.00th=[ 63177], | 70.00th=[ 72877], 80.00th=[ 88605], 90.00th=[107480], 95.00th=[131597], | 99.00th=[219153], 99.50th=[227541], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 30, max= 479, per=25.32%, avg=145.34, stdev=70.22, samples=79 iops : min= 1, max= 29, avg= 8.29, stdev= 4.40, samples=79 write: IOPS=9, BW=157KiB/s (160kB/s)(6368KiB/40681msec); 0 zone resets clat (usec): min=1489, max=379899, avg=50227.52, stdev=57310.01 lat (usec): min=1491, max=379901, avg=50229.43, stdev=57310.04 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1811], 10.00th=[ 2638], 20.00th=[ 8848], | 30.00th=[ 12780], 40.00th=[ 19530], 50.00th=[ 27132], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 83362], 90.00th=[128451], 95.00th=[164627], | 99.00th=[270533], 99.50th=[329253], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 318, per=25.99%, avg=156.97, stdev=68.46, samples=79 iops : min= 1, max= 19, avg= 9.04, stdev= 4.33, samples=79 lat (usec) : 50=1.69%, 100=8.72%, 250=0.26%, 500=0.26%, 1000=0.26% lat (msec) : 2=4.04%, 4=1.56%, 10=6.38%, 20=9.51%, 50=22.92% lat (msec) : 100=30.21%, 250=13.41%, 500=0.78% cpu : usr=0.07%, sys=4.29%, ctx=1366, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144705: Thu Jul 30 04:49:36 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(5744KiB/41456msec) clat (usec): min=37, max=402180, avg=61254.20, stdev=50701.51 lat (usec): min=37, max=402181, avg=61255.31, stdev=50701.51 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 19530], | 30.00th=[ 39060], 40.00th=[ 45351], 50.00th=[ 56361], 60.00th=[ 64226], | 70.00th=[ 79168], 80.00th=[ 96994], 90.00th=[125305], 95.00th=[137364], | 99.00th=[235930], 99.50th=[362808], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 31, max= 359, per=24.47%, avg=140.43, stdev=66.27, samples=79 iops : min= 1, max= 22, avg= 7.97, stdev= 4.18, samples=79 write: IOPS=9, BW=158KiB/s (162kB/s)(6544KiB/41456msec); 0 zone resets clat (usec): min=1444, max=290912, avg=46954.69, stdev=52954.60 lat (usec): min=1445, max=290914, avg=46958.92, stdev=52956.32 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1696], 10.00th=[ 1844], 20.00th=[ 7177], | 30.00th=[ 11338], 40.00th=[ 17433], 50.00th=[ 26608], 60.00th=[ 42206], | 70.00th=[ 56361], 80.00th=[ 81265], 90.00th=[115868], 95.00th=[156238], | 99.00th=[250610], 99.50th=[267387], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 30, max= 432, per=26.13%, avg=157.82, stdev=76.52, samples=80 iops : min= 1, max= 27, avg= 9.09, stdev= 4.87, samples=80 lat (usec) : 50=1.04%, 100=6.64%, 250=0.52%, 500=0.13% lat (msec) : 2=6.12%, 4=1.95%, 10=6.77%, 20=8.98%, 50=22.27% lat (msec) : 100=29.69%, 250=14.84%, 500=1.04% cpu : usr=0.05%, sys=4.11%, ctx=1343, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144706: Thu Jul 30 04:49:36 2026 read: IOPS=9, BW=150KiB/s (154kB/s)(6256KiB/41718msec) clat (usec): min=30, max=233336, avg=55582.05, stdev=47029.07 lat (usec): min=30, max=233337, avg=55583.19, stdev=47029.04 clat percentiles (usec): | 1.00th=[ 34], 5.00th=[ 53], 10.00th=[ 58], 20.00th=[ 89], | 30.00th=[ 31065], 40.00th=[ 40633], 50.00th=[ 50070], 60.00th=[ 59507], | 70.00th=[ 71828], 80.00th=[ 88605], 90.00th=[113771], 95.00th=[149947], | 99.00th=[208667], 99.50th=[210764], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 30, max= 316, per=26.48%, avg=151.98, stdev=64.76, samples=80 iops : min= 1, max= 19, avg= 8.72, stdev= 4.10, samples=80 write: IOPS=9, BW=145KiB/s (148kB/s)(6032KiB/41718msec); 0 zone resets clat (usec): min=1217, max=592988, avg=52351.86, stdev=61548.24 lat (usec): min=1220, max=592990, avg=52353.98, stdev=61548.20 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1713], 10.00th=[ 2073], 20.00th=[ 7242], | 30.00th=[ 12649], 40.00th=[ 19530], 50.00th=[ 31589], 60.00th=[ 44827], | 70.00th=[ 66847], 80.00th=[ 90702], 90.00th=[131597], 95.00th=[158335], | 99.00th=[295699], 99.50th=[337642], 99.90th=[591397], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 30, max= 310, per=23.61%, avg=142.60, stdev=65.23, samples=81 iops : min= 1, max= 19, avg= 8.12, stdev= 4.13, samples=81 lat (usec) : 50=1.56%, 100=8.85%, 250=0.52%, 1000=0.13% lat (msec) : 2=4.56%, 4=2.34%, 10=5.86%, 20=8.46%, 50=24.74% lat (msec) : 100=27.34%, 250=15.10%, 500=0.39%, 750=0.13% cpu : usr=0.05%, sys=4.24%, ctx=1410, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144707: Thu Jul 30 04:49:36 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38932msec) clat (usec): min=27, max=270734, avg=56291.68, stdev=45988.20 lat (usec): min=27, max=270735, avg=56346.98, stdev=46077.42 clat percentiles (usec): | 1.00th=[ 36], 5.00th=[ 49], 10.00th=[ 58], 20.00th=[ 74], | 30.00th=[ 30540], 40.00th=[ 44303], 50.00th=[ 54789], 60.00th=[ 68682], | 70.00th=[ 77071], 80.00th=[ 88605], 90.00th=[109577], 95.00th=[133694], | 99.00th=[196084], 99.50th=[248513], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 30, max= 316, per=26.92%, avg=154.53, stdev=69.20, samples=76 iops : min= 1, max= 19, avg= 8.87, stdev= 4.36, samples=76 write: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38932msec); 0 zone resets clat (usec): min=1050, max=416469, avg=44930.34, stdev=55124.60 lat (usec): min=1051, max=416470, avg=44932.21, stdev=55124.57 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1713], 10.00th=[ 1893], 20.00th=[ 6587], | 30.00th=[ 10028], 40.00th=[ 15926], 50.00th=[ 22676], 60.00th=[ 37487], | 70.00th=[ 53740], 80.00th=[ 74974], 90.00th=[112722], 95.00th=[154141], | 99.00th=[278922], 99.50th=[320865], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 30, max= 446, per=26.56%, avg=160.41, stdev=79.64, samples=76 iops : min= 1, max= 27, avg= 9.25, stdev= 5.05, samples=76 lat (usec) : 50=2.60%, 100=8.07%, 250=0.78%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=6.51%, 4=1.69%, 10=7.16%, 20=9.64%, 50=19.92% lat (msec) : 100=29.95%, 250=12.37%, 500=0.78% cpu : usr=0.05%, sys=4.75%, ctx=1369, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=574KiB/s (588kB/s), 139KiB/s-155KiB/s (142kB/s-159kB/s), io=23.4MiB (24.5MB), run=38932-41718msec WRITE: bw=604KiB/s (619kB/s), 145KiB/s-161KiB/s (148kB/s-165kB/s), io=24.6MiB (25.8MB), run=38932-41718msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144709: Thu Jul 30 04:50:26 2026 read: IOPS=4, BW=65.4KiB/s (66.0kB/s)(5920KiB/90502msec) clat (msec): min=6, max=520, avg=53.40, stdev=63.12 lat (msec): min=6, max=520, avg=53.41, stdev=63.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 125], 95.00th=[ 192], | 99.00th=[ 317], 99.50th=[ 405], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 30, max= 285, per=30.25%, avg=79.55, stdev=54.36, samples=145 iops : min= 1, max= 17, avg= 4.17, stdev= 3.46, samples=145 write: IOPS=4, BW=70.4KiB/s (72.1kB/s)(6368KiB/90502msec); 0 zone resets clat (msec): min=40, max=697, avg=177.43, stdev=93.89 lat (msec): min=40, max=697, avg=177.43, stdev=93.89 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 80], 20.00th=[ 105], | 30.00th=[ 118], 40.00th=[ 133], 50.00th=[ 153], 60.00th=[ 176], | 70.00th=[ 203], 80.00th=[ 249], 90.00th=[ 317], 95.00th=[ 359], | 99.00th=[ 468], 99.50th=[ 558], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 30, max= 191, per=26.42%, avg=73.18, stdev=38.75, samples=170 iops : min= 1, max= 11, avg= 3.76, stdev= 2.47, samples=170 lat (msec) : 10=1.69%, 20=10.94%, 50=21.22%, 100=17.06%, 250=37.63% lat (msec) : 500=10.94%, 750=0.52% cpu : usr=0.03%, sys=1.06%, ctx=1327, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144710: Thu Jul 30 04:50:27 2026 read: IOPS=3, BW=63.2KiB/s (64.7kB/s)(5744KiB/90866msec) clat (msec): min=7, max=373, avg=49.65, stdev=53.00 lat (msec): min=7, max=373, avg=49.65, stdev=53.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 66], 90.00th=[ 108], 95.00th=[ 182], | 99.00th=[ 253], 99.50th=[ 300], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 318, per=29.28%, avg=77.01, stdev=55.47, samples=146 iops : min= 1, max= 19, avg= 4.03, stdev= 3.50, samples=146 write: IOPS=4, BW=72.0KiB/s (73.7kB/s)(6544KiB/90866msec); 0 zone resets clat (msec): min=33, max=650, avg=178.32, stdev=97.17 lat (msec): min=33, max=650, avg=178.33, stdev=97.17 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 69], 10.00th=[ 85], 20.00th=[ 101], | 30.00th=[ 122], 40.00th=[ 138], 50.00th=[ 155], 60.00th=[ 178], | 70.00th=[ 207], 80.00th=[ 236], 90.00th=[ 300], 95.00th=[ 388], | 99.00th=[ 506], 99.50th=[ 584], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 29, max= 187, per=27.07%, avg=74.98, stdev=36.53, samples=171 iops : min= 1, max= 11, avg= 3.88, stdev= 2.34, samples=171 lat (msec) : 10=1.17%, 20=11.46%, 50=21.48%, 100=17.84%, 250=38.67% lat (msec) : 500=8.59%, 750=0.78% cpu : usr=0.03%, sys=1.04%, ctx=1328, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144711: Thu Jul 30 04:50:27 2026 read: IOPS=4, BW=70.7KiB/s (72.4kB/s)(6256KiB/88478msec) clat (msec): min=6, max=426, avg=49.45, stdev=56.61 lat (msec): min=6, max=426, avg=49.45, stdev=56.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 109], 95.00th=[ 174], | 99.00th=[ 309], 99.50th=[ 363], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 350, per=33.27%, avg=87.49, stdev=64.80, samples=141 iops : min= 1, max= 21, avg= 4.68, stdev= 4.09, samples=141 write: IOPS=4, BW=68.2KiB/s (69.8kB/s)(6032KiB/88478msec); 0 zone resets clat (msec): min=45, max=708, avg=183.01, stdev=94.25 lat (msec): min=45, max=708, avg=183.01, stdev=94.25 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 78], 10.00th=[ 87], 20.00th=[ 105], | 30.00th=[ 124], 40.00th=[ 140], 50.00th=[ 159], 60.00th=[ 182], | 70.00th=[ 213], 80.00th=[ 255], 90.00th=[ 321], 95.00th=[ 368], | 99.00th=[ 451], 99.50th=[ 600], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 28, max= 191, per=25.77%, avg=71.39, stdev=33.59, samples=165 iops : min= 1, max= 11, avg= 3.65, stdev= 2.16, samples=165 lat (msec) : 10=1.30%, 20=11.46%, 50=24.87%, 100=15.63%, 250=35.81% lat (msec) : 500=10.68%, 750=0.26% cpu : usr=0.03%, sys=1.11%, ctx=1338, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144712: Thu Jul 30 04:50:27 2026 read: IOPS=4, BW=67.5KiB/s (69.1kB/s)(6032KiB/89341msec) clat (msec): min=7, max=719, avg=51.37, stdev=72.20 lat (msec): min=7, max=719, avg=51.37, stdev=72.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 67], 90.00th=[ 109], 95.00th=[ 133], | 99.00th=[ 388], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 30, max= 256, per=31.94%, avg=84.01, stdev=55.66, samples=140 iops : min= 1, max= 16, avg= 4.49, stdev= 3.58, samples=140 write: IOPS=4, BW=70.0KiB/s (71.7kB/s)(6256KiB/89341msec); 0 zone resets clat (msec): min=42, max=638, avg=178.76, stdev=98.20 lat (msec): min=42, max=638, avg=178.76, stdev=98.21 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 74], 10.00th=[ 84], 20.00th=[ 101], | 30.00th=[ 116], 40.00th=[ 133], 50.00th=[ 153], 60.00th=[ 174], | 70.00th=[ 207], 80.00th=[ 247], 90.00th=[ 305], 95.00th=[ 388], | 99.00th=[ 498], 99.50th=[ 609], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 30, max= 190, per=26.67%, avg=73.88, stdev=36.00, samples=166 iops : min= 1, max= 11, avg= 3.84, stdev= 2.33, samples=166 lat (msec) : 10=1.43%, 20=11.59%, 50=22.79%, 100=17.19%, 250=36.98% lat (msec) : 500=9.24%, 750=0.78% cpu : usr=0.03%, sys=1.10%, ctx=1322, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=264KiB/s (270kB/s), 63.2KiB/s-70.7KiB/s (64.7kB/s-72.4kB/s), io=23.4MiB (24.5MB), run=88478-90866msec WRITE: bw=277KiB/s (284kB/s), 68.2KiB/s-72.0KiB/s (69.8kB/s-73.7kB/s), io=24.6MiB (25.8MB), run=88478-90866msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144732: Thu Jul 30 04:50:49 2026 read: IOPS=1, BW=1870KiB/s (1914kB/s)(7168KiB/3834msec) clat (msec): min=123, max=561, avg=300.07, stdev=138.93 lat (msec): min=123, max=561, avg=300.07, stdev=138.93 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 178], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 300], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 330], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1535, max= 4087, per=94.31%, avg=2932.00, stdev=1348.24, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1335KiB/s (1367kB/s)(5120KiB/3834msec); 0 zone resets clat (msec): min=158, max=639, avg=314.89, stdev=190.46 lat (msec): min=158, max=639, avg=314.97, stdev=190.44 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1799, max= 4031, per=56.61%, avg=2464.25, stdev=1049.66, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=10.49%, ctx=351, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144733: Thu Jul 30 04:50:49 2026 read: IOPS=0, BW=311KiB/s (318kB/s)(2048KiB/6586msec) clat (msec): min=58, max=374, avg=216.85, stdev=223.50 lat (msec): min=58, max=374, avg=216.86, stdev=223.51 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 59], 40.00th=[ 59], 50.00th=[ 59], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1961, max= 2043, per=64.39%, avg=2002.00, stdev=57.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1555KiB/s (1592kB/s)(10.0MiB/6586msec); 0 zone resets clat (msec): min=221, max=947, avg=583.65, stdev=251.41 lat (msec): min=221, max=947, avg=583.72, stdev=251.42 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 279], | 30.00th=[ 388], 40.00th=[ 510], 50.00th=[ 527], 60.00th=[ 584], | 70.00th=[ 651], 80.00th=[ 860], 90.00th=[ 877], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1799, max= 2043, per=45.63%, avg=1986.44, stdev=74.07, samples=9 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=9 lat (msec) : 100=8.33%, 250=8.33%, 500=25.00%, 750=33.33%, 1000=25.00% cpu : usr=0.00%, sys=6.30%, ctx=157, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144734: Thu Jul 30 04:50:49 2026 read: IOPS=1, BW=1545KiB/s (1582kB/s)(6144KiB/3977msec) clat (usec): min=500, max=548172, avg=242535.96, stdev=207417.62 lat (usec): min=502, max=548174, avg=242537.28, stdev=207417.64 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 16909], | 30.00th=[ 16909], 40.00th=[248513], 50.00th=[248513], 60.00th=[316670], | 70.00th=[325059], 80.00th=[325059], 90.00th=[549454], 95.00th=[549454], | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 1799, max= 4031, per=79.07%, avg=2458.25, stdev=1052.93, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1545KiB/s (1582kB/s)(6144KiB/3977msec); 0 zone resets clat (msec): min=197, max=851, avg=410.89, stdev=234.83 lat (msec): min=200, max=851, avg=411.46, stdev=234.27 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 376], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1799, max= 3968, per=62.46%, avg=2718.75, stdev=997.18, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=9.86%, ctx=153, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144735: Thu Jul 30 04:50:49 2026 read: IOPS=0, BW=779KiB/s (798kB/s)(5120KiB/6572msec) clat (usec): min=504, max=325189, avg=174407.48, stdev=155325.83 lat (usec): min=505, max=325190, avg=174408.45, stdev=155325.45 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 19530], 40.00th=[ 19530], 50.00th=[221250], 60.00th=[221250], | 70.00th=[308282], 80.00th=[308282], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 1996, max= 4007, per=86.27%, avg=2682.00, stdev=1147.72, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1091KiB/s (1117kB/s)(7168KiB/6572msec); 0 zone resets clat (msec): min=302, max=2066, avg=698.31, stdev=616.66 lat (msec): min=302, max=2066, avg=698.39, stdev=616.66 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 363], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 567], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 625], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 1961, max= 2043, per=45.96%, avg=2000.50, stdev=34.83, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=8.33%, 500=41.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=6.62%, ctx=139, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3110KiB/s (3184kB/s), 311KiB/s-1870KiB/s (318kB/s-1914kB/s), io=20.0MiB (20.0MB), run=3834-6586msec WRITE: bw=4353KiB/s (4458kB/s), 1091KiB/s-1555KiB/s (1117kB/s-1592kB/s), io=28.0MiB (29.4MB), run=3834-6586msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144736: Thu Jul 30 04:50:49 2026 read: IOPS=1, BW=1067KiB/s (1093kB/s)(7168KiB/6717msec) clat (msec): min=152, max=1607, avg=501.25, stdev=512.02 lat (msec): min=152, max=1607, avg=501.25, stdev=512.02 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 199], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 279], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 567], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1436, max= 4087, per=100.00%, avg=2779.00, stdev=1389.75, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=762KiB/s (781kB/s)(5120KiB/6717msec); 0 zone resets clat (msec): min=419, max=885, avg=607.92, stdev=206.17 lat (msec): min=419, max=885, avg=608.21, stdev=206.39 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1729, max= 2035, per=48.50%, avg=1886.25, stdev=140.49, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=2.59%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144737: Thu Jul 30 04:50:49 2026 read: IOPS=0, BW=280KiB/s (287kB/s)(2048KiB/7317msec) clat (msec): min=216, max=332, avg=274.38, stdev=82.07 lat (msec): min=216, max=332, avg=274.38, stdev=82.07 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 2035, max= 2043, per=73.40%, avg=2039.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1399KiB/s (1433kB/s)(10.0MiB/7317msec); 0 zone resets clat (msec): min=223, max=1734, avg=617.72, stdev=439.33 lat (msec): min=223, max=1734, avg=617.87, stdev=439.28 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 288], | 30.00th=[ 313], 40.00th=[ 376], 50.00th=[ 527], 60.00th=[ 558], | 70.00th=[ 617], 80.00th=[ 684], 90.00th=[ 860], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1729, max= 4087, per=56.58%, avg=2200.25, stdev=770.10, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 250=16.67%, 500=33.33%, 750=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.01%, sys=2.97%, ctx=116, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144738: Thu Jul 30 04:50:49 2026 read: IOPS=1, BW=1040KiB/s (1065kB/s)(6144KiB/5910msec) clat (msec): min=94, max=707, avg=220.45, stdev=239.58 lat (msec): min=94, max=707, avg=220.45, stdev=239.58 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 124], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2007, max= 3624, per=92.08%, avg=2558.00, stdev=923.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1040KiB/s (1065kB/s)(6144KiB/5910msec); 0 zone resets clat (msec): min=178, max=2026, avg=674.94, stdev=722.54 lat (msec): min=178, max=2026, avg=675.02, stdev=722.54 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 351], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 1812, max= 4087, per=67.76%, avg=2635.33, stdev=1260.96, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.81%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144739: Thu Jul 30 04:50:49 2026 read: IOPS=0, BW=695KiB/s (711kB/s)(5120KiB/7372msec) clat (msec): min=96, max=629, avg=264.51, stdev=211.03 lat (msec): min=96, max=629, avg=264.51, stdev=211.03 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1812, max= 4063, per=94.91%, avg=2636.67, stdev=1240.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=972KiB/s (996kB/s)(7168KiB/7372msec); 0 zone resets clat (msec): min=277, max=1716, avg=773.81, stdev=542.52 lat (msec): min=277, max=1716, avg=774.73, stdev=542.59 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 334], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 506], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1150], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1932, max= 4087, per=64.96%, avg=2526.25, stdev=1041.81, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, 2000=25.00% cpu : usr=0.00%, sys=1.94%, ctx=152, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2778KiB/s (2845kB/s), 280KiB/s-1067KiB/s (287kB/s-1093kB/s), io=20.0MiB (20.0MB), run=5910-7372msec WRITE: bw=3889KiB/s (3983kB/s), 762KiB/s-1399KiB/s (781kB/s-1433kB/s), io=28.0MiB (29.4MB), run=5910-7372msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144752: Thu Jul 30 04:51:11 2026 read: IOPS=1, BW=4129KiB/s (4228kB/s)(12.0MiB/2976msec) clat (msec): min=866, max=1044, avg=968.14, stdev=91.99 lat (msec): min=866, max=1044, avg=968.14, stdev=91.99 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.29%, ctx=262, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144753: Thu Jul 30 04:51:11 2026 read: IOPS=0, BW=860KiB/s (881kB/s)(4096KiB/4761msec) clat (nsec): min=957623k, max=957623k, avg=957623164.00, stdev= 0.00 lat (nsec): min=957626k, max=957626k, avg=957626068.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1721KiB/s (1762kB/s)(8192KiB/4761msec); 0 zone resets clat (msec): min=822, max=2926, avg=1874.56, stdev=1487.40 lat (msec): min=823, max=2926, avg=1875.27, stdev=1486.94 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 2937], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.51%, ctx=86, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144754: Thu Jul 30 04:51:11 2026 write: IOPS=0, BW=2598KiB/s (2660kB/s)(12.0MiB/4730msec); 0 zone resets clat (msec): min=602, max=2517, avg=1557.32, stdev=957.54 lat (msec): min=602, max=2517, avg=1558.03, stdev=957.55 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 7984, max= 8062, per=100.00%, avg=8023.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.41%, ctx=35, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144755: Thu Jul 30 04:51:11 2026 write: IOPS=0, BW=2951KiB/s (3022kB/s)(12.0MiB/4164msec); 0 zone resets clat (msec): min=444, max=2304, avg=1340.50, stdev=932.34 lat (msec): min=444, max=2305, avg=1341.15, stdev=932.24 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.23%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3441KiB/s (3524kB/s), 860KiB/s-4129KiB/s (881kB/s-4228kB/s), io=16.0MiB (16.8MB), run=2976-4761msec WRITE: bw=6883KiB/s (7048kB/s), 1721KiB/s-2951KiB/s (1762kB/s-3022kB/s), io=32.0MiB (33.6MB), run=4164-4761msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144747: Thu Jul 30 04:51:11 2026 read: IOPS=0, BW=3509KiB/s (3593kB/s)(12.0MiB/3502msec) clat (msec): min=1010, max=1447, avg=1158.08, stdev=250.77 lat (msec): min=1010, max=1447, avg=1158.09, stdev=250.77 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8015, max= 8126, per=100.00%, avg=8070.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.74%, ctx=47, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144748: Thu Jul 30 04:51:11 2026 read: IOPS=0, BW=778KiB/s (797kB/s)(4096KiB/5262msec) clat (nsec): min=341469k, max=341469k, avg=341469112.00, stdev= 0.00 lat (nsec): min=341471k, max=341471k, avg=341471439.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7406, max= 7406, per=100.00%, avg=7406.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1557KiB/s (1594kB/s)(8192KiB/5262msec); 0 zone resets clat (msec): min=1060, max=3826, avg=2443.32, stdev=1955.86 lat (msec): min=1060, max=3826, avg=2443.67, stdev=1955.91 clat percentiles (msec): | 1.00th=[ 1062], 5.00th=[ 1062], 10.00th=[ 1062], 20.00th=[ 1062], | 30.00th=[ 1062], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 3842], | 70.00th=[ 3842], 80.00th=[ 3842], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.39%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144749: Thu Jul 30 04:51:11 2026 write: IOPS=0, BW=2922KiB/s (2992kB/s)(12.0MiB/4206msec); 0 zone resets clat (msec): min=551, max=2010, avg=1373.81, stdev=746.83 lat (msec): min=552, max=2011, avg=1374.29, stdev=746.55 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 7585, max= 7922, per=100.00%, avg=7753.50, stdev=238.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.23%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144750: Thu Jul 30 04:51:11 2026 write: IOPS=1, BW=4979KiB/s (5098kB/s)(12.0MiB/2468msec); 0 zone resets clat (msec): min=483, max=1016, avg=795.41, stdev=277.70 lat (msec): min=484, max=1018, avg=796.02, stdev=277.95 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 6826, max= 8192, per=100.00%, avg=7509.00, stdev=965.91, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.81%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3114KiB/s (3188kB/s), 778KiB/s-3509KiB/s (797kB/s-3593kB/s), io=16.0MiB (16.8MB), run=3502-5262msec WRITE: bw=6227KiB/s (6377kB/s), 1557KiB/s-4979KiB/s (1594kB/s-5098kB/s), io=32.0MiB (33.6MB), run=2468-5262msec