== sanity test 398b: DIO and buffer IO race ============== 00:35:46 (1789187746) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.95518 s, 17.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178602: Sat Sep 12 00:37:09 2026 read: IOPS=20, BW=82.2KiB/s (84.2kB/s)(5992KiB/72888msec) clat (usec): min=32, max=715927, avg=26313.21, stdev=24850.19 lat (usec): min=32, max=715929, avg=26315.94, stdev=24850.26 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 5604], 10.00th=[ 9765], 20.00th=[ 13173], | 30.00th=[ 16188], 40.00th=[ 19268], 50.00th=[ 22414], 60.00th=[ 26084], | 70.00th=[ 30540], 80.00th=[ 36439], 90.00th=[ 46924], 95.00th=[ 55313], | 99.00th=[ 90702], 99.50th=[115868], 99.90th=[139461], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 14, max= 184, per=24.78%, avg=81.51, stdev=28.14, samples=144 iops : min= 3, max= 46, avg=19.87, stdev= 7.10, samples=144 write: IOPS=21, BW=86.4KiB/s (88.5kB/s)(6296KiB/72888msec); 0 zone resets clat (usec): min=685, max=123405, avg=21047.97, stdev=19297.76 lat (usec): min=686, max=123406, avg=21049.45, stdev=19297.73 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1352], 10.00th=[ 1893], 20.00th=[ 3261], | 30.00th=[ 6259], 40.00th=[ 12649], 50.00th=[ 16581], 60.00th=[ 20841], | 70.00th=[ 27395], 80.00th=[ 35390], 90.00th=[ 48497], 95.00th=[ 58459], | 99.00th=[ 81265], 99.50th=[ 94897], 99.90th=[120062], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 24, max= 198, per=25.07%, avg=86.24, stdev=27.52, samples=143 iops : min= 6, max= 49, avg=21.06, stdev= 6.95, samples=143 lat (usec) : 50=0.39%, 100=1.53%, 250=0.42%, 750=0.10%, 1000=0.49% lat (msec) : 2=4.98%, 4=6.74%, 10=8.85%, 20=26.92%, 50=40.79% lat (msec) : 100=8.14%, 250=0.62%, 750=0.03% cpu : usr=0.11%, sys=10.79%, ctx=7179, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178603: Sat Sep 12 00:37:09 2026 read: IOPS=20, BW=81.9KiB/s (83.8kB/s)(5940KiB/72566msec) clat (usec): min=23, max=152643, avg=26444.23, stdev=16831.79 lat (usec): min=23, max=152644, avg=26446.42, stdev=16832.07 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 7439], 10.00th=[ 10683], 20.00th=[ 13829], | 30.00th=[ 16712], 40.00th=[ 19792], 50.00th=[ 22938], 60.00th=[ 26870], | 70.00th=[ 31589], 80.00th=[ 36963], 90.00th=[ 47449], 95.00th=[ 55313], | 99.00th=[ 79168], 99.50th=[104334], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 7, max= 168, per=24.77%, avg=81.50, stdev=25.37, samples=144 iops : min= 1, max= 42, avg=19.87, stdev= 6.39, samples=144 write: IOPS=21, BW=87.5KiB/s (89.6kB/s)(6348KiB/72566msec); 0 zone resets clat (usec): min=703, max=708798, avg=20782.79, stdev=26253.10 lat (usec): min=703, max=708799, avg=20784.44, stdev=26253.01 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1221], 10.00th=[ 1745], 20.00th=[ 2966], | 30.00th=[ 5211], 40.00th=[ 10028], 50.00th=[ 15533], 60.00th=[ 20317], | 70.00th=[ 25822], 80.00th=[ 34866], 90.00th=[ 47449], 95.00th=[ 59507], | 99.00th=[ 84411], 99.50th=[104334], 99.90th=[137364], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 14, max= 176, per=25.30%, avg=87.02, stdev=29.64, samples=144 iops : min= 3, max= 44, avg=21.26, stdev= 7.50, samples=144 lat (usec) : 50=0.20%, 100=1.43%, 250=0.29%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.65% lat (msec) : 2=6.02%, 4=6.58%, 10=9.44%, 20=25.52%, 50=41.37% lat (msec) : 100=7.85%, 250=0.52%, 750=0.03% cpu : usr=0.12%, sys=10.54%, ctx=7033, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178604: Sat Sep 12 00:37:09 2026 read: IOPS=20, BW=83.2KiB/s (85.1kB/s)(6028KiB/72493msec) clat (usec): min=26, max=138893, avg=26190.52, stdev=15741.53 lat (usec): min=26, max=138895, avg=26193.26, stdev=15740.42 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 7701], 10.00th=[ 10290], 20.00th=[ 14222], | 30.00th=[ 16909], 40.00th=[ 19792], 50.00th=[ 22938], 60.00th=[ 27132], | 70.00th=[ 31327], 80.00th=[ 37487], 90.00th=[ 45351], 95.00th=[ 55313], | 99.00th=[ 79168], 99.50th=[ 89654], 99.90th=[101188], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 31, max= 143, per=25.48%, avg=83.83, stdev=22.94, samples=141 iops : min= 7, max= 35, avg=20.45, stdev= 5.78, samples=141 write: IOPS=21, BW=86.4KiB/s (88.4kB/s)(6260KiB/72493msec); 0 zone resets clat (usec): min=650, max=760626, avg=20891.78, stdev=26718.84 lat (usec): min=651, max=760627, avg=20894.28, stdev=26718.95 clat percentiles (usec): | 1.00th=[ 955], 5.00th=[ 1270], 10.00th=[ 1680], 20.00th=[ 2868], | 30.00th=[ 5080], 40.00th=[ 11338], 50.00th=[ 15926], 60.00th=[ 21103], | 70.00th=[ 26608], 80.00th=[ 34866], 90.00th=[ 46924], 95.00th=[ 57410], | 99.00th=[ 78119], 99.50th=[ 85459], 99.90th=[152044], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 24, max= 176, per=25.05%, avg=86.17, stdev=29.15, samples=142 iops : min= 6, max= 44, avg=21.04, stdev= 7.34, samples=142 lat (usec) : 50=0.29%, 100=1.04%, 250=0.33%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.62% lat (msec) : 2=5.66%, 4=7.00%, 10=9.08%, 20=25.36%, 50=42.71% lat (msec) : 100=7.52%, 250=0.20%, 1000=0.03% cpu : usr=0.12%, sys=10.69%, ctx=7114, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178606: Sat Sep 12 00:37:09 2026 read: IOPS=20, BW=83.4KiB/s (85.4kB/s)(6052KiB/72533msec) clat (usec): min=37, max=729451, avg=26666.93, stdev=24388.58 lat (usec): min=38, max=729452, avg=26669.56, stdev=24387.76 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 7832], 10.00th=[ 10421], 20.00th=[ 13698], | 30.00th=[ 16909], 40.00th=[ 19530], 50.00th=[ 22938], 60.00th=[ 26870], | 70.00th=[ 31851], 80.00th=[ 36963], 90.00th=[ 44827], 95.00th=[ 53740], | 99.00th=[ 85459], 99.50th=[108528], 99.90th=[156238], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 13, max= 155, per=25.24%, avg=83.06, stdev=23.54, samples=144 iops : min= 3, max= 38, avg=20.26, stdev= 5.96, samples=144 write: IOPS=21, BW=85.0KiB/s (88.0kB/s)(6236KiB/72533msec); 0 zone resets clat (usec): min=663, max=127917, avg=20423.21, stdev=20067.42 lat (usec): min=665, max=127918, avg=20424.58, stdev=20067.45 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1270], 10.00th=[ 1713], 20.00th=[ 2868], | 30.00th=[ 4752], 40.00th=[ 10028], 50.00th=[ 15664], 60.00th=[ 20055], | 70.00th=[ 26608], 80.00th=[ 35914], 90.00th=[ 46924], 95.00th=[ 58983], | 99.00th=[ 87557], 99.50th=[105382], 99.90th=[123208], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 24, max= 191, per=24.88%, avg=85.58, stdev=29.43, samples=144 iops : min= 6, max= 47, avg=20.89, stdev= 7.37, samples=144 lat (usec) : 50=0.29%, 100=1.20%, 250=0.39%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.65% lat (msec) : 2=6.22%, 4=6.97%, 10=8.82%, 20=25.81%, 50=41.63% lat (msec) : 100=7.23%, 250=0.55%, 750=0.03% cpu : usr=0.10%, sys=10.70%, ctx=6971, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=329KiB/s (337kB/s), 81.9KiB/s-83.4KiB/s (83.8kB/s-85.4kB/s), io=23.4MiB (24.6MB), run=72493-72888msec WRITE: bw=345KiB/s (353kB/s), 85.0KiB/s-87.5KiB/s (88.0kB/s-89.6kB/s), io=24.6MiB (25.7MB), run=72493-72888msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178607: Sat Sep 12 00:37:29 2026 read: IOPS=16, BW=64.3KiB/s (65.8kB/s)(5992KiB/93229msec) clat (msec): min=3, max=726, avg=24.36, stdev=28.64 lat (msec): min=3, max=726, avg=24.37, stdev=28.64 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 36], 90.00th=[ 56], 95.00th=[ 74], | 99.00th=[ 104], 99.50th=[ 118], 99.90th=[ 163], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 15, max= 198, per=24.85%, avg=63.88, stdev=42.60, samples=184 iops : min= 3, max= 49, avg=15.45, stdev=10.70, samples=184 write: IOPS=16, BW=67.5KiB/s (69.2kB/s)(6296KiB/93229msec); 0 zone resets clat (msec): min=6, max=193, avg=35.89, stdev=25.77 lat (msec): min=6, max=193, avg=35.89, stdev=25.77 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 71], 95.00th=[ 88], | 99.00th=[ 123], 99.50th=[ 146], 99.90th=[ 192], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 7, max= 183, per=25.00%, avg=67.24, stdev=42.49, samples=184 iops : min= 1, max= 45, avg=16.29, stdev=10.67, samples=184 lat (msec) : 4=0.13%, 10=14.00%, 20=34.05%, 50=33.27%, 100=16.54% lat (msec) : 250=1.99%, 750=0.03% cpu : usr=0.09%, sys=3.63%, ctx=4942, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178608: Sat Sep 12 00:37:29 2026 read: IOPS=15, BW=63.8KiB/s (65.3kB/s)(5940KiB/93108msec) clat (msec): min=3, max=749, avg=24.13, stdev=28.23 lat (msec): min=3, max=749, avg=24.13, stdev=28.23 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 36], 90.00th=[ 56], 95.00th=[ 71], | 99.00th=[ 99], 99.50th=[ 112], 99.90th=[ 140], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 238, per=24.81%, avg=63.76, stdev=43.46, samples=184 iops : min= 1, max= 59, avg=15.42, stdev=10.93, samples=184 write: IOPS=17, BW=68.2KiB/s (69.8kB/s)(6348KiB/93108msec); 0 zone resets clat (msec): min=6, max=187, avg=35.93, stdev=25.35 lat (msec): min=6, max=187, avg=35.94, stdev=25.35 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 71], 95.00th=[ 87], | 99.00th=[ 131], 99.50th=[ 153], 99.90th=[ 171], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 16, max= 175, per=25.34%, avg=68.16, stdev=41.29, samples=184 iops : min= 4, max= 43, avg=16.52, stdev=10.37, samples=184 lat (msec) : 4=0.07%, 10=13.09%, 20=34.05%, 50=35.09%, 100=16.05% lat (msec) : 250=1.63%, 750=0.03% cpu : usr=0.08%, sys=3.72%, ctx=4867, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178609: Sat Sep 12 00:37:29 2026 read: IOPS=16, BW=64.9KiB/s (66.5kB/s)(6028KiB/92844msec) clat (msec): min=3, max=175, avg=23.90, stdev=21.12 lat (msec): min=3, max=175, avg=23.90, stdev=21.12 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 54], 95.00th=[ 68], | 99.00th=[ 99], 99.50th=[ 117], 99.90th=[ 169], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 15, max= 215, per=25.20%, avg=64.77, stdev=40.13, samples=183 iops : min= 3, max= 53, avg=15.67, stdev=10.07, samples=183 write: IOPS=16, BW=67.4KiB/s (69.0kB/s)(6260KiB/92844msec); 0 zone resets clat (msec): min=6, max=754, avg=36.15, stdev=30.54 lat (msec): min=6, max=754, avg=36.16, stdev=30.54 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 70], 95.00th=[ 84], | 99.00th=[ 121], 99.50th=[ 142], 99.90th=[ 186], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 183, per=24.98%, avg=67.20, stdev=41.68, samples=183 iops : min= 1, max= 45, avg=16.28, stdev=10.47, samples=183 lat (msec) : 4=0.03%, 10=12.37%, 20=34.15%, 50=35.87%, 100=15.76% lat (msec) : 250=1.79%, 1000=0.03% cpu : usr=0.10%, sys=3.81%, ctx=4922, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178610: Sat Sep 12 00:37:29 2026 read: IOPS=16, BW=65.1KiB/s (66.7kB/s)(6052KiB/92944msec) clat (msec): min=3, max=170, avg=23.92, stdev=21.63 lat (msec): min=3, max=170, avg=23.92, stdev=21.63 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 35], 90.00th=[ 54], 95.00th=[ 70], | 99.00th=[ 105], 99.50th=[ 117], 99.90th=[ 159], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 7, max= 222, per=25.70%, avg=66.04, stdev=41.91, samples=180 iops : min= 1, max= 55, avg=15.99, stdev=10.53, samples=180 write: IOPS=16, BW=67.1KiB/s (68.7kB/s)(6236KiB/92944msec); 0 zone resets clat (msec): min=7, max=750, avg=36.24, stdev=30.45 lat (msec): min=7, max=750, avg=36.25, stdev=30.45 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 54], 90.00th=[ 68], 95.00th=[ 85], | 99.00th=[ 123], 99.50th=[ 138], 99.90th=[ 184], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 183, per=24.87%, avg=66.90, stdev=40.84, samples=183 iops : min= 1, max= 45, avg=16.20, stdev=10.23, samples=183 lat (msec) : 4=0.03%, 10=13.05%, 20=33.59%, 50=35.58%, 100=15.85% lat (msec) : 250=1.86%, 1000=0.03% cpu : usr=0.10%, sys=3.65%, ctx=4875, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=258KiB/s (264kB/s), 63.8KiB/s-65.1KiB/s (65.3kB/s-66.7kB/s), io=23.4MiB (24.6MB), run=92844-93229msec WRITE: bw=270KiB/s (276kB/s), 67.1KiB/s-68.2KiB/s (68.7kB/s-69.8kB/s), io=24.6MiB (25.7MB), run=92844-93229msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178641: Sat Sep 12 00:37:53 2026 read: IOPS=18, BW=303KiB/s (310kB/s)(5920KiB/19547msec) clat (usec): min=31, max=164410, avg=27671.23, stdev=18588.22 lat (usec): min=31, max=164411, avg=27672.30, stdev=18588.24 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 98], 10.00th=[ 11076], 20.00th=[ 15139], | 30.00th=[ 17695], 40.00th=[ 21103], 50.00th=[ 24511], 60.00th=[ 28181], | 70.00th=[ 32375], 80.00th=[ 38011], 90.00th=[ 45876], 95.00th=[ 61080], | 99.00th=[ 83362], 99.50th=[147850], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 158, max= 541, per=24.43%, avg=299.24, stdev=87.89, samples=38 iops : min= 9, max= 33, avg=18.13, stdev= 5.45, samples=38 write: IOPS=20, BW=326KiB/s (334kB/s)(6368KiB/19547msec); 0 zone resets clat (usec): min=985, max=161071, avg=22771.41, stdev=21820.96 lat (usec): min=987, max=161074, avg=22773.77, stdev=21820.96 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1926], 10.00th=[ 2507], 20.00th=[ 4047], | 30.00th=[ 7373], 40.00th=[ 13042], 50.00th=[ 17695], 60.00th=[ 22676], | 70.00th=[ 27919], 80.00th=[ 35914], 90.00th=[ 50594], 95.00th=[ 61604], | 99.00th=[104334], 99.50th=[137364], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 159, max= 541, per=25.17%, avg=324.45, stdev=102.31, samples=38 iops : min= 9, max= 33, avg=19.74, stdev= 6.37, samples=38 lat (usec) : 50=0.52%, 100=2.08%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.60%, 4=7.68%, 10=7.94%, 20=23.70%, 50=45.44% lat (msec) : 100=8.46%, 250=0.91% cpu : usr=0.08%, sys=10.97%, ctx=1905, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178642: Sat Sep 12 00:37:53 2026 read: IOPS=19, BW=312KiB/s (320kB/s)(5744KiB/18397msec) clat (usec): min=52, max=127614, avg=27345.40, stdev=17811.21 lat (usec): min=52, max=127616, avg=27346.40, stdev=17811.25 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 82], 10.00th=[ 8979], 20.00th=[ 15795], | 30.00th=[ 19006], 40.00th=[ 21890], 50.00th=[ 25297], 60.00th=[ 28443], | 70.00th=[ 32900], 80.00th=[ 38011], 90.00th=[ 45876], 95.00th=[ 56886], | 99.00th=[116917], 99.50th=[125305], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 79, max= 448, per=25.61%, avg=313.75, stdev=83.81, samples=36 iops : min= 4, max= 28, avg=19.06, stdev= 5.36, samples=36 write: IOPS=22, BW=356KiB/s (364kB/s)(6544KiB/18397msec); 0 zone resets clat (usec): min=990, max=109096, avg=20730.95, stdev=20905.45 lat (usec): min=991, max=109098, avg=20735.31, stdev=20903.14 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1876], 10.00th=[ 2474], 20.00th=[ 4015], | 30.00th=[ 6849], 40.00th=[ 9634], 50.00th=[ 13829], 60.00th=[ 19006], | 70.00th=[ 24249], 80.00th=[ 33162], 90.00th=[ 50594], 95.00th=[ 62653], | 99.00th=[102237], 99.50th=[104334], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 157, max= 544, per=27.82%, avg=358.61, stdev=109.90, samples=36 iops : min= 9, max= 34, avg=21.89, stdev= 6.92, samples=36 lat (usec) : 100=2.60%, 250=1.04%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.99%, 4=7.42%, 10=12.76%, 20=21.22%, 50=42.71% lat (msec) : 100=7.68%, 250=1.30% cpu : usr=0.10%, sys=11.44%, ctx=1831, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178643: Sat Sep 12 00:37:53 2026 read: IOPS=20, BW=332KiB/s (340kB/s)(6256KiB/18843msec) clat (usec): min=43, max=182779, avg=26608.19, stdev=20135.17 lat (usec): min=43, max=182780, avg=26609.21, stdev=20135.15 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 2540], 20.00th=[ 14222], | 30.00th=[ 17433], 40.00th=[ 20055], 50.00th=[ 23200], 60.00th=[ 26870], | 70.00th=[ 31065], 80.00th=[ 36963], 90.00th=[ 45351], 95.00th=[ 61080], | 99.00th=[111674], 99.50th=[120062], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 160, max= 576, per=27.25%, avg=333.81, stdev=96.60, samples=37 iops : min= 10, max= 36, avg=20.30, stdev= 6.07, samples=37 write: IOPS=20, BW=320KiB/s (328kB/s)(6032KiB/18843msec); 0 zone resets clat (usec): min=1088, max=151426, avg=22260.97, stdev=22126.28 lat (usec): min=1088, max=151428, avg=22263.94, stdev=22126.05 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1811], 10.00th=[ 2769], 20.00th=[ 4752], | 30.00th=[ 6915], 40.00th=[ 11338], 50.00th=[ 15926], 60.00th=[ 20579], | 70.00th=[ 27395], 80.00th=[ 35914], 90.00th=[ 51643], 95.00th=[ 67634], | 99.00th=[102237], 99.50th=[110625], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 126, max= 698, per=24.60%, avg=317.14, stdev=124.87, samples=37 iops : min= 7, max= 43, avg=19.27, stdev= 7.77, samples=37 lat (usec) : 50=0.78%, 100=3.39%, 250=0.65%, 1000=0.13% lat (msec) : 2=2.99%, 4=5.86%, 10=10.81%, 20=24.48%, 50=41.80% lat (msec) : 100=7.81%, 250=1.30% cpu : usr=0.07%, sys=10.96%, ctx=1778, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178644: Sat Sep 12 00:37:53 2026 read: IOPS=19, BW=311KiB/s (318kB/s)(6032KiB/19404msec) clat (usec): min=38, max=129325, avg=26904.80, stdev=19180.29 lat (usec): min=39, max=129326, avg=26925.87, stdev=19177.48 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 69], 10.00th=[ 192], 20.00th=[ 13829], | 30.00th=[ 17171], 40.00th=[ 20317], 50.00th=[ 23462], 60.00th=[ 27132], | 70.00th=[ 31327], 80.00th=[ 39584], 90.00th=[ 50594], 95.00th=[ 60556], | 99.00th=[ 88605], 99.50th=[128451], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 106, max= 510, per=25.22%, avg=308.89, stdev=110.86, samples=38 iops : min= 6, max= 31, avg=18.74, stdev= 6.88, samples=38 write: IOPS=20, BW=322KiB/s (330kB/s)(6256KiB/19404msec); 0 zone resets clat (usec): min=1027, max=127837, avg=23104.85, stdev=22231.42 lat (usec): min=1029, max=127839, avg=23108.22, stdev=22230.70 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1795], 10.00th=[ 2409], 20.00th=[ 4113], | 30.00th=[ 6915], 40.00th=[ 11994], 50.00th=[ 15926], 60.00th=[ 21890], | 70.00th=[ 28443], 80.00th=[ 39060], 90.00th=[ 55837], 95.00th=[ 67634], | 99.00th=[103285], 99.50th=[116917], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 126, max= 512, per=24.78%, avg=319.47, stdev=91.64, samples=38 iops : min= 7, max= 32, avg=19.42, stdev= 5.71, samples=38 lat (usec) : 50=0.78%, 100=2.60%, 250=1.69%, 500=0.13% lat (msec) : 2=3.78%, 4=6.12%, 10=8.59%, 20=25.00%, 50=39.71% lat (msec) : 100=10.81%, 250=0.78% cpu : usr=0.08%, sys=10.66%, ctx=1848, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1225KiB/s (1255kB/s), 303KiB/s-332KiB/s (310kB/s-340kB/s), io=23.4MiB (24.5MB), run=18397-19547msec WRITE: bw=1289KiB/s (1320kB/s), 320KiB/s-356KiB/s (328kB/s-364kB/s), io=24.6MiB (25.8MB), run=18397-19547msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178636: Sat Sep 12 00:37:59 2026 read: IOPS=14, BW=228KiB/s (233kB/s)(5920KiB/25966msec) clat (msec): min=5, max=130, avg=28.01, stdev=22.74 lat (msec): min=5, max=130, avg=28.01, stdev=22.74 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 23], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 63], 95.00th=[ 80], | 99.00th=[ 103], 99.50th=[ 120], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 63, max= 798, per=24.60%, avg=225.37, stdev=140.72, samples=51 iops : min= 3, max= 49, avg=13.43, stdev= 8.87, samples=51 write: IOPS=15, BW=245KiB/s (251kB/s)(6368KiB/25966msec); 0 zone resets clat (msec): min=9, max=192, avg=38.80, stdev=26.29 lat (msec): min=9, max=192, avg=38.80, stdev=26.29 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 77], 95.00th=[ 90], | 99.00th=[ 129], 99.50th=[ 169], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 63, max= 603, per=25.37%, avg=244.29, stdev=137.65, samples=51 iops : min= 3, max= 37, avg=14.61, stdev= 8.71, samples=51 lat (msec) : 10=6.64%, 20=30.34%, 50=41.54%, 100=19.66%, 250=1.82% cpu : usr=0.09%, sys=3.66%, ctx=1269, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178638: Sat Sep 12 00:37:59 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(5744KiB/25913msec) clat (msec): min=4, max=201, avg=28.75, stdev=26.12 lat (msec): min=4, max=201, avg=28.75, stdev=26.12 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 65], 95.00th=[ 80], | 99.00th=[ 136], 99.50th=[ 178], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 63, max= 574, per=24.07%, avg=220.45, stdev=128.37, samples=51 iops : min= 3, max= 35, avg=13.12, stdev= 8.08, samples=51 write: IOPS=15, BW=253KiB/s (259kB/s)(6544KiB/25913msec); 0 zone resets clat (msec): min=7, max=172, avg=38.02, stdev=25.13 lat (msec): min=7, max=172, avg=38.03, stdev=25.13 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 75], 95.00th=[ 94], | 99.00th=[ 123], 99.50th=[ 131], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 31, max= 670, per=26.07%, avg=251.06, stdev=139.01, samples=51 iops : min= 1, max= 41, avg=15.04, stdev= 8.75, samples=51 lat (msec) : 10=7.03%, 20=28.52%, 50=45.44%, 100=16.54%, 250=2.47% cpu : usr=0.07%, sys=3.69%, ctx=1212, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178639: Sat Sep 12 00:37:59 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(6256KiB/25811msec) clat (msec): min=4, max=158, avg=28.20, stdev=24.21 lat (msec): min=4, max=158, avg=28.21, stdev=24.21 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 57], 95.00th=[ 80], | 99.00th=[ 129], 99.50th=[ 153], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 63, max= 544, per=26.61%, avg=243.71, stdev=142.29, samples=51 iops : min= 3, max= 34, avg=14.57, stdev= 8.97, samples=51 write: IOPS=14, BW=234KiB/s (239kB/s)(6032KiB/25811msec); 0 zone resets clat (msec): min=9, max=136, avg=38.96, stdev=24.44 lat (msec): min=9, max=136, avg=38.97, stdev=24.44 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 78], 95.00th=[ 88], | 99.00th=[ 117], 99.50th=[ 136], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 702, per=24.12%, avg=232.25, stdev=124.61, samples=51 iops : min= 3, max= 43, avg=13.86, stdev= 7.82, samples=51 lat (msec) : 10=7.29%, 20=27.47%, 50=46.22%, 100=16.15%, 250=2.86% cpu : usr=0.06%, sys=3.79%, ctx=1315, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178640: Sat Sep 12 00:37:59 2026 read: IOPS=14, BW=231KiB/s (236kB/s)(6032KiB/26147msec) clat (msec): min=5, max=135, avg=28.50, stdev=21.80 lat (msec): min=5, max=135, avg=28.50, stdev=21.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 44], 90.00th=[ 62], 95.00th=[ 77], | 99.00th=[ 101], 99.50th=[ 102], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 62, max= 608, per=24.42%, avg=223.65, stdev=126.96, samples=51 iops : min= 3, max= 38, avg=13.31, stdev= 8.05, samples=51 write: IOPS=14, BW=239KiB/s (245kB/s)(6256KiB/26147msec); 0 zone resets clat (msec): min=8, max=189, avg=39.09, stdev=26.90 lat (msec): min=8, max=189, avg=39.09, stdev=26.90 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 79], 95.00th=[ 91], | 99.00th=[ 122], 99.50th=[ 161], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 64, max= 734, per=24.29%, avg=233.94, stdev=131.24, samples=51 iops : min= 4, max= 45, avg=13.96, stdev= 8.20, samples=51 lat (msec) : 10=7.03%, 20=28.39%, 50=44.01%, 100=18.36%, 250=2.21% cpu : usr=0.08%, sys=3.65%, ctx=1247, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=916KiB/s (938kB/s), 222KiB/s-242KiB/s (227kB/s-248kB/s), io=23.4MiB (24.5MB), run=25811-26147msec WRITE: bw=964KiB/s (987kB/s), 234KiB/s-253KiB/s (239kB/s-259kB/s), io=24.6MiB (25.8MB), run=25811-26147msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178657: Sat Sep 12 00:38:08 2026 read: IOPS=3, BW=3503KiB/s (3588kB/s)(7168KiB/2046msec) clat (usec): min=550, max=223639, avg=120983.60, stdev=90062.65 lat (usec): min=551, max=223640, avg=120984.88, stdev=90062.65 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 668], | 30.00th=[119014], 40.00th=[119014], 50.00th=[141558], 60.00th=[152044], | 70.00th=[152044], 80.00th=[208667], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 2048, max= 4000, per=50.23%, avg=3230.67, stdev=1039.57, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=2, BW=2502KiB/s (2563kB/s)(5120KiB/2046msec); 0 zone resets clat (msec): min=62, max=444, avg=211.65, stdev=158.87 lat (msec): min=62, max=444, avg=211.71, stdev=158.87 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2048, max= 6000, per=44.69%, avg=4024.00, stdev=2794.49, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (usec) : 750=16.67% lat (msec) : 100=16.67%, 250=50.00%, 500=16.67% cpu : usr=0.00%, sys=34.38%, ctx=378, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178658: Sat Sep 12 00:38:08 2026 read: IOPS=0, BW=643KiB/s (659kB/s)(2048KiB/3184msec) clat (usec): min=631, max=165122, avg=82876.97, stdev=116313.20 lat (usec): min=632, max=165125, avg=82878.74, stdev=116314.15 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[ 635], 50.00th=[ 635], 60.00th=[164627], | 70.00th=[164627], 80.00th=[164627], 90.00th=[164627], 95.00th=[164627], | 99.00th=[164627], 99.50th=[164627], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 1738, max= 2048, per=29.43%, avg=1893.00, stdev=219.20, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3216KiB/s (3293kB/s)(10.0MiB/3184msec); 0 zone resets clat (msec): min=158, max=874, avg=296.64, stdev=214.01 lat (msec): min=158, max=874, avg=296.71, stdev=214.02 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 182], | 30.00th=[ 199], 40.00th=[ 207], 50.00th=[ 224], 60.00th=[ 226], | 70.00th=[ 245], 80.00th=[ 249], 90.00th=[ 409], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2043, max= 6144, per=51.13%, avg=4604.50, stdev=1963.77, samples=4 iops : min= 1, max= 6, avg= 4.00, stdev= 2.45, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=75.00%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=30.91%, ctx=137, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178659: Sat Sep 12 00:38:08 2026 read: IOPS=2, BW=2341KiB/s (2398kB/s)(6144KiB/2624msec) clat (msec): min=23, max=227, avg=151.42, stdev=78.86 lat (msec): min=23, max=227, avg=151.42, stdev=78.86 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 192], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 2000, max= 4096, per=39.59%, avg=2546.75, stdev=1033.06, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=2, BW=2341KiB/s (2398kB/s)(6144KiB/2624msec); 0 zone resets clat (msec): min=84, max=513, avg=264.47, stdev=175.61 lat (msec): min=85, max=514, avg=264.53, stdev=175.61 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 321], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2000, max= 3537, per=25.93%, avg=2335.20, stdev=672.13, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.08%, sys=33.02%, ctx=296, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178660: Sat Sep 12 00:38:08 2026 read: IOPS=1, BW=1996KiB/s (2044kB/s)(5120KiB/2565msec) clat (usec): min=483, max=424137, avg=160491.80, stdev=174852.24 lat (usec): min=484, max=424138, avg=160492.78, stdev=174852.34 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 482], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[187696], 60.00th=[187696], | 70.00th=[187696], 80.00th=[187696], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 2000, max= 6131, per=63.21%, avg=4065.50, stdev=2921.06, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2795KiB/s (2862kB/s)(7168KiB/2565msec); 0 zone resets clat (msec): min=132, max=399, avg=239.74, stdev=97.76 lat (msec): min=132, max=399, avg=239.84, stdev=97.77 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 161], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 236], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 330], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1783, max= 6144, per=44.01%, avg=3963.50, stdev=3083.69, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=38.73%, ctx=140, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6432KiB/s (6587kB/s), 643KiB/s-3503KiB/s (659kB/s-3588kB/s), io=20.0MiB (20.0MB), run=2046-3184msec WRITE: bw=9005KiB/s (9221kB/s), 2341KiB/s-3216KiB/s (2398kB/s-3293kB/s), io=28.0MiB (29.4MB), run=2046-3184msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178652: Sat Sep 12 00:38:08 2026 read: IOPS=2, BW=2590KiB/s (2652kB/s)(7168KiB/2768msec) clat (msec): min=71, max=361, avg=220.59, stdev=117.87 lat (msec): min=71, max=361, avg=220.59, stdev=117.87 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 90], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 239], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 342], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1980, max= 5278, per=47.50%, avg=2822.25, stdev=1637.36, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1850KiB/s (1894kB/s)(5120KiB/2768msec); 0 zone resets clat (msec): min=107, max=392, avg=230.22, stdev=115.05 lat (msec): min=107, max=392, avg=230.30, stdev=115.05 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1992, max= 4087, per=32.54%, avg=2706.00, stdev=1196.21, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=14.89%, ctx=162, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178653: Sat Sep 12 00:38:08 2026 read: IOPS=0, BW=654KiB/s (670kB/s)(2048KiB/3130msec) clat (msec): min=55, max=119, avg=87.70, stdev=45.56 lat (msec): min=55, max=119, avg=87.70, stdev=45.56 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 56], 60.00th=[ 121], | 70.00th=[ 121], 80.00th=[ 121], 90.00th=[ 121], 95.00th=[ 121], | 99.00th=[ 121], 99.50th=[ 121], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 1753, max= 2043, per=31.95%, avg=1898.00, stdev=205.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3272KiB/s (3350kB/s)(10.0MiB/3130msec); 0 zone resets clat (msec): min=96, max=674, avg=292.16, stdev=182.29 lat (msec): min=96, max=674, avg=292.23, stdev=182.29 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 121], | 30.00th=[ 146], 40.00th=[ 192], 50.00th=[ 213], 60.00th=[ 241], | 70.00th=[ 401], 80.00th=[ 405], 90.00th=[ 435], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1753, max= 4039, per=35.71%, avg=2969.83, stdev=1127.85, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=16.33%, ctx=220, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178654: Sat Sep 12 00:38:08 2026 read: IOPS=1, BW=1782KiB/s (1825kB/s)(6144KiB/3447msec) clat (msec): min=65, max=579, avg=292.64, stdev=189.35 lat (msec): min=65, max=579, avg=292.64, stdev=189.35 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 334], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 4039, max= 4087, per=68.39%, avg=4063.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1782KiB/s (1825kB/s)(6144KiB/3447msec); 0 zone resets clat (msec): min=76, max=967, avg=278.81, stdev=343.70 lat (msec): min=76, max=967, avg=278.91, stdev=343.74 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 80], | 30.00th=[ 80], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 215], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1980, max= 3385, per=29.67%, avg=2468.00, stdev=794.69, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=9.08%, ctx=164, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178655: Sat Sep 12 00:38:08 2026 read: IOPS=1, BW=1916KiB/s (1962kB/s)(5120KiB/2672msec) clat (msec): min=38, max=585, avg=296.92, stdev=232.89 lat (msec): min=38, max=585, avg=296.92, stdev=232.89 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 39], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2043, max= 5976, per=67.49%, avg=4009.50, stdev=2781.05, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2683KiB/s (2747kB/s)(7168KiB/2672msec); 0 zone resets clat (msec): min=85, max=238, avg=163.46, stdev=57.74 lat (msec): min=85, max=238, avg=163.66, stdev=57.57 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 92], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 197], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 2039, max= 7111, per=53.05%, avg=4412.33, stdev=2551.60, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.07%, sys=9.66%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5941KiB/s (6084kB/s), 654KiB/s-2590KiB/s (670kB/s-2652kB/s), io=20.0MiB (20.0MB), run=2672-3447msec WRITE: bw=8318KiB/s (8518kB/s), 1782KiB/s-3272KiB/s (1825kB/s-3350kB/s), io=28.0MiB (29.4MB), run=2672-3447msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178669: Sat Sep 12 00:38:16 2026 read: IOPS=1, BW=7376KiB/s (7553kB/s)(12.0MiB/1666msec) clat (msec): min=491, max=627, avg=540.82, stdev=75.45 lat (msec): min=491, max=627, avg=540.83, stdev=75.45 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 8143, max= 8192, per=86.20%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=23.96%, ctx=887, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178671: Sat Sep 12 00:38:16 2026 read: IOPS=0, BW=2369KiB/s (2426kB/s)(4096KiB/1729msec) clat (nsec): min=478138k, max=478138k, avg=478137915.00, stdev= 0.00 lat (nsec): min=478140k, max=478140k, avg=478140068.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 8143, max= 8143, per=85.94%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4738KiB/s (4852kB/s)(8192KiB/1729msec); 0 zone resets clat (msec): min=429, max=711, avg=570.55, stdev=198.93 lat (msec): min=430, max=711, avg=571.10, stdev=198.61 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8143, max= 8143, per=55.64%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=9.32%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178673: Sat Sep 12 00:38:16 2026 write: IOPS=1, BW=5488KiB/s (5620kB/s)(12.0MiB/2239msec); 0 zone resets clat (msec): min=316, max=1106, avg=698.40, stdev=396.07 lat (msec): min=316, max=1107, avg=698.74, stdev=396.09 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8094, max= 8192, per=55.64%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.51%, ctx=33, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178674: Sat Sep 12 00:38:16 2026 write: IOPS=1, BW=5563KiB/s (5696kB/s)(12.0MiB/2209msec); 0 zone resets clat (msec): min=355, max=1179, avg=687.41, stdev=434.61 lat (msec): min=355, max=1179, avg=687.67, stdev=434.60 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7223, max= 8143, per=52.50%, avg=7683.00, stdev=650.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.70%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9476KiB/s (9703kB/s), 2369KiB/s-7376KiB/s (2426kB/s-7553kB/s), io=16.0MiB (16.8MB), run=1666-1729msec WRITE: bw=14.3MiB/s (14.0MB/s), 4738KiB/s-5563KiB/s (4852kB/s-5696kB/s), io=32.0MiB (33.6MB), run=1729-2239msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178667: Sat Sep 12 00:38:16 2026 read: IOPS=1, BW=6950KiB/s (7117kB/s)(12.0MiB/1768msec) clat (msec): min=370, max=779, avg=576.58, stdev=204.64 lat (msec): min=370, max=779, avg=576.58, stdev=204.64 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8062, max= 8175, per=87.62%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.85%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178668: Sat Sep 12 00:38:16 2026 read: IOPS=0, BW=2491KiB/s (2551kB/s)(4096KiB/1644msec) clat (nsec): min=186415k, max=186415k, avg=186415358.00, stdev= 0.00 lat (nsec): min=186418k, max=186418k, avg=186417738.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 5801, max= 5801, per=62.61%, avg=5801.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4983KiB/s (5103kB/s)(8192KiB/1644msec); 0 zone resets clat (msec): min=641, max=744, avg=693.31, stdev=72.82 lat (msec): min=644, max=745, avg=694.68, stdev=71.35 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8062, max= 8062, per=58.09%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=9.13%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178670: Sat Sep 12 00:38:16 2026 write: IOPS=1, BW=5205KiB/s (5329kB/s)(12.0MiB/2361msec); 0 zone resets clat (msec): min=104, max=1989, avg=774.96, stdev=1053.86 lat (msec): min=106, max=1990, avg=775.89, stdev=1053.36 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8094, max= 8094, per=58.32%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.04%, sys=6.53%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178672: Sat Sep 12 00:38:16 2026 write: IOPS=1, BW=7362KiB/s (7539kB/s)(12.0MiB/1669msec); 0 zone resets clat (msec): min=208, max=962, avg=511.92, stdev=398.25 lat (msec): min=208, max=963, avg=512.40, stdev=398.32 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7892, max= 8047, per=57.43%, avg=7969.50, stdev=109.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=10.61%, ctx=81, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9267KiB/s (9489kB/s), 2491KiB/s-6950KiB/s (2551kB/s-7117kB/s), io=16.0MiB (16.8MB), run=1644-1768msec WRITE: bw=13.6MiB/s (14.2MB/s), 4983KiB/s-7362KiB/s (5103kB/s-7539kB/s), io=32.0MiB (33.6MB), run=1644-2361msec