== sanity test 398b: DIO and buffer IO race ============== 17:51:53 (1777585913) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.58529 s, 11.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179105: Thu Apr 30 17:53:48 2026 read: IOPS=15, BW=60.8KiB/s (62.2kB/s)(5992KiB/98584msec) clat (usec): min=39, max=766229, avg=36539.89, stdev=29968.69 lat (usec): min=40, max=766231, avg=36542.42, stdev=29968.51 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 10028], 10.00th=[ 14353], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 26608], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 51119], 90.00th=[ 62653], 95.00th=[ 76022], | 99.00th=[115868], 99.50th=[145753], 99.90th=[270533], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 126, per=25.29%, avg=60.45, stdev=21.13, samples=194 iops : min= 1, max= 31, avg=14.49, stdev= 5.31, samples=194 write: IOPS=15, BW=63.9KiB/s (65.4kB/s)(6296KiB/98584msec); 0 zone resets clat (usec): min=1149, max=244140, avg=27599.68, stdev=27881.68 lat (usec): min=1150, max=244142, avg=27602.65, stdev=27881.77 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1598], 10.00th=[ 2245], 20.00th=[ 3982], | 30.00th=[ 6587], 40.00th=[ 14222], 50.00th=[ 20579], 60.00th=[ 26870], | 70.00th=[ 34866], 80.00th=[ 46400], 90.00th=[ 64226], 95.00th=[ 80217], | 99.00th=[123208], 99.50th=[158335], 99.90th=[191890], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 134, per=25.48%, avg=63.96, stdev=25.90, samples=193 iops : min= 1, max= 33, avg=15.37, stdev= 6.49, samples=193 lat (usec) : 50=0.23%, 100=1.33%, 250=0.42%, 500=0.03%, 750=0.03% lat (msec) : 2=4.43%, 4=5.92%, 10=8.04%, 20=15.85%, 50=44.37% lat (msec) : 100=17.38%, 250=1.89%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=7.25%, ctx=7109, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179106: Thu Apr 30 17:53:48 2026 read: IOPS=15, BW=60.3KiB/s (61.7kB/s)(5940KiB/98557msec) clat (usec): min=48, max=662516, avg=37012.46, stdev=28091.10 lat (usec): min=48, max=662517, avg=37014.41, stdev=28091.44 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11207], 10.00th=[ 15533], 20.00th=[ 19792], | 30.00th=[ 23462], 40.00th=[ 27919], 50.00th=[ 32375], 60.00th=[ 36963], | 70.00th=[ 43779], 80.00th=[ 50594], 90.00th=[ 62129], 95.00th=[ 77071], | 99.00th=[127402], 99.50th=[143655], 99.90th=[250610], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 7, max= 119, per=25.08%, avg=59.94, stdev=21.35, samples=194 iops : min= 1, max= 29, avg=14.36, stdev= 5.35, samples=194 write: IOPS=16, BW=64.4KiB/s (65.0kB/s)(6348KiB/98557msec); 0 zone resets clat (usec): min=1060, max=189995, avg=27216.06, stdev=27112.00 lat (usec): min=1061, max=189999, avg=27220.05, stdev=27110.76 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1631], 10.00th=[ 2343], 20.00th=[ 4113], | 30.00th=[ 6652], 40.00th=[ 13435], 50.00th=[ 20317], 60.00th=[ 26346], | 70.00th=[ 33424], 80.00th=[ 45876], 90.00th=[ 65799], 95.00th=[ 80217], | 99.00th=[115868], 99.50th=[127402], 99.90th=[183501], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 7, max= 135, per=25.48%, avg=63.96, stdev=26.46, samples=194 iops : min= 1, max= 33, avg=15.37, stdev= 6.64, samples=194 lat (usec) : 50=0.10%, 100=1.33%, 250=0.26%, 500=0.07%, 1000=0.03% lat (msec) : 2=3.97%, 4=6.18%, 10=8.82%, 20=14.84%, 50=45.48% lat (msec) : 100=16.70%, 250=2.15%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=7.29%, ctx=7236, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179107: Thu Apr 30 17:53:48 2026 read: IOPS=15, BW=60.2KiB/s (61.7kB/s)(6028KiB/100079msec) clat (usec): min=34, max=256415, avg=35938.85, stdev=23602.34 lat (usec): min=35, max=256415, avg=35943.09, stdev=23603.51 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10290], 10.00th=[ 14353], 20.00th=[ 18482], | 30.00th=[ 22676], 40.00th=[ 26346], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 42206], 80.00th=[ 51119], 90.00th=[ 63177], 95.00th=[ 77071], | 99.00th=[114820], 99.50th=[130548], 99.90th=[229639], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 7, max= 143, per=24.95%, avg=59.64, stdev=22.83, samples=198 iops : min= 1, max= 35, avg=14.28, stdev= 5.70, samples=198 write: IOPS=15, BW=62.5KiB/s (64.1kB/s)(6260KiB/100079msec); 0 zone resets clat (usec): min=1082, max=748914, avg=29089.75, stdev=33212.77 lat (usec): min=1084, max=748916, avg=29094.39, stdev=33214.23 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1729], 10.00th=[ 2343], 20.00th=[ 4178], | 30.00th=[ 7308], 40.00th=[ 15795], 50.00th=[ 22414], 60.00th=[ 28705], | 70.00th=[ 36963], 80.00th=[ 48497], 90.00th=[ 66847], 95.00th=[ 82314], | 99.00th=[120062], 99.50th=[141558], 99.90th=[254804], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 15, max= 159, per=24.65%, avg=61.88, stdev=24.32, samples=198 iops : min= 3, max= 39, avg=14.84, stdev= 6.11, samples=198 lat (usec) : 50=0.23%, 100=1.30%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.78%, 4=5.63%, 10=8.27%, 20=16.18%, 50=44.40% lat (msec) : 100=17.77%, 250=2.02%, 500=0.07%, 750=0.03% cpu : usr=0.10%, sys=7.37%, ctx=7234, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179108: Thu Apr 30 17:53:48 2026 read: IOPS=15, BW=61.0KiB/s (62.5kB/s)(6052KiB/99176msec) clat (usec): min=39, max=178395, avg=36353.46, stdev=22590.56 lat (usec): min=40, max=179014, avg=36359.70, stdev=22594.45 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10421], 10.00th=[ 14484], 20.00th=[ 19268], | 30.00th=[ 23200], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 36439], | 70.00th=[ 43779], 80.00th=[ 51119], 90.00th=[ 64750], 95.00th=[ 80217], | 99.00th=[110625], 99.50th=[127402], 99.90th=[177210], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 7, max= 127, per=25.51%, avg=60.96, stdev=21.60, samples=194 iops : min= 1, max= 31, avg=14.61, stdev= 5.43, samples=194 write: IOPS=15, BW=62.9KiB/s (64.4kB/s)(6236KiB/99176msec); 0 zone resets clat (usec): min=854, max=689729, avg=28079.75, stdev=32403.92 lat (usec): min=855, max=689732, avg=28085.23, stdev=32403.01 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1467], 10.00th=[ 2212], 20.00th=[ 3916], | 30.00th=[ 6652], 40.00th=[ 14091], 50.00th=[ 21627], 60.00th=[ 27657], | 70.00th=[ 35914], 80.00th=[ 45876], 90.00th=[ 63177], 95.00th=[ 79168], | 99.00th=[119014], 99.50th=[145753], 99.90th=[270533], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 136, per=24.91%, avg=62.52, stdev=24.24, samples=195 iops : min= 3, max= 34, avg=15.01, stdev= 6.10, samples=195 lat (usec) : 50=0.26%, 100=1.33%, 250=0.20%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.43%, 4=5.89%, 10=8.11%, 20=14.55%, 50=45.41% lat (msec) : 100=17.77%, 250=1.76%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=7.20%, ctx=7301, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=240KiB/s (246kB/s), 60.2KiB/s-61.0KiB/s (61.7kB/s-62.5kB/s), io=23.4MiB (24.6MB), run=98557-100079msec WRITE: bw=251KiB/s (257kB/s), 62.5KiB/s-64.4KiB/s (64.1kB/s-65.0kB/s), io=24.6MiB (25.7MB), run=98557-100079msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179101: Thu Apr 30 17:54:16 2026 read: IOPS=11, BW=46.9KiB/s (48.0kB/s)(5992KiB/127729msec) clat (msec): min=5, max=792, avg=33.17, stdev=35.26 lat (msec): min=5, max=792, avg=33.17, stdev=35.26 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 75], 95.00th=[ 94], | 99.00th=[ 136], 99.50th=[ 159], 99.90th=[ 228], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 160, per=25.35%, avg=47.15, stdev=31.87, samples=248 iops : min= 1, max= 40, avg=11.14, stdev= 7.99, samples=248 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6296KiB/127729msec); 0 zone resets clat (msec): min=9, max=286, avg=49.36, stdev=34.23 lat (msec): min=9, max=286, avg=49.36, stdev=34.23 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 74], 90.00th=[ 96], 95.00th=[ 117], | 99.00th=[ 165], 99.50th=[ 194], 99.90th=[ 271], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 159, per=25.13%, avg=49.00, stdev=31.11, samples=251 iops : min= 1, max= 39, avg=11.60, stdev= 7.81, samples=251 lat (msec) : 10=4.26%, 20=24.15%, 50=43.88%, 100=21.06%, 250=6.54% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=3.13%, ctx=5212, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179102: Thu Apr 30 17:54:16 2026 read: IOPS=11, BW=46.3KiB/s (47.4kB/s)(5940KiB/128426msec) clat (msec): min=5, max=689, avg=32.20, stdev=34.12 lat (msec): min=5, max=689, avg=32.21, stdev=34.11 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 70], 95.00th=[ 95], | 99.00th=[ 150], 99.50th=[ 180], 99.90th=[ 251], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 167, per=24.75%, avg=46.03, stdev=33.42, samples=251 iops : min= 1, max= 41, avg=10.86, stdev= 8.40, samples=251 write: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6348KiB/128426msec); 0 zone resets clat (msec): min=10, max=334, avg=50.56, stdev=36.65 lat (msec): min=10, max=334, avg=50.57, stdev=36.65 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 60], 80.00th=[ 74], 90.00th=[ 97], 95.00th=[ 123], | 99.00th=[ 184], 99.50th=[ 232], 99.90th=[ 288], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 143, per=25.08%, avg=48.90, stdev=30.89, samples=252 iops : min= 1, max= 35, avg=11.58, stdev= 7.75, samples=252 lat (msec) : 10=5.53%, 20=23.01%, 50=43.42%, 100=21.13%, 250=6.67% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=2.99%, ctx=5098, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179103: Thu Apr 30 17:54:16 2026 read: IOPS=11, BW=47.0KiB/s (48.1kB/s)(6028KiB/128231msec) clat (msec): min=5, max=247, avg=33.67, stdev=31.56 lat (msec): min=5, max=247, avg=33.67, stdev=31.56 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 101], | 99.00th=[ 144], 99.50th=[ 176], 99.90th=[ 243], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 7, max= 159, per=25.22%, avg=46.90, stdev=32.60, samples=251 iops : min= 1, max= 39, avg=11.08, stdev= 8.18, samples=251 write: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6260KiB/128231msec); 0 zone resets clat (msec): min=10, max=691, avg=49.28, stdev=39.58 lat (msec): min=10, max=691, avg=49.28, stdev=39.58 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 71], 90.00th=[ 97], 95.00th=[ 115], | 99.00th=[ 180], 99.50th=[ 232], 99.90th=[ 330], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 144, per=24.86%, avg=48.48, stdev=32.18, samples=252 iops : min= 1, max= 36, avg=11.47, stdev= 8.08, samples=252 lat (msec) : 10=5.53%, 20=23.24%, 50=43.75%, 100=20.51%, 250=6.74% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=3.05%, ctx=5083, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179104: Thu Apr 30 17:54:16 2026 read: IOPS=11, BW=47.0KiB/s (48.1kB/s)(6052KiB/128760msec) clat (msec): min=5, max=175, avg=32.15, stdev=28.22 lat (msec): min=5, max=175, avg=32.16, stdev=28.22 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 49], 90.00th=[ 74], 95.00th=[ 95], | 99.00th=[ 130], 99.50th=[ 140], 99.90th=[ 153], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 7, max= 167, per=25.37%, avg=47.18, stdev=32.86, samples=250 iops : min= 1, max= 41, avg=11.14, stdev= 8.23, samples=250 write: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6236KiB/128760msec); 0 zone resets clat (msec): min=9, max=696, avg=51.17, stdev=41.33 lat (msec): min=9, max=696, avg=51.17, stdev=41.33 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 77], 90.00th=[ 97], 95.00th=[ 127], | 99.00th=[ 194], 99.50th=[ 232], 99.90th=[ 305], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 151, per=24.63%, avg=48.03, stdev=31.78, samples=253 iops : min= 1, max= 37, avg=11.36, stdev= 7.98, samples=253 lat (msec) : 10=5.66%, 20=23.24%, 50=43.00%, 100=21.48%, 250=6.41% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.06%, sys=2.97%, ctx=5188, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (191kB/s), 46.3KiB/s-47.0KiB/s (47.4kB/s-48.1kB/s), io=23.4MiB (24.6MB), run=127729-128760msec WRITE: bw=195KiB/s (200kB/s), 48.4KiB/s-49.4KiB/s (49.6kB/s-50.6kB/s), io=24.6MiB (25.7MB), run=127729-128760msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179143: Thu Apr 30 17:54:48 2026 read: IOPS=15, BW=250KiB/s (256kB/s)(5920KiB/23647msec) clat (usec): min=38, max=166727, avg=32569.52, stdev=20578.20 lat (usec): min=38, max=166728, avg=32571.00, stdev=20578.00 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 11731], 20.00th=[ 17695], | 30.00th=[ 21627], 40.00th=[ 24773], 50.00th=[ 29492], 60.00th=[ 35390], | 70.00th=[ 40633], 80.00th=[ 47449], 90.00th=[ 55313], 95.00th=[ 66847], | 99.00th=[ 94897], 99.50th=[116917], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 95, max= 509, per=25.71%, avg=248.85, stdev=81.38, samples=46 iops : min= 5, max= 31, avg=14.74, stdev= 5.10, samples=46 write: IOPS=16, BW=269KiB/s (276kB/s)(6368KiB/23647msec); 0 zone resets clat (usec): min=1602, max=158274, avg=28974.17, stdev=26484.13 lat (usec): min=1604, max=158276, avg=28982.31, stdev=26487.62 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2409], 10.00th=[ 3228], 20.00th=[ 5473], | 30.00th=[ 8848], 40.00th=[ 13435], 50.00th=[ 22152], 60.00th=[ 27395], | 70.00th=[ 38011], 80.00th=[ 50070], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[106431], 99.50th=[125305], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 63, max= 476, per=26.38%, avg=268.85, stdev=91.15, samples=46 iops : min= 3, max= 29, avg=16.00, stdev= 5.73, samples=46 lat (usec) : 50=0.65%, 100=2.86%, 250=1.04% lat (msec) : 2=1.30%, 4=6.25%, 10=9.51%, 20=15.10%, 50=44.92% lat (msec) : 100=17.32%, 250=1.04% cpu : usr=0.08%, sys=9.11%, ctx=1894, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179144: Thu Apr 30 17:54:48 2026 read: IOPS=14, BW=237KiB/s (243kB/s)(5744KiB/24222msec) clat (usec): min=51, max=212242, avg=35130.35, stdev=23100.44 lat (usec): min=52, max=212243, avg=35131.53, stdev=23100.46 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 66], 10.00th=[ 12911], 20.00th=[ 19792], | 30.00th=[ 24249], 40.00th=[ 28443], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 42206], 80.00th=[ 48497], 90.00th=[ 60031], 95.00th=[ 76022], | 99.00th=[106431], 99.50th=[135267], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 63, max= 443, per=24.28%, avg=235.06, stdev=81.23, samples=47 iops : min= 3, max= 27, avg=13.89, stdev= 5.07, samples=47 write: IOPS=16, BW=270KiB/s (277kB/s)(6544KiB/24222msec); 0 zone resets clat (usec): min=1658, max=161961, avg=28069.45, stdev=24919.76 lat (usec): min=1660, max=161962, avg=28072.24, stdev=24919.67 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2073], 10.00th=[ 3392], 20.00th=[ 5211], | 30.00th=[ 9241], 40.00th=[ 15008], 50.00th=[ 21365], 60.00th=[ 28181], | 70.00th=[ 37487], 80.00th=[ 48497], 90.00th=[ 66847], 95.00th=[ 76022], | 99.00th=[ 98042], 99.50th=[102237], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 62, max= 479, per=26.15%, avg=266.47, stdev=89.16, samples=47 iops : min= 3, max= 29, avg=15.85, stdev= 5.60, samples=47 lat (usec) : 100=3.78%, 250=0.65%, 500=0.13% lat (msec) : 2=2.34%, 4=4.82%, 10=9.64%, 20=13.80%, 50=46.09% lat (msec) : 100=17.32%, 250=1.43% cpu : usr=0.08%, sys=8.51%, ctx=1875, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179145: Thu Apr 30 17:54:48 2026 read: IOPS=15, BW=253KiB/s (259kB/s)(6256KiB/24728msec) clat (usec): min=32, max=153330, avg=36530.41, stdev=23626.16 lat (usec): min=33, max=153331, avg=36531.64, stdev=23626.13 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 86], 10.00th=[ 13304], 20.00th=[ 19792], | 30.00th=[ 24249], 40.00th=[ 28181], 50.00th=[ 32900], 60.00th=[ 38011], | 70.00th=[ 43779], 80.00th=[ 51643], 90.00th=[ 63701], 95.00th=[ 79168], | 99.00th=[121111], 99.50th=[130548], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 123, max= 382, per=25.84%, avg=250.10, stdev=68.04, samples=48 iops : min= 7, max= 23, avg=14.81, stdev= 4.31, samples=48 write: IOPS=15, BW=244KiB/s (250kB/s)(6032KiB/24728msec); 0 zone resets clat (usec): min=1328, max=134356, avg=27263.60, stdev=25510.47 lat (usec): min=1329, max=134358, avg=27273.85, stdev=25528.09 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2311], 10.00th=[ 3425], 20.00th=[ 5604], | 30.00th=[ 8225], 40.00th=[ 14091], 50.00th=[ 21627], 60.00th=[ 26346], | 70.00th=[ 34866], 80.00th=[ 44827], 90.00th=[ 61604], 95.00th=[ 79168], | 99.00th=[117965], 99.50th=[129500], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 95, max= 479, per=23.02%, avg=234.58, stdev=96.09, samples=48 iops : min= 5, max= 29, avg=13.85, stdev= 6.03, samples=48 lat (usec) : 50=0.26%, 100=2.99%, 250=1.04% lat (msec) : 2=1.69%, 4=4.69%, 10=10.42%, 20=12.37%, 50=48.31% lat (msec) : 100=15.89%, 250=2.34% cpu : usr=0.08%, sys=8.66%, ctx=1981, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179146: Thu Apr 30 17:54:48 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(6032KiB/23677msec) clat (usec): min=42, max=189865, avg=33839.78, stdev=23469.68 lat (usec): min=43, max=189867, avg=33841.28, stdev=23470.16 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 109], 20.00th=[ 17171], | 30.00th=[ 21365], 40.00th=[ 26346], 50.00th=[ 31065], 60.00th=[ 35914], | 70.00th=[ 42206], 80.00th=[ 50594], 90.00th=[ 60556], 95.00th=[ 71828], | 99.00th=[103285], 99.50th=[111674], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 415, per=26.12%, avg=252.85, stdev=78.91, samples=46 iops : min= 1, max= 25, avg=15.00, stdev= 4.97, samples=46 write: IOPS=16, BW=264KiB/s (271kB/s)(6256KiB/23677msec); 0 zone resets clat (usec): min=1583, max=137668, avg=27386.12, stdev=25324.32 lat (usec): min=1585, max=137669, avg=27388.19, stdev=25324.36 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2507], 10.00th=[ 3195], 20.00th=[ 5211], | 30.00th=[ 8225], 40.00th=[ 12125], 50.00th=[ 20317], 60.00th=[ 26608], | 70.00th=[ 35914], 80.00th=[ 48497], 90.00th=[ 62129], 95.00th=[ 81265], | 99.00th=[101188], 99.50th=[113771], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 126, max= 447, per=25.74%, avg=262.30, stdev=80.42, samples=46 iops : min= 7, max= 27, avg=15.61, stdev= 5.03, samples=46 lat (usec) : 50=0.39%, 100=4.17%, 250=1.17%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.82%, 4=4.56%, 10=11.33%, 20=13.67%, 50=43.23% lat (msec) : 100=18.23%, 250=1.04% cpu : usr=0.10%, sys=8.81%, ctx=1883, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=969KiB/s (992kB/s), 237KiB/s-255KiB/s (243kB/s-261kB/s), io=23.4MiB (24.5MB), run=23647-24728msec WRITE: bw=1019KiB/s (1044kB/s), 244KiB/s-270KiB/s (250kB/s-277kB/s), io=24.6MiB (25.8MB), run=23647-24728msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179147: Thu Apr 30 17:54:58 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(5920KiB/33726msec) clat (msec): min=6, max=149, avg=34.65, stdev=27.09 lat (msec): min=6, max=149, avg=34.65, stdev=27.09 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 99], | 99.00th=[ 129], 99.50th=[ 148], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 31, max= 414, per=24.84%, avg=174.65, stdev=92.67, samples=65 iops : min= 1, max= 25, avg=10.23, stdev= 5.84, samples=65 write: IOPS=11, BW=189KiB/s (193kB/s)(6368KiB/33726msec); 0 zone resets clat (msec): min=14, max=194, avg=51.96, stdev=31.95 lat (msec): min=14, max=194, avg=51.96, stdev=31.95 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 59], 80.00th=[ 73], 90.00th=[ 104], 95.00th=[ 118], | 99.00th=[ 155], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 31, max= 416, per=25.25%, avg=186.61, stdev=89.81, samples=66 iops : min= 1, max= 26, avg=11.00, stdev= 5.65, samples=66 lat (msec) : 10=1.30%, 20=18.10%, 50=52.21%, 100=20.70%, 250=7.68% cpu : usr=0.04%, sys=2.98%, ctx=1221, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179148: Thu Apr 30 17:54:58 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5744KiB/33772msec) clat (msec): min=8, max=197, avg=35.58, stdev=30.26 lat (msec): min=8, max=197, avg=35.58, stdev=30.26 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 80], 95.00th=[ 105], | 99.00th=[ 150], 99.50th=[ 167], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 445, per=24.45%, avg=171.89, stdev=97.26, samples=65 iops : min= 1, max= 27, avg=10.08, stdev= 6.10, samples=65 write: IOPS=12, BW=194KiB/s (198kB/s)(6544KiB/33772msec); 0 zone resets clat (msec): min=14, max=194, avg=50.99, stdev=30.87 lat (msec): min=14, max=194, avg=51.00, stdev=30.87 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 29], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 57], 80.00th=[ 70], 90.00th=[ 91], 95.00th=[ 111], | 99.00th=[ 174], 99.50th=[ 180], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 63, max= 448, per=26.28%, avg=194.22, stdev=94.14, samples=65 iops : min= 3, max= 28, avg=11.46, stdev= 5.95, samples=65 lat (msec) : 10=0.65%, 20=19.27%, 50=51.69%, 100=22.14%, 250=6.25% cpu : usr=0.06%, sys=3.06%, ctx=1278, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179149: Thu Apr 30 17:54:58 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(6256KiB/34067msec) clat (msec): min=6, max=199, avg=35.78, stdev=29.11 lat (msec): min=6, max=199, avg=35.78, stdev=29.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 78], 95.00th=[ 91], | 99.00th=[ 146], 99.50th=[ 186], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 540, per=26.14%, avg=183.73, stdev=111.61, samples=67 iops : min= 1, max= 33, avg=10.84, stdev= 6.96, samples=67 write: IOPS=11, BW=177KiB/s (181kB/s)(6032KiB/34067msec); 0 zone resets clat (msec): min=13, max=174, avg=53.09, stdev=31.11 lat (msec): min=13, max=174, avg=53.10, stdev=31.11 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 95], 95.00th=[ 112], | 99.00th=[ 167], 99.50th=[ 174], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 416, per=23.51%, avg=173.72, stdev=87.49, samples=67 iops : min= 1, max= 26, avg=10.19, stdev= 5.53, samples=67 lat (msec) : 10=1.56%, 20=17.97%, 50=49.74%, 100=24.48%, 250=6.25% cpu : usr=0.04%, sys=3.01%, ctx=1302, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179150: Thu Apr 30 17:54:58 2026 read: IOPS=11, BW=177KiB/s (182kB/s)(6032KiB/33996msec) clat (msec): min=6, max=186, avg=35.15, stdev=27.32 lat (msec): min=6, max=186, avg=35.15, stdev=27.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 73], 95.00th=[ 95], | 99.00th=[ 138], 99.50th=[ 161], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 63, max= 475, per=25.32%, avg=178.00, stdev=97.89, samples=66 iops : min= 3, max= 29, avg=10.47, stdev= 6.15, samples=66 write: IOPS=11, BW=184KiB/s (188kB/s)(6256KiB/33996msec); 0 zone resets clat (msec): min=11, max=192, avg=52.57, stdev=33.16 lat (msec): min=11, max=192, avg=52.58, stdev=33.16 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 60], 80.00th=[ 74], 90.00th=[ 103], 95.00th=[ 125], | 99.00th=[ 171], 99.50th=[ 184], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 31, max= 412, per=24.82%, avg=183.40, stdev=95.88, samples=67 iops : min= 1, max= 25, avg=10.81, stdev= 6.04, samples=67 lat (msec) : 10=1.43%, 20=16.02%, 50=53.65%, 100=21.74%, 250=7.16% cpu : usr=0.05%, sys=3.03%, ctx=1248, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=703KiB/s (720kB/s), 170KiB/s-184KiB/s (174kB/s-188kB/s), io=23.4MiB (24.5MB), run=33726-34067msec WRITE: bw=740KiB/s (757kB/s), 177KiB/s-194KiB/s (181kB/s-198kB/s), io=24.6MiB (25.8MB), run=33726-34067msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179161: Thu Apr 30 17:55:11 2026 read: IOPS=1, BW=1529KiB/s (1565kB/s)(7168KiB/4689msec) clat (usec): min=477, max=2660.9k, avg=468364.62, stdev=969912.07 lat (usec): min=478, max=2660.9k, avg=468366.22, stdev=969912.74 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], | 20.00th=[ 619], 30.00th=[ 96994], 40.00th=[ 96994], | 50.00th=[ 160433], 60.00th=[ 177210], 70.00th=[ 177210], | 80.00th=[ 181404], 90.00th=[2667578], 95.00th=[2667578], | 99.00th=[2667578], 99.50th=[2667578], 99.90th=[2667578], | 99.95th=[2667578], 99.99th=[2667578] bw ( KiB/s): min= 3878, max= 6095, per=100.00%, avg=4986.50, stdev=1567.66, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1092KiB/s (1118kB/s)(5120KiB/4689msec); 0 zone resets clat (msec): min=100, max=609, avg=256.22, stdev=201.61 lat (msec): min=100, max=609, avg=256.28, stdev=201.62 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1939, max= 2031, per=39.01%, avg=1985.00, stdev=65.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=14.42%, ctx=627, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179162: Thu Apr 30 17:55:11 2026 read: IOPS=0, BW=364KiB/s (372kB/s)(2048KiB/5634msec) clat (msec): min=156, max=168, avg=162.38, stdev= 8.29 lat (msec): min=156, max=168, avg=162.38, stdev= 8.29 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 169], 95.00th=[ 169], | 99.00th=[ 169], 99.50th=[ 169], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 1363, max= 2048, per=46.92%, avg=1705.50, stdev=484.37, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1818KiB/s (1861kB/s)(10.0MiB/5634msec); 0 zone resets clat (msec): min=116, max=2829, avg=517.30, stdev=821.95 lat (msec): min=116, max=2829, avg=517.46, stdev=822.15 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 128], | 30.00th=[ 136], 40.00th=[ 211], 50.00th=[ 251], 60.00th=[ 284], | 70.00th=[ 305], 80.00th=[ 405], 90.00th=[ 510], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2039, max= 4063, per=62.81%, avg=3196.20, stdev=1054.33, samples=5 iops : min= 1, max= 3, avg= 2.40, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=14.88%, ctx=117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179164: Thu Apr 30 17:55:11 2026 read: IOPS=1, BW=1282KiB/s (1313kB/s)(6144KiB/4792msec) clat (usec): min=497, max=172550, avg=66286.00, stdev=74141.68 lat (usec): min=498, max=172552, avg=66287.08, stdev=74141.69 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 537], | 30.00th=[ 537], 40.00th=[ 5014], 50.00th=[ 5014], 60.00th=[105382], | 70.00th=[113771], 80.00th=[113771], 90.00th=[173016], 95.00th=[173016], | 99.00th=[173016], 99.50th=[173016], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 2039, max= 5818, per=90.83%, avg=3301.67, stdev=2179.21, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1282KiB/s (1313kB/s)(6144KiB/4792msec); 0 zone resets clat (msec): min=176, max=2963, avg=724.24, stdev=1101.65 lat (msec): min=176, max=2963, avg=724.30, stdev=1101.66 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 388], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 2039, max= 3878, per=56.74%, avg=2887.33, stdev=927.73, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=50.00%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.02%, ctx=241, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179167: Thu Apr 30 17:55:11 2026 read: IOPS=1, BW=1050KiB/s (1075kB/s)(5120KiB/4877msec) clat (usec): min=441, max=208745, avg=54835.25, stdev=90083.54 lat (usec): min=441, max=208746, avg=54836.45, stdev=90083.78 clat percentiles (usec): | 1.00th=[ 441], 5.00th=[ 441], 10.00th=[ 441], 20.00th=[ 441], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 1893], 60.00th=[ 1893], | 70.00th=[ 62653], 80.00th=[ 62653], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1470KiB/s (1505kB/s)(7168KiB/4877msec); 0 zone resets clat (msec): min=179, max=2737, avg=639.66, stdev=939.54 lat (msec): min=179, max=2737, avg=639.73, stdev=939.55 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 215], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 230], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 659], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 2035, max= 4079, per=59.12%, avg=3008.75, stdev=1122.78, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=11.73%, ctx=228, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3635KiB/s (3722kB/s), 364KiB/s-1529KiB/s (372kB/s-1565kB/s), io=20.0MiB (20.0MB), run=4689-5634msec WRITE: bw=5089KiB/s (5211kB/s), 1092KiB/s-1818KiB/s (1118kB/s-1861kB/s), io=28.0MiB (29.4MB), run=4689-5634msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179163: Thu Apr 30 17:55:11 2026 read: IOPS=1, BW=1219KiB/s (1248kB/s)(7168KiB/5880msec) clat (msec): min=69, max=2406, avg=657.48, stdev=851.77 lat (msec): min=69, max=2406, avg=657.48, stdev=851.77 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 72], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 239], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 969], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1921, max= 4087, per=69.44%, avg=2417.80, stdev=934.35, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=871KiB/s (892kB/s)(5120KiB/5880msec); 0 zone resets clat (msec): min=102, max=230, avg=173.79, stdev=56.38 lat (msec): min=102, max=230, avg=173.90, stdev=56.35 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 174], 60.00th=[ 174], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 2039, max= 4079, per=55.79%, avg=2720.33, stdev=1176.64, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=50.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.62%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179165: Thu Apr 30 17:55:11 2026 read: IOPS=0, BW=353KiB/s (361kB/s)(2048KiB/5804msec) clat (msec): min=88, max=197, avg=143.04, stdev=76.89 lat (msec): min=88, max=197, avg=143.04, stdev=76.89 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 89], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 1503, max= 2043, per=50.92%, avg=1773.00, stdev=381.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1764KiB/s (1807kB/s)(10.0MiB/5804msec); 0 zone resets clat (msec): min=70, max=2912, avg=511.33, stdev=859.62 lat (msec): min=70, max=2912, avg=511.81, stdev=859.58 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 128], 40.00th=[ 180], 50.00th=[ 186], 60.00th=[ 236], | 70.00th=[ 264], 80.00th=[ 477], 90.00th=[ 584], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1921, max= 6131, per=74.79%, avg=3646.60, stdev=2262.92, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.88%, ctx=134, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179166: Thu Apr 30 17:55:11 2026 read: IOPS=1, BW=1110KiB/s (1137kB/s)(6144KiB/5533msec) clat (msec): min=88, max=379, avg=202.54, stdev=130.19 lat (msec): min=88, max=379, avg=202.55, stdev=130.19 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 171], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1921, max= 4087, per=77.03%, avg=2682.33, stdev=1217.91, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1110KiB/s (1137kB/s)(6144KiB/5533msec); 0 zone resets clat (msec): min=59, max=3038, avg=653.12, stdev=1173.68 lat (msec): min=59, max=3038, avg=653.20, stdev=1173.69 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 194], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 2023, max= 4087, per=62.33%, avg=3039.00, stdev=1032.37, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=5.62%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179168: Thu Apr 30 17:55:11 2026 read: IOPS=0, BW=879KiB/s (900kB/s)(5120KiB/5826msec) clat (msec): min=48, max=361, avg=134.80, stdev=128.59 lat (msec): min=48, max=361, avg=134.80, stdev=128.59 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 49], | 30.00th=[ 71], 40.00th=[ 71], 50.00th=[ 83], 60.00th=[ 83], | 70.00th=[ 111], 80.00th=[ 111], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2039, max= 6131, per=100.00%, avg=4085.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1230KiB/s (1260kB/s)(7168KiB/5826msec); 0 zone resets clat (msec): min=112, max=3005, avg=725.49, stdev=1018.86 lat (msec): min=112, max=3005, avg=725.57, stdev=1018.86 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 127], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 477], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 498], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1551, max= 4079, per=47.63%, avg=2322.60, stdev=1001.47, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.13%, ctx=113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3483KiB/s (3567kB/s), 353KiB/s-1219KiB/s (361kB/s-1248kB/s), io=20.0MiB (20.0MB), run=5533-5880msec WRITE: bw=4876KiB/s (4993kB/s), 871KiB/s-1764KiB/s (892kB/s-1807kB/s), io=28.0MiB (29.4MB), run=5533-5880msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179175: Thu Apr 30 17:55:25 2026 read: IOPS=0, BW=2632KiB/s (2696kB/s)(12.0MiB/4668msec) clat (msec): min=657, max=3238, avg=1529.56, stdev=1479.94 lat (msec): min=657, max=3238, avg=1529.56, stdev=1479.94 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 7968, max= 8126, per=100.00%, avg=8047.00, stdev=111.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=8.74%, ctx=346, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179176: Thu Apr 30 17:55:25 2026 read: IOPS=0, BW=756KiB/s (774kB/s)(4096KiB/5417msec) clat (nsec): min=3072.4M, max=3072.4M, avg=3072435802.00, stdev= 0.00 lat (nsec): min=3072.4M, max=3072.4M, avg=3072438767.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3071], 5.00th=[ 3071], 10.00th=[ 3071], 20.00th=[ 3071], | 30.00th=[ 3071], 40.00th=[ 3071], 50.00th=[ 3071], 60.00th=[ 3071], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1512KiB/s (1549kB/s)(8192KiB/5417msec); 0 zone resets clat (msec): min=772, max=1508, avg=1140.43, stdev=520.34 lat (msec): min=773, max=1508, avg=1140.91, stdev=520.08 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.89%, ctx=513, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179177: Thu Apr 30 17:55:25 2026 write: IOPS=0, BW=2761KiB/s (2827kB/s)(12.0MiB/4451msec); 0 zone resets clat (msec): min=456, max=2917, avg=1451.22, stdev=1296.78 lat (msec): min=460, max=2918, avg=1452.80, stdev=1295.57 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 7968, max= 8143, per=100.00%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.88%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179180: Thu Apr 30 17:55:25 2026 write: IOPS=0, BW=2395KiB/s (2453kB/s)(12.0MiB/5130msec); 0 zone resets clat (msec): min=263, max=2931, avg=1683.72, stdev=1342.38 lat (msec): min=263, max=2932, avg=1684.44, stdev=1342.50 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 1854], 50.00th=[ 1854], 60.00th=[ 1854], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.55%, ctx=82, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3025KiB/s (3097kB/s), 756KiB/s-2632KiB/s (774kB/s-2696kB/s), io=16.0MiB (16.8MB), run=4668-5417msec WRITE: bw=6049KiB/s (6194kB/s), 1512KiB/s-2761KiB/s (1549kB/s-2827kB/s), io=32.0MiB (33.6MB), run=4451-5417msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179178: Thu Apr 30 17:55:25 2026 read: IOPS=0, BW=2455KiB/s (2514kB/s)(12.0MiB/5006msec) clat (msec): min=754, max=3329, avg=1655.04, stdev=1451.50 lat (msec): min=754, max=3329, avg=1655.04, stdev=1451.50 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 8062, max= 8126, per=100.00%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.14%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179179: Thu Apr 30 17:55:25 2026 read: IOPS=0, BW=722KiB/s (739kB/s)(4096KiB/5674msec) clat (nsec): min=3567.5M, max=3567.5M, avg=3567512675.00, stdev= 0.00 lat (nsec): min=3567.5M, max=3567.5M, avg=3567515364.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3574], 5.00th=[ 3574], 10.00th=[ 3574], 20.00th=[ 3574], | 30.00th=[ 3574], 40.00th=[ 3574], 50.00th=[ 3574], 60.00th=[ 3574], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1444KiB/s (1478kB/s)(8192KiB/5674msec); 0 zone resets clat (msec): min=889, max=1050, avg=969.80, stdev=113.79 lat (msec): min=889, max=1050, avg=970.05, stdev=113.78 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.68%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179181: Thu Apr 30 17:55:25 2026 write: IOPS=0, BW=2189KiB/s (2242kB/s)(12.0MiB/5613msec); 0 zone resets clat (msec): min=210, max=4379, avg=1839.27, stdev=2229.34 lat (msec): min=210, max=4380, avg=1839.61, stdev=2229.37 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 4396], 80.00th=[ 4396], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.12%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179182: Thu Apr 30 17:55:25 2026 write: IOPS=0, BW=2309KiB/s (2365kB/s)(12.0MiB/5321msec); 0 zone resets clat (msec): min=231, max=3154, avg=1728.99, stdev=1463.14 lat (msec): min=231, max=3155, avg=1729.36, stdev=1463.19 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 1804], 50.00th=[ 1804], 60.00th=[ 1804], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.24%, ctx=84, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2888KiB/s (2957kB/s), 722KiB/s-2455KiB/s (739kB/s-2514kB/s), io=16.0MiB (16.8MB), run=5006-5674msec WRITE: bw=5775KiB/s (5914kB/s), 1444KiB/s-2309KiB/s (1478kB/s-2365kB/s), io=32.0MiB (33.6MB), run=5321-5674msec