== sanity test 398b: DIO and buffer IO race ============== 15:00:41 (1788289241) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.67791 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145400: Tue Sep 1 15:03:08 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(5992KiB/128514msec) clat (usec): min=35, max=944873, avg=41072.63, stdev=38518.45 lat (usec): min=35, max=944877, avg=41074.44, stdev=38519.03 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 404], 20.00th=[ 19268], | 30.00th=[ 24511], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[141558], 99.50th=[164627], 99.90th=[367002], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 118, per=25.04%, avg=46.58, stdev=18.67, samples=249 iops : min= 1, max= 29, avg=11.00, stdev= 4.70, samples=249 write: IOPS=12, BW=48.0KiB/s (50.2kB/s)(6296KiB/128514msec); 0 zone resets clat (usec): min=855, max=350082, avg=42301.45, stdev=42753.46 lat (usec): min=856, max=350084, avg=42303.25, stdev=42753.36 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1680], 20.00th=[ 4359], | 30.00th=[ 9110], 40.00th=[ 21103], 50.00th=[ 31851], 60.00th=[ 43779], | 70.00th=[ 56886], 80.00th=[ 74974], 90.00th=[ 96994], 95.00th=[115868], | 99.00th=[185598], 99.50th=[252707], 99.90th=[325059], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 142, per=25.01%, avg=48.77, stdev=20.58, samples=250 iops : min= 1, max= 35, avg=11.55, stdev= 5.16, samples=250 lat (usec) : 50=0.72%, 100=3.68%, 250=0.39%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=5.73%, 4=3.91%, 10=6.51%, 20=9.28%, 50=36.72% lat (msec) : 100=26.37%, 250=5.92%, 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=4.84%, ctx=6488, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145401: Tue Sep 1 15:03:08 2026 read: IOPS=11, BW=46.9KiB/s (48.0kB/s)(5940KiB/126676msec) clat (usec): min=34, max=940641, avg=40752.66, stdev=36372.74 lat (usec): min=34, max=940643, avg=40754.82, stdev=36374.27 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 7373], 20.00th=[ 20055], | 30.00th=[ 25035], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[152044], 99.90th=[256902], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 95, per=25.23%, avg=46.93, stdev=19.49, samples=247 iops : min= 1, max= 23, avg=11.10, stdev= 4.92, samples=247 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6348KiB/126676msec); 0 zone resets clat (usec): min=961, max=517401, avg=41453.42, stdev=44563.36 lat (usec): min=961, max=517403, avg=41456.22, stdev=44562.82 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1549], 20.00th=[ 4113], | 30.00th=[ 7963], 40.00th=[ 18482], 50.00th=[ 30540], 60.00th=[ 41157], | 70.00th=[ 53216], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[123208], | 99.00th=[185598], 99.50th=[214959], 99.90th=[375391], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 120, per=25.62%, avg=49.95, stdev=20.68, samples=248 iops : min= 1, max= 30, avg=11.85, stdev= 5.19, samples=248 lat (usec) : 50=0.52%, 100=3.58%, 250=0.46%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.18%, 4=4.13%, 10=7.03%, 20=8.63%, 50=38.48% lat (msec) : 100=24.67%, 250=5.99%, 500=0.10%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.91%, ctx=6515, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145402: Tue Sep 1 15:03:08 2026 read: IOPS=11, BW=47.3KiB/s (48.5kB/s)(6028KiB/127317msec) clat (usec): min=30, max=723127, avg=40425.16, stdev=37094.31 lat (usec): min=30, max=723129, avg=40426.83, stdev=37094.34 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 627], 20.00th=[ 19006], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 48497], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[133694], 99.50th=[185598], 99.90th=[471860], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 126, per=25.52%, avg=47.47, stdev=20.49, samples=247 iops : min= 1, max= 31, avg=11.23, stdev= 5.16, samples=247 write: IOPS=12, BW=49.2KiB/s (50.3kB/s)(6260KiB/127317msec); 0 zone resets clat (usec): min=829, max=1186.4k, avg=42132.18, stdev=50502.15 lat (usec): min=830, max=1186.4k, avg=42134.44, stdev=50501.80 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1680], | 20.00th=[ 4047], 30.00th=[ 9372], 40.00th=[ 20055], | 50.00th=[ 31065], 60.00th=[ 43254], 70.00th=[ 56886], | 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[ 119014], | 99.00th=[ 185598], 99.50th=[ 221250], 99.90th=[ 320865], | 99.95th=[1182794], 99.99th=[1182794] bw ( KiB/s): min= 7, max= 119, per=25.22%, avg=49.18, stdev=20.01, samples=247 iops : min= 1, max= 29, avg=11.66, stdev= 5.02, samples=247 lat (usec) : 50=0.78%, 100=3.74%, 250=0.20%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=5.96%, 4=4.07%, 10=5.96%, 20=9.86%, 50=37.30% lat (msec) : 100=25.55%, 250=5.96%, 500=0.20%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.85%, ctx=6494, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145403: Tue Sep 1 15:03:08 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6052KiB/126824msec) clat (usec): min=33, max=951872, avg=41416.82, stdev=40168.81 lat (usec): min=34, max=951873, avg=41419.74, stdev=40167.92 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 314], 20.00th=[ 19268], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[158335], 99.50th=[202376], 99.90th=[329253], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 96, per=25.72%, avg=47.83, stdev=19.11, samples=247 iops : min= 1, max= 24, avg=11.32, stdev= 4.80, samples=247 write: IOPS=12, BW=49.2KiB/s (50.3kB/s)(6236KiB/126824msec); 0 zone resets clat (usec): min=948, max=414926, avg=40931.60, stdev=43318.11 lat (usec): min=949, max=414927, avg=40933.25, stdev=43317.92 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1663], 20.00th=[ 3949], | 30.00th=[ 7898], 40.00th=[ 17695], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 55313], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[123208], | 99.00th=[196084], 99.50th=[225444], 99.90th=[270533], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 7, max= 135, per=25.25%, avg=49.24, stdev=20.30, samples=247 iops : min= 1, max= 33, avg=11.68, stdev= 5.10, samples=247 lat (usec) : 50=0.52%, 100=3.61%, 250=0.72%, 500=0.23%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.02%, 4=4.17%, 10=7.03%, 20=9.15%, 50=37.21% lat (msec) : 100=24.61%, 250=6.28%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=4.92%, ctx=6608, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=187KiB/s (191kB/s), 46.6KiB/s-47.7KiB/s (47.7kB/s-48.9kB/s), io=23.4MiB (24.6MB), run=126676-128514msec WRITE: bw=196KiB/s (200kB/s), 48.0KiB/s-50.1KiB/s (50.2kB/s-51.3kB/s), io=24.6MiB (25.7MB), run=126676-128514msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145395: Tue Sep 1 15:05:38 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(5992KiB/277406msec) clat (msec): min=5, max=1008, avg=35.21, stdev=43.54 lat (msec): min=5, max=1008, avg=35.21, stdev=43.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 79], 95.00th=[ 107], | 99.00th=[ 165], 99.50th=[ 232], 99.90th=[ 456], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 80, per=28.26%, avg=24.30, stdev=16.12, samples=477 iops : min= 1, max= 20, avg= 5.47, stdev= 4.07, samples=477 write: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6296KiB/277406msec); 0 zone resets clat (msec): min=34, max=587, avg=142.46, stdev=63.08 lat (msec): min=34, max=587, avg=142.46, stdev=63.08 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 116], 50.00th=[ 129], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 226], 95.00th=[ 264], | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 485], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 48, per=24.87%, avg=22.38, stdev= 9.67, samples=542 iops : min= 1, max= 12, avg= 4.98, stdev= 2.46, samples=542 lat (msec) : 10=3.06%, 20=18.03%, 50=19.40%, 100=19.63%, 250=36.43% lat (msec) : 500=3.39%, 750=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.07%, ctx=5092, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145396: Tue Sep 1 15:05:38 2026 read: IOPS=5, BW=21.3KiB/s (21.9kB/s)(5940KiB/278231msec) clat (msec): min=5, max=956, avg=34.92, stdev=45.07 lat (msec): min=5, max=956, avg=34.93, stdev=45.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 69], 95.00th=[ 101], | 99.00th=[ 178], 99.50th=[ 228], 99.90th=[ 481], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 87, per=28.57%, avg=24.57, stdev=16.37, samples=468 iops : min= 1, max= 21, avg= 5.54, stdev= 4.12, samples=468 write: IOPS=5, BW=22.8KiB/s (23.4kB/s)(6348KiB/278231msec); 0 zone resets clat (msec): min=36, max=571, avg=142.36, stdev=65.38 lat (msec): min=36, max=571, avg=142.37, stdev=65.38 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 89], | 30.00th=[ 102], 40.00th=[ 115], 50.00th=[ 128], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 226], 95.00th=[ 268], | 99.00th=[ 359], 99.50th=[ 422], 99.90th=[ 502], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 63, per=25.10%, avg=22.59, stdev= 9.91, samples=542 iops : min= 1, max= 15, avg= 5.03, stdev= 2.52, samples=542 lat (msec) : 10=2.96%, 20=18.33%, 50=19.17%, 100=20.25%, 250=35.58% lat (msec) : 500=3.61%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5154, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145397: Tue Sep 1 15:05:38 2026 read: IOPS=5, BW=21.6KiB/s (22.2kB/s)(6028KiB/278508msec) clat (msec): min=5, max=269, avg=34.04, stdev=31.76 lat (msec): min=5, max=269, avg=34.05, stdev=31.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 96], | 99.00th=[ 163], 99.50th=[ 201], 99.90th=[ 264], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 103, per=27.71%, avg=23.83, stdev=16.54, samples=488 iops : min= 1, max= 25, avg= 5.34, stdev= 4.18, samples=488 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6260KiB/278508msec); 0 zone resets clat (msec): min=30, max=1286, avg=144.88, stdev=72.39 lat (msec): min=30, max=1286, avg=144.89, stdev=72.39 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 105], 40.00th=[ 116], 50.00th=[ 129], 60.00th=[ 144], | 70.00th=[ 163], 80.00th=[ 188], 90.00th=[ 230], 95.00th=[ 266], | 99.00th=[ 355], 99.50th=[ 460], 99.90th=[ 709], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 48, per=24.52%, avg=22.07, stdev= 9.50, samples=545 iops : min= 1, max= 12, avg= 4.90, stdev= 2.43, samples=545 lat (msec) : 10=2.38%, 20=17.90%, 50=20.21%, 100=19.63%, 250=36.39% lat (msec) : 500=3.32%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.04%, ctx=5108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145398: Tue Sep 1 15:05:38 2026 read: IOPS=5, BW=21.0KiB/s (22.5kB/s)(6052KiB/275368msec) clat (msec): min=5, max=430, avg=34.30, stdev=34.73 lat (msec): min=5, max=430, avg=34.30, stdev=34.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 75], 95.00th=[ 100], | 99.00th=[ 165], 99.50th=[ 209], 99.90th=[ 388], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 80, per=28.89%, avg=24.85, stdev=16.52, samples=471 iops : min= 1, max= 20, avg= 5.60, stdev= 4.19, samples=471 write: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6236KiB/275368msec); 0 zone resets clat (msec): min=34, max=1119, avg=143.05, stdev=67.42 lat (msec): min=34, max=1119, avg=143.05, stdev=67.42 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 115], 50.00th=[ 129], 60.00th=[ 144], | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 228], 95.00th=[ 266], | 99.00th=[ 342], 99.50th=[ 376], 99.90th=[ 709], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 55, per=24.61%, avg=22.15, stdev= 9.75, samples=542 iops : min= 1, max= 13, avg= 4.92, stdev= 2.49, samples=542 lat (msec) : 10=2.60%, 20=17.87%, 50=20.35%, 100=19.73%, 250=35.81% lat (msec) : 500=3.58%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5144, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.2KiB/s (88.3kB/s), 21.3KiB/s-21.0KiB/s (21.9kB/s-22.5kB/s), io=23.4MiB (24.6MB), run=275368-278508msec WRITE: bw=90.3KiB/s (92.4kB/s), 22.5KiB/s-22.8KiB/s (23.0kB/s-23.4kB/s), io=24.6MiB (25.7MB), run=275368-278508msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145479: Tue Sep 1 15:06:17 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(5920KiB/28606msec) clat (usec): min=34, max=171748, avg=37619.22, stdev=32261.56 lat (usec): min=34, max=171749, avg=37621.59, stdev=32262.49 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 50], 10.00th=[ 60], 20.00th=[ 79], | 30.00th=[ 14091], 40.00th=[ 26346], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[ 94897], | 99.00th=[115868], 99.50th=[135267], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 93, max= 508, per=25.88%, avg=207.07, stdev=93.98, samples=56 iops : min= 5, max= 31, avg=12.21, stdev= 5.89, samples=56 write: IOPS=13, BW=223KiB/s (228kB/s)(6368KiB/28606msec); 0 zone resets clat (usec): min=1432, max=224630, avg=36737.82, stdev=39428.77 lat (usec): min=1433, max=224632, avg=36741.45, stdev=39431.59 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1713], 10.00th=[ 2073], 20.00th=[ 4817], | 30.00th=[ 7701], 40.00th=[ 12518], 50.00th=[ 22676], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 66847], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[177210], 99.50th=[196084], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 478, per=26.49%, avg=223.02, stdev=98.13, samples=56 iops : min= 1, max= 29, avg=13.23, stdev= 6.15, samples=56 lat (usec) : 50=2.34%, 100=8.98%, 250=1.17%, 500=0.52% lat (msec) : 2=5.34%, 4=4.43%, 10=9.90%, 20=7.94%, 50=28.78% lat (msec) : 100=24.74%, 250=5.86% cpu : usr=0.07%, sys=5.31%, ctx=1407, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145480: Tue Sep 1 15:06:17 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(5744KiB/29913msec) clat (usec): min=37, max=248080, avg=39379.17, stdev=33037.40 lat (usec): min=37, max=248082, avg=39381.06, stdev=33037.20 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 123], | 30.00th=[ 23725], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 90702], | 99.00th=[122160], 99.50th=[200279], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 24, max= 372, per=24.81%, avg=198.52, stdev=83.97, samples=56 iops : min= 1, max= 23, avg=11.68, stdev= 5.22, samples=56 write: IOPS=13, BW=219KiB/s (224kB/s)(6544KiB/29913msec); 0 zone resets clat (usec): min=1414, max=286232, avg=38481.01, stdev=43492.68 lat (usec): min=1415, max=286234, avg=38483.35, stdev=43492.37 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1713], 10.00th=[ 2802], 20.00th=[ 5276], | 30.00th=[ 8356], 40.00th=[ 13698], 50.00th=[ 23987], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 65799], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[187696], 99.50th=[225444], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 63, max= 383, per=25.85%, avg=217.64, stdev=94.29, samples=58 iops : min= 3, max= 23, avg=12.88, stdev= 5.90, samples=58 lat (usec) : 50=1.82%, 100=7.16%, 250=1.04%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=4.56%, 4=3.78%, 10=9.64%, 20=8.46%, 50=32.42% lat (msec) : 100=24.48%, 250=5.73%, 500=0.26% cpu : usr=0.05%, sys=5.26%, ctx=1436, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145481: Tue Sep 1 15:06:17 2026 read: IOPS=13, BW=220KiB/s (226kB/s)(6256KiB/28374msec) clat (usec): min=37, max=341258, avg=39124.67, stdev=32573.30 lat (usec): min=37, max=341260, avg=39127.46, stdev=32573.73 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 2835], | 30.00th=[ 23462], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[152044], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 50, max= 509, per=27.75%, avg=222.04, stdev=90.87, samples=55 iops : min= 3, max= 31, avg=13.18, stdev= 5.69, samples=55 write: IOPS=13, BW=213KiB/s (218kB/s)(6032KiB/28374msec); 0 zone resets clat (usec): min=1379, max=307766, avg=34561.34, stdev=40058.21 lat (usec): min=1379, max=307767, avg=34582.22, stdev=40055.81 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1729], 10.00th=[ 2180], 20.00th=[ 4178], | 30.00th=[ 7504], 40.00th=[ 11469], 50.00th=[ 18482], 60.00th=[ 31589], | 70.00th=[ 45876], 80.00th=[ 58983], 90.00th=[ 89654], 95.00th=[115868], | 99.00th=[168821], 99.50th=[274727], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 32, max= 407, per=25.00%, avg=210.47, stdev=93.17, samples=55 iops : min= 2, max= 25, avg=12.44, stdev= 5.86, samples=55 lat (usec) : 50=0.78%, 100=7.42%, 250=1.04%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.95%, 4=5.08%, 10=8.98%, 20=9.77%, 50=32.42% lat (msec) : 100=23.44%, 250=5.34%, 500=0.39% cpu : usr=0.09%, sys=5.51%, ctx=1455, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145482: Tue Sep 1 15:06:17 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(6032KiB/28382msec) clat (usec): min=29, max=176222, avg=37043.20, stdev=32484.82 lat (usec): min=29, max=176223, avg=37045.62, stdev=32485.16 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 72], | 30.00th=[ 18220], 40.00th=[ 27919], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 60031], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[154141], 99.50th=[158335], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 504, per=26.28%, avg=210.27, stdev=94.69, samples=55 iops : min= 1, max= 31, avg=12.44, stdev= 5.96, samples=55 write: IOPS=13, BW=220KiB/s (226kB/s)(6256KiB/28382msec); 0 zone resets clat (usec): min=1357, max=194919, avg=36756.32, stdev=39529.04 lat (usec): min=1357, max=194922, avg=36777.02, stdev=39523.25 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1762], 10.00th=[ 2409], 20.00th=[ 5211], | 30.00th=[ 8029], 40.00th=[ 13042], 50.00th=[ 24249], 60.00th=[ 31851], | 70.00th=[ 48497], 80.00th=[ 65274], 90.00th=[ 88605], 95.00th=[121111], | 99.00th=[185598], 99.50th=[191890], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 61, max= 506, per=26.01%, avg=219.02, stdev=90.05, samples=55 iops : min= 3, max= 31, avg=12.98, stdev= 5.65, samples=55 lat (usec) : 50=1.95%, 100=9.38%, 250=1.56%, 500=0.13%, 1000=0.26% lat (msec) : 2=4.69%, 4=3.91%, 10=10.16%, 20=7.16%, 50=30.34% lat (msec) : 100=24.74%, 250=5.73% cpu : usr=0.07%, sys=5.35%, ctx=1398, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=801KiB/s (820kB/s), 192KiB/s-220KiB/s (197kB/s-226kB/s), io=23.4MiB (24.5MB), run=28374-29913msec WRITE: bw=842KiB/s (863kB/s), 213KiB/s-223KiB/s (218kB/s-228kB/s), io=24.6MiB (25.8MB), run=28374-29913msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145474: Tue Sep 1 15:07:02 2026 read: IOPS=5, BW=80.4KiB/s (82.4kB/s)(5920KiB/73597msec) clat (msec): min=8, max=405, avg=43.11, stdev=38.13 lat (msec): min=8, max=405, avg=43.11, stdev=38.13 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 45], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 197], 99.50th=[ 230], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 350, per=29.17%, avg=93.63, stdev=54.62, samples=124 iops : min= 1, max= 21, avg= 5.10, stdev= 3.48, samples=124 write: IOPS=5, BW=86.5KiB/s (88.6kB/s)(6368KiB/73597msec); 0 zone resets clat (msec): min=54, max=411, avg=144.44, stdev=61.65 lat (msec): min=54, max=411, avg=144.45, stdev=61.65 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 73], 10.00th=[ 86], 20.00th=[ 100], | 30.00th=[ 108], 40.00th=[ 117], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 180], 90.00th=[ 226], 95.00th=[ 275], | 99.00th=[ 376], 99.50th=[ 384], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 26, max= 160, per=25.52%, avg=85.99, stdev=35.28, samples=145 iops : min= 1, max= 10, avg= 4.62, stdev= 2.24, samples=145 lat (msec) : 10=0.65%, 20=8.59%, 50=27.86%, 100=18.88%, 250=39.97% lat (msec) : 500=4.04% cpu : usr=0.04%, sys=1.13%, ctx=1396, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145475: Tue Sep 1 15:07:02 2026 read: IOPS=4, BW=77.0KiB/s (78.8kB/s)(5744KiB/74597msec) clat (msec): min=8, max=407, avg=45.84, stdev=41.24 lat (msec): min=8, max=407, avg=45.84, stdev=41.24 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 86], 95.00th=[ 120], | 99.00th=[ 201], 99.50th=[ 305], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 26, max= 254, per=27.49%, avg=88.24, stdev=56.44, samples=127 iops : min= 1, max= 15, avg= 4.76, stdev= 3.56, samples=127 write: IOPS=5, BW=87.7KiB/s (89.8kB/s)(6544KiB/74597msec); 0 zone resets clat (msec): min=44, max=485, avg=141.77, stdev=61.86 lat (msec): min=44, max=485, avg=141.78, stdev=61.86 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 72], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 106], 40.00th=[ 117], 50.00th=[ 128], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 182], 90.00th=[ 224], 95.00th=[ 264], | 99.00th=[ 351], 99.50th=[ 388], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 26, max= 160, per=26.42%, avg=89.04, stdev=35.84, samples=144 iops : min= 1, max= 10, avg= 4.82, stdev= 2.28, samples=144 lat (msec) : 10=0.52%, 20=8.33%, 50=25.39%, 100=22.40%, 250=39.97% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.24%, ctx=1457, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145476: Tue Sep 1 15:07:02 2026 read: IOPS=5, BW=87.9KiB/s (89.0kB/s)(6256KiB/71192msec) clat (msec): min=8, max=405, avg=42.53, stdev=39.97 lat (msec): min=8, max=405, avg=42.53, stdev=39.97 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 120], | 99.00th=[ 207], 99.50th=[ 309], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 286, per=29.30%, avg=94.04, stdev=61.01, samples=131 iops : min= 1, max= 17, avg= 5.14, stdev= 3.84, samples=131 write: IOPS=5, BW=84.7KiB/s (86.8kB/s)(6032KiB/71192msec); 0 zone resets clat (msec): min=52, max=424, avg=144.31, stdev=63.89 lat (msec): min=52, max=424, avg=144.31, stdev=63.89 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 74], 10.00th=[ 82], 20.00th=[ 95], | 30.00th=[ 106], 40.00th=[ 116], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 292], | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 26, max= 159, per=25.08%, avg=84.50, stdev=34.26, samples=139 iops : min= 1, max= 9, avg= 4.53, stdev= 2.20, samples=139 lat (msec) : 10=0.39%, 20=9.90%, 50=29.43%, 100=19.92%, 250=35.81% lat (msec) : 500=4.56% cpu : usr=0.03%, sys=1.32%, ctx=1424, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145477: Tue Sep 1 15:07:02 2026 read: IOPS=5, BW=81.4KiB/s (83.4kB/s)(6032KiB/74059msec) clat (msec): min=7, max=319, avg=45.88, stdev=40.87 lat (msec): min=7, max=319, avg=45.90, stdev=40.89 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 90], 95.00th=[ 134], | 99.00th=[ 213], 99.50th=[ 279], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 256, per=28.61%, avg=91.83, stdev=55.37, samples=128 iops : min= 1, max= 16, avg= 4.98, stdev= 3.52, samples=128 write: IOPS=5, BW=84.5KiB/s (86.5kB/s)(6256KiB/74059msec); 0 zone resets clat (msec): min=43, max=479, avg=144.99, stdev=60.68 lat (msec): min=43, max=479, avg=145.00, stdev=60.68 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 78], 10.00th=[ 84], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 120], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 232], 95.00th=[ 266], | 99.00th=[ 334], 99.50th=[ 435], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 31, max= 160, per=25.65%, avg=86.45, stdev=33.81, samples=142 iops : min= 1, max= 10, avg= 4.65, stdev= 2.19, samples=142 lat (msec) : 10=1.04%, 20=8.72%, 50=26.17%, 100=21.22%, 250=39.45% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.16%, ctx=1299, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=321KiB/s (329kB/s), 77.0KiB/s-87.9KiB/s (78.8kB/s-89.0kB/s), io=23.4MiB (24.5MB), run=71192-74597msec WRITE: bw=338KiB/s (346kB/s), 84.5KiB/s-87.7KiB/s (86.5kB/s-89.8kB/s), io=24.6MiB (25.8MB), run=71192-74597msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145501: Tue Sep 1 15:07:17 2026 read: IOPS=1, BW=1438KiB/s (1472kB/s)(7168KiB/4986msec) clat (usec): min=507, max=2797.6k, avg=515959.67, stdev=1009354.85 lat (usec): min=509, max=2797.6k, avg=515961.11, stdev=1009354.82 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], | 20.00th=[ 52167], 30.00th=[ 166724], 40.00th=[ 166724], | 50.00th=[ 179307], 60.00th=[ 183501], 70.00th=[ 183501], | 80.00th=[ 229639], 90.00th=[2801796], 95.00th=[2801796], | 99.00th=[2801796], 99.50th=[2801796], 99.90th=[2801796], | 99.95th=[2801796], 99.99th=[2801796] bw ( KiB/s): min= 1475, max= 3961, per=78.33%, avg=2376.50, stdev=1088.82, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1027KiB/s (1052kB/s)(5120KiB/4986msec); 0 zone resets clat (msec): min=144, max=472, avg=251.34, stdev=132.08 lat (msec): min=144, max=472, avg=251.40, stdev=132.08 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1980, max= 3976, per=62.69%, avg=2662.33, stdev=1137.95, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=9.51%, ctx=693, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145502: Tue Sep 1 15:07:17 2026 read: IOPS=0, BW=303KiB/s (311kB/s)(2048KiB/6750msec) clat (usec): min=560, max=259141, avg=129851.17, stdev=182844.39 lat (usec): min=561, max=259143, avg=129852.80, stdev=182845.32 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[ 562], 60.00th=[258999], | 70.00th=[258999], 80.00th=[258999], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 1519, max= 2043, per=58.70%, avg=1781.00, stdev=370.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1517KiB/s (1553kB/s)(10.0MiB/6750msec); 0 zone resets clat (msec): min=104, max=2835, avg=614.10, stdev=827.31 lat (msec): min=104, max=2839, avg=614.61, stdev=828.64 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 153], | 30.00th=[ 176], 40.00th=[ 205], 50.00th=[ 230], 60.00th=[ 359], | 70.00th=[ 363], 80.00th=[ 852], 90.00th=[ 869], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1980, max= 6131, per=71.64%, avg=3042.67, stdev=1722.53, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=9.59%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145503: Tue Sep 1 15:07:17 2026 read: IOPS=1, BW=1214KiB/s (1243kB/s)(6144KiB/5061msec) clat (usec): min=487, max=255935, avg=152460.15, stdev=112807.35 lat (usec): min=489, max=255936, avg=152461.35, stdev=112807.06 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 31327], | 30.00th=[ 31327], 40.00th=[149947], 50.00th=[149947], 60.00th=[227541], | 70.00th=[250610], 80.00th=[250610], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 3976, max= 4063, per=100.00%, avg=4019.50, stdev=61.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1214KiB/s (1243kB/s)(6144KiB/5061msec); 0 zone resets clat (msec): min=125, max=2791, avg=646.14, stdev=1052.37 lat (msec): min=125, max=2791, avg=646.34, stdev=1052.31 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 247], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1980, max= 2860, per=52.15%, avg=2214.75, stdev=430.75, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 250=50.00%, 500=25.00%, >=2000=8.33% cpu : usr=0.04%, sys=9.23%, ctx=178, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145504: Tue Sep 1 15:07:17 2026 read: IOPS=0, BW=933KiB/s (956kB/s)(5120KiB/5487msec) clat (msec): min=141, max=296, avg=255.80, stdev=64.61 lat (msec): min=141, max=296, avg=255.80, stdev=64.61 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 2031, max= 3976, per=88.44%, avg=2683.33, stdev=1119.50, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1306KiB/s (1338kB/s)(7168KiB/5487msec); 0 zone resets clat (msec): min=136, max=2654, avg=575.15, stdev=919.93 lat (msec): min=138, max=2658, avg=576.10, stdev=921.27 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 171], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 236], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 359], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1906, max= 4087, per=70.55%, avg=2996.25, stdev=1188.95, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=41.67%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=9.66%, ctx=182, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3034KiB/s (3107kB/s), 303KiB/s-1438KiB/s (311kB/s-1472kB/s), io=20.0MiB (20.0MB), run=4986-6750msec WRITE: bw=4248KiB/s (4350kB/s), 1027KiB/s-1517KiB/s (1052kB/s-1553kB/s), io=28.0MiB (29.4MB), run=4986-6750msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145505: Tue Sep 1 15:07:17 2026 read: IOPS=1, BW=1079KiB/s (1105kB/s)(7168KiB/6643msec) clat (msec): min=44, max=2819, avg=724.49, stdev=1009.42 lat (msec): min=44, max=2819, avg=724.49, stdev=1009.42 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 96], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 1053], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2035, max= 4096, per=79.54%, avg=2451.40, stdev=919.37, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 write: IOPS=0, BW=771KiB/s (789kB/s)(5120KiB/6643msec); 0 zone resets clat (msec): min=226, max=359, avg=291.34, stdev=53.05 lat (msec): min=226, max=360, avg=291.53, stdev=53.15 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2039, max= 3961, per=62.16%, avg=2682.67, stdev=1107.08, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.71%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145506: Tue Sep 1 15:07:17 2026 read: IOPS=0, BW=309KiB/s (316kB/s)(2048KiB/6628msec) clat (msec): min=106, max=123, avg=114.95, stdev=11.75 lat (msec): min=106, max=123, avg=114.95, stdev=11.75 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 124], | 70.00th=[ 124], 80.00th=[ 124], 90.00th=[ 124], 95.00th=[ 124], | 99.00th=[ 124], 99.50th=[ 124], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 1402, max= 2015, per=55.43%, avg=1708.50, stdev=433.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1545KiB/s (1582kB/s)(10.0MiB/6628msec); 0 zone resets clat (msec): min=130, max=3018, avg=626.20, stdev=870.08 lat (msec): min=130, max=3018, avg=626.27, stdev=870.09 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 159], | 30.00th=[ 222], 40.00th=[ 241], 50.00th=[ 251], 60.00th=[ 334], | 70.00th=[ 447], 80.00th=[ 609], 90.00th=[ 852], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 2035, max= 5941, per=74.52%, avg=3216.20, stdev=1751.05, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.10%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145507: Tue Sep 1 15:07:17 2026 read: IOPS=0, BW=946KiB/s (968kB/s)(6144KiB/6498msec) clat (msec): min=81, max=288, avg=193.91, stdev=77.61 lat (msec): min=81, max=288, avg=193.91, stdev=77.61 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 213], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1980, max= 4096, per=82.33%, avg=2537.50, stdev=1039.35, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=946KiB/s (968kB/s)(6144KiB/6498msec); 0 zone resets clat (msec): min=143, max=2997, avg=851.62, stdev=1068.14 lat (msec): min=143, max=2997, avg=851.71, stdev=1068.14 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 625], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1980, max= 4071, per=58.51%, avg=2525.25, stdev=1030.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.23%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145508: Tue Sep 1 15:07:17 2026 read: IOPS=0, BW=842KiB/s (862kB/s)(5120KiB/6080msec) clat (msec): min=69, max=721, avg=219.45, stdev=281.14 lat (msec): min=69, max=721, avg=219.45, stdev=281.14 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 104], 60.00th=[ 104], | 70.00th=[ 115], 80.00th=[ 115], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 4079, max= 4096, per=100.00%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1179KiB/s (1207kB/s)(7168KiB/6080msec); 0 zone resets clat (msec): min=207, max=2877, avg=671.42, stdev=977.32 lat (msec): min=207, max=2877, avg=671.81, stdev=977.20 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 232], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 296], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 493], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 2035, max= 4071, per=65.59%, avg=2830.80, stdev=1082.64, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.15%, ctx=142, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3083KiB/s (3157kB/s), 309KiB/s-1079KiB/s (316kB/s-1105kB/s), io=20.0MiB (20.0MB), run=6080-6643msec WRITE: bw=4316KiB/s (4420kB/s), 771KiB/s-1545KiB/s (789kB/s-1582kB/s), io=28.0MiB (29.4MB), run=6080-6643msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145518: Tue Sep 1 15:07:33 2026 read: IOPS=1, BW=4804KiB/s (4919kB/s)(12.0MiB/2558msec) clat (msec): min=712, max=873, avg=811.57, stdev=86.79 lat (msec): min=712, max=873, avg=811.57, stdev=86.79 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8015, max= 8192, per=100.00%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=9.82%, ctx=172, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145520: Tue Sep 1 15:07:33 2026 read: IOPS=0, BW=1306KiB/s (1337kB/s)(4096KiB/3137msec) clat (nsec): min=861387k, max=861387k, avg=861387286.00, stdev= 0.00 lat (nsec): min=861389k, max=861389k, avg=861389483.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2611KiB/s (2674kB/s)(8192KiB/3137msec); 0 zone resets clat (msec): min=830, max=1335, avg=1083.19, stdev=356.79 lat (msec): min=831, max=1335, avg=1083.92, stdev=356.37 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8143, max= 8143, per=90.88%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.26%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145521: Tue Sep 1 15:07:33 2026 write: IOPS=0, BW=3360KiB/s (3441kB/s)(12.0MiB/3657msec); 0 zone resets clat (msec): min=351, max=1662, avg=1188.95, stdev=727.74 lat (msec): min=351, max=1663, avg=1189.38, stdev=727.76 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8143, max= 8143, per=90.88%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.08%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145523: Tue Sep 1 15:07:33 2026 write: IOPS=1, BW=5001KiB/s (5121kB/s)(12.0MiB/2457msec); 0 zone resets clat (msec): min=551, max=1054, avg=782.23, stdev=254.31 lat (msec): min=552, max=1055, avg=783.18, stdev=253.74 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8015, max= 8143, per=90.17%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.36%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5223KiB/s (5348kB/s), 1306KiB/s-4804KiB/s (1337kB/s-4919kB/s), io=16.0MiB (16.8MB), run=2558-3137msec WRITE: bw=8960KiB/s (9175kB/s), 2611KiB/s-5001KiB/s (2674kB/s-5121kB/s), io=32.0MiB (33.6MB), run=2457-3657msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145516: Tue Sep 1 15:07:34 2026 read: IOPS=1, BW=4128KiB/s (4227kB/s)(12.0MiB/2977msec) clat (msec): min=373, max=1257, avg=949.98, stdev=499.19 lat (msec): min=374, max=1257, avg=949.98, stdev=499.19 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.56%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145517: Tue Sep 1 15:07:34 2026 read: IOPS=0, BW=1072KiB/s (1097kB/s)(4096KiB/3822msec) clat (nsec): min=1335.6M, max=1335.6M, avg=1335596396.00, stdev= 0.00 lat (nsec): min=1335.6M, max=1335.6M, avg=1335598515.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1334], 5.00th=[ 1334], 10.00th=[ 1334], 20.00th=[ 1334], | 30.00th=[ 1334], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2143KiB/s (2195kB/s)(8192KiB/3822msec); 0 zone resets clat (msec): min=769, max=1665, avg=1217.87, stdev=633.57 lat (msec): min=771, max=1666, avg=1218.74, stdev=632.62 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8047, max= 8047, per=93.86%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.64%, ctx=38, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145519: Tue Sep 1 15:07:34 2026 write: IOPS=1, BW=7670KiB/s (7855kB/s)(12.0MiB/1602msec); 0 zone resets clat (msec): min=341, max=617, avg=515.36, stdev=151.04 lat (msec): min=342, max=618, avg=515.87, stdev=150.77 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 6564, max= 8047, per=85.22%, avg=7305.50, stdev=1048.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=6.50%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145522: Tue Sep 1 15:07:34 2026 write: IOPS=1, BW=5242KiB/s (5368kB/s)(12.0MiB/2344msec); 0 zone resets clat (msec): min=465, max=934, avg=715.20, stdev=235.70 lat (msec): min=468, max=934, avg=716.29, stdev=234.69 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 5468, max= 8192, per=79.67%, avg=6830.00, stdev=1926.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=4.91%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4287KiB/s (4390kB/s), 1072KiB/s-4128KiB/s (1097kB/s-4227kB/s), io=16.0MiB (16.8MB), run=2977-3822msec WRITE: bw=8574KiB/s (8779kB/s), 2143KiB/s-7670KiB/s (2195kB/s-7855kB/s), io=32.0MiB (33.6MB), run=1602-3822msec