== sanity test 398b: DIO and buffer IO race ============== 09:38:56 (1788183536) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.32045 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144513: Mon Aug 31 09:41:36 2026 read: IOPS=10, BW=42.6KiB/s (43.6kB/s)(5992KiB/140587msec) clat (usec): min=30, max=908803, avg=46550.34, stdev=41903.66 lat (usec): min=30, max=908805, avg=46556.21, stdev=41902.18 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 10945], 20.00th=[ 21103], | 30.00th=[ 26870], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[166724], 99.50th=[200279], 99.90th=[434111], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 103, per=24.93%, avg=42.38, stdev=20.35, samples=274 iops : min= 1, max= 25, avg= 9.95, stdev= 5.12, samples=274 write: IOPS=11, BW=44.8KiB/s (45.9kB/s)(6296KiB/140587msec); 0 zone resets clat (usec): min=1101, max=498207, avg=44910.36, stdev=46821.14 lat (usec): min=1101, max=498209, avg=44924.21, stdev=46824.47 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1418], 10.00th=[ 2147], 20.00th=[ 5080], | 30.00th=[ 10814], 40.00th=[ 21627], 50.00th=[ 34341], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[103285], 95.00th=[131597], | 99.00th=[214959], 99.50th=[240124], 99.90th=[320865], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 167, per=24.98%, avg=44.46, stdev=21.64, samples=275 iops : min= 1, max= 41, avg=10.47, stdev= 5.44, samples=275 lat (usec) : 50=0.62%, 100=3.52%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.75%, 4=3.61%, 10=6.93%, 20=8.98%, 50=35.45% lat (msec) : 100=27.05%, 250=8.50%, 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=4.90%, ctx=6767, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144514: Mon Aug 31 09:41:36 2026 read: IOPS=10, BW=42.7KiB/s (43.8kB/s)(5940KiB/138960msec) clat (usec): min=24, max=751045, avg=46035.54, stdev=39816.88 lat (usec): min=24, max=751047, avg=46036.83, stdev=39816.88 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 10421], 20.00th=[ 19792], | 30.00th=[ 26084], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[168821], 99.50th=[214959], 99.90th=[320865], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 103, per=25.31%, avg=43.03, stdev=20.23, samples=269 iops : min= 1, max= 25, avg=10.10, stdev= 5.08, samples=269 write: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6348KiB/138960msec); 0 zone resets clat (usec): min=1079, max=425751, avg=44371.56, stdev=46912.37 lat (usec): min=1080, max=425753, avg=44374.67, stdev=46913.61 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1434], 10.00th=[ 2278], 20.00th=[ 4948], | 30.00th=[ 9896], 40.00th=[ 21103], 50.00th=[ 32375], 60.00th=[ 43779], | 70.00th=[ 56886], 80.00th=[ 76022], 90.00th=[101188], 95.00th=[135267], | 99.00th=[212861], 99.50th=[248513], 99.90th=[346031], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 120, per=25.64%, avg=45.64, stdev=22.36, samples=271 iops : min= 1, max= 30, avg=10.76, stdev= 5.63, samples=271 lat (usec) : 50=0.39%, 100=3.68%, 250=0.26%, 500=0.07% lat (msec) : 2=4.46%, 4=4.23%, 10=7.32%, 20=9.54%, 50=34.67% lat (msec) : 100=26.73%, 250=8.30%, 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=4.81%, ctx=6571, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144515: Mon Aug 31 09:41:36 2026 read: IOPS=10, BW=43.3KiB/s (44.3kB/s)(6028KiB/139329msec) clat (usec): min=33, max=281079, avg=43903.42, stdev=35024.93 lat (usec): min=34, max=281080, avg=43912.34, stdev=35017.90 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 118], 20.00th=[ 19530], | 30.00th=[ 25035], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[170918], 99.50th=[189793], 99.90th=[278922], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 126, per=25.50%, avg=43.36, stdev=23.06, samples=271 iops : min= 1, max= 31, avg=10.19, stdev= 5.81, samples=271 write: IOPS=11, BW=44.9KiB/s (46.0kB/s)(6260KiB/139329msec); 0 zone resets clat (usec): min=1195, max=831189, avg=46595.95, stdev=54837.79 lat (usec): min=1197, max=831190, avg=46600.15, stdev=54838.09 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1418], 10.00th=[ 2057], 20.00th=[ 5080], | 30.00th=[ 9634], 40.00th=[ 18744], 50.00th=[ 32113], 60.00th=[ 46400], | 70.00th=[ 60031], 80.00th=[ 78119], 90.00th=[107480], 95.00th=[137364], | 99.00th=[225444], 99.50th=[299893], 99.90th=[566232], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 96, per=25.20%, avg=44.86, stdev=19.94, samples=272 iops : min= 1, max= 24, avg=10.57, stdev= 5.03, samples=272 lat (usec) : 50=0.72%, 100=3.91%, 250=0.49%, 500=0.23%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.05%, 4=3.87%, 10=7.03%, 20=9.83%, 50=34.41% lat (msec) : 100=25.26%, 250=8.56%, 500=0.46%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=4.60%, ctx=6602, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144516: Mon Aug 31 09:41:36 2026 read: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6052KiB/138846msec) clat (usec): min=32, max=331009, avg=45494.24, stdev=37049.80 lat (usec): min=33, max=331011, avg=45495.72, stdev=37050.01 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 1074], 20.00th=[ 20317], | 30.00th=[ 26346], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[109577], | 99.00th=[179307], 99.50th=[248513], 99.90th=[325059], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 120, per=25.84%, avg=43.93, stdev=20.77, samples=269 iops : min= 1, max= 30, avg=10.33, stdev= 5.23, samples=269 write: IOPS=11, BW=44.9KiB/s (45.0kB/s)(6236KiB/138846msec); 0 zone resets clat (usec): min=1126, max=841594, avg=44799.09, stdev=50987.80 lat (usec): min=1126, max=841597, avg=44801.89, stdev=50987.39 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1401], 10.00th=[ 1975], 20.00th=[ 4555], | 30.00th=[ 9110], 40.00th=[ 19268], 50.00th=[ 31851], 60.00th=[ 42730], | 70.00th=[ 57410], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[135267], | 99.00th=[225444], 99.50th=[261096], 99.90th=[295699], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 7, max= 112, per=25.53%, avg=45.44, stdev=21.97, samples=268 iops : min= 1, max= 28, avg=10.71, stdev= 5.54, samples=268 lat (usec) : 50=0.62%, 100=3.74%, 250=0.36%, 500=0.10%, 750=0.10% lat (msec) : 2=5.24%, 4=4.07%, 10=6.87%, 20=8.98%, 50=35.51% lat (msec) : 100=25.33%, 250=8.56%, 500=0.49%, 1000=0.03% cpu : usr=0.08%, sys=4.61%, ctx=6618, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.6KiB/s-43.6KiB/s (43.6kB/s-44.6kB/s), io=23.4MiB (24.6MB), run=138846-140587msec WRITE: bw=179KiB/s (183kB/s), 44.8KiB/s-45.7KiB/s (45.9kB/s-46.8kB/s), io=24.6MiB (25.7MB), run=138846-140587msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144508: Mon Aug 31 09:43:54 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(5992KiB/277732msec) clat (msec): min=5, max=1006, avg=37.70, stdev=43.30 lat (msec): min=5, max=1006, avg=37.70, stdev=43.30 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 186], 99.50th=[ 215], 99.90th=[ 268], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 103, per=28.54%, avg=24.54, stdev=17.19, samples=472 iops : min= 1, max= 25, avg= 5.51, stdev= 4.35, samples=472 write: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6296KiB/277732msec); 0 zone resets clat (msec): min=37, max=783, avg=140.31, stdev=78.98 lat (msec): min=37, max=783, avg=140.32, stdev=78.98 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 155], 80.00th=[ 186], 90.00th=[ 236], 95.00th=[ 292], | 99.00th=[ 435], 99.50th=[ 514], 99.90th=[ 642], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 62, per=25.11%, avg=22.60, stdev=11.11, samples=536 iops : min= 1, max= 15, avg= 5.02, stdev= 2.86, samples=536 lat (msec) : 10=2.99%, 20=16.02%, 50=19.95%, 100=24.64%, 250=32.06% lat (msec) : 500=4.00%, 750=0.26%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.29%, ctx=5367, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144509: Mon Aug 31 09:43:54 2026 read: IOPS=5, BW=21.3KiB/s (21.8kB/s)(5940KiB/278963msec) clat (msec): min=5, max=856, avg=38.53, stdev=46.56 lat (msec): min=5, max=856, avg=38.53, stdev=46.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 81], 95.00th=[ 116], | 99.00th=[ 192], 99.50th=[ 271], 99.90th=[ 642], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 111, per=28.58%, avg=24.58, stdev=17.62, samples=466 iops : min= 1, max= 27, avg= 5.52, stdev= 4.45, samples=466 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6348KiB/278963msec); 0 zone resets clat (msec): min=39, max=637, avg=139.46, stdev=74.09 lat (msec): min=39, max=637, avg=139.47, stdev=74.09 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 188], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 393], 99.50th=[ 498], 99.90th=[ 609], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 48, per=25.29%, avg=22.76, stdev=10.82, samples=536 iops : min= 1, max= 12, avg= 5.06, stdev= 2.79, samples=536 lat (msec) : 10=2.80%, 20=16.60%, 50=19.27%, 100=24.77%, 250=32.13% lat (msec) : 500=4.13%, 750=0.26%, 1000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=5417, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144510: Mon Aug 31 09:43:54 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6028KiB/278066msec) clat (msec): min=6, max=496, avg=39.48, stdev=41.98 lat (msec): min=6, max=496, avg=39.48, stdev=41.98 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 203], 99.50th=[ 266], 99.90th=[ 439], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7, max= 119, per=27.90%, avg=23.99, stdev=16.61, samples=485 iops : min= 1, max= 29, avg= 5.37, stdev= 4.21, samples=485 write: IOPS=5, BW=22.5KiB/s (23.1kB/s)(6260KiB/278066msec); 0 zone resets clat (msec): min=39, max=941, avg=139.38, stdev=76.17 lat (msec): min=39, max=941, avg=139.38, stdev=76.17 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 234], 95.00th=[ 284], | 99.00th=[ 418], 99.50th=[ 477], 99.90th=[ 651], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 55, per=24.98%, avg=22.48, stdev=11.31, samples=536 iops : min= 1, max= 13, avg= 4.99, stdev= 2.92, samples=536 lat (msec) : 10=2.96%, 20=15.79%, 50=19.47%, 100=25.94%, 250=31.28% lat (msec) : 500=4.43%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.35%, ctx=5492, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144511: Mon Aug 31 09:43:54 2026 read: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6052KiB/276165msec) clat (msec): min=5, max=640, avg=38.70, stdev=42.56 lat (msec): min=5, max=640, avg=38.71, stdev=42.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 86], 95.00th=[ 120], | 99.00th=[ 180], 99.50th=[ 259], 99.90th=[ 443], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 88, per=28.86%, avg=24.82, stdev=17.75, samples=471 iops : min= 1, max= 22, avg= 5.58, stdev= 4.52, samples=471 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6236KiB/276165msec); 0 zone resets clat (msec): min=34, max=941, avg=139.33, stdev=76.25 lat (msec): min=34, max=941, avg=139.33, stdev=76.24 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 155], 80.00th=[ 184], 90.00th=[ 234], 95.00th=[ 292], | 99.00th=[ 405], 99.50th=[ 447], 99.90th=[ 659], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 54, per=24.77%, avg=22.30, stdev=11.29, samples=538 iops : min= 1, max= 13, avg= 4.94, stdev= 2.90, samples=538 lat (msec) : 10=3.58%, 20=16.50%, 50=18.88%, 100=24.77%, 250=31.80% lat (msec) : 500=4.26%, 750=0.16%, 1000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5524, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.1KiB/s (88.1kB/s), 21.3KiB/s-21.9KiB/s (21.8kB/s-22.4kB/s), io=23.4MiB (24.6MB), run=276165-278963msec WRITE: bw=90.1KiB/s (92.3kB/s), 22.5KiB/s-22.8KiB/s (23.1kB/s-23.3kB/s), io=24.6MiB (25.7MB), run=276165-278963msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144571: Mon Aug 31 09:44:31 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(5920KiB/28595msec) clat (usec): min=47, max=211243, avg=40189.92, stdev=29934.16 lat (usec): min=48, max=211244, avg=40191.81, stdev=29934.06 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 17695], | 30.00th=[ 24773], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[164627], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 379, per=25.07%, avg=209.84, stdev=74.92, samples=55 iops : min= 1, max= 23, avg=12.36, stdev= 4.74, samples=55 write: IOPS=13, BW=223KiB/s (228kB/s)(6368KiB/28595msec); 0 zone resets clat (usec): min=1532, max=452468, avg=34280.75, stdev=43111.11 lat (usec): min=1533, max=452470, avg=34288.24, stdev=43108.43 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1926], 10.00th=[ 3294], 20.00th=[ 5538], | 30.00th=[ 8455], 40.00th=[ 12780], 50.00th=[ 20579], 60.00th=[ 28967], | 70.00th=[ 43254], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[103285], | 99.00th=[170918], 99.50th=[387974], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 61, max= 448, per=25.25%, avg=222.46, stdev=89.91, samples=56 iops : min= 3, max= 28, avg=13.16, stdev= 5.70, samples=56 lat (usec) : 50=0.26%, 100=6.25%, 250=0.52%, 750=0.13% lat (msec) : 2=3.12%, 4=4.82%, 10=10.55%, 20=10.68%, 50=36.59% lat (msec) : 100=22.79%, 250=4.04%, 500=0.26% cpu : usr=0.09%, sys=6.12%, ctx=1576, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144572: Mon Aug 31 09:44:31 2026 read: IOPS=12, BW=208KiB/s (212kB/s)(5744KiB/27681msec) clat (usec): min=39, max=311323, avg=42322.62, stdev=38636.22 lat (usec): min=39, max=311324, avg=42323.97, stdev=38636.23 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 71], 20.00th=[ 18482], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 49546], 80.00th=[ 58983], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[206570], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 58, max= 383, per=24.63%, avg=206.13, stdev=82.44, samples=54 iops : min= 3, max= 23, avg=12.15, stdev= 5.21, samples=54 write: IOPS=14, BW=236KiB/s (242kB/s)(6544KiB/27681msec); 0 zone resets clat (usec): min=1548, max=176126, avg=30143.22, stdev=31689.35 lat (usec): min=1550, max=176128, avg=30145.40, stdev=31689.33 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1926], 10.00th=[ 2835], 20.00th=[ 5211], | 30.00th=[ 7767], 40.00th=[ 11207], 50.00th=[ 16319], 60.00th=[ 26608], | 70.00th=[ 38011], 80.00th=[ 54264], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[130548], 99.50th=[158335], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 542, per=26.67%, avg=235.00, stdev=122.39, samples=54 iops : min= 1, max= 33, avg=13.98, stdev= 7.75, samples=54 lat (usec) : 50=0.52%, 100=5.34%, 250=0.65%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.99%, 4=5.60%, 10=11.85%, 20=10.42%, 50=36.72% lat (msec) : 100=22.14%, 250=3.12%, 500=0.39% cpu : usr=0.08%, sys=6.13%, ctx=1504, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144573: Mon Aug 31 09:44:31 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(6256KiB/28081msec) clat (usec): min=32, max=486606, avg=39940.96, stdev=40101.76 lat (usec): min=33, max=486607, avg=39950.10, stdev=40095.81 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 11600], | 30.00th=[ 22938], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 80217], 95.00th=[ 93848], | 99.00th=[158335], 99.50th=[295699], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 30, max= 563, per=26.72%, avg=223.67, stdev=104.15, samples=55 iops : min= 1, max= 35, avg=13.25, stdev= 6.59, samples=55 write: IOPS=13, BW=215KiB/s (220kB/s)(6032KiB/28081msec); 0 zone resets clat (usec): min=1664, max=210979, avg=32596.18, stdev=34049.00 lat (usec): min=1666, max=210980, avg=32602.14, stdev=34052.07 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2180], 10.00th=[ 3392], 20.00th=[ 5669], | 30.00th=[ 7963], 40.00th=[ 13698], 50.00th=[ 22152], 60.00th=[ 28705], | 70.00th=[ 40633], 80.00th=[ 56361], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[156238], 99.50th=[196084], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 30, max= 433, per=24.59%, avg=216.63, stdev=93.04, samples=54 iops : min= 1, max= 27, avg=12.81, stdev= 5.91, samples=54 lat (usec) : 50=0.52%, 100=7.16%, 250=1.30%, 750=0.39%, 1000=0.13% lat (msec) : 2=1.56%, 4=5.21%, 10=11.72%, 20=7.68%, 50=37.50% lat (msec) : 100=22.40%, 250=4.17%, 500=0.26% cpu : usr=0.09%, sys=5.71%, ctx=1562, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144574: Mon Aug 31 09:44:31 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(6032KiB/27173msec) clat (usec): min=37, max=263250, avg=39307.10, stdev=35657.62 lat (usec): min=38, max=263251, avg=39356.24, stdev=35699.86 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 180], | 30.00th=[ 23725], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[189793], 99.50th=[242222], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 63, max= 382, per=26.89%, avg=225.08, stdev=80.92, samples=52 iops : min= 3, max= 23, avg=13.33, stdev= 5.06, samples=52 write: IOPS=14, BW=230KiB/s (236kB/s)(6256KiB/27173msec); 0 zone resets clat (usec): min=1592, max=343104, avg=31116.78, stdev=35896.65 lat (usec): min=1595, max=343107, avg=31119.41, stdev=35896.73 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2474], 10.00th=[ 3654], 20.00th=[ 5735], | 30.00th=[ 8291], 40.00th=[ 10945], 50.00th=[ 18482], 60.00th=[ 28967], | 70.00th=[ 39060], 80.00th=[ 51643], 90.00th=[ 70779], 95.00th=[ 92799], | 99.00th=[147850], 99.50th=[263193], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 61, max= 447, per=26.11%, avg=230.04, stdev=85.14, samples=53 iops : min= 3, max= 27, avg=13.66, stdev= 5.37, samples=53 lat (usec) : 50=0.78%, 100=8.07%, 250=1.17%, 500=0.39% lat (msec) : 2=1.30%, 4=4.82%, 10=12.63%, 20=9.38%, 50=36.85% lat (msec) : 100=20.57%, 250=3.65%, 500=0.39% cpu : usr=0.06%, sys=6.08%, ctx=1579, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=838KiB/s (858kB/s), 207KiB/s-223KiB/s (212kB/s-228kB/s), io=23.4MiB (24.5MB), run=27173-28595msec WRITE: bw=881KiB/s (902kB/s), 215KiB/s-236KiB/s (220kB/s-242kB/s), io=24.6MiB (25.8MB), run=27173-28595msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144576: Mon Aug 31 09:45:12 2026 read: IOPS=5, BW=85.8KiB/s (87.9kB/s)(5920KiB/69000msec) clat (msec): min=7, max=304, avg=39.54, stdev=32.10 lat (msec): min=7, max=304, avg=39.55, stdev=32.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 70], 95.00th=[ 111], | 99.00th=[ 159], 99.50th=[ 213], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 287, per=27.51%, avg=95.19, stdev=58.57, samples=122 iops : min= 1, max= 17, avg= 5.20, stdev= 3.75, samples=122 write: IOPS=5, BW=92.3KiB/s (94.5kB/s)(6368KiB/69000msec); 0 zone resets clat (msec): min=45, max=574, avg=136.44, stdev=73.31 lat (msec): min=45, max=574, avg=136.44, stdev=73.31 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 116], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 232], 95.00th=[ 279], | 99.00th=[ 451], 99.50th=[ 542], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 21, max= 192, per=25.64%, avg=93.34, stdev=40.13, samples=134 iops : min= 1, max= 12, avg= 5.08, stdev= 2.60, samples=134 lat (msec) : 10=0.91%, 20=10.42%, 50=27.08%, 100=24.35%, 250=33.72% lat (msec) : 500=3.12%, 750=0.39% cpu : usr=0.06%, sys=1.55%, ctx=1455, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144577: Mon Aug 31 09:45:12 2026 read: IOPS=5, BW=83.2KiB/s (85.2kB/s)(5744KiB/69054msec) clat (msec): min=6, max=281, avg=40.89, stdev=35.35 lat (msec): min=6, max=281, avg=40.89, stdev=35.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 80], 95.00th=[ 114], | 99.00th=[ 180], 99.50th=[ 226], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 21, max= 380, per=27.48%, avg=95.09, stdev=59.07, samples=118 iops : min= 1, max= 23, avg= 5.19, stdev= 3.75, samples=118 write: IOPS=5, BW=94.8KiB/s (97.0kB/s)(6544KiB/69054msec); 0 zone resets clat (msec): min=40, max=513, avg=132.84, stdev=63.61 lat (msec): min=40, max=513, avg=132.84, stdev=63.61 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 249], | 99.00th=[ 351], 99.50th=[ 368], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 31, max= 192, per=26.66%, avg=97.05, stdev=40.41, samples=132 iops : min= 1, max= 12, avg= 5.31, stdev= 2.65, samples=132 lat (msec) : 10=1.69%, 20=11.07%, 50=23.18%, 100=27.34%, 250=33.98% lat (msec) : 500=2.60%, 750=0.13% cpu : usr=0.04%, sys=1.55%, ctx=1453, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144578: Mon Aug 31 09:45:12 2026 read: IOPS=5, BW=93.3KiB/s (95.5kB/s)(6256KiB/67071msec) clat (msec): min=6, max=221, avg=37.18, stdev=28.32 lat (msec): min=6, max=221, avg=37.18, stdev=28.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 87], | 99.00th=[ 176], 99.50th=[ 188], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 288, per=29.78%, avg=103.04, stdev=63.98, samples=120 iops : min= 1, max= 18, avg= 5.71, stdev= 4.06, samples=120 write: IOPS=5, BW=89.9KiB/s (92.1kB/s)(6032KiB/67071msec); 0 zone resets clat (msec): min=37, max=405, avg=139.16, stdev=70.39 lat (msec): min=37, max=405, avg=139.17, stdev=70.39 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 87], | 30.00th=[ 96], 40.00th=[ 106], 50.00th=[ 117], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 190], 90.00th=[ 239], 95.00th=[ 305], | 99.00th=[ 363], 99.50th=[ 376], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 190, per=24.56%, avg=89.39, stdev=40.74, samples=133 iops : min= 1, max= 11, avg= 4.84, stdev= 2.64, samples=133 lat (msec) : 10=1.30%, 20=10.94%, 50=29.17%, 100=24.22%, 250=30.08% lat (msec) : 500=4.30% cpu : usr=0.07%, sys=1.60%, ctx=1621, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144579: Mon Aug 31 09:45:12 2026 read: IOPS=5, BW=88.4KiB/s (90.5kB/s)(6032KiB/68273msec) clat (msec): min=8, max=471, avg=40.51, stdev=41.39 lat (msec): min=8, max=471, avg=40.51, stdev=41.39 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 74], 95.00th=[ 108], | 99.00th=[ 203], 99.50th=[ 284], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 31, max= 347, per=29.64%, avg=102.57, stdev=64.04, samples=115 iops : min= 1, max= 21, avg= 5.68, stdev= 4.06, samples=115 write: IOPS=5, BW=91.6KiB/s (93.8kB/s)(6256KiB/68273msec); 0 zone resets clat (msec): min=47, max=578, avg=135.35, stdev=66.30 lat (msec): min=47, max=578, avg=135.36, stdev=66.30 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 89], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 224], 95.00th=[ 262], | 99.00th=[ 368], 99.50th=[ 498], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 31, max= 160, per=25.81%, avg=93.94, stdev=38.16, samples=131 iops : min= 1, max= 10, avg= 5.14, stdev= 2.45, samples=131 lat (msec) : 10=0.78%, 20=12.63%, 50=24.87%, 100=25.39%, 250=32.55% lat (msec) : 500=3.65%, 750=0.13% cpu : usr=0.05%, sys=1.47%, ctx=1456, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=347KiB/s (355kB/s), 83.2KiB/s-93.3KiB/s (85.2kB/s-95.5kB/s), io=23.4MiB (24.5MB), run=67071-69054msec WRITE: bw=365KiB/s (374kB/s), 89.9KiB/s-94.8KiB/s (92.1kB/s-97.0kB/s), io=24.6MiB (25.8MB), run=67071-69054msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144606: Mon Aug 31 09:45:29 2026 read: IOPS=1, BW=1449KiB/s (1484kB/s)(7168KiB/4946msec) clat (msec): min=102, max=378, avg=187.84, stdev=100.64 lat (msec): min=102, max=378, avg=187.84, stdev=100.64 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 105], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 144], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 255], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2043, max= 4106, per=79.62%, avg=2561.25, stdev=1029.84, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=1, BW=1035KiB/s (1060kB/s)(5120KiB/4946msec); 0 zone resets clat (msec): min=247, max=2380, avg=706.62, stdev=936.31 lat (msec): min=247, max=2380, avg=706.71, stdev=936.31 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1368, max= 2048, per=41.25%, avg=1857.75, stdev=328.07, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=50.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.54%, ctx=79, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144607: Mon Aug 31 09:45:29 2026 read: IOPS=0, BW=322KiB/s (329kB/s)(2048KiB/6365msec) clat (msec): min=144, max=237, avg=191.15, stdev=65.66 lat (msec): min=144, max=237, avg=191.16, stdev=65.66 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 2031, max= 2039, per=63.26%, avg=2035.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1609KiB/s (1647kB/s)(10.0MiB/6365msec); 0 zone resets clat (msec): min=170, max=2373, avg=586.92, stdev=662.17 lat (msec): min=170, max=2373, avg=587.11, stdev=662.13 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 201], | 30.00th=[ 224], 40.00th=[ 264], 50.00th=[ 266], 60.00th=[ 363], | 70.00th=[ 567], 80.00th=[ 693], 90.00th=[ 760], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1996, max= 6000, per=67.22%, avg=3027.50, stdev=1663.05, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.38%, ctx=90, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144608: Mon Aug 31 09:45:29 2026 read: IOPS=1, BW=1189KiB/s (1218kB/s)(6144KiB/5166msec) clat (msec): min=88, max=532, avg=315.91, stdev=154.75 lat (msec): min=88, max=532, avg=315.91, stdev=154.75 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 321], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2039, max= 3992, per=78.63%, avg=2529.50, stdev=975.01, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1189KiB/s (1218kB/s)(6144KiB/5166msec); 0 zone resets clat (msec): min=217, max=1737, avg=537.88, stdev=600.99 lat (msec): min=218, max=1737, avg=538.01, stdev=600.98 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 264], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1988, max= 4039, per=53.87%, avg=2426.40, stdev=901.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=2.54%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144609: Mon Aug 31 09:45:29 2026 read: IOPS=0, BW=916KiB/s (938kB/s)(5120KiB/5587msec) clat (msec): min=117, max=205, avg=157.34, stdev=43.17 lat (msec): min=117, max=205, avg=157.34, stdev=43.17 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 136], 60.00th=[ 136], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 2039, max= 5930, per=100.00%, avg=3984.50, stdev=2751.35, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1283KiB/s (1314kB/s)(7168KiB/5587msec); 0 zone resets clat (msec): min=184, max=2316, avg=678.70, stdev=754.71 lat (msec): min=184, max=2316, avg=678.82, stdev=754.71 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 292], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 359], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 869], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2048, max= 4087, per=61.80%, avg=2783.50, stdev=967.66, samples=4 iops : min= 2, max= 3, avg= 2.25, stdev= 0.50, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.61%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3218KiB/s (3295kB/s), 322KiB/s-1449KiB/s (329kB/s-1484kB/s), io=20.0MiB (20.0MB), run=4946-6365msec WRITE: bw=4505KiB/s (4613kB/s), 1035KiB/s-1609KiB/s (1060kB/s-1647kB/s), io=28.0MiB (29.4MB), run=4946-6365msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144611: Mon Aug 31 09:45:29 2026 read: IOPS=1, BW=1608KiB/s (1647kB/s)(7168KiB/4457msec) clat (usec): min=1891, max=1898.2k, avg=442846.78, stdev=650690.75 lat (usec): min=1893, max=1898.2k, avg=442848.35, stdev=650690.71 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 1893], 10.00th=[ 1893], | 20.00th=[ 175113], 30.00th=[ 179307], 40.00th=[ 179307], | 50.00th=[ 229639], 60.00th=[ 261096], 70.00th=[ 261096], | 80.00th=[ 354419], 90.00th=[1904215], 95.00th=[1904215], | 99.00th=[1904215], 99.50th=[1904215], 99.90th=[1904215], | 99.95th=[1904215], 99.99th=[1904215] bw ( KiB/s): min= 2035, max= 3915, per=85.62%, avg=3002.00, stdev=941.16, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1149KiB/s (1176kB/s)(5120KiB/4457msec); 0 zone resets clat (msec): min=116, max=572, avg=270.84, stdev=177.43 lat (msec): min=116, max=572, avg=270.97, stdev=177.45 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1969, max= 4071, per=54.83%, avg=2691.67, stdev=1194.99, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.04%, sys=12.88%, ctx=378, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144612: Mon Aug 31 09:45:29 2026 read: IOPS=0, BW=351KiB/s (359kB/s)(2048KiB/5840msec) clat (msec): min=105, max=165, avg=135.52, stdev=42.61 lat (msec): min=105, max=165, avg=135.52, stdev=42.61 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 165], 95.00th=[ 165], | 99.00th=[ 165], 99.50th=[ 165], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 1462, max= 2035, per=49.87%, avg=1748.50, stdev=405.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1753KiB/s (1796kB/s)(10.0MiB/5840msec); 0 zone resets clat (msec): min=111, max=2377, avg=556.55, stdev=696.15 lat (msec): min=111, max=2378, avg=556.75, stdev=696.15 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 133], | 30.00th=[ 159], 40.00th=[ 167], 50.00th=[ 194], 60.00th=[ 241], | 70.00th=[ 600], 80.00th=[ 718], 90.00th=[ 869], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1961, max= 6107, per=61.76%, avg=3031.83, stdev=1722.79, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=66.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.26%, ctx=126, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144613: Mon Aug 31 09:45:29 2026 read: IOPS=1, BW=1164KiB/s (1192kB/s)(6144KiB/5277msec) clat (usec): min=694, max=338835, avg=101502.04, stdev=135424.01 lat (usec): min=696, max=338836, avg=101503.90, stdev=135423.76 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 799], | 30.00th=[ 799], 40.00th=[ 1106], 50.00th=[ 1106], 60.00th=[ 95945], | 70.00th=[170918], 80.00th=[170918], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 1961, max= 3938, per=93.31%, avg=3271.33, stdev=1134.84, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1164KiB/s (1192kB/s)(6144KiB/5277msec); 0 zone resets clat (msec): min=230, max=2168, avg=776.58, stdev=714.45 lat (msec): min=230, max=2168, avg=776.75, stdev=714.41 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 684], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1526, max= 2035, per=38.93%, avg=1911.17, stdev=191.44, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.54%, ctx=169, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144614: Mon Aug 31 09:45:29 2026 read: IOPS=0, BW=1015KiB/s (1039kB/s)(5120KiB/5046msec) clat (usec): min=604, max=382781, avg=129483.27, stdev=181170.35 lat (usec): min=605, max=382783, avg=129484.53, stdev=181170.30 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 1029], 40.00th=[ 1029], 50.00th=[ 1090], 60.00th=[ 1090], | 70.00th=[261096], 80.00th=[261096], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1421KiB/s (1455kB/s)(7168KiB/5046msec); 0 zone resets clat (msec): min=130, max=2278, avg=627.62, stdev=755.00 lat (msec): min=131, max=2278, avg=627.74, stdev=754.99 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 144], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 359], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1539, max= 2035, per=38.55%, avg=1892.20, stdev=199.98, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=16.67%, 250=16.67%, 500=33.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=9.55%, ctx=125, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3507KiB/s (3591kB/s), 351KiB/s-1608KiB/s (359kB/s-1647kB/s), io=20.0MiB (20.0MB), run=4457-5840msec WRITE: bw=4910KiB/s (5027kB/s), 1149KiB/s-1753KiB/s (1176kB/s-1796kB/s), io=28.0MiB (29.4MB), run=4457-5840msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144622: Mon Aug 31 09:45:41 2026 read: IOPS=0, BW=3961KiB/s (4056kB/s)(12.0MiB/3102msec) clat (msec): min=223, max=1329, avg=935.20, stdev=617.55 lat (msec): min=223, max=1329, avg=935.20, stdev=617.55 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.45%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144623: Mon Aug 31 09:45:41 2026 read: IOPS=0, BW=2438KiB/s (2497kB/s)(4096KiB/1680msec) clat (nsec): min=237705k, max=237705k, avg=237705114.00, stdev= 0.00 lat (nsec): min=237716k, max=237716k, avg=237716216.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4876KiB/s (4993kB/s)(8192KiB/1680msec); 0 zone resets clat (msec): min=463, max=650, avg=556.64, stdev=132.26 lat (msec): min=463, max=650, avg=557.16, stdev=132.22 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8000, max= 8000, per=59.59%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=10.78%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144624: Mon Aug 31 09:45:41 2026 write: IOPS=1, BW=7425KiB/s (7603kB/s)(12.0MiB/1655msec); 0 zone resets clat (msec): min=349, max=548, avg=460.96, stdev=101.70 lat (msec): min=349, max=550, avg=462.29, stdev=102.72 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8047, max= 8047, per=59.94%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.12%, sys=8.52%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144625: Mon Aug 31 09:45:41 2026 write: IOPS=1, BW=5034KiB/s (5155kB/s)(12.0MiB/2441msec); 0 zone resets clat (msec): min=319, max=1408, avg=706.32, stdev=609.22 lat (msec): min=320, max=1409, avg=707.27, stdev=609.58 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7984, max= 8000, per=59.54%, avg=7992.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=5.04%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5282KiB/s (5409kB/s), 2438KiB/s-3961KiB/s (2497kB/s-4056kB/s), io=16.0MiB (16.8MB), run=1680-3102msec WRITE: bw=13.1MiB/s (13.7MB/s), 4876KiB/s-7425KiB/s (4993kB/s-7603kB/s), io=32.0MiB (33.6MB), run=1655-2441msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144626: Mon Aug 31 09:45:42 2026 read: IOPS=1, BW=5048KiB/s (5170kB/s)(12.0MiB/2434msec) clat (msec): min=663, max=853, avg=776.42, stdev=99.92 lat (msec): min=663, max=853, avg=776.42, stdev=99.92 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7968, max= 8143, per=100.00%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=15.25%, ctx=280, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144627: Mon Aug 31 09:45:42 2026 read: IOPS=0, BW=1426KiB/s (1460kB/s)(4096KiB/2872msec) clat (nsec): min=774072k, max=774072k, avg=774072282.00, stdev= 0.00 lat (nsec): min=774075k, max=774075k, avg=774075035.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2852KiB/s (2921kB/s)(8192KiB/2872msec); 0 zone resets clat (msec): min=833, max=1077, avg=955.62, stdev=172.73 lat (msec): min=833, max=1079, avg=956.73, stdev=173.71 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8143, max= 8143, per=84.74%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.54%, ctx=148, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144628: Mon Aug 31 09:45:42 2026 write: IOPS=0, BW=3604KiB/s (3690kB/s)(12.0MiB/3410msec); 0 zone resets clat (msec): min=241, max=2152, avg=1122.88, stdev=963.97 lat (msec): min=242, max=2152, avg=1123.38, stdev=963.60 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8143, max= 8175, per=84.91%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.55%, ctx=74, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144629: Mon Aug 31 09:45:42 2026 write: IOPS=1, BW=4315KiB/s (4418kB/s)(12.0MiB/2848msec); 0 zone resets clat (msec): min=696, max=1270, avg=906.51, stdev=316.62 lat (msec): min=696, max=1271, avg=907.03, stdev=316.66 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7968, max= 8143, per=83.83%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.17%, ctx=77, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5705KiB/s (5842kB/s), 1426KiB/s-5048KiB/s (1460kB/s-5170kB/s), io=16.0MiB (16.8MB), run=2434-2872msec WRITE: bw=9609KiB/s (9840kB/s), 2852KiB/s-4315KiB/s (2921kB/s-4418kB/s), io=32.0MiB (33.6MB), run=2848-3410msec