== sanity test 398b: DIO and buffer IO race ============== 18:48:25 (1781218105) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.43009 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179193: Thu Jun 11 18:51:17 2026 read: IOPS=9, BW=38.9KiB/s (39.9kB/s)(5992KiB/153855msec) clat (usec): min=38, max=675207, avg=57991.82, stdev=40488.13 lat (usec): min=38, max=675208, avg=57995.46, stdev=40487.68 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 14484], 10.00th=[ 22152], 20.00th=[ 28705], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 49546], 60.00th=[ 58983], | 70.00th=[ 68682], 80.00th=[ 82314], 90.00th=[106431], 95.00th=[128451], | 99.00th=[193987], 99.50th=[227541], 99.90th=[329253], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 83, per=24.97%, avg=38.45, stdev=14.67, samples=302 iops : min= 1, max= 20, avg= 8.94, stdev= 3.69, samples=302 write: IOPS=10, BW=40.9KiB/s (41.9kB/s)(6296KiB/153855msec); 0 zone resets clat (usec): min=1170, max=334377, avg=42214.96, stdev=42836.46 lat (usec): min=1171, max=334382, avg=42218.36, stdev=42836.04 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1598], 10.00th=[ 2409], 20.00th=[ 5407], | 30.00th=[ 10290], 40.00th=[ 20841], 50.00th=[ 32113], 60.00th=[ 41681], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[100140], 95.00th=[124257], | 99.00th=[187696], 99.50th=[225444], 99.90th=[274727], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 95, per=25.37%, avg=40.84, stdev=18.13, samples=299 iops : min= 1, max= 23, avg= 9.54, stdev= 4.58, samples=299 lat (usec) : 50=0.10%, 100=1.53%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.46%, 4=3.52%, 10=7.32%, 20=6.87%, 50=34.86% lat (msec) : 100=30.31%, 250=10.48%, 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=4.91%, ctx=6972, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179194: Thu Jun 11 18:51:17 2026 read: IOPS=9, BW=39.5KiB/s (40.4kB/s)(5940KiB/150450msec) clat (usec): min=44, max=321065, avg=55769.45, stdev=35176.71 lat (usec): min=45, max=321065, avg=55771.96, stdev=35177.09 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 15401], 10.00th=[ 22152], 20.00th=[ 30278], | 30.00th=[ 35390], 40.00th=[ 41681], 50.00th=[ 48497], 60.00th=[ 55837], | 70.00th=[ 66323], 80.00th=[ 78119], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[175113], 99.50th=[212861], 99.90th=[278922], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 79, per=25.30%, avg=38.96, stdev=14.88, samples=295 iops : min= 1, max= 19, avg= 9.06, stdev= 3.75, samples=295 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6348KiB/150450msec); 0 zone resets clat (usec): min=1077, max=622334, avg=42302.00, stdev=43041.31 lat (usec): min=1078, max=622334, avg=42310.38, stdev=43044.62 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1795], 10.00th=[ 2835], 20.00th=[ 5932], | 30.00th=[ 11076], 40.00th=[ 20317], 50.00th=[ 30540], 60.00th=[ 41681], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[124257], | 99.00th=[164627], 99.50th=[170918], 99.90th=[316670], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 122, per=25.81%, avg=41.55, stdev=19.86, samples=295 iops : min= 1, max= 30, avg= 9.72, stdev= 5.01, samples=295 lat (usec) : 50=0.13%, 100=1.43%, 250=0.23%, 1000=0.03% lat (msec) : 2=3.03%, 4=4.26%, 10=7.39%, 20=7.52%, 50=35.97% lat (msec) : 100=29.98%, 250=9.80%, 500=0.20%, 750=0.03% cpu : usr=0.09%, sys=4.84%, ctx=6854, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179195: Thu Jun 11 18:51:17 2026 read: IOPS=9, BW=39.7KiB/s (40.7kB/s)(6028KiB/151804msec) clat (usec): min=38, max=354962, avg=56537.32, stdev=37180.83 lat (usec): min=38, max=354964, avg=56540.63, stdev=37180.86 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 13566], 10.00th=[ 20841], 20.00th=[ 28705], | 30.00th=[ 35914], 40.00th=[ 42206], 50.00th=[ 49546], 60.00th=[ 57410], | 70.00th=[ 66323], 80.00th=[ 80217], 90.00th=[100140], 95.00th=[122160], | 99.00th=[189793], 99.50th=[219153], 99.90th=[304088], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 7, max= 88, per=25.50%, avg=39.27, stdev=15.90, samples=298 iops : min= 1, max= 22, avg= 9.15, stdev= 4.02, samples=298 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6260KiB/151804msec); 0 zone resets clat (usec): min=1189, max=499883, avg=42249.04, stdev=43511.89 lat (usec): min=1190, max=499885, avg=42257.55, stdev=43515.64 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1647], 10.00th=[ 2409], 20.00th=[ 5211], | 30.00th=[ 9634], 40.00th=[ 18744], 50.00th=[ 30802], 60.00th=[ 40109], | 70.00th=[ 55313], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[126354], | 99.00th=[166724], 99.50th=[198181], 99.90th=[263193], 99.95th=[501220], | 99.99th=[501220] bw ( KiB/s): min= 7, max= 127, per=25.32%, avg=40.77, stdev=19.67, samples=298 iops : min= 1, max= 31, avg= 9.52, stdev= 4.94, samples=298 lat (usec) : 50=0.20%, 100=1.40%, 250=0.29%, 500=0.13%, 1000=0.07% lat (msec) : 2=4.20%, 4=3.84%, 10=7.68%, 20=7.36%, 50=33.66% lat (msec) : 100=30.89%, 250=10.06%, 500=0.23% cpu : usr=0.09%, sys=4.65%, ctx=6858, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179196: Thu Jun 11 18:51:17 2026 read: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6052KiB/155270msec) clat (usec): min=33, max=324184, avg=56514.48, stdev=36525.62 lat (usec): min=34, max=324184, avg=56516.44, stdev=36525.33 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 15401], 10.00th=[ 21365], 20.00th=[ 28705], | 30.00th=[ 35914], 40.00th=[ 43254], 50.00th=[ 50070], 60.00th=[ 58459], | 70.00th=[ 66323], 80.00th=[ 79168], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[181404], 99.50th=[223347], 99.90th=[316670], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 87, per=25.17%, avg=38.77, stdev=16.65, samples=303 iops : min= 1, max= 21, avg= 9.01, stdev= 4.20, samples=303 write: IOPS=10, BW=40.2KiB/s (41.1kB/s)(6236KiB/155270msec); 0 zone resets clat (usec): min=1231, max=551552, avg=44385.72, stdev=46051.51 lat (usec): min=1231, max=551554, avg=44389.67, stdev=46052.26 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1647], 10.00th=[ 2507], 20.00th=[ 5866], | 30.00th=[ 10683], 40.00th=[ 21627], 50.00th=[ 32113], 60.00th=[ 43779], | 70.00th=[ 56886], 80.00th=[ 73925], 90.00th=[105382], 95.00th=[130548], | 99.00th=[193987], 99.50th=[225444], 99.90th=[362808], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 95, per=24.63%, avg=39.66, stdev=17.81, samples=305 iops : min= 1, max= 23, avg= 9.25, stdev= 4.47, samples=305 lat (usec) : 50=0.16%, 100=1.43%, 250=0.26%, 500=0.10% lat (msec) : 2=3.87%, 4=3.78%, 10=7.06%, 20=7.26%, 50=33.76% lat (msec) : 100=31.80%, 250=10.19%, 500=0.29%, 750=0.03% cpu : usr=0.07%, sys=4.73%, ctx=7145, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (158kB/s), 38.9KiB/s-39.7KiB/s (39.9kB/s-40.7kB/s), io=23.4MiB (24.6MB), run=150450-155270msec WRITE: bw=162KiB/s (166kB/s), 40.2KiB/s-42.2KiB/s (41.1kB/s-43.2kB/s), io=24.6MiB (25.7MB), run=150450-155270msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179198: Thu Jun 11 18:52:06 2026 read: IOPS=7, BW=29.7KiB/s (30.4kB/s)(5992KiB/201864msec) clat (msec): min=7, max=679, avg=54.10, stdev=49.54 lat (msec): min=7, max=679, avg=54.10, stdev=49.55 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 78], 90.00th=[ 123], 95.00th=[ 165], | 99.00th=[ 230], 99.50th=[ 251], 99.90th=[ 305], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 111, per=25.89%, avg=30.29, stdev=20.19, samples=382 iops : min= 1, max= 27, avg= 6.88, stdev= 5.07, samples=382 write: IOPS=7, BW=31.2KiB/s (31.9kB/s)(6296KiB/201864msec); 0 zone resets clat (msec): min=12, max=475, avg=76.60, stdev=54.61 lat (msec): min=12, max=475, avg=76.60, stdev=54.61 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 110], 90.00th=[ 144], 95.00th=[ 186], | 99.00th=[ 279], 99.50th=[ 334], 99.90th=[ 443], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 103, per=25.51%, avg=31.13, stdev=18.93, samples=391 iops : min= 1, max= 25, avg= 7.08, stdev= 4.75, samples=391 lat (msec) : 10=0.36%, 20=8.69%, 50=42.74%, 100=29.10%, 250=18.13% lat (msec) : 500=0.94%, 750=0.03% cpu : usr=0.07%, sys=2.08%, ctx=5050, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179199: Thu Jun 11 18:52:06 2026 read: IOPS=7, BW=29.0KiB/s (29.7kB/s)(5940KiB/204476msec) clat (msec): min=6, max=796, avg=54.26, stdev=51.44 lat (msec): min=6, max=796, avg=54.26, stdev=51.44 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 75], 90.00th=[ 121], 95.00th=[ 161], | 99.00th=[ 230], 99.50th=[ 241], 99.90th=[ 405], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 112, per=25.72%, avg=30.09, stdev=20.54, samples=381 iops : min= 1, max= 28, avg= 6.83, stdev= 5.16, samples=381 write: IOPS=7, BW=31.0KiB/s (31.8kB/s)(6348KiB/204476msec); 0 zone resets clat (msec): min=12, max=444, avg=77.81, stdev=55.47 lat (msec): min=12, max=444, avg=77.82, stdev=55.47 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 72], | 70.00th=[ 90], 80.00th=[ 113], 90.00th=[ 155], 95.00th=[ 194], | 99.00th=[ 266], 99.50th=[ 330], 99.90th=[ 388], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 103, per=25.29%, avg=30.85, stdev=19.49, samples=396 iops : min= 1, max= 25, avg= 7.02, stdev= 4.90, samples=396 lat (msec) : 10=0.29%, 20=8.89%, 50=43.75%, 100=27.93%, 250=18.23% lat (msec) : 500=0.88%, 1000=0.03% cpu : usr=0.06%, sys=1.93%, ctx=5077, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179200: Thu Jun 11 18:52:06 2026 read: IOPS=7, BW=29.4KiB/s (30.1kB/s)(6028KiB/204738msec) clat (msec): min=7, max=439, avg=54.63, stdev=47.78 lat (msec): min=7, max=439, avg=54.64, stdev=47.78 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 124], 95.00th=[ 159], | 99.00th=[ 222], 99.50th=[ 241], 99.90th=[ 368], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 111, per=25.42%, avg=29.74, stdev=19.83, samples=392 iops : min= 1, max= 27, avg= 6.74, stdev= 4.98, samples=392 write: IOPS=7, BW=30.6KiB/s (31.3kB/s)(6260KiB/204738msec); 0 zone resets clat (msec): min=13, max=844, avg=77.96, stdev=58.69 lat (msec): min=13, max=844, avg=77.96, stdev=58.70 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 87], 80.00th=[ 113], 90.00th=[ 153], 95.00th=[ 190], | 99.00th=[ 271], 99.50th=[ 334], 99.90th=[ 485], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 87, per=25.36%, avg=30.94, stdev=18.85, samples=391 iops : min= 1, max= 21, avg= 7.04, stdev= 4.74, samples=391 lat (msec) : 10=0.62%, 20=7.88%, 50=43.65%, 100=28.94%, 250=17.90% lat (msec) : 500=0.98%, 1000=0.03% cpu : usr=0.07%, sys=1.94%, ctx=5033, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179201: Thu Jun 11 18:52:06 2026 read: IOPS=7, BW=29.7KiB/s (30.4kB/s)(6052KiB/204085msec) clat (msec): min=6, max=307, avg=55.12, stdev=47.45 lat (msec): min=6, max=307, avg=55.12, stdev=47.45 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 60], 80.00th=[ 83], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 226], 99.50th=[ 253], 99.90th=[ 292], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 119, per=25.87%, avg=30.27, stdev=20.39, samples=387 iops : min= 1, max= 29, avg= 6.88, stdev= 5.13, samples=387 write: IOPS=7, BW=30.6KiB/s (31.3kB/s)(6236KiB/204085msec); 0 zone resets clat (msec): min=11, max=768, avg=77.10, stdev=55.84 lat (msec): min=11, max=768, avg=77.11, stdev=55.84 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 90], 80.00th=[ 112], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 268], 99.50th=[ 321], 99.90th=[ 485], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 111, per=25.33%, avg=30.91, stdev=18.76, samples=391 iops : min= 1, max= 27, avg= 7.03, stdev= 4.71, samples=391 lat (msec) : 10=0.65%, 20=8.17%, 50=42.77%, 100=28.97%, 250=18.52% lat (msec) : 500=0.88%, 1000=0.03% cpu : usr=0.06%, sys=1.98%, ctx=5162, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=117KiB/s (120kB/s), 29.0KiB/s-29.7KiB/s (29.7kB/s-30.4kB/s), io=23.4MiB (24.6MB), run=201864-204738msec WRITE: bw=123KiB/s (126kB/s), 30.6KiB/s-31.2KiB/s (31.3kB/s-31.9kB/s), io=24.6MiB (25.7MB), run=201864-204738msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179245: Thu Jun 11 18:52:52 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5920KiB/34203msec) clat (usec): min=51, max=178101, avg=49809.79, stdev=33182.56 lat (usec): min=51, max=178102, avg=49812.20, stdev=33183.85 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 83], 10.00th=[ 14091], 20.00th=[ 25035], | 30.00th=[ 31851], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 51643], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[116917], | 99.00th=[162530], 99.50th=[175113], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 444, per=25.35%, avg=172.37, stdev=71.31, samples=67 iops : min= 1, max= 27, avg=10.03, stdev= 4.45, samples=67 write: IOPS=11, BW=186KiB/s (191kB/s)(6368KiB/34203msec); 0 zone resets clat (usec): min=1916, max=221921, avg=38968.39, stdev=35201.43 lat (usec): min=1919, max=221924, avg=38971.22, stdev=35201.45 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 15], 40.00th=[ 22], 50.00th=[ 29], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 93], 95.00th=[ 108], | 99.00th=[ 148], 99.50th=[ 174], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 352, per=26.01%, avg=186.21, stdev=77.92, samples=67 iops : min= 1, max= 22, avg=10.90, stdev= 4.92, samples=67 lat (usec) : 100=3.26%, 250=0.91%, 500=0.26% lat (msec) : 2=0.13%, 4=2.73%, 10=9.38%, 20=10.29%, 50=37.11% lat (msec) : 100=29.04%, 250=6.90% cpu : usr=0.07%, sys=6.10%, ctx=1895, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179246: Thu Jun 11 18:52:52 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(5744KiB/35178msec) clat (usec): min=48, max=205284, avg=50456.70, stdev=30761.64 lat (usec): min=49, max=205285, avg=50459.24, stdev=30761.35 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 141], 10.00th=[ 20055], 20.00th=[ 27132], | 30.00th=[ 33162], 40.00th=[ 39584], 50.00th=[ 45351], 60.00th=[ 52691], | 70.00th=[ 61604], 80.00th=[ 71828], 90.00th=[ 85459], 95.00th=[108528], | 99.00th=[149947], 99.50th=[196084], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 30, max= 318, per=23.90%, avg=162.51, stdev=68.48, samples=69 iops : min= 1, max= 19, avg= 9.39, stdev= 4.36, samples=69 write: IOPS=11, BW=186KiB/s (190kB/s)(6544KiB/35178msec); 0 zone resets clat (msec): min=2, max=186, avg=40.65, stdev=36.36 lat (msec): min=2, max=186, avg=40.66, stdev=36.36 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 10], | 30.00th=[ 16], 40.00th=[ 25], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 94], 95.00th=[ 120], | 99.00th=[ 157], 99.50th=[ 176], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 62, max= 411, per=25.83%, avg=184.97, stdev=79.79, samples=69 iops : min= 3, max= 25, avg=10.81, stdev= 5.02, samples=69 lat (usec) : 50=0.13%, 100=1.95%, 250=0.26%, 500=0.26%, 750=0.26% lat (msec) : 2=0.13%, 4=4.30%, 10=7.29%, 20=8.46%, 50=40.89% lat (msec) : 100=28.13%, 250=7.94% cpu : usr=0.06%, sys=6.14%, ctx=2021, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179248: Thu Jun 11 18:52:52 2026 read: IOPS=11, BW=181KiB/s (186kB/s)(6256KiB/34470msec) clat (usec): min=38, max=215060, avg=48252.92, stdev=32874.38 lat (usec): min=39, max=215061, avg=48257.29, stdev=32877.47 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 81], 10.00th=[ 9765], 20.00th=[ 25297], | 30.00th=[ 32113], 40.00th=[ 38011], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 58983], 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[185598], 99.50th=[193987], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 59, max= 382, per=26.70%, avg=181.59, stdev=73.59, samples=68 iops : min= 3, max= 23, avg=10.60, stdev= 4.66, samples=68 write: IOPS=10, BW=175KiB/s (179kB/s)(6032KiB/34470msec); 0 zone resets clat (usec): min=1880, max=200945, avg=40704.99, stdev=35493.72 lat (usec): min=1882, max=200947, avg=40708.42, stdev=35493.72 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 9], | 30.00th=[ 17], 40.00th=[ 26], 50.00th=[ 33], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 65], 90.00th=[ 90], 95.00th=[ 108], | 99.00th=[ 169], 99.50th=[ 194], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 62, max= 350, per=24.56%, avg=175.84, stdev=65.04, samples=67 iops : min= 3, max= 21, avg=10.24, stdev= 4.10, samples=67 lat (usec) : 50=0.39%, 100=3.26%, 250=0.91%, 750=0.26% lat (msec) : 2=0.39%, 4=4.04%, 10=6.77%, 20=7.81%, 50=40.10% lat (msec) : 100=29.56%, 250=6.51% cpu : usr=0.10%, sys=6.19%, ctx=1970, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179249: Thu Jun 11 18:52:52 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(6032KiB/34413msec) clat (usec): min=53, max=266641, avg=51382.81, stdev=34938.30 lat (usec): min=54, max=266642, avg=51390.82, stdev=34941.16 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 80], 10.00th=[ 14222], 20.00th=[ 26084], | 30.00th=[ 32375], 40.00th=[ 38011], 50.00th=[ 46400], 60.00th=[ 53216], | 70.00th=[ 62653], 80.00th=[ 74974], 90.00th=[ 94897], 95.00th=[115868], | 99.00th=[160433], 99.50th=[185598], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 284, per=25.56%, avg=173.81, stdev=58.70, samples=67 iops : min= 1, max= 17, avg=10.12, stdev= 3.68, samples=67 write: IOPS=11, BW=182KiB/s (186kB/s)(6256KiB/34413msec); 0 zone resets clat (usec): min=1752, max=253849, avg=38187.08, stdev=35147.78 lat (usec): min=1753, max=253851, avg=38191.71, stdev=35148.45 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 12], 40.00th=[ 20], 50.00th=[ 29], 60.00th=[ 38], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 89], 95.00th=[ 104], | 99.00th=[ 148], 99.50th=[ 155], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 447, per=25.35%, avg=181.52, stdev=75.36, samples=67 iops : min= 1, max= 27, avg=10.60, stdev= 4.76, samples=67 lat (usec) : 100=3.39%, 250=0.78%, 500=0.26%, 750=0.13% lat (msec) : 2=0.39%, 4=4.30%, 10=8.98%, 20=9.77%, 50=34.64% lat (msec) : 100=30.60%, 250=6.51%, 500=0.26% cpu : usr=0.10%, sys=5.87%, ctx=1860, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=681KiB/s (697kB/s), 163KiB/s-181KiB/s (167kB/s-186kB/s), io=23.4MiB (24.5MB), run=34203-35178msec WRITE: bw=716KiB/s (734kB/s), 175KiB/s-186KiB/s (179kB/s-191kB/s), io=24.6MiB (25.8MB), run=34203-35178msec fio: pid=179251, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=179250: Thu Jun 11 18:53:05 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(5920KiB/48164msec) clat (msec): min=10, max=242, avg=51.52, stdev=35.60 lat (msec): min=10, max=242, avg=51.52, stdev=35.60 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 18], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 101], 95.00th=[ 133], | 99.00th=[ 188], 99.50th=[ 207], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 320, per=27.40%, avg=126.29, stdev=61.70, samples=92 iops : min= 1, max= 20, avg= 7.09, stdev= 3.93, samples=92 write: IOPS=8, BW=132KiB/s (135kB/s)(6368KiB/48164msec); 0 zone resets clat (msec): min=19, max=322, avg=72.22, stdev=46.12 lat (msec): min=19, max=322, avg=72.23, stdev=46.13 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 58], 60.00th=[ 67], | 70.00th=[ 79], 80.00th=[ 97], 90.00th=[ 138], 95.00th=[ 171], | 99.00th=[ 243], 99.50th=[ 284], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 27, max= 352, per=27.45%, avg=131.74, stdev=62.07, samples=95 iops : min= 1, max= 22, avg= 7.42, stdev= 3.95, samples=95 lat (msec) : 20=3.91%, 50=47.40%, 100=33.72%, 250=14.58%, 500=0.39% cpu : usr=0.06%, sys=2.43%, ctx=1427, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=179251: Thu Jun 11 18:53:05 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(4016KiB/38694msec) clat (msec): min=6, max=262, avg=59.56, stdev=44.75 lat (msec): min=6, max=262, avg=59.56, stdev=44.75 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 69], 80.00th=[ 91], 90.00th=[ 126], 95.00th=[ 146], | 99.00th=[ 236], 99.50th=[ 247], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 28, max= 350, per=23.15%, avg=106.73, stdev=62.14, samples=73 iops : min= 1, max= 21, avg= 5.85, stdev= 3.90, samples=73 write: IOPS=7, BW=115KiB/s (118kB/s)(4464KiB/38694msec); 0 zone resets clat (msec): min=24, max=245, avg=83.36, stdev=44.86 lat (msec): min=24, max=245, avg=83.37, stdev=44.86 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 34], 10.00th=[ 38], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 60], 50.00th=[ 72], 60.00th=[ 83], | 70.00th=[ 102], 80.00th=[ 118], 90.00th=[ 153], 95.00th=[ 171], | 99.00th=[ 205], 99.50th=[ 226], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 277, per=24.20%, avg=116.16, stdev=46.08, samples=75 iops : min= 1, max= 17, avg= 6.44, stdev= 2.96, samples=75 lat (msec) : 10=0.19%, 20=3.39%, 50=39.55%, 100=33.15%, 250=23.35% lat (msec) : 500=0.19% cpu : usr=0.04%, sys=2.02%, ctx=811, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=252,279,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179252: Thu Jun 11 18:53:05 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(6256KiB/48133msec) clat (msec): min=7, max=257, avg=52.76, stdev=37.10 lat (msec): min=7, max=257, avg=52.77, stdev=37.09 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 58], 80.00th=[ 70], 90.00th=[ 103], 95.00th=[ 134], | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 318, per=29.14%, avg=134.34, stdev=67.62, samples=92 iops : min= 1, max= 19, avg= 7.59, stdev= 4.25, samples=92 write: IOPS=7, BW=125KiB/s (128kB/s)(6032KiB/48133msec); 0 zone resets clat (msec): min=12, max=279, avg=71.88, stdev=41.91 lat (msec): min=12, max=279, avg=71.89, stdev=41.91 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 62], 60.00th=[ 69], | 70.00th=[ 82], 80.00th=[ 100], 90.00th=[ 131], 95.00th=[ 153], | 99.00th=[ 226], 99.50th=[ 255], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 287, per=26.13%, avg=125.44, stdev=56.55, samples=94 iops : min= 1, max= 17, avg= 7.02, stdev= 3.59, samples=94 lat (msec) : 10=0.13%, 20=4.56%, 50=45.70%, 100=34.38%, 250=14.84% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=2.45%, ctx=1432, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179253: Thu Jun 11 18:53:05 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(6032KiB/47982msec) clat (msec): min=7, max=254, avg=51.99, stdev=35.89 lat (msec): min=7, max=254, avg=51.99, stdev=35.89 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 105], 95.00th=[ 133], | 99.00th=[ 167], 99.50th=[ 182], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 339, per=28.42%, avg=131.02, stdev=66.36, samples=89 iops : min= 1, max= 21, avg= 7.36, stdev= 4.24, samples=89 write: IOPS=8, BW=130KiB/s (134kB/s)(6256KiB/47982msec); 0 zone resets clat (msec): min=20, max=316, avg=72.15, stdev=46.01 lat (msec): min=20, max=316, avg=72.16, stdev=46.01 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 70], | 70.00th=[ 82], 80.00th=[ 101], 90.00th=[ 126], 95.00th=[ 171], | 99.00th=[ 251], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 382, per=27.24%, avg=130.76, stdev=58.96, samples=93 iops : min= 1, max= 23, avg= 7.34, stdev= 3.75, samples=93 lat (msec) : 10=0.65%, 20=3.52%, 50=46.88%, 100=33.20%, 250=15.10% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=2.35%, ctx=1376, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=461KiB/s (472kB/s), 104KiB/s-130KiB/s (106kB/s-133kB/s), io=21.7MiB (22.8MB), run=38694-48164msec WRITE: bw=480KiB/s (492kB/s), 115KiB/s-132KiB/s (118kB/s-135kB/s), io=22.6MiB (23.7MB), run=38694-48164msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179266: Thu Jun 11 18:53:21 2026 read: IOPS=1, BW=1540KiB/s (1577kB/s)(7168KiB/4654msec) clat (usec): min=638, max=343811, avg=203877.71, stdev=117921.29 lat (usec): min=639, max=343812, avg=203879.07, stdev=117921.46 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 93848], | 30.00th=[210764], 40.00th=[210764], 50.00th=[235930], 60.00th=[263193], | 70.00th=[263193], 80.00th=[278922], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 1404, max= 4015, per=62.55%, avg=2294.40, stdev=997.88, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1100KiB/s (1127kB/s)(5120KiB/4654msec); 0 zone resets clat (msec): min=273, max=1010, avg=570.53, stdev=371.85 lat (msec): min=277, max=1010, avg=571.55, stdev=370.92 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1976, max= 4047, per=52.19%, avg=2680.67, stdev=1183.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.43%, ctx=192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179267: Thu Jun 11 18:53:21 2026 read: IOPS=0, BW=367KiB/s (376kB/s)(2048KiB/5582msec) clat (msec): min=283, max=289, avg=286.33, stdev= 4.21 lat (msec): min=283, max=289, avg=286.33, stdev= 4.21 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1633, max= 2043, per=50.11%, avg=1838.00, stdev=289.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1834KiB/s (1878kB/s)(10.0MiB/5582msec); 0 zone resets clat (msec): min=140, max=1096, avg=479.15, stdev=338.45 lat (msec): min=140, max=1096, avg=479.54, stdev=338.37 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 165], | 30.00th=[ 174], 40.00th=[ 192], 50.00th=[ 351], 60.00th=[ 426], | 70.00th=[ 651], 80.00th=[ 751], 90.00th=[ 852], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1976, max= 6000, per=58.72%, avg=3016.00, stdev=1673.29, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.02%, sys=13.89%, ctx=208, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179268: Thu Jun 11 18:53:21 2026 read: IOPS=1, BW=1537KiB/s (1574kB/s)(6144KiB/3998msec) clat (msec): min=2, max=309, avg=166.86, stdev=117.92 lat (msec): min=2, max=309, avg=166.86, stdev=117.92 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 89], | 30.00th=[ 89], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 174], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1615, max= 3953, per=64.60%, avg=2369.50, stdev=1068.74, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1537KiB/s (1574kB/s)(6144KiB/3998msec); 0 zone resets clat (msec): min=231, max=1180, avg=492.87, stdev=351.82 lat (msec): min=231, max=1180, avg=493.19, stdev=351.64 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 451], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1444, max= 2011, per=35.25%, avg=1810.60, stdev=263.98, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=11.93%, ctx=142, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179269: Thu Jun 11 18:53:21 2026 read: IOPS=1, BW=1179KiB/s (1207kB/s)(5120KiB/4344msec) clat (usec): min=426, max=252851, avg=84156.42, stdev=118486.60 lat (usec): min=427, max=252852, avg=84157.46, stdev=118486.82 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 429], 10.00th=[ 429], 20.00th=[ 429], | 30.00th=[ 469], 40.00th=[ 469], 50.00th=[ 799], 60.00th=[ 799], | 70.00th=[166724], 80.00th=[166724], 90.00th=[252707], 95.00th=[252707], | 99.00th=[252707], 99.50th=[252707], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1650KiB/s (1690kB/s)(7168KiB/4344msec); 0 zone resets clat (msec): min=174, max=839, avg=531.14, stdev=245.25 lat (msec): min=174, max=839, avg=531.22, stdev=245.25 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 288], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 776], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1615, max= 2019, per=36.07%, avg=1852.80, stdev=205.18, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 250=16.67%, 500=25.00%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=12.92%, ctx=187, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3669KiB/s (3757kB/s), 367KiB/s-1540KiB/s (376kB/s-1577kB/s), io=20.0MiB (20.0MB), run=3998-5582msec WRITE: bw=5137KiB/s (5260kB/s), 1100KiB/s-1834KiB/s (1127kB/s-1878kB/s), io=28.0MiB (29.4MB), run=3998-5582msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179270: Thu Jun 11 18:53:22 2026 read: IOPS=1, BW=1261KiB/s (1291kB/s)(7168KiB/5685msec) clat (msec): min=119, max=815, avg=284.35, stdev=243.98 lat (msec): min=119, max=815, avg=284.35, stdev=243.98 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 140], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 205], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 330], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1638, max= 4063, per=91.66%, avg=2876.25, stdev=1242.10, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=901KiB/s (922kB/s)(5120KiB/5685msec); 0 zone resets clat (msec): min=198, max=1304, avg=693.71, stdev=464.22 lat (msec): min=198, max=1305, avg=693.99, stdev=464.52 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1612, max= 2031, per=43.56%, avg=1913.50, stdev=202.12, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.29%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179271: Thu Jun 11 18:53:22 2026 read: IOPS=0, BW=335KiB/s (343kB/s)(2048KiB/6116msec) clat (msec): min=160, max=938, avg=549.34, stdev=549.97 lat (msec): min=160, max=938, avg=549.34, stdev=549.97 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 2031, max= 2035, per=64.79%, avg=2033.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1674KiB/s (1714kB/s)(10.0MiB/6116msec); 0 zone resets clat (msec): min=89, max=1006, avg=494.44, stdev=428.76 lat (msec): min=89, max=1009, avg=494.87, stdev=429.20 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 108], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 126], 60.00th=[ 472], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1612, max= 6107, per=62.19%, avg=2731.80, stdev=1894.02, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 1000=25.00%, 2000=16.67% cpu : usr=0.00%, sys=5.76%, ctx=150, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179272: Thu Jun 11 18:53:22 2026 read: IOPS=0, BW=1018KiB/s (1042kB/s)(6144KiB/6035msec) clat (msec): min=66, max=837, avg=408.30, stdev=332.53 lat (msec): min=66, max=837, avg=408.30, stdev=332.53 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 567], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1612, max= 2035, per=61.40%, avg=1926.80, stdev=177.86, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=1018KiB/s (1042kB/s)(6144KiB/6035msec); 0 zone resets clat (msec): min=123, max=856, avg=562.18, stdev=300.02 lat (msec): min=124, max=856, avg=563.28, stdev=299.97 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 776], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1910, max= 2039, per=45.61%, avg=2003.60, stdev=54.20, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=33.33% cpu : usr=0.07%, sys=3.56%, ctx=104, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179273: Thu Jun 11 18:53:22 2026 read: IOPS=0, BW=785KiB/s (803kB/s)(5120KiB/6526msec) clat (msec): min=89, max=779, avg=497.06, stdev=278.21 lat (msec): min=89, max=779, avg=497.06, stdev=278.21 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2023, max= 3968, per=85.30%, avg=2676.67, stdev=1118.36, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1098KiB/s (1125kB/s)(7168KiB/6526msec); 0 zone resets clat (msec): min=112, max=1246, avg=544.41, stdev=447.93 lat (msec): min=112, max=1246, avg=544.52, stdev=447.93 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 186], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 313], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 911], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1612, max= 4047, per=53.13%, avg=2333.80, stdev=972.78, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 750=16.67%, 1000=25.00% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=3.51%, ctx=97, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3138KiB/s (3214kB/s), 335KiB/s-1261KiB/s (343kB/s-1291kB/s), io=20.0MiB (20.0MB), run=5685-6526msec WRITE: bw=4394KiB/s (4499kB/s), 901KiB/s-1674KiB/s (922kB/s-1714kB/s), io=28.0MiB (29.4MB), run=5685-6526msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179282: Thu Jun 11 18:53:37 2026 read: IOPS=1, BW=4785KiB/s (4900kB/s)(12.0MiB/2568msec) clat (msec): min=779, max=883, avg=838.01, stdev=53.05 lat (msec): min=779, max=883, avg=838.01, stdev=53.05 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.53%, ctx=257, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179283: Thu Jun 11 18:53:37 2026 read: IOPS=0, BW=1258KiB/s (1288kB/s)(4096KiB/3257msec) clat (nsec): min=990073k, max=990073k, avg=990072578.00, stdev= 0.00 lat (nsec): min=990076k, max=990076k, avg=990075988.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2515KiB/s (2576kB/s)(8192KiB/3257msec); 0 zone resets clat (msec): min=596, max=1592, avg=1094.48, stdev=703.72 lat (msec): min=597, max=1592, avg=1094.86, stdev=703.78 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8175, max= 8175, per=88.97%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.98%, ctx=132, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179286: Thu Jun 11 18:53:37 2026 write: IOPS=0, BW=3446KiB/s (3529kB/s)(12.0MiB/3566msec); 0 zone resets clat (msec): min=322, max=2076, avg=1170.20, stdev=878.60 lat (msec): min=323, max=2076, avg=1171.47, stdev=877.90 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 8110, max= 8159, per=88.52%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.17%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179288: Thu Jun 11 18:53:37 2026 write: IOPS=1, BW=5071KiB/s (5193kB/s)(12.0MiB/2423msec); 0 zone resets clat (msec): min=244, max=1535, avg=790.50, stdev=667.75 lat (msec): min=245, max=1535, avg=790.97, stdev=667.60 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.46%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5030KiB/s (5151kB/s), 1258KiB/s-4785KiB/s (1288kB/s-4900kB/s), io=16.0MiB (16.8MB), run=2568-3257msec WRITE: bw=9189KiB/s (9410kB/s), 2515KiB/s-5071KiB/s (2576kB/s-5193kB/s), io=32.0MiB (33.6MB), run=2423-3566msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179284: Thu Jun 11 18:53:37 2026 read: IOPS=1, BW=4282KiB/s (4384kB/s)(12.0MiB/2870msec) clat (msec): min=208, max=1386, avg=886.69, stdev=609.20 lat (msec): min=208, max=1387, avg=886.70, stdev=609.20 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.73%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179285: Thu Jun 11 18:53:37 2026 read: IOPS=0, BW=1097KiB/s (1123kB/s)(4096KiB/3734msec) clat (nsec): min=1276.8M, max=1276.8M, avg=1276850727.00, stdev= 0.00 lat (nsec): min=1276.9M, max=1276.9M, avg=1276854299.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1284], 5.00th=[ 1284], 10.00th=[ 1284], 20.00th=[ 1284], | 30.00th=[ 1284], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2194KiB/s (2247kB/s)(8192KiB/3734msec); 0 zone resets clat (msec): min=602, max=1639, avg=1121.34, stdev=733.48 lat (msec): min=603, max=1640, avg=1121.81, stdev=733.51 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8159, max= 8159, per=93.35%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.27%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179287: Thu Jun 11 18:53:37 2026 write: IOPS=0, BW=3278KiB/s (3356kB/s)(12.0MiB/3749msec); 0 zone resets clat (msec): min=414, max=1771, avg=1172.97, stdev=692.89 lat (msec): min=414, max=1772, avg=1173.52, stdev=692.99 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8110, max= 8159, per=93.07%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.07%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179289: Thu Jun 11 18:53:37 2026 write: IOPS=1, BW=4635KiB/s (4746kB/s)(12.0MiB/2651msec); 0 zone resets clat (msec): min=319, max=1273, avg=864.29, stdev=491.00 lat (msec): min=320, max=1274, avg=865.57, stdev=491.27 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8078, max= 8078, per=92.43%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.83%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4388KiB/s (4493kB/s), 1097KiB/s-4282KiB/s (1123kB/s-4384kB/s), io=16.0MiB (16.8MB), run=2870-3734msec WRITE: bw=8740KiB/s (8950kB/s), 2194KiB/s-4635KiB/s (2247kB/s-4746kB/s), io=32.0MiB (33.6MB), run=2651-3749msec