== sanity test 398b: DIO and buffer IO race ============== 11:45:04 (1783957504) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.40054 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145428: Mon Jul 13 11:47:28 2026 read: IOPS=11, BW=47.5KiB/s (48.6kB/s)(5992KiB/126251msec) clat (usec): min=20, max=886569, avg=40365.39, stdev=36204.47 lat (usec): min=21, max=886570, avg=40369.89, stdev=36205.82 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 84], 20.00th=[ 19268], | 30.00th=[ 23987], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50070], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[139461], 99.50th=[152044], 99.90th=[208667], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 127, per=24.73%, avg=46.98, stdev=19.99, samples=248 iops : min= 1, max= 31, avg=11.11, stdev= 5.01, samples=248 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6296KiB/126251msec); 0 zone resets clat (usec): min=764, max=247829, avg=41447.26, stdev=40108.63 lat (usec): min=765, max=247831, avg=41461.04, stdev=40121.81 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 1876], 20.00th=[ 4490], | 30.00th=[ 10159], 40.00th=[ 22152], 50.00th=[ 32637], 60.00th=[ 43254], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[117965], | 99.00th=[173016], 99.50th=[193987], 99.90th=[240124], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 119, per=25.07%, avg=49.64, stdev=19.27, samples=247 iops : min= 1, max= 29, avg=11.79, stdev= 4.84, samples=247 lat (usec) : 50=1.17%, 100=4.04%, 250=0.29%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.50%, 4=3.84%, 10=6.22%, 20=8.92%, 50=37.99% lat (msec) : 100=25.39%, 250=6.35%, 1000=0.03% cpu : usr=0.06%, sys=5.00%, ctx=6562, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145430: Mon Jul 13 11:47:28 2026 read: IOPS=11, BW=47.3KiB/s (48.4kB/s)(5940KiB/125588msec) clat (usec): min=22, max=229836, avg=39565.03, stdev=28906.22 lat (usec): min=22, max=229837, avg=39567.85, stdev=28907.52 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 99], 20.00th=[ 19006], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[129500], 99.50th=[160433], 99.90th=[196084], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 111, per=24.72%, avg=46.97, stdev=20.46, samples=247 iops : min= 1, max= 27, avg=11.12, stdev= 5.15, samples=247 write: IOPS=12, BW=50.5KiB/s (51.8kB/s)(6348KiB/125588msec); 0 zone resets clat (usec): min=871, max=912255, avg=41800.64, stdev=45448.45 lat (usec): min=871, max=912256, avg=41805.72, stdev=45451.76 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1713], 20.00th=[ 4424], | 30.00th=[ 9503], 40.00th=[ 20841], 50.00th=[ 32637], 60.00th=[ 43254], | 70.00th=[ 56886], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[166724], 99.50th=[196084], 99.90th=[283116], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 116, per=25.51%, avg=50.51, stdev=19.97, samples=246 iops : min= 1, max= 29, avg=12.00, stdev= 5.04, samples=246 lat (usec) : 50=0.49%, 100=4.36%, 250=0.36%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=6.05%, 4=3.42%, 10=6.84%, 20=9.08%, 50=37.08% lat (msec) : 100=25.81%, 250=6.12%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.29%, ctx=6598, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145432: Mon Jul 13 11:47:28 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6028KiB/126336msec) clat (usec): min=21, max=929663, avg=39793.61, stdev=36428.97 lat (usec): min=21, max=929667, avg=39795.34, stdev=36428.96 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 93], 20.00th=[ 18482], | 30.00th=[ 24249], 40.00th=[ 28967], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[164627], 99.90th=[208667], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 103, per=25.01%, avg=47.53, stdev=18.99, samples=248 iops : min= 1, max= 25, avg=11.26, stdev= 4.78, samples=248 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6260KiB/126336msec); 0 zone resets clat (usec): min=1005, max=442839, avg=42051.90, stdev=43078.28 lat (usec): min=1007, max=442841, avg=42055.76, stdev=43080.39 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1762], 20.00th=[ 4424], | 30.00th=[ 8717], 40.00th=[ 19268], 50.00th=[ 31851], 60.00th=[ 43779], | 70.00th=[ 56361], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[123208], | 99.00th=[166724], 99.50th=[193987], 99.90th=[383779], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 111, per=24.82%, avg=49.14, stdev=20.35, samples=249 iops : min= 1, max= 27, avg=11.66, stdev= 5.11, samples=249 lat (usec) : 50=0.94%, 100=4.10%, 250=0.42%, 500=0.10%, 1000=0.03% lat (msec) : 2=5.73%, 4=4.00%, 10=6.93%, 20=9.15%, 50=37.24% lat (msec) : 100=24.67%, 250=6.51%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=5.09%, ctx=6490, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145435: Mon Jul 13 11:47:28 2026 read: IOPS=12, BW=48.7KiB/s (49.8kB/s)(6052KiB/124383msec) clat (usec): min=20, max=271641, avg=39924.20, stdev=29362.57 lat (usec): min=20, max=271644, avg=39928.17, stdev=29363.23 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 80], 20.00th=[ 19792], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 87557], | 99.00th=[132645], 99.50th=[166724], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 112, per=26.00%, avg=49.40, stdev=17.35, samples=240 iops : min= 1, max= 28, avg=11.72, stdev= 4.39, samples=240 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6236KiB/124383msec); 0 zone resets clat (usec): min=870, max=1087.9k, avg=40689.24, stdev=48588.74 lat (usec): min=872, max=1087.9k, avg=40708.80, stdev=48578.20 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1696], | 20.00th=[ 4113], 30.00th=[ 8979], 40.00th=[ 19792], | 50.00th=[ 29492], 60.00th=[ 40109], 70.00th=[ 52691], | 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[ 114820], | 99.00th=[ 179307], 99.50th=[ 217056], 99.90th=[ 320865], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 120, per=25.27%, avg=50.03, stdev=20.13, samples=244 iops : min= 1, max= 30, avg=11.89, stdev= 5.06, samples=244 lat (usec) : 50=0.85%, 100=4.36%, 250=0.39%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=6.02%, 4=3.94%, 10=6.09%, 20=8.76%, 50=38.64% lat (msec) : 100=24.74%, 250=5.79%, 500=0.20%, 2000=0.03% cpu : usr=0.08%, sys=5.20%, ctx=6464, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=190KiB/s (195kB/s), 47.3KiB/s-48.7KiB/s (48.4kB/s-49.8kB/s), io=23.4MiB (24.6MB), run=124383-126336msec WRITE: bw=199KiB/s (204kB/s), 49.5KiB/s-50.5KiB/s (50.7kB/s-51.8kB/s), io=24.6MiB (25.7MB), run=124383-126336msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145429: Mon Jul 13 11:49:40 2026 read: IOPS=5, BW=23.2KiB/s (23.8kB/s)(5992KiB/258079msec) clat (msec): min=5, max=904, avg=34.83, stdev=42.63 lat (msec): min=5, max=904, avg=34.84, stdev=42.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 103], | 99.00th=[ 188], 99.50th=[ 234], 99.90th=[ 418], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 95, per=28.01%, avg=26.05, stdev=18.31, samples=445 iops : min= 1, max= 23, avg= 5.90, stdev= 4.61, samples=445 write: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6296KiB/258079msec); 0 zone resets clat (msec): min=33, max=491, avg=130.50, stdev=68.80 lat (msec): min=33, max=491, avg=130.51, stdev=68.80 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 110], 60.00th=[ 127], | 70.00th=[ 148], 80.00th=[ 184], 90.00th=[ 228], 95.00th=[ 266], | 99.00th=[ 351], 99.50th=[ 384], 99.90th=[ 489], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 63, per=24.87%, avg=24.12, stdev=12.31, samples=503 iops : min= 1, max= 15, avg= 5.41, stdev= 3.17, samples=503 lat (msec) : 10=3.68%, 20=18.29%, 50=19.66%, 100=26.43%, 250=28.29% lat (msec) : 500=3.61%, 1000=0.03% cpu : usr=0.04%, sys=1.38%, ctx=5362, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145431: Mon Jul 13 11:49:40 2026 read: IOPS=5, BW=23.2KiB/s (23.7kB/s)(5940KiB/256209msec) clat (msec): min=5, max=943, avg=34.69, stdev=43.25 lat (msec): min=5, max=943, avg=34.70, stdev=43.25 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 109], | 99.00th=[ 180], 99.50th=[ 218], 99.90th=[ 489], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 103, per=27.80%, avg=25.85, stdev=17.80, samples=445 iops : min= 1, max= 25, avg= 5.85, stdev= 4.50, samples=445 write: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6348KiB/256209msec); 0 zone resets clat (msec): min=30, max=478, avg=128.68, stdev=66.60 lat (msec): min=30, max=478, avg=128.68, stdev=66.60 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 97], 50.00th=[ 111], 60.00th=[ 129], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 220], 95.00th=[ 255], | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 447], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 64, per=25.19%, avg=24.44, stdev=12.31, samples=502 iops : min= 1, max= 16, avg= 5.49, stdev= 3.15, samples=502 lat (msec) : 10=4.36%, 20=17.97%, 50=19.01%, 100=26.37%, 250=29.26% lat (msec) : 500=2.99%, 1000=0.03% cpu : usr=0.05%, sys=1.44%, ctx=5412, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145433: Mon Jul 13 11:49:40 2026 read: IOPS=5, BW=23.5KiB/s (24.0kB/s)(6028KiB/256974msec) clat (msec): min=6, max=496, avg=35.92, stdev=38.92 lat (msec): min=6, max=496, avg=35.93, stdev=38.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 51], 90.00th=[ 79], 95.00th=[ 109], | 99.00th=[ 201], 99.50th=[ 249], 99.90th=[ 321], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 7, max= 103, per=27.81%, avg=25.86, stdev=18.66, samples=451 iops : min= 1, max= 25, avg= 5.86, stdev= 4.70, samples=451 write: IOPS=6, BW=24.4KiB/s (24.9kB/s)(6260KiB/256974msec); 0 zone resets clat (msec): min=33, max=952, avg=129.27, stdev=69.89 lat (msec): min=33, max=952, avg=129.28, stdev=69.89 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 111], 60.00th=[ 128], | 70.00th=[ 146], 80.00th=[ 176], 90.00th=[ 215], 95.00th=[ 259], | 99.00th=[ 363], 99.50th=[ 414], 99.90th=[ 502], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 63, per=24.90%, avg=24.15, stdev=12.12, samples=500 iops : min= 1, max= 15, avg= 5.42, stdev= 3.10, samples=500 lat (msec) : 10=3.97%, 20=17.61%, 50=18.72%, 100=27.12%, 250=29.10% lat (msec) : 500=3.42%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.38%, ctx=5314, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145434: Mon Jul 13 11:49:40 2026 read: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6052KiB/255497msec) clat (msec): min=6, max=428, avg=34.26, stdev=34.14 lat (msec): min=6, max=428, avg=34.27, stdev=34.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 101], | 99.00th=[ 163], 99.50th=[ 205], 99.90th=[ 284], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 127, per=28.51%, avg=26.52, stdev=18.41, samples=442 iops : min= 1, max= 31, avg= 6.02, stdev= 4.63, samples=442 write: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6236KiB/255497msec); 0 zone resets clat (msec): min=38, max=1096, avg=130.31, stdev=70.68 lat (msec): min=38, max=1096, avg=130.33, stdev=70.69 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 88], 40.00th=[ 97], 50.00th=[ 109], 60.00th=[ 127], | 70.00th=[ 150], 80.00th=[ 178], 90.00th=[ 228], 95.00th=[ 262], | 99.00th=[ 347], 99.50th=[ 380], 99.90th=[ 527], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 63, per=24.89%, avg=24.14, stdev=12.00, samples=498 iops : min= 1, max= 15, avg= 5.42, stdev= 3.07, samples=498 lat (msec) : 10=3.45%, 20=18.85%, 50=19.01%, 100=27.18%, 250=28.32% lat (msec) : 500=3.12%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.39%, ctx=5332, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=93.0KiB/s (95.3kB/s), 23.2KiB/s-23.7KiB/s (23.7kB/s-24.3kB/s), io=23.4MiB (24.6MB), run=255497-258079msec WRITE: bw=97.4KiB/s (99.7kB/s), 24.4KiB/s-24.8KiB/s (24.9kB/s-25.4kB/s), io=24.6MiB (25.7MB), run=255497-258079msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145489: Mon Jul 13 11:50:20 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(5920KiB/29724msec) clat (usec): min=31, max=332493, avg=44758.30, stdev=39695.28 lat (usec): min=31, max=332495, avg=44764.83, stdev=39699.88 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 50], 10.00th=[ 59], 20.00th=[ 13829], | 30.00th=[ 26608], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 55313], 80.00th=[ 64750], 90.00th=[ 86508], 95.00th=[114820], | 99.00th=[179307], 99.50th=[212861], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 63, max= 406, per=25.27%, avg=195.62, stdev=80.21, samples=58 iops : min= 3, max= 25, avg=11.47, stdev= 5.09, samples=58 write: IOPS=13, BW=214KiB/s (219kB/s)(6368KiB/29724msec); 0 zone resets clat (usec): min=1339, max=300936, avg=32220.58, stdev=34753.78 lat (usec): min=1341, max=300938, avg=32225.52, stdev=34751.30 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1860], 10.00th=[ 2474], 20.00th=[ 4490], | 30.00th=[ 7111], 40.00th=[ 11338], 50.00th=[ 21365], 60.00th=[ 30802], | 70.00th=[ 43254], 80.00th=[ 56361], 90.00th=[ 78119], 95.00th=[103285], | 99.00th=[135267], 99.50th=[147850], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 30, max= 382, per=26.19%, avg=213.17, stdev=80.90, samples=58 iops : min= 1, max= 23, avg=12.55, stdev= 5.09, samples=58 lat (usec) : 50=2.47%, 100=5.60%, 250=0.65%, 1000=0.13% lat (msec) : 2=4.17%, 4=5.60%, 10=9.38%, 20=8.20%, 50=33.85% lat (msec) : 100=23.05%, 250=6.64%, 500=0.26% cpu : usr=0.08%, sys=5.52%, ctx=1470, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145491: Mon Jul 13 11:50:20 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(5744KiB/30925msec) clat (usec): min=28, max=258848, avg=44677.71, stdev=35254.83 lat (usec): min=28, max=258849, avg=44679.17, stdev=35254.85 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 17171], | 30.00th=[ 26346], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 58459], 80.00th=[ 68682], 90.00th=[ 91751], 95.00th=[106431], | 99.00th=[160433], 99.50th=[212861], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 30, max= 380, per=24.78%, avg=191.81, stdev=82.63, samples=59 iops : min= 1, max= 23, avg=11.19, stdev= 5.16, samples=59 write: IOPS=13, BW=212KiB/s (217kB/s)(6544KiB/30925msec); 0 zone resets clat (usec): min=1084, max=274471, avg=35474.88, stdev=43344.72 lat (usec): min=1086, max=274472, avg=35477.28, stdev=43344.68 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1778], 10.00th=[ 2180], 20.00th=[ 4178], | 30.00th=[ 7570], 40.00th=[ 11076], 50.00th=[ 19006], 60.00th=[ 30278], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[212861], 99.50th=[258999], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 62, max= 507, per=26.36%, avg=214.53, stdev=98.47, samples=60 iops : min= 3, max= 31, avg=12.63, stdev= 6.18, samples=60 lat (usec) : 50=1.30%, 100=6.51%, 250=0.39%, 750=0.13% lat (msec) : 2=4.43%, 4=5.34%, 10=10.55%, 20=8.72%, 50=32.42% lat (msec) : 100=23.05%, 250=6.64%, 500=0.52% cpu : usr=0.07%, sys=5.04%, ctx=1456, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145493: Mon Jul 13 11:50:20 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(6256KiB/30128msec) clat (usec): min=37, max=175222, avg=41477.63, stdev=30741.72 lat (usec): min=37, max=175223, avg=41481.50, stdev=30751.37 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 71], 20.00th=[ 19268], | 30.00th=[ 25822], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[160433], 99.50th=[173016], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 63, max= 411, per=26.85%, avg=207.81, stdev=80.39, samples=59 iops : min= 3, max= 25, avg=12.22, stdev= 5.03, samples=59 write: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30128msec); 0 zone resets clat (usec): min=1227, max=386654, avg=36553.09, stdev=45252.71 lat (usec): min=1231, max=386655, avg=36557.79, stdev=45251.14 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1893], 10.00th=[ 2671], 20.00th=[ 4883], | 30.00th=[ 8848], 40.00th=[ 14353], 50.00th=[ 22676], 60.00th=[ 31065], | 70.00th=[ 44827], 80.00th=[ 58983], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[193987], 99.50th=[358613], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 63, max= 382, per=24.21%, avg=197.07, stdev=77.00, samples=59 iops : min= 3, max= 23, avg=11.54, stdev= 4.86, samples=59 lat (usec) : 50=0.91%, 100=5.86%, 250=1.04%, 500=0.26% lat (msec) : 2=3.12%, 4=5.21%, 10=7.94%, 20=9.64%, 50=35.81% lat (msec) : 100=24.87%, 250=4.95%, 500=0.39% cpu : usr=0.07%, sys=4.82%, ctx=1443, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145494: Mon Jul 13 11:50:20 2026 read: IOPS=12, BW=199KiB/s (203kB/s)(6032KiB/30374msec) clat (usec): min=36, max=225890, avg=40454.94, stdev=32880.94 lat (usec): min=36, max=225891, avg=40456.78, stdev=32881.29 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 60], 20.00th=[ 97], | 30.00th=[ 23462], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[127402], 99.50th=[196084], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 477, per=26.52%, avg=205.29, stdev=90.80, samples=58 iops : min= 1, max= 29, avg=12.05, stdev= 5.70, samples=58 write: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30374msec); 0 zone resets clat (usec): min=1242, max=283332, avg=37896.08, stdev=43231.90 lat (usec): min=1244, max=283334, avg=37903.20, stdev=43229.02 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1860], 10.00th=[ 2835], 20.00th=[ 5211], | 30.00th=[ 8291], 40.00th=[ 14353], 50.00th=[ 23200], 60.00th=[ 32900], | 70.00th=[ 47449], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[124257], | 99.00th=[198181], 99.50th=[210764], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 30, max= 414, per=25.33%, avg=206.22, stdev=81.19, samples=60 iops : min= 1, max= 25, avg=12.12, stdev= 5.08, samples=60 lat (usec) : 50=1.17%, 100=8.98%, 250=0.65%, 500=0.26% lat (msec) : 2=3.65%, 4=3.91%, 10=10.42%, 20=6.90%, 50=32.81% lat (msec) : 100=25.52%, 250=5.60%, 500=0.13% cpu : usr=0.07%, sys=5.21%, ctx=1445, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=775KiB/s (793kB/s), 186KiB/s-208KiB/s (190kB/s-213kB/s), io=23.4MiB (24.5MB), run=29724-30925msec WRITE: bw=815KiB/s (834kB/s), 200KiB/s-214KiB/s (205kB/s-219kB/s), io=24.6MiB (25.8MB), run=29724-30925msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145487: Mon Jul 13 11:50:58 2026 read: IOPS=5, BW=85.3KiB/s (87.4kB/s)(5920KiB/69383msec) clat (msec): min=7, max=374, avg=41.17, stdev=43.01 lat (msec): min=7, max=374, avg=41.17, stdev=43.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 271], 99.50th=[ 313], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 30, max= 350, per=27.58%, avg=94.86, stdev=63.05, samples=122 iops : min= 1, max= 21, avg= 5.16, stdev= 4.01, samples=122 write: IOPS=5, BW=91.8KiB/s (93.0kB/s)(6368KiB/69383msec); 0 zone resets clat (msec): min=32, max=538, avg=135.15, stdev=74.96 lat (msec): min=32, max=538, avg=135.16, stdev=74.95 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 129], | 70.00th=[ 146], 80.00th=[ 180], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 409], 99.50th=[ 502], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 224, per=25.63%, avg=92.54, stdev=47.36, samples=135 iops : min= 1, max= 14, avg= 5.01, stdev= 3.06, samples=135 lat (msec) : 10=1.56%, 20=13.28%, 50=24.09%, 100=24.87%, 250=31.77% lat (msec) : 500=4.17%, 750=0.26% cpu : usr=0.05%, sys=1.50%, ctx=1441, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145488: Mon Jul 13 11:50:58 2026 read: IOPS=5, BW=82.5KiB/s (84.5kB/s)(5744KiB/69618msec) clat (msec): min=6, max=344, avg=42.65, stdev=43.79 lat (msec): min=6, max=344, avg=42.65, stdev=43.79 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 92], 95.00th=[ 134], | 99.00th=[ 215], 99.50th=[ 275], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 29, max= 315, per=28.05%, avg=96.49, stdev=59.32, samples=116 iops : min= 1, max= 19, avg= 5.27, stdev= 3.77, samples=116 write: IOPS=5, BW=93.0KiB/s (96.3kB/s)(6544KiB/69618msec); 0 zone resets clat (msec): min=39, max=572, avg=132.52, stdev=73.39 lat (msec): min=39, max=572, avg=132.52, stdev=73.39 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 113], 60.00th=[ 129], | 70.00th=[ 153], 80.00th=[ 184], 90.00th=[ 215], 95.00th=[ 284], | 99.00th=[ 384], 99.50th=[ 405], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 29, max= 221, per=26.96%, avg=97.33, stdev=46.28, samples=131 iops : min= 1, max= 13, avg= 5.32, stdev= 3.00, samples=131 lat (msec) : 10=2.21%, 20=11.85%, 50=24.22%, 100=26.04%, 250=31.64% lat (msec) : 500=3.91%, 750=0.13% cpu : usr=0.04%, sys=1.50%, ctx=1450, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145490: Mon Jul 13 11:50:58 2026 read: IOPS=5, BW=92.8KiB/s (95.0kB/s)(6256KiB/67417msec) clat (msec): min=7, max=287, avg=38.58, stdev=37.47 lat (msec): min=7, max=287, avg=38.58, stdev=37.47 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 77], 95.00th=[ 120], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 416, per=31.01%, avg=106.69, stdev=75.15, samples=116 iops : min= 1, max= 26, avg= 5.91, stdev= 4.75, samples=116 write: IOPS=5, BW=89.5KiB/s (91.6kB/s)(6032KiB/67417msec); 0 zone resets clat (msec): min=33, max=517, avg=138.00, stdev=77.81 lat (msec): min=33, max=517, avg=138.00, stdev=77.81 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 153], 80.00th=[ 186], 90.00th=[ 239], 95.00th=[ 300], | 99.00th=[ 418], 99.50th=[ 502], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 30, max= 192, per=25.33%, avg=91.43, stdev=42.41, samples=129 iops : min= 1, max= 12, avg= 4.94, stdev= 2.72, samples=129 lat (msec) : 10=0.39%, 20=16.02%, 50=26.30%, 100=24.22%, 250=28.26% lat (msec) : 500=4.69%, 750=0.13% cpu : usr=0.04%, sys=1.51%, ctx=1485, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145492: Mon Jul 13 11:50:58 2026 read: IOPS=5, BW=87.3KiB/s (89.4kB/s)(6032KiB/69072msec) clat (msec): min=7, max=346, avg=40.60, stdev=39.07 lat (msec): min=7, max=346, avg=40.60, stdev=39.07 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 74], 95.00th=[ 123], | 99.00th=[ 209], 99.50th=[ 262], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 318, per=28.92%, avg=99.47, stdev=61.30, samples=118 iops : min= 1, max= 19, avg= 5.45, stdev= 3.89, samples=118 write: IOPS=5, BW=90.6KiB/s (92.7kB/s)(6256KiB/69072msec); 0 zone resets clat (msec): min=32, max=517, avg=136.84, stdev=76.49 lat (msec): min=32, max=517, avg=136.84, stdev=76.49 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 54], 10.00th=[ 64], 20.00th=[ 79], | 30.00th=[ 91], 40.00th=[ 101], 50.00th=[ 115], 60.00th=[ 131], | 70.00th=[ 153], 80.00th=[ 190], 90.00th=[ 241], 95.00th=[ 288], | 99.00th=[ 439], 99.50th=[ 498], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 30, max= 223, per=25.48%, avg=91.99, stdev=45.57, samples=133 iops : min= 1, max= 13, avg= 4.98, stdev= 2.94, samples=133 lat (msec) : 10=1.30%, 20=11.33%, 50=26.82%, 100=26.69%, 250=29.04% lat (msec) : 500=4.69%, 750=0.13% cpu : usr=0.03%, sys=1.51%, ctx=1429, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=344KiB/s (352kB/s), 82.5KiB/s-92.8KiB/s (84.5kB/s-95.0kB/s), io=23.4MiB (24.5MB), run=67417-69618msec WRITE: bw=362KiB/s (371kB/s), 89.5KiB/s-93.0KiB/s (91.6kB/s-96.3kB/s), io=24.6MiB (25.8MB), run=67417-69618msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145509: Mon Jul 13 11:51:11 2026 read: IOPS=2, BW=2286KiB/s (2341kB/s)(7168KiB/3136msec) clat (usec): min=554, max=467147, avg=262167.23, stdev=162422.60 lat (usec): min=557, max=467149, avg=262169.03, stdev=162422.53 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[193987], | 30.00th=[208667], 40.00th=[208667], 50.00th=[238027], 60.00th=[265290], | 70.00th=[265290], 80.00th=[463471], 90.00th=[467665], 95.00th=[467665], | 99.00th=[467665], 99.50th=[467665], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 1943, max= 4096, per=49.30%, avg=2694.00, stdev=1004.16, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1633KiB/s (1672kB/s)(5120KiB/3136msec); 0 zone resets clat (msec): min=118, max=424, avg=235.41, stdev=114.77 lat (msec): min=118, max=424, avg=235.51, stdev=114.77 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2048, max= 5555, per=49.70%, avg=3801.50, stdev=2479.82, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=33.33% cpu : usr=0.06%, sys=12.54%, ctx=210, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145510: Mon Jul 13 11:51:11 2026 read: IOPS=0, BW=546KiB/s (560kB/s)(2048KiB/3748msec) clat (usec): min=621, max=272284, avg=136452.77, stdev=192094.42 lat (usec): min=622, max=272286, avg=136454.80, stdev=192095.48 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 619], 60.00th=[270533], | 70.00th=[270533], 80.00th=[270533], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1965, max= 2007, per=36.35%, avg=1986.00, stdev=29.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2732KiB/s (2798kB/s)(10.0MiB/3748msec); 0 zone resets clat (msec): min=85, max=655, avg=335.36, stdev=160.24 lat (msec): min=85, max=655, avg=335.56, stdev=160.20 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 178], | 30.00th=[ 259], 40.00th=[ 292], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 330], 80.00th=[ 426], 90.00th=[ 493], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2003, max= 4071, per=38.66%, avg=2956.83, stdev=1024.41, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=66.67%, 750=8.33% cpu : usr=0.00%, sys=12.28%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145511: Mon Jul 13 11:51:11 2026 read: IOPS=1, BW=1664KiB/s (1704kB/s)(6144KiB/3693msec) clat (usec): min=534, max=485317, avg=234129.08, stdev=198431.95 lat (usec): min=536, max=485318, avg=234130.63, stdev=198431.61 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 6259], | 30.00th=[ 6259], 40.00th=[256902], 50.00th=[256902], 60.00th=[261096], | 70.00th=[396362], 80.00th=[396362], 90.00th=[484443], 95.00th=[484443], | 99.00th=[484443], 99.50th=[484443], 99.90th=[484443], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 1851, max= 3886, per=44.71%, avg=2443.00, stdev=965.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1664KiB/s (1704kB/s)(6144KiB/3693msec); 0 zone resets clat (msec): min=182, max=724, avg=375.79, stdev=213.10 lat (msec): min=182, max=724, avg=376.07, stdev=212.91 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 451], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1943, max= 2786, per=28.83%, avg=2205.00, stdev=390.34, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=50.00%, 750=8.33% cpu : usr=0.05%, sys=9.62%, ctx=140, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145512: Mon Jul 13 11:51:11 2026 read: IOPS=1, BW=1501KiB/s (1537kB/s)(5120KiB/3411msec) clat (usec): min=355, max=387275, avg=154723.73, stdev=211082.25 lat (usec): min=356, max=387278, avg=154725.20, stdev=211082.57 clat percentiles (usec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[ 881], 60.00th=[ 881], | 70.00th=[383779], 80.00th=[383779], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7406, max= 7406, per=100.00%, avg=7406.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2101KiB/s (2152kB/s)(7168KiB/3411msec); 0 zone resets clat (msec): min=169, max=691, avg=361.31, stdev=182.99 lat (msec): min=169, max=691, avg=361.58, stdev=182.95 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 207], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 342], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 510], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1367, max= 4096, per=37.72%, avg=2885.50, stdev=1415.76, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 250=16.67%, 500=41.67%, 750=16.67% cpu : usr=0.09%, sys=12.29%, ctx=154, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5464KiB/s (5595kB/s), 546KiB/s-2286KiB/s (560kB/s-2341kB/s), io=20.0MiB (20.0MB), run=3136-3748msec WRITE: bw=7650KiB/s (7834kB/s), 1633KiB/s-2732KiB/s (1672kB/s-2798kB/s), io=28.0MiB (29.4MB), run=3136-3748msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145514: Mon Jul 13 11:51:12 2026 read: IOPS=1, BW=1973KiB/s (2020kB/s)(7168KiB/3633msec) clat (msec): min=112, max=767, avg=298.90, stdev=270.96 lat (msec): min=112, max=767, avg=298.90, stdev=270.96 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 123], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 157], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 609], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1878, max= 4087, per=49.55%, avg=2410.20, stdev=939.72, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1409KiB/s (1443kB/s)(5120KiB/3633msec); 0 zone resets clat (msec): min=181, max=472, avg=286.61, stdev=120.24 lat (msec): min=181, max=472, avg=286.85, stdev=120.12 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2048, max= 4087, per=49.72%, avg=3386.00, stdev=1159.18, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (msec) : 250=66.67%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=5.97%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145515: Mon Jul 13 11:51:12 2026 read: IOPS=0, BW=506KiB/s (518kB/s)(2048KiB/4048msec) clat (msec): min=160, max=164, avg=162.36, stdev= 2.79 lat (msec): min=160, max=164, avg=162.36, stdev= 2.79 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 165], 95.00th=[ 165], | 99.00th=[ 165], 99.50th=[ 165], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 1440, max= 2048, per=35.86%, avg=1744.00, stdev=429.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2530KiB/s (2590kB/s)(10.0MiB/4048msec); 0 zone resets clat (msec): min=162, max=952, avg=370.59, stdev=240.90 lat (msec): min=162, max=953, avg=370.71, stdev=240.93 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 186], | 30.00th=[ 224], 40.00th=[ 262], 50.00th=[ 279], 60.00th=[ 288], | 70.00th=[ 317], 80.00th=[ 451], 90.00th=[ 592], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2003, max= 4087, per=47.69%, avg=3248.00, stdev=1116.37, samples=5 iops : min= 1, max= 3, avg= 2.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.84%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145516: Mon Jul 13 11:51:12 2026 read: IOPS=1, BW=1597KiB/s (1635kB/s)(6144KiB/3848msec) clat (msec): min=108, max=407, avg=218.89, stdev=109.93 lat (msec): min=108, max=407, avg=218.89, stdev=109.93 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 234], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2011, max= 4087, per=55.79%, avg=2713.67, stdev=1189.45, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1597KiB/s (1635kB/s)(6144KiB/3848msec); 0 zone resets clat (msec): min=168, max=772, avg=406.26, stdev=251.79 lat (msec): min=168, max=772, avg=406.48, stdev=251.69 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 321], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1996, max= 2048, per=29.69%, avg=2021.80, stdev=22.55, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.05%, sys=4.78%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145517: Mon Jul 13 11:51:12 2026 read: IOPS=1, BW=1216KiB/s (1245kB/s)(5120KiB/4210msec) clat (msec): min=92, max=441, avg=232.09, stdev=145.84 lat (msec): min=92, max=441, avg=232.09, stdev=145.84 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2011, max= 4096, per=55.85%, avg=2716.67, stdev=1194.64, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1703KiB/s (1743kB/s)(7168KiB/4210msec); 0 zone resets clat (msec): min=200, max=753, avg=425.20, stdev=250.21 lat (msec): min=200, max=753, avg=425.30, stdev=250.22 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 213], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 266], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 693], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1402, max= 2043, per=27.89%, avg=1899.60, stdev=278.70, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.75%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4865KiB/s (4981kB/s), 506KiB/s-1973KiB/s (518kB/s-2020kB/s), io=20.0MiB (20.0MB), run=3633-4210msec WRITE: bw=6810KiB/s (6974kB/s), 1409KiB/s-2530KiB/s (1443kB/s-2590kB/s), io=28.0MiB (29.4MB), run=3633-4210msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145524: Mon Jul 13 11:51:28 2026 read: IOPS=0, BW=2064KiB/s (2113kB/s)(12.0MiB/5954msec) clat (msec): min=844, max=3957, avg=1945.86, stdev=1744.70 lat (msec): min=844, max=3957, avg=1945.87, stdev=1744.70 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8062, max= 8078, per=100.00%, avg=8070.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=8.75%, ctx=694, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145525: Mon Jul 13 11:51:28 2026 read: IOPS=0, BW=669KiB/s (685kB/s)(4096KiB/6124msec) clat (nsec): min=3911.7M, max=3911.7M, avg=3911677599.00, stdev= 0.00 lat (nsec): min=3911.7M, max=3911.7M, avg=3911680174.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3910], 5.00th=[ 3910], 10.00th=[ 3910], 20.00th=[ 3910], | 30.00th=[ 3910], 40.00th=[ 3910], 50.00th=[ 3910], 60.00th=[ 3910], | 70.00th=[ 3910], 80.00th=[ 3910], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1338KiB/s (1370kB/s)(8192KiB/6124msec); 0 zone resets clat (msec): min=522, max=1550, avg=1036.74, stdev=727.07 lat (msec): min=525, max=1551, avg=1038.32, stdev=725.65 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.08%, sys=4.26%, ctx=500, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145526: Mon Jul 13 11:51:28 2026 write: IOPS=0, BW=1950KiB/s (1997kB/s)(12.0MiB/6302msec); 0 zone resets clat (msec): min=876, max=4361, avg=2069.74, stdev=1985.62 lat (msec): min=876, max=4362, avg=2072.53, stdev=1983.80 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 8015, max= 8110, per=100.00%, avg=8062.50, stdev=67.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.05%, sys=3.60%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145527: Mon Jul 13 11:51:28 2026 write: IOPS=0, BW=2136KiB/s (2188kB/s)(12.0MiB/5752msec); 0 zone resets clat (msec): min=445, max=4517, avg=1863.05, stdev=2300.23 lat (msec): min=446, max=4517, avg=1863.60, stdev=2300.07 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 4530], 80.00th=[ 4530], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 8078, max= 8143, per=100.00%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.42%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2675KiB/s (2740kB/s), 669KiB/s-2064KiB/s (685kB/s-2113kB/s), io=16.0MiB (16.8MB), run=5954-6124msec WRITE: bw=5200KiB/s (5324kB/s), 1338KiB/s-2136KiB/s (1370kB/s-2188kB/s), io=32.0MiB (33.6MB), run=5752-6302msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145529: Mon Jul 13 11:51:29 2026 read: IOPS=0, BW=2035KiB/s (2084kB/s)(12.0MiB/6039msec) clat (msec): min=569, max=3816, avg=2012.42, stdev=1653.69 lat (msec): min=569, max=3816, avg=2012.42, stdev=1653.69 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 7984, max= 8143, per=100.00%, avg=8063.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.69%, ctx=35, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145530: Mon Jul 13 11:51:29 2026 read: IOPS=0, BW=644KiB/s (660kB/s)(4096KiB/6359msec) clat (nsec): min=4050.8M, max=4050.8M, avg=4050815893.00, stdev= 0.00 lat (nsec): min=4050.8M, max=4050.8M, avg=4050817157.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4044], 5.00th=[ 4044], 10.00th=[ 4044], 20.00th=[ 4044], | 30.00th=[ 4044], 40.00th=[ 4044], 50.00th=[ 4044], 60.00th=[ 4044], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1288KiB/s (1319kB/s)(8192KiB/6359msec); 0 zone resets clat (msec): min=561, max=1741, avg=1151.41, stdev=834.20 lat (msec): min=562, max=1743, avg=1153.41, stdev=835.12 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=2.33%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145531: Mon Jul 13 11:51:29 2026 write: IOPS=0, BW=1927KiB/s (1973kB/s)(12.0MiB/6377msec); 0 zone resets clat (msec): min=415, max=4317, avg=2109.97, stdev=2001.05 lat (msec): min=415, max=4318, avg=2112.31, stdev=2000.51 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 7876, max= 8062, per=100.00%, avg=7969.00, stdev=131.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.15%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145532: Mon Jul 13 11:51:29 2026 write: IOPS=0, BW=2286KiB/s (2341kB/s)(12.0MiB/5375msec); 0 zone resets clat (msec): min=335, max=4652, avg=1781.13, stdev=2486.92 lat (msec): min=336, max=4653, avg=1781.95, stdev=2487.07 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 4665], 80.00th=[ 4665], 90.00th=[ 4665], 95.00th=[ 4665], | 99.00th=[ 4665], 99.50th=[ 4665], 99.90th=[ 4665], 99.95th=[ 4665], | 99.99th=[ 4665] bw ( KiB/s): min= 6714, max= 8110, per=100.00%, avg=7412.00, stdev=987.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.99%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2577KiB/s (2638kB/s), 644KiB/s-2035KiB/s (660kB/s-2084kB/s), io=16.0MiB (16.8MB), run=6039-6359msec WRITE: bw=5138KiB/s (5262kB/s), 1288KiB/s-2286KiB/s (1319kB/s-2341kB/s), io=32.0MiB (33.6MB), run=5375-6377msec