== sanity test 398b: DIO and buffer IO race ============== 15:35:55 (1787859355) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.0697 s, 7.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179397: Thu Aug 27 15:38:26 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(5992KiB/131086msec) clat (usec): min=42, max=262738, avg=47390.31, stdev=30784.52 lat (usec): min=43, max=262740, avg=47405.31, stdev=30787.94 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 13829], 10.00th=[ 18744], 20.00th=[ 24511], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[160433], 99.50th=[187696], 99.90th=[244319], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 95, per=24.80%, avg=45.38, stdev=17.89, samples=256 iops : min= 1, max= 23, avg=10.69, stdev= 4.50, samples=256 write: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6296KiB/131086msec); 0 zone resets clat (usec): min=978, max=818908, avg=37848.97, stdev=42135.59 lat (usec): min=980, max=818909, avg=37852.82, stdev=42137.94 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1745], 10.00th=[ 2933], 20.00th=[ 5145], | 30.00th=[ 8848], 40.00th=[ 17957], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 64226], 90.00th=[ 87557], 95.00th=[113771], | 99.00th=[160433], 99.50th=[185598], 99.90th=[265290], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 127, per=24.94%, avg=47.63, stdev=21.06, samples=257 iops : min= 1, max= 31, avg=11.25, stdev= 5.29, samples=257 lat (usec) : 50=0.03%, 100=1.30%, 250=0.23%, 750=0.10%, 1000=0.10% lat (msec) : 2=3.32%, 4=4.79%, 10=8.59%, 20=9.31%, 50=39.10% lat (msec) : 100=26.76%, 250=6.28%, 500=0.07%, 1000=0.03% cpu : usr=0.10%, sys=5.57%, ctx=7028, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179398: Thu Aug 27 15:38:26 2026 read: IOPS=11, BW=45.9KiB/s (47.0kB/s)(5940KiB/129353msec) clat (usec): min=50, max=314636, avg=46606.27, stdev=29533.61 lat (usec): min=50, max=314637, avg=46608.53, stdev=29533.20 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 11994], 10.00th=[ 18744], 20.00th=[ 24511], | 30.00th=[ 28967], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[ 98042], | 99.00th=[141558], 99.50th=[160433], 99.90th=[278922], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 95, per=24.90%, avg=45.57, stdev=17.46, samples=253 iops : min= 1, max= 23, avg=10.74, stdev= 4.41, samples=253 write: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6348KiB/129353msec); 0 zone resets clat (usec): min=1054, max=806949, avg=37590.59, stdev=42559.61 lat (usec): min=1056, max=806951, avg=37599.84, stdev=42555.74 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1598], 10.00th=[ 2409], 20.00th=[ 4752], | 30.00th=[ 8717], 40.00th=[ 18482], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 46400], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[162530], 99.50th=[202376], 99.90th=[316670], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 143, per=25.38%, avg=48.48, stdev=22.58, samples=254 iops : min= 1, max= 35, avg=11.46, stdev= 5.68, samples=254 lat (usec) : 100=1.63%, 250=0.33%, 500=0.07%, 1000=0.03% lat (msec) : 2=3.91%, 4=5.14%, 10=7.58%, 20=8.37%, 50=41.47% lat (msec) : 100=25.75%, 250=5.47%, 500=0.23%, 1000=0.03% cpu : usr=0.10%, sys=5.79%, ctx=6948, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179399: Thu Aug 27 15:38:26 2026 read: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6028KiB/126368msec) clat (usec): min=45, max=770454, avg=46450.24, stdev=36024.49 lat (usec): min=46, max=770455, avg=46456.44, stdev=36023.11 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 586], 10.00th=[ 16909], 20.00th=[ 22938], | 30.00th=[ 28705], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 65274], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[162530], 99.50th=[196084], 99.90th=[304088], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 118, per=25.85%, avg=47.30, stdev=18.86, samples=248 iops : min= 1, max= 29, avg=11.17, stdev= 4.76, samples=248 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6260KiB/126368msec); 0 zone resets clat (usec): min=1039, max=330324, avg=35644.46, stdev=37228.45 lat (usec): min=1041, max=330325, avg=35651.96, stdev=37227.20 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1598], 10.00th=[ 2638], 20.00th=[ 4752], | 30.00th=[ 7898], 40.00th=[ 14484], 50.00th=[ 24773], 60.00th=[ 35390], | 70.00th=[ 46924], 80.00th=[ 61080], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[160433], 99.50th=[183501], 99.90th=[270533], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 134, per=25.83%, avg=49.33, stdev=22.99, samples=247 iops : min= 1, max= 33, avg=11.68, stdev= 5.80, samples=247 lat (usec) : 50=0.26%, 100=1.53%, 250=0.55%, 500=0.10%, 750=0.03% lat (msec) : 2=3.74%, 4=4.62%, 10=9.47%, 20=10.03%, 50=38.25% lat (msec) : 100=25.94%, 250=5.27%, 500=0.16%, 1000=0.03% cpu : usr=0.11%, sys=5.92%, ctx=6747, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179400: Thu Aug 27 15:38:26 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6052KiB/131005msec) clat (usec): min=34, max=888700, avg=47674.44, stdev=38310.68 lat (usec): min=35, max=888701, avg=47681.33, stdev=38309.74 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 404], 10.00th=[ 17171], 20.00th=[ 23200], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[162530], 99.50th=[185598], 99.90th=[246416], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 119, per=25.08%, avg=45.89, stdev=17.65, samples=256 iops : min= 1, max= 29, avg=10.82, stdev= 4.43, samples=256 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6236KiB/131005msec); 0 zone resets clat (usec): min=1077, max=317098, avg=37434.57, stdev=38833.30 lat (usec): min=1078, max=317099, avg=37438.32, stdev=38833.98 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1549], 10.00th=[ 2606], 20.00th=[ 5014], | 30.00th=[ 8848], 40.00th=[ 17695], 50.00th=[ 27132], 60.00th=[ 36963], | 70.00th=[ 47973], 80.00th=[ 63701], 90.00th=[ 88605], 95.00th=[111674], | 99.00th=[179307], 99.50th=[212861], 99.90th=[256902], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 136, per=24.65%, avg=47.07, stdev=21.16, samples=257 iops : min= 1, max= 34, avg=11.11, stdev= 5.34, samples=257 lat (usec) : 50=0.20%, 100=1.92%, 250=0.23%, 500=0.13%, 750=0.10% lat (msec) : 2=3.94%, 4=4.20%, 10=8.33%, 20=9.18%, 50=38.96% lat (msec) : 100=26.17%, 250=6.51%, 500=0.10%, 1000=0.03% cpu : usr=0.10%, sys=5.60%, ctx=6926, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=183KiB/s (188kB/s), 45.7KiB/s-47.7KiB/s (46.8kB/s-48.8kB/s), io=23.4MiB (24.6MB), run=126368-131086msec WRITE: bw=192KiB/s (196kB/s), 47.6KiB/s-49.5KiB/s (48.7kB/s-50.7kB/s), io=24.6MiB (25.7MB), run=126368-131086msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179402: Thu Aug 27 15:39:12 2026 read: IOPS=8, BW=33.9KiB/s (34.8kB/s)(5992KiB/176511msec) clat (msec): min=5, max=1136, avg=45.94, stdev=46.95 lat (msec): min=5, max=1136, avg=45.94, stdev=46.96 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 64], 90.00th=[ 101], 95.00th=[ 127], | 99.00th=[ 188], 99.50th=[ 222], 99.90th=[ 257], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 126, per=25.36%, avg=34.24, stdev=22.07, samples=340 iops : min= 1, max= 31, avg= 7.89, stdev= 5.58, samples=340 write: IOPS=8, BW=35.7KiB/s (36.5kB/s)(6296KiB/176511msec); 0 zone resets clat (msec): min=12, max=410, avg=68.30, stdev=45.29 lat (msec): min=12, max=410, avg=68.30, stdev=45.29 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 80], 80.00th=[ 100], 90.00th=[ 127], 95.00th=[ 153], | 99.00th=[ 230], 99.50th=[ 255], 99.90th=[ 393], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 103, per=24.94%, avg=35.41, stdev=19.57, samples=345 iops : min= 1, max= 25, avg= 8.18, stdev= 4.95, samples=345 lat (msec) : 10=1.14%, 20=11.23%, 50=45.31%, 100=27.47%, 250=14.42% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.07%, sys=1.90%, ctx=4770, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179403: Thu Aug 27 15:39:12 2026 read: IOPS=8, BW=33.6KiB/s (34.4kB/s)(5940KiB/176775msec) clat (msec): min=6, max=885, avg=47.04, stdev=44.56 lat (msec): min=6, max=885, avg=47.04, stdev=44.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 69], 90.00th=[ 107], 95.00th=[ 133], | 99.00th=[ 184], 99.50th=[ 201], 99.90th=[ 239], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 111, per=25.71%, avg=34.71, stdev=21.67, samples=331 iops : min= 1, max= 27, avg= 8.00, stdev= 5.46, samples=331 write: IOPS=8, BW=35.9KiB/s (36.8kB/s)(6348KiB/176775msec); 0 zone resets clat (msec): min=12, max=426, avg=67.26, stdev=45.66 lat (msec): min=12, max=426, avg=67.26, stdev=45.66 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 77], 80.00th=[ 96], 90.00th=[ 129], 95.00th=[ 159], | 99.00th=[ 224], 99.50th=[ 257], 99.90th=[ 355], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 111, per=25.07%, avg=35.60, stdev=20.96, samples=344 iops : min= 1, max= 27, avg= 8.23, stdev= 5.31, samples=344 lat (msec) : 10=1.40%, 20=11.72%, 50=44.63%, 100=27.34%, 250=14.58% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.08%, sys=1.88%, ctx=4853, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179404: Thu Aug 27 15:39:12 2026 read: IOPS=8, BW=34.2KiB/s (34.0kB/s)(6028KiB/176458msec) clat (msec): min=5, max=320, avg=45.78, stdev=38.10 lat (msec): min=5, max=320, avg=45.79, stdev=38.10 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 96], 95.00th=[ 129], | 99.00th=[ 180], 99.50th=[ 220], 99.90th=[ 262], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 103, per=25.43%, avg=34.33, stdev=20.69, samples=341 iops : min= 1, max= 25, avg= 7.91, stdev= 5.23, samples=341 write: IOPS=8, BW=35.5KiB/s (36.3kB/s)(6260KiB/176458msec); 0 zone resets clat (msec): min=10, max=898, avg=68.54, stdev=49.65 lat (msec): min=10, max=898, avg=68.54, stdev=49.65 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 80], 80.00th=[ 100], 90.00th=[ 129], 95.00th=[ 153], | 99.00th=[ 222], 99.50th=[ 266], 99.90th=[ 464], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 103, per=24.94%, avg=35.42, stdev=20.50, samples=343 iops : min= 1, max= 25, avg= 8.18, stdev= 5.18, samples=343 lat (msec) : 10=1.04%, 20=11.52%, 50=44.99%, 100=27.83%, 250=14.19% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.07%, sys=1.92%, ctx=4901, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179405: Thu Aug 27 15:39:12 2026 read: IOPS=8, BW=34.5KiB/s (35.3kB/s)(6052KiB/175667msec) clat (msec): min=6, max=232, avg=45.96, stdev=37.86 lat (msec): min=6, max=232, avg=45.96, stdev=37.86 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 97], 95.00th=[ 129], | 99.00th=[ 190], 99.50th=[ 209], 99.90th=[ 222], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7, max= 127, per=25.72%, avg=34.72, stdev=21.34, samples=338 iops : min= 1, max= 31, avg= 8.00, stdev= 5.39, samples=338 write: IOPS=8, BW=35.5KiB/s (36.3kB/s)(6236KiB/175667msec); 0 zone resets clat (msec): min=9, max=869, avg=67.95, stdev=50.80 lat (msec): min=9, max=869, avg=67.96, stdev=50.80 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 75], 80.00th=[ 97], 90.00th=[ 126], 95.00th=[ 159], | 99.00th=[ 241], 99.50th=[ 330], 99.90th=[ 460], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 102, per=24.74%, avg=35.13, stdev=20.06, samples=344 iops : min= 1, max= 25, avg= 8.11, stdev= 5.06, samples=344 lat (msec) : 10=1.20%, 20=10.71%, 50=45.77%, 100=28.26%, 250=13.57% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.07%, sys=1.88%, ctx=4711, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=136KiB/s (139kB/s), 33.6KiB/s-34.5KiB/s (34.4kB/s-35.3kB/s), io=23.4MiB (24.6MB), run=175667-176775msec WRITE: bw=142KiB/s (146kB/s), 35.5KiB/s-35.9KiB/s (36.3kB/s-36.8kB/s), io=24.6MiB (25.7MB), run=175667-176775msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179448: Thu Aug 27 15:40:01 2026 read: IOPS=10, BW=161KiB/s (164kB/s)(5920KiB/36874msec) clat (usec): min=47, max=252340, avg=55051.17, stdev=36543.20 lat (usec): min=48, max=252341, avg=55052.86, stdev=36543.01 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 82], 10.00th=[ 14877], 20.00th=[ 28181], | 30.00th=[ 34866], 40.00th=[ 42206], 50.00th=[ 49021], 60.00th=[ 57410], | 70.00th=[ 67634], 80.00th=[ 78119], 90.00th=[103285], 95.00th=[119014], | 99.00th=[173016], 99.50th=[187696], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 351, per=25.37%, avg=161.10, stdev=72.86, samples=71 iops : min= 1, max= 21, avg= 9.24, stdev= 4.58, samples=71 write: IOPS=10, BW=173KiB/s (177kB/s)(6368KiB/36874msec); 0 zone resets clat (usec): min=1406, max=255845, avg=40939.44, stdev=40142.71 lat (usec): min=1408, max=255847, avg=40967.41, stdev=40149.78 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2180], 10.00th=[ 4424], 20.00th=[ 7570], | 30.00th=[ 11338], 40.00th=[ 19792], 50.00th=[ 27395], 60.00th=[ 40109], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[130548], | 99.00th=[164627], 99.50th=[191890], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 319, per=25.73%, avg=171.86, stdev=73.24, samples=72 iops : min= 1, max= 19, avg= 9.93, stdev= 4.63, samples=72 lat (usec) : 50=0.13%, 100=2.86%, 250=0.52%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.34%, 4=2.08%, 10=9.64%, 20=8.59%, 50=33.20% lat (msec) : 100=29.56%, 250=10.16%, 500=0.26% cpu : usr=0.07%, sys=5.31%, ctx=1749, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179449: Thu Aug 27 15:40:01 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(5744KiB/35832msec) clat (usec): min=43, max=179420, avg=53067.39, stdev=34129.34 lat (usec): min=43, max=179421, avg=53084.29, stdev=34125.64 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 73], 10.00th=[ 371], 20.00th=[ 30278], | 30.00th=[ 36963], 40.00th=[ 42730], 50.00th=[ 48497], 60.00th=[ 55313], | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[100140], 95.00th=[116917], | 99.00th=[166724], 99.50th=[177210], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 59, max= 287, per=25.15%, avg=159.69, stdev=56.13, samples=70 iops : min= 3, max= 17, avg= 9.14, stdev= 3.54, samples=70 write: IOPS=11, BW=183KiB/s (187kB/s)(6544KiB/35832msec); 0 zone resets clat (usec): min=1445, max=240394, avg=40491.91, stdev=39864.80 lat (usec): min=1446, max=240396, avg=40494.96, stdev=39864.57 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2180], 10.00th=[ 3621], 20.00th=[ 6849], | 30.00th=[ 11076], 40.00th=[ 19006], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[ 98042], 95.00th=[119014], | 99.00th=[168821], 99.50th=[198181], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 507, per=27.37%, avg=182.80, stdev=87.08, samples=70 iops : min= 1, max= 31, avg=10.61, stdev= 5.53, samples=70 lat (usec) : 50=0.26%, 100=3.78%, 250=0.39%, 500=0.26%, 1000=0.26% lat (msec) : 2=2.47%, 4=3.52%, 10=8.98%, 20=8.59%, 50=32.94% lat (msec) : 100=29.04%, 250=9.51% cpu : usr=0.09%, sys=5.51%, ctx=1686, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179450: Thu Aug 27 15:40:01 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37674msec) clat (usec): min=40, max=238789, avg=53957.72, stdev=35977.88 lat (usec): min=41, max=238790, avg=53959.32, stdev=35977.91 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 75], 10.00th=[ 15401], 20.00th=[ 27132], | 30.00th=[ 34866], 40.00th=[ 41681], 50.00th=[ 50070], 60.00th=[ 56361], | 70.00th=[ 65799], 80.00th=[ 78119], 90.00th=[ 96994], 95.00th=[126354], | 99.00th=[175113], 99.50th=[229639], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 319, per=26.13%, avg=165.92, stdev=63.49, samples=74 iops : min= 1, max= 19, avg= 9.55, stdev= 4.03, samples=74 write: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37674msec); 0 zone resets clat (usec): min=1570, max=199370, avg=43475.30, stdev=40469.19 lat (usec): min=1572, max=199372, avg=43485.12, stdev=40464.48 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2212], 10.00th=[ 3589], 20.00th=[ 7767], | 30.00th=[ 14222], 40.00th=[ 23462], 50.00th=[ 32113], 60.00th=[ 41157], | 70.00th=[ 55313], 80.00th=[ 74974], 90.00th=[ 99091], 95.00th=[129500], | 99.00th=[168821], 99.50th=[193987], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 60, max= 438, per=23.73%, avg=158.53, stdev=73.12, samples=74 iops : min= 3, max= 27, avg= 9.09, stdev= 4.65, samples=74 lat (usec) : 50=0.39%, 100=3.52%, 250=0.52%, 1000=0.13% lat (msec) : 2=1.95%, 4=4.04%, 10=5.99%, 20=8.33%, 50=33.72% lat (msec) : 100=32.16%, 250=9.24% cpu : usr=0.08%, sys=5.30%, ctx=1761, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179451: Thu Aug 27 15:40:01 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36295msec) clat (usec): min=40, max=196744, avg=50629.85, stdev=32918.90 lat (usec): min=41, max=196746, avg=50633.67, stdev=32918.55 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 72], 10.00th=[ 8848], 20.00th=[ 25297], | 30.00th=[ 33424], 40.00th=[ 40109], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 93848], 95.00th=[109577], | 99.00th=[154141], 99.50th=[179307], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 318, per=25.93%, avg=164.66, stdev=68.46, samples=71 iops : min= 1, max= 19, avg= 9.46, stdev= 4.31, samples=71 write: IOPS=10, BW=172KiB/s (177kB/s)(6256KiB/36295msec); 0 zone resets clat (usec): min=1550, max=263311, avg=43672.40, stdev=45145.49 lat (usec): min=1552, max=263314, avg=43675.32, stdev=45145.57 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2278], 10.00th=[ 4293], 20.00th=[ 7767], | 30.00th=[ 12125], 40.00th=[ 17695], 50.00th=[ 27657], 60.00th=[ 39060], | 70.00th=[ 54789], 80.00th=[ 78119], 90.00th=[102237], 95.00th=[135267], | 99.00th=[189793], 99.50th=[212861], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 63, max= 381, per=25.77%, avg=172.15, stdev=66.44, samples=71 iops : min= 3, max= 23, avg= 9.94, stdev= 4.20, samples=71 lat (usec) : 50=0.13%, 100=4.30%, 250=0.26%, 750=0.13% lat (msec) : 2=2.21%, 4=2.60%, 10=8.20%, 20=10.03%, 50=34.24% lat (msec) : 100=29.17%, 250=8.59%, 500=0.13% cpu : usr=0.08%, sys=5.24%, ctx=1651, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=636KiB/s (651kB/s), 160KiB/s-166KiB/s (164kB/s-170kB/s), io=23.4MiB (24.5MB), run=35832-37674msec WRITE: bw=669KiB/s (685kB/s), 160KiB/s-183KiB/s (164kB/s-187kB/s), io=24.6MiB (25.8MB), run=35832-37674msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179453: Thu Aug 27 15:40:16 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5920KiB/51803msec) clat (msec): min=8, max=322, avg=58.52, stdev=47.16 lat (msec): min=8, max=322, avg=58.52, stdev=47.16 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 81], 90.00th=[ 116], 95.00th=[ 148], | 99.00th=[ 249], 99.50th=[ 300], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 318, per=25.01%, avg=114.81, stdev=64.28, samples=101 iops : min= 1, max= 19, avg= 6.39, stdev= 4.13, samples=101 write: IOPS=7, BW=123KiB/s (126kB/s)(6368KiB/51803msec); 0 zone resets clat (msec): min=17, max=274, avg=75.44, stdev=47.18 lat (msec): min=17, max=274, avg=75.45, stdev=47.18 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 61], 60.00th=[ 72], | 70.00th=[ 86], 80.00th=[ 107], 90.00th=[ 144], 95.00th=[ 178], | 99.00th=[ 239], 99.50th=[ 251], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 382, per=26.07%, avg=125.90, stdev=65.88, samples=99 iops : min= 1, max= 23, avg= 7.09, stdev= 4.16, samples=99 lat (msec) : 10=0.39%, 20=5.47%, 50=40.10%, 100=36.07%, 250=17.32% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.65%, ctx=1138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179454: Thu Aug 27 15:40:16 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(5744KiB/52061msec) clat (msec): min=7, max=313, avg=56.95, stdev=44.99 lat (msec): min=7, max=313, avg=56.96, stdev=44.99 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 62], 80.00th=[ 82], 90.00th=[ 120], 95.00th=[ 155], | 99.00th=[ 205], 99.50th=[ 292], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 30, max= 351, per=25.01%, avg=114.80, stdev=68.61, samples=97 iops : min= 1, max= 21, avg= 6.38, stdev= 4.38, samples=97 write: IOPS=7, BW=126KiB/s (129kB/s)(6544KiB/52061msec); 0 zone resets clat (msec): min=13, max=344, avg=77.15, stdev=49.05 lat (msec): min=13, max=344, avg=77.16, stdev=49.05 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 32], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 63], 60.00th=[ 74], | 70.00th=[ 88], 80.00th=[ 110], 90.00th=[ 140], 95.00th=[ 180], | 99.00th=[ 247], 99.50th=[ 264], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 350, per=26.26%, avg=126.83, stdev=68.37, samples=100 iops : min= 1, max= 21, avg= 7.15, stdev= 4.34, samples=100 lat (msec) : 10=0.52%, 20=5.47%, 50=38.93%, 100=36.85%, 250=17.45% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=1.59%, ctx=1175, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179455: Thu Aug 27 15:40:16 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/51979msec) clat (msec): min=8, max=277, avg=56.28, stdev=42.27 lat (msec): min=8, max=277, avg=56.28, stdev=42.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 16], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 82], 90.00th=[ 117], 95.00th=[ 157], | 99.00th=[ 188], 99.50th=[ 207], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 345, per=26.81%, avg=123.05, stdev=75.38, samples=100 iops : min= 1, max= 21, avg= 6.90, stdev= 4.75, samples=100 write: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/51979msec); 0 zone resets clat (msec): min=16, max=296, avg=79.27, stdev=50.87 lat (msec): min=16, max=296, avg=79.27, stdev=50.87 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 75], | 70.00th=[ 91], 80.00th=[ 118], 90.00th=[ 153], 95.00th=[ 186], | 99.00th=[ 251], 99.50th=[ 292], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 318, per=23.67%, avg=114.31, stdev=61.16, samples=102 iops : min= 1, max= 19, avg= 6.36, stdev= 3.88, samples=102 lat (msec) : 10=0.78%, 20=4.43%, 50=43.75%, 100=32.16%, 250=18.23% lat (msec) : 500=0.65% cpu : usr=0.03%, sys=1.43%, ctx=1173, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179456: Thu Aug 27 15:40:16 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/52072msec) clat (msec): min=6, max=318, avg=57.76, stdev=44.36 lat (msec): min=6, max=318, avg=57.76, stdev=44.36 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 61], 80.00th=[ 79], 90.00th=[ 127], 95.00th=[ 159], | 99.00th=[ 203], 99.50th=[ 279], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 28, max= 345, per=25.68%, avg=117.88, stdev=67.75, samples=99 iops : min= 1, max= 21, avg= 6.59, stdev= 4.29, samples=99 write: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52072msec); 0 zone resets clat (msec): min=13, max=340, avg=77.28, stdev=49.54 lat (msec): min=13, max=340, avg=77.29, stdev=49.53 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 73], | 70.00th=[ 86], 80.00th=[ 113], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 275], 99.50th=[ 309], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 284, per=24.95%, avg=120.51, stdev=64.15, samples=101 iops : min= 1, max= 17, avg= 6.75, stdev= 4.08, samples=101 lat (msec) : 10=0.13%, 20=4.69%, 50=40.62%, 100=36.46%, 250=17.06% lat (msec) : 500=1.04% cpu : usr=0.06%, sys=1.56%, ctx=1155, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=460KiB/s (471kB/s), 110KiB/s-120KiB/s (113kB/s-123kB/s), io=23.4MiB (24.5MB), run=51803-52072msec WRITE: bw=484KiB/s (496kB/s), 116KiB/s-126KiB/s (119kB/s-129kB/s), io=24.6MiB (25.8MB), run=51803-52072msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179469: Thu Aug 27 15:40:29 2026 read: IOPS=2, BW=2084KiB/s (2134kB/s)(7168KiB/3439msec) clat (msec): min=89, max=653, avg=265.92, stdev=215.52 lat (msec): min=89, max=653, avg=265.92, stdev=215.52 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 136], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 167], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 485], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1976, max= 4612, per=65.15%, avg=3547.67, stdev=1389.30, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1489KiB/s (1525kB/s)(5120KiB/3439msec); 0 zone resets clat (msec): min=110, max=947, avg=308.31, stdev=360.82 lat (msec): min=110, max=947, avg=308.78, stdev=360.71 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 132], 60.00th=[ 132], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1537, max= 4055, per=30.79%, avg=2347.50, stdev=1151.07, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=5.85%, ctx=79, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179470: Thu Aug 27 15:40:29 2026 read: IOPS=0, BW=581KiB/s (595kB/s)(2048KiB/3526msec) clat (msec): min=137, max=159, avg=148.63, stdev=16.07 lat (msec): min=137, max=159, avg=148.63, stdev=16.07 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 1577, max= 2043, per=33.24%, avg=1810.00, stdev=329.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2904KiB/s (2974kB/s)(10.0MiB/3526msec); 0 zone resets clat (msec): min=118, max=850, avg=307.19, stdev=220.42 lat (msec): min=118, max=851, avg=307.40, stdev=220.52 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 180], 50.00th=[ 207], 60.00th=[ 257], | 70.00th=[ 266], 80.00th=[ 397], 90.00th=[ 472], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1577, max= 6083, per=33.84%, avg=2579.50, stdev=1723.82, samples=6 iops : min= 1, max= 5, avg= 1.67, stdev= 1.63, samples=6 lat (msec) : 250=58.33%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=3.94%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179471: Thu Aug 27 15:40:29 2026 read: IOPS=1, BW=1634KiB/s (1673kB/s)(6144KiB/3761msec) clat (msec): min=89, max=686, avg=263.38, stdev=220.04 lat (msec): min=89, max=686, avg=263.38, stdev=220.04 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 249], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1906, max= 4055, per=59.66%, avg=3248.67, stdev=1170.59, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1634KiB/s (1673kB/s)(6144KiB/3761msec); 0 zone resets clat (msec): min=136, max=695, avg=329.23, stdev=247.93 lat (msec): min=136, max=695, avg=329.39, stdev=247.88 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 249], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1906, max= 4748, per=35.18%, avg=2682.00, stdev=1378.73, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=4.41%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179472: Thu Aug 27 15:40:29 2026 read: IOPS=1, BW=1457KiB/s (1492kB/s)(5120KiB/3513msec) clat (msec): min=63, max=373, avg=231.35, stdev=136.24 lat (msec): min=63, max=373, avg=231.35, stdev=136.24 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 64], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1892, max= 4087, per=49.01%, avg=2668.67, stdev=1230.17, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=2040KiB/s (2089kB/s)(7168KiB/3513msec); 0 zone resets clat (msec): min=143, max=699, avg=318.32, stdev=223.55 lat (msec): min=143, max=699, avg=318.61, stdev=223.40 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 165], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 213], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 575], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1906, max= 4055, per=36.27%, avg=2764.50, stdev=1024.90, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=5.44%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5445KiB/s (5576kB/s), 581KiB/s-2084KiB/s (595kB/s-2134kB/s), io=20.0MiB (20.0MB), run=3439-3761msec WRITE: bw=7624KiB/s (7806kB/s), 1489KiB/s-2904KiB/s (1525kB/s-2974kB/s), io=28.0MiB (29.4MB), run=3439-3761msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179474: Thu Aug 27 15:40:31 2026 read: IOPS=1, BW=2035KiB/s (2083kB/s)(7168KiB/3523msec) clat (usec): min=1000, max=546357, avg=209298.25, stdev=191904.75 lat (usec): min=1001, max=546358, avg=209299.79, stdev=191904.73 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1004], 10.00th=[ 1004], 20.00th=[ 1020], | 30.00th=[152044], 40.00th=[152044], 50.00th=[170918], 60.00th=[283116], | 70.00th=[283116], 80.00th=[312476], 90.00th=[549454], 95.00th=[549454], | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 1673, max= 2760, per=40.75%, avg=2106.80, stdev=397.15, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1453KiB/s (1488kB/s)(5120KiB/3523msec); 0 zone resets clat (msec): min=220, max=859, avg=411.10, stdev=256.09 lat (msec): min=220, max=859, avg=411.27, stdev=256.18 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2031, max= 4071, per=37.47%, avg=2712.33, stdev=1176.64, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=16.87%, ctx=233, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179475: Thu Aug 27 15:40:31 2026 read: IOPS=0, BW=517KiB/s (529kB/s)(2048KiB/3961msec) clat (msec): min=136, max=370, avg=253.27, stdev=165.11 lat (msec): min=136, max=370, avg=253.28, stdev=165.11 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2039, max= 2043, per=39.48%, avg=2041.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2585KiB/s (2647kB/s)(10.0MiB/3961msec); 0 zone resets clat (msec): min=174, max=748, avg=345.03, stdev=174.48 lat (msec): min=174, max=748, avg=345.32, stdev=174.44 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 245], | 30.00th=[ 251], 40.00th=[ 257], 50.00th=[ 262], 60.00th=[ 268], | 70.00th=[ 279], 80.00th=[ 481], 90.00th=[ 485], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1723, max= 4055, per=36.34%, avg=2630.17, stdev=1096.63, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=25.00%, 500=66.67%, 750=8.33% cpu : usr=0.03%, sys=16.99%, ctx=293, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179476: Thu Aug 27 15:40:31 2026 read: IOPS=1, BW=1988KiB/s (2036kB/s)(6144KiB/3090msec) clat (usec): min=511, max=192195, avg=52075.74, stdev=82297.95 lat (usec): min=512, max=192196, avg=52078.71, stdev=82296.71 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 644], | 30.00th=[ 644], 40.00th=[ 1942], 50.00th=[ 1942], 60.00th=[ 2311], | 70.00th=[114820], 80.00th=[114820], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 3346, max= 6095, per=91.31%, avg=4720.50, stdev=1943.84, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1988KiB/s (2036kB/s)(6144KiB/3090msec); 0 zone resets clat (msec): min=243, max=742, avg=460.90, stdev=188.83 lat (msec): min=243, max=742, avg=461.10, stdev=188.88 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 506], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1359, max= 4063, per=32.77%, avg=2372.00, stdev=1171.25, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=12.95%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179477: Thu Aug 27 15:40:31 2026 read: IOPS=1, BW=1437KiB/s (1471kB/s)(5120KiB/3563msec) clat (usec): min=871, max=362500, avg=188734.61, stdev=181334.19 lat (usec): min=872, max=362503, avg=188736.15, stdev=181334.11 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 873], 10.00th=[ 873], 20.00th=[ 873], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[217056], 60.00th=[217056], | 70.00th=[362808], 80.00th=[362808], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 3346, max= 4063, per=71.65%, avg=3704.50, stdev=507.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2012KiB/s (2060kB/s)(7168KiB/3563msec); 0 zone resets clat (msec): min=202, max=631, avg=372.85, stdev=164.65 lat (msec): min=202, max=631, avg=372.98, stdev=164.65 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 326], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 523], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1372, max= 4071, per=30.90%, avg=2236.40, stdev=1062.20, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=15.13%, ctx=258, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5170KiB/s (5295kB/s), 517KiB/s-2035KiB/s (529kB/s-2083kB/s), io=20.0MiB (20.0MB), run=3090-3961msec WRITE: bw=7239KiB/s (7412kB/s), 1453KiB/s-2585KiB/s (1488kB/s-2647kB/s), io=28.0MiB (29.4MB), run=3090-3961msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179488: Thu Aug 27 15:40:45 2026 read: IOPS=1, BW=4995KiB/s (5115kB/s)(12.0MiB/2460msec) clat (msec): min=658, max=913, avg=799.45, stdev=129.87 lat (msec): min=658, max=913, avg=799.45, stdev=129.87 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=16.67%, ctx=528, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179489: Thu Aug 27 15:40:45 2026 read: IOPS=0, BW=1277KiB/s (1308kB/s)(4096KiB/3207msec) clat (nsec): min=884751k, max=884751k, avg=884750792.00, stdev= 0.00 lat (nsec): min=884754k, max=884754k, avg=884754213.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2554KiB/s (2616kB/s)(8192KiB/3207msec); 0 zone resets clat (msec): min=858, max=1301, avg=1079.80, stdev=313.40 lat (msec): min=858, max=1302, avg=1080.37, stdev=313.59 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8143, max= 8143, per=94.57%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.33%, ctx=174, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179490: Thu Aug 27 15:40:45 2026 write: IOPS=0, BW=3229KiB/s (3307kB/s)(12.0MiB/3805msec); 0 zone resets clat (msec): min=285, max=2314, avg=1217.32, stdev=1024.98 lat (msec): min=285, max=2316, avg=1218.52, stdev=1025.64 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8126, max= 8192, per=94.75%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.10%, ctx=126, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179491: Thu Aug 27 15:40:45 2026 write: IOPS=0, BW=3650KiB/s (3737kB/s)(12.0MiB/3367msec); 0 zone resets clat (msec): min=871, max=1281, avg=1090.99, stdev=206.88 lat (msec): min=871, max=1282, avg=1091.52, stdev=206.94 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8126, max= 8175, per=94.65%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.93%, ctx=67, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5109KiB/s (5231kB/s), 1277KiB/s-4995KiB/s (1308kB/s-5115kB/s), io=16.0MiB (16.8MB), run=2460-3207msec WRITE: bw=8612KiB/s (8819kB/s), 2554KiB/s-3650KiB/s (2616kB/s-3737kB/s), io=32.0MiB (33.6MB), run=3207-3805msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179484: Thu Aug 27 15:40:45 2026 read: IOPS=0, BW=2829KiB/s (2897kB/s)(12.0MiB/4343msec) clat (msec): min=409, max=2731, avg=1327.13, stdev=1235.03 lat (msec): min=409, max=2731, avg=1327.13, stdev=1235.03 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 7892, max= 8143, per=100.00%, avg=8017.50, stdev=177.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.36%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179485: Thu Aug 27 15:40:45 2026 read: IOPS=0, BW=979KiB/s (1003kB/s)(4096KiB/4183msec) clat (nsec): min=2249.3M, max=2249.3M, avg=2249257004.00, stdev= 0.00 lat (nsec): min=2249.3M, max=2249.3M, avg=2249260401.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2265], 5.00th=[ 2265], 10.00th=[ 2265], 20.00th=[ 2265], | 30.00th=[ 2265], 40.00th=[ 2265], 50.00th=[ 2265], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1958KiB/s (2005kB/s)(8192KiB/4183msec); 0 zone resets clat (msec): min=607, max=1079, avg=843.60, stdev=333.57 lat (msec): min=608, max=1080, avg=844.49, stdev=333.22 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.92%, ctx=54, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179486: Thu Aug 27 15:40:45 2026 write: IOPS=0, BW=3626KiB/s (3713kB/s)(12.0MiB/3389msec); 0 zone resets clat (msec): min=458, max=1536, avg=1047.27, stdev=546.14 lat (msec): min=458, max=1537, avg=1048.86, stdev=546.50 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.02%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179487: Thu Aug 27 15:40:45 2026 write: IOPS=0, BW=3654KiB/s (3742kB/s)(12.0MiB/3363msec); 0 zone resets clat (msec): min=277, max=2496, avg=1044.12, stdev=1258.76 lat (msec): min=278, max=2497, avg=1044.61, stdev=1258.49 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 5527, max= 8031, per=86.54%, avg=6779.00, stdev=1770.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.32%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3773KiB/s (3863kB/s), 979KiB/s-2829KiB/s (1003kB/s-2897kB/s), io=16.0MiB (16.8MB), run=4183-4343msec WRITE: bw=7834KiB/s (8022kB/s), 1958KiB/s-3654KiB/s (2005kB/s-3742kB/s), io=32.0MiB (33.6MB), run=3363-4183msec