== sanity test 398b: DIO and buffer IO race ============== 05:58:29 (1788515909) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.5561 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179536: Fri Sep 4 06:01:08 2026 read: IOPS=10, BW=42.7KiB/s (43.8kB/s)(5992KiB/140223msec) clat (usec): min=35, max=940981, avg=51586.05, stdev=40149.73 lat (usec): min=35, max=940982, avg=51598.29, stdev=40148.44 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11731], 10.00th=[ 19006], 20.00th=[ 26084], | 30.00th=[ 31327], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 52691], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[111674], | 99.00th=[175113], 99.50th=[198181], 99.90th=[270533], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 111, per=24.89%, avg=42.56, stdev=17.73, samples=274 iops : min= 1, max= 27, avg= 9.97, stdev= 4.48, samples=274 write: IOPS=11, BW=44.9KiB/s (45.0kB/s)(6296KiB/140223msec); 0 zone resets clat (usec): min=1054, max=264157, avg=39660.23, stdev=38936.96 lat (usec): min=1055, max=264157, avg=39662.27, stdev=38936.93 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1598], 10.00th=[ 2474], 20.00th=[ 5145], | 30.00th=[ 10028], 40.00th=[ 21365], 50.00th=[ 30016], 60.00th=[ 40109], | 70.00th=[ 51643], 80.00th=[ 67634], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[170918], 99.50th=[189793], 99.90th=[254804], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 96, per=24.97%, avg=44.70, stdev=19.69, samples=274 iops : min= 1, max= 24, avg=10.51, stdev= 4.96, samples=274 lat (usec) : 50=0.10%, 100=1.66%, 250=0.16%, 500=0.10% lat (msec) : 2=4.26%, 4=3.84%, 10=7.58%, 20=7.62%, 50=37.96% lat (msec) : 100=29.39%, 250=7.19%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.11%, ctx=7036, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179538: Fri Sep 4 06:01:08 2026 read: IOPS=10, BW=43.3KiB/s (44.4kB/s)(5940KiB/137108msec) clat (usec): min=36, max=273633, avg=49568.38, stdev=32080.96 lat (usec): min=37, max=273633, avg=49575.73, stdev=32077.89 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 11207], 10.00th=[ 19006], 20.00th=[ 25297], | 30.00th=[ 30540], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 59507], 80.00th=[ 71828], 90.00th=[ 87557], 95.00th=[108528], | 99.00th=[154141], 99.50th=[196084], 99.90th=[240124], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 5, max= 95, per=25.23%, avg=43.14, stdev=17.38, samples=268 iops : min= 1, max= 23, avg=10.12, stdev= 4.36, samples=268 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6348KiB/137108msec); 0 zone resets clat (usec): min=882, max=873881, avg=39681.55, stdev=44640.54 lat (usec): min=884, max=873882, avg=39685.67, stdev=44640.64 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1532], 10.00th=[ 2343], 20.00th=[ 4817], | 30.00th=[ 8979], 40.00th=[ 17957], 50.00th=[ 29230], 60.00th=[ 37487], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[173016], 99.50th=[191890], 99.90th=[283116], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 103, per=25.79%, avg=46.17, stdev=19.56, samples=267 iops : min= 1, max= 25, avg=10.88, stdev= 4.93, samples=267 lat (usec) : 50=0.20%, 100=1.73%, 250=0.23%, 500=0.10%, 1000=0.03% lat (msec) : 2=4.30%, 4=4.23%, 10=7.94%, 20=8.17%, 50=37.66% lat (msec) : 100=27.67%, 250=7.62%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.04%, ctx=6848, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179540: Fri Sep 4 06:01:08 2026 read: IOPS=10, BW=43.5KiB/s (44.5kB/s)(6028KiB/138704msec) clat (usec): min=36, max=906804, avg=49188.21, stdev=38677.68 lat (usec): min=37, max=906805, avg=49190.33, stdev=38677.61 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10552], 10.00th=[ 17957], 20.00th=[ 25297], | 30.00th=[ 30802], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 49546], | 70.00th=[ 58459], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[102237], | 99.00th=[160433], 99.50th=[202376], 99.90th=[283116], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 5, max= 111, per=25.20%, avg=43.09, stdev=17.28, samples=272 iops : min= 1, max= 27, avg=10.10, stdev= 4.36, samples=272 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6260KiB/138704msec); 0 zone resets clat (usec): min=1054, max=239926, avg=40969.43, stdev=40628.95 lat (usec): min=1055, max=239927, avg=40973.14, stdev=40628.03 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1582], 10.00th=[ 2311], 20.00th=[ 5145], | 30.00th=[ 9241], 40.00th=[ 19006], 50.00th=[ 30016], 60.00th=[ 41157], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[170918], 99.50th=[198181], 99.90th=[231736], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 117, per=25.10%, avg=44.93, stdev=20.36, samples=271 iops : min= 1, max= 29, avg=10.57, stdev= 5.12, samples=271 lat (usec) : 50=0.20%, 100=1.73%, 250=0.29%, 500=0.03% lat (msec) : 2=4.23%, 4=4.26%, 10=7.62%, 20=8.14%, 50=37.57% lat (msec) : 100=28.06%, 250=7.75%, 500=0.10%, 1000=0.03% cpu : usr=0.06%, sys=5.10%, ctx=6879, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179542: Fri Sep 4 06:01:08 2026 read: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6052KiB/138843msec) clat (usec): min=42, max=284063, avg=50234.00, stdev=31954.72 lat (usec): min=42, max=284064, avg=50240.93, stdev=31953.76 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 2311], 10.00th=[ 18482], 20.00th=[ 27132], | 30.00th=[ 32113], 40.00th=[ 38011], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[154141], 99.50th=[187696], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 112, per=25.48%, avg=43.58, stdev=16.60, samples=271 iops : min= 1, max= 28, avg=10.23, stdev= 4.19, samples=271 write: IOPS=11, BW=44.9KiB/s (45.0kB/s)(6236KiB/138843msec); 0 zone resets clat (usec): min=1030, max=786093, avg=39978.27, stdev=44314.22 lat (usec): min=1032, max=786097, avg=39981.18, stdev=44314.52 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1500], 10.00th=[ 2147], 20.00th=[ 4359], | 30.00th=[ 8291], 40.00th=[ 17171], 50.00th=[ 28705], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[175113], 99.50th=[193987], 99.90th=[233833], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 110, per=24.90%, avg=44.57, stdev=19.57, samples=273 iops : min= 1, max= 27, avg=10.48, stdev= 4.92, samples=273 lat (usec) : 50=0.03%, 100=1.86%, 250=0.46%, 500=0.07%, 750=0.03% lat (msec) : 2=4.69%, 4=4.56%, 10=7.62%, 20=7.75%, 50=35.97% lat (msec) : 100=29.65%, 250=7.19%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.07%, ctx=6903, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.7KiB/s-43.6KiB/s (43.8kB/s-44.6kB/s), io=23.4MiB (24.6MB), run=137108-140223msec WRITE: bw=179KiB/s (184kB/s), 44.9KiB/s-46.3KiB/s (45.0kB/s-47.4kB/s), io=24.6MiB (25.7MB), run=137108-140223msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179537: Fri Sep 4 06:01:51 2026 read: IOPS=8, BW=32.8KiB/s (33.6kB/s)(5992KiB/182428msec) clat (msec): min=6, max=918, avg=48.53, stdev=48.05 lat (msec): min=6, max=918, avg=48.54, stdev=48.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 107], 95.00th=[ 138], | 99.00th=[ 211], 99.50th=[ 243], 99.90th=[ 296], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 135, per=25.58%, avg=33.51, stdev=22.99, samples=347 iops : min= 1, max= 33, avg= 7.73, stdev= 5.78, samples=347 write: IOPS=8, BW=34.5KiB/s (35.3kB/s)(6296KiB/182428msec); 0 zone resets clat (msec): min=14, max=391, avg=69.43, stdev=48.65 lat (msec): min=14, max=391, avg=69.44, stdev=48.65 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 103], 90.00th=[ 136], 95.00th=[ 163], | 99.00th=[ 243], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 104, per=25.26%, avg=34.61, stdev=21.43, samples=353 iops : min= 1, max= 26, avg= 8.00, stdev= 5.39, samples=353 lat (msec) : 10=0.85%, 20=11.46%, 50=45.77%, 100=25.91%, 250=15.33% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.06%, sys=2.11%, ctx=5035, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179539: Fri Sep 4 06:01:51 2026 read: IOPS=8, BW=32.5KiB/s (33.3kB/s)(5940KiB/182735msec) clat (msec): min=6, max=831, avg=47.91, stdev=47.16 lat (msec): min=6, max=831, avg=47.91, stdev=47.16 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 106], 95.00th=[ 142], | 99.00th=[ 201], 99.50th=[ 234], 99.90th=[ 334], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 119, per=25.10%, avg=32.89, stdev=23.07, samples=349 iops : min= 1, max= 29, avg= 7.57, stdev= 5.79, samples=349 write: IOPS=8, BW=34.7KiB/s (35.6kB/s)(6348KiB/182735msec); 0 zone resets clat (msec): min=10, max=384, avg=70.03, stdev=48.75 lat (msec): min=10, max=384, avg=70.03, stdev=48.75 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 106], 90.00th=[ 142], 95.00th=[ 167], | 99.00th=[ 243], 99.50th=[ 259], 99.90th=[ 380], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 104, per=25.32%, avg=34.69, stdev=21.49, samples=353 iops : min= 1, max= 26, avg= 8.02, stdev= 5.42, samples=353 lat (msec) : 10=1.01%, 20=12.08%, 50=45.41%, 100=24.67%, 250=16.24% lat (msec) : 500=0.55%, 1000=0.03% cpu : usr=0.06%, sys=2.03%, ctx=4897, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179541: Fri Sep 4 06:01:51 2026 read: IOPS=8, BW=33.0KiB/s (33.8kB/s)(6028KiB/182546msec) clat (msec): min=5, max=335, avg=48.77, stdev=44.31 lat (msec): min=5, max=335, avg=48.77, stdev=44.31 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 71], 90.00th=[ 111], 95.00th=[ 142], | 99.00th=[ 213], 99.50th=[ 259], 99.90th=[ 317], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 127, per=25.61%, avg=33.55, stdev=22.41, samples=348 iops : min= 1, max= 31, avg= 7.74, stdev= 5.64, samples=348 write: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6260KiB/182546msec); 0 zone resets clat (msec): min=10, max=870, avg=69.40, stdev=52.04 lat (msec): min=10, max=870, avg=69.40, stdev=52.04 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 80], 80.00th=[ 104], 90.00th=[ 133], 95.00th=[ 163], | 99.00th=[ 236], 99.50th=[ 259], 99.90th=[ 456], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 112, per=24.85%, avg=34.05, stdev=21.97, samples=356 iops : min= 1, max= 28, avg= 7.86, stdev= 5.52, samples=356 lat (msec) : 10=1.07%, 20=11.69%, 50=45.96%, 100=24.48%, 250=16.15% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.06%, sys=2.06%, ctx=4962, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179543: Fri Sep 4 06:01:51 2026 read: IOPS=8, BW=33.1KiB/s (33.9kB/s)(6052KiB/182570msec) clat (msec): min=6, max=334, avg=47.49, stdev=43.18 lat (msec): min=6, max=334, avg=47.49, stdev=43.18 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 199], 99.50th=[ 228], 99.90th=[ 326], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 127, per=26.29%, avg=34.44, stdev=23.33, samples=341 iops : min= 1, max= 31, avg= 7.96, stdev= 5.87, samples=341 write: IOPS=8, BW=34.2KiB/s (34.0kB/s)(6236KiB/182570msec); 0 zone resets clat (msec): min=11, max=836, avg=70.67, stdev=54.06 lat (msec): min=11, max=836, avg=70.67, stdev=54.06 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 83], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 171], | 99.00th=[ 253], 99.50th=[ 284], 99.90th=[ 330], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 104, per=24.87%, avg=34.08, stdev=21.80, samples=354 iops : min= 1, max= 26, avg= 7.87, stdev= 5.48, samples=354 lat (msec) : 10=0.78%, 20=12.17%, 50=46.58%, 100=23.44%, 250=16.24% lat (msec) : 500=0.75%, 1000=0.03% cpu : usr=0.06%, sys=2.00%, ctx=5004, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=131KiB/s (135kB/s), 32.5KiB/s-33.1KiB/s (33.3kB/s-33.9kB/s), io=23.4MiB (24.6MB), run=182428-182735msec WRITE: bw=138KiB/s (141kB/s), 34.2KiB/s-34.7KiB/s (34.0kB/s-35.6kB/s), io=24.6MiB (25.7MB), run=182428-182735msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179598: Fri Sep 4 06:02:39 2026 read: IOPS=9, BW=147KiB/s (151kB/s)(5920KiB/40176msec) clat (usec): min=41, max=238649, avg=56979.42, stdev=36806.35 lat (usec): min=42, max=238651, avg=56991.72, stdev=36801.41 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 75], 10.00th=[ 12649], 20.00th=[ 28181], | 30.00th=[ 36439], 40.00th=[ 43779], 50.00th=[ 52691], 60.00th=[ 60556], | 70.00th=[ 71828], 80.00th=[ 84411], 90.00th=[102237], 95.00th=[121111], | 99.00th=[173016], 99.50th=[193987], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 315, per=24.92%, avg=147.29, stdev=58.65, samples=79 iops : min= 1, max= 19, avg= 8.39, stdev= 3.69, samples=79 write: IOPS=9, BW=159KiB/s (162kB/s)(6368KiB/40176msec); 0 zone resets clat (usec): min=1765, max=261266, avg=47255.75, stdev=45298.75 lat (usec): min=1767, max=261269, avg=47258.19, stdev=45298.77 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2409], 10.00th=[ 4621], 20.00th=[ 7635], | 30.00th=[ 12911], 40.00th=[ 22152], 50.00th=[ 32637], 60.00th=[ 46400], | 70.00th=[ 62129], 80.00th=[ 81265], 90.00th=[117965], 95.00th=[141558], | 99.00th=[189793], 99.50th=[191890], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 31, max= 345, per=25.73%, avg=160.04, stdev=68.03, samples=78 iops : min= 1, max= 21, avg= 9.21, stdev= 4.30, samples=78 lat (usec) : 50=0.26%, 100=3.52%, 250=0.78%, 750=0.13% lat (msec) : 2=1.17%, 4=2.73%, 10=9.38%, 20=7.16%, 50=30.99% lat (msec) : 100=31.12%, 250=12.63%, 500=0.13% cpu : usr=0.06%, sys=5.23%, ctx=1846, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179599: Fri Sep 4 06:02:39 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(5744KiB/40288msec) clat (usec): min=39, max=272719, avg=62442.46, stdev=44567.13 lat (usec): min=40, max=272720, avg=62443.82, stdev=44567.20 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 76], 10.00th=[ 12125], 20.00th=[ 30802], | 30.00th=[ 38536], 40.00th=[ 45876], 50.00th=[ 54264], 60.00th=[ 63177], | 70.00th=[ 72877], 80.00th=[ 91751], 90.00th=[120062], 95.00th=[152044], | 99.00th=[212861], 99.50th=[244319], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 61, max= 286, per=24.11%, avg=142.47, stdev=53.04, samples=79 iops : min= 3, max= 17, avg= 8.09, stdev= 3.36, samples=79 write: IOPS=10, BW=162KiB/s (166kB/s)(6544KiB/40288msec); 0 zone resets clat (usec): min=1719, max=186320, avg=43065.43, stdev=41140.16 lat (usec): min=1721, max=186323, avg=43067.98, stdev=41140.11 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 5], 20.00th=[ 9], | 30.00th=[ 15], 40.00th=[ 22], 50.00th=[ 30], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 72], 90.00th=[ 103], 95.00th=[ 138], | 99.00th=[ 169], 99.50th=[ 178], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 461, per=26.01%, avg=161.81, stdev=90.56, samples=79 iops : min= 1, max= 28, avg= 9.30, stdev= 5.70, samples=79 lat (usec) : 50=0.13%, 100=2.99%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=0.39%, 4=3.52%, 10=8.33%, 20=9.38%, 50=30.47% lat (msec) : 100=31.12%, 250=12.37%, 500=0.13% cpu : usr=0.07%, sys=5.30%, ctx=1800, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179600: Fri Sep 4 06:02:39 2026 read: IOPS=9, BW=155KiB/s (158kB/s)(6256KiB/40471msec) clat (usec): min=35, max=318056, avg=57040.90, stdev=41462.48 lat (usec): min=35, max=318058, avg=57042.48, stdev=41462.45 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 93], 20.00th=[ 25822], | 30.00th=[ 35390], 40.00th=[ 43779], 50.00th=[ 51119], 60.00th=[ 60031], | 70.00th=[ 71828], 80.00th=[ 86508], 90.00th=[106431], 95.00th=[133694], | 99.00th=[189793], 99.50th=[219153], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 316, per=26.21%, avg=154.89, stdev=66.31, samples=79 iops : min= 1, max= 19, avg= 8.86, stdev= 4.17, samples=79 write: IOPS=9, BW=149KiB/s (153kB/s)(6032KiB/40471msec); 0 zone resets clat (usec): min=1858, max=262276, avg=47802.35, stdev=45624.68 lat (usec): min=1860, max=262278, avg=47870.21, stdev=45593.78 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 5], 20.00th=[ 10], | 30.00th=[ 16], 40.00th=[ 22], 50.00th=[ 34], 60.00th=[ 47], | 70.00th=[ 64], 80.00th=[ 80], 90.00th=[ 117], 95.00th=[ 142], | 99.00th=[ 186], 99.50th=[ 215], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 349, per=23.96%, avg=149.04, stdev=63.58, samples=78 iops : min= 1, max= 21, avg= 8.51, stdev= 4.03, samples=78 lat (usec) : 50=0.13%, 100=5.34%, 250=1.04%, 500=0.13% lat (msec) : 2=0.39%, 4=4.04%, 10=6.25%, 20=9.38%, 50=27.99% lat (msec) : 100=31.90%, 250=13.15%, 500=0.26% cpu : usr=0.06%, sys=4.86%, ctx=1767, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179601: Fri Sep 4 06:02:39 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6032KiB/39894msec) clat (usec): min=52, max=285313, avg=56484.27, stdev=36389.35 lat (usec): min=53, max=285314, avg=56485.58, stdev=36389.43 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 71], 10.00th=[ 11994], 20.00th=[ 30278], | 30.00th=[ 37487], 40.00th=[ 44303], 50.00th=[ 52167], 60.00th=[ 58983], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[100140], 95.00th=[122160], | 99.00th=[154141], 99.50th=[185598], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 313, per=26.00%, avg=153.66, stdev=63.94, samples=76 iops : min= 1, max= 19, avg= 8.80, stdev= 4.07, samples=76 write: IOPS=9, BW=157KiB/s (161kB/s)(6256KiB/39894msec); 0 zone resets clat (usec): min=1614, max=234007, avg=47030.05, stdev=47346.57 lat (usec): min=1615, max=234010, avg=47047.58, stdev=47334.64 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3097], 10.00th=[ 4948], 20.00th=[ 9110], | 30.00th=[ 16188], 40.00th=[ 22938], 50.00th=[ 29754], 60.00th=[ 39584], | 70.00th=[ 55313], 80.00th=[ 76022], 90.00th=[117965], 95.00th=[154141], | 99.00th=[208667], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 318, per=25.86%, avg=160.87, stdev=64.62, samples=76 iops : min= 1, max= 19, avg= 9.26, stdev= 4.11, samples=76 lat (usec) : 100=3.78%, 250=0.65%, 500=0.13% lat (msec) : 2=0.65%, 4=3.26%, 10=7.42%, 20=8.07%, 50=33.07% lat (msec) : 100=30.60%, 250=12.24%, 500=0.13% cpu : usr=0.07%, sys=5.20%, ctx=1838, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=592KiB/s (606kB/s), 143KiB/s-155KiB/s (146kB/s-158kB/s), io=23.4MiB (24.5MB), run=39894-40471msec WRITE: bw=623KiB/s (638kB/s), 149KiB/s-162KiB/s (153kB/s-166kB/s), io=24.6MiB (25.8MB), run=39894-40471msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179603: Fri Sep 4 06:02:54 2026 read: IOPS=6, BW=109KiB/s (112kB/s)(5920KiB/54108msec) clat (msec): min=8, max=454, avg=59.11, stdev=53.01 lat (msec): min=8, max=454, avg=59.11, stdev=53.01 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 125], 95.00th=[ 176], | 99.00th=[ 232], 99.50th=[ 251], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 28, max= 383, per=25.17%, avg=111.25, stdev=72.46, samples=104 iops : min= 1, max= 23, avg= 6.15, stdev= 4.58, samples=104 write: IOPS=7, BW=118KiB/s (121kB/s)(6368KiB/54108msec); 0 zone resets clat (msec): min=16, max=362, avg=80.42, stdev=52.52 lat (msec): min=16, max=362, avg=80.44, stdev=52.52 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 33], 20.00th=[ 42], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 78], | 70.00th=[ 95], 80.00th=[ 115], 90.00th=[ 144], 95.00th=[ 176], | 99.00th=[ 271], 99.50th=[ 330], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 22, max= 317, per=25.47%, avg=118.44, stdev=70.14, samples=105 iops : min= 1, max= 19, avg= 6.62, stdev= 4.43, samples=105 lat (msec) : 10=0.39%, 20=5.86%, 50=41.80%, 100=30.21%, 250=20.44% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.83%, ctx=1274, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179604: Fri Sep 4 06:02:54 2026 read: IOPS=6, BW=106KiB/s (109kB/s)(5744KiB/54069msec) clat (msec): min=8, max=272, avg=57.63, stdev=46.77 lat (msec): min=8, max=272, avg=57.63, stdev=46.77 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 84], 90.00th=[ 133], 95.00th=[ 165], | 99.00th=[ 226], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 22, max= 351, per=25.75%, avg=113.83, stdev=79.02, samples=99 iops : min= 1, max= 21, avg= 6.31, stdev= 4.96, samples=99 write: IOPS=7, BW=121KiB/s (124kB/s)(6544KiB/54069msec); 0 zone resets clat (msec): min=14, max=328, avg=81.06, stdev=57.23 lat (msec): min=14, max=328, avg=81.06, stdev=57.23 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 62], 60.00th=[ 72], | 70.00th=[ 92], 80.00th=[ 122], 90.00th=[ 165], 95.00th=[ 209], | 99.00th=[ 262], 99.50th=[ 266], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 28, max= 383, per=26.25%, avg=122.07, stdev=74.75, samples=105 iops : min= 1, max= 23, avg= 6.84, stdev= 4.74, samples=105 lat (msec) : 10=0.39%, 20=6.38%, 50=41.54%, 100=30.86%, 250=19.40% lat (msec) : 500=1.43% cpu : usr=0.04%, sys=1.82%, ctx=1260, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179605: Fri Sep 4 06:02:54 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/54006msec) clat (msec): min=5, max=452, avg=60.53, stdev=55.00 lat (msec): min=5, max=452, avg=60.53, stdev=55.00 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 86], 90.00th=[ 134], 95.00th=[ 190], | 99.00th=[ 259], 99.50th=[ 266], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 30, max= 413, per=27.61%, avg=122.05, stdev=80.24, samples=101 iops : min= 1, max= 25, avg= 6.84, stdev= 5.07, samples=101 write: IOPS=6, BW=112KiB/s (114kB/s)(6032KiB/54006msec); 0 zone resets clat (msec): min=17, max=292, avg=79.93, stdev=53.51 lat (msec): min=17, max=292, avg=79.93, stdev=53.51 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 73], | 70.00th=[ 93], 80.00th=[ 121], 90.00th=[ 155], 95.00th=[ 192], | 99.00th=[ 259], 99.50th=[ 266], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 28, max= 351, per=24.33%, avg=113.12, stdev=69.28, samples=104 iops : min= 1, max= 21, avg= 6.28, stdev= 4.36, samples=104 lat (msec) : 10=0.26%, 20=6.25%, 50=42.32%, 100=29.69%, 250=19.92% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.76%, ctx=1219, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179606: Fri Sep 4 06:02:54 2026 read: IOPS=6, BW=111KiB/s (114kB/s)(6032KiB/54123msec) clat (msec): min=9, max=305, avg=58.00, stdev=50.55 lat (msec): min=9, max=305, avg=58.00, stdev=50.55 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 79], 90.00th=[ 121], 95.00th=[ 178], | 99.00th=[ 259], 99.50th=[ 271], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 349, per=26.79%, avg=118.42, stdev=70.68, samples=99 iops : min= 1, max= 21, avg= 6.62, stdev= 4.46, samples=99 write: IOPS=7, BW=116KiB/s (118kB/s)(6256KiB/54123msec); 0 zone resets clat (msec): min=16, max=333, avg=81.99, stdev=55.38 lat (msec): min=16, max=333, avg=81.99, stdev=55.38 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 41], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 92], 80.00th=[ 121], 90.00th=[ 159], 95.00th=[ 192], | 99.00th=[ 266], 99.50th=[ 296], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 351, per=25.30%, avg=117.66, stdev=73.84, samples=104 iops : min= 1, max= 21, avg= 6.57, stdev= 4.66, samples=104 lat (msec) : 10=0.26%, 20=5.73%, 50=40.36%, 100=33.85%, 250=18.49% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.88%, ctx=1196, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=443KiB/s (453kB/s), 106KiB/s-116KiB/s (109kB/s-119kB/s), io=23.4MiB (24.5MB), run=54006-54123msec WRITE: bw=466KiB/s (477kB/s), 112KiB/s-121KiB/s (114kB/s-124kB/s), io=24.6MiB (25.8MB), run=54006-54123msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179621: Fri Sep 4 06:03:11 2026 read: IOPS=1, BW=1049KiB/s (1075kB/s)(7168KiB/6831msec) clat (usec): min=1993, max=4317.3k, avg=744486.56, stdev=1577609.60 lat (usec): min=1994, max=4317.3k, avg=744488.05, stdev=1577609.59 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 1991], 10.00th=[ 1991], | 20.00th=[ 105382], 30.00th=[ 131597], 40.00th=[ 131597], | 50.00th=[ 183501], 60.00th=[ 233833], 70.00th=[ 233833], | 80.00th=[ 238027], 90.00th=[4328522], 95.00th=[4328522], | 99.00th=[4328522], 99.50th=[4328522], 99.90th=[4328522], | 99.95th=[4328522], 99.99th=[4328522] bw ( KiB/s): min= 1783, max= 5885, per=100.00%, avg=3204.67, stdev=2322.67, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=750KiB/s (768kB/s)(5120KiB/6831msec); 0 zone resets clat (msec): min=108, max=501, avg=281.85, stdev=156.49 lat (msec): min=108, max=501, avg=282.11, stdev=156.57 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1961, max= 2039, per=47.96%, avg=2013.00, stdev=45.03, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 2=8.33%, 250=66.67%, 500=8.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.02%, ctx=394, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179622: Fri Sep 4 06:03:11 2026 read: IOPS=0, BW=353KiB/s (362kB/s)(2048KiB/5798msec) clat (msec): min=246, max=370, avg=308.24, stdev=87.66 lat (msec): min=246, max=370, avg=308.24, stdev=87.66 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1805, max= 2043, per=64.18%, avg=1924.00, stdev=168.29, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1766KiB/s (1809kB/s)(10.0MiB/5798msec); 0 zone resets clat (msec): min=158, max=1737, avg=513.18, stdev=489.56 lat (msec): min=158, max=1737, avg=513.28, stdev=489.58 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 203], | 30.00th=[ 213], 40.00th=[ 247], 50.00th=[ 300], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 481], 90.00th=[ 969], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1799, max= 5545, per=72.95%, avg=3061.60, stdev=1677.08, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.61%, ctx=196, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179623: Fri Sep 4 06:03:11 2026 read: IOPS=0, BW=990KiB/s (1014kB/s)(6144KiB/6207msec) clat (usec): min=479, max=419190, avg=224567.03, stdev=153975.72 lat (usec): min=481, max=419192, avg=224568.38, stdev=153975.57 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 94897], | 30.00th=[ 94897], 40.00th=[227541], 50.00th=[227541], 60.00th=[278922], | 70.00th=[329253], 80.00th=[329253], 90.00th=[417334], 95.00th=[417334], | 99.00th=[417334], 99.50th=[417334], 99.90th=[417334], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 3750, max= 4063, per=100.00%, avg=3906.50, stdev=221.32, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=990KiB/s (1014kB/s)(6144KiB/6207msec); 0 zone resets clat (msec): min=164, max=1662, avg=769.13, stdev=538.52 lat (msec): min=164, max=1662, avg=769.20, stdev=538.54 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 852], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1858, max= 2048, per=47.39%, avg=1989.00, stdev=81.33, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=7.14%, ctx=160, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179624: Fri Sep 4 06:03:11 2026 read: IOPS=0, BW=831KiB/s (851kB/s)(5120KiB/6159msec) clat (msec): min=103, max=516, avg=287.36, stdev=159.11 lat (msec): min=103, max=516, avg=287.36, stdev=159.11 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 3716, max= 4087, per=100.00%, avg=3901.50, stdev=262.34, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1164KiB/s (1192kB/s)(7168KiB/6159msec); 0 zone resets clat (msec): min=246, max=2158, avg=643.94, stdev=681.12 lat (msec): min=246, max=2158, avg=644.05, stdev=681.11 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 317], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 380], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 667], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1848, max= 3599, per=54.29%, avg=2278.60, stdev=741.24, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.46%, ctx=192, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2998KiB/s (3070kB/s), 353KiB/s-1049KiB/s (362kB/s-1075kB/s), io=20.0MiB (20.0MB), run=5798-6831msec WRITE: bw=4197KiB/s (4298kB/s), 750KiB/s-1766KiB/s (768kB/s-1809kB/s), io=28.0MiB (29.4MB), run=5798-6831msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179625: Fri Sep 4 06:03:12 2026 read: IOPS=0, BW=967KiB/s (990kB/s)(7168KiB/7416msec) clat (msec): min=106, max=3061, avg=821.87, stdev=1083.39 lat (msec): min=106, max=3061, avg=821.87, stdev=1083.39 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 131], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 199], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 1234], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1374, max= 2048, per=69.32%, avg=1913.83, stdev=265.69, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=690KiB/s (707kB/s)(5120KiB/7416msec); 0 zone resets clat (msec): min=76, max=399, avg=249.98, stdev=139.70 lat (msec): min=77, max=399, avg=250.40, stdev=139.60 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1935, max= 6071, per=86.07%, avg=3327.33, stdev=2376.17, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.95%, ctx=121, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179626: Fri Sep 4 06:03:12 2026 read: IOPS=0, BW=305KiB/s (312kB/s)(2048KiB/6724msec) clat (msec): min=130, max=301, avg=216.15, stdev=120.51 lat (msec): min=130, max=301, avg=216.15, stdev=120.51 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 1899, max= 2035, per=71.24%, avg=1967.00, stdev=96.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1523KiB/s (1559kB/s)(10.0MiB/6724msec); 0 zone resets clat (msec): min=126, max=1784, avg=617.25, stdev=637.39 lat (msec): min=126, max=1784, avg=617.33, stdev=637.37 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 128], | 30.00th=[ 169], 40.00th=[ 213], 50.00th=[ 279], 60.00th=[ 426], | 70.00th=[ 575], 80.00th=[ 726], 90.00th=[ 1754], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 2007, max= 4087, per=78.22%, avg=3023.83, stdev=1101.28, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 2000=16.67% cpu : usr=0.01%, sys=3.44%, ctx=109, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179627: Fri Sep 4 06:03:12 2026 read: IOPS=0, BW=877KiB/s (898kB/s)(6144KiB/7009msec) clat (msec): min=280, max=708, avg=421.53, stdev=172.47 lat (msec): min=280, max=708, avg=421.53, stdev=172.47 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 422], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1935, max= 4000, per=90.28%, avg=2492.50, stdev=1005.91, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=877KiB/s (898kB/s)(6144KiB/7009msec); 0 zone resets clat (msec): min=378, max=1467, avg=706.69, stdev=446.72 lat (msec): min=378, max=1479, avg=708.81, stdev=450.94 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 506], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1935, max= 4039, per=62.49%, avg=2416.00, stdev=908.38, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 500=58.33%, 750=25.00%, 2000=16.67% cpu : usr=0.00%, sys=2.18%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179628: Fri Sep 4 06:03:12 2026 read: IOPS=0, BW=718KiB/s (736kB/s)(5120KiB/7127msec) clat (msec): min=94, max=811, avg=283.08, stdev=299.95 lat (msec): min=94, max=811, avg=283.08, stdev=299.95 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2000, max= 2043, per=73.53%, avg=2030.25, stdev=20.25, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=1006KiB/s (1030kB/s)(7168KiB/7127msec); 0 zone resets clat (msec): min=166, max=1964, avg=775.11, stdev=607.64 lat (msec): min=166, max=1965, avg=775.20, stdev=607.65 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 342], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 609], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 1150], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 1935, max= 2039, per=51.77%, avg=2001.60, stdev=40.22, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=8.33%, 750=25.00%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=3.38%, ctx=115, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2762KiB/s (2828kB/s), 305KiB/s-967KiB/s (312kB/s-990kB/s), io=20.0MiB (20.0MB), run=6724-7416msec WRITE: bw=3866KiB/s (3959kB/s), 690KiB/s-1523KiB/s (707kB/s-1559kB/s), io=28.0MiB (29.4MB), run=6724-7416msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179634: Fri Sep 4 06:03:23 2026 read: IOPS=1, BW=5968KiB/s (6111kB/s)(12.0MiB/2059msec) clat (msec): min=317, max=1269, avg=652.04, stdev=535.10 lat (msec): min=317, max=1269, avg=652.04, stdev=535.10 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 5535, max= 7953, per=84.76%, avg=6744.00, stdev=1709.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.10%, sys=6.56%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179635: Fri Sep 4 06:03:23 2026 read: IOPS=0, BW=2251KiB/s (2305kB/s)(4096KiB/1820msec) clat (nsec): min=562070k, max=562070k, avg=562070222.00, stdev= 0.00 lat (nsec): min=562073k, max=562073k, avg=562072670.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7953, max= 7953, per=99.95%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4501KiB/s (4609kB/s)(8192KiB/1820msec); 0 zone resets clat (msec): min=516, max=710, avg=613.77, stdev=137.09 lat (msec): min=518, max=710, avg=614.76, stdev=135.91 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7953, max= 7953, per=55.65%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=100.00% cpu : usr=0.11%, sys=4.67%, ctx=41, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179636: Fri Sep 4 06:03:23 2026 write: IOPS=1, BW=5359KiB/s (5488kB/s)(12.0MiB/2293msec); 0 zone resets clat (msec): min=418, max=1169, avg=762.04, stdev=379.45 lat (msec): min=418, max=1169, avg=762.40, stdev=379.41 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7613, max= 7953, per=54.46%, avg=7783.00, stdev=240.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.76%, ctx=36, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179637: Fri Sep 4 06:03:23 2026 write: IOPS=1, BW=5508KiB/s (5640kB/s)(12.0MiB/2231msec); 0 zone resets clat (msec): min=348, max=1282, avg=723.79, stdev=493.71 lat (msec): min=348, max=1283, avg=724.32, stdev=493.72 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 6942, max= 7953, per=52.12%, avg=7447.50, stdev=714.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.87%, ctx=53, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7957KiB/s (8148kB/s), 2251KiB/s-5968KiB/s (2305kB/s-6111kB/s), io=16.0MiB (16.8MB), run=1820-2059msec WRITE: bw=13.0MiB/s (14.6MB/s), 4501KiB/s-5508KiB/s (4609kB/s-5640kB/s), io=32.0MiB (33.6MB), run=1820-2293msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179639: Fri Sep 4 06:03:24 2026 read: IOPS=1, BW=6159KiB/s (6307kB/s)(12.0MiB/1995msec) clat (msec): min=480, max=884, avg=630.05, stdev=221.57 lat (msec): min=480, max=884, avg=630.06, stdev=221.57 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.40%, ctx=587, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179640: Fri Sep 4 06:03:24 2026 read: IOPS=0, BW=1639KiB/s (1678kB/s)(4096KiB/2499msec) clat (nsec): min=1042.0M, max=1042.0M, avg=1042004777.00, stdev= 0.00 lat (nsec): min=1042.0M, max=1042.0M, avg=1042007099.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3278KiB/s (3357kB/s)(8192KiB/2499msec); 0 zone resets clat (msec): min=353, max=1099, avg=726.40, stdev=527.43 lat (msec): min=353, max=1099, avg=726.77, stdev=527.31 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8175, max= 8175, per=64.44%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=8.93%, ctx=220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179641: Fri Sep 4 06:03:24 2026 write: IOPS=1, BW=4849KiB/s (4966kB/s)(12.0MiB/2534msec); 0 zone resets clat (msec): min=630, max=1105, avg=843.65, stdev=241.07 lat (msec): min=631, max=1105, avg=844.18, stdev=240.73 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 5439, max= 8192, per=53.72%, avg=6815.50, stdev=1946.66, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.05%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179642: Fri Sep 4 06:03:24 2026 write: IOPS=1, BW=4757KiB/s (4871kB/s)(12.0MiB/2583msec); 0 zone resets clat (msec): min=330, max=1464, avg=859.59, stdev=570.72 lat (msec): min=331, max=1464, avg=860.20, stdev=570.47 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8192, max= 8192, per=64.58%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.80%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6556KiB/s (6714kB/s), 1639KiB/s-6159KiB/s (1678kB/s-6307kB/s), io=16.0MiB (16.8MB), run=1995-2499msec WRITE: bw=12.4MiB/s (12.0MB/s), 3278KiB/s-4849KiB/s (3357kB/s-4966kB/s), io=32.0MiB (33.6MB), run=2499-2583msec