== sanity test 398b: DIO and buffer IO race ============== 07:56:22 (1788782182) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.50073 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178815: Mon Sep 7 07:58:57 2026 read: IOPS=11, BW=44.9KiB/s (45.0kB/s)(5992KiB/133391msec) clat (usec): min=36, max=273117, avg=49575.88, stdev=32251.27 lat (usec): min=36, max=273118, avg=49581.05, stdev=32253.13 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 537], 10.00th=[ 17171], 20.00th=[ 24511], | 30.00th=[ 30016], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[108528], | 99.00th=[145753], 99.50th=[175113], 99.90th=[225444], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 143, per=25.15%, avg=44.26, stdev=17.46, samples=263 iops : min= 1, max= 35, avg=10.40, stdev= 4.38, samples=263 write: IOPS=11, BW=47.2KiB/s (48.3kB/s)(6296KiB/133391msec); 0 zone resets clat (usec): min=887, max=329038, avg=37444.46, stdev=40263.65 lat (usec): min=888, max=329039, avg=37452.04, stdev=40265.62 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1418], 20.00th=[ 2933], | 30.00th=[ 5932], 40.00th=[ 12911], 50.00th=[ 26870], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[162530], 99.50th=[204473], 99.90th=[291505], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 118, per=25.29%, avg=46.54, stdev=20.75, samples=263 iops : min= 1, max= 29, avg=10.98, stdev= 5.24, samples=263 lat (usec) : 50=0.39%, 100=1.76%, 250=0.20%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.26% lat (msec) : 2=7.06%, 4=4.82%, 10=7.19%, 20=7.45%, 50=35.94% lat (msec) : 100=27.05%, 250=7.62%, 500=0.10% cpu : usr=0.06%, sys=4.61%, ctx=6255, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178816: Mon Sep 7 07:58:57 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(5940KiB/130535msec) clat (usec): min=32, max=297521, avg=48321.53, stdev=32096.01 lat (usec): min=32, max=297522, avg=48323.86, stdev=32095.74 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 90], 10.00th=[ 16581], 20.00th=[ 23725], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[108528], | 99.00th=[149947], 99.50th=[168821], 99.90th=[200279], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 87, per=25.71%, avg=45.25, stdev=16.09, samples=255 iops : min= 1, max= 21, avg=10.65, stdev= 4.05, samples=255 write: IOPS=12, BW=48.6KiB/s (49.8kB/s)(6348KiB/130535msec); 0 zone resets clat (usec): min=1001, max=360810, avg=36936.39, stdev=41004.32 lat (usec): min=1002, max=360811, avg=36938.43, stdev=41003.88 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1401], 20.00th=[ 3032], | 30.00th=[ 6259], 40.00th=[ 12911], 50.00th=[ 25035], 60.00th=[ 35390], | 70.00th=[ 47973], 80.00th=[ 64226], 90.00th=[ 94897], 95.00th=[114820], | 99.00th=[175113], 99.50th=[217056], 99.90th=[283116], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 118, per=26.21%, avg=48.24, stdev=21.14, samples=255 iops : min= 1, max= 29, avg=11.41, stdev= 5.33, samples=255 lat (usec) : 50=0.39%, 100=2.12%, 250=0.23%, 500=0.03% lat (msec) : 2=7.42%, 4=4.85%, 10=6.87%, 20=8.24%, 50=36.56% lat (msec) : 100=25.36%, 250=7.81%, 500=0.13% cpu : usr=0.07%, sys=4.66%, ctx=6197, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178817: Mon Sep 7 07:58:57 2026 read: IOPS=11, BW=44.4KiB/s (45.4kB/s)(6028KiB/135910msec) clat (usec): min=33, max=358661, avg=48374.22, stdev=33942.59 lat (usec): min=33, max=358663, avg=48377.10, stdev=33941.13 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 101], 10.00th=[ 15795], 20.00th=[ 23462], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[107480], | 99.00th=[168821], 99.50th=[198181], 99.90th=[291505], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 95, per=24.93%, avg=43.88, stdev=18.46, samples=267 iops : min= 1, max= 23, avg=10.31, stdev= 4.65, samples=267 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6260KiB/135910msec); 0 zone resets clat (usec): min=950, max=349995, avg=40140.35, stdev=40787.61 lat (usec): min=952, max=349997, avg=40145.44, stdev=40785.84 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1582], 20.00th=[ 3884], | 30.00th=[ 8225], 40.00th=[ 18482], 50.00th=[ 30540], 60.00th=[ 41157], | 70.00th=[ 53216], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[175113], 99.50th=[196084], 99.90th=[246416], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 127, per=24.72%, avg=45.49, stdev=20.69, samples=267 iops : min= 1, max= 31, avg=10.71, stdev= 5.20, samples=267 lat (usec) : 50=0.33%, 100=2.12%, 250=0.23%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=6.12%, 4=4.13%, 10=6.45%, 20=8.43%, 50=35.64% lat (msec) : 100=28.42%, 250=7.68%, 500=0.16% cpu : usr=0.08%, sys=4.50%, ctx=6406, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178818: Mon Sep 7 07:58:57 2026 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6052KiB/135582msec) clat (usec): min=32, max=243209, avg=49074.44, stdev=32921.05 lat (usec): min=32, max=243210, avg=49077.03, stdev=32925.48 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 70], 10.00th=[ 16319], 20.00th=[ 24249], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 58983], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[110625], | 99.00th=[156238], 99.50th=[187696], 99.90th=[231736], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 96, per=24.96%, avg=43.93, stdev=17.26, samples=267 iops : min= 1, max= 24, avg=10.31, stdev= 4.35, samples=267 write: IOPS=11, BW=45.0KiB/s (47.1kB/s)(6236KiB/135582msec); 0 zone resets clat (usec): min=815, max=269244, avg=39214.55, stdev=39966.39 lat (usec): min=816, max=269245, avg=39222.24, stdev=39966.47 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1713], 20.00th=[ 3884], | 30.00th=[ 7439], 40.00th=[ 18482], 50.00th=[ 28967], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[164627], 99.50th=[193987], 99.90th=[261096], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 127, per=24.68%, avg=45.42, stdev=20.73, samples=266 iops : min= 1, max= 31, avg=10.69, stdev= 5.23, samples=266 lat (usec) : 50=0.55%, 100=2.25%, 250=0.16%, 500=0.03%, 1000=0.07% lat (msec) : 2=5.86%, 4=4.59%, 10=6.51%, 20=7.71%, 50=36.82% lat (msec) : 100=27.28%, 250=8.11%, 500=0.07% cpu : usr=0.07%, sys=4.43%, ctx=6349, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=177KiB/s (181kB/s), 44.4KiB/s-45.5KiB/s (45.4kB/s-46.6kB/s), io=23.4MiB (24.6MB), run=130535-135910msec WRITE: bw=185KiB/s (189kB/s), 45.0KiB/s-48.6KiB/s (47.1kB/s-49.8kB/s), io=24.6MiB (25.7MB), run=130535-135910msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178810: Mon Sep 7 07:59:43 2026 read: IOPS=8, BW=32.8KiB/s (33.6kB/s)(5992KiB/182686msec) clat (msec): min=6, max=746, avg=47.53, stdev=48.71 lat (msec): min=6, max=746, avg=47.53, stdev=48.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 49], 80.00th=[ 70], 90.00th=[ 105], 95.00th=[ 134], | 99.00th=[ 257], 99.50th=[ 300], 99.90th=[ 342], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 135, per=24.94%, avg=32.68, stdev=22.77, samples=355 iops : min= 1, max= 33, avg= 7.50, stdev= 5.74, samples=355 write: IOPS=8, BW=34.5KiB/s (35.3kB/s)(6296KiB/182686msec); 0 zone resets clat (msec): min=11, max=354, avg=70.59, stdev=47.77 lat (msec): min=11, max=354, avg=70.60, stdev=47.77 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 66], | 70.00th=[ 84], 80.00th=[ 109], 90.00th=[ 138], 95.00th=[ 165], | 99.00th=[ 226], 99.50th=[ 279], 99.90th=[ 338], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 119, per=25.01%, avg=34.26, stdev=21.63, samples=356 iops : min= 1, max= 29, avg= 7.90, stdev= 5.45, samples=356 lat (msec) : 10=1.69%, 20=12.43%, 50=44.17%, 100=23.96%, 250=16.86% lat (msec) : 500=0.85%, 750=0.03% cpu : usr=0.05%, sys=1.52%, ctx=4632, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178811: Mon Sep 7 07:59:43 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(5940KiB/181428msec) clat (msec): min=5, max=630, avg=46.63, stdev=46.30 lat (msec): min=5, max=630, avg=46.63, stdev=46.30 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 140], | 99.00th=[ 224], 99.50th=[ 288], 99.90th=[ 372], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 127, per=25.23%, avg=33.05, stdev=23.32, samples=349 iops : min= 1, max= 31, avg= 7.60, stdev= 5.86, samples=349 write: IOPS=8, BW=34.0KiB/s (35.8kB/s)(6348KiB/181428msec); 0 zone resets clat (msec): min=11, max=465, avg=70.44, stdev=47.68 lat (msec): min=11, max=465, avg=70.45, stdev=47.68 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 67], | 70.00th=[ 85], 80.00th=[ 105], 90.00th=[ 133], 95.00th=[ 163], | 99.00th=[ 236], 99.50th=[ 275], 99.90th=[ 363], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 111, per=25.58%, avg=35.04, stdev=21.49, samples=352 iops : min= 1, max= 27, avg= 8.09, stdev= 5.42, samples=352 lat (msec) : 10=1.33%, 20=13.02%, 50=43.82%, 100=25.42%, 250=15.79% lat (msec) : 500=0.59%, 750=0.03% cpu : usr=0.06%, sys=1.57%, ctx=4560, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178812: Mon Sep 7 07:59:43 2026 read: IOPS=8, BW=33.1KiB/s (33.8kB/s)(6028KiB/182363msec) clat (msec): min=5, max=340, avg=47.78, stdev=45.15 lat (msec): min=5, max=340, avg=47.79, stdev=45.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 109], 95.00th=[ 142], | 99.00th=[ 222], 99.50th=[ 257], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 126, per=25.61%, avg=33.55, stdev=22.02, samples=348 iops : min= 1, max= 31, avg= 7.72, stdev= 5.55, samples=348 write: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6260KiB/182363msec); 0 zone resets clat (msec): min=11, max=661, avg=70.26, stdev=52.40 lat (msec): min=11, max=661, avg=70.27, stdev=52.40 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 102], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 255], 99.50th=[ 317], 99.90th=[ 575], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 103, per=24.81%, avg=33.99, stdev=21.55, samples=357 iops : min= 1, max= 25, avg= 7.83, stdev= 5.43, samples=357 lat (msec) : 10=1.20%, 20=12.92%, 50=43.82%, 100=26.11%, 250=15.14% lat (msec) : 500=0.75%, 750=0.07% cpu : usr=0.06%, sys=1.61%, ctx=4732, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178813: Mon Sep 7 07:59:43 2026 read: IOPS=8, BW=33.0KiB/s (33.8kB/s)(6052KiB/183285msec) clat (msec): min=6, max=332, avg=47.02, stdev=44.35 lat (msec): min=6, max=332, avg=47.03, stdev=44.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 222], 99.50th=[ 271], 99.90th=[ 317], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 119, per=26.03%, avg=34.10, stdev=23.21, samples=344 iops : min= 1, max= 29, avg= 7.85, stdev= 5.84, samples=344 write: IOPS=8, BW=34.0KiB/s (34.8kB/s)(6236KiB/183285msec); 0 zone resets clat (msec): min=12, max=645, avg=71.68, stdev=53.53 lat (msec): min=12, max=645, avg=71.69, stdev=53.53 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 66], | 70.00th=[ 81], 80.00th=[ 106], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 259], 99.50th=[ 313], 99.90th=[ 592], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 95, per=24.79%, avg=33.97, stdev=20.78, samples=355 iops : min= 1, max= 23, avg= 7.82, stdev= 5.24, samples=355 lat (msec) : 10=1.30%, 20=12.43%, 50=44.79%, 100=25.10%, 250=15.40% lat (msec) : 500=0.91%, 750=0.07% cpu : usr=0.06%, sys=1.67%, ctx=4772, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=131KiB/s (134kB/s), 32.7KiB/s-33.1KiB/s (33.5kB/s-33.8kB/s), io=23.4MiB (24.6MB), run=181428-183285msec WRITE: bw=137KiB/s (140kB/s), 34.0KiB/s-34.0KiB/s (34.8kB/s-35.8kB/s), io=24.6MiB (25.7MB), run=181428-183285msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178867: Mon Sep 7 08:00:39 2026 read: IOPS=8, BW=143KiB/s (147kB/s)(5920KiB/41353msec) clat (usec): min=32, max=305891, avg=63114.80, stdev=45707.26 lat (usec): min=32, max=305892, avg=63116.01, stdev=45707.20 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 14877], 20.00th=[ 30540], | 30.00th=[ 38536], 40.00th=[ 47449], 50.00th=[ 56886], 60.00th=[ 64750], | 70.00th=[ 77071], 80.00th=[ 88605], 90.00th=[116917], 95.00th=[135267], | 99.00th=[254804], 99.50th=[295699], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 302, per=27.17%, avg=142.94, stdev=54.45, samples=81 iops : min= 1, max= 18, avg= 8.11, stdev= 3.44, samples=81 write: IOPS=9, BW=154KiB/s (158kB/s)(6368KiB/41353msec); 0 zone resets clat (usec): min=1294, max=216918, avg=45134.88, stdev=44428.09 lat (usec): min=1295, max=216921, avg=45137.30, stdev=44427.80 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1745], 10.00th=[ 2835], 20.00th=[ 6456], | 30.00th=[ 11338], 40.00th=[ 19006], 50.00th=[ 31851], 60.00th=[ 44303], | 70.00th=[ 59507], 80.00th=[ 79168], 90.00th=[106431], 95.00th=[141558], | 99.00th=[187696], 99.50th=[196084], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 30, max= 345, per=27.86%, avg=154.07, stdev=74.87, samples=81 iops : min= 1, max= 21, avg= 8.83, stdev= 4.71, samples=81 lat (usec) : 50=0.39%, 100=3.65%, 250=0.13%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.91%, 4=2.99%, 10=7.03%, 20=7.81%, 50=27.99% lat (msec) : 100=32.81%, 250=12.37%, 500=0.52% cpu : usr=0.05%, sys=4.27%, ctx=1596, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178868: Mon Sep 7 08:00:39 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5744KiB/44248msec) clat (usec): min=40, max=372120, avg=64479.43, stdev=46179.93 lat (usec): min=40, max=372121, avg=64484.67, stdev=46174.27 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 71], 10.00th=[ 21103], 20.00th=[ 32637], | 30.00th=[ 39060], 40.00th=[ 49021], 50.00th=[ 58983], 60.00th=[ 67634], | 70.00th=[ 78119], 80.00th=[ 90702], 90.00th=[108528], 95.00th=[141558], | 99.00th=[235930], 99.50th=[304088], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 31, max= 343, per=24.92%, avg=131.06, stdev=59.02, samples=86 iops : min= 1, max= 21, avg= 7.40, stdev= 3.74, samples=86 write: IOPS=9, BW=148KiB/s (151kB/s)(6544KiB/44248msec); 0 zone resets clat (usec): min=1402, max=235658, avg=51521.05, stdev=52469.34 lat (usec): min=1405, max=235660, avg=51524.54, stdev=52470.48 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1729], 10.00th=[ 2900], 20.00th=[ 7242], | 30.00th=[ 12780], 40.00th=[ 25560], 50.00th=[ 33162], 60.00th=[ 47973], | 70.00th=[ 67634], 80.00th=[ 87557], 90.00th=[133694], 95.00th=[158335], | 99.00th=[223347], 99.50th=[231736], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 31, max= 319, per=26.63%, avg=147.24, stdev=65.24, samples=87 iops : min= 1, max= 19, avg= 8.40, stdev= 4.14, samples=87 lat (usec) : 50=0.26%, 100=2.99%, 250=0.39%, 750=0.13% lat (msec) : 2=4.69%, 4=1.82%, 10=6.64%, 20=7.03%, 50=27.73% lat (msec) : 100=33.46%, 250=14.45%, 500=0.39% cpu : usr=0.05%, sys=3.65%, ctx=1563, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178869: Mon Sep 7 08:00:39 2026 read: IOPS=8, BW=137KiB/s (141kB/s)(6256KiB/45504msec) clat (usec): min=42, max=248779, avg=65114.61, stdev=42075.35 lat (usec): min=42, max=248780, avg=65116.20, stdev=42075.57 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 19530], 20.00th=[ 31327], | 30.00th=[ 41681], 40.00th=[ 49546], 50.00th=[ 58983], 60.00th=[ 69731], | 70.00th=[ 82314], 80.00th=[ 98042], 90.00th=[116917], 95.00th=[137364], | 99.00th=[212861], 99.50th=[221250], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 319, per=26.12%, avg=137.39, stdev=60.55, samples=89 iops : min= 1, max= 19, avg= 7.79, stdev= 3.82, samples=89 write: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45504msec); 0 zone resets clat (usec): min=1407, max=292369, avg=53030.35, stdev=53388.84 lat (usec): min=1409, max=292371, avg=53032.53, stdev=53388.86 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1745], 10.00th=[ 3195], 20.00th=[ 7111], | 30.00th=[ 12649], 40.00th=[ 28181], 50.00th=[ 38011], 60.00th=[ 53216], | 70.00th=[ 65799], 80.00th=[ 89654], 90.00th=[120062], 95.00th=[177210], | 99.00th=[244319], 99.50th=[274727], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 374, per=24.14%, avg=133.48, stdev=60.24, samples=87 iops : min= 1, max= 23, avg= 7.54, stdev= 3.83, samples=87 lat (usec) : 50=0.13%, 100=3.91%, 250=0.13% lat (msec) : 2=4.04%, 4=1.82%, 10=6.90%, 20=5.21%, 50=27.21% lat (msec) : 100=33.20%, 250=17.19%, 500=0.26% cpu : usr=0.04%, sys=3.49%, ctx=1637, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178870: Mon Sep 7 08:00:39 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(6032KiB/42978msec) clat (usec): min=42, max=339355, avg=65442.35, stdev=51854.05 lat (usec): min=43, max=339356, avg=65443.50, stdev=51854.04 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 60], 10.00th=[ 96], 20.00th=[ 29230], | 30.00th=[ 37487], 40.00th=[ 45351], 50.00th=[ 54789], 60.00th=[ 64750], | 70.00th=[ 79168], 80.00th=[ 96994], 90.00th=[126354], 95.00th=[154141], | 99.00th=[295699], 99.50th=[316670], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 332, per=26.79%, avg=140.93, stdev=70.05, samples=83 iops : min= 1, max= 20, avg= 8.00, stdev= 4.43, samples=83 write: IOPS=9, BW=146KiB/s (149kB/s)(6256KiB/42978msec); 0 zone resets clat (usec): min=1427, max=348627, avg=46622.29, stdev=50914.95 lat (usec): min=1430, max=348630, avg=46653.29, stdev=50900.38 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1696], 10.00th=[ 1942], 20.00th=[ 5800], | 30.00th=[ 12256], 40.00th=[ 18744], 50.00th=[ 31589], 60.00th=[ 44303], | 70.00th=[ 57934], 80.00th=[ 80217], 90.00th=[107480], 95.00th=[143655], | 99.00th=[248513], 99.50th=[337642], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 479, per=26.65%, avg=147.39, stdev=77.83, samples=83 iops : min= 1, max= 29, avg= 8.41, stdev= 4.90, samples=83 lat (usec) : 50=0.39%, 100=4.56%, 250=0.13%, 1000=0.13% lat (msec) : 2=5.34%, 4=2.73%, 10=5.99%, 20=7.68%, 50=27.08% lat (msec) : 100=30.60%, 250=14.19%, 500=1.17% cpu : usr=0.05%, sys=3.90%, ctx=1572, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=526KiB/s (539kB/s), 130KiB/s-143KiB/s (133kB/s-147kB/s), io=23.4MiB (24.5MB), run=41353-45504msec WRITE: bw=554KiB/s (567kB/s), 133KiB/s-154KiB/s (136kB/s-158kB/s), io=24.6MiB (25.8MB), run=41353-45504msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178862: Mon Sep 7 08:00:53 2026 read: IOPS=6, BW=97.9KiB/s (100kB/s)(5920KiB/60494msec) clat (msec): min=7, max=468, avg=61.50, stdev=56.18 lat (msec): min=7, max=468, avg=61.51, stdev=56.18 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 88], 90.00th=[ 142], 95.00th=[ 184], | 99.00th=[ 253], 99.50th=[ 334], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 30, max= 317, per=26.24%, avg=103.63, stdev=66.43, samples=111 iops : min= 1, max= 19, avg= 5.66, stdev= 4.20, samples=111 write: IOPS=6, BW=105KiB/s (108kB/s)(6368KiB/60494msec); 0 zone resets clat (msec): min=17, max=523, avg=94.67, stdev=67.99 lat (msec): min=17, max=523, avg=94.68, stdev=67.99 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 36], 20.00th=[ 44], | 30.00th=[ 52], 40.00th=[ 60], 50.00th=[ 69], 60.00th=[ 87], | 70.00th=[ 115], 80.00th=[ 140], 90.00th=[ 184], 95.00th=[ 230], | 99.00th=[ 368], 99.50th=[ 397], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 30, max= 317, per=26.23%, avg=109.13, stdev=65.65, samples=114 iops : min= 1, max= 19, avg= 6.01, stdev= 4.13, samples=114 lat (msec) : 10=0.78%, 20=5.99%, 50=36.20%, 100=30.60%, 250=24.22% lat (msec) : 500=2.08%, 750=0.13% cpu : usr=0.03%, sys=1.26%, ctx=1157, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178863: Mon Sep 7 08:00:53 2026 read: IOPS=5, BW=95.3KiB/s (97.5kB/s)(5744KiB/60300msec) clat (msec): min=7, max=406, avg=59.65, stdev=53.91 lat (msec): min=7, max=406, avg=59.65, stdev=53.91 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 52], | 70.00th=[ 62], 80.00th=[ 84], 90.00th=[ 130], 95.00th=[ 186], | 99.00th=[ 243], 99.50th=[ 330], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 380, per=27.30%, avg=107.83, stdev=69.74, samples=103 iops : min= 1, max= 23, avg= 5.92, stdev= 4.42, samples=103 write: IOPS=6, BW=109KiB/s (111kB/s)(6544KiB/60300msec); 0 zone resets clat (msec): min=19, max=426, avg=94.67, stdev=67.96 lat (msec): min=19, max=426, avg=94.68, stdev=67.96 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 44], | 30.00th=[ 52], 40.00th=[ 59], 50.00th=[ 70], 60.00th=[ 86], | 70.00th=[ 109], 80.00th=[ 140], 90.00th=[ 192], 95.00th=[ 226], | 99.00th=[ 326], 99.50th=[ 409], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 318, per=26.22%, avg=109.06, stdev=64.58, samples=116 iops : min= 1, max= 19, avg= 6.01, stdev= 4.05, samples=116 lat (msec) : 10=0.39%, 20=6.25%, 50=36.20%, 100=32.16%, 250=23.05% lat (msec) : 500=1.95% cpu : usr=0.03%, sys=1.06%, ctx=1085, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178864: Mon Sep 7 08:00:53 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59750msec) clat (msec): min=7, max=478, avg=65.23, stdev=60.75 lat (msec): min=7, max=478, avg=65.23, stdev=60.75 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 95], 90.00th=[ 148], 95.00th=[ 186], | 99.00th=[ 317], 99.50th=[ 363], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 380, per=28.19%, avg=111.36, stdev=75.64, samples=110 iops : min= 1, max= 23, avg= 6.15, stdev= 4.76, samples=110 write: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59750msec); 0 zone resets clat (msec): min=19, max=428, avg=90.40, stdev=59.65 lat (msec): min=19, max=428, avg=90.40, stdev=59.65 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 45], | 30.00th=[ 52], 40.00th=[ 59], 50.00th=[ 72], 60.00th=[ 86], | 70.00th=[ 109], 80.00th=[ 131], 90.00th=[ 163], 95.00th=[ 194], | 99.00th=[ 309], 99.50th=[ 363], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 253, per=24.48%, avg=101.85, stdev=58.63, samples=114 iops : min= 1, max= 15, avg= 5.55, stdev= 3.72, samples=114 lat (msec) : 10=0.39%, 20=5.99%, 50=37.11%, 100=30.86%, 250=23.96% lat (msec) : 500=1.69% cpu : usr=0.03%, sys=1.21%, ctx=1141, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178865: Mon Sep 7 08:00:53 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(6032KiB/59542msec) clat (msec): min=7, max=358, avg=64.34, stdev=53.97 lat (msec): min=7, max=358, avg=64.34, stdev=53.97 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 69], 80.00th=[ 97], 90.00th=[ 148], 95.00th=[ 178], | 99.00th=[ 271], 99.50th=[ 313], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 29, max= 316, per=26.48%, avg=104.59, stdev=64.06, samples=111 iops : min= 1, max= 19, avg= 5.73, stdev= 4.04, samples=111 write: IOPS=6, BW=105KiB/s (108kB/s)(6256KiB/59542msec); 0 zone resets clat (msec): min=20, max=519, avg=89.80, stdev=60.63 lat (msec): min=20, max=519, avg=89.84, stdev=60.67 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 46], | 30.00th=[ 53], 40.00th=[ 59], 50.00th=[ 69], 60.00th=[ 83], | 70.00th=[ 100], 80.00th=[ 129], 90.00th=[ 174], 95.00th=[ 203], | 99.00th=[ 305], 99.50th=[ 321], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 30, max= 381, per=26.32%, avg=109.50, stdev=63.12, samples=111 iops : min= 1, max= 23, avg= 6.05, stdev= 4.01, samples=111 lat (msec) : 10=0.26%, 20=4.17%, 50=36.98%, 100=34.51%, 250=22.27% lat (msec) : 500=1.69%, 750=0.13% cpu : usr=0.04%, sys=1.15%, ctx=1091, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=396KiB/s (405kB/s), 95.3KiB/s-105KiB/s (97.5kB/s-107kB/s), io=23.4MiB (24.5MB), run=59542-60494msec WRITE: bw=417KiB/s (427kB/s), 101KiB/s-109KiB/s (103kB/s-111kB/s), io=24.6MiB (25.8MB), run=59542-60494msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178900: Mon Sep 7 08:01:09 2026 read: IOPS=1, BW=1887KiB/s (1932kB/s)(7168KiB/3799msec) clat (msec): min=235, max=398, avg=313.27, stdev=66.24 lat (msec): min=235, max=398, avg=313.27, stdev=66.24 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 245], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 292], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 384], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1932, max= 4023, per=55.06%, avg=2396.00, stdev=910.14, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1348KiB/s (1380kB/s)(5120KiB/3799msec); 0 zone resets clat (msec): min=220, max=415, avg=320.61, stdev=87.80 lat (msec): min=221, max=415, avg=320.83, stdev=87.68 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1932, max= 4079, per=41.06%, avg=2501.50, stdev=1052.27, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=25.00%, 500=75.00% cpu : usr=0.00%, sys=17.67%, ctx=251, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178901: Mon Sep 7 08:01:09 2026 read: IOPS=0, BW=435KiB/s (446kB/s)(2048KiB/4705msec) clat (usec): min=969, max=605825, avg=303397.59, stdev=427698.32 lat (usec): min=970, max=605827, avg=303399.17, stdev=427698.43 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 971], 10.00th=[ 971], 20.00th=[ 971], | 30.00th=[ 971], 40.00th=[ 971], 50.00th=[ 971], 60.00th=[608175], | 70.00th=[608175], 80.00th=[608175], 90.00th=[608175], 95.00th=[608175], | 99.00th=[608175], 99.50th=[608175], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 1535, max= 1988, per=40.48%, avg=1761.50, stdev=320.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2176KiB/s (2229kB/s)(10.0MiB/4705msec); 0 zone resets clat (msec): min=96, max=1577, avg=409.60, stdev=438.77 lat (msec): min=97, max=1577, avg=409.71, stdev=438.73 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 138], | 30.00th=[ 176], 40.00th=[ 184], 50.00th=[ 243], 60.00th=[ 296], | 70.00th=[ 347], 80.00th=[ 422], 90.00th=[ 625], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1892, max= 5965, per=57.15%, avg=3482.00, stdev=1935.34, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=13.20%, ctx=111, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178902: Mon Sep 7 08:01:09 2026 read: IOPS=1, BW=1646KiB/s (1685kB/s)(6144KiB/3733msec) clat (msec): min=3, max=475, avg=249.92, stdev=183.46 lat (msec): min=3, max=475, avg=249.92, stdev=183.46 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 266], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1932, max= 4079, per=76.73%, avg=3339.33, stdev=1219.32, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1646KiB/s (1685kB/s)(6144KiB/3733msec); 0 zone resets clat (msec): min=149, max=903, avg=371.66, stdev=267.27 lat (msec): min=149, max=903, avg=371.79, stdev=267.26 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 305], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1932, max= 4096, per=39.59%, avg=2412.40, stdev=942.06, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 4=8.33%, 250=25.00%, 500=58.33%, 1000=8.33% cpu : usr=0.00%, sys=13.72%, ctx=110, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178903: Mon Sep 7 08:01:09 2026 read: IOPS=1, BW=1409KiB/s (1443kB/s)(5120KiB/3633msec) clat (usec): min=1534, max=280148, avg=113641.64, stdev=152000.03 lat (usec): min=1535, max=280150, avg=113642.92, stdev=152000.18 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1532], 10.00th=[ 1532], 20.00th=[ 1532], | 30.00th=[ 2409], 40.00th=[ 2409], 50.00th=[ 3982], 60.00th=[ 3982], | 70.00th=[278922], 80.00th=[278922], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1973KiB/s (2020kB/s)(7168KiB/3633msec); 0 zone resets clat (msec): min=229, max=998, avg=436.97, stdev=265.76 lat (msec): min=229, max=998, avg=437.56, stdev=265.49 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 268], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 359], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 531], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1885, max= 4007, per=38.80%, avg=2363.80, stdev=919.93, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 4=16.67%, 250=8.33%, 500=50.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=15.75%, ctx=199, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4353KiB/s (4457kB/s), 435KiB/s-1887KiB/s (446kB/s-1932kB/s), io=20.0MiB (20.0MB), run=3633-4705msec WRITE: bw=6094KiB/s (6240kB/s), 1348KiB/s-2176KiB/s (1380kB/s-2229kB/s), io=28.0MiB (29.4MB), run=3633-4705msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178895: Mon Sep 7 08:01:10 2026 read: IOPS=1, BW=1543KiB/s (1581kB/s)(7168KiB/4644msec) clat (msec): min=90, max=1933, avg=501.37, stdev=672.37 lat (msec): min=90, max=1933, avg=501.37, stdev=672.37 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 96], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 220], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 751], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1885, max= 5389, per=82.96%, avg=3104.33, stdev=1980.08, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1102KiB/s (1129kB/s)(5120KiB/4644msec); 0 zone resets clat (msec): min=110, max=358, avg=216.98, stdev=98.15 lat (msec): min=110, max=358, avg=217.08, stdev=98.14 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1347, max= 6131, per=59.57%, avg=3121.00, stdev=2620.58, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.65%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178896: Mon Sep 7 08:01:10 2026 read: IOPS=0, BW=397KiB/s (406kB/s)(2048KiB/5162msec) clat (msec): min=155, max=1156, avg=656.01, stdev=707.65 lat (msec): min=155, max=1156, avg=656.01, stdev=707.65 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1354, max= 2007, per=44.91%, avg=1680.50, stdev=461.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1984KiB/s (2031kB/s)(10.0MiB/5162msec); 0 zone resets clat (msec): min=139, max=1239, avg=370.71, stdev=347.89 lat (msec): min=140, max=1240, avg=370.98, stdev=348.32 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 161], | 30.00th=[ 184], 40.00th=[ 192], 50.00th=[ 211], 60.00th=[ 215], | 70.00th=[ 247], 80.00th=[ 430], 90.00th=[ 693], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1885, max= 4063, per=46.78%, avg=2450.67, stdev=843.47, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 0.82, samples=6 lat (msec) : 250=66.67%, 500=8.33%, 750=8.33%, 2000=16.67% cpu : usr=0.02%, sys=5.56%, ctx=103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178897: Mon Sep 7 08:01:10 2026 read: IOPS=1, BW=1123KiB/s (1150kB/s)(6144KiB/5472msec) clat (msec): min=91, max=1077, avg=609.46, stdev=469.50 lat (msec): min=91, max=1077, avg=609.46, stdev=469.50 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 1003], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2007, max= 4087, per=67.82%, avg=2538.00, stdev=1032.72, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1123KiB/s (1150kB/s)(6144KiB/5472msec); 0 zone resets clat (msec): min=165, max=503, avg=285.20, stdev=139.56 lat (msec): min=166, max=503, avg=285.33, stdev=139.53 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 313], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1885, max= 2763, per=41.05%, avg=2150.80, stdev=348.46, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 2000=25.00% cpu : usr=0.00%, sys=3.95%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178898: Mon Sep 7 08:01:10 2026 read: IOPS=1, BW=1372KiB/s (1405kB/s)(5120KiB/3731msec) clat (msec): min=81, max=331, avg=204.12, stdev=116.55 lat (msec): min=81, max=331, avg=204.12, stdev=116.55 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 3771, max= 4087, per=100.00%, avg=3929.00, stdev=223.45, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1921KiB/s (1967kB/s)(7168KiB/3731msec); 0 zone resets clat (msec): min=153, max=658, avg=371.13, stdev=215.25 lat (msec): min=153, max=659, avg=371.35, stdev=215.41 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 167], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 279], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 617], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1885, max= 2727, per=41.01%, avg=2148.40, stdev=330.65, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=6.51%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3743KiB/s (3833kB/s), 397KiB/s-1543KiB/s (406kB/s-1581kB/s), io=20.0MiB (20.0MB), run=3731-5472msec WRITE: bw=5240KiB/s (5366kB/s), 1102KiB/s-1984KiB/s (1129kB/s-2031kB/s), io=28.0MiB (29.4MB), run=3731-5472msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178909: Mon Sep 7 08:01:25 2026 read: IOPS=0, BW=3224KiB/s (3301kB/s)(12.0MiB/3812msec) clat (msec): min=1001, max=1535, avg=1234.77, stdev=273.58 lat (msec): min=1001, max=1535, avg=1234.77, stdev=273.58 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=1.65%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178910: Mon Sep 7 08:01:25 2026 read: IOPS=0, BW=1202KiB/s (1231kB/s)(4096KiB/3408msec) clat (nsec): min=1068.5M, max=1068.5M, avg=1068509055.00, stdev= 0.00 lat (nsec): min=1068.5M, max=1068.5M, avg=1068509984.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2404KiB/s (2461kB/s)(8192KiB/3408msec); 0 zone resets clat (msec): min=820, max=1429, avg=1124.94, stdev=431.14 lat (msec): min=823, max=1430, avg=1127.09, stdev=429.28 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8094, max= 8094, per=84.82%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.76%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178911: Mon Sep 7 08:01:25 2026 write: IOPS=1, BW=4553KiB/s (4662kB/s)(12.0MiB/2699msec); 0 zone resets clat (msec): min=315, max=1394, avg=852.65, stdev=539.23 lat (msec): min=316, max=1406, avg=857.16, stdev=545.46 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7460, max= 8159, per=81.84%, avg=7809.50, stdev=494.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=6.60%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178912: Mon Sep 7 08:01:25 2026 write: IOPS=0, BW=3578KiB/s (3664kB/s)(12.0MiB/3434msec); 0 zone resets clat (msec): min=304, max=2747, avg=1125.18, stdev=1404.89 lat (msec): min=304, max=2747, avg=1125.61, stdev=1404.90 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min=11206, max=11206, per=100.00%, avg=11206.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.06%, sys=3.93%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4298KiB/s (4401kB/s), 1202KiB/s-3224KiB/s (1231kB/s-3301kB/s), io=16.0MiB (16.8MB), run=3408-3812msec WRITE: bw=9542KiB/s (9771kB/s), 2404KiB/s-4553KiB/s (2461kB/s-4662kB/s), io=32.0MiB (33.6MB), run=2699-3434msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178915: Mon Sep 7 08:01:25 2026 read: IOPS=0, BW=4093KiB/s (4192kB/s)(12.0MiB/3002msec) clat (msec): min=875, max=1061, avg=997.48, stdev=105.48 lat (msec): min=875, max=1061, avg=997.48, stdev=105.48 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8000, max= 8031, per=100.00%, avg=8015.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.46%, ctx=268, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178916: Mon Sep 7 08:01:25 2026 read: IOPS=0, BW=1047KiB/s (1072kB/s)(4096KiB/3913msec) clat (nsec): min=926915k, max=926915k, avg=926915399.00, stdev= 0.00 lat (nsec): min=926917k, max=926917k, avg=926916746.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2094KiB/s (2144kB/s)(8192KiB/3913msec); 0 zone resets clat (msec): min=352, max=2620, avg=1486.14, stdev=1603.83 lat (msec): min=364, max=2620, avg=1492.53, stdev=1595.42 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 2635], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 8192, max= 8192, per=97.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=4.63%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178917: Mon Sep 7 08:01:25 2026 write: IOPS=0, BW=3174KiB/s (3251kB/s)(12.0MiB/3871msec); 0 zone resets clat (msec): min=451, max=2114, avg=1288.78, stdev=831.55 lat (msec): min=452, max=2114, avg=1289.33, stdev=831.23 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8031, max= 8192, per=96.87%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.69%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178918: Mon Sep 7 08:01:25 2026 write: IOPS=0, BW=3669KiB/s (3757kB/s)(12.0MiB/3349msec); 0 zone resets clat (msec): min=663, max=1941, avg=1113.97, stdev=717.71 lat (msec): min=663, max=1942, avg=1114.46, stdev=717.73 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8000, max= 8143, per=96.39%, avg=8071.50, stdev=101.12, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.81%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4187KiB/s (4288kB/s), 1047KiB/s-4093KiB/s (1072kB/s-4192kB/s), io=16.0MiB (16.8MB), run=3002-3913msec WRITE: bw=8374KiB/s (8575kB/s), 2094KiB/s-3669KiB/s (2144kB/s-3757kB/s), io=32.0MiB (33.6MB), run=3349-3913msec