== sanity test 398b: DIO and buffer IO race ============== 05:06:17 (1789031177) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.7415 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178784: Thu Sep 10 05:08:33 2026 read: IOPS=13, BW=52.2KiB/s (53.4kB/s)(5992KiB/114825msec) clat (usec): min=44, max=962842, avg=42616.65, stdev=35735.99 lat (usec): min=45, max=962843, avg=42618.79, stdev=35736.13 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 12649], 10.00th=[ 17171], 20.00th=[ 22152], | 30.00th=[ 26346], 40.00th=[ 31065], 50.00th=[ 36439], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[145753], 99.50th=[166724], 99.90th=[256902], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 103, per=25.29%, avg=51.85, stdev=18.15, samples=226 iops : min= 1, max= 25, avg=12.32, stdev= 4.56, samples=226 write: IOPS=13, BW=54.8KiB/s (56.1kB/s)(6296KiB/114825msec); 0 zone resets clat (usec): min=928, max=241472, avg=32106.53, stdev=32344.85 lat (usec): min=930, max=241474, avg=32112.46, stdev=32341.83 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1860], 20.00th=[ 3949], | 30.00th=[ 7439], 40.00th=[ 15270], 50.00th=[ 23987], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 54789], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[158335], 99.90th=[238027], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 133, per=25.43%, avg=54.68, stdev=23.85, samples=225 iops : min= 1, max= 33, avg=13.04, stdev= 6.03, samples=225 lat (usec) : 50=0.16%, 100=1.33%, 250=0.10%, 750=0.03%, 1000=0.07% lat (msec) : 2=5.66%, 4=4.65%, 10=7.36%, 20=11.23%, 50=42.64% lat (msec) : 100=23.31%, 250=3.39%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.59%, ctx=6678, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178786: Thu Sep 10 05:08:33 2026 read: IOPS=12, BW=51.9KiB/s (53.2kB/s)(5940KiB/114377msec) clat (usec): min=39, max=889913, avg=42735.37, stdev=36042.09 lat (usec): min=39, max=889915, avg=42737.25, stdev=36042.71 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10945], 10.00th=[ 15926], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 42730], | 70.00th=[ 49546], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[147850], 99.50th=[183501], 99.90th=[325059], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 111, per=25.21%, avg=51.68, stdev=18.90, samples=224 iops : min= 1, max= 27, avg=12.28, stdev= 4.76, samples=224 write: IOPS=13, BW=55.5KiB/s (56.8kB/s)(6348KiB/114377msec); 0 zone resets clat (usec): min=998, max=253707, avg=31769.58, stdev=33368.89 lat (usec): min=1000, max=253709, avg=31772.06, stdev=33369.44 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1745], 20.00th=[ 3458], | 30.00th=[ 6521], 40.00th=[ 14091], 50.00th=[ 23200], 60.00th=[ 30802], | 70.00th=[ 40633], 80.00th=[ 55313], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[143655], 99.50th=[166724], 99.90th=[235930], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 142, per=25.66%, avg=55.18, stdev=22.52, samples=224 iops : min= 1, max= 35, avg=13.15, stdev= 5.69, samples=224 lat (usec) : 50=0.36%, 100=1.40%, 250=0.20%, 1000=0.07% lat (msec) : 2=5.99%, 4=5.31%, 10=7.68%, 20=11.39%, 50=41.70% lat (msec) : 100=21.97%, 250=3.84%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.53%, ctx=6543, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178787: Thu Sep 10 05:08:33 2026 read: IOPS=12, BW=51.6KiB/s (52.8kB/s)(6028KiB/116893msec) clat (usec): min=45, max=243601, avg=41689.64, stdev=26849.56 lat (usec): min=46, max=243602, avg=41707.32, stdev=26865.04 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11863], 10.00th=[ 16057], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[132645], 99.50th=[149947], 99.90th=[210764], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 134, per=25.06%, avg=51.38, stdev=20.48, samples=229 iops : min= 1, max= 33, avg=12.21, stdev= 5.17, samples=229 write: IOPS=13, BW=53.6KiB/s (54.8kB/s)(6260KiB/116893msec); 0 zone resets clat (usec): min=1012, max=865712, avg=34261.92, stdev=40197.33 lat (usec): min=1013, max=865712, avg=34264.33, stdev=40197.96 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1254], 10.00th=[ 1811], 20.00th=[ 4228], | 30.00th=[ 8291], 40.00th=[ 16909], 50.00th=[ 24511], 60.00th=[ 32375], | 70.00th=[ 42730], 80.00th=[ 56886], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[152044], 99.50th=[179307], 99.90th=[233833], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 119, per=24.66%, avg=53.03, stdev=21.72, samples=230 iops : min= 1, max= 29, avg=12.63, stdev= 5.49, samples=230 lat (usec) : 50=0.16%, 100=1.20%, 250=0.13%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.66%, 4=4.26%, 10=7.29%, 20=12.37%, 50=41.28% lat (msec) : 100=23.18%, 250=4.36%, 1000=0.03% cpu : usr=0.08%, sys=5.52%, ctx=6731, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178789: Thu Sep 10 05:08:33 2026 read: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6052KiB/115168msec) clat (usec): min=37, max=883003, avg=42060.55, stdev=35129.00 lat (usec): min=37, max=883004, avg=42061.98, stdev=35129.02 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11076], 10.00th=[ 15664], 20.00th=[ 21103], | 30.00th=[ 25822], 40.00th=[ 30802], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[149947], 99.50th=[164627], 99.90th=[287310], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 111, per=25.48%, avg=52.23, stdev=21.41, samples=227 iops : min= 1, max= 27, avg=12.42, stdev= 5.39, samples=227 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6236KiB/115168msec); 0 zone resets clat (usec): min=968, max=279735, avg=32774.60, stdev=34640.13 lat (usec): min=969, max=279736, avg=32789.36, stdev=34651.29 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1745], 20.00th=[ 3654], | 30.00th=[ 6652], 40.00th=[ 13829], 50.00th=[ 23462], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[149947], 99.50th=[164627], 99.90th=[214959], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 151, per=25.03%, avg=53.81, stdev=22.35, samples=227 iops : min= 1, max= 37, avg=12.82, stdev= 5.64, samples=227 lat (usec) : 50=0.16%, 100=1.46%, 250=0.16%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.05%, 4=4.75%, 10=7.88%, 20=11.04%, 50=42.38% lat (msec) : 100=21.26%, 250=4.59%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.49%, ctx=6578, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=205KiB/s (210kB/s), 51.6KiB/s-52.5KiB/s (52.8kB/s-53.8kB/s), io=23.4MiB (24.6MB), run=114377-116893msec WRITE: bw=215KiB/s (220kB/s), 53.6KiB/s-55.5KiB/s (54.8kB/s-56.8kB/s), io=24.6MiB (25.7MB), run=114377-116893msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178783: Thu Sep 10 05:09:21 2026 read: IOPS=9, BW=36.6KiB/s (37.5kB/s)(5992KiB/163773msec) clat (msec): min=5, max=956, avg=41.48, stdev=38.76 lat (msec): min=5, max=956, avg=41.49, stdev=38.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 157], 99.50th=[ 171], 99.90th=[ 224], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 111, per=25.51%, avg=36.99, stdev=20.91, samples=316 iops : min= 1, max= 27, avg= 8.60, stdev= 5.26, samples=316 write: IOPS=9, BW=38.4KiB/s (39.4kB/s)(6296KiB/163773msec); 0 zone resets clat (msec): min=10, max=297, avg=64.35, stdev=40.80 lat (msec): min=10, max=297, avg=64.35, stdev=40.80 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 120], 95.00th=[ 142], | 99.00th=[ 220], 99.50th=[ 257], 99.90th=[ 296], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 109, per=25.05%, avg=38.08, stdev=19.23, samples=322 iops : min= 1, max= 27, avg= 8.87, stdev= 4.83, samples=322 lat (msec) : 10=1.46%, 20=11.62%, 50=47.23%, 100=28.29%, 250=11.07% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.05%, sys=1.86%, ctx=4691, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178785: Thu Sep 10 05:09:21 2026 read: IOPS=9, BW=36.0KiB/s (36.9kB/s)(5940KiB/164950msec) clat (msec): min=5, max=888, avg=43.19, stdev=40.88 lat (msec): min=5, max=888, avg=43.19, stdev=40.88 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 87], 95.00th=[ 123], | 99.00th=[ 174], 99.50th=[ 194], 99.90th=[ 279], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 111, per=25.05%, avg=36.32, stdev=21.68, samples=318 iops : min= 1, max= 27, avg= 8.43, stdev= 5.43, samples=318 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6348KiB/164950msec); 0 zone resets clat (msec): min=10, max=352, avg=63.30, stdev=42.41 lat (msec): min=10, max=352, avg=63.31, stdev=42.41 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 88], 90.00th=[ 114], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 268], 99.90th=[ 305], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 135, per=25.09%, avg=38.14, stdev=20.64, samples=323 iops : min= 1, max= 33, avg= 8.89, stdev= 5.19, samples=323 lat (msec) : 10=1.14%, 20=12.27%, 50=47.43%, 100=28.09%, 250=10.61% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.07%, sys=1.89%, ctx=4880, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178788: Thu Sep 10 05:09:21 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6028KiB/162443msec) clat (msec): min=5, max=286, avg=41.87, stdev=34.66 lat (msec): min=5, max=286, avg=41.88, stdev=34.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 59], 90.00th=[ 87], 95.00th=[ 112], | 99.00th=[ 176], 99.50th=[ 188], 99.90th=[ 275], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 127, per=25.73%, avg=37.32, stdev=20.63, samples=314 iops : min= 1, max= 31, avg= 8.68, stdev= 5.18, samples=314 write: IOPS=9, BW=38.5KiB/s (39.5kB/s)(6260KiB/162443msec); 0 zone resets clat (msec): min=12, max=869, avg=63.27, stdev=43.75 lat (msec): min=12, max=869, avg=63.27, stdev=43.75 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 197], 99.50th=[ 249], 99.90th=[ 296], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 127, per=25.17%, avg=38.26, stdev=19.59, samples=318 iops : min= 1, max= 31, avg= 8.92, stdev= 4.92, samples=318 lat (msec) : 10=1.33%, 20=12.21%, 50=46.84%, 100=29.43%, 250=9.86% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.07%, sys=1.91%, ctx=4841, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178790: Thu Sep 10 05:09:21 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(6052KiB/163965msec) clat (msec): min=5, max=261, avg=42.96, stdev=34.75 lat (msec): min=5, max=261, avg=42.96, stdev=34.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 116], | 99.00th=[ 169], 99.50th=[ 184], 99.90th=[ 236], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 119, per=25.86%, avg=37.50, stdev=21.41, samples=314 iops : min= 1, max= 29, avg= 8.73, stdev= 5.38, samples=314 write: IOPS=9, BW=38.0KiB/s (38.9kB/s)(6236KiB/163965msec); 0 zone resets clat (msec): min=9, max=869, avg=63.24, stdev=45.09 lat (msec): min=9, max=869, avg=63.25, stdev=45.09 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 87], 90.00th=[ 115], 95.00th=[ 144], | 99.00th=[ 220], 99.50th=[ 241], 99.90th=[ 305], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 127, per=24.92%, avg=37.87, stdev=19.35, samples=320 iops : min= 1, max= 31, avg= 8.82, stdev= 4.86, samples=320 lat (msec) : 10=1.33%, 20=12.08%, 50=47.27%, 100=28.06%, 250=11.00% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=1.85%, ctx=4755, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=146KiB/s (149kB/s), 36.0KiB/s-37.1KiB/s (36.9kB/s-37.0kB/s), io=23.4MiB (24.6MB), run=162443-164950msec WRITE: bw=152KiB/s (156kB/s), 38.0KiB/s-38.5KiB/s (38.9kB/s-39.5kB/s), io=24.6MiB (25.7MB), run=162443-164950msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178835: Thu Sep 10 05:10:02 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(5920KiB/30478msec) clat (usec): min=30, max=195561, avg=41976.15, stdev=28314.55 lat (usec): min=30, max=195562, avg=41977.41, stdev=28314.54 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 91], 20.00th=[ 21627], | 30.00th=[ 28967], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 60031], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[119014], 99.50th=[166724], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 320, per=24.80%, avg=194.68, stdev=66.80, samples=60 iops : min= 1, max= 20, avg=11.40, stdev= 4.24, samples=60 write: IOPS=13, BW=209KiB/s (214kB/s)(6368KiB/30478msec); 0 zone resets clat (usec): min=1557, max=293225, avg=36735.78, stdev=35818.02 lat (usec): min=1558, max=293227, avg=36757.31, stdev=35804.75 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2343], 10.00th=[ 3392], 20.00th=[ 5735], | 30.00th=[ 8455], 40.00th=[ 18482], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 61604], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[152044], 99.50th=[175113], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 63, max= 441, per=25.34%, avg=209.28, stdev=82.42, samples=60 iops : min= 3, max= 27, avg=12.33, stdev= 5.22, samples=60 lat (usec) : 50=0.39%, 100=4.69%, 250=0.52%, 750=0.13% lat (msec) : 2=1.95%, 4=4.95%, 10=9.77%, 20=8.07%, 50=39.19% lat (msec) : 100=25.13%, 250=5.08%, 500=0.13% cpu : usr=0.08%, sys=6.06%, ctx=1711, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178837: Thu Sep 10 05:10:02 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(5744KiB/30344msec) clat (usec): min=41, max=231333, avg=44345.17, stdev=32686.00 lat (usec): min=42, max=231334, avg=44346.83, stdev=32685.46 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 2868], 20.00th=[ 21627], | 30.00th=[ 28181], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 53740], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[166724], 99.50th=[217056], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 32, max= 382, per=23.91%, avg=187.73, stdev=70.56, samples=59 iops : min= 2, max= 23, avg=10.97, stdev= 4.39, samples=59 write: IOPS=13, BW=216KiB/s (221kB/s)(6544KiB/30344msec); 0 zone resets clat (usec): min=1548, max=205475, avg=34999.33, stdev=34262.71 lat (usec): min=1550, max=205478, avg=35001.43, stdev=34262.74 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2343], 10.00th=[ 3884], 20.00th=[ 6390], | 30.00th=[ 11076], 40.00th=[ 18220], 50.00th=[ 25822], 60.00th=[ 31851], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[160433], 99.50th=[177210], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 473, per=25.58%, avg=211.25, stdev=90.89, samples=59 iops : min= 1, max= 29, avg=12.46, stdev= 5.76, samples=59 lat (usec) : 50=0.26%, 100=3.52%, 250=0.52%, 500=0.26% lat (msec) : 2=1.82%, 4=3.78%, 10=9.90%, 20=11.46%, 50=39.06% lat (msec) : 100=24.48%, 250=4.95% cpu : usr=0.08%, sys=5.87%, ctx=1679, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178839: Thu Sep 10 05:10:02 2026 read: IOPS=12, BW=208KiB/s (212kB/s)(6256KiB/30149msec) clat (usec): min=48, max=247133, avg=43972.58, stdev=30145.89 lat (usec): min=48, max=247134, avg=43973.96, stdev=30145.84 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 15664], 20.00th=[ 21890], | 30.00th=[ 27395], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 63701], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[133694], 99.50th=[233833], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 44, max= 381, per=26.46%, avg=207.73, stdev=68.50, samples=59 iops : min= 2, max= 23, avg=12.22, stdev= 4.28, samples=59 write: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30149msec); 0 zone resets clat (usec): min=1316, max=213325, avg=33466.30, stdev=32807.44 lat (usec): min=1319, max=213328, avg=33468.45, stdev=32807.50 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1958], 10.00th=[ 3064], 20.00th=[ 5604], | 30.00th=[ 9110], 40.00th=[ 18220], 50.00th=[ 25297], 60.00th=[ 32900], | 70.00th=[ 43779], 80.00th=[ 53740], 90.00th=[ 76022], 95.00th=[100140], | 99.00th=[145753], 99.50th=[187696], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 448, per=23.81%, avg=196.71, stdev=88.61, samples=59 iops : min= 1, max= 28, avg=11.54, stdev= 5.59, samples=59 lat (usec) : 50=0.13%, 100=3.12%, 250=0.65%, 500=0.39% lat (msec) : 2=2.47%, 4=5.08%, 10=7.68%, 20=9.64%, 50=41.93% lat (msec) : 100=24.74%, 250=4.17% cpu : usr=0.07%, sys=6.26%, ctx=1755, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178840: Thu Sep 10 05:10:02 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29504msec) clat (usec): min=31, max=217824, avg=42661.72, stdev=29802.31 lat (usec): min=31, max=217825, avg=42663.08, stdev=29802.26 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 60], 10.00th=[ 82], 20.00th=[ 20579], | 30.00th=[ 27395], 40.00th=[ 33424], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 52691], 80.00th=[ 64750], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[128451], 99.50th=[168821], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 63, max= 381, per=25.83%, avg=202.74, stdev=71.55, samples=58 iops : min= 3, max= 23, avg=11.90, stdev= 4.50, samples=58 write: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29504msec); 0 zone resets clat (usec): min=1552, max=211383, avg=33382.70, stdev=32890.19 lat (usec): min=1555, max=211385, avg=33384.83, stdev=32890.20 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2245], 10.00th=[ 3589], 20.00th=[ 6521], | 30.00th=[ 10290], 40.00th=[ 17957], 50.00th=[ 23462], 60.00th=[ 30540], | 70.00th=[ 40109], 80.00th=[ 52167], 90.00th=[ 78119], 95.00th=[103285], | 99.00th=[137364], 99.50th=[198181], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 63, max= 447, per=25.63%, avg=211.69, stdev=77.78, samples=58 iops : min= 3, max= 27, avg=12.47, stdev= 4.89, samples=58 lat (usec) : 50=0.26%, 100=5.21%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=1.95%, 4=4.30%, 10=8.98%, 20=9.77%, 50=41.02% lat (msec) : 100=22.53%, 250=5.08% cpu : usr=0.07%, sys=6.49%, ctx=1654, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=786KiB/s (805kB/s), 189KiB/s-208KiB/s (194kB/s-212kB/s), io=23.4MiB (24.5MB), run=29504-30478msec WRITE: bw=827KiB/s (847kB/s), 200KiB/s-216KiB/s (205kB/s-221kB/s), io=24.6MiB (25.8MB), run=29504-30478msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178833: Thu Sep 10 05:10:16 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(5920KiB/43211msec) clat (msec): min=8, max=238, avg=49.28, stdev=34.68 lat (msec): min=8, max=238, avg=49.28, stdev=34.68 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 38], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 67], 90.00th=[ 96], 95.00th=[ 128], | 99.00th=[ 184], 99.50th=[ 211], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 318, per=25.05%, avg=136.28, stdev=67.77, samples=85 iops : min= 1, max= 19, avg= 7.69, stdev= 4.24, samples=85 write: IOPS=9, BW=147KiB/s (151kB/s)(6368KiB/43211msec); 0 zone resets clat (msec): min=15, max=286, avg=62.34, stdev=39.66 lat (msec): min=15, max=286, avg=62.35, stdev=39.66 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 93], 90.00th=[ 116], 95.00th=[ 140], | 99.00th=[ 194], 99.50th=[ 266], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 349, per=26.05%, avg=149.02, stdev=72.82, samples=84 iops : min= 1, max= 21, avg= 8.50, stdev= 4.55, samples=84 lat (msec) : 10=0.39%, 20=4.95%, 50=54.95%, 100=26.30%, 250=13.15% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.98%, ctx=1269, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178834: Thu Sep 10 05:10:16 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(5744KiB/44001msec) clat (msec): min=8, max=190, avg=47.31, stdev=30.28 lat (msec): min=8, max=190, avg=47.31, stdev=30.28 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 52], 80.00th=[ 66], 90.00th=[ 84], 95.00th=[ 108], | 99.00th=[ 169], 99.50th=[ 182], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 30, max= 319, per=24.36%, avg=132.50, stdev=75.33, samples=84 iops : min= 1, max= 19, avg= 7.46, stdev= 4.72, samples=84 write: IOPS=9, BW=149KiB/s (152kB/s)(6544KiB/44001msec); 0 zone resets clat (msec): min=10, max=341, avg=65.62, stdev=45.46 lat (msec): min=10, max=341, avg=65.62, stdev=45.46 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 74], 80.00th=[ 96], 90.00th=[ 127], 95.00th=[ 157], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 383, per=25.77%, avg=147.38, stdev=78.42, samples=86 iops : min= 1, max= 23, avg= 8.40, stdev= 4.89, samples=86 lat (msec) : 10=0.65%, 20=5.73%, 50=52.21%, 100=28.65%, 250=12.63% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.95%, ctx=1350, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178836: Thu Sep 10 05:10:16 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(6256KiB/43557msec) clat (msec): min=9, max=244, avg=47.18, stdev=33.12 lat (msec): min=9, max=244, avg=47.18, stdev=33.12 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 90], 95.00th=[ 117], | 99.00th=[ 163], 99.50th=[ 209], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 414, per=26.87%, avg=146.16, stdev=84.44, samples=83 iops : min= 1, max= 25, avg= 8.31, stdev= 5.29, samples=83 write: IOPS=8, BW=138KiB/s (142kB/s)(6032KiB/43557msec); 0 zone resets clat (msec): min=13, max=368, avg=65.90, stdev=47.06 lat (msec): min=13, max=368, avg=65.91, stdev=47.06 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 122], 95.00th=[ 157], | 99.00th=[ 288], 99.50th=[ 342], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 383, per=23.99%, avg=137.23, stdev=65.06, samples=84 iops : min= 1, max= 23, avg= 7.76, stdev= 4.07, samples=84 lat (msec) : 10=0.13%, 20=8.33%, 50=50.91%, 100=27.73%, 250=12.24% lat (msec) : 500=0.65% cpu : usr=0.07%, sys=2.01%, ctx=1345, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178838: Thu Sep 10 05:10:16 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(6032KiB/42797msec) clat (msec): min=9, max=257, avg=46.86, stdev=33.79 lat (msec): min=9, max=257, avg=46.86, stdev=33.79 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 115], | 99.00th=[ 176], 99.50th=[ 255], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 415, per=25.72%, avg=139.92, stdev=76.63, samples=84 iops : min= 1, max= 25, avg= 7.93, stdev= 4.82, samples=84 write: IOPS=9, BW=146KiB/s (150kB/s)(6256KiB/42797msec); 0 zone resets clat (msec): min=15, max=268, avg=64.16, stdev=41.08 lat (msec): min=15, max=268, avg=64.16, stdev=41.08 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 129], 95.00th=[ 148], | 99.00th=[ 213], 99.50th=[ 234], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 382, per=25.51%, avg=145.92, stdev=72.49, samples=84 iops : min= 1, max= 23, avg= 8.31, stdev= 4.55, samples=84 lat (msec) : 10=0.52%, 20=6.25%, 50=52.47%, 100=28.26%, 250=12.11% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=2.04%, ctx=1307, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=544KiB/s (557kB/s), 131KiB/s-144KiB/s (134kB/s-147kB/s), io=23.4MiB (24.5MB), run=42797-44001msec WRITE: bw=573KiB/s (586kB/s), 138KiB/s-149KiB/s (142kB/s-152kB/s), io=24.6MiB (25.8MB), run=42797-44001msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178853: Thu Sep 10 05:10:33 2026 read: IOPS=1, BW=1503KiB/s (1539kB/s)(7168KiB/4770msec) clat (usec): min=1198, max=381837, avg=193610.37, stdev=134778.74 lat (usec): min=1200, max=381838, avg=193612.13, stdev=134778.67 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1205], 10.00th=[ 1205], 20.00th=[115868], | 30.00th=[116917], 40.00th=[116917], 50.00th=[183501], 60.00th=[206570], | 70.00th=[206570], 80.00th=[350225], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 1768, max= 4345, per=89.81%, avg=2720.33, stdev=1413.95, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1073KiB/s (1099kB/s)(5120KiB/4770msec); 0 zone resets clat (msec): min=145, max=2227, avg=649.29, stdev=888.92 lat (msec): min=145, max=2227, avg=649.38, stdev=888.92 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 2048, max= 4079, per=72.24%, avg=3063.50, stdev=1436.13, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (msec) : 2=8.33%, 250=58.33%, 500=25.00%, >=2000=8.33% cpu : usr=0.02%, sys=13.34%, ctx=202, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178854: Thu Sep 10 05:10:33 2026 read: IOPS=0, BW=303KiB/s (310kB/s)(2048KiB/6760msec) clat (usec): min=473, max=2527.1k, avg=1263777.33, stdev=1786581.61 lat (usec): min=474, max=2527.1k, avg=1263779.33, stdev=1786583.04 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], | 20.00th=[ 474], 30.00th=[ 474], 40.00th=[ 474], | 50.00th=[ 474], 60.00th=[2533360], 70.00th=[2533360], | 80.00th=[2533360], 90.00th=[2533360], 95.00th=[2533360], | 99.00th=[2533360], 99.50th=[2533360], 99.90th=[2533360], | 99.95th=[2533360], 99.99th=[2533360] bw ( KiB/s): min= 2023, max= 2043, per=67.12%, avg=2033.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1515KiB/s (1551kB/s)(10.0MiB/6760msec); 0 zone resets clat (msec): min=192, max=1151, avg=417.95, stdev=288.91 lat (msec): min=193, max=1152, avg=418.05, stdev=288.88 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 207], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 309], 60.00th=[ 321], | 70.00th=[ 351], 80.00th=[ 430], 90.00th=[ 651], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1805, max= 4087, per=70.85%, avg=3004.83, stdev=1151.49, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (usec) : 500=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=12.89%, ctx=656, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178855: Thu Sep 10 05:10:33 2026 read: IOPS=0, BW=1021KiB/s (1046kB/s)(6144KiB/6015msec) clat (usec): min=419, max=306570, avg=113056.45, stdev=133296.93 lat (usec): min=420, max=306571, avg=113057.82, stdev=133296.64 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 791], | 30.00th=[ 791], 40.00th=[ 922], 50.00th=[ 922], 60.00th=[143655], | 70.00th=[225444], 80.00th=[225444], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 2039, max= 6144, per=100.00%, avg=3408.67, stdev=2368.87, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=0, BW=1021KiB/s (1046kB/s)(6144KiB/6015msec); 0 zone resets clat (msec): min=166, max=3061, avg=860.22, stdev=1103.74 lat (msec): min=166, max=3061, avg=860.29, stdev=1103.77 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 659], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1768, max= 4096, per=56.56%, avg=2398.80, stdev=956.23, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (usec) : 500=8.33%, 1000=16.67% lat (msec) : 250=33.33%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=10.29%, ctx=198, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178856: Thu Sep 10 05:10:33 2026 read: IOPS=0, BW=918KiB/s (940kB/s)(5120KiB/5579msec) clat (usec): min=525, max=282475, avg=137183.04, stdev=129471.16 lat (usec): min=526, max=282477, avg=137184.28, stdev=129471.15 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[187696], 60.00th=[187696], | 70.00th=[214959], 80.00th=[214959], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 2039, max= 6131, per=100.00%, avg=4085.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1285KiB/s (1316kB/s)(7168KiB/5579msec); 0 zone resets clat (msec): min=106, max=2754, avg=686.29, stdev=935.20 lat (msec): min=106, max=2754, avg=686.38, stdev=935.20 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 176], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 351], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 617], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1768, max= 6131, per=82.73%, avg=3508.50, stdev=2034.00, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 2.06, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=13.54%, ctx=121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3030KiB/s (3102kB/s), 303KiB/s-1503KiB/s (310kB/s-1539kB/s), io=20.0MiB (20.0MB), run=4770-6760msec WRITE: bw=4241KiB/s (4343kB/s), 1021KiB/s-1515KiB/s (1046kB/s-1551kB/s), io=28.0MiB (29.4MB), run=4770-6760msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178857: Thu Sep 10 05:10:34 2026 read: IOPS=1, BW=1085KiB/s (1111kB/s)(7168KiB/6605msec) clat (msec): min=97, max=589, avg=246.68, stdev=200.59 lat (msec): min=97, max=589, avg=246.68, stdev=200.59 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 107], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 123], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 464], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2043, max= 4320, per=100.00%, avg=3478.00, stdev=1248.97, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=775KiB/s (794kB/s)(5120KiB/6605msec); 0 zone resets clat (msec): min=351, max=2631, avg=941.74, stdev=952.14 lat (msec): min=352, max=2631, avg=942.09, stdev=952.01 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1980, max= 2043, per=49.69%, avg=2023.25, stdev=29.80, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=3.57%, ctx=98, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178858: Thu Sep 10 05:10:34 2026 read: IOPS=0, BW=291KiB/s (298kB/s)(2048KiB/7040msec) clat (msec): min=357, max=2385, avg=1371.17, stdev=1434.19 lat (msec): min=357, max=2390, avg=1373.64, stdev=1437.68 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 2035, max= 2043, per=70.09%, avg=2039.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1455KiB/s (1489kB/s)(10.0MiB/7040msec); 0 zone resets clat (msec): min=112, max=1205, avg=402.37, stdev=367.73 lat (msec): min=112, max=1205, avg=402.46, stdev=367.73 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 150], | 30.00th=[ 169], 40.00th=[ 192], 50.00th=[ 228], 60.00th=[ 288], | 70.00th=[ 317], 80.00th=[ 435], 90.00th=[ 927], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 2027, max= 6107, per=79.86%, avg=3251.80, stdev=1816.20, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.24%, ctx=174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178859: Thu Sep 10 05:10:34 2026 read: IOPS=0, BW=909KiB/s (931kB/s)(6144KiB/6756msec) clat (msec): min=133, max=503, avg=215.25, stdev=141.83 lat (msec): min=133, max=503, avg=215.25, stdev=141.83 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 171], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2043, max= 4071, per=87.66%, avg=2550.00, stdev=1014.00, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=909KiB/s (931kB/s)(6144KiB/6756msec); 0 zone resets clat (msec): min=311, max=2825, avg=899.13, stdev=963.35 lat (msec): min=311, max=2825, avg=899.57, stdev=963.27 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 701], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2035, max= 3778, per=60.77%, avg=2474.75, stdev=868.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=4.15%, ctx=137, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178860: Thu Sep 10 05:10:34 2026 read: IOPS=0, BW=734KiB/s (751kB/s)(5120KiB/6979msec) clat (msec): min=79, max=395, avg=202.71, stdev=133.28 lat (msec): min=79, max=395, avg=202.71, stdev=133.28 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 132], 60.00th=[ 132], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2019, max= 4087, per=93.38%, avg=2716.33, stdev=1187.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1027KiB/s (1052kB/s)(7168KiB/6979msec); 0 zone resets clat (msec): min=120, max=3577, avg=826.04, stdev=1241.27 lat (msec): min=120, max=3581, avg=827.46, stdev=1242.45 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 126], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 321], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 894], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 1980, max= 4039, per=59.59%, avg=2426.40, stdev=901.84, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.92%, ctx=108, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2909KiB/s (2979kB/s), 291KiB/s-1085KiB/s (298kB/s-1111kB/s), io=20.0MiB (20.0MB), run=6605-7040msec WRITE: bw=4073KiB/s (4170kB/s), 775KiB/s-1455KiB/s (794kB/s-1489kB/s), io=28.0MiB (29.4MB), run=6605-7040msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178868: Thu Sep 10 05:10:49 2026 read: IOPS=0, BW=2622KiB/s (2685kB/s)(12.0MiB/4687msec) clat (msec): min=666, max=2944, avg=1525.96, stdev=1237.69 lat (msec): min=666, max=2944, avg=1525.96, stdev=1237.69 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 2937], 80.00th=[ 2937], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 8078, max= 8159, per=100.00%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=12.04%, ctx=704, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178869: Thu Sep 10 05:10:49 2026 read: IOPS=0, BW=795KiB/s (814kB/s)(4096KiB/5150msec) clat (nsec): min=3240.1M, max=3240.1M, avg=3240114584.00, stdev= 0.00 lat (nsec): min=3240.1M, max=3240.1M, avg=3240116200.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3239], 5.00th=[ 3239], 10.00th=[ 3239], 20.00th=[ 3239], | 30.00th=[ 3239], 40.00th=[ 3239], 50.00th=[ 3239], 60.00th=[ 3239], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1591KiB/s (1629kB/s)(8192KiB/5150msec); 0 zone resets clat (msec): min=265, max=1586, avg=925.92, stdev=934.49 lat (msec): min=266, max=1588, avg=927.93, stdev=934.87 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.26%, ctx=136, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178870: Thu Sep 10 05:10:49 2026 write: IOPS=0, BW=3172KiB/s (3248kB/s)(12.0MiB/3874msec); 0 zone resets clat (msec): min=490, max=2780, avg=1270.31, stdev=1308.04 lat (msec): min=490, max=2780, avg=1270.72, stdev=1308.00 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 2769], 80.00th=[ 2769], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 8047, max= 8078, per=100.00%, avg=8062.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.64%, ctx=79, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178871: Thu Sep 10 05:10:49 2026 write: IOPS=0, BW=2774KiB/s (2840kB/s)(12.0MiB/4430msec); 0 zone resets clat (msec): min=290, max=2791, avg=1467.76, stdev=1257.01 lat (msec): min=290, max=2792, avg=1468.61, stdev=1257.18 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=4.00%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3181KiB/s (3258kB/s), 795KiB/s-2622KiB/s (814kB/s-2685kB/s), io=16.0MiB (16.8MB), run=4687-5150msec WRITE: bw=6363KiB/s (6515kB/s), 1591KiB/s-3172KiB/s (1629kB/s-3248kB/s), io=32.0MiB (33.6MB), run=3874-5150msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178872: Thu Sep 10 05:10:50 2026 read: IOPS=0, BW=2421KiB/s (2479kB/s)(12.0MiB/5075msec) clat (msec): min=189, max=3376, avg=1684.05, stdev=1602.57 lat (msec): min=189, max=3376, avg=1684.05, stdev=1602.57 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 3373], 80.00th=[ 3373], 90.00th=[ 3373], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.23%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178873: Thu Sep 10 05:10:50 2026 read: IOPS=0, BW=752KiB/s (770kB/s)(4096KiB/5444msec) clat (nsec): min=3813.8M, max=3813.8M, avg=3813844194.00, stdev= 0.00 lat (nsec): min=3813.8M, max=3813.8M, avg=3813846436.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3809], 5.00th=[ 3809], 10.00th=[ 3809], 20.00th=[ 3809], | 30.00th=[ 3809], 40.00th=[ 3809], 50.00th=[ 3809], 60.00th=[ 3809], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1505KiB/s (1541kB/s)(8192KiB/5444msec); 0 zone resets clat (msec): min=727, max=837, avg=782.34, stdev=77.35 lat (msec): min=729, max=837, avg=783.47, stdev=75.98 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.55%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178874: Thu Sep 10 05:10:50 2026 write: IOPS=0, BW=2260KiB/s (2314kB/s)(12.0MiB/5437msec); 0 zone resets clat (msec): min=224, max=3687, avg=1798.47, stdev=1752.93 lat (msec): min=228, max=3688, avg=1799.86, stdev=1751.60 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 7922, max= 8062, per=100.00%, avg=7992.00, stdev=98.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.35%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178875: Thu Sep 10 05:10:50 2026 write: IOPS=0, BW=2589KiB/s (2651kB/s)(12.0MiB/4747msec); 0 zone resets clat (msec): min=279, max=3126, avg=1568.67, stdev=1442.21 lat (msec): min=279, max=3127, avg=1569.40, stdev=1442.68 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.25%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3010KiB/s (3082kB/s), 752KiB/s-2421KiB/s (770kB/s-2479kB/s), io=16.0MiB (16.8MB), run=5075-5444msec WRITE: bw=6019KiB/s (6164kB/s), 1505KiB/s-2589KiB/s (1541kB/s-2651kB/s), io=32.0MiB (33.6MB), run=4747-5444msec