== sanity test 398b: DIO and buffer IO race ============== 17:29:19 (1788816559) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.67542 s, 10.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144716: Mon Sep 7 17:31:04 2026 read: IOPS=17, BW=68.6KiB/s (70.3kB/s)(5992KiB/87298msec) clat (usec): min=34, max=364733, avg=28040.20, stdev=23884.02 lat (usec): min=35, max=364735, avg=28043.68, stdev=23885.39 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 123], 20.00th=[ 13304], | 30.00th=[ 16319], 40.00th=[ 20055], 50.00th=[ 23462], 60.00th=[ 27657], | 70.00th=[ 33817], 80.00th=[ 41681], 90.00th=[ 53740], 95.00th=[ 66847], | 99.00th=[107480], 99.50th=[119014], 99.90th=[325059], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 135, per=25.93%, avg=68.98, stdev=26.27, samples=171 iops : min= 1, max= 33, avg=16.65, stdev= 6.56, samples=171 write: IOPS=18, BW=72.1KiB/s (73.9kB/s)(6296KiB/87298msec); 0 zone resets clat (usec): min=937, max=701992, avg=28558.68, stdev=34374.88 lat (usec): min=938, max=701993, avg=28562.59, stdev=34373.81 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1483], 10.00th=[ 2040], 20.00th=[ 3556], | 30.00th=[ 6128], 40.00th=[ 12387], 50.00th=[ 20579], 60.00th=[ 29754], | 70.00th=[ 37487], 80.00th=[ 47973], 90.00th=[ 64226], 95.00th=[ 79168], | 99.00th=[129500], 99.50th=[158335], 99.90th=[471860], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 151, per=25.91%, avg=72.04, stdev=25.85, samples=172 iops : min= 1, max= 37, avg=17.42, stdev= 6.48, samples=172 lat (usec) : 50=0.36%, 100=4.04%, 250=1.07%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.01%, 4=6.22%, 10=8.85%, 20=18.98%, 50=39.65% lat (msec) : 100=13.77%, 250=1.63%, 500=0.10%, 750=0.03% cpu : usr=0.10%, sys=8.19%, ctx=6795, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144717: Mon Sep 7 17:31:04 2026 read: IOPS=16, BW=67.8KiB/s (69.5kB/s)(5940KiB/87550msec) clat (usec): min=34, max=415300, avg=27261.91, stdev=21982.27 lat (usec): min=34, max=415300, avg=27263.22, stdev=21982.26 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 194], 20.00th=[ 13173], | 30.00th=[ 16450], 40.00th=[ 19530], 50.00th=[ 22414], 60.00th=[ 26608], | 70.00th=[ 32637], 80.00th=[ 41681], 90.00th=[ 52691], 95.00th=[ 64226], | 99.00th=[ 90702], 99.50th=[104334], 99.90th=[154141], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 15, max= 151, per=25.60%, avg=68.09, stdev=26.26, samples=171 iops : min= 3, max= 37, avg=16.43, stdev= 6.56, samples=171 write: IOPS=18, BW=72.5KiB/s (74.2kB/s)(6348KiB/87550msec); 0 zone resets clat (usec): min=892, max=703817, avg=29398.16, stdev=36660.64 lat (usec): min=892, max=703818, avg=29401.99, stdev=36663.79 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1516], 10.00th=[ 2180], 20.00th=[ 3884], | 30.00th=[ 6325], 40.00th=[ 13566], 50.00th=[ 22152], 60.00th=[ 29492], | 70.00th=[ 36963], 80.00th=[ 47973], 90.00th=[ 65799], 95.00th=[ 82314], | 99.00th=[124257], 99.50th=[156238], 99.90th=[608175], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 23, max= 143, per=26.11%, avg=72.59, stdev=25.91, samples=171 iops : min= 5, max= 35, avg=17.56, stdev= 6.52, samples=171 lat (usec) : 50=0.49%, 100=3.55%, 250=0.94%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.43%, 4=6.22%, 10=9.18%, 20=19.86%, 50=39.55% lat (msec) : 100=14.06%, 250=1.40%, 500=0.07%, 750=0.07% cpu : usr=0.10%, sys=8.33%, ctx=6809, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144718: Mon Sep 7 17:31:04 2026 read: IOPS=17, BW=68.3KiB/s (69.0kB/s)(6028KiB/88238msec) clat (usec): min=36, max=695049, avg=27886.96, stdev=26706.29 lat (usec): min=36, max=695051, avg=27890.53, stdev=26707.56 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 196], 20.00th=[ 13304], | 30.00th=[ 16581], 40.00th=[ 19792], 50.00th=[ 23200], 60.00th=[ 27657], | 70.00th=[ 33424], 80.00th=[ 41157], 90.00th=[ 53740], 95.00th=[ 65799], | 99.00th=[ 91751], 99.50th=[104334], 99.90th=[208667], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 15, max= 142, per=25.60%, avg=68.09, stdev=25.17, samples=174 iops : min= 3, max= 35, avg=16.43, stdev= 6.32, samples=174 write: IOPS=17, BW=70.9KiB/s (72.6kB/s)(6260KiB/88238msec); 0 zone resets clat (usec): min=972, max=300055, avg=29310.51, stdev=29300.28 lat (usec): min=973, max=300057, avg=29315.28, stdev=29301.49 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1467], 10.00th=[ 2089], 20.00th=[ 3621], | 30.00th=[ 6325], 40.00th=[ 13566], 50.00th=[ 22938], 60.00th=[ 30540], | 70.00th=[ 38536], 80.00th=[ 50594], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[119014], 99.50th=[147850], 99.90th=[225444], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 151, per=25.44%, avg=70.72, stdev=24.23, samples=174 iops : min= 1, max= 37, avg=17.08, stdev= 6.09, samples=174 lat (usec) : 50=0.49%, 100=3.78%, 250=0.78%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.82%, 4=6.45%, 10=8.24%, 20=18.98%, 50=39.68% lat (msec) : 100=15.17%, 250=1.27%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=8.19%, ctx=6869, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144719: Mon Sep 7 17:31:04 2026 read: IOPS=16, BW=67.1KiB/s (68.7kB/s)(6052KiB/90201msec) clat (usec): min=35, max=308126, avg=28158.61, stdev=23430.25 lat (usec): min=35, max=308127, avg=28160.44, stdev=23430.20 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 123], 20.00th=[ 13173], | 30.00th=[ 16712], 40.00th=[ 19792], 50.00th=[ 23200], 60.00th=[ 27919], | 70.00th=[ 33817], 80.00th=[ 41681], 90.00th=[ 53216], 95.00th=[ 64226], | 99.00th=[100140], 99.50th=[135267], 99.90th=[246416], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 159, per=25.19%, avg=67.02, stdev=26.18, samples=178 iops : min= 1, max= 39, avg=16.16, stdev= 6.57, samples=178 write: IOPS=17, BW=69.1KiB/s (70.8kB/s)(6236KiB/90201msec); 0 zone resets clat (usec): min=1001, max=685099, avg=30305.78, stdev=34871.99 lat (usec): min=1002, max=685101, avg=30309.65, stdev=34870.62 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1369], 10.00th=[ 2024], 20.00th=[ 3785], | 30.00th=[ 6849], 40.00th=[ 15401], 50.00th=[ 23725], 60.00th=[ 30802], | 70.00th=[ 38011], 80.00th=[ 49546], 90.00th=[ 68682], 95.00th=[ 88605], | 99.00th=[131597], 99.50th=[154141], 99.90th=[316670], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 15, max= 143, per=24.82%, avg=68.99, stdev=26.43, samples=178 iops : min= 3, max= 35, avg=16.65, stdev= 6.63, samples=178 lat (usec) : 50=0.55%, 100=3.91%, 250=0.75%, 500=0.13% lat (msec) : 2=5.21%, 4=5.83%, 10=8.33%, 20=18.85%, 50=40.46% lat (msec) : 100=13.90%, 250=1.92%, 500=0.13%, 750=0.03% cpu : usr=0.10%, sys=8.17%, ctx=6931, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=266KiB/s (273kB/s), 67.1KiB/s-68.6KiB/s (68.7kB/s-70.3kB/s), io=23.4MiB (24.6MB), run=87298-90201msec WRITE: bw=279KiB/s (285kB/s), 69.1KiB/s-72.5KiB/s (70.8kB/s-74.2kB/s), io=24.6MiB (25.7MB), run=87298-90201msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144721: Mon Sep 7 17:32:35 2026 read: IOPS=8, BW=33.3KiB/s (34.1kB/s)(5992KiB/180016msec) clat (msec): min=5, max=720, avg=22.99, stdev=28.02 lat (msec): min=5, max=720, avg=23.00, stdev=28.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 51], 95.00th=[ 69], | 99.00th=[ 109], 99.50th=[ 128], 99.90th=[ 211], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 104, per=26.04%, avg=34.63, stdev=22.33, samples=338 iops : min= 1, max= 26, avg= 8.14, stdev= 5.66, samples=338 write: IOPS=8, BW=34.0KiB/s (35.8kB/s)(6296KiB/180016msec); 0 zone resets clat (msec): min=32, max=675, avg=92.41, stdev=47.42 lat (msec): min=32, max=675, avg=92.41, stdev=47.42 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 46], 10.00th=[ 51], 20.00th=[ 58], | 30.00th=[ 67], 40.00th=[ 73], 50.00th=[ 81], 60.00th=[ 89], | 70.00th=[ 100], 80.00th=[ 120], 90.00th=[ 153], 95.00th=[ 180], | 99.00th=[ 251], 99.50th=[ 288], 99.90th=[ 498], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 71, per=24.95%, avg=34.69, stdev=14.60, samples=354 iops : min= 1, max= 17, avg= 8.14, stdev= 3.75, samples=354 lat (msec) : 10=10.06%, 20=22.85%, 50=15.92%, 100=35.32%, 250=15.33% lat (msec) : 500=0.46%, 750=0.07% cpu : usr=0.06%, sys=1.71%, ctx=5385, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144722: Mon Sep 7 17:32:35 2026 read: IOPS=8, BW=32.9KiB/s (33.7kB/s)(5940KiB/180534msec) clat (msec): min=5, max=727, avg=23.52, stdev=30.01 lat (msec): min=5, max=727, avg=23.52, stdev=30.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 31], 90.00th=[ 51], 95.00th=[ 71], | 99.00th=[ 122], 99.50th=[ 155], 99.90th=[ 259], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 136, per=25.80%, avg=34.32, stdev=21.92, samples=338 iops : min= 1, max= 34, avg= 8.05, stdev= 5.56, samples=338 write: IOPS=8, BW=35.2KiB/s (36.0kB/s)(6348KiB/180534msec); 0 zone resets clat (msec): min=31, max=402, avg=91.66, stdev=43.09 lat (msec): min=31, max=402, avg=91.66, stdev=43.09 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 47], 10.00th=[ 53], 20.00th=[ 59], | 30.00th=[ 66], 40.00th=[ 72], 50.00th=[ 80], 60.00th=[ 88], | 70.00th=[ 101], 80.00th=[ 121], 90.00th=[ 153], 95.00th=[ 176], | 99.00th=[ 241], 99.50th=[ 292], 99.90th=[ 347], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 64, per=24.93%, avg=34.66, stdev=14.79, samples=357 iops : min= 1, max= 16, avg= 8.13, stdev= 3.80, samples=357 lat (msec) : 10=10.22%, 20=23.01%, 50=14.62%, 100=35.84%, 250=15.79% lat (msec) : 500=0.49%, 750=0.03% cpu : usr=0.05%, sys=1.67%, ctx=5406, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144723: Mon Sep 7 17:32:35 2026 read: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6028KiB/179714msec) clat (msec): min=5, max=252, avg=24.06, stdev=23.87 lat (msec): min=5, max=252, avg=24.06, stdev=23.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 55], 95.00th=[ 72], | 99.00th=[ 111], 99.50th=[ 138], 99.90th=[ 201], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7, max= 120, per=25.89%, avg=34.44, stdev=21.71, samples=343 iops : min= 1, max= 30, avg= 8.08, stdev= 5.54, samples=343 write: IOPS=8, BW=34.8KiB/s (35.7kB/s)(6260KiB/179714msec); 0 zone resets clat (msec): min=32, max=804, avg=91.59, stdev=49.18 lat (msec): min=32, max=804, avg=91.59, stdev=49.18 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 46], 10.00th=[ 51], 20.00th=[ 58], | 30.00th=[ 66], 40.00th=[ 72], 50.00th=[ 81], 60.00th=[ 88], | 70.00th=[ 99], 80.00th=[ 118], 90.00th=[ 148], 95.00th=[ 176], | 99.00th=[ 241], 99.50th=[ 262], 99.90th=[ 735], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 71, per=24.90%, avg=34.62, stdev=14.90, samples=354 iops : min= 1, max= 17, avg= 8.12, stdev= 3.82, samples=354 lat (msec) : 10=9.77%, 20=23.18%, 50=15.20%, 100=36.36%, 250=15.14% lat (msec) : 500=0.29%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.69%, ctx=5350, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144724: Mon Sep 7 17:32:35 2026 read: IOPS=8, BW=33.0KiB/s (34.8kB/s)(6052KiB/178028msec) clat (msec): min=4, max=459, avg=23.20, stdev=24.82 lat (msec): min=4, max=459, avg=23.20, stdev=24.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 53], 95.00th=[ 74], | 99.00th=[ 108], 99.50th=[ 134], 99.90th=[ 153], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 120, per=26.49%, avg=35.23, stdev=22.66, samples=336 iops : min= 1, max= 30, avg= 8.28, stdev= 5.74, samples=336 write: IOPS=8, BW=35.0KiB/s (35.9kB/s)(6236KiB/178028msec); 0 zone resets clat (msec): min=30, max=862, avg=91.61, stdev=47.94 lat (msec): min=30, max=862, avg=91.61, stdev=47.94 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 45], 10.00th=[ 51], 20.00th=[ 58], | 30.00th=[ 66], 40.00th=[ 74], 50.00th=[ 82], 60.00th=[ 90], | 70.00th=[ 101], 80.00th=[ 116], 90.00th=[ 144], 95.00th=[ 178], | 99.00th=[ 222], 99.50th=[ 288], 99.90th=[ 676], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 71, per=25.18%, avg=35.00, stdev=14.31, samples=348 iops : min= 1, max= 17, avg= 8.22, stdev= 3.69, samples=348 lat (msec) : 10=11.39%, 20=21.84%, 50=15.56%, 100=35.09%, 250=15.76% lat (msec) : 500=0.29%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.75%, ctx=5436, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=133KiB/s (136kB/s), 32.9KiB/s-33.0KiB/s (33.7kB/s-34.8kB/s), io=23.4MiB (24.6MB), run=178028-180534msec WRITE: bw=139KiB/s (143kB/s), 34.8KiB/s-35.2KiB/s (35.7kB/s-36.0kB/s), io=24.6MiB (25.7MB), run=178028-180534msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144763: Mon Sep 7 17:33:00 2026 read: IOPS=20, BW=336KiB/s (344kB/s)(5920KiB/17623msec) clat (usec): min=32, max=114554, avg=23377.37, stdev=17532.61 lat (usec): min=32, max=114554, avg=23378.43, stdev=17532.61 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 334], | 30.00th=[ 15139], 40.00th=[ 18744], 50.00th=[ 22414], 60.00th=[ 27132], | 70.00th=[ 31327], 80.00th=[ 35914], 90.00th=[ 45351], 95.00th=[ 55837], | 99.00th=[ 63701], 99.50th=[ 95945], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 159, max= 507, per=23.98%, avg=325.91, stdev=82.21, samples=34 iops : min= 9, max= 31, avg=19.59, stdev= 5.22, samples=34 write: IOPS=22, BW=361KiB/s (370kB/s)(6368KiB/17623msec); 0 zone resets clat (usec): min=1524, max=174130, avg=22307.36, stdev=22225.54 lat (usec): min=1527, max=174131, avg=22309.88, stdev=22225.73 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2114], 10.00th=[ 2737], 20.00th=[ 4178], | 30.00th=[ 6128], 40.00th=[ 8848], 50.00th=[ 15795], 60.00th=[ 22152], | 70.00th=[ 28967], 80.00th=[ 36439], 90.00th=[ 50070], 95.00th=[ 66847], | 99.00th=[ 91751], 99.50th=[110625], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 63, max= 698, per=24.50%, avg=350.15, stdev=117.41, samples=34 iops : min= 3, max= 43, avg=21.12, stdev= 7.35, samples=34 lat (usec) : 50=0.52%, 100=6.25%, 250=2.73%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=1.82%, 4=8.46%, 10=12.11%, 20=17.58%, 50=40.89% lat (msec) : 100=8.46%, 250=0.39% cpu : usr=0.12%, sys=11.98%, ctx=1659, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144764: Mon Sep 7 17:33:00 2026 read: IOPS=21, BW=336KiB/s (344kB/s)(5744KiB/17084msec) clat (usec): min=37, max=144426, avg=24807.42, stdev=19699.76 lat (usec): min=38, max=144427, avg=24808.42, stdev=19699.77 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 75], 20.00th=[ 457], | 30.00th=[ 15926], 40.00th=[ 19792], 50.00th=[ 22938], 60.00th=[ 26608], | 70.00th=[ 31589], 80.00th=[ 39060], 90.00th=[ 46924], 95.00th=[ 55313], | 99.00th=[ 89654], 99.50th=[109577], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 151, max= 542, per=24.79%, avg=336.94, stdev=94.12, samples=33 iops : min= 9, max= 33, avg=20.27, stdev= 5.86, samples=33 write: IOPS=23, BW=383KiB/s (392kB/s)(6544KiB/17084msec); 0 zone resets clat (usec): min=1363, max=82902, avg=19767.76, stdev=18213.13 lat (usec): min=1364, max=82904, avg=19769.84, stdev=18213.04 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2278], 10.00th=[ 2835], 20.00th=[ 4047], | 30.00th=[ 5997], 40.00th=[ 8848], 50.00th=[12518], 60.00th=[19006], | 70.00th=[26346], 80.00th=[35914], 90.00th=[46924], 95.00th=[57934], | 99.00th=[73925], 99.50th=[82314], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 190, max= 793, per=26.33%, avg=376.30, stdev=125.44, samples=33 iops : min= 11, max= 49, avg=22.73, stdev= 7.95, samples=33 lat (usec) : 50=0.52%, 100=5.34%, 250=3.26%, 500=0.26% lat (msec) : 2=0.78%, 4=9.90%, 10=12.50%, 20=19.27%, 50=40.23% lat (msec) : 100=7.68%, 250=0.26% cpu : usr=0.09%, sys=12.52%, ctx=1680, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144765: Mon Sep 7 17:33:00 2026 read: IOPS=22, BW=365KiB/s (373kB/s)(6256KiB/17162msec) clat (usec): min=31, max=214163, avg=23349.96, stdev=22969.34 lat (usec): min=31, max=214164, avg=23351.12, stdev=22969.31 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 151], | 30.00th=[ 14615], 40.00th=[ 18744], 50.00th=[ 22152], 60.00th=[ 25035], | 70.00th=[ 28443], 80.00th=[ 33817], 90.00th=[ 42206], 95.00th=[ 53216], | 99.00th=[104334], 99.50th=[198181], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 127, max= 606, per=26.83%, avg=364.59, stdev=120.74, samples=34 iops : min= 7, max= 37, avg=22.03, stdev= 7.54, samples=34 write: IOPS=21, BW=351KiB/s (360kB/s)(6032KiB/17162msec); 0 zone resets clat (usec): min=1463, max=110407, avg=21069.31, stdev=20338.53 lat (usec): min=1465, max=110409, avg=21071.23, stdev=20338.60 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2114], 10.00th=[ 2606], 20.00th=[ 4178], | 30.00th=[ 5669], 40.00th=[ 8717], 50.00th=[ 14484], 60.00th=[ 19268], | 70.00th=[ 26870], 80.00th=[ 38536], 90.00th=[ 52691], 95.00th=[ 60556], | 99.00th=[ 79168], 99.50th=[108528], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 191, max= 568, per=24.32%, avg=347.47, stdev=94.51, samples=34 iops : min= 11, max= 35, avg=20.97, stdev= 5.97, samples=34 lat (usec) : 50=0.91%, 100=7.81%, 250=1.95%, 500=0.65%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.69%, 4=7.68%, 10=11.85%, 20=19.66%, 50=38.67% lat (msec) : 100=7.94%, 250=0.91% cpu : usr=0.12%, sys=11.74%, ctx=1574, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144766: Mon Sep 7 17:33:00 2026 read: IOPS=22, BW=357KiB/s (366kB/s)(6032KiB/16892msec) clat (usec): min=44, max=240593, avg=23888.09, stdev=21345.99 lat (usec): min=44, max=240594, avg=23889.13, stdev=21345.99 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 83], 20.00th=[ 219], | 30.00th=[ 15139], 40.00th=[ 19006], 50.00th=[ 22676], 60.00th=[ 25822], | 70.00th=[ 30278], 80.00th=[ 36963], 90.00th=[ 47449], 95.00th=[ 54789], | 99.00th=[ 86508], 99.50th=[111674], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 188, max= 512, per=26.14%, avg=355.18, stdev=82.91, samples=33 iops : min= 11, max= 32, avg=21.42, stdev= 5.23, samples=33 write: IOPS=23, BW=370KiB/s (379kB/s)(6256KiB/16892msec); 0 zone resets clat (usec): min=1504, max=152705, avg=20050.37, stdev=20671.42 lat (usec): min=1506, max=152706, avg=20052.91, stdev=20671.03 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2073], 10.00th=[ 2966], 20.00th=[ 4178], | 30.00th=[ 5473], 40.00th=[ 7308], 50.00th=[ 10945], 60.00th=[ 17171], | 70.00th=[ 26346], 80.00th=[ 34866], 90.00th=[ 51643], 95.00th=[ 63177], | 99.00th=[ 80217], 99.50th=[ 88605], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 158, max= 728, per=25.94%, avg=370.64, stdev=119.85, samples=33 iops : min= 9, max= 45, avg=22.36, stdev= 7.57, samples=33 lat (usec) : 50=0.52%, 100=6.38%, 250=2.99%, 500=0.78%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=2.34%, 4=7.81%, 10=14.97%, 20=17.19%, 50=36.46% lat (msec) : 100=9.64%, 250=0.39% cpu : usr=0.14%, sys=11.92%, ctx=1561, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1359KiB/s (1392kB/s), 336KiB/s-365KiB/s (344kB/s-373kB/s), io=23.4MiB (24.5MB), run=16892-17623msec WRITE: bw=1430KiB/s (1464kB/s), 351KiB/s-383KiB/s (360kB/s-392kB/s), io=24.6MiB (25.8MB), run=16892-17623msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144768: Mon Sep 7 17:33:23 2026 read: IOPS=9, BW=146KiB/s (150kB/s)(5920KiB/40492msec) clat (msec): min=5, max=168, avg=22.08, stdev=21.98 lat (msec): min=5, max=168, avg=22.08, stdev=21.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 44], 95.00th=[ 62], | 99.00th=[ 126], 99.50th=[ 153], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 31, max= 416, per=26.20%, avg=151.42, stdev=85.50, samples=77 iops : min= 1, max= 26, avg= 8.78, stdev= 5.44, samples=77 write: IOPS=9, BW=157KiB/s (161kB/s)(6368KiB/40492msec); 0 zone resets clat (msec): min=31, max=262, avg=81.08, stdev=37.19 lat (msec): min=31, max=262, avg=81.09, stdev=37.19 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 43], 10.00th=[ 46], 20.00th=[ 52], | 30.00th=[ 57], 40.00th=[ 65], 50.00th=[ 71], 60.00th=[ 79], | 70.00th=[ 90], 80.00th=[ 105], 90.00th=[ 129], 95.00th=[ 161], | 99.00th=[ 213], 99.50th=[ 228], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 63, max= 287, per=25.81%, avg=156.90, stdev=64.78, samples=80 iops : min= 3, max= 17, avg= 9.14, stdev= 4.04, samples=80 lat (msec) : 10=8.46%, 20=25.00%, 50=19.27%, 100=34.77%, 250=12.37% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.41%, ctx=1403, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144769: Mon Sep 7 17:33:23 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(5744KiB/41382msec) clat (msec): min=5, max=136, avg=21.91, stdev=19.73 lat (msec): min=5, max=136, avg=21.91, stdev=19.73 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 31], 90.00th=[ 48], 95.00th=[ 66], | 99.00th=[ 113], 99.50th=[ 115], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 31, max= 415, per=25.09%, avg=145.04, stdev=85.45, samples=77 iops : min= 1, max= 25, avg= 8.38, stdev= 5.37, samples=77 write: IOPS=9, BW=158KiB/s (162kB/s)(6544KiB/41382msec); 0 zone resets clat (msec): min=27, max=237, avg=81.81, stdev=33.71 lat (msec): min=27, max=237, avg=81.82, stdev=33.71 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 42], 10.00th=[ 47], 20.00th=[ 55], | 30.00th=[ 62], 40.00th=[ 69], 50.00th=[ 78], 60.00th=[ 83], | 70.00th=[ 90], 80.00th=[ 105], 90.00th=[ 127], 95.00th=[ 146], | 99.00th=[ 197], 99.50th=[ 203], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 63, max= 288, per=25.74%, avg=156.47, stdev=60.05, samples=81 iops : min= 3, max= 18, avg= 9.10, stdev= 3.78, samples=81 lat (msec) : 10=9.90%, 20=22.27%, 50=18.10%, 100=37.50%, 250=12.24% cpu : usr=0.06%, sys=2.26%, ctx=1375, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144770: Mon Sep 7 17:33:23 2026 read: IOPS=9, BW=158KiB/s (162kB/s)(6256KiB/39520msec) clat (msec): min=5, max=159, avg=22.42, stdev=23.26 lat (msec): min=5, max=159, avg=22.42, stdev=23.26 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 45], 95.00th=[ 75], | 99.00th=[ 122], 99.50th=[ 157], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 31, max= 447, per=27.87%, avg=161.06, stdev=104.54, samples=77 iops : min= 1, max= 27, avg= 9.40, stdev= 6.62, samples=77 write: IOPS=9, BW=153KiB/s (156kB/s)(6032KiB/39520msec); 0 zone resets clat (msec): min=31, max=247, avg=81.46, stdev=38.53 lat (msec): min=31, max=247, avg=81.47, stdev=38.53 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 42], 10.00th=[ 46], 20.00th=[ 52], | 30.00th=[ 57], 40.00th=[ 64], 50.00th=[ 69], 60.00th=[ 78], | 70.00th=[ 90], 80.00th=[ 108], 90.00th=[ 133], 95.00th=[ 167], | 99.00th=[ 213], 99.50th=[ 234], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 286, per=25.05%, avg=152.32, stdev=63.38, samples=78 iops : min= 1, max= 17, avg= 8.86, stdev= 3.95, samples=78 lat (msec) : 10=9.90%, 20=26.69%, 50=19.01%, 100=31.25%, 250=13.15% cpu : usr=0.06%, sys=2.33%, ctx=1431, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144771: Mon Sep 7 17:33:23 2026 read: IOPS=9, BW=149KiB/s (153kB/s)(6032KiB/40390msec) clat (msec): min=5, max=136, avg=21.57, stdev=18.59 lat (msec): min=5, max=136, avg=21.57, stdev=18.59 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 30], 90.00th=[ 45], 95.00th=[ 61], | 99.00th=[ 101], 99.50th=[ 116], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 31, max= 413, per=26.78%, avg=154.79, stdev=84.68, samples=77 iops : min= 1, max= 25, avg= 9.01, stdev= 5.27, samples=77 write: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40390msec); 0 zone resets clat (msec): min=28, max=239, avg=82.40, stdev=36.16 lat (msec): min=28, max=239, avg=82.41, stdev=36.17 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 43], 10.00th=[ 47], 20.00th=[ 56], | 30.00th=[ 62], 40.00th=[ 67], 50.00th=[ 74], 60.00th=[ 81], | 70.00th=[ 89], 80.00th=[ 105], 90.00th=[ 132], 95.00th=[ 163], | 99.00th=[ 209], 99.50th=[ 232], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 63, max= 287, per=25.48%, avg=154.94, stdev=61.66, samples=80 iops : min= 3, max= 17, avg= 9.01, stdev= 3.89, samples=80 lat (msec) : 10=9.77%, 20=23.96%, 50=19.14%, 100=35.68%, 250=11.46% cpu : usr=0.06%, sys=2.36%, ctx=1432, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=579KiB/s (593kB/s), 139KiB/s-158KiB/s (142kB/s-162kB/s), io=23.4MiB (24.5MB), run=39520-41382msec WRITE: bw=609KiB/s (624kB/s), 153KiB/s-158KiB/s (156kB/s-162kB/s), io=24.6MiB (25.8MB), run=39520-41382msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144788: Mon Sep 7 17:33:34 2026 read: IOPS=2, BW=2076KiB/s (2126kB/s)(7168KiB/3453msec) clat (usec): min=532, max=1982.4k, avg=370939.98, stdev=718730.88 lat (usec): min=533, max=1982.4k, avg=370941.39, stdev=718730.79 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], | 20.00th=[ 627], 30.00th=[ 635], 40.00th=[ 635], | 50.00th=[ 145753], 60.00th=[ 196084], 70.00th=[ 196084], | 80.00th=[ 270533], 90.00th=[1988101], 95.00th=[1988101], | 99.00th=[1988101], 99.50th=[1988101], 99.90th=[1988101], | 99.95th=[1988101], 99.99th=[1988101] bw ( KiB/s): min= 1943, max= 6131, per=62.49%, avg=3374.00, stdev=2388.21, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1483KiB/s (1518kB/s)(5120KiB/3453msec); 0 zone resets clat (msec): min=67, max=195, avg=134.67, stdev=47.99 lat (msec): min=67, max=196, avg=134.75, stdev=47.93 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 129], 60.00th=[ 129], | 70.00th=[ 161], 80.00th=[ 161], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 2043, max= 2043, per=27.03%, avg=2043.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (usec) : 750=25.00% lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 2000=8.33% cpu : usr=0.03%, sys=22.97%, ctx=387, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144789: Mon Sep 7 17:33:34 2026 read: IOPS=0, BW=540KiB/s (553kB/s)(2048KiB/3793msec) clat (msec): min=96, max=215, avg=155.86, stdev=83.71 lat (msec): min=96, max=215, avg=155.87, stdev=83.71 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 215], 95.00th=[ 215], | 99.00th=[ 215], 99.50th=[ 215], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 1875, max= 2043, per=36.28%, avg=1959.00, stdev=118.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2700KiB/s (2765kB/s)(10.0MiB/3793msec); 0 zone resets clat (msec): min=84, max=1186, avg=343.36, stdev=332.89 lat (msec): min=84, max=1186, avg=343.49, stdev=332.90 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 123], | 30.00th=[ 157], 40.00th=[ 167], 50.00th=[ 197], 60.00th=[ 241], | 70.00th=[ 288], 80.00th=[ 397], 90.00th=[ 600], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1875, max= 6144, per=53.48%, avg=4042.25, stdev=2406.55, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.63, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=25.98%, ctx=440, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144790: Mon Sep 7 17:33:34 2026 read: IOPS=1, BW=1878KiB/s (1923kB/s)(6144KiB/3271msec) clat (usec): min=459, max=207087, avg=127305.46, stdev=98706.12 lat (usec): min=460, max=207088, avg=127306.65, stdev=98706.09 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 1254], | 30.00th=[ 1254], 40.00th=[168821], 50.00th=[168821], 60.00th=[191890], | 70.00th=[193987], 80.00th=[193987], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 2043, max= 4071, per=50.36%, avg=2719.00, stdev=1170.87, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1878KiB/s (1923kB/s)(6144KiB/3271msec); 0 zone resets clat (msec): min=97, max=883, avg=385.26, stdev=324.48 lat (msec): min=98, max=883, avg=385.35, stdev=324.44 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 249], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1946, max= 2048, per=26.78%, avg=2024.60, stdev=43.99, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=28.41%, ctx=454, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144791: Mon Sep 7 17:33:34 2026 read: IOPS=1, BW=1616KiB/s (1654kB/s)(5120KiB/3169msec) clat (usec): min=397, max=131497, avg=27594.61, stdev=58116.91 lat (usec): min=398, max=131497, avg=27595.27, stdev=58116.71 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 400], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 5014], 80.00th=[ 5014], 90.00th=[131597], 95.00th=[131597], | 99.00th=[131597], 99.50th=[131597], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 2043, max= 6107, per=75.48%, avg=4075.00, stdev=2873.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2262KiB/s (2316kB/s)(7168KiB/3169msec); 0 zone resets clat (msec): min=155, max=725, avg=408.03, stdev=243.08 lat (msec): min=155, max=725, avg=408.13, stdev=243.05 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 205], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 288], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 701], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1939, max= 4087, per=40.20%, avg=3039.00, stdev=1210.87, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 10=8.33%, 250=33.33%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=26.61%, ctx=146, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5399KiB/s (5529kB/s), 540KiB/s-2076KiB/s (553kB/s-2126kB/s), io=20.0MiB (20.0MB), run=3169-3793msec WRITE: bw=7559KiB/s (7741kB/s), 1483KiB/s-2700KiB/s (1518kB/s-2765kB/s), io=28.0MiB (29.4MB), run=3169-3793msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144784: Mon Sep 7 17:33:34 2026 read: IOPS=3, BW=3795KiB/s (3886kB/s)(7168KiB/1889msec) clat (msec): min=58, max=324, avg=153.45, stdev=112.32 lat (msec): min=58, max=324, avg=153.45, stdev=112.32 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 62], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 92], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 292], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 2043, max= 5545, per=78.40%, avg=3891.67, stdev=1759.15, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2710KiB/s (2775kB/s)(5120KiB/1889msec); 0 zone resets clat (msec): min=95, max=245, avg=149.26, stdev=61.42 lat (msec): min=95, max=245, avg=149.37, stdev=61.42 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 125], 60.00th=[ 125], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 4087, max= 4087, per=58.81%, avg=4087.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (msec) : 100=41.67%, 250=41.67%, 500=16.67% cpu : usr=0.00%, sys=12.87%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144785: Mon Sep 7 17:33:34 2026 read: IOPS=0, BW=510KiB/s (522kB/s)(2048KiB/4016msec) clat (msec): min=81, max=141, avg=111.70, stdev=42.16 lat (msec): min=81, max=141, avg=111.70, stdev=42.16 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 142], 95.00th=[ 142], | 99.00th=[ 142], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 1838, max= 1969, per=38.35%, avg=1903.50, stdev=92.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2550KiB/s (2611kB/s)(10.0MiB/4016msec); 0 zone resets clat (msec): min=79, max=1160, avg=369.52, stdev=312.29 lat (msec): min=79, max=1161, avg=369.96, stdev=312.24 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 90], | 30.00th=[ 207], 40.00th=[ 213], 50.00th=[ 279], 60.00th=[ 305], | 70.00th=[ 405], 80.00th=[ 468], 90.00th=[ 489], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1969, max= 4096, per=46.84%, avg=3255.60, stdev=1142.82, samples=5 iops : min= 1, max= 4, avg= 2.40, stdev= 1.34, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=10.36%, ctx=137, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144786: Mon Sep 7 17:33:34 2026 read: IOPS=1, BW=1550KiB/s (1587kB/s)(6144KiB/3964msec) clat (msec): min=67, max=646, avg=224.97, stdev=216.64 lat (msec): min=67, max=646, avg=224.97, stdev=216.64 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 182], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1969, max= 4087, per=54.42%, avg=2701.33, stdev=1200.67, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1550KiB/s (1587kB/s)(6144KiB/3964msec); 0 zone resets clat (msec): min=82, max=1361, avg=431.05, stdev=502.75 lat (msec): min=82, max=1361, avg=431.15, stdev=502.76 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 292], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 2048, max= 4087, per=47.15%, avg=3277.00, stdev=1082.15, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=5.55%, ctx=79, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144787: Mon Sep 7 17:33:34 2026 read: IOPS=1, BW=1241KiB/s (1271kB/s)(5120KiB/4125msec) clat (msec): min=45, max=542, avg=209.22, stdev=200.91 lat (msec): min=45, max=542, avg=209.22, stdev=200.91 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 3938, max= 4096, per=80.92%, avg=4017.00, stdev=111.72, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1738KiB/s (1779kB/s)(7168KiB/4125msec); 0 zone resets clat (msec): min=61, max=1470, avg=426.15, stdev=491.41 lat (msec): min=61, max=1470, avg=426.23, stdev=491.40 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 144], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 230], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 600], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1961, max= 4087, per=43.81%, avg=3044.50, stdev=1204.24, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=8.33%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=6.30%, ctx=84, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4965KiB/s (5084kB/s), 510KiB/s-3795KiB/s (522kB/s-3886kB/s), io=20.0MiB (20.0MB), run=1889-4125msec WRITE: bw=6951KiB/s (7118kB/s), 1550KiB/s-2710KiB/s (1587kB/s-2775kB/s), io=28.0MiB (29.4MB), run=1889-4125msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144797: Mon Sep 7 17:33:43 2026 read: IOPS=2, BW=9752KiB/s (9986kB/s)(12.0MiB/1260msec) clat (msec): min=163, max=752, avg=397.17, stdev=312.67 lat (msec): min=163, max=752, avg=397.18, stdev=312.67 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min=12506, max=12506, per=100.00%, avg=12506.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.26%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144799: Mon Sep 7 17:33:43 2026 read: IOPS=0, BW=2674KiB/s (2738kB/s)(4096KiB/1532msec) clat (nsec): min=133935k, max=133935k, avg=133935317.00, stdev= 0.00 lat (nsec): min=133938k, max=133938k, avg=133937986.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 134], 80.00th=[ 134], 90.00th=[ 134], 95.00th=[ 134], | 99.00th=[ 134], 99.50th=[ 134], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 6159, max= 6159, per=57.59%, avg=6159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5347KiB/s (5476kB/s)(8192KiB/1532msec); 0 zone resets clat (msec): min=654, max=709, avg=681.78, stdev=38.68 lat (msec): min=654, max=710, avg=682.54, stdev=39.14 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8175, max= 8175, per=62.10%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.07%, sys=18.03%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144800: Mon Sep 7 17:33:43 2026 write: IOPS=1, BW=4937KiB/s (5055kB/s)(12.0MiB/2489msec); 0 zone resets clat (msec): min=203, max=1100, avg=787.20, stdev=505.57 lat (msec): min=204, max=1103, avg=788.53, stdev=506.41 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8175, max= 8175, per=62.10%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.73%, ctx=115, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144801: Mon Sep 7 17:33:43 2026 write: IOPS=1, BW=6203KiB/s (6352kB/s)(12.0MiB/1981msec); 0 zone resets clat (msec): min=263, max=1149, avg=645.20, stdev=455.66 lat (msec): min=264, max=1150, avg=645.64, stdev=455.65 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 6747, max= 8175, per=56.67%, avg=7461.00, stdev=1009.75, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.94%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.4MiB/s (10.0MB/s), 2674KiB/s-9752KiB/s (2738kB/s-9986kB/s), io=16.0MiB (16.8MB), run=1260-1532msec WRITE: bw=12.9MiB/s (13.5MB/s), 4937KiB/s-6203KiB/s (5055kB/s-6352kB/s), io=32.0MiB (33.6MB), run=1532-2489msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144802: Mon Sep 7 17:33:43 2026 read: IOPS=1, BW=7336KiB/s (7512kB/s)(12.0MiB/1675msec) clat (msec): min=486, max=579, avg=530.00, stdev=46.56 lat (msec): min=486, max=579, avg=530.00, stdev=46.56 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=30.29%, ctx=464, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144803: Mon Sep 7 17:33:43 2026 read: IOPS=0, BW=1853KiB/s (1898kB/s)(4096KiB/2210msec) clat (nsec): min=452664k, max=452664k, avg=452664342.00, stdev= 0.00 lat (nsec): min=452667k, max=452667k, avg=452667155.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 5505, max= 5505, per=74.26%, avg=5505.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3707KiB/s (3796kB/s)(8192KiB/2210msec); 0 zone resets clat (msec): min=620, max=1036, avg=828.85, stdev=294.27 lat (msec): min=621, max=1037, avg=829.29, stdev=294.33 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8159, max= 8159, per=62.25%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.46%, ctx=120, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144804: Mon Sep 7 17:33:43 2026 write: IOPS=1, BW=4915KiB/s (5033kB/s)(12.0MiB/2500msec); 0 zone resets clat (msec): min=126, max=1534, avg=818.63, stdev=704.40 lat (msec): min=126, max=1534, avg=819.06, stdev=704.47 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8192, max= 8192, per=62.50%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.96%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144805: Mon Sep 7 17:33:43 2026 write: IOPS=1, BW=6225KiB/s (6374kB/s)(12.0MiB/1974msec); 0 zone resets clat (msec): min=186, max=989, avg=630.36, stdev=408.14 lat (msec): min=188, max=990, avg=631.73, stdev=407.32 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8159, max= 8159, per=62.25%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.15%, sys=8.87%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7414KiB/s (7592kB/s), 1853KiB/s-7336KiB/s (1898kB/s-7512kB/s), io=16.0MiB (16.8MB), run=1675-2210msec WRITE: bw=12.8MiB/s (13.4MB/s), 3707KiB/s-6225KiB/s (3796kB/s-6374kB/s), io=32.0MiB (33.6MB), run=1974-2500msec