== sanity test 398b: DIO and buffer IO race ============== 16:23:29 (1761251009) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.98167 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183536: Thu Oct 23 16:25:28 2025 read: IOPS=15, BW=61.0KiB/s (62.5kB/s)(5992KiB/98170msec) clat (usec): min=105, max=1144.4k, avg=37631.02, stdev=36836.78 lat (usec): min=105, max=1144.4k, avg=37633.02, stdev=36836.36 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 10159], 10.00th=[ 15270], | 20.00th=[ 19530], 30.00th=[ 23987], 40.00th=[ 28181], | 50.00th=[ 32637], 60.00th=[ 38011], 70.00th=[ 43779], | 80.00th=[ 50594], 90.00th=[ 64750], 95.00th=[ 74974], | 99.00th=[ 125305], 99.50th=[ 168821], 99.90th=[ 202376], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 112, per=25.10%, avg=60.98, stdev=20.61, samples=192 iops : min= 1, max= 28, avg=14.64, stdev= 5.21, samples=192 write: IOPS=16, BW=64.1KiB/s (65.7kB/s)(6296KiB/98170msec); 0 zone resets clat (usec): min=897, max=178874, avg=26311.81, stdev=26800.84 lat (usec): min=897, max=178876, avg=26315.65, stdev=26803.80 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1090], 10.00th=[ 1172], 20.00th=[ 1385], | 30.00th=[ 4752], 40.00th=[ 12780], 50.00th=[ 20055], 60.00th=[ 26346], | 70.00th=[ 34866], 80.00th=[ 46400], 90.00th=[ 62129], 95.00th=[ 79168], | 99.00th=[109577], 99.50th=[123208], 99.90th=[164627], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 15, max= 157, per=25.38%, avg=64.47, stdev=25.41, samples=191 iops : min= 3, max= 39, avg=15.51, stdev= 6.43, samples=191 lat (usec) : 250=1.46%, 500=0.29%, 750=0.10%, 1000=0.68% lat (msec) : 2=11.17%, 4=2.80%, 10=4.75%, 20=14.36%, 50=45.61% lat (msec) : 100=16.80%, 250=1.95%, 2000=0.03% cpu : usr=0.10%, sys=6.78%, ctx=6265, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183537: Thu Oct 23 16:25:28 2025 read: IOPS=15, BW=60.2KiB/s (61.6kB/s)(5940KiB/98734msec) clat (usec): min=92, max=1142.5k, avg=37286.97, stdev=36578.16 lat (usec): min=92, max=1142.5k, avg=37291.42, stdev=36584.07 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 9765], 10.00th=[ 14746], | 20.00th=[ 19268], 30.00th=[ 23462], 40.00th=[ 27919], | 50.00th=[ 32375], 60.00th=[ 38011], 70.00th=[ 43254], | 80.00th=[ 50594], 90.00th=[ 63177], 95.00th=[ 78119], | 99.00th=[ 128451], 99.50th=[ 141558], 99.90th=[ 198181], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 111, per=24.70%, avg=60.01, stdev=19.72, samples=193 iops : min= 1, max= 27, avg=14.39, stdev= 4.99, samples=193 write: IOPS=16, BW=64.3KiB/s (65.8kB/s)(6348KiB/98734msec); 0 zone resets clat (usec): min=860, max=261432, avg=27046.84, stdev=28107.67 lat (usec): min=861, max=261434, avg=27054.60, stdev=28103.82 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1106], 10.00th=[ 1188], 20.00th=[ 2343], | 30.00th=[ 6652], 40.00th=[ 13435], 50.00th=[ 20317], 60.00th=[ 26084], | 70.00th=[ 33817], 80.00th=[ 45351], 90.00th=[ 66323], 95.00th=[ 80217], | 99.00th=[122160], 99.50th=[145753], 99.90th=[189793], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 166, per=25.24%, avg=64.10, stdev=26.16, samples=193 iops : min= 1, max= 41, avg=15.41, stdev= 6.59, samples=193 lat (usec) : 100=0.03%, 250=1.53%, 500=0.20%, 1000=0.59% lat (msec) : 2=9.21%, 4=2.80%, 10=6.74%, 20=14.71%, 50=45.64% lat (msec) : 100=16.41%, 250=2.08%, 500=0.03%, 2000=0.03% cpu : usr=0.10%, sys=6.69%, ctx=6289, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183538: Thu Oct 23 16:25:28 2025 read: IOPS=15, BW=61.5KiB/s (62.0kB/s)(6028KiB/97994msec) clat (usec): min=108, max=208236, avg=36092.10, stdev=22606.99 lat (usec): min=108, max=208237, avg=36099.92, stdev=22602.95 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 8979], 10.00th=[ 14484], 20.00th=[ 19530], | 30.00th=[ 23462], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 50070], 90.00th=[ 62129], 95.00th=[ 77071], | 99.00th=[103285], 99.50th=[143655], 99.90th=[191890], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 7, max= 125, per=25.29%, avg=61.45, stdev=20.13, samples=191 iops : min= 1, max= 31, avg=14.76, stdev= 5.10, samples=191 write: IOPS=15, BW=63.9KiB/s (65.4kB/s)(6260KiB/97994msec); 0 zone resets clat (usec): min=819, max=1123.2k, avg=27591.55, stdev=39373.86 lat (usec): min=820, max=1123.2k, avg=27595.70, stdev=39372.53 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1090], 10.00th=[ 1172], | 20.00th=[ 1696], 30.00th=[ 5538], 40.00th=[ 11863], | 50.00th=[ 19006], 60.00th=[ 26346], 70.00th=[ 35390], | 80.00th=[ 48497], 90.00th=[ 65274], 95.00th=[ 81265], | 99.00th=[ 121111], 99.50th=[ 152044], 99.90th=[ 183501], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 14, max= 136, per=25.09%, avg=63.73, stdev=25.31, samples=191 iops : min= 3, max= 34, avg=15.34, stdev= 6.40, samples=191 lat (usec) : 250=1.69%, 500=0.26%, 1000=0.49% lat (msec) : 2=10.45%, 4=2.67%, 10=6.12%, 20=15.23%, 50=43.52% lat (msec) : 100=17.87%, 250=1.66%, 2000=0.03% cpu : usr=0.12%, sys=6.67%, ctx=6255, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183539: Thu Oct 23 16:25:28 2025 read: IOPS=15, BW=62.9KiB/s (64.4kB/s)(6052KiB/96162msec) clat (usec): min=106, max=1131.5k, avg=36753.22, stdev=37174.58 lat (usec): min=107, max=1131.5k, avg=36756.39, stdev=37174.87 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 9765], 10.00th=[ 14877], | 20.00th=[ 19268], 30.00th=[ 22938], 40.00th=[ 26608], | 50.00th=[ 30278], 60.00th=[ 35390], 70.00th=[ 41681], | 80.00th=[ 49546], 90.00th=[ 64226], 95.00th=[ 79168], | 99.00th=[ 126354], 99.50th=[ 156238], 99.90th=[ 287310], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 118, per=25.90%, avg=62.93, stdev=20.24, samples=188 iops : min= 1, max= 29, avg=15.13, stdev= 5.13, samples=188 write: IOPS=16, BW=64.8KiB/s (66.4kB/s)(6236KiB/96162msec); 0 zone resets clat (usec): min=868, max=187571, avg=25741.93, stdev=26852.17 lat (usec): min=868, max=187573, avg=25748.62, stdev=26849.50 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1106], 10.00th=[ 1172], 20.00th=[ 1795], | 30.00th=[ 5473], 40.00th=[ 11600], 50.00th=[ 19268], 60.00th=[ 25822], | 70.00th=[ 32637], 80.00th=[ 44303], 90.00th=[ 61604], 95.00th=[ 80217], | 99.00th=[112722], 99.50th=[131597], 99.90th=[185598], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7, max= 134, per=25.54%, avg=64.86, stdev=27.60, samples=188 iops : min= 1, max= 33, avg=15.61, stdev= 7.00, samples=188 lat (usec) : 250=1.69%, 500=0.16%, 1000=0.59% lat (msec) : 2=10.38%, 4=2.83%, 10=5.79%, 20=15.33%, 50=45.31% lat (msec) : 100=15.63%, 250=2.21%, 500=0.03%, 2000=0.03% cpu : usr=0.09%, sys=6.63%, ctx=6203, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=243KiB/s (249kB/s), 60.2KiB/s-62.9KiB/s (61.6kB/s-64.4kB/s), io=23.4MiB (24.6MB), run=96162-98734msec WRITE: bw=255KiB/s (261kB/s), 63.9KiB/s-64.8KiB/s (65.4kB/s-66.4kB/s), io=24.6MiB (25.7MB), run=96162-98734msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183542: Thu Oct 23 16:26:04 2025 read: IOPS=11, BW=44.7KiB/s (45.8kB/s)(5992KiB/134087msec) clat (msec): min=4, max=1190, avg=34.83, stdev=43.57 lat (msec): min=4, max=1190, avg=34.83, stdev=43.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 49], 90.00th=[ 78], 95.00th=[ 99], | 99.00th=[ 157], 99.50th=[ 190], 99.90th=[ 300], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 139, per=25.29%, avg=45.02, stdev=28.51, samples=259 iops : min= 1, max= 34, avg=10.59, stdev= 7.17, samples=259 write: IOPS=11, BW=46.0KiB/s (48.1kB/s)(6296KiB/134087msec); 0 zone resets clat (msec): min=9, max=230, avg=51.95, stdev=32.93 lat (msec): min=9, max=230, avg=51.96, stdev=32.93 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 75], 90.00th=[ 100], 95.00th=[ 122], | 99.00th=[ 163], 99.50th=[ 186], 99.90th=[ 226], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7, max= 124, per=25.07%, avg=46.89, stdev=26.46, samples=261 iops : min= 1, max= 31, avg=11.08, stdev= 6.67, samples=261 lat (msec) : 10=3.65%, 20=20.51%, 50=46.78%, 100=22.04%, 250=6.87% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.07%, sys=2.16%, ctx=4828, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183543: Thu Oct 23 16:26:04 2025 read: IOPS=11, BW=44.3KiB/s (45.3kB/s)(5940KiB/134186msec) clat (msec): min=4, max=1169, avg=33.53, stdev=40.91 lat (msec): min=4, max=1169, avg=33.54, stdev=40.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 94], | 99.00th=[ 142], 99.50th=[ 161], 99.90th=[ 257], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 143, per=24.95%, avg=44.42, stdev=28.65, samples=260 iops : min= 1, max= 35, avg=10.45, stdev= 7.21, samples=260 write: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6348KiB/134186msec); 0 zone resets clat (msec): min=8, max=244, avg=53.09, stdev=35.40 lat (msec): min=8, max=244, avg=53.09, stdev=35.40 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 49], | 70.00th=[ 63], 80.00th=[ 81], 90.00th=[ 104], 95.00th=[ 123], | 99.00th=[ 171], 99.50th=[ 209], 99.90th=[ 239], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 7, max= 133, per=25.15%, avg=47.03, stdev=27.24, samples=262 iops : min= 1, max= 33, avg=11.10, stdev= 6.86, samples=262 lat (msec) : 10=3.09%, 20=21.22%, 50=46.84%, 100=20.83%, 250=7.94% lat (msec) : 500=0.03%, 2000=0.03% cpu : usr=0.06%, sys=2.16%, ctx=4832, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183544: Thu Oct 23 16:26:04 2025 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6028KiB/133032msec) clat (msec): min=4, max=300, avg=33.50, stdev=30.34 lat (msec): min=4, max=300, avg=33.50, stdev=30.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 72], 95.00th=[ 97], | 99.00th=[ 148], 99.50th=[ 169], 99.90th=[ 275], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 140, per=25.52%, avg=45.43, stdev=27.38, samples=258 iops : min= 1, max= 35, avg=10.70, stdev= 6.89, samples=258 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6260KiB/133032msec); 0 zone resets clat (msec): min=9, max=1219, avg=52.68, stdev=44.09 lat (msec): min=9, max=1219, avg=52.69, stdev=44.09 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 62], 80.00th=[ 77], 90.00th=[ 95], 95.00th=[ 115], | 99.00th=[ 176], 99.50th=[ 192], 99.90th=[ 275], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 128, per=25.15%, avg=47.02, stdev=26.09, samples=259 iops : min= 1, max= 32, avg=11.10, stdev= 6.58, samples=259 lat (msec) : 10=3.19%, 20=20.28%, 50=47.88%, 100=22.10%, 250=6.38% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.06%, sys=2.17%, ctx=4762, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183545: Thu Oct 23 16:26:04 2025 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6052KiB/133093msec) clat (msec): min=5, max=293, avg=33.53, stdev=29.85 lat (msec): min=5, max=293, avg=33.53, stdev=29.85 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 93], | 99.00th=[ 144], 99.50th=[ 165], 99.90th=[ 288], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 142, per=25.64%, avg=45.64, stdev=28.24, samples=258 iops : min= 1, max= 35, avg=10.76, stdev= 7.11, samples=258 write: IOPS=11, BW=46.9KiB/s (47.0kB/s)(6236KiB/133093msec); 0 zone resets clat (msec): min=11, max=1209, avg=52.76, stdev=44.91 lat (msec): min=11, max=1209, avg=52.76, stdev=44.91 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 59], 80.00th=[ 73], 90.00th=[ 97], 95.00th=[ 116], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 275], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7, max= 127, per=24.90%, avg=46.57, stdev=25.83, samples=260 iops : min= 1, max= 31, avg=10.99, stdev= 6.53, samples=260 lat (msec) : 10=3.29%, 20=20.67%, 50=47.40%, 100=22.20%, 250=6.28% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.07%, sys=2.12%, ctx=4778, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=179KiB/s (183kB/s), 44.3KiB/s-45.5KiB/s (45.3kB/s-46.6kB/s), io=23.4MiB (24.6MB), run=133032-134186msec WRITE: bw=187KiB/s (192kB/s), 46.9KiB/s-47.3KiB/s (47.0kB/s-48.4kB/s), io=24.6MiB (25.7MB), run=133032-134186msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183583: Thu Oct 23 16:26:38 2025 read: IOPS=15, BW=247KiB/s (253kB/s)(5920KiB/23923msec) clat (usec): min=111, max=154734, avg=33510.18, stdev=21769.71 lat (usec): min=112, max=154735, avg=33511.32, stdev=21769.69 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 167], 10.00th=[ 249], 20.00th=[ 17433], | 30.00th=[ 21627], 40.00th=[ 25822], 50.00th=[ 30540], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 50070], 90.00th=[ 61604], 95.00th=[ 71828], | 99.00th=[100140], 99.50th=[132645], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 128, max= 506, per=24.98%, avg=247.34, stdev=76.07, samples=47 iops : min= 8, max= 31, avg=14.77, stdev= 4.74, samples=47 write: IOPS=16, BW=266KiB/s (273kB/s)(6368KiB/23923msec); 0 zone resets clat (usec): min=1380, max=205953, avg=28606.37, stdev=25530.30 lat (usec): min=1381, max=205954, avg=28609.05, stdev=25529.51 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1680], 10.00th=[ 1827], 20.00th=[ 5604], | 30.00th=[ 10683], 40.00th=[ 16909], 50.00th=[ 23200], 60.00th=[ 28967], | 70.00th=[ 38011], 80.00th=[ 47973], 90.00th=[ 62129], 95.00th=[ 71828], | 99.00th=[101188], 99.50th=[158335], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 94, max= 448, per=25.64%, avg=267.17, stdev=88.86, samples=47 iops : min= 5, max= 28, avg=16.00, stdev= 5.65, samples=47 lat (usec) : 250=4.82%, 500=0.13% lat (msec) : 2=6.77%, 4=2.47%, 10=5.99%, 20=14.58%, 50=46.48% lat (msec) : 100=17.71%, 250=1.04% cpu : usr=0.13%, sys=8.06%, ctx=1680, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183585: Thu Oct 23 16:26:38 2025 read: IOPS=14, BW=238KiB/s (244kB/s)(5744KiB/24095msec) clat (usec): min=116, max=152207, avg=35142.20, stdev=22716.43 lat (usec): min=116, max=152209, avg=35143.28, stdev=22716.43 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 165], 10.00th=[ 13304], 20.00th=[ 19268], | 30.00th=[ 23200], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 36963], | 70.00th=[ 42730], 80.00th=[ 49021], 90.00th=[ 61604], 95.00th=[ 71828], | 99.00th=[110625], 99.50th=[149947], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 32, max= 444, per=23.91%, avg=236.72, stdev=84.72, samples=47 iops : min= 2, max= 27, avg=14.11, stdev= 5.32, samples=47 write: IOPS=16, BW=272KiB/s (278kB/s)(6544KiB/24095msec); 0 zone resets clat (usec): min=1418, max=201603, avg=27924.40, stdev=27378.54 lat (usec): min=1421, max=201604, avg=27928.81, stdev=27376.32 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1647], 10.00th=[ 1876], 20.00th=[ 5014], | 30.00th=[ 8848], 40.00th=[ 14353], 50.00th=[ 19792], 60.00th=[ 25822], | 70.00th=[ 35390], 80.00th=[ 48497], 90.00th=[ 65274], 95.00th=[ 84411], | 99.00th=[114820], 99.50th=[116917], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 62, max= 507, per=25.66%, avg=267.36, stdev=90.57, samples=47 iops : min= 3, max= 31, avg=16.02, stdev= 5.70, samples=47 lat (usec) : 250=3.39%, 500=0.65% lat (msec) : 2=5.60%, 4=3.26%, 10=8.33%, 20=15.49%, 50=44.92% lat (msec) : 100=16.28%, 250=2.08% cpu : usr=0.07%, sys=8.33%, ctx=1705, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183586: Thu Oct 23 16:26:38 2025 read: IOPS=16, BW=259KiB/s (265kB/s)(6256KiB/24184msec) clat (usec): min=117, max=107942, avg=33521.26, stdev=20353.43 lat (usec): min=118, max=107943, avg=33522.55, stdev=20353.30 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 190], 10.00th=[ 8979], 20.00th=[ 17695], | 30.00th=[ 22414], 40.00th=[ 26346], 50.00th=[ 31851], 60.00th=[ 36439], | 70.00th=[ 41681], 80.00th=[ 48497], 90.00th=[ 60556], 95.00th=[ 74974], | 99.00th=[ 90702], 99.50th=[ 96994], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 94, max= 478, per=26.17%, avg=259.04, stdev=88.83, samples=47 iops : min= 5, max= 29, avg=15.49, stdev= 5.52, samples=47 write: IOPS=15, BW=249KiB/s (255kB/s)(6032KiB/24184msec); 0 zone resets clat (usec): min=1314, max=150356, avg=28781.34, stdev=25391.64 lat (usec): min=1315, max=150358, avg=28783.28, stdev=25391.66 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1614], 10.00th=[ 1745], 20.00th=[ 5800], | 30.00th=[ 9765], 40.00th=[ 17433], 50.00th=[ 22414], 60.00th=[ 28705], | 70.00th=[ 38011], 80.00th=[ 49021], 90.00th=[ 63701], 95.00th=[ 80217], | 99.00th=[100140], 99.50th=[123208], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 93, max= 444, per=23.62%, avg=246.11, stdev=77.42, samples=47 iops : min= 5, max= 27, avg=14.68, stdev= 4.85, samples=47 lat (usec) : 250=3.65%, 500=0.39% lat (msec) : 2=6.51%, 4=2.08%, 10=7.55%, 20=14.97%, 50=45.96% lat (msec) : 100=18.23%, 250=0.65% cpu : usr=0.10%, sys=7.79%, ctx=1739, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183587: Thu Oct 23 16:26:38 2025 read: IOPS=16, BW=259KiB/s (265kB/s)(6032KiB/23325msec) clat (usec): min=116, max=161954, avg=31491.75, stdev=21061.09 lat (usec): min=117, max=161956, avg=31502.37, stdev=21062.55 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 155], 10.00th=[ 188], 20.00th=[ 17433], | 30.00th=[ 21365], 40.00th=[ 25297], 50.00th=[ 28967], 60.00th=[ 34866], | 70.00th=[ 40633], 80.00th=[ 46400], 90.00th=[ 53740], 95.00th=[ 67634], | 99.00th=[103285], 99.50th=[121111], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 96, max= 539, per=25.98%, avg=257.17, stdev=97.98, samples=46 iops : min= 6, max= 33, avg=15.39, stdev= 6.09, samples=46 write: IOPS=16, BW=268KiB/s (275kB/s)(6256KiB/23325msec); 0 zone resets clat (usec): min=1429, max=157725, avg=28652.07, stdev=27682.28 lat (usec): min=1432, max=157727, avg=28654.62, stdev=27682.25 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1680], 10.00th=[ 1827], 20.00th=[ 4686], | 30.00th=[ 8455], 40.00th=[ 16057], 50.00th=[ 20841], 60.00th=[ 27657], | 70.00th=[ 35390], 80.00th=[ 45876], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[130548], 99.50th=[145753], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 62, max= 604, per=25.77%, avg=268.57, stdev=94.88, samples=46 iops : min= 3, max= 37, avg=16.11, stdev= 6.00, samples=46 lat (usec) : 250=5.47%, 500=0.91%, 750=0.13% lat (msec) : 2=6.12%, 4=3.12%, 10=7.55%, 20=14.58%, 50=46.61% lat (msec) : 100=13.80%, 250=1.69% cpu : usr=0.11%, sys=7.85%, ctx=1667, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=990KiB/s (1014kB/s), 238KiB/s-259KiB/s (244kB/s-265kB/s), io=23.4MiB (24.5MB), run=23325-24184msec WRITE: bw=1042KiB/s (1067kB/s), 249KiB/s-272KiB/s (255kB/s-278kB/s), io=24.6MiB (25.8MB), run=23325-24184msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183588: Thu Oct 23 16:26:49 2025 read: IOPS=10, BW=173KiB/s (177kB/s)(5920KiB/34213msec) clat (msec): min=6, max=154, avg=35.73, stdev=26.88 lat (msec): min=6, max=154, avg=35.74, stdev=26.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 102], | 99.00th=[ 122], 99.50th=[ 138], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 31, max= 476, per=25.40%, avg=171.67, stdev=81.26, samples=67 iops : min= 1, max= 29, avg= 9.96, stdev= 5.08, samples=67 write: IOPS=11, BW=186KiB/s (191kB/s)(6368KiB/34213msec); 0 zone resets clat (msec): min=10, max=192, avg=52.50, stdev=29.58 lat (msec): min=10, max=192, avg=52.50, stdev=29.58 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 52], | 70.00th=[ 60], 80.00th=[ 72], 90.00th=[ 93], 95.00th=[ 117], | 99.00th=[ 155], 99.50th=[ 167], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 31, max= 414, per=26.08%, avg=185.72, stdev=81.78, samples=67 iops : min= 1, max= 25, avg=10.87, stdev= 5.11, samples=67 lat (msec) : 10=2.73%, 20=14.97%, 50=51.04%, 100=24.48%, 250=6.77% cpu : usr=0.07%, sys=2.61%, ctx=1285, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183589: Thu Oct 23 16:26:49 2025 read: IOPS=10, BW=162KiB/s (166kB/s)(5744KiB/35384msec) clat (msec): min=5, max=183, avg=38.94, stdev=32.46 lat (msec): min=5, max=183, avg=38.94, stdev=32.46 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 58], 90.00th=[ 89], 95.00th=[ 113], | 99.00th=[ 150], 99.50th=[ 174], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 28, max= 415, per=24.00%, avg=162.24, stdev=89.67, samples=68 iops : min= 1, max= 25, avg= 9.38, stdev= 5.67, samples=68 write: IOPS=11, BW=185KiB/s (189kB/s)(6544KiB/35384msec); 0 zone resets clat (msec): min=10, max=257, avg=51.59, stdev=30.03 lat (msec): min=10, max=257, avg=51.60, stdev=30.03 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 71], 90.00th=[ 95], 95.00th=[ 110], | 99.00th=[ 148], 99.50th=[ 161], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 383, per=25.41%, avg=180.93, stdev=82.33, samples=69 iops : min= 1, max= 23, avg=10.57, stdev= 5.17, samples=69 lat (msec) : 10=1.95%, 20=15.63%, 50=50.26%, 100=24.87%, 250=7.16% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.35%, ctx=1286, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183590: Thu Oct 23 16:26:49 2025 read: IOPS=11, BW=179KiB/s (183kB/s)(6256KiB/35008msec) clat (msec): min=5, max=177, avg=37.08, stdev=28.68 lat (msec): min=5, max=177, avg=37.08, stdev=28.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 73], 95.00th=[ 102], | 99.00th=[ 148], 99.50th=[ 171], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 31, max= 507, per=26.44%, avg=178.72, stdev=108.62, samples=69 iops : min= 1, max= 31, avg=10.42, stdev= 6.82, samples=69 write: IOPS=10, BW=172KiB/s (176kB/s)(6032KiB/35008msec); 0 zone resets clat (msec): min=12, max=255, avg=53.72, stdev=32.19 lat (msec): min=12, max=255, avg=53.73, stdev=32.19 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 61], 80.00th=[ 73], 90.00th=[ 106], 95.00th=[ 118], | 99.00th=[ 159], 99.50th=[ 169], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 350, per=24.13%, avg=171.80, stdev=77.44, samples=69 iops : min= 1, max= 21, avg= 9.99, stdev= 4.87, samples=69 lat (msec) : 10=1.95%, 20=14.45%, 50=53.39%, 100=21.88%, 250=8.20% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.41%, ctx=1285, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183591: Thu Oct 23 16:26:49 2025 read: IOPS=11, BW=177KiB/s (181kB/s)(6032KiB/34104msec) clat (msec): min=6, max=198, avg=35.88, stdev=29.73 lat (msec): min=6, max=198, avg=35.88, stdev=29.73 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 75], 95.00th=[ 103], | 99.00th=[ 150], 99.50th=[ 171], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 412, per=26.73%, avg=180.72, stdev=84.04, samples=65 iops : min= 1, max= 25, avg=10.55, stdev= 5.28, samples=65 write: IOPS=11, BW=183KiB/s (188kB/s)(6256KiB/34104msec); 0 zone resets clat (msec): min=12, max=180, avg=51.89, stdev=29.24 lat (msec): min=12, max=180, avg=51.90, stdev=29.24 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 43], 60.00th=[ 49], | 70.00th=[ 60], 80.00th=[ 74], 90.00th=[ 88], 95.00th=[ 111], | 99.00th=[ 159], 99.50th=[ 176], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 62, max= 383, per=25.84%, avg=183.97, stdev=84.11, samples=67 iops : min= 3, max= 23, avg=10.75, stdev= 5.26, samples=67 lat (msec) : 10=2.21%, 20=16.41%, 50=52.47%, 100=22.27%, 250=6.64% cpu : usr=0.06%, sys=2.46%, ctx=1205, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=677KiB/s (693kB/s), 162KiB/s-179KiB/s (166kB/s-183kB/s), io=23.4MiB (24.5MB), run=34104-35384msec WRITE: bw=712KiB/s (729kB/s), 172KiB/s-186KiB/s (176kB/s-191kB/s), io=24.6MiB (25.8MB), run=34104-35384msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183603: Thu Oct 23 16:27:02 2025 read: IOPS=2, BW=2482KiB/s (2542kB/s)(7168KiB/2888msec) clat (usec): min=637, max=348656, avg=189218.66, stdev=114611.18 lat (usec): min=639, max=348658, avg=189220.19, stdev=114611.08 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[109577], | 30.00th=[173016], 40.00th=[173016], 50.00th=[177210], 60.00th=[225444], | 70.00th=[225444], 80.00th=[287310], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 1768, max= 4079, per=65.44%, avg=2964.50, stdev=1253.70, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1773KiB/s (1815kB/s)(5120KiB/2888msec); 0 zone resets clat (msec): min=195, max=457, avg=301.31, stdev=104.49 lat (msec): min=195, max=458, avg=301.39, stdev=104.49 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1768, max= 3992, per=51.12%, avg=3242.67, stdev=1277.16, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=41.67% cpu : usr=0.07%, sys=23.17%, ctx=180, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183604: Thu Oct 23 16:27:02 2025 read: IOPS=0, BW=453KiB/s (464kB/s)(2048KiB/4520msec) clat (usec): min=748, max=146107, avg=73428.11, stdev=102784.66 lat (usec): min=749, max=146110, avg=73430.26, stdev=102785.88 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[ 750], | 30.00th=[ 750], 40.00th=[ 750], 50.00th=[ 750], 60.00th=[145753], | 70.00th=[145753], 80.00th=[145753], 90.00th=[145753], 95.00th=[145753], | 99.00th=[145753], 99.50th=[145753], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 1361, max= 2027, per=37.40%, avg=1694.00, stdev=470.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2265KiB/s (2320kB/s)(10.0MiB/4520msec); 0 zone resets clat (msec): min=107, max=755, avg=420.82, stdev=213.77 lat (msec): min=107, max=755, avg=420.92, stdev=213.76 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 138], | 30.00th=[ 207], 40.00th=[ 388], 50.00th=[ 430], 60.00th=[ 477], | 70.00th=[ 510], 80.00th=[ 592], 90.00th=[ 609], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1802, max= 4096, per=35.90%, avg=2277.00, stdev=806.57, samples=7 iops : min= 1, max= 4, avg= 1.57, stdev= 1.13, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=17.37%, ctx=140, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183605: Thu Oct 23 16:27:02 2025 read: IOPS=1, BW=1808KiB/s (1851kB/s)(6144KiB/3399msec) clat (usec): min=1027, max=362009, avg=198372.23, stdev=137935.31 lat (usec): min=1029, max=362009, avg=198373.41, stdev=137935.06 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1029], 10.00th=[ 1029], 20.00th=[ 89654], | 30.00th=[ 89654], 40.00th=[185598], 50.00th=[185598], 60.00th=[225444], | 70.00th=[329253], 80.00th=[329253], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 1802, max= 2039, per=43.25%, avg=1959.00, stdev=95.60, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1808KiB/s (1851kB/s)(6144KiB/3399msec); 0 zone resets clat (msec): min=219, max=496, avg=340.00, stdev=109.72 lat (msec): min=219, max=496, avg=340.06, stdev=109.71 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 359], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1802, max= 2778, per=33.21%, avg=2106.80, stdev=384.61, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=50.00% cpu : usr=0.00%, sys=20.48%, ctx=141, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183606: Thu Oct 23 16:27:02 2025 read: IOPS=1, BW=1505KiB/s (1542kB/s)(5120KiB/3401msec) clat (usec): min=557, max=291954, avg=106200.42, stdev=143772.93 lat (usec): min=559, max=291955, avg=106201.52, stdev=143772.89 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 660], 40.00th=[ 660], 50.00th=[ 5866], 60.00th=[ 5866], | 70.00th=[231736], 80.00th=[231736], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 1984, max= 5829, per=86.24%, avg=3906.50, stdev=2718.83, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2108KiB/s (2158kB/s)(7168KiB/3401msec); 0 zone resets clat (msec): min=236, max=527, avg=388.37, stdev=105.78 lat (msec): min=236, max=528, avg=388.47, stdev=105.79 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 313], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 384], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 510], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1393, max= 2039, per=29.40%, avg=1864.67, stdev=246.38, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 250=16.67%, 500=41.67%, 750=16.67% cpu : usr=0.06%, sys=16.53%, ctx=99, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4531KiB/s (4640kB/s), 453KiB/s-2482KiB/s (464kB/s-2542kB/s), io=20.0MiB (20.0MB), run=2888-4520msec WRITE: bw=6343KiB/s (6496kB/s), 1773KiB/s-2265KiB/s (1815kB/s-2320kB/s), io=28.0MiB (29.4MB), run=2888-4520msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183607: Thu Oct 23 16:27:02 2025 read: IOPS=1, BW=1731KiB/s (1773kB/s)(7168KiB/4141msec) clat (msec): min=118, max=228, avg=158.58, stdev=35.70 lat (msec): min=118, max=228, avg=158.58, stdev=35.70 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 138], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 150], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 174], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 2011, max= 4023, per=68.50%, avg=2990.50, stdev=1118.48, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1236KiB/s (1266kB/s)(5120KiB/4141msec); 0 zone resets clat (msec): min=114, max=953, avg=564.19, stdev=324.45 lat (msec): min=114, max=953, avg=564.33, stdev=324.49 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1946, max= 4071, per=40.96%, avg=2504.00, stdev=1044.99, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=66.67%, 500=8.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=5.85%, ctx=124, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183608: Thu Oct 23 16:27:02 2025 read: IOPS=0, BW=466KiB/s (477kB/s)(2048KiB/4392msec) clat (msec): min=83, max=389, avg=236.57, stdev=216.08 lat (msec): min=83, max=389, avg=236.58, stdev=216.08 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 1367, max= 2035, per=38.96%, avg=1701.00, stdev=472.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2332KiB/s (2387kB/s)(10.0MiB/4392msec); 0 zone resets clat (msec): min=106, max=613, avg=386.18, stdev=180.89 lat (msec): min=106, max=613, avg=386.27, stdev=180.89 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 213], | 30.00th=[ 241], 40.00th=[ 271], 50.00th=[ 296], 60.00th=[ 464], | 70.00th=[ 523], 80.00th=[ 542], 90.00th=[ 592], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1906, max= 4007, per=41.81%, avg=2556.00, stdev=981.57, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=5.92%, ctx=97, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183609: Thu Oct 23 16:27:02 2025 read: IOPS=1, BW=1384KiB/s (1417kB/s)(6144KiB/4439msec) clat (msec): min=101, max=830, avg=319.62, stdev=316.65 lat (msec): min=101, max=830, avg=319.62, stdev=316.65 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 132], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1932, max= 4071, per=57.43%, avg=2507.25, stdev=1043.21, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1384KiB/s (1417kB/s)(6144KiB/4439msec); 0 zone resets clat (msec): min=180, max=850, avg=387.61, stdev=251.15 lat (msec): min=180, max=850, avg=387.72, stdev=251.14 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 317], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1932, max= 3893, per=40.35%, avg=2466.75, stdev=951.83, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=6.02%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183610: Thu Oct 23 16:27:02 2025 read: IOPS=1, BW=1092KiB/s (1118kB/s)(5120KiB/4690msec) clat (msec): min=87, max=959, avg=399.32, stdev=337.98 lat (msec): min=87, max=959, avg=399.32, stdev=337.98 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1988, max= 4007, per=61.15%, avg=2670.00, stdev=1157.95, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1528KiB/s (1565kB/s)(7168KiB/4690msec); 0 zone resets clat (msec): min=98, max=955, avg=362.62, stdev=288.18 lat (msec): min=98, max=955, avg=362.74, stdev=288.16 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 113], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 368], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 384], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1957, max= 3813, per=39.95%, avg=2442.25, stdev=914.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=8.79%, ctx=128, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4367KiB/s (4472kB/s), 466KiB/s-1731KiB/s (477kB/s-1773kB/s), io=20.0MiB (20.0MB), run=4141-4690msec WRITE: bw=6113KiB/s (6260kB/s), 1236KiB/s-2332KiB/s (1266kB/s-2387kB/s), io=28.0MiB (29.4MB), run=4141-4690msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183618: Thu Oct 23 16:27:17 2025 read: IOPS=0, BW=3886KiB/s (3979kB/s)(12.0MiB/3162msec) clat (msec): min=964, max=1065, avg=1022.14, stdev=51.80 lat (msec): min=964, max=1065, avg=1022.14, stdev=51.80 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.14%, ctx=212, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183620: Thu Oct 23 16:27:17 2025 read: IOPS=0, BW=1269KiB/s (1300kB/s)(4096KiB/3227msec) clat (nsec): min=726566k, max=726566k, avg=726566493.00, stdev= 0.00 lat (nsec): min=726570k, max=726570k, avg=726570260.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2539KiB/s (2600kB/s)(8192KiB/3227msec); 0 zone resets clat (msec): min=936, max=1125, avg=1031.14, stdev=133.46 lat (msec): min=937, max=1125, avg=1031.50, stdev=133.37 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8159, max= 8159, per=89.49%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.59%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183623: Thu Oct 23 16:27:17 2025 write: IOPS=0, BW=3419KiB/s (3501kB/s)(12.0MiB/3594msec); 0 zone resets clat (msec): min=460, max=1738, avg=1072.33, stdev=640.57 lat (msec): min=461, max=1739, avg=1072.76, stdev=640.61 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 7922, max= 8159, per=88.19%, avg=8040.50, stdev=167.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.64%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183624: Thu Oct 23 16:27:17 2025 write: IOPS=0, BW=3502KiB/s (3586kB/s)(12.0MiB/3509msec); 0 zone resets clat (msec): min=738, max=1245, avg=1072.77, stdev=289.65 lat (msec): min=738, max=1246, avg=1073.25, stdev=289.89 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7892, max= 8159, per=88.03%, avg=8025.50, stdev=188.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=2.91%, ctx=36, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5077KiB/s (5199kB/s), 1269KiB/s-3886KiB/s (1300kB/s-3979kB/s), io=16.0MiB (16.8MB), run=3162-3227msec WRITE: bw=9117KiB/s (9336kB/s), 2539KiB/s-3502KiB/s (2600kB/s-3586kB/s), io=32.0MiB (33.6MB), run=3227-3594msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183617: Thu Oct 23 16:27:17 2025 read: IOPS=1, BW=5902KiB/s (6044kB/s)(12.0MiB/2082msec) clat (msec): min=189, max=1582, avg=660.53, stdev=798.81 lat (msec): min=189, max=1582, avg=660.54, stdev=798.81 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min=12900, max=12900, per=100.00%, avg=12900.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.86%, ctx=33, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183619: Thu Oct 23 16:27:17 2025 read: IOPS=0, BW=1093KiB/s (1119kB/s)(4096KiB/3747msec) clat (nsec): min=900482k, max=900482k, avg=900481772.00, stdev= 0.00 lat (nsec): min=900484k, max=900484k, avg=900484307.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2186KiB/s (2239kB/s)(8192KiB/3747msec); 0 zone resets clat (msec): min=353, max=2050, avg=1201.95, stdev=1199.50 lat (msec): min=354, max=2050, avg=1202.40, stdev=1199.36 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 2056], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 7937, max= 7937, per=91.44%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.30%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183621: Thu Oct 23 16:27:17 2025 write: IOPS=0, BW=3255KiB/s (3333kB/s)(12.0MiB/3775msec); 0 zone resets clat (msec): min=291, max=2614, avg=1158.80, stdev=1268.01 lat (msec): min=293, max=2614, avg=1159.91, stdev=1267.34 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 2601], 80.00th=[ 2601], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 7937, max= 8062, per=92.16%, avg=7999.50, stdev=88.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.62%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183622: Thu Oct 23 16:27:17 2025 write: IOPS=0, BW=3751KiB/s (3841kB/s)(12.0MiB/3276msec); 0 zone resets clat (msec): min=774, max=1335, avg=1024.35, stdev=285.60 lat (msec): min=774, max=1335, avg=1024.75, stdev=285.55 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7831, max= 7876, per=90.48%, avg=7853.50, stdev=31.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.24%, sys=4.49%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4373KiB/s (4478kB/s), 1093KiB/s-5902KiB/s (1119kB/s-6044kB/s), io=16.0MiB (16.8MB), run=2082-3747msec WRITE: bw=8680KiB/s (8889kB/s), 2186KiB/s-3751KiB/s (2239kB/s-3841kB/s), io=32.0MiB (33.6MB), run=3276-3775msec