== sanity test 398b: DIO and buffer IO race ============== 20:36:10 (1781224570) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.02142 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180407: Thu Jun 11 20:38:40 2026 read: IOPS=11, BW=47.5KiB/s (48.7kB/s)(5992KiB/126025msec) clat (usec): min=38, max=974916, avg=47502.59, stdev=37833.41 lat (usec): min=39, max=974918, avg=47503.77, stdev=37833.46 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11600], 10.00th=[ 18482], 20.00th=[ 24511], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 56886], 80.00th=[ 65799], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[149947], 99.50th=[185598], 99.90th=[210764], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 5, max= 103, per=25.96%, avg=47.51, stdev=17.17, samples=246 iops : min= 1, max= 25, avg=11.23, stdev= 4.33, samples=246 write: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6296KiB/126025msec); 0 zone resets clat (usec): min=1223, max=192964, avg=34560.37, stdev=33317.76 lat (usec): min=1225, max=192965, avg=34570.81, stdev=33316.54 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1418], 10.00th=[ 1778], 20.00th=[ 4555], | 30.00th=[ 9241], 40.00th=[ 17171], 50.00th=[ 26084], 60.00th=[ 34341], | 70.00th=[ 44827], 80.00th=[ 60031], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[139461], 99.50th=[160433], 99.90th=[187696], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 7, max= 111, per=26.24%, avg=50.12, stdev=20.15, samples=245 iops : min= 1, max= 27, avg=11.90, stdev= 5.08, samples=245 lat (usec) : 50=0.13%, 100=1.53%, 250=0.10%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.63%, 4=3.78%, 10=7.13%, 20=9.67%, 50=40.59% lat (msec) : 100=26.46%, 250=4.88%, 1000=0.03% cpu : usr=0.06%, sys=5.55%, ctx=6624, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180408: Thu Jun 11 20:38:40 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(5940KiB/129665msec) clat (usec): min=41, max=987405, avg=48164.41, stdev=38461.52 lat (usec): min=42, max=987406, avg=48167.88, stdev=38461.47 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 13566], 10.00th=[ 18482], 20.00th=[ 25822], | 30.00th=[ 30540], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 48497], | 70.00th=[ 56361], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[145753], 99.50th=[206570], 99.90th=[258999], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 5, max= 95, per=24.90%, avg=45.57, stdev=17.68, samples=254 iops : min= 1, max= 23, avg=10.75, stdev= 4.46, samples=254 write: IOPS=12, BW=48.0KiB/s (50.1kB/s)(6348KiB/129665msec); 0 zone resets clat (usec): min=1168, max=198561, avg=36342.84, stdev=35713.90 lat (usec): min=1169, max=198562, avg=36344.85, stdev=35713.60 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1450], 10.00th=[ 2008], 20.00th=[ 4752], | 30.00th=[ 8225], 40.00th=[ 16909], 50.00th=[ 26608], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 63701], 90.00th=[ 88605], 95.00th=[107480], | 99.00th=[154141], 99.50th=[168821], 99.90th=[189793], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 7, max= 134, per=25.52%, avg=48.74, stdev=20.19, samples=253 iops : min= 1, max= 33, avg=11.55, stdev= 5.11, samples=253 lat (usec) : 50=0.36%, 100=1.33%, 250=0.03%, 750=0.03% lat (msec) : 2=5.11%, 4=3.78%, 10=8.14%, 20=9.18%, 50=39.00% lat (msec) : 100=27.28%, 250=5.70%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.37%, ctx=6665, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180410: Thu Jun 11 20:38:40 2026 read: IOPS=11, BW=47.2KiB/s (48.4kB/s)(6028KiB/127645msec) clat (usec): min=43, max=963754, avg=48095.16, stdev=38549.09 lat (usec): min=43, max=963756, avg=48099.10, stdev=38550.40 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12256], 10.00th=[ 18482], 20.00th=[ 24511], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[147850], 99.50th=[179307], 99.90th=[295699], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 5, max= 102, per=25.61%, avg=46.86, stdev=16.89, samples=250 iops : min= 1, max= 25, avg=11.08, stdev= 4.28, samples=250 write: IOPS=12, BW=49.0KiB/s (50.2kB/s)(6260KiB/127645msec); 0 zone resets clat (usec): min=1154, max=307017, avg=34942.70, stdev=36824.94 lat (usec): min=1155, max=307017, avg=34951.05, stdev=36826.05 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1418], 10.00th=[ 1795], 20.00th=[ 4424], | 30.00th=[ 8160], 40.00th=[ 15270], 50.00th=[ 23725], 60.00th=[ 32900], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 84411], 95.00th=[107480], | 99.00th=[162530], 99.50th=[177210], 99.90th=[270533], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7, max= 111, per=25.43%, avg=48.58, stdev=19.89, samples=250 iops : min= 1, max= 27, avg=11.52, stdev= 5.00, samples=250 lat (usec) : 50=0.23%, 100=1.60%, 250=0.16%, 500=0.13%, 750=0.03% lat (msec) : 2=5.76%, 4=3.81%, 10=7.81%, 20=9.60%, 50=38.12% lat (msec) : 100=26.95%, 250=5.60%, 500=0.16%, 1000=0.03% cpu : usr=0.08%, sys=5.40%, ctx=6612, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180411: Thu Jun 11 20:38:40 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6052KiB/131087msec) clat (usec): min=36, max=956212, avg=48631.36, stdev=37903.72 lat (usec): min=36, max=956214, avg=48632.59, stdev=37903.72 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 12518], 10.00th=[ 18482], 20.00th=[ 25035], | 30.00th=[ 30016], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[147850], 99.50th=[170918], 99.90th=[287310], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 103, per=25.15%, avg=46.02, stdev=17.23, samples=256 iops : min= 1, max= 25, avg=10.87, stdev= 4.33, samples=256 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6236KiB/131087msec); 0 zone resets clat (usec): min=1119, max=242661, avg=36602.36, stdev=36755.14 lat (usec): min=1121, max=242662, avg=36604.00, stdev=36755.00 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1418], 10.00th=[ 2040], 20.00th=[ 4817], | 30.00th=[ 9372], 40.00th=[ 18220], 50.00th=[ 27657], 60.00th=[ 36439], | 70.00th=[ 46924], 80.00th=[ 61080], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[156238], 99.50th=[185598], 99.90th=[240124], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 111, per=24.70%, avg=47.18, stdev=20.05, samples=257 iops : min= 1, max= 27, avg=11.16, stdev= 5.06, samples=257 lat (usec) : 50=0.10%, 100=1.56%, 250=0.16%, 500=0.10% lat (msec) : 2=4.98%, 4=3.71%, 10=7.10%, 20=9.47%, 50=39.68% lat (msec) : 100=27.21%, 250=5.86%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.28%, ctx=6798, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=183KiB/s (188kB/s), 45.8KiB/s-47.5KiB/s (46.9kB/s-48.7kB/s), io=23.4MiB (24.6MB), run=126025-131087msec WRITE: bw=192KiB/s (196kB/s), 47.6KiB/s-49.0KiB/s (48.7kB/s-51.2kB/s), io=24.6MiB (25.7MB), run=126025-131087msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180404: Thu Jun 11 20:39:16 2026 read: IOPS=9, BW=36.1KiB/s (36.0kB/s)(5992KiB/165901msec) clat (msec): min=5, max=998, avg=43.76, stdev=45.49 lat (msec): min=5, max=998, avg=43.76, stdev=45.49 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 66], 90.00th=[ 101], 95.00th=[ 127], | 99.00th=[ 186], 99.50th=[ 203], 99.90th=[ 232], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 128, per=25.94%, avg=37.10, stdev=24.77, samples=313 iops : min= 1, max= 32, avg= 8.62, stdev= 6.23, samples=313 write: IOPS=9, BW=37.0KiB/s (38.9kB/s)(6296KiB/165901msec); 0 zone resets clat (msec): min=10, max=373, avg=63.48, stdev=45.15 lat (msec): min=10, max=373, avg=63.48, stdev=45.15 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 96], 90.00th=[ 122], 95.00th=[ 153], | 99.00th=[ 220], 99.50th=[ 249], 99.90th=[ 363], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 120, per=25.21%, avg=37.82, stdev=24.04, samples=323 iops : min= 1, max= 30, avg= 8.81, stdev= 6.04, samples=323 lat (msec) : 10=1.63%, 20=15.66%, 50=44.79%, 100=23.80%, 250=13.87% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.05%, sys=2.19%, ctx=4955, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180405: Thu Jun 11 20:39:16 2026 read: IOPS=8, BW=35.8KiB/s (36.6kB/s)(5940KiB/166079msec) clat (msec): min=5, max=981, avg=42.41, stdev=45.54 lat (msec): min=5, max=981, avg=42.41, stdev=45.54 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 95], 95.00th=[ 130], | 99.00th=[ 188], 99.50th=[ 211], 99.90th=[ 262], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 128, per=25.64%, avg=36.67, stdev=26.18, samples=315 iops : min= 1, max= 32, avg= 8.51, stdev= 6.57, samples=315 write: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6348KiB/166079msec); 0 zone resets clat (msec): min=11, max=364, avg=64.68, stdev=46.54 lat (msec): min=11, max=364, avg=64.69, stdev=46.55 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 61], | 70.00th=[ 78], 80.00th=[ 94], 90.00th=[ 126], 95.00th=[ 155], | 99.00th=[ 243], 99.50th=[ 275], 99.90th=[ 309], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 127, per=25.68%, avg=38.51, stdev=23.91, samples=321 iops : min= 1, max= 31, avg= 8.98, stdev= 6.01, samples=321 lat (msec) : 10=2.38%, 20=15.85%, 50=44.34%, 100=23.44%, 250=13.51% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.05%, sys=2.15%, ctx=4994, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180406: Thu Jun 11 20:39:16 2026 read: IOPS=9, BW=36.2KiB/s (37.1kB/s)(6028KiB/166551msec) clat (msec): min=4, max=273, avg=43.43, stdev=39.36 lat (msec): min=4, max=273, avg=43.43, stdev=39.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 67], 90.00th=[ 100], 95.00th=[ 128], | 99.00th=[ 192], 99.50th=[ 215], 99.90th=[ 257], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 135, per=25.51%, avg=36.48, stdev=25.41, samples=322 iops : min= 1, max= 33, avg= 8.47, stdev= 6.38, samples=322 write: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6260KiB/166551msec); 0 zone resets clat (msec): min=11, max=1025, avg=64.31, stdev=51.95 lat (msec): min=11, max=1025, avg=64.31, stdev=51.95 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 74], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 241], 99.50th=[ 284], 99.90th=[ 456], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 119, per=24.84%, avg=37.26, stdev=24.49, samples=327 iops : min= 1, max= 29, avg= 8.67, stdev= 6.16, samples=327 lat (msec) : 10=2.05%, 20=15.36%, 50=44.79%, 100=24.32%, 250=13.05% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.05%, sys=2.24%, ctx=4978, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180409: Thu Jun 11 20:39:16 2026 read: IOPS=9, BW=36.2KiB/s (37.0kB/s)(6052KiB/167410msec) clat (msec): min=6, max=291, avg=43.48, stdev=40.51 lat (msec): min=6, max=291, avg=43.48, stdev=40.51 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 100], 95.00th=[ 127], | 99.00th=[ 194], 99.50th=[ 236], 99.90th=[ 264], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 136, per=25.77%, avg=36.85, stdev=26.13, samples=317 iops : min= 1, max= 34, avg= 8.57, stdev= 6.57, samples=317 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6236KiB/167410msec); 0 zone resets clat (msec): min=9, max=1028, avg=64.91, stdev=52.99 lat (msec): min=9, max=1028, avg=64.92, stdev=52.99 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 75], 80.00th=[ 97], 90.00th=[ 129], 95.00th=[ 157], | 99.00th=[ 226], 99.50th=[ 268], 99.90th=[ 447], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 128, per=24.65%, avg=36.98, stdev=24.64, samples=326 iops : min= 1, max= 32, avg= 8.60, stdev= 6.20, samples=326 lat (msec) : 10=2.31%, 20=16.05%, 50=44.43%, 100=22.85%, 250=13.93% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=2.15%, ctx=5033, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=143KiB/s (147kB/s), 35.8KiB/s-36.2KiB/s (36.6kB/s-37.1kB/s), io=23.4MiB (24.6MB), run=165901-167410msec WRITE: bw=150KiB/s (154kB/s), 37.2KiB/s-38.2KiB/s (38.1kB/s-39.1kB/s), io=24.6MiB (25.7MB), run=165901-167410msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180456: Thu Jun 11 20:40:03 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5920KiB/34660msec) clat (usec): min=36, max=200977, avg=47899.24, stdev=34165.36 lat (usec): min=37, max=200979, avg=47900.51, stdev=34165.41 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 668], 20.00th=[ 25035], | 30.00th=[ 29492], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 49021], | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[175113], 99.50th=[198181], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 62, max= 380, per=24.72%, avg=170.79, stdev=64.60, samples=66 iops : min= 3, max= 23, avg= 9.86, stdev= 4.09, samples=66 write: IOPS=11, BW=184KiB/s (188kB/s)(6368KiB/34660msec); 0 zone resets clat (usec): min=1685, max=220328, avg=41754.48, stdev=38138.99 lat (usec): min=1688, max=220330, avg=41773.17, stdev=38123.93 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2900], 10.00th=[ 5014], 20.00th=[ 8979], | 30.00th=[ 13829], 40.00th=[ 21627], 50.00th=[ 30802], 60.00th=[ 40633], | 70.00th=[ 55313], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[127402], | 99.00th=[164627], 99.50th=[175113], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 348, per=25.20%, avg=183.18, stdev=72.79, samples=67 iops : min= 1, max= 21, avg=10.64, stdev= 4.58, samples=67 lat (usec) : 50=0.39%, 100=3.65%, 250=0.65%, 750=0.13% lat (msec) : 2=0.91%, 4=3.26%, 10=7.16%, 20=10.55%, 50=37.89% lat (msec) : 100=27.47%, 250=7.94% cpu : usr=0.08%, sys=6.01%, ctx=1748, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180457: Thu Jun 11 20:40:03 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5744KiB/34147msec) clat (usec): min=41, max=171670, avg=50543.49, stdev=30930.93 lat (usec): min=41, max=171671, avg=50544.68, stdev=30930.99 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 83], 10.00th=[ 15401], 20.00th=[ 27395], | 30.00th=[ 34341], 40.00th=[ 39584], 50.00th=[ 46400], 60.00th=[ 54789], | 70.00th=[ 64750], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[147850], 99.50th=[168821], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 31, max= 316, per=24.34%, avg=168.18, stdev=66.81, samples=66 iops : min= 1, max= 19, avg= 9.70, stdev= 4.22, samples=66 write: IOPS=11, BW=192KiB/s (196kB/s)(6544KiB/34147msec); 0 zone resets clat (usec): min=1686, max=193394, avg=38784.41, stdev=36489.85 lat (usec): min=1688, max=193396, avg=38786.80, stdev=36489.67 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 2180], 10.00th=[ 4228], 20.00th=[ 8094], | 30.00th=[ 11994], 40.00th=[ 18744], 50.00th=[ 28181], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 63701], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[154141], 99.50th=[168821], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 382, per=26.24%, avg=190.77, stdev=74.91, samples=66 iops : min= 1, max= 23, avg=11.12, stdev= 4.70, samples=66 lat (usec) : 50=0.13%, 100=2.86%, 250=0.65%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.65%, 4=4.43%, 10=8.59%, 20=10.81%, 50=34.64% lat (msec) : 100=29.56%, 250=7.42% cpu : usr=0.07%, sys=6.04%, ctx=1742, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180458: Thu Jun 11 20:40:03 2026 read: IOPS=11, BW=191KiB/s (195kB/s)(6256KiB/32772msec) clat (usec): min=47, max=193416, avg=46539.00, stdev=29400.99 lat (usec): min=48, max=193417, avg=46540.43, stdev=29400.95 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 11600], 20.00th=[ 24773], | 30.00th=[ 31065], 40.00th=[ 37487], 50.00th=[ 43254], 60.00th=[ 49546], | 70.00th=[ 56886], 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[141558], 99.50th=[166724], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 62, max= 380, per=27.67%, avg=191.17, stdev=72.31, samples=64 iops : min= 3, max= 23, avg=11.17, stdev= 4.57, samples=64 write: IOPS=11, BW=184KiB/s (188kB/s)(6032KiB/32772msec); 0 zone resets clat (usec): min=1771, max=224134, avg=38103.77, stdev=38754.00 lat (usec): min=1773, max=224135, avg=38106.75, stdev=38754.28 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 2311], 10.00th=[ 3752], 20.00th=[ 6521], | 30.00th=[ 10421], 40.00th=[ 15533], 50.00th=[ 23987], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[116917], | 99.00th=[170918], 99.50th=[214959], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 446, per=25.11%, avg=182.52, stdev=85.54, samples=64 iops : min= 1, max= 27, avg=10.61, stdev= 5.43, samples=64 lat (usec) : 50=0.13%, 100=3.91%, 250=0.91%, 500=0.13% lat (msec) : 2=0.78%, 4=4.69%, 10=8.59%, 20=10.03%, 50=35.94% lat (msec) : 100=28.52%, 250=6.38% cpu : usr=0.09%, sys=5.80%, ctx=1729, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180459: Thu Jun 11 20:40:03 2026 read: IOPS=11, BW=188KiB/s (193kB/s)(6032KiB/32020msec) clat (usec): min=40, max=188413, avg=45862.69, stdev=32467.21 lat (usec): min=40, max=188414, avg=45863.85, stdev=32467.21 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 61], 10.00th=[ 74], 20.00th=[ 21627], | 30.00th=[ 29230], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[147850], 99.50th=[160433], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 22, max= 380, per=27.10%, avg=187.29, stdev=75.03, samples=62 iops : min= 1, max= 23, avg=10.92, stdev= 4.73, samples=62 write: IOPS=12, BW=195KiB/s (200kB/s)(6256KiB/32020msec); 0 zone resets clat (usec): min=1703, max=197587, avg=36647.67, stdev=34391.61 lat (usec): min=1704, max=197590, avg=36677.30, stdev=34394.93 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2442], 10.00th=[ 3851], 20.00th=[ 6915], | 30.00th=[ 12911], 40.00th=[ 21103], 50.00th=[ 26346], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 61604], 90.00th=[ 83362], 95.00th=[112722], | 99.00th=[147850], 99.50th=[196084], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 63, max= 382, per=26.69%, avg=194.05, stdev=72.18, samples=62 iops : min= 3, max= 23, avg=11.34, stdev= 4.55, samples=62 lat (usec) : 50=0.26%, 100=5.86%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=1.30%, 4=4.30%, 10=7.68%, 20=7.81%, 50=39.06% lat (msec) : 100=26.56%, 250=5.99% cpu : usr=0.06%, sys=6.12%, ctx=1733, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=691KiB/s (708kB/s), 168KiB/s-191KiB/s (172kB/s-195kB/s), io=23.4MiB (24.5MB), run=32020-34660msec WRITE: bw=727KiB/s (745kB/s), 184KiB/s-195KiB/s (188kB/s-200kB/s), io=24.6MiB (25.8MB), run=32020-34660msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180452: Thu Jun 11 20:40:19 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(5920KiB/50210msec) clat (msec): min=8, max=261, avg=53.73, stdev=37.80 lat (msec): min=8, max=261, avg=53.73, stdev=37.80 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 61], 80.00th=[ 78], 90.00th=[ 102], 95.00th=[ 133], | 99.00th=[ 188], 99.50th=[ 207], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 381, per=25.44%, avg=121.36, stdev=69.12, samples=96 iops : min= 1, max= 23, avg= 6.76, stdev= 4.36, samples=96 write: IOPS=7, BW=127KiB/s (130kB/s)(6368KiB/50210msec); 0 zone resets clat (msec): min=13, max=308, avg=75.56, stdev=45.72 lat (msec): min=13, max=308, avg=75.56, stdev=45.72 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 32], 20.00th=[ 40], | 30.00th=[ 48], 40.00th=[ 55], 50.00th=[ 62], 60.00th=[ 73], | 70.00th=[ 90], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 167], | 99.00th=[ 234], 99.50th=[ 288], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 318, per=25.49%, avg=127.70, stdev=58.44, samples=98 iops : min= 1, max= 19, avg= 7.17, stdev= 3.66, samples=98 lat (msec) : 10=0.39%, 20=5.73%, 50=40.23%, 100=36.46%, 250=16.80% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.05%, ctx=1314, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180453: Thu Jun 11 20:40:19 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(5744KiB/49625msec) clat (msec): min=11, max=259, avg=51.92, stdev=35.48 lat (msec): min=11, max=259, avg=51.92, stdev=35.48 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 56], 80.00th=[ 68], 90.00th=[ 100], 95.00th=[ 136], | 99.00th=[ 180], 99.50th=[ 197], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 22, max= 381, per=24.85%, avg=118.54, stdev=69.38, samples=94 iops : min= 1, max= 23, avg= 6.60, stdev= 4.39, samples=94 write: IOPS=8, BW=132KiB/s (135kB/s)(6544KiB/49625msec); 0 zone resets clat (msec): min=16, max=347, avg=74.79, stdev=44.66 lat (msec): min=16, max=347, avg=74.79, stdev=44.66 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 73], | 70.00th=[ 85], 80.00th=[ 108], 90.00th=[ 132], 95.00th=[ 169], | 99.00th=[ 226], 99.50th=[ 245], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 383, per=26.13%, avg=130.90, stdev=63.32, samples=97 iops : min= 1, max= 23, avg= 7.36, stdev= 3.97, samples=97 lat (msec) : 20=4.04%, 50=44.14%, 100=35.03%, 250=16.41%, 500=0.39% cpu : usr=0.04%, sys=2.04%, ctx=1307, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180454: Thu Jun 11 20:40:19 2026 read: IOPS=8, BW=128KiB/s (131kB/s)(6256KiB/48819msec) clat (msec): min=8, max=275, avg=50.21, stdev=38.25 lat (msec): min=8, max=275, avg=50.21, stdev=38.25 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 65], 90.00th=[ 103], 95.00th=[ 134], | 99.00th=[ 209], 99.50th=[ 247], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 409, per=27.52%, avg=131.27, stdev=70.04, samples=94 iops : min= 1, max= 25, avg= 7.38, stdev= 4.43, samples=94 write: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48819msec); 0 zone resets clat (msec): min=18, max=342, avg=76.65, stdev=47.31 lat (msec): min=18, max=342, avg=76.65, stdev=47.31 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 53], 50.00th=[ 62], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 109], 90.00th=[ 146], 95.00th=[ 167], | 99.00th=[ 224], 99.50th=[ 300], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 288, per=24.70%, avg=123.73, stdev=54.22, samples=95 iops : min= 1, max= 18, avg= 6.92, stdev= 3.44, samples=95 lat (msec) : 10=0.13%, 20=5.99%, 50=44.66%, 100=32.03%, 250=16.67% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=2.30%, ctx=1334, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180455: Thu Jun 11 20:40:19 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49369msec) clat (msec): min=7, max=231, avg=54.67, stdev=41.70 lat (msec): min=7, max=231, avg=54.68, stdev=41.70 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 74], 90.00th=[ 114], 95.00th=[ 146], | 99.00th=[ 218], 99.50th=[ 228], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 349, per=25.39%, avg=121.10, stdev=68.60, samples=97 iops : min= 1, max= 21, avg= 6.75, stdev= 4.31, samples=97 write: IOPS=7, BW=127KiB/s (130kB/s)(6256KiB/49369msec); 0 zone resets clat (msec): min=19, max=286, avg=73.30, stdev=42.77 lat (msec): min=19, max=286, avg=73.31, stdev=42.77 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 62], 60.00th=[ 71], | 70.00th=[ 82], 80.00th=[ 101], 90.00th=[ 138], 95.00th=[ 169], | 99.00th=[ 236], 99.50th=[ 245], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 351, per=25.29%, avg=126.69, stdev=58.37, samples=97 iops : min= 1, max= 21, avg= 7.10, stdev= 3.66, samples=97 lat (msec) : 10=0.26%, 20=6.12%, 50=41.28%, 100=35.16%, 250=17.06% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.00%, ctx=1220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=477KiB/s (488kB/s), 116KiB/s-128KiB/s (119kB/s-131kB/s), io=23.4MiB (24.5MB), run=48819-50210msec WRITE: bw=502KiB/s (514kB/s), 124KiB/s-132KiB/s (127kB/s-135kB/s), io=24.6MiB (25.8MB), run=48819-50210msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180477: Thu Jun 11 20:40:39 2026 read: IOPS=1, BW=1464KiB/s (1499kB/s)(7168KiB/4896msec) clat (usec): min=816, max=357826, avg=191380.72, stdev=137803.28 lat (usec): min=817, max=357827, avg=191381.93, stdev=137803.33 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 816], 10.00th=[ 816], 20.00th=[ 2606], | 30.00th=[210764], 40.00th=[210764], 50.00th=[225444], 60.00th=[267387], | 70.00th=[267387], 80.00th=[274727], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 1539, max= 4096, per=60.69%, avg=2299.00, stdev=1022.15, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=1, BW=1046KiB/s (1071kB/s)(5120KiB/4896msec); 0 zone resets clat (msec): min=340, max=821, avg=666.30, stdev=188.09 lat (msec): min=340, max=821, avg=666.36, stdev=188.09 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1939, max= 3723, per=48.01%, avg=2546.00, stdev=1019.48, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=33.33%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=7.97%, ctx=241, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180478: Thu Jun 11 20:40:39 2026 read: IOPS=0, BW=379KiB/s (388kB/s)(2048KiB/5406msec) clat (msec): min=264, max=508, avg=386.74, stdev=172.64 lat (msec): min=264, max=508, avg=386.75, stdev=172.64 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1600, max= 1861, per=45.68%, avg=1730.50, stdev=184.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1894KiB/s (1940kB/s)(10.0MiB/5406msec); 0 zone resets clat (msec): min=197, max=1184, avg=441.50, stdev=312.20 lat (msec): min=197, max=1184, avg=441.58, stdev=312.20 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 226], | 30.00th=[ 241], 40.00th=[ 259], 50.00th=[ 275], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 451], 90.00th=[ 776], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1861, max= 4096, per=48.28%, avg=2560.29, stdev=1002.96, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=11.82%, ctx=152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180479: Thu Jun 11 20:40:39 2026 read: IOPS=1, BW=1426KiB/s (1460kB/s)(6144KiB/4308msec) clat (usec): min=865, max=362301, avg=157344.80, stdev=156529.56 lat (usec): min=866, max=362302, avg=157345.86, stdev=156529.73 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 865], 10.00th=[ 865], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 57934], 50.00th=[ 57934], 60.00th=[246416], | 70.00th=[274727], 80.00th=[274727], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 2031, max= 4047, per=87.61%, avg=3318.67, stdev=1118.35, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1426KiB/s (1460kB/s)(6144KiB/4308msec); 0 zone resets clat (msec): min=121, max=806, avg=527.93, stdev=256.77 lat (msec): min=121, max=806, avg=527.99, stdev=256.78 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 642], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2003, max= 4047, per=47.75%, avg=2532.25, stdev=1010.00, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=25.00% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=8.03%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180480: Thu Jun 11 20:40:39 2026 read: IOPS=1, BW=1181KiB/s (1209kB/s)(5120KiB/4336msec) clat (usec): min=609, max=318918, avg=160865.86, stdev=149545.11 lat (usec): min=610, max=318918, avg=160866.96, stdev=149545.22 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 898], 40.00th=[ 898], 50.00th=[235930], 60.00th=[235930], | 70.00th=[246416], 80.00th=[246416], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 2031, max= 5818, per=100.00%, avg=3924.50, stdev=2677.81, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1653KiB/s (1693kB/s)(7168KiB/4336msec); 0 zone resets clat (msec): min=163, max=1100, avg=490.64, stdev=302.30 lat (msec): min=163, max=1100, avg=490.71, stdev=302.30 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 359], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 397], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 642], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1438, max= 2031, per=35.62%, avg=1888.67, stdev=229.29, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.51%, ctx=166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3788KiB/s (3879kB/s), 379KiB/s-1464KiB/s (388kB/s-1499kB/s), io=20.0MiB (20.0MB), run=4308-5406msec WRITE: bw=5304KiB/s (5431kB/s), 1046KiB/s-1894KiB/s (1071kB/s-1940kB/s), io=28.0MiB (29.4MB), run=4308-5406msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180473: Thu Jun 11 20:40:40 2026 read: IOPS=2, BW=2051KiB/s (2100kB/s)(7168KiB/3495msec) clat (msec): min=106, max=519, avg=215.40, stdev=147.50 lat (msec): min=106, max=519, avg=215.40, stdev=147.50 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 111], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 155], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 284], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1892, max= 3968, per=78.41%, avg=2722.50, stdev=969.39, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1465KiB/s (1500kB/s)(5120KiB/3495msec); 0 zone resets clat (msec): min=212, max=514, avg=380.14, stdev=134.97 lat (msec): min=213, max=514, avg=380.20, stdev=134.96 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1984, max= 3900, per=54.05%, avg=2628.00, stdev=1101.61, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=3.46%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180474: Thu Jun 11 20:40:40 2026 read: IOPS=0, BW=350KiB/s (358kB/s)(2048KiB/5850msec) clat (msec): min=45, max=692, avg=369.01, stdev=457.02 lat (msec): min=45, max=692, avg=369.01, stdev=457.02 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 46], | 30.00th=[ 46], 40.00th=[ 46], 50.00th=[ 46], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1756, max= 1984, per=53.86%, avg=1870.00, stdev=161.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1750KiB/s (1792kB/s)(10.0MiB/5850msec); 0 zone resets clat (msec): min=125, max=925, avg=486.36, stdev=245.71 lat (msec): min=125, max=925, avg=486.44, stdev=245.71 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 268], | 30.00th=[ 309], 40.00th=[ 384], 50.00th=[ 426], 60.00th=[ 498], | 70.00th=[ 506], 80.00th=[ 609], 90.00th=[ 818], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1950, max= 3512, per=46.48%, avg=2259.83, stdev=614.31, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 50=8.33%, 250=8.33%, 500=41.67%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=4.80%, ctx=140, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180475: Thu Jun 11 20:40:40 2026 read: IOPS=1, BW=1137KiB/s (1164kB/s)(6144KiB/5404msec) clat (msec): min=107, max=827, avg=428.25, stdev=304.29 lat (msec): min=107, max=827, avg=428.25, stdev=304.29 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 617], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1756, max= 2043, per=56.13%, avg=1949.00, stdev=124.00, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1137KiB/s (1164kB/s)(6144KiB/5404msec); 0 zone resets clat (msec): min=143, max=672, avg=441.02, stdev=223.48 lat (msec): min=143, max=672, avg=441.11, stdev=223.50 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 575], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1756, max= 4055, per=48.60%, avg=2362.80, stdev=951.98, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=8.33%, 750=41.67%, 1000=8.33% cpu : usr=0.00%, sys=3.11%, ctx=59, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180476: Thu Jun 11 20:40:40 2026 read: IOPS=0, BW=868KiB/s (889kB/s)(5120KiB/5897msec) clat (msec): min=100, max=591, avg=296.05, stdev=249.87 lat (msec): min=100, max=591, avg=296.05, stdev=249.87 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1756, max= 4087, per=75.56%, avg=2623.33, stdev=1274.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1216KiB/s (1245kB/s)(7168KiB/5897msec); 0 zone resets clat (msec): min=98, max=1041, avg=587.11, stdev=371.16 lat (msec): min=98, max=1041, avg=587.24, stdev=371.16 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 150], | 30.00th=[ 535], 40.00th=[ 535], 50.00th=[ 609], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 1011], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1892, max= 6107, per=57.63%, avg=2802.00, stdev=1848.25, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 750=41.67%, 2000=16.67% cpu : usr=0.00%, sys=3.24%, ctx=118, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3473KiB/s (3556kB/s), 350KiB/s-2051KiB/s (358kB/s-2100kB/s), io=20.0MiB (20.0MB), run=3495-5897msec WRITE: bw=4862KiB/s (4979kB/s), 1137KiB/s-1750KiB/s (1164kB/s-1792kB/s), io=28.0MiB (29.4MB), run=3495-5897msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180487: Thu Jun 11 20:40:52 2026 read: IOPS=4, BW=16.0MiB/s (16.8MB/s)(12.0MiB/750msec) clat (msec): min=169, max=256, avg=218.11, stdev=44.49 lat (msec): min=169, max=256, avg=218.11, stdev=44.49 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min=15663, max=15663, per=100.00%, avg=15663.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.80%, sys=14.02%, ctx=32, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180488: Thu Jun 11 20:40:52 2026 read: IOPS=0, BW=2174KiB/s (2226kB/s)(4096KiB/1884msec) clat (nsec): min=428790k, max=428790k, avg=428789764.00, stdev= 0.00 lat (nsec): min=428791k, max=428791k, avg=428790756.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 5461, max= 5461, per=62.80%, avg=5461.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4348KiB/s (4453kB/s)(8192KiB/1884msec); 0 zone resets clat (msec): min=620, max=761, avg=691.07, stdev=99.48 lat (msec): min=620, max=762, avg=691.58, stdev=99.95 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8159, max= 8159, per=50.92%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=4.41%, ctx=71, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180489: Thu Jun 11 20:40:52 2026 write: IOPS=1, BW=6009KiB/s (6153kB/s)(12.0MiB/2045msec); 0 zone resets clat (msec): min=510, max=757, avg=658.63, stdev=130.50 lat (msec): min=511, max=760, avg=659.81, stdev=131.35 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8159, max= 8192, per=51.02%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.75%, ctx=34, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180490: Thu Jun 11 20:40:52 2026 write: IOPS=2, BW=9518KiB/s (9747kB/s)(12.0MiB/1291msec); 0 zone resets clat (msec): min=252, max=541, avg=416.96, stdev=148.75 lat (msec): min=252, max=541, avg=418.00, stdev=148.76 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 5893, max= 8192, per=43.95%, avg=7042.50, stdev=1625.64, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.16%, sys=7.91%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8696KiB/s (8905kB/s), 2174KiB/s-16.0MiB/s (2226kB/s-16.8MB/s), io=16.0MiB (16.8MB), run=750-1884msec WRITE: bw=15.6MiB/s (16.4MB/s), 4348KiB/s-9518KiB/s (4453kB/s-9747kB/s), io=32.0MiB (33.6MB), run=1291-2045msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180492: Thu Jun 11 20:40:54 2026 read: IOPS=1, BW=4339KiB/s (4443kB/s)(12.0MiB/2832msec) clat (msec): min=830, max=1022, avg=939.56, stdev=98.46 lat (msec): min=830, max=1022, avg=939.56, stdev=98.46 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8000, max= 8078, per=100.00%, avg=8039.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.91%, ctx=309, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180493: Thu Jun 11 20:40:54 2026 read: IOPS=0, BW=1323KiB/s (1355kB/s)(4096KiB/3095msec) clat (nsec): min=993673k, max=993673k, avg=993673163.00, stdev= 0.00 lat (nsec): min=993675k, max=993675k, avg=993674619.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2647KiB/s (2710kB/s)(8192KiB/3095msec); 0 zone resets clat (msec): min=795, max=1303, avg=1049.70, stdev=359.20 lat (msec): min=796, max=1304, avg=1050.06, stdev=359.22 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8078, max= 8078, per=81.19%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.56%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180494: Thu Jun 11 20:40:54 2026 write: IOPS=0, BW=3732KiB/s (3821kB/s)(12.0MiB/3293msec); 0 zone resets clat (msec): min=155, max=1607, avg=1096.99, stdev=816.46 lat (msec): min=155, max=1607, avg=1097.34, stdev=816.35 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7488, max= 8126, per=78.46%, avg=7807.00, stdev=451.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.25%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180495: Thu Jun 11 20:40:54 2026 write: IOPS=0, BW=3991KiB/s (4087kB/s)(12.0MiB/3079msec); 0 zone resets clat (msec): min=504, max=1657, avg=1023.96, stdev=584.92 lat (msec): min=505, max=1657, avg=1025.37, stdev=584.56 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8000, max= 8126, per=81.04%, avg=8063.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.10%, sys=3.96%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5294KiB/s (5421kB/s), 1323KiB/s-4339KiB/s (1355kB/s-4443kB/s), io=16.0MiB (16.8MB), run=2832-3095msec WRITE: bw=9951KiB/s (10.2MB/s), 2647KiB/s-3991KiB/s (2710kB/s-4087kB/s), io=32.0MiB (33.6MB), run=3079-3293msec