== sanity test 398b: DIO and buffer IO race ============== 00:16:58 (1789359418) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.56629 s, 19.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes fio: pid=194678, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=194671: Mon Sep 14 00:17:57 2026 read: IOPS=29, BW=118KiB/s (121kB/s)(5992KiB/50657msec) clat (usec): min=44, max=655972, avg=18185.11, stdev=19217.50 lat (usec): min=44, max=655974, avg=18185.89, stdev=19217.58 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 6390], 10.00th=[ 7635], 20.00th=[ 9634], | 30.00th=[ 11863], 40.00th=[ 13566], 50.00th=[ 15795], 60.00th=[ 18220], | 70.00th=[ 21103], 80.00th=[ 24773], 90.00th=[ 30540], 95.00th=[ 34866], | 99.00th=[ 53216], 99.50th=[ 59507], 99.90th=[ 73925], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 15, max= 224, per=24.66%, avg=116.91, stdev=37.12, samples=100 iops : min= 3, max= 56, avg=28.84, stdev= 9.43, samples=100 write: IOPS=31, BW=124KiB/s (127kB/s)(6296KiB/50657msec); 0 zone resets clat (usec): min=572, max=104242, avg=14752.47, stdev=11911.86 lat (usec): min=573, max=104243, avg=14753.95, stdev=11911.62 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2245], 10.00th=[ 2802], 20.00th=[ 3982], | 30.00th=[ 6587], 40.00th=[ 9634], 50.00th=[ 11994], 60.00th=[ 15008], | 70.00th=[ 18744], 80.00th=[ 23200], 90.00th=[ 30802], 95.00th=[ 36439], | 99.00th=[ 52167], 99.50th=[ 60556], 99.90th=[ 83362], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 47, max= 264, per=24.97%, avg=123.83, stdev=41.86, samples=99 iops : min= 11, max= 66, avg=30.58, stdev=10.53, samples=99 lat (usec) : 50=0.03%, 100=0.20%, 250=0.65%, 750=0.10%, 1000=0.46% lat (msec) : 2=1.14%, 4=8.72%, 10=20.83%, 20=37.34%, 50=29.26% lat (msec) : 100=1.20%, 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=26.35%, ctx=9079, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194674: Mon Sep 14 00:17:57 2026 read: IOPS=29, BW=119KiB/s (122kB/s)(5940KiB/49876msec) clat (usec): min=32, max=79785, avg=17989.35, stdev=9958.05 lat (usec): min=32, max=79786, avg=17990.07, stdev=9958.12 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 6718], 10.00th=[ 7767], 20.00th=[ 9503], | 30.00th=[11863], 40.00th=[13960], 50.00th=[16319], 60.00th=[18482], | 70.00th=[21103], 80.00th=[24773], 90.00th=[31327], 95.00th=[37487], | 99.00th=[50070], 99.50th=[55313], 99.90th=[67634], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 7, max= 224, per=25.01%, avg=118.57, stdev=38.20, samples=99 iops : min= 1, max= 56, avg=29.25, stdev= 9.67, samples=99 write: IOPS=31, BW=127KiB/s (130kB/s)(6348KiB/49876msec); 0 zone resets clat (usec): min=588, max=678608, avg=14460.85, stdev=20154.52 lat (usec): min=589, max=678609, avg=14462.04, stdev=20154.62 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 2180], 10.00th=[ 2704], 20.00th=[ 3785], | 30.00th=[ 5604], 40.00th=[ 8586], 50.00th=[ 11338], 60.00th=[ 14222], | 70.00th=[ 17957], 80.00th=[ 22414], 90.00th=[ 29754], 95.00th=[ 37487], | 99.00th=[ 49546], 99.50th=[ 56886], 99.90th=[ 66847], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 312, per=25.47%, avg=126.32, stdev=44.93, samples=99 iops : min= 1, max= 78, avg=31.19, stdev=11.33, samples=99 lat (usec) : 50=0.07%, 100=0.26%, 250=0.65%, 750=0.16%, 1000=0.59% lat (msec) : 2=1.43%, 4=8.89%, 10=21.45%, 20=37.04%, 50=28.55% lat (msec) : 100=0.88%, 750=0.03% cpu : usr=0.11%, sys=26.34%, ctx=9063, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194675: Mon Sep 14 00:17:57 2026 read: IOPS=30, BW=122KiB/s (125kB/s)(6028KiB/49413msec) clat (usec): min=46, max=89786, avg=17096.47, stdev=9539.39 lat (usec): min=47, max=89787, avg=17097.25, stdev=9539.46 clat percentiles (usec): | 1.00th=[ 103], 5.00th=[ 6194], 10.00th=[ 7504], 20.00th=[ 9372], | 30.00th=[11338], 40.00th=[13173], 50.00th=[15401], 60.00th=[17695], | 70.00th=[20579], 80.00th=[23725], 90.00th=[28967], 95.00th=[34866], | 99.00th=[46400], 99.50th=[52691], 99.90th=[80217], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 32, max= 232, per=25.83%, avg=122.42, stdev=40.53, samples=97 iops : min= 8, max= 58, avg=30.22, stdev=10.19, samples=97 write: IOPS=31, BW=127KiB/s (130kB/s)(6260KiB/49413msec); 0 zone resets clat (usec): min=568, max=698742, avg=14994.52, stdev=20930.08 lat (usec): min=568, max=698745, avg=14995.53, stdev=20930.13 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 2089], 10.00th=[ 2638], 20.00th=[ 3752], | 30.00th=[ 5997], 40.00th=[ 9110], 50.00th=[ 12125], 60.00th=[ 15270], | 70.00th=[ 18744], 80.00th=[ 22938], 90.00th=[ 30278], 95.00th=[ 36963], | 99.00th=[ 53740], 99.50th=[ 61080], 99.90th=[ 88605], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 40, max= 216, per=25.58%, avg=126.86, stdev=39.88, samples=97 iops : min= 10, max= 54, avg=31.33, stdev=10.09, samples=97 lat (usec) : 50=0.07%, 100=0.26%, 250=1.07%, 750=0.33%, 1000=0.29% lat (msec) : 2=1.69%, 4=8.63%, 10=20.83%, 20=38.18%, 50=27.60% lat (msec) : 100=1.01%, 750=0.03% cpu : usr=0.12%, sys=26.54%, ctx=8921, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194677: Mon Sep 14 00:17:57 2026 read: IOPS=29, BW=120KiB/s (123kB/s)(6052KiB/50577msec) clat (usec): min=61, max=84494, avg=17506.17, stdev=9922.16 lat (usec): min=62, max=84495, avg=17506.89, stdev=9922.29 clat percentiles (usec): | 1.00th=[ 100], 5.00th=[ 5997], 10.00th=[ 7308], 20.00th=[ 9372], | 30.00th=[11207], 40.00th=[13304], 50.00th=[15664], 60.00th=[17957], | 70.00th=[20841], 80.00th=[25035], 90.00th=[30540], 95.00th=[35914], | 99.00th=[48497], 99.50th=[53216], 99.90th=[69731], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 55, max= 240, per=25.17%, avg=119.29, stdev=37.76, samples=99 iops : min= 13, max= 60, avg=29.44, stdev= 9.58, samples=99 write: IOPS=30, BW=123KiB/s (126kB/s)(6236KiB/50577msec); 0 zone resets clat (usec): min=578, max=680396, avg=15318.57, stdev=20652.81 lat (usec): min=579, max=680396, avg=15319.39, stdev=20652.84 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 2089], 10.00th=[ 2606], 20.00th=[ 3818], | 30.00th=[ 6194], 40.00th=[ 9503], 50.00th=[ 12125], 60.00th=[ 15533], | 70.00th=[ 19268], 80.00th=[ 24511], 90.00th=[ 31065], 95.00th=[ 38011], | 99.00th=[ 52691], 99.50th=[ 60031], 99.90th=[ 92799], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 15, max= 248, per=24.55%, avg=121.79, stdev=42.79, samples=100 iops : min= 3, max= 62, avg=30.06, stdev=10.78, samples=100 lat (usec) : 100=0.49%, 250=0.75%, 500=0.07%, 750=0.23%, 1000=0.33% lat (msec) : 2=1.86%, 4=8.33%, 10=20.96%, 20=36.30%, 50=29.62% lat (msec) : 100=1.04%, 750=0.03% cpu : usr=0.12%, sys=26.02%, ctx=9033, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=474KiB/s (485kB/s), 118KiB/s-122KiB/s (121kB/s-125kB/s), io=23.4MiB (24.6MB), run=49413-50657msec WRITE: bw=496KiB/s (508kB/s), 123KiB/s-127KiB/s (126kB/s-130kB/s), io=24.6MiB (25.7MB), run=49413-50657msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194672: Mon Sep 14 00:18:02 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(5992KiB/56037msec) clat (msec): min=2, max=666, avg=16.17, stdev=21.51 lat (msec): min=2, max=666, avg=16.17, stdev=21.51 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 65], 99.50th=[ 72], 99.90th=[ 95], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 31, max= 448, per=28.47%, avg=106.48, stdev=86.60, samples=110 iops : min= 7, max= 112, avg=26.25, stdev=21.76, samples=110 write: IOPS=28, BW=112KiB/s (115kB/s)(6296KiB/56037msec); 0 zone resets clat (msec): min=3, max=106, avg=20.10, stdev=15.15 lat (msec): min=3, max=106, avg=20.10, stdev=15.15 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 41], 95.00th=[ 49], | 99.00th=[ 66], 99.50th=[ 85], 99.90th=[ 95], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 40, max= 504, per=28.32%, avg=111.58, stdev=86.89, samples=110 iops : min= 10, max= 126, avg=27.53, stdev=21.82, samples=110 lat (msec) : 4=5.99%, 10=32.62%, 20=27.47%, 50=30.05%, 100=3.81% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=12.67%, ctx=5492, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194673: Mon Sep 14 00:18:02 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(5940KiB/56042msec) clat (msec): min=2, max=685, avg=16.30, stdev=22.33 lat (msec): min=2, max=685, avg=16.31, stdev=22.33 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 35], 95.00th=[ 44], | 99.00th=[ 69], 99.50th=[ 75], 99.90th=[ 126], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 15, max= 432, per=28.32%, avg=105.91, stdev=87.98, samples=110 iops : min= 3, max= 108, avg=26.11, stdev=22.10, samples=110 write: IOPS=28, BW=113KiB/s (116kB/s)(6348KiB/56042msec); 0 zone resets clat (msec): min=3, max=126, avg=19.95, stdev=14.89 lat (msec): min=3, max=126, avg=19.95, stdev=14.89 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 47], | 99.00th=[ 66], 99.50th=[ 75], 99.90th=[ 96], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 39, max= 472, per=28.47%, avg=112.16, stdev=88.42, samples=110 iops : min= 9, max= 118, avg=27.67, stdev=22.22, samples=110 lat (msec) : 4=5.21%, 10=34.51%, 20=25.91%, 50=31.05%, 100=3.19% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=12.41%, ctx=5446, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194676: Mon Sep 14 00:18:02 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(6028KiB/56166msec) clat (usec): min=2212, max=83029, avg=15957.54, stdev=13558.55 lat (usec): min=2212, max=83029, avg=15958.21, stdev=13558.65 clat percentiles (usec): | 1.00th=[ 2507], 5.00th=[ 3261], 10.00th=[ 3818], 20.00th=[ 4817], | 30.00th=[ 5669], 40.00th=[ 8979], 50.00th=[11994], 60.00th=[14877], | 70.00th=[18744], 80.00th=[25822], 90.00th=[35390], 95.00th=[44827], | 99.00th=[57934], 99.50th=[69731], 99.90th=[82314], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 31, max= 504, per=28.30%, avg=105.84, stdev=88.56, samples=110 iops : min= 7, max= 126, avg=26.09, stdev=22.24, samples=110 write: IOPS=27, BW=111KiB/s (114kB/s)(6260KiB/56166msec); 0 zone resets clat (msec): min=3, max=691, avg=20.41, stdev=23.18 lat (msec): min=3, max=691, avg=20.41, stdev=23.18 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 51], | 99.00th=[ 75], 99.50th=[ 87], 99.90th=[ 128], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 32, max= 408, per=27.78%, avg=109.47, stdev=86.77, samples=110 iops : min= 8, max= 102, avg=27.00, stdev=21.81, samples=110 lat (msec) : 4=6.48%, 10=33.37%, 20=26.33%, 50=29.79%, 100=3.94% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.11%, sys=12.37%, ctx=5441, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=194678: Mon Sep 14 00:18:02 2026 read: IOPS=18, BW=71.0KiB/s (73.7kB/s)(3064KiB/42579msec) clat (msec): min=5, max=124, avg=23.40, stdev=15.25 lat (msec): min=5, max=124, avg=23.40, stdev=15.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 55], | 99.00th=[ 78], 99.50th=[ 79], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 32, max= 128, per=19.38%, avg=72.47, stdev=21.79, samples=83 iops : min= 8, max= 32, avg=17.67, stdev= 5.48, samples=83 write: IOPS=18, BW=75.8KiB/s (77.6kB/s)(3228KiB/42579msec); 0 zone resets clat (msec): min=7, max=698, avg=30.33, stdev=27.99 lat (msec): min=7, max=698, avg=30.34, stdev=27.99 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 42], 90.00th=[ 50], 95.00th=[ 58], | 99.00th=[ 81], 99.50th=[ 90], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 31, max= 127, per=19.32%, avg=76.13, stdev=19.38, samples=83 iops : min= 7, max= 31, avg=18.59, stdev= 4.85, samples=83 lat (msec) : 10=7.75%, 20=34.82%, 50=48.92%, 100=8.26%, 250=0.13% lat (msec) : 750=0.06% cpu : usr=0.06%, sys=10.72%, ctx=2593, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=767,807,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=374KiB/s (383kB/s), 71.0KiB/s-107KiB/s (73.7kB/s-110kB/s), io=20.5MiB (21.5MB), run=42579-56166msec WRITE: bw=394KiB/s (404kB/s), 75.8KiB/s-113KiB/s (77.6kB/s-116kB/s), io=21.6MiB (22.7MB), run=42579-56166msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194705: Mon Sep 14 00:18:20 2026 read: IOPS=28, BW=449KiB/s (460kB/s)(5920KiB/13180msec) clat (usec): min=70, max=67898, avg=17203.10, stdev=9414.53 lat (usec): min=70, max=67899, avg=17203.75, stdev=9414.52 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 172], 10.00th=[ 8160], 20.00th=[10421], | 30.00th=[11994], 40.00th=[14091], 50.00th=[16057], 60.00th=[18744], | 70.00th=[20579], 80.00th=[23462], 90.00th=[27919], 95.00th=[31851], | 99.00th=[46924], 99.50th=[63701], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 287, max= 736, per=24.73%, avg=449.27, stdev=110.41, samples=26 iops : min= 17, max= 46, avg=27.54, stdev= 7.06, samples=26 write: IOPS=30, BW=483KiB/s (495kB/s)(6368KiB/13180msec); 0 zone resets clat (usec): min=1008, max=78137, avg=16948.72, stdev=11249.24 lat (usec): min=1008, max=78139, avg=16949.81, stdev=11249.23 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 3818], 10.00th=[ 4621], 20.00th=[ 7046], | 30.00th=[ 9634], 40.00th=[11731], 50.00th=[13960], 60.00th=[17695], | 70.00th=[20841], 80.00th=[25560], 90.00th=[33424], 95.00th=[39060], | 99.00th=[46924], 99.50th=[51119], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 256, max= 702, per=25.24%, avg=482.35, stdev=124.05, samples=26 iops : min= 16, max= 43, avg=29.62, stdev= 7.66, samples=26 lat (usec) : 100=0.91%, 250=1.69% lat (msec) : 2=0.65%, 4=2.73%, 10=17.97%, 20=42.58%, 50=32.81% lat (msec) : 100=0.65% cpu : usr=0.08%, sys=27.30%, ctx=2728, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194706: Mon Sep 14 00:18:20 2026 read: IOPS=28, BW=450KiB/s (461kB/s)(5744KiB/12766msec) clat (usec): min=62, max=58214, avg=18213.75, stdev=9172.57 lat (usec): min=63, max=58214, avg=18214.41, stdev=9172.67 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 7111], 10.00th=[ 9110], 20.00th=[11338], | 30.00th=[13304], 40.00th=[15008], 50.00th=[17171], 60.00th=[19006], | 70.00th=[21103], 80.00th=[23987], 90.00th=[28967], 95.00th=[36963], | 99.00th=[50070], 99.50th=[54789], 99.90th=[58459], 99.95th=[58459], | 99.99th=[58459] bw ( KiB/s): min= 213, max= 606, per=24.78%, avg=450.28, stdev=106.83, samples=25 iops : min= 13, max= 37, avg=27.60, stdev= 6.65, samples=25 write: IOPS=32, BW=513KiB/s (525kB/s)(6544KiB/12766msec); 0 zone resets clat (usec): min=862, max=85811, avg=14999.78, stdev=11116.55 lat (usec): min=864, max=85812, avg=15000.88, stdev=11116.53 clat percentiles (usec): | 1.00th=[ 2040], 5.00th=[ 3654], 10.00th=[ 4228], 20.00th=[ 5407], | 30.00th=[ 7308], 40.00th=[10421], 50.00th=[12125], 60.00th=[15270], | 70.00th=[18482], 80.00th=[21890], 90.00th=[28967], 95.00th=[38536], | 99.00th=[48497], 99.50th=[53740], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 352, max= 862, per=26.84%, avg=512.88, stdev=120.69, samples=25 iops : min= 22, max= 53, avg=31.52, stdev= 7.48, samples=25 lat (usec) : 100=0.39%, 250=1.17%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.39%, 4=3.52%, 10=20.57%, 20=44.01%, 50=28.91% lat (msec) : 100=0.78% cpu : usr=0.09%, sys=28.15%, ctx=2718, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194707: Mon Sep 14 00:18:20 2026 read: IOPS=30, BW=488KiB/s (500kB/s)(6256KiB/12815msec) clat (usec): min=54, max=77592, avg=17326.50, stdev=10177.09 lat (usec): min=55, max=77592, avg=17327.16, stdev=10177.13 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 6128], 10.00th=[ 8356], 20.00th=[10421], | 30.00th=[12256], 40.00th=[14091], 50.00th=[15926], 60.00th=[17695], | 70.00th=[19530], 80.00th=[21627], 90.00th=[27657], 95.00th=[36963], | 99.00th=[54789], 99.50th=[74974], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 254, max= 704, per=26.99%, avg=490.32, stdev=120.72, samples=25 iops : min= 15, max= 44, avg=30.08, stdev= 7.62, samples=25 write: IOPS=29, BW=471KiB/s (482kB/s)(6032KiB/12815msec); 0 zone resets clat (usec): min=1092, max=69710, avg=15949.86, stdev=10715.83 lat (usec): min=1093, max=69711, avg=15951.25, stdev=10715.71 clat percentiles (usec): | 1.00th=[ 2671], 5.00th=[ 3752], 10.00th=[ 4490], 20.00th=[ 7111], | 30.00th=[ 9503], 40.00th=[10945], 50.00th=[12649], 60.00th=[15008], | 70.00th=[20055], 80.00th=[25035], 90.00th=[31589], 95.00th=[36963], | 99.00th=[45876], 99.50th=[50594], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 191, max= 734, per=24.38%, avg=465.92, stdev=127.48, samples=25 iops : min= 11, max= 45, avg=28.56, stdev= 8.03, samples=25 lat (usec) : 100=0.78%, 250=1.30% lat (msec) : 2=0.26%, 4=2.86%, 10=20.05%, 20=46.09%, 50=27.73% lat (msec) : 100=0.91% cpu : usr=0.07%, sys=27.31%, ctx=2671, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194708: Mon Sep 14 00:18:20 2026 read: IOPS=29, BW=479KiB/s (490kB/s)(6032KiB/12594msec) clat (usec): min=29, max=80865, avg=16715.03, stdev=9637.41 lat (usec): min=30, max=80866, avg=16720.60, stdev=9635.26 clat percentiles (usec): | 1.00th=[ 95], 5.00th=[ 147], 10.00th=[ 7963], 20.00th=[10421], | 30.00th=[11863], 40.00th=[13173], 50.00th=[15401], 60.00th=[17433], | 70.00th=[19530], 80.00th=[22414], 90.00th=[27395], 95.00th=[32637], | 99.00th=[48497], 99.50th=[61604], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 213, max= 638, per=26.32%, avg=478.25, stdev=105.45, samples=24 iops : min= 13, max= 39, avg=29.33, stdev= 6.52, samples=24 write: IOPS=31, BW=497KiB/s (509kB/s)(6256KiB/12594msec); 0 zone resets clat (usec): min=1017, max=61995, avg=15807.02, stdev=10879.66 lat (usec): min=1017, max=61997, avg=15808.07, stdev=10879.69 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 3458], 10.00th=[ 4113], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[11600], 50.00th=[13698], 60.00th=[16188], | 70.00th=[20317], 80.00th=[24773], 90.00th=[30540], 95.00th=[36439], | 99.00th=[51643], 99.50th=[56361], 99.90th=[62129], 99.95th=[62129], | 99.99th=[62129] bw ( KiB/s): min= 256, max= 766, per=26.11%, avg=499.04, stdev=126.12, samples=24 iops : min= 16, max= 47, avg=30.62, stdev= 7.90, samples=24 lat (usec) : 50=0.13%, 100=0.52%, 250=2.21%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.91%, 4=3.91%, 10=18.62%, 20=44.79%, 50=27.73% lat (msec) : 100=0.91% cpu : usr=0.11%, sys=27.75%, ctx=2549, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1817KiB/s (1861kB/s), 449KiB/s-488KiB/s (460kB/s-500kB/s), io=23.4MiB (24.5MB), run=12594-13180msec WRITE: bw=1912KiB/s (1958kB/s), 471KiB/s-513KiB/s (482kB/s-525kB/s), io=24.6MiB (25.8MB), run=12594-13180msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194700: Mon Sep 14 00:18:22 2026 read: IOPS=24, BW=399KiB/s (408kB/s)(5920KiB/14846msec) clat (usec): min=2214, max=87816, avg=17349.32, stdev=13620.24 lat (usec): min=2214, max=87817, avg=17349.95, stdev=13620.22 clat percentiles (usec): | 1.00th=[ 2507], 5.00th=[ 4424], 10.00th=[ 5342], 20.00th=[ 7111], | 30.00th=[ 8356], 40.00th=[10028], 50.00th=[12125], 60.00th=[14353], | 70.00th=[21103], 80.00th=[27657], 90.00th=[35914], 95.00th=[44303], | 99.00th=[62653], 99.50th=[69731], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 192, max= 1024, per=23.64%, avg=381.28, stdev=199.78, samples=29 iops : min= 12, max= 64, avg=23.38, stdev=12.60, samples=29 write: IOPS=26, BW=429KiB/s (439kB/s)(6368KiB/14846msec); 0 zone resets clat (usec): min=3936, max=77939, avg=21069.01, stdev=14236.22 lat (usec): min=3936, max=77941, avg=21070.33, stdev=14236.23 clat percentiles (usec): | 1.00th=[ 4424], 5.00th=[ 6456], 10.00th=[ 7963], 20.00th=[ 9503], | 30.00th=[11076], 40.00th=[13304], 50.00th=[16057], 60.00th=[20579], | 70.00th=[24511], 80.00th=[32375], 90.00th=[41681], 95.00th=[51119], | 99.00th=[65799], 99.50th=[68682], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 125, max= 1184, per=24.62%, avg=417.79, stdev=219.66, samples=29 iops : min= 7, max= 74, avg=25.66, stdev=13.90, samples=29 lat (msec) : 4=1.43%, 10=30.34%, 20=32.03%, 50=31.77%, 100=4.43% cpu : usr=0.05%, sys=11.91%, ctx=1346, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194701: Mon Sep 14 00:18:22 2026 read: IOPS=24, BW=391KiB/s (400kB/s)(5744KiB/14702msec) clat (msec): min=3, max=104, avg=16.79, stdev=12.86 lat (msec): min=3, max=104, avg=16.79, stdev=12.86 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 35], 95.00th=[ 44], | 99.00th=[ 56], 99.50th=[ 68], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 159, max= 928, per=24.11%, avg=388.83, stdev=176.69, samples=29 iops : min= 9, max= 58, avg=23.83, stdev=11.25, samples=29 write: IOPS=27, BW=445KiB/s (456kB/s)(6544KiB/14702msec); 0 zone resets clat (usec): min=5742, max=97157, avg=21124.94, stdev=13614.97 lat (usec): min=5744, max=97158, avg=21126.26, stdev=13614.98 clat percentiles (usec): | 1.00th=[ 6128], 5.00th=[ 7439], 10.00th=[ 8225], 20.00th=[10159], | 30.00th=[12125], 40.00th=[14484], 50.00th=[16581], 60.00th=[19792], | 70.00th=[23725], 80.00th=[32113], 90.00th=[41681], 95.00th=[49021], | 99.00th=[58983], 99.50th=[61080], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 224, max= 1280, per=26.18%, avg=444.34, stdev=241.24, samples=29 iops : min= 14, max= 80, avg=27.31, stdev=15.22, samples=29 lat (msec) : 4=0.26%, 10=28.78%, 20=38.80%, 50=28.78%, 100=3.26% lat (msec) : 250=0.13% cpu : usr=0.10%, sys=12.28%, ctx=1442, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194702: Mon Sep 14 00:18:22 2026 read: IOPS=26, BW=423KiB/s (433kB/s)(6256KiB/14805msec) clat (usec): min=3651, max=69934, avg=17149.25, stdev=12547.00 lat (usec): min=3652, max=69934, avg=17150.02, stdev=12546.95 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 4817], 10.00th=[ 5669], 20.00th=[ 7504], | 30.00th=[ 8586], 40.00th=[10028], 50.00th=[12256], 60.00th=[15139], | 70.00th=[20055], 80.00th=[26870], 90.00th=[36439], 95.00th=[42206], | 99.00th=[52691], 99.50th=[63177], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 253, max= 1344, per=25.90%, avg=417.76, stdev=236.29, samples=29 iops : min= 15, max= 84, avg=25.66, stdev=14.89, samples=29 write: IOPS=25, BW=407KiB/s (417kB/s)(6032KiB/14805msec); 0 zone resets clat (usec): min=4830, max=93046, avg=21428.42, stdev=13710.85 lat (usec): min=4831, max=93047, avg=21429.86, stdev=13710.82 clat percentiles (usec): | 1.00th=[ 5145], 5.00th=[ 6390], 10.00th=[ 7570], 20.00th=[ 9896], | 30.00th=[11338], 40.00th=[13960], 50.00th=[17433], 60.00th=[21103], | 70.00th=[26608], 80.00th=[32113], 90.00th=[42206], 95.00th=[47973], | 99.00th=[61604], 99.50th=[72877], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 992, per=23.39%, avg=396.90, stdev=200.16, samples=29 iops : min= 9, max= 62, avg=24.34, stdev=12.67, samples=29 lat (msec) : 4=0.39%, 10=30.08%, 20=32.68%, 50=33.85%, 100=2.99% cpu : usr=0.05%, sys=12.02%, ctx=1334, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194703: Mon Sep 14 00:18:22 2026 read: IOPS=25, BW=407KiB/s (417kB/s)(6032KiB/14804msec) clat (usec): min=3394, max=88111, avg=16057.85, stdev=12666.61 lat (usec): min=3395, max=88112, avg=16058.60, stdev=12666.62 clat percentiles (usec): | 1.00th=[ 3949], 5.00th=[ 5080], 10.00th=[ 5866], 20.00th=[ 7242], | 30.00th=[ 8455], 40.00th=[ 9765], 50.00th=[11469], 60.00th=[13829], | 70.00th=[17433], 80.00th=[23987], 90.00th=[32375], 95.00th=[43254], | 99.00th=[65799], 99.50th=[77071], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 159, max= 1056, per=24.66%, avg=397.76, stdev=228.30, samples=29 iops : min= 9, max= 66, avg=24.41, stdev=14.42, samples=29 write: IOPS=26, BW=423KiB/s (433kB/s)(6256KiB/14804msec); 0 zone resets clat (usec): min=4278, max=79116, avg=22252.59, stdev=14343.45 lat (usec): min=4279, max=79118, avg=22253.95, stdev=14343.46 clat percentiles (usec): | 1.00th=[ 5473], 5.00th=[ 6915], 10.00th=[ 8029], 20.00th=[10421], | 30.00th=[12125], 40.00th=[15008], 50.00th=[18482], 60.00th=[22152], | 70.00th=[27395], 80.00th=[32375], 90.00th=[40633], 95.00th=[52691], | 99.00th=[69731], 99.50th=[78119], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 221, max= 1120, per=24.57%, avg=417.00, stdev=195.61, samples=29 iops : min= 13, max= 70, avg=25.62, stdev=12.36, samples=29 lat (msec) : 4=0.52%, 10=29.17%, 20=35.03%, 50=30.86%, 100=4.43% cpu : usr=0.08%, sys=11.99%, ctx=1319, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1613KiB/s (1652kB/s), 391KiB/s-423KiB/s (400kB/s-433kB/s), io=23.4MiB (24.5MB), run=14702-14846msec WRITE: bw=1697KiB/s (1738kB/s), 407KiB/s-445KiB/s (417kB/s-456kB/s), io=24.6MiB (25.8MB), run=14702-14846msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194715: Mon Sep 14 00:18:31 2026 read: IOPS=2, BW=2067KiB/s (2117kB/s)(7168KiB/3467msec) clat (msec): min=108, max=797, avg=255.18, stdev=250.21 lat (msec): min=108, max=797, avg=255.18, stdev=250.21 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 115], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 131], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 317], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2043, max= 4096, per=56.56%, avg=2873.75, stdev=1009.04, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=1, BW=1477KiB/s (1512kB/s)(5120KiB/3467msec); 0 zone resets clat (msec): min=92, max=1059, avg=326.63, stdev=413.74 lat (msec): min=92, max=1059, avg=326.68, stdev=413.72 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 133], 60.00th=[ 133], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 3849, max= 4096, per=55.84%, avg=3972.50, stdev=174.66, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=39.93%, ctx=1394, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194716: Mon Sep 14 00:18:31 2026 read: IOPS=0, BW=508KiB/s (520kB/s)(2048KiB/4030msec) clat (usec): min=528, max=70453, avg=35490.91, stdev=49444.00 lat (usec): min=529, max=70454, avg=35492.18, stdev=49444.62 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 529], 60.00th=[70779], | 70.00th=[70779], 80.00th=[70779], 90.00th=[70779], 95.00th=[70779], | 99.00th=[70779], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 1651, max= 2043, per=36.35%, avg=1847.00, stdev=277.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2541KiB/s (2602kB/s)(10.0MiB/4030msec); 0 zone resets clat (msec): min=92, max=1310, avg=394.77, stdev=482.43 lat (msec): min=92, max=1310, avg=394.83, stdev=482.42 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 101], | 30.00th=[ 104], 40.00th=[ 130], 50.00th=[ 133], 60.00th=[ 153], | 70.00th=[ 169], 80.00th=[ 506], 90.00th=[ 1250], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1651, max= 6144, per=48.97%, avg=3483.50, stdev=2072.56, samples=4 iops : min= 1, max= 6, avg= 3.00, stdev= 2.45, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=25.00%, 250=41.67%, 750=8.33%, 2000=16.67% cpu : usr=0.02%, sys=29.76%, ctx=207, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194717: Mon Sep 14 00:18:31 2026 read: IOPS=1, BW=1561KiB/s (1598kB/s)(6144KiB/3937msec) clat (usec): min=477, max=1066.4k, avg=264848.45, stdev=397436.60 lat (usec): min=478, max=1066.4k, avg=264849.39, stdev=397436.55 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], | 20.00th=[ 95945], 30.00th=[ 95945], 40.00th=[ 116917], | 50.00th=[ 116917], 60.00th=[ 117965], 70.00th=[ 191890], | 80.00th=[ 191890], 90.00th=[1069548], 95.00th=[1069548], | 99.00th=[1069548], 99.50th=[1069548], 99.90th=[1069548], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 2048, max= 4096, per=67.18%, avg=3413.33, stdev=1182.41, samples=3 iops : min= 2, max= 4, avg= 3.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1561KiB/s (1598kB/s)(6144KiB/3937msec); 0 zone resets clat (msec): min=129, max=965, avg=386.30, stdev=305.39 lat (msec): min=129, max=965, avg=386.36, stdev=305.39 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 309], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1924, max= 3303, per=32.76%, avg=2330.75, stdev=650.80, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=30.36%, ctx=1095, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194718: Mon Sep 14 00:18:31 2026 read: IOPS=1, BW=1389KiB/s (1422kB/s)(5120KiB/3686msec) clat (usec): min=452, max=855809, avg=259337.38, stdev=350882.86 lat (usec): min=453, max=855810, avg=259338.34, stdev=350883.04 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 1696], 40.00th=[ 1696], 50.00th=[212861], 60.00th=[212861], | 70.00th=[225444], 80.00th=[225444], 90.00th=[859833], 95.00th=[859833], | 99.00th=[859833], 99.50th=[859833], 99.90th=[859833], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 1924, max= 4096, per=52.90%, avg=2687.67, stdev=1221.10, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1945KiB/s (1991kB/s)(7168KiB/3686msec); 0 zone resets clat (msec): min=144, max=1000, avg=337.75, stdev=307.03 lat (msec): min=144, max=1000, avg=337.80, stdev=307.03 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 161], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 215], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 426], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1648, max= 4096, per=41.34%, avg=2941.00, stdev=1338.43, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 250=58.33%, 500=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=39.62%, ctx=925, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5082KiB/s (5204kB/s), 508KiB/s-2067KiB/s (520kB/s-2117kB/s), io=20.0MiB (20.0MB), run=3467-4030msec WRITE: bw=7115KiB/s (7285kB/s), 1477KiB/s-2541KiB/s (1512kB/s-2602kB/s), io=28.0MiB (29.4MB), run=3467-4030msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194720: Mon Sep 14 00:18:32 2026 read: IOPS=1, BW=1928KiB/s (1975kB/s)(7168KiB/3717msec) clat (msec): min=50, max=775, avg=193.74, stdev=259.35 lat (msec): min=50, max=775, avg=193.74, stdev=259.35 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 52], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 140], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2048, max= 4096, per=59.82%, avg=2894.25, stdev=1019.37, samples=4 iops : min= 2, max= 4, avg= 2.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1377KiB/s (1411kB/s)(5120KiB/3717msec); 0 zone resets clat (msec): min=104, max=832, avg=461.94, stdev=342.71 lat (msec): min=104, max=832, avg=462.00, stdev=342.72 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2043, max= 4096, per=40.29%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 1000=25.00% cpu : usr=0.05%, sys=12.22%, ctx=134, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194721: Mon Sep 14 00:18:32 2026 read: IOPS=0, BW=488KiB/s (499kB/s)(2048KiB/4199msec) clat (msec): min=352, max=732, avg=542.43, stdev=268.16 lat (msec): min=352, max=732, avg=542.43, stdev=268.16 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1715, max= 2048, per=38.89%, avg=1881.50, stdev=235.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2439KiB/s (2497kB/s)(10.0MiB/4199msec); 0 zone resets clat (msec): min=37, max=1403, avg=306.95, stdev=446.14 lat (msec): min=37, max=1403, avg=307.02, stdev=446.14 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 70], | 30.00th=[ 72], 40.00th=[ 86], 50.00th=[ 93], 60.00th=[ 110], | 70.00th=[ 131], 80.00th=[ 275], 90.00th=[ 793], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 2043, max= 8192, per=80.61%, avg=5459.67, stdev=3131.10, samples=3 iops : min= 1, max= 8, avg= 5.00, stdev= 3.61, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.36%, ctx=101, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194722: Mon Sep 14 00:18:32 2026 read: IOPS=1, BW=1535KiB/s (1572kB/s)(6144KiB/4002msec) clat (msec): min=57, max=256, avg=129.74, stdev=73.08 lat (msec): min=57, max=256, avg=129.74, stdev=73.08 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 88], 50.00th=[ 88], 60.00th=[ 130], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 4063, max= 4096, per=84.32%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1535KiB/s (1572kB/s)(6144KiB/4002msec); 0 zone resets clat (msec): min=122, max=1217, avg=529.24, stdev=525.23 lat (msec): min=122, max=1217, avg=529.30, stdev=525.23 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 384], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 2031, max= 3436, per=36.99%, avg=2505.00, stdev=806.31, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 2000=16.67% cpu : usr=0.00%, sys=12.92%, ctx=495, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194723: Mon Sep 14 00:18:32 2026 read: IOPS=1, BW=1210KiB/s (1239kB/s)(5120KiB/4233msec) clat (msec): min=17, max=421, avg=189.04, stdev=170.47 lat (msec): min=17, max=421, avg=189.04, stdev=170.47 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 18], | 30.00th=[ 55], 40.00th=[ 55], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 4096, max= 4096, per=84.66%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1693KiB/s (1734kB/s)(7168KiB/4233msec); 0 zone resets clat (msec): min=28, max=1431, avg=460.95, stdev=586.00 lat (msec): min=28, max=1431, avg=461.02, stdev=586.01 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 29], 10.00th=[ 29], 20.00th=[ 51], | 30.00th=[ 54], 40.00th=[ 54], 50.00th=[ 62], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 1116], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 1700, max= 2048, per=28.89%, avg=1956.75, stdev=171.35, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 20=8.33%, 50=16.67%, 100=25.00%, 250=8.33%, 500=25.00% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=14.34%, ctx=289, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4838KiB/s (4954kB/s), 488KiB/s-1928KiB/s (499kB/s-1975kB/s), io=20.0MiB (20.0MB), run=3717-4233msec WRITE: bw=6773KiB/s (6936kB/s), 1377KiB/s-2439KiB/s (1411kB/s-2497kB/s), io=28.0MiB (29.4MB), run=3717-4233msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194730: Mon Sep 14 00:18:39 2026 read: IOPS=2, BW=9776KiB/s (10.0MB/s)(12.0MiB/1257msec) clat (msec): min=384, max=448, avg=412.64, stdev=32.45 lat (msec): min=384, max=448, avg=412.64, stdev=32.45 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 5728, max= 8192, per=59.39%, avg=6960.00, stdev=1742.31, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=62.82%, ctx=2752, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194732: Mon Sep 14 00:18:39 2026 read: IOPS=0, BW=2930KiB/s (3000kB/s)(4096KiB/1398msec) clat (nsec): min=426396k, max=426396k, avg=426395572.00, stdev= 0.00 lat (nsec): min=426398k, max=426398k, avg=426397981.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 5902, max= 5902, per=50.36%, avg=5902.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5860KiB/s (6000kB/s)(8192KiB/1398msec); 0 zone resets clat (msec): min=434, max=517, avg=476.00, stdev=58.91 lat (msec): min=434, max=517, avg=476.27, stdev=58.89 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 8192, max= 8192, per=45.05%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=12.53%, ctx=760, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194734: Mon Sep 14 00:18:39 2026 write: IOPS=1, BW=6819KiB/s (6983kB/s)(12.0MiB/1802msec); 0 zone resets clat (msec): min=83, max=1589, avg=594.76, stdev=861.85 lat (msec): min=84, max=1590, avg=595.06, stdev=861.89 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 111], 50.00th=[ 111], 60.00th=[ 111], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8192, max= 8192, per=45.05%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 250=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.99%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194736: Mon Sep 14 00:18:39 2026 write: IOPS=1, BW=7969KiB/s (8160kB/s)(12.0MiB/1542msec); 0 zone resets clat (msec): min=232, max=922, avg=504.89, stdev=367.52 lat (msec): min=233, max=923, avg=505.12, stdev=367.56 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min=11924, max=11924, per=65.57%, avg=11924.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.74%, ctx=232, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.4MiB/s (12.0MB/s), 2930KiB/s-9776KiB/s (3000kB/s-10.0MB/s), io=16.0MiB (16.8MB), run=1257-1398msec WRITE: bw=17.8MiB/s (18.6MB/s), 5860KiB/s-7969KiB/s (6000kB/s-8160kB/s), io=32.0MiB (33.6MB), run=1398-1802msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194729: Mon Sep 14 00:18:39 2026 read: IOPS=2, BW=9387KiB/s (9613kB/s)(12.0MiB/1309msec) clat (msec): min=362, max=523, avg=426.42, stdev=85.61 lat (msec): min=362, max=523, avg=426.43, stdev=85.62 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 5603, max= 8192, per=57.43%, avg=6897.50, stdev=1830.70, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=18.20%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194731: Mon Sep 14 00:18:39 2026 read: IOPS=0, BW=3003KiB/s (3075kB/s)(4096KiB/1364msec) clat (nsec): min=289430k, max=289430k, avg=289430488.00, stdev= 0.00 lat (nsec): min=289433k, max=289433k, avg=289432688.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 8000, max= 8000, per=66.61%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6006KiB/s (6150kB/s)(8192KiB/1364msec); 0 zone resets clat (msec): min=377, max=668, avg=523.07, stdev=206.20 lat (msec): min=377, max=669, avg=523.39, stdev=206.21 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8192, max= 8192, per=43.78%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=18.42%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194733: Mon Sep 14 00:18:39 2026 write: IOPS=1, BW=7148KiB/s (7320kB/s)(12.0MiB/1719msec); 0 zone resets clat (msec): min=118, max=1405, avg=564.44, stdev=729.12 lat (msec): min=118, max=1405, avg=564.65, stdev=729.04 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min=16384, max=16384, per=87.55%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.73%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194735: Mon Sep 14 00:18:39 2026 write: IOPS=1, BW=7018KiB/s (7186kB/s)(12.0MiB/1751msec); 0 zone resets clat (msec): min=146, max=1298, avg=572.55, stdev=631.49 lat (msec): min=146, max=1298, avg=573.38, stdev=631.05 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min=15906, max=15906, per=85.00%, avg=15906.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.97%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.7MiB/s (12.3MB/s), 3003KiB/s-9387KiB/s (3075kB/s-9613kB/s), io=16.0MiB (16.8MB), run=1309-1364msec WRITE: bw=18.3MiB/s (19.2MB/s), 6006KiB/s-7148KiB/s (6150kB/s-7320kB/s), io=32.0MiB (33.6MB), run=1364-1751msec