== sanity test 398b: DIO and buffer IO race ============== 10:13:52 (1781619232) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.6887 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151696: Tue Jun 16 10:16:19 2026 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(5992KiB/130098msec) clat (usec): min=36, max=375230, avg=42371.82, stdev=32820.01 lat (usec): min=36, max=375232, avg=42375.08, stdev=32819.54 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 11338], 20.00th=[ 20055], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 51119], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[158335], 99.50th=[193987], 99.90th=[287310], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 134, per=24.81%, avg=45.66, stdev=20.16, samples=256 iops : min= 1, max= 33, avg=10.76, stdev= 5.07, samples=256 write: IOPS=12, BW=48.4KiB/s (49.6kB/s)(6296KiB/130098msec); 0 zone resets clat (usec): min=1057, max=386101, avg=42197.33, stdev=41289.59 lat (usec): min=1057, max=386103, avg=42204.44, stdev=41286.53 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1647], 10.00th=[ 3032], 20.00th=[ 5866], | 30.00th=[ 10159], 40.00th=[ 21103], 50.00th=[ 32375], 60.00th=[ 42206], | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[120062], | 99.00th=[175113], 99.50th=[208667], 99.90th=[350225], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 143, per=24.80%, avg=47.87, stdev=21.23, samples=256 iops : min= 1, max= 35, avg=11.33, stdev= 5.36, samples=256 lat (usec) : 50=0.13%, 100=3.32%, 250=0.72%, 500=0.23%, 1000=0.10% lat (msec) : 2=3.39%, 4=3.91%, 10=8.20%, 20=9.73%, 50=37.24% lat (msec) : 100=26.20%, 250=6.64%, 500=0.20% cpu : usr=0.07%, sys=5.87%, ctx=7101, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151697: Tue Jun 16 10:16:19 2026 read: IOPS=11, BW=46.5KiB/s (47.6kB/s)(5940KiB/127730msec) clat (usec): min=32, max=386052, avg=41908.69, stdev=32476.39 lat (usec): min=32, max=386059, avg=41912.21, stdev=32477.81 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 71], 10.00th=[ 594], 20.00th=[ 19792], | 30.00th=[ 24773], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 50594], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[175113], 99.90th=[358613], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 124, per=25.17%, avg=46.32, stdev=20.11, samples=250 iops : min= 1, max= 31, avg=10.93, stdev= 5.06, samples=250 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6348KiB/127730msec); 0 zone resets clat (usec): min=1171, max=382287, avg=41150.49, stdev=42035.10 lat (usec): min=1172, max=382288, avg=41152.69, stdev=42035.24 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1745], 10.00th=[ 2966], 20.00th=[ 5604], | 30.00th=[ 10290], 40.00th=[ 20579], 50.00th=[ 31065], 60.00th=[ 42206], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[181404], 99.50th=[229639], 99.90th=[341836], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=49.01, stdev=20.82, samples=252 iops : min= 1, max= 29, avg=11.60, stdev= 5.23, samples=252 lat (usec) : 50=0.33%, 100=3.74%, 250=0.62%, 500=0.13%, 750=0.03% lat (msec) : 2=3.22%, 4=4.69%, 10=7.75%, 20=9.73%, 50=38.31% lat (msec) : 100=25.29%, 250=5.89%, 500=0.26% cpu : usr=0.07%, sys=6.13%, ctx=7081, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151698: Tue Jun 16 10:16:19 2026 read: IOPS=11, BW=47.4KiB/s (48.5kB/s)(6028KiB/127223msec) clat (usec): min=35, max=238612, avg=42496.65, stdev=30196.05 lat (usec): min=35, max=238613, avg=42506.36, stdev=30197.22 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 67], 10.00th=[ 10421], 20.00th=[ 20055], | 30.00th=[ 25560], 40.00th=[ 31065], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[133694], 99.50th=[168821], 99.90th=[231736], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 119, per=25.60%, avg=47.10, stdev=19.49, samples=250 iops : min= 1, max= 29, avg=11.13, stdev= 4.90, samples=250 write: IOPS=12, BW=49.2KiB/s (50.4kB/s)(6260KiB/127223msec); 0 zone resets clat (usec): min=1179, max=335072, avg=40240.49, stdev=40513.17 lat (usec): min=1180, max=335074, avg=40247.32, stdev=40510.56 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1631], 10.00th=[ 2638], 20.00th=[ 5604], | 30.00th=[ 10421], 40.00th=[ 20579], 50.00th=[ 30802], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[179307], 99.50th=[221250], 99.90th=[325059], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 95, per=25.21%, avg=48.65, stdev=19.76, samples=251 iops : min= 1, max= 23, avg=11.52, stdev= 5.01, samples=251 lat (usec) : 50=0.39%, 100=3.26%, 250=0.72%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=3.78%, 4=3.91%, 10=7.52%, 20=9.96%, 50=38.31% lat (msec) : 100=26.01%, 250=5.76%, 500=0.13% cpu : usr=0.08%, sys=5.90%, ctx=6958, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151699: Tue Jun 16 10:16:19 2026 read: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6052KiB/128559msec) clat (usec): min=33, max=248252, avg=41208.00, stdev=30864.87 lat (usec): min=33, max=248253, avg=41211.64, stdev=30864.67 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 212], 20.00th=[ 19530], | 30.00th=[ 24773], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 60556], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[147850], 99.50th=[173016], 99.90th=[233833], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 119, per=25.52%, avg=46.95, stdev=20.02, samples=252 iops : min= 1, max= 29, avg=11.08, stdev= 5.04, samples=252 write: IOPS=12, BW=48.5KiB/s (49.7kB/s)(6236KiB/128559msec); 0 zone resets clat (usec): min=1138, max=337625, avg=42319.55, stdev=42205.70 lat (usec): min=1139, max=337627, avg=42324.00, stdev=42203.59 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1762], 10.00th=[ 2835], 20.00th=[ 5604], | 30.00th=[ 11076], 40.00th=[ 21365], 50.00th=[ 31589], 60.00th=[ 41681], | 70.00th=[ 54789], 80.00th=[ 71828], 90.00th=[ 95945], 95.00th=[125305], | 99.00th=[185598], 99.50th=[204473], 99.90th=[250610], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 111, per=24.93%, avg=48.12, stdev=19.96, samples=253 iops : min= 1, max= 27, avg=11.38, stdev= 5.04, samples=253 lat (usec) : 50=0.59%, 100=3.35%, 250=1.07%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=3.29%, 4=4.59%, 10=7.32%, 20=9.70%, 50=38.31% lat (msec) : 100=24.77%, 250=6.74%, 500=0.07% cpu : usr=0.10%, sys=5.99%, ctx=7093, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=185KiB/s (189kB/s), 46.1KiB/s-47.4KiB/s (47.2kB/s-48.5kB/s), io=23.4MiB (24.6MB), run=127223-130098msec WRITE: bw=193KiB/s (198kB/s), 48.4KiB/s-49.7KiB/s (49.6kB/s-50.9kB/s), io=24.6MiB (25.7MB), run=127223-130098msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151691: Tue Jun 16 10:18:07 2026 read: IOPS=6, BW=25.2KiB/s (25.8kB/s)(5992KiB/237542msec) clat (msec): min=6, max=787, avg=34.05, stdev=40.38 lat (msec): min=6, max=787, avg=34.05, stdev=40.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 50], 90.00th=[ 78], 95.00th=[ 102], | 99.00th=[ 165], 99.50th=[ 197], 99.90th=[ 418], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 87, per=27.79%, avg=27.79, stdev=18.20, samples=417 iops : min= 1, max= 21, avg= 6.31, stdev= 4.60, samples=417 write: IOPS=6, BW=26.5KiB/s (27.1kB/s)(6296KiB/237542msec); 0 zone resets clat (msec): min=35, max=603, avg=118.24, stdev=64.25 lat (msec): min=35, max=603, avg=118.24, stdev=64.25 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 80], 40.00th=[ 89], 50.00th=[ 100], 60.00th=[ 112], | 70.00th=[ 130], 80.00th=[ 161], 90.00th=[ 199], 95.00th=[ 241], | 99.00th=[ 363], 99.50th=[ 422], 99.90th=[ 550], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 56, per=25.01%, avg=26.26, stdev=12.99, samples=462 iops : min= 1, max= 14, avg= 5.92, stdev= 3.32, samples=462 lat (msec) : 10=3.52%, 20=20.67%, 50=16.31%, 100=31.80%, 250=25.46% lat (msec) : 500=2.12%, 750=0.10%, 1000=0.03% cpu : usr=0.06%, sys=1.66%, ctx=5294, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151692: Tue Jun 16 10:18:07 2026 read: IOPS=6, BW=24.9KiB/s (25.5kB/s)(5940KiB/238285msec) clat (msec): min=5, max=722, avg=34.43, stdev=41.61 lat (msec): min=5, max=722, avg=34.43, stdev=41.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 49], 90.00th=[ 78], 95.00th=[ 106], | 99.00th=[ 194], 99.50th=[ 243], 99.90th=[ 388], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 96, per=27.28%, avg=27.28, stdev=19.32, samples=421 iops : min= 1, max= 24, avg= 6.19, stdev= 4.87, samples=421 write: IOPS=6, BW=26.6KiB/s (27.3kB/s)(6348KiB/238285msec); 0 zone resets clat (msec): min=36, max=603, avg=117.66, stdev=63.20 lat (msec): min=36, max=603, avg=117.66, stdev=63.20 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 80], 40.00th=[ 88], 50.00th=[ 99], 60.00th=[ 111], | 70.00th=[ 132], 80.00th=[ 159], 90.00th=[ 203], 95.00th=[ 239], | 99.00th=[ 334], 99.50th=[ 418], 99.90th=[ 472], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 64, per=25.13%, avg=26.39, stdev=13.45, samples=465 iops : min= 1, max= 16, avg= 5.95, stdev= 3.45, samples=465 lat (msec) : 10=3.94%, 20=20.08%, 50=16.34%, 100=32.03%, 250=25.23% lat (msec) : 500=2.31%, 750=0.07% cpu : usr=0.06%, sys=1.66%, ctx=5430, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151693: Tue Jun 16 10:18:07 2026 read: IOPS=6, BW=25.4KiB/s (25.0kB/s)(6028KiB/237509msec) clat (msec): min=5, max=340, avg=34.53, stdev=35.07 lat (msec): min=5, max=340, avg=34.53, stdev=35.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 105], | 99.00th=[ 171], 99.50th=[ 186], 99.90th=[ 300], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 119, per=27.00%, avg=27.00, stdev=18.62, samples=432 iops : min= 1, max= 29, avg= 6.12, stdev= 4.72, samples=432 write: IOPS=6, BW=26.4KiB/s (26.0kB/s)(6260KiB/237509msec); 0 zone resets clat (msec): min=34, max=829, avg=118.23, stdev=65.19 lat (msec): min=34, max=829, avg=118.23, stdev=65.19 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 70], | 30.00th=[ 81], 40.00th=[ 90], 50.00th=[ 102], 60.00th=[ 113], | 70.00th=[ 131], 80.00th=[ 157], 90.00th=[ 199], 95.00th=[ 239], | 99.00th=[ 334], 99.50th=[ 401], 99.90th=[ 642], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 64, per=24.84%, avg=26.08, stdev=13.24, samples=463 iops : min= 1, max= 16, avg= 5.88, stdev= 3.39, samples=463 lat (msec) : 10=3.78%, 20=20.02%, 50=16.99%, 100=30.53%, 250=26.46% lat (msec) : 500=2.12%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=5256, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151694: Tue Jun 16 10:18:07 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6052KiB/236699msec) clat (msec): min=5, max=436, avg=34.31, stdev=38.17 lat (msec): min=5, max=436, avg=34.31, stdev=38.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 32], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 107], | 99.00th=[ 178], 99.50th=[ 249], 99.90th=[ 393], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 110, per=27.87%, avg=27.87, stdev=19.14, samples=421 iops : min= 1, max= 27, avg= 6.34, stdev= 4.84, samples=421 write: IOPS=6, BW=26.3KiB/s (26.0kB/s)(6236KiB/236699msec); 0 zone resets clat (msec): min=34, max=837, avg=118.26, stdev=63.97 lat (msec): min=34, max=837, avg=118.26, stdev=63.97 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 101], 60.00th=[ 113], | 70.00th=[ 132], 80.00th=[ 159], 90.00th=[ 201], 95.00th=[ 243], | 99.00th=[ 321], 99.50th=[ 397], 99.90th=[ 558], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 64, per=24.81%, avg=26.05, stdev=13.18, samples=463 iops : min= 1, max= 16, avg= 5.87, stdev= 3.37, samples=463 lat (msec) : 10=3.84%, 20=20.48%, 50=17.22%, 100=30.11%, 250=25.85% lat (msec) : 500=2.41%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.61%, ctx=5296, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=101KiB/s (103kB/s), 24.9KiB/s-25.6KiB/s (25.5kB/s-26.2kB/s), io=23.4MiB (24.6MB), run=236699-238285msec WRITE: bw=106KiB/s (108kB/s), 26.3KiB/s-26.6KiB/s (26.0kB/s-27.3kB/s), io=24.6MiB (25.7MB), run=236699-238285msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151749: Tue Jun 16 10:18:35 2026 read: IOPS=18, BW=288KiB/s (295kB/s)(5920KiB/20526msec) clat (usec): min=34, max=230282, avg=27192.75, stdev=23951.92 lat (usec): min=34, max=230283, avg=27195.08, stdev=23952.01 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 89], 20.00th=[ 243], | 30.00th=[ 17433], 40.00th=[ 21103], 50.00th=[ 25297], 60.00th=[ 28181], | 70.00th=[ 34866], 80.00th=[ 41681], 90.00th=[ 53740], 95.00th=[ 63177], | 99.00th=[ 96994], 99.50th=[173016], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 95, max= 512, per=24.27%, avg=282.98, stdev=95.01, samples=40 iops : min= 5, max= 32, avg=17.00, stdev= 5.97, samples=40 write: IOPS=19, BW=310KiB/s (318kB/s)(6368KiB/20526msec); 0 zone resets clat (usec): min=1412, max=209174, avg=26117.43, stdev=27488.25 lat (usec): min=1413, max=209178, avg=26119.73, stdev=27488.34 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2180], 10.00th=[ 3621], 20.00th=[ 5473], | 30.00th=[ 7439], 40.00th=[ 10683], 50.00th=[ 16909], 60.00th=[ 24249], | 70.00th=[ 32375], 80.00th=[ 44303], 90.00th=[ 61080], 95.00th=[ 76022], | 99.00th=[147850], 99.50th=[181404], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 149, max= 608, per=25.01%, avg=306.90, stdev=91.33, samples=40 iops : min= 9, max= 38, avg=18.50, stdev= 5.75, samples=40 lat (usec) : 50=0.52%, 100=5.08%, 250=4.04%, 500=0.26%, 750=0.39% lat (msec) : 2=1.56%, 4=4.82%, 10=14.19%, 20=15.23%, 50=39.58% lat (msec) : 100=12.76%, 250=1.56% cpu : usr=0.13%, sys=11.93%, ctx=1824, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151750: Tue Jun 16 10:18:35 2026 read: IOPS=17, BW=284KiB/s (291kB/s)(5744KiB/20212msec) clat (usec): min=52, max=132104, avg=30215.78, stdev=22180.08 lat (usec): min=52, max=132106, avg=30221.26, stdev=22183.32 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 90], 10.00th=[ 141], 20.00th=[ 14877], | 30.00th=[ 19792], 40.00th=[ 23987], 50.00th=[ 27395], 60.00th=[ 32637], | 70.00th=[ 38536], 80.00th=[ 44827], 90.00th=[ 52167], 95.00th=[ 63701], | 99.00th=[122160], 99.50th=[127402], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 95, max= 447, per=24.39%, avg=284.43, stdev=85.33, samples=40 iops : min= 5, max= 27, avg=17.10, stdev= 5.38, samples=40 write: IOPS=20, BW=324KiB/s (332kB/s)(6544KiB/20212msec); 0 zone resets clat (usec): min=1650, max=162920, avg=22547.02, stdev=21986.96 lat (usec): min=1652, max=162922, avg=22549.35, stdev=21986.94 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 2442], 10.00th=[ 3195], 20.00th=[ 4621], | 30.00th=[ 6849], 40.00th=[ 9503], 50.00th=[ 13698], 60.00th=[ 20055], | 70.00th=[ 28967], 80.00th=[ 41681], 90.00th=[ 56886], 95.00th=[ 63177], | 99.00th=[ 88605], 99.50th=[ 92799], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 157, max= 512, per=26.27%, avg=322.35, stdev=97.23, samples=40 iops : min= 9, max= 32, avg=19.47, stdev= 6.24, samples=40 lat (usec) : 100=2.99%, 250=3.12%, 500=0.52%, 750=0.26% lat (msec) : 2=0.78%, 4=7.29%, 10=14.19%, 20=17.19%, 50=40.10% lat (msec) : 100=12.63%, 250=0.91% cpu : usr=0.14%, sys=12.23%, ctx=1892, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151751: Tue Jun 16 10:18:35 2026 read: IOPS=20, BW=326KiB/s (334kB/s)(6256KiB/19177msec) clat (usec): min=37, max=134666, avg=28181.83, stdev=20917.74 lat (usec): min=37, max=134668, avg=28185.00, stdev=20918.04 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 63], 10.00th=[ 99], 20.00th=[ 12911], | 30.00th=[ 18220], 40.00th=[ 22676], 50.00th=[ 27919], 60.00th=[ 31065], | 70.00th=[ 36963], 80.00th=[ 41681], 90.00th=[ 51643], 95.00th=[ 61604], | 99.00th=[103285], 99.50th=[125305], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 159, max= 606, per=27.91%, avg=325.49, stdev=114.24, samples=37 iops : min= 9, max= 37, avg=19.65, stdev= 7.17, samples=37 write: IOPS=19, BW=315KiB/s (322kB/s)(6032KiB/19177msec); 0 zone resets clat (usec): min=1743, max=124422, avg=21268.47, stdev=21407.01 lat (usec): min=1745, max=124423, avg=21271.12, stdev=21407.02 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2343], 10.00th=[ 3097], 20.00th=[ 4752], | 30.00th=[ 6259], 40.00th=[ 8356], 50.00th=[ 12125], 60.00th=[ 19006], | 70.00th=[ 25560], 80.00th=[ 38011], 90.00th=[ 52691], 95.00th=[ 66847], | 99.00th=[ 91751], 99.50th=[115868], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 94, max= 508, per=25.19%, avg=309.11, stdev=98.49, samples=37 iops : min= 5, max= 31, avg=18.62, stdev= 6.10, samples=37 lat (usec) : 50=0.65%, 100=4.69%, 250=3.39%, 500=0.26%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=7.29%, 10=14.32%, 20=15.49%, 50=41.28% lat (msec) : 100=10.29%, 250=1.04% cpu : usr=0.11%, sys=12.49%, ctx=1744, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151752: Tue Jun 16 10:18:35 2026 read: IOPS=19, BW=312KiB/s (319kB/s)(6032KiB/19351msec) clat (usec): min=25, max=253335, avg=27517.59, stdev=25397.12 lat (usec): min=25, max=253336, avg=27519.06, stdev=25397.07 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 61], 10.00th=[ 77], 20.00th=[ 155], | 30.00th=[ 16909], 40.00th=[ 20841], 50.00th=[ 24773], 60.00th=[ 30278], | 70.00th=[ 35914], 80.00th=[ 42206], 90.00th=[ 52167], 95.00th=[ 69731], | 99.00th=[121111], 99.50th=[126354], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 119, max= 640, per=26.62%, avg=310.39, stdev=109.16, samples=38 iops : min= 7, max= 40, avg=18.71, stdev= 6.88, samples=38 write: IOPS=20, BW=323KiB/s (331kB/s)(6256KiB/19351msec); 0 zone resets clat (usec): min=1648, max=113893, avg=22671.60, stdev=21747.61 lat (usec): min=1650, max=113895, avg=22682.55, stdev=21744.34 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2376], 10.00th=[ 3261], 20.00th=[ 4948], | 30.00th=[ 6915], 40.00th=[ 9503], 50.00th=[ 14615], 60.00th=[ 21890], | 70.00th=[ 28705], 80.00th=[ 37487], 90.00th=[ 55313], 95.00th=[ 68682], | 99.00th=[ 92799], 99.50th=[101188], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 127, max= 544, per=26.44%, avg=324.45, stdev=94.34, samples=38 iops : min= 7, max= 34, avg=19.61, stdev= 5.99, samples=38 lat (usec) : 50=0.65%, 100=6.38%, 250=3.65%, 500=0.65%, 750=0.13% lat (msec) : 2=1.69%, 4=5.34%, 10=14.32%, 20=15.23%, 50=39.84% lat (msec) : 100=10.94%, 250=1.04%, 500=0.13% cpu : usr=0.11%, sys=12.05%, ctx=1707, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1167KiB/s (1195kB/s), 284KiB/s-326KiB/s (291kB/s-334kB/s), io=23.4MiB (24.5MB), run=19177-20526msec WRITE: bw=1228KiB/s (1257kB/s), 310KiB/s-324KiB/s (318kB/s-332kB/s), io=24.6MiB (25.8MB), run=19177-20526msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151754: Tue Jun 16 10:19:00 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(5920KiB/45340msec) clat (msec): min=7, max=273, avg=29.06, stdev=30.20 lat (msec): min=7, max=273, avg=29.06, stdev=30.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 53], 95.00th=[ 84], | 99.00th=[ 163], 99.50th=[ 249], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 447, per=25.55%, avg=134.90, stdev=79.59, samples=87 iops : min= 1, max= 27, avg= 7.71, stdev= 5.00, samples=87 write: IOPS=8, BW=140KiB/s (144kB/s)(6368KiB/45340msec); 0 zone resets clat (msec): min=30, max=372, avg=86.73, stdev=38.23 lat (msec): min=30, max=372, avg=86.76, stdev=38.26 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 58], | 30.00th=[ 66], 40.00th=[ 72], 50.00th=[ 79], 60.00th=[ 83], | 70.00th=[ 94], 80.00th=[ 110], 90.00th=[ 133], 95.00th=[ 159], | 99.00th=[ 251], 99.50th=[ 262], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 254, per=25.23%, avg=140.01, stdev=57.85, samples=90 iops : min= 1, max= 15, avg= 8.04, stdev= 3.70, samples=90 lat (msec) : 10=4.69%, 20=19.27%, 50=23.18%, 100=38.02%, 250=14.19% lat (msec) : 500=0.65% cpu : usr=0.08%, sys=2.74%, ctx=1557, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151755: Tue Jun 16 10:19:00 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5744KiB/45349msec) clat (msec): min=6, max=191, avg=27.42, stdev=25.79 lat (msec): min=6, max=191, avg=27.43, stdev=25.79 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 59], 95.00th=[ 85], | 99.00th=[ 129], 99.50th=[ 150], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 21, max= 350, per=24.49%, avg=129.31, stdev=80.63, samples=87 iops : min= 1, max= 21, avg= 7.33, stdev= 5.03, samples=87 write: IOPS=9, BW=144KiB/s (148kB/s)(6544KiB/45349msec); 0 zone resets clat (msec): min=36, max=376, avg=86.69, stdev=39.41 lat (msec): min=36, max=376, avg=86.69, stdev=39.41 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 45], 10.00th=[ 51], 20.00th=[ 58], | 30.00th=[ 65], 40.00th=[ 72], 50.00th=[ 79], 60.00th=[ 85], | 70.00th=[ 92], 80.00th=[ 109], 90.00th=[ 134], 95.00th=[ 155], | 99.00th=[ 220], 99.50th=[ 232], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 287, per=25.95%, avg=144.01, stdev=57.82, samples=89 iops : min= 1, max= 17, avg= 8.26, stdev= 3.70, samples=89 lat (msec) : 10=4.43%, 20=20.96%, 50=20.96%, 100=38.93%, 250=14.58% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.76%, ctx=1489, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151756: Tue Jun 16 10:19:00 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(6256KiB/44355msec) clat (msec): min=6, max=251, avg=26.20, stdev=25.10 lat (msec): min=6, max=251, avg=26.20, stdev=25.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 37], 90.00th=[ 50], 95.00th=[ 72], | 99.00th=[ 123], 99.50th=[ 167], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 510, per=28.33%, avg=149.59, stdev=96.91, samples=83 iops : min= 1, max= 31, avg= 8.65, stdev= 6.06, samples=83 write: IOPS=8, BW=136KiB/s (139kB/s)(6032KiB/44355msec); 0 zone resets clat (msec): min=28, max=324, avg=90.35, stdev=43.33 lat (msec): min=28, max=324, avg=90.35, stdev=43.33 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 60], | 30.00th=[ 65], 40.00th=[ 69], 50.00th=[ 78], 60.00th=[ 89], | 70.00th=[ 99], 80.00th=[ 114], 90.00th=[ 153], 95.00th=[ 182], | 99.00th=[ 253], 99.50th=[ 275], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 256, per=24.43%, avg=135.61, stdev=57.51, samples=88 iops : min= 1, max= 16, avg= 7.77, stdev= 3.64, samples=88 lat (msec) : 10=6.25%, 20=23.31%, 50=20.18%, 100=35.29%, 250=14.32% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=2.94%, ctx=1571, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151757: Tue Jun 16 10:19:00 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(6032KiB/44506msec) clat (msec): min=6, max=159, avg=28.28, stdev=24.39 lat (msec): min=6, max=159, avg=28.28, stdev=24.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 54], 95.00th=[ 81], | 99.00th=[ 155], 99.50th=[ 157], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 31, max= 415, per=25.69%, avg=135.65, stdev=79.10, samples=86 iops : min= 1, max= 25, avg= 7.74, stdev= 5.06, samples=86 write: IOPS=8, BW=141KiB/s (144kB/s)(6256KiB/44506msec); 0 zone resets clat (msec): min=33, max=230, avg=86.45, stdev=36.10 lat (msec): min=33, max=230, avg=86.45, stdev=36.10 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 58], | 30.00th=[ 66], 40.00th=[ 72], 50.00th=[ 77], 60.00th=[ 84], | 70.00th=[ 92], 80.00th=[ 110], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 203], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 255, per=25.30%, avg=140.43, stdev=56.19, samples=87 iops : min= 1, max= 15, avg= 8.03, stdev= 3.59, samples=87 lat (msec) : 10=3.65%, 20=19.79%, 50=25.00%, 100=37.37%, 250=14.19% cpu : usr=0.08%, sys=2.77%, ctx=1507, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=528KiB/s (541kB/s), 127KiB/s-141KiB/s (130kB/s-144kB/s), io=23.4MiB (24.5MB), run=44355-45349msec WRITE: bw=556KiB/s (569kB/s), 136KiB/s-144KiB/s (139kB/s-148kB/s), io=24.6MiB (25.8MB), run=44355-45349msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151775: Tue Jun 16 10:19:12 2026 read: IOPS=2, BW=2362KiB/s (2418kB/s)(7168KiB/3035msec) clat (usec): min=1632, max=328626, avg=169292.07, stdev=103526.72 lat (usec): min=1633, max=328627, avg=169293.47, stdev=103526.77 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1631], 10.00th=[ 1631], 20.00th=[ 96994], | 30.00th=[164627], 40.00th=[164627], 50.00th=[166724], 60.00th=[185598], | 70.00th=[185598], 80.00th=[242222], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 2043, max= 4087, per=71.76%, avg=3395.00, stdev=1170.98, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1687KiB/s (1727kB/s)(5120KiB/3035msec); 0 zone resets clat (msec): min=137, max=459, avg=285.46, stdev=126.01 lat (msec): min=137, max=459, avg=285.54, stdev=126.01 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1899, max= 2043, per=29.76%, avg=1971.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2=8.33%, 100=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=23.47%, ctx=272, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151776: Tue Jun 16 10:19:12 2026 read: IOPS=0, BW=473KiB/s (485kB/s)(2048KiB/4328msec) clat (usec): min=575, max=267777, avg=134176.60, stdev=188940.49 lat (usec): min=576, max=267780, avg=134178.51, stdev=188941.55 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 578], 60.00th=[267387], | 70.00th=[267387], 80.00th=[267387], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 2027, max= 2039, per=42.97%, avg=2033.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2366KiB/s (2423kB/s)(10.0MiB/4328msec); 0 zone resets clat (msec): min=131, max=951, avg=370.29, stdev=251.85 lat (msec): min=131, max=951, avg=370.36, stdev=251.85 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 203], | 30.00th=[ 207], 40.00th=[ 220], 50.00th=[ 262], 60.00th=[ 284], | 70.00th=[ 317], 80.00th=[ 542], 90.00th=[ 584], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2027, max= 4087, per=41.01%, avg=2716.50, stdev=1049.26, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=19.64%, ctx=168, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151777: Tue Jun 16 10:19:12 2026 read: IOPS=1, BW=1507KiB/s (1543kB/s)(6144KiB/4077msec) clat (msec): min=71, max=251, avg=158.81, stdev=69.50 lat (msec): min=71, max=251, avg=158.81, stdev=69.50 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 1899, max= 4079, per=53.21%, avg=2517.25, stdev=1043.46, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1507KiB/s (1543kB/s)(6144KiB/4077msec); 0 zone resets clat (msec): min=131, max=765, avg=465.95, stdev=265.53 lat (msec): min=131, max=765, avg=466.01, stdev=265.54 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 617], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2039, max= 4055, per=38.44%, avg=2546.25, stdev=1005.84, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=18.57%, ctx=347, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151778: Tue Jun 16 10:19:12 2026 read: IOPS=1, BW=1778KiB/s (1820kB/s)(5120KiB/2880msec) clat (usec): min=790, max=257974, avg=156699.31, stdev=96492.93 lat (usec): min=791, max=257975, avg=156700.22, stdev=96493.00 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 791], | 30.00th=[152044], 40.00th=[152044], 50.00th=[166724], 60.00th=[166724], | 70.00th=[206570], 80.00th=[206570], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 4087, max= 4087, per=86.39%, avg=4087.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2489KiB/s (2549kB/s)(7168KiB/2880msec); 0 zone resets clat (msec): min=128, max=479, avg=294.77, stdev=147.59 lat (msec): min=128, max=479, avg=294.84, stdev=147.59 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 138], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 342], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 439], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1899, max= 3938, per=36.08%, avg=2390.00, stdev=867.46, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=41.67% cpu : usr=0.07%, sys=23.48%, ctx=150, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4732KiB/s (4846kB/s), 473KiB/s-2362KiB/s (485kB/s-2418kB/s), io=20.0MiB (20.0MB), run=2880-4328msec WRITE: bw=6625KiB/s (6784kB/s), 1507KiB/s-2489KiB/s (1543kB/s-2549kB/s), io=28.0MiB (29.4MB), run=2880-4328msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151770: Tue Jun 16 10:19:12 2026 read: IOPS=2, BW=2593KiB/s (2656kB/s)(7168KiB/2764msec) clat (msec): min=73, max=596, avg=212.08, stdev=184.97 lat (msec): min=73, max=596, avg=212.08, stdev=184.97 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 120], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 259], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2039, max= 5763, per=83.07%, avg=3944.33, stdev=1863.51, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1852KiB/s (1897kB/s)(5120KiB/2764msec); 0 zone resets clat (msec): min=228, max=277, avg=251.58, stdev=21.81 lat (msec): min=228, max=277, avg=251.65, stdev=21.82 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 2043, max= 4079, per=51.16%, avg=3400.33, stdev=1175.49, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=11.07%, ctx=105, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151771: Tue Jun 16 10:19:12 2026 read: IOPS=0, BW=475KiB/s (486kB/s)(2048KiB/4313msec) clat (msec): min=80, max=181, avg=131.09, stdev=71.76 lat (msec): min=80, max=181, avg=131.09, stdev=71.75 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 81], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1965, max= 2039, per=42.17%, avg=2002.00, stdev=52.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2374KiB/s (2431kB/s)(10.0MiB/4313msec); 0 zone resets clat (msec): min=198, max=1019, avg=395.62, stdev=248.45 lat (msec): min=198, max=1019, avg=395.74, stdev=248.42 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 201], | 30.00th=[ 211], 40.00th=[ 251], 50.00th=[ 288], 60.00th=[ 363], | 70.00th=[ 443], 80.00th=[ 468], 90.00th=[ 514], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1965, max= 4063, per=45.60%, avg=3031.33, stdev=1113.00, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.58%, ctx=133, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151772: Tue Jun 16 10:19:12 2026 read: IOPS=1, BW=1587KiB/s (1625kB/s)(6144KiB/3872msec) clat (msec): min=124, max=219, avg=180.07, stdev=34.87 lat (msec): min=124, max=219, avg=180.07, stdev=34.87 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 197], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 2031, max= 4079, per=53.64%, avg=2547.00, stdev=1021.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1587KiB/s (1625kB/s)(6144KiB/3872msec); 0 zone resets clat (msec): min=320, max=572, avg=434.20, stdev=87.11 lat (msec): min=320, max=572, avg=434.28, stdev=87.10 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 443], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2015, max= 4087, per=38.29%, avg=2545.00, stdev=1028.06, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=6.12%, ctx=110, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151773: Tue Jun 16 10:19:12 2026 read: IOPS=1, BW=1247KiB/s (1277kB/s)(5120KiB/4107msec) clat (msec): min=67, max=523, avg=186.87, stdev=191.96 lat (msec): min=67, max=523, avg=186.87, stdev=191.96 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 110], 60.00th=[ 110], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2023, max= 4079, per=57.10%, avg=2711.00, stdev=1184.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1745KiB/s (1787kB/s)(7168KiB/4107msec); 0 zone resets clat (msec): min=114, max=744, avg=395.50, stdev=257.18 lat (msec): min=114, max=744, avg=395.66, stdev=257.21 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 124], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 401], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 684], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 2039, max= 6071, per=42.82%, avg=2846.20, stdev=1802.72, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=25.00% cpu : usr=0.02%, sys=6.55%, ctx=136, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4748KiB/s (4862kB/s), 475KiB/s-2593KiB/s (486kB/s-2656kB/s), io=20.0MiB (20.0MB), run=2764-4313msec WRITE: bw=6648KiB/s (6807kB/s), 1587KiB/s-2374KiB/s (1625kB/s-2431kB/s), io=28.0MiB (29.4MB), run=2764-4313msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151784: Tue Jun 16 10:19:22 2026 read: IOPS=1, BW=6815KiB/s (6979kB/s)(12.0MiB/1803msec) clat (msec): min=529, max=586, avg=556.11, stdev=28.54 lat (msec): min=529, max=586, avg=556.11, stdev=28.54 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8062, max= 8110, per=100.00%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=29.25%, ctx=398, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151785: Tue Jun 16 10:19:22 2026 read: IOPS=0, BW=1877KiB/s (1922kB/s)(4096KiB/2182msec) clat (nsec): min=550429k, max=550429k, avg=550428948.00, stdev= 0.00 lat (nsec): min=550430k, max=550430k, avg=550429979.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3754KiB/s (3844kB/s)(8192KiB/2182msec); 0 zone resets clat (msec): min=410, max=1075, avg=742.73, stdev=469.98 lat (msec): min=410, max=1075, avg=743.00, stdev=469.97 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8110, max= 8110, per=63.53%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.27%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151787: Tue Jun 16 10:19:22 2026 write: IOPS=1, BW=4787KiB/s (4902kB/s)(12.0MiB/2567msec); 0 zone resets clat (msec): min=219, max=1160, avg=805.22, stdev=510.75 lat (msec): min=220, max=1160, avg=805.61, stdev=510.79 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8110, max= 8110, per=63.53%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=8.89%, ctx=95, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151788: Tue Jun 16 10:19:22 2026 write: IOPS=1, BW=6026KiB/s (6171kB/s)(12.0MiB/2039msec); 0 zone resets clat (msec): min=265, max=1277, avg=633.26, stdev=559.60 lat (msec): min=265, max=1277, avg=633.56, stdev=559.57 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 6977, max= 8062, per=58.91%, avg=7519.50, stdev=767.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.74%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7509KiB/s (7689kB/s), 1877KiB/s-6815KiB/s (1922kB/s-6979kB/s), io=16.0MiB (16.8MB), run=1803-2182msec WRITE: bw=12.5MiB/s (13.1MB/s), 3754KiB/s-6026KiB/s (3844kB/s-6171kB/s), io=32.0MiB (33.6MB), run=2039-2567msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151789: Tue Jun 16 10:19:22 2026 read: IOPS=1, BW=4754KiB/s (4868kB/s)(12.0MiB/2585msec) clat (msec): min=193, max=1495, avg=861.09, stdev=651.68 lat (msec): min=193, max=1495, avg=861.09, stdev=651.68 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.30%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151790: Tue Jun 16 10:19:22 2026 read: IOPS=0, BW=1566KiB/s (1603kB/s)(4096KiB/2616msec) clat (nsec): min=1013.1M, max=1013.1M, avg=1013116111.00, stdev= 0.00 lat (nsec): min=1013.1M, max=1013.1M, avg=1013118531.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3131KiB/s (3207kB/s)(8192KiB/2616msec); 0 zone resets clat (msec): min=682, max=886, avg=784.27, stdev=144.30 lat (msec): min=699, max=886, avg=792.94, stdev=132.44 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8175, max= 8175, per=65.27%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.12%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151791: Tue Jun 16 10:19:22 2026 write: IOPS=1, BW=5114KiB/s (5236kB/s)(12.0MiB/2403msec); 0 zone resets clat (msec): min=190, max=1353, avg=797.46, stdev=583.44 lat (msec): min=190, max=1353, avg=797.81, stdev=583.44 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8175, max= 8175, per=65.27%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.45%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151792: Tue Jun 16 10:19:22 2026 write: IOPS=1, BW=6522KiB/s (6679kB/s)(12.0MiB/1884msec); 0 zone resets clat (msec): min=459, max=718, avg=624.52, stdev=143.56 lat (msec): min=459, max=718, avg=624.82, stdev=143.65 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 5818, max= 8159, per=55.80%, avg=6988.50, stdev=1655.34, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=10.62%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6263KiB/s (6413kB/s), 1566KiB/s-4754KiB/s (1603kB/s-4868kB/s), io=16.0MiB (16.8MB), run=2585-2616msec WRITE: bw=12.2MiB/s (12.8MB/s), 3131KiB/s-6522KiB/s (3207kB/s-6679kB/s), io=32.0MiB (33.6MB), run=1884-2616msec