== sanity test 398b: DIO and buffer IO race ============== 15:46:19 (1789069579) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.79766 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179461: Thu Sep 10 15:48:44 2026 read: IOPS=11, BW=47.9KiB/s (49.0kB/s)(5992KiB/125202msec) clat (usec): min=31, max=551942, avg=46158.91, stdev=32641.68 lat (usec): min=31, max=551943, avg=46160.98, stdev=32642.32 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11207], 10.00th=[ 16450], 20.00th=[ 23462], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[154141], 99.50th=[170918], 99.90th=[240124], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 151, per=25.18%, avg=47.60, stdev=19.45, samples=245 iops : min= 1, max= 37, avg=11.26, stdev= 4.88, samples=245 write: IOPS=12, BW=50.3KiB/s (51.5kB/s)(6296KiB/125202msec); 0 zone resets clat (usec): min=968, max=336991, avg=35481.33, stdev=36097.25 lat (usec): min=969, max=336992, avg=35483.16, stdev=36097.37 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1369], 10.00th=[ 1975], 20.00th=[ 4293], | 30.00th=[ 7963], 40.00th=[ 17957], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[156238], 99.50th=[168821], 99.90th=[223347], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 136, per=25.21%, avg=49.91, stdev=23.31, samples=246 iops : min= 1, max= 34, avg=11.84, stdev= 5.87, samples=246 lat (usec) : 50=0.23%, 100=1.66%, 250=0.13%, 500=0.07%, 1000=0.07% lat (msec) : 2=5.31%, 4=4.46%, 10=7.26%, 20=9.51%, 50=40.72% lat (msec) : 100=24.93%, 250=5.60%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=4.86%, ctx=6408, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179462: Thu Sep 10 15:48:44 2026 read: IOPS=11, BW=46.9KiB/s (47.0kB/s)(5940KiB/126761msec) clat (usec): min=41, max=645220, avg=46962.52, stdev=33030.94 lat (usec): min=42, max=645222, avg=46969.18, stdev=33031.37 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11600], 10.00th=[ 17171], 20.00th=[ 23462], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 47973], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[158335], 99.50th=[170918], 99.90th=[219153], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 135, per=24.71%, avg=46.71, stdev=18.91, samples=249 iops : min= 1, max= 33, avg=11.03, stdev= 4.75, samples=249 write: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6348KiB/126761msec); 0 zone resets clat (usec): min=982, max=235282, avg=35823.40, stdev=36078.82 lat (usec): min=983, max=235285, avg=35828.27, stdev=36082.53 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1287], 10.00th=[ 1860], 20.00th=[ 4293], | 30.00th=[ 8455], 40.00th=[ 17695], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[152044], 99.50th=[179307], 99.90th=[233833], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 15, max= 176, per=25.13%, avg=49.75, stdev=23.21, samples=250 iops : min= 3, max= 44, avg=11.80, stdev= 5.84, samples=250 lat (usec) : 50=0.20%, 100=1.50%, 250=0.10%, 750=0.07%, 1000=0.10% lat (msec) : 2=5.76%, 4=4.17%, 10=6.58%, 20=10.16%, 50=39.06% lat (msec) : 100=26.76%, 250=5.53%, 750=0.03% cpu : usr=0.08%, sys=5.04%, ctx=6620, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179463: Thu Sep 10 15:48:44 2026 read: IOPS=11, BW=47.9KiB/s (49.0kB/s)(6028KiB/125903msec) clat (usec): min=31, max=219397, avg=45926.04, stdev=30964.23 lat (usec): min=32, max=219398, avg=45928.93, stdev=30964.40 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11338], 10.00th=[ 17695], 20.00th=[ 22938], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[162530], 99.50th=[183501], 99.90th=[217056], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 120, per=25.11%, avg=47.46, stdev=18.47, samples=248 iops : min= 1, max= 30, avg=11.22, stdev= 4.68, samples=248 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6260KiB/125903msec); 0 zone resets clat (usec): min=956, max=664443, avg=36115.11, stdev=38336.97 lat (usec): min=957, max=664444, avg=36120.45, stdev=38338.60 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1319], 10.00th=[ 2073], 20.00th=[ 4555], | 30.00th=[ 8586], 40.00th=[ 18220], 50.00th=[ 27132], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 60031], 90.00th=[ 81265], 95.00th=[107480], | 99.00th=[158335], 99.50th=[168821], 99.90th=[233833], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 135, per=24.91%, avg=49.32, stdev=22.55, samples=248 iops : min= 1, max= 33, avg=11.69, stdev= 5.67, samples=248 lat (usec) : 50=0.46%, 100=0.94%, 250=0.42%, 500=0.03%, 1000=0.07% lat (msec) : 2=4.85%, 4=4.39%, 10=7.13%, 20=9.99%, 50=41.31% lat (msec) : 100=24.38%, 250=5.99%, 750=0.03% cpu : usr=0.08%, sys=4.91%, ctx=6514, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179464: Thu Sep 10 15:48:44 2026 read: IOPS=12, BW=48.4KiB/s (49.5kB/s)(6052KiB/125084msec) clat (usec): min=37, max=346716, avg=45427.88, stdev=30676.32 lat (usec): min=37, max=346717, avg=45431.98, stdev=30678.73 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 8455], 10.00th=[ 16909], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 63701], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[166724], 99.90th=[299893], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 103, per=25.46%, avg=48.12, stdev=18.29, samples=245 iops : min= 1, max= 25, avg=11.39, stdev= 4.59, samples=245 write: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6236KiB/125084msec); 0 zone resets clat (usec): min=939, max=663091, avg=36010.90, stdev=40615.84 lat (usec): min=940, max=663094, avg=36013.30, stdev=40616.57 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1352], 10.00th=[ 1942], 20.00th=[ 4015], | 30.00th=[ 7570], 40.00th=[ 15795], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[110625], | 99.00th=[173016], 99.50th=[200279], 99.90th=[235930], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 151, per=24.94%, avg=49.37, stdev=22.38, samples=246 iops : min= 1, max= 37, avg=11.70, stdev= 5.62, samples=246 lat (usec) : 50=0.42%, 100=1.53%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.21%, 4=4.85%, 10=7.58%, 20=9.47%, 50=39.58% lat (msec) : 100=25.55%, 250=5.31%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=4.95%, ctx=6384, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=189KiB/s (194kB/s), 46.9KiB/s-48.4KiB/s (47.0kB/s-49.5kB/s), io=23.4MiB (24.6MB), run=125084-126761msec WRITE: bw=198KiB/s (203kB/s), 49.7KiB/s-50.3KiB/s (50.9kB/s-51.5kB/s), io=24.6MiB (25.7MB), run=125084-126761msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179456: Thu Sep 10 15:49:20 2026 read: IOPS=9, BW=37.0KiB/s (37.9kB/s)(5992KiB/161802msec) clat (msec): min=5, max=815, avg=43.26, stdev=45.23 lat (msec): min=5, max=815, avg=43.26, stdev=45.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 93], 95.00th=[ 131], | 99.00th=[ 197], 99.50th=[ 226], 99.90th=[ 338], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 144, per=25.21%, avg=37.06, stdev=25.53, samples=313 iops : min= 1, max= 36, avg= 8.61, stdev= 6.44, samples=313 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6296KiB/161802msec); 0 zone resets clat (msec): min=12, max=395, avg=61.36, stdev=43.78 lat (msec): min=12, max=395, avg=61.36, stdev=43.77 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 92], 90.00th=[ 120], 95.00th=[ 146], | 99.00th=[ 218], 99.50th=[ 236], 99.90th=[ 388], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 127, per=25.29%, avg=38.94, stdev=25.04, samples=314 iops : min= 1, max= 31, avg= 9.08, stdev= 6.31, samples=314 lat (msec) : 10=2.93%, 20=15.23%, 50=45.21%, 100=23.70%, 250=12.53% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.06%, sys=1.77%, ctx=4716, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179457: Thu Sep 10 15:49:20 2026 read: IOPS=9, BW=36.4KiB/s (37.3kB/s)(5940KiB/163226msec) clat (msec): min=4, max=917, avg=43.39, stdev=46.85 lat (msec): min=4, max=917, avg=43.39, stdev=46.85 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 103], 95.00th=[ 133], | 99.00th=[ 201], 99.50th=[ 224], 99.90th=[ 338], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 128, per=24.98%, avg=36.72, stdev=27.11, samples=314 iops : min= 1, max= 32, avg= 8.53, stdev= 6.83, samples=314 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6348KiB/163226msec); 0 zone resets clat (msec): min=10, max=399, avg=61.99, stdev=44.76 lat (msec): min=10, max=399, avg=61.99, stdev=44.76 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 121], 95.00th=[ 150], | 99.00th=[ 213], 99.50th=[ 275], 99.90th=[ 376], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 111, per=25.11%, avg=38.66, stdev=24.95, samples=318 iops : min= 1, max= 27, avg= 9.02, stdev= 6.30, samples=318 lat (msec) : 10=2.67%, 20=16.96%, 50=44.01%, 100=22.95%, 250=12.96% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.06%, sys=1.76%, ctx=4709, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179458: Thu Sep 10 15:49:20 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6028KiB/161992msec) clat (msec): min=5, max=372, avg=42.86, stdev=39.43 lat (msec): min=5, max=372, avg=42.87, stdev=39.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 97], 95.00th=[ 126], | 99.00th=[ 184], 99.50th=[ 226], 99.90th=[ 271], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 158, per=25.59%, avg=37.62, stdev=26.84, samples=312 iops : min= 1, max= 39, avg= 8.75, stdev= 6.78, samples=312 write: IOPS=9, BW=38.6KiB/s (39.6kB/s)(6260KiB/161992msec); 0 zone resets clat (msec): min=11, max=957, avg=61.93, stdev=49.92 lat (msec): min=11, max=957, avg=61.94, stdev=49.92 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 122], 95.00th=[ 153], | 99.00th=[ 224], 99.50th=[ 268], 99.90th=[ 384], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 111, per=25.02%, avg=38.53, stdev=25.29, samples=316 iops : min= 1, max= 27, avg= 8.98, stdev= 6.38, samples=316 lat (msec) : 10=2.96%, 20=15.72%, 50=44.60%, 100=23.96%, 250=12.27% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.05%, sys=1.72%, ctx=4700, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179459: Thu Sep 10 15:49:20 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6052KiB/163211msec) clat (msec): min=5, max=321, avg=43.46, stdev=40.61 lat (msec): min=5, max=321, avg=43.46, stdev=40.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 97], 95.00th=[ 133], | 99.00th=[ 194], 99.50th=[ 257], 99.90th=[ 309], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 134, per=25.51%, avg=37.50, stdev=26.20, samples=313 iops : min= 1, max= 33, avg= 8.73, stdev= 6.60, samples=313 write: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6236KiB/163211msec); 0 zone resets clat (msec): min=12, max=953, avg=62.23, stdev=48.57 lat (msec): min=12, max=953, avg=62.23, stdev=48.57 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 146], | 99.00th=[ 224], 99.50th=[ 253], 99.90th=[ 309], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 121, per=24.59%, avg=37.87, stdev=24.35, samples=319 iops : min= 1, max= 30, avg= 8.82, stdev= 6.15, samples=319 lat (msec) : 10=2.15%, 20=15.17%, 50=45.64%, 100=24.09%, 250=12.43% lat (msec) : 500=0.49%, 1000=0.03% cpu : usr=0.05%, sys=1.76%, ctx=4797, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (151kB/s), 36.4KiB/s-37.2KiB/s (37.3kB/s-38.1kB/s), io=23.4MiB (24.6MB), run=161802-163226msec WRITE: bw=154KiB/s (158kB/s), 38.2KiB/s-38.9KiB/s (39.1kB/s-39.8kB/s), io=24.6MiB (25.7MB), run=161802-163226msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179508: Thu Sep 10 15:50:05 2026 read: IOPS=11, BW=180KiB/s (185kB/s)(5920KiB/32820msec) clat (usec): min=45, max=161900, avg=46328.04, stdev=31929.32 lat (usec): min=46, max=161901, avg=46337.71, stdev=31946.03 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 81], 20.00th=[ 22676], | 30.00th=[ 28181], 40.00th=[ 35390], 50.00th=[ 40633], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[143655], 99.50th=[156238], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 31, max= 349, per=25.20%, avg=179.92, stdev=67.25, samples=64 iops : min= 1, max= 21, avg=10.52, stdev= 4.28, samples=64 write: IOPS=12, BW=194KiB/s (199kB/s)(6368KiB/32820msec); 0 zone resets clat (usec): min=1354, max=221044, avg=38772.70, stdev=39541.34 lat (usec): min=1356, max=221047, avg=38792.44, stdev=39532.62 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1795], 10.00th=[ 3032], 20.00th=[ 5538], | 30.00th=[ 8848], 40.00th=[ 16319], 50.00th=[ 26608], 60.00th=[ 35914], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[100140], 95.00th=[114820], | 99.00th=[170918], 99.50th=[210764], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 29, max= 493, per=25.84%, avg=194.08, stdev=85.00, samples=64 iops : min= 1, max= 30, avg=11.39, stdev= 5.37, samples=64 lat (usec) : 50=0.52%, 100=4.69%, 250=0.52% lat (msec) : 2=3.39%, 4=3.39%, 10=9.90%, 20=8.20%, 50=34.77% lat (msec) : 100=26.30%, 250=8.33% cpu : usr=0.07%, sys=4.84%, ctx=1538, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179509: Thu Sep 10 15:50:05 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5744KiB/33528msec) clat (usec): min=48, max=238887, avg=48886.65, stdev=33037.05 lat (usec): min=48, max=238888, avg=48887.76, stdev=33037.01 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 13042], 20.00th=[ 24249], | 30.00th=[ 30016], 40.00th=[ 38011], 50.00th=[ 43779], 60.00th=[ 51119], | 70.00th=[ 60556], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[105382], | 99.00th=[160433], 99.50th=[191890], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 62, max= 377, per=24.30%, avg=173.50, stdev=71.95, samples=64 iops : min= 3, max= 23, avg=10.11, stdev= 4.51, samples=64 write: IOPS=12, BW=195KiB/s (200kB/s)(6544KiB/33528msec); 0 zone resets clat (usec): min=1542, max=271585, avg=38629.38, stdev=39708.07 lat (usec): min=1542, max=271586, avg=38631.26, stdev=39707.98 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2114], 10.00th=[ 2737], 20.00th=[ 7177], | 30.00th=[ 10552], 40.00th=[ 17957], 50.00th=[ 28181], 60.00th=[ 37487], | 70.00th=[ 47449], 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[113771], | 99.00th=[198181], 99.50th=[204473], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 352, per=25.87%, avg=194.31, stdev=75.89, samples=65 iops : min= 1, max= 22, avg=11.40, stdev= 4.80, samples=65 lat (usec) : 50=0.13%, 100=3.39%, 250=0.26%, 500=0.13% lat (msec) : 2=1.95%, 4=4.56%, 10=9.11%, 20=10.03%, 50=35.68% lat (msec) : 100=28.13%, 250=6.51%, 500=0.13% cpu : usr=0.06%, sys=4.75%, ctx=1653, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179510: Thu Sep 10 15:50:05 2026 read: IOPS=11, BW=191KiB/s (195kB/s)(6256KiB/32781msec) clat (usec): min=49, max=197572, avg=47297.52, stdev=32838.16 lat (usec): min=50, max=197573, avg=47298.64, stdev=32838.16 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 60], 10.00th=[ 11863], 20.00th=[ 23462], | 30.00th=[ 29492], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 47973], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 89654], 95.00th=[104334], | 99.00th=[175113], 99.50th=[181404], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 60, max= 415, per=26.69%, avg=190.58, stdev=74.15, samples=64 iops : min= 3, max= 25, avg=11.19, stdev= 4.68, samples=64 write: IOPS=11, BW=184KiB/s (188kB/s)(6032KiB/32781msec); 0 zone resets clat (usec): min=1389, max=213144, avg=37351.64, stdev=39529.42 lat (usec): min=1390, max=213146, avg=37353.76, stdev=39529.21 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1762], 10.00th=[ 2802], 20.00th=[ 5014], | 30.00th=[ 8160], 40.00th=[ 14877], 50.00th=[ 24511], 60.00th=[ 34866], | 70.00th=[ 48497], 80.00th=[ 65799], 90.00th=[ 87557], 95.00th=[122160], | 99.00th=[179307], 99.50th=[204473], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 347, per=24.03%, avg=180.45, stdev=72.42, samples=64 iops : min= 1, max= 21, avg=10.55, stdev= 4.63, samples=64 lat (usec) : 50=0.13%, 100=4.30%, 250=0.13%, 750=0.13% lat (msec) : 2=3.65%, 4=4.30%, 10=8.46%, 20=9.38%, 50=35.42% lat (msec) : 100=27.21%, 250=6.90% cpu : usr=0.06%, sys=5.05%, ctx=1575, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179511: Thu Sep 10 15:50:05 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6032KiB/32690msec) clat (usec): min=37, max=211203, avg=48360.61, stdev=34847.85 lat (usec): min=37, max=211203, avg=48361.65, stdev=34847.83 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 70], 20.00th=[ 23462], | 30.00th=[ 31589], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 59507], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[170918], 99.50th=[179307], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 63, max= 414, per=25.65%, avg=183.16, stdev=70.70, samples=64 iops : min= 3, max= 25, avg=10.72, stdev= 4.50, samples=64 write: IOPS=11, BW=191KiB/s (196kB/s)(6256KiB/32690msec); 0 zone resets clat (usec): min=1318, max=243933, avg=36795.97, stdev=37484.51 lat (usec): min=1319, max=243935, avg=36798.35, stdev=37484.77 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1876], 10.00th=[ 3195], 20.00th=[ 5866], | 30.00th=[ 10683], 40.00th=[ 17171], 50.00th=[ 25035], 60.00th=[ 33817], | 70.00th=[ 43254], 80.00th=[ 63701], 90.00th=[ 93848], 95.00th=[111674], | 99.00th=[160433], 99.50th=[193987], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 31, max= 480, per=25.49%, avg=191.42, stdev=93.86, samples=64 iops : min= 1, max= 30, avg=11.23, stdev= 5.98, samples=64 lat (usec) : 50=0.39%, 100=5.21%, 250=0.91%, 750=0.13% lat (msec) : 2=2.73%, 4=4.43%, 10=7.81%, 20=8.98%, 50=34.90% lat (msec) : 100=27.08%, 250=7.42% cpu : usr=0.06%, sys=4.83%, ctx=1672, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=714KiB/s (732kB/s), 171KiB/s-191KiB/s (175kB/s-195kB/s), io=23.4MiB (24.5MB), run=32690-33528msec WRITE: bw=752KiB/s (770kB/s), 184KiB/s-195KiB/s (188kB/s-200kB/s), io=24.6MiB (25.8MB), run=32690-33528msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179513: Thu Sep 10 15:50:20 2026 read: IOPS=7, BW=128KiB/s (131kB/s)(5920KiB/46314msec) clat (msec): min=7, max=301, avg=49.60, stdev=42.81 lat (msec): min=7, max=301, avg=49.60, stdev=42.81 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 112], 95.00th=[ 148], | 99.00th=[ 182], 99.50th=[ 288], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 412, per=25.03%, avg=127.15, stdev=79.43, samples=91 iops : min= 1, max= 25, avg= 7.13, stdev= 5.00, samples=91 write: IOPS=8, BW=137KiB/s (141kB/s)(6368KiB/46314msec); 0 zone resets clat (msec): min=14, max=274, avg=70.10, stdev=46.03 lat (msec): min=14, max=274, avg=70.10, stdev=46.03 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 80], 80.00th=[ 96], 90.00th=[ 132], 95.00th=[ 161], | 99.00th=[ 245], 99.50th=[ 268], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 349, per=25.69%, avg=137.19, stdev=76.19, samples=91 iops : min= 1, max= 21, avg= 7.76, stdev= 4.79, samples=91 lat (msec) : 10=0.52%, 20=8.20%, 50=48.18%, 100=27.99%, 250=14.45% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.44%, ctx=1117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179514: Thu Sep 10 15:50:20 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(5744KiB/47121msec) clat (msec): min=6, max=353, avg=48.81, stdev=42.43 lat (msec): min=6, max=353, avg=48.81, stdev=42.43 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 71], 90.00th=[ 104], 95.00th=[ 136], | 99.00th=[ 192], 99.50th=[ 249], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 23, max= 445, per=24.56%, avg=124.75, stdev=80.92, samples=89 iops : min= 1, max= 27, avg= 6.98, stdev= 5.11, samples=89 write: IOPS=8, BW=139KiB/s (142kB/s)(6544KiB/47121msec); 0 zone resets clat (msec): min=16, max=304, avg=72.04, stdev=46.17 lat (msec): min=16, max=304, avg=72.04, stdev=46.17 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 67], | 70.00th=[ 80], 80.00th=[ 109], 90.00th=[ 140], 95.00th=[ 165], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 349, per=26.02%, avg=138.96, stdev=71.91, samples=91 iops : min= 1, max= 21, avg= 7.87, stdev= 4.50, samples=91 lat (msec) : 10=0.52%, 20=10.16%, 50=43.36%, 100=28.52%, 250=17.06% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.48%, ctx=1099, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179515: Thu Sep 10 15:50:20 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6256KiB/47094msec) clat (msec): min=7, max=298, avg=46.72, stdev=38.42 lat (msec): min=7, max=298, avg=46.72, stdev=38.42 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 67], 90.00th=[ 91], 95.00th=[ 117], | 99.00th=[ 243], 99.50th=[ 264], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 383, per=26.93%, avg=136.82, stdev=87.18, samples=89 iops : min= 1, max= 23, avg= 7.73, stdev= 5.51, samples=89 write: IOPS=8, BW=128KiB/s (131kB/s)(6032KiB/47094msec); 0 zone resets clat (msec): min=18, max=284, avg=76.22, stdev=51.29 lat (msec): min=18, max=284, avg=76.22, stdev=51.29 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 70], | 70.00th=[ 89], 80.00th=[ 118], 90.00th=[ 153], 95.00th=[ 188], | 99.00th=[ 222], 99.50th=[ 251], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 413, per=23.53%, avg=125.66, stdev=70.94, samples=92 iops : min= 1, max= 25, avg= 7.03, stdev= 4.46, samples=92 lat (msec) : 10=1.04%, 20=9.64%, 50=44.27%, 100=27.34%, 250=17.19% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.54%, ctx=1214, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179516: Thu Sep 10 15:50:20 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(6032KiB/46842msec) clat (msec): min=8, max=357, avg=50.15, stdev=44.35 lat (msec): min=8, max=357, avg=50.15, stdev=44.35 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 75], 90.00th=[ 115], 95.00th=[ 146], | 99.00th=[ 209], 99.50th=[ 243], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 413, per=25.34%, avg=128.75, stdev=78.71, samples=91 iops : min= 1, max= 25, avg= 7.22, stdev= 4.95, samples=91 write: IOPS=8, BW=134KiB/s (137kB/s)(6256KiB/46842msec); 0 zone resets clat (msec): min=15, max=269, avg=71.21, stdev=48.83 lat (msec): min=15, max=269, avg=71.21, stdev=48.83 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 67], | 70.00th=[ 84], 80.00th=[ 103], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 247], 99.50th=[ 266], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 380, per=25.77%, avg=137.63, stdev=82.73, samples=89 iops : min= 1, max= 23, avg= 7.79, stdev= 5.20, samples=89 lat (msec) : 10=0.91%, 20=9.38%, 50=47.01%, 100=26.82%, 250=15.36% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.59%, ctx=1257, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=508KiB/s (521kB/s), 122KiB/s-133KiB/s (125kB/s-136kB/s), io=23.4MiB (24.5MB), run=46314-47121msec WRITE: bw=535KiB/s (548kB/s), 128KiB/s-139KiB/s (131kB/s-142kB/s), io=24.6MiB (25.8MB), run=46314-47121msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179528: Thu Sep 10 15:50:35 2026 read: IOPS=2, BW=2458KiB/s (2517kB/s)(7168KiB/2916msec) clat (msec): min=155, max=308, avg=208.79, stdev=60.20 lat (msec): min=155, max=308, avg=208.79, stdev=60.20 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 169], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 264], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 2035, max= 4087, per=67.86%, avg=3053.00, stdev=1170.98, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1756KiB/s (1798kB/s)(5120KiB/2916msec); 0 zone resets clat (msec): min=191, max=421, avg=279.73, stdev=97.43 lat (msec): min=191, max=422, avg=279.83, stdev=97.45 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2043, max= 4087, per=43.26%, avg=2724.33, stdev=1180.10, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=41.67% cpu : usr=0.03%, sys=18.28%, ctx=307, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179529: Thu Sep 10 15:50:35 2026 read: IOPS=0, BW=450KiB/s (461kB/s)(2048KiB/4552msec) clat (msec): min=48, max=354, avg=201.61, stdev=216.72 lat (msec): min=48, max=354, avg=201.61, stdev=216.72 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 49], | 30.00th=[ 49], 40.00th=[ 49], 50.00th=[ 49], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1359, max= 1965, per=36.94%, avg=1662.00, stdev=428.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2250KiB/s (2304kB/s)(10.0MiB/4552msec); 0 zone resets clat (msec): min=148, max=1250, avg=396.94, stdev=322.96 lat (msec): min=148, max=1250, avg=397.02, stdev=322.96 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 199], | 30.00th=[ 215], 40.00th=[ 232], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 342], 80.00th=[ 443], 90.00th=[ 550], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2039, max= 4087, per=55.57%, avg=3500.00, stdev=869.55, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=15.56%, ctx=189, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179531: Thu Sep 10 15:50:35 2026 read: IOPS=1, BW=1916KiB/s (1962kB/s)(6144KiB/3206msec) clat (usec): min=449, max=377087, avg=188905.72, stdev=134509.40 lat (usec): min=450, max=377088, avg=188907.13, stdev=134509.50 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 76022], | 30.00th=[ 76022], 40.00th=[189793], 50.00th=[189793], 60.00th=[229639], | 70.00th=[261096], 80.00th=[261096], 90.00th=[375391], 95.00th=[375391], | 99.00th=[375391], 99.50th=[375391], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 1678, max= 4087, per=72.93%, avg=3281.33, stdev=1388.53, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1916KiB/s (1962kB/s)(6144KiB/3206msec); 0 zone resets clat (msec): min=115, max=606, avg=328.64, stdev=195.44 lat (msec): min=115, max=606, avg=328.99, stdev=195.60 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 266], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1678, max= 2760, per=33.79%, avg=2128.00, stdev=454.05, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=15.57%, ctx=147, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179532: Thu Sep 10 15:50:35 2026 read: IOPS=1, BW=1211KiB/s (1240kB/s)(5120KiB/4228msec) clat (usec): min=376, max=239951, avg=132907.55, stdev=112677.24 lat (usec): min=377, max=239953, avg=132908.68, stdev=112677.14 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 375], 10.00th=[ 375], 20.00th=[ 375], | 30.00th=[ 27132], 40.00th=[ 27132], 50.00th=[166724], 60.00th=[166724], | 70.00th=[229639], 80.00th=[229639], 90.00th=[240124], 95.00th=[240124], | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1695KiB/s (1736kB/s)(7168KiB/4228msec); 0 zone resets clat (msec): min=182, max=1335, avg=480.26, stdev=400.18 lat (msec): min=182, max=1335, avg=480.34, stdev=400.19 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 262], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 275], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 542], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1442, max= 3946, per=35.14%, avg=2213.20, stdev=997.14, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 50=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=14.67%, ctx=234, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4499KiB/s (4607kB/s), 450KiB/s-2458KiB/s (461kB/s-2517kB/s), io=20.0MiB (20.0MB), run=2916-4552msec WRITE: bw=6299KiB/s (6450kB/s), 1695KiB/s-2250KiB/s (1736kB/s-2304kB/s), io=28.0MiB (29.4MB), run=2916-4552msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179533: Thu Sep 10 15:50:35 2026 read: IOPS=1, BW=1869KiB/s (1913kB/s)(7168KiB/3836msec) clat (msec): min=127, max=339, avg=204.78, stdev=89.76 lat (msec): min=127, max=339, avg=204.81, stdev=89.73 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 178], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 326], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1882, max= 4079, per=58.37%, avg=2372.80, stdev=955.66, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1335KiB/s (1367kB/s)(5120KiB/3836msec); 0 zone resets clat (msec): min=240, max=878, avg=470.40, stdev=247.75 lat (msec): min=240, max=878, avg=470.47, stdev=247.76 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1892, max= 4063, per=46.68%, avg=2656.67, stdev=1219.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.98%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179534: Thu Sep 10 15:50:35 2026 read: IOPS=0, BW=414KiB/s (424kB/s)(2048KiB/4947msec) clat (msec): min=129, max=521, avg=325.45, stdev=277.33 lat (msec): min=129, max=521, avg=325.45, stdev=277.33 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2031, max= 2039, per=50.06%, avg=2035.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2070KiB/s (2120kB/s)(10.0MiB/4947msec); 0 zone resets clat (msec): min=86, max=1152, avg=398.03, stdev=322.46 lat (msec): min=86, max=1152, avg=398.11, stdev=322.46 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 127], | 30.00th=[ 197], 40.00th=[ 234], 50.00th=[ 236], 60.00th=[ 363], | 70.00th=[ 397], 80.00th=[ 489], 90.00th=[ 701], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1892, max= 4087, per=49.34%, avg=2808.20, stdev=1143.16, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=5.78%, ctx=115, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179535: Thu Sep 10 15:50:35 2026 read: IOPS=1, BW=1314KiB/s (1345kB/s)(6144KiB/4676msec) clat (msec): min=99, max=588, avg=348.16, stdev=188.18 lat (msec): min=99, max=588, avg=348.16, stdev=188.18 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 351], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2043, max= 3992, per=80.52%, avg=3273.33, stdev=1070.51, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1314KiB/s (1345kB/s)(6144KiB/4676msec); 0 zone resets clat (msec): min=115, max=671, avg=376.67, stdev=240.99 lat (msec): min=116, max=671, avg=377.24, stdev=240.70 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 363], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2031, max= 4031, per=42.79%, avg=2435.00, stdev=892.21, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=3.57%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179536: Thu Sep 10 15:50:35 2026 read: IOPS=0, BW=1016KiB/s (1041kB/s)(5120KiB/5038msec) clat (msec): min=76, max=211, avg=146.95, stdev=57.66 lat (msec): min=76, max=211, avg=146.95, stdev=57.66 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 211], 95.00th=[ 211], | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 1892, max= 6095, per=98.24%, avg=3993.50, stdev=2971.97, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1423KiB/s (1457kB/s)(7168KiB/5038msec); 0 zone resets clat (msec): min=73, max=1065, avg=585.77, stdev=353.52 lat (msec): min=73, max=1065, avg=585.84, stdev=353.51 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 321], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 489], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 969], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1892, max= 2043, per=35.21%, avg=2004.00, stdev=63.52, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=25.00%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=5.94%, ctx=131, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4065KiB/s (4163kB/s), 414KiB/s-1869KiB/s (424kB/s-1913kB/s), io=20.0MiB (20.0MB), run=3836-5038msec WRITE: bw=5691KiB/s (5828kB/s), 1314KiB/s-2070KiB/s (1345kB/s-2120kB/s), io=28.0MiB (29.4MB), run=3836-5038msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179544: Thu Sep 10 15:50:49 2026 read: IOPS=1, BW=8052KiB/s (8246kB/s)(12.0MiB/1526msec) clat (msec): min=309, max=682, avg=493.79, stdev=186.18 lat (msec): min=309, max=682, avg=493.79, stdev=186.18 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5641, max= 7641, per=98.30%, avg=6641.00, stdev=1414.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=6.95%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179546: Thu Sep 10 15:50:49 2026 read: IOPS=0, BW=1689KiB/s (1730kB/s)(4096KiB/2425msec) clat (nsec): min=441421k, max=441421k, avg=441421348.00, stdev= 0.00 lat (nsec): min=441424k, max=441424k, avg=441423581.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7641, max= 7641, per=100.00%, avg=7641.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3378KiB/s (3459kB/s)(8192KiB/2425msec); 0 zone resets clat (msec): min=531, max=1258, avg=895.19, stdev=514.07 lat (msec): min=532, max=1259, avg=896.06, stdev=513.45 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8143, max= 8143, per=63.62%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.57%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179548: Thu Sep 10 15:50:49 2026 write: IOPS=1, BW=4800KiB/s (4915kB/s)(12.0MiB/2560msec); 0 zone resets clat (msec): min=674, max=898, avg=772.13, stdev=115.12 lat (msec): min=674, max=899, avg=773.28, stdev=115.12 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7831, max= 8175, per=62.52%, avg=8003.00, stdev=243.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=8.56%, ctx=99, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179549: Thu Sep 10 15:50:49 2026 write: IOPS=1, BW=5491KiB/s (5622kB/s)(12.0MiB/2238msec); 0 zone resets clat (msec): min=317, max=1269, avg=720.58, stdev=492.40 lat (msec): min=317, max=1269, avg=720.99, stdev=492.24 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 6895, max= 7641, per=56.78%, avg=7268.00, stdev=527.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.45%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6756KiB/s (6918kB/s), 1689KiB/s-8052KiB/s (1730kB/s-8246kB/s), io=16.0MiB (16.8MB), run=1526-2425msec WRITE: bw=12.5MiB/s (13.1MB/s), 3378KiB/s-5491KiB/s (3459kB/s-5622kB/s), io=32.0MiB (33.6MB), run=2238-2560msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179545: Thu Sep 10 15:50:50 2026 read: IOPS=1, BW=4900KiB/s (5017kB/s)(12.0MiB/2508msec) clat (msec): min=715, max=785, avg=761.08, stdev=39.41 lat (msec): min=715, max=785, avg=761.08, stdev=39.41 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8031, max= 8047, per=100.00%, avg=8039.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.68%, ctx=231, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179547: Thu Sep 10 15:50:50 2026 read: IOPS=0, BW=1554KiB/s (1592kB/s)(4096KiB/2635msec) clat (nsec): min=747276k, max=747276k, avg=747276089.00, stdev= 0.00 lat (nsec): min=747278k, max=747278k, avg=747278037.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3109KiB/s (3184kB/s)(8192KiB/2635msec); 0 zone resets clat (msec): min=685, max=983, avg=834.46, stdev=210.68 lat (msec): min=686, max=983, avg=835.31, stdev=210.06 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7953, max= 7953, per=72.89%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.68%, ctx=192, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179550: Thu Sep 10 15:50:50 2026 write: IOPS=0, BW=4092KiB/s (4190kB/s)(12.0MiB/3003msec); 0 zone resets clat (msec): min=161, max=1687, avg=937.54, stdev=763.04 lat (msec): min=162, max=1687, avg=937.90, stdev=762.97 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8047, max= 8047, per=73.75%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.00%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179551: Thu Sep 10 15:50:50 2026 write: IOPS=1, BW=5016KiB/s (5136kB/s)(12.0MiB/2450msec); 0 zone resets clat (msec): min=466, max=1068, avg=796.09, stdev=304.90 lat (msec): min=467, max=1069, avg=796.47, stdev=304.76 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8031, max= 8031, per=73.60%, avg=8031.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.00%, ctx=134, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6218KiB/s (6367kB/s), 1554KiB/s-4900KiB/s (1592kB/s-5017kB/s), io=16.0MiB (16.8MB), run=2508-2635msec WRITE: bw=10.7MiB/s (11.2MB/s), 3109KiB/s-5016KiB/s (3184kB/s-5136kB/s), io=32.0MiB (33.6MB), run=2450-3003msec