== sanity test 398b: DIO and buffer IO race ============== 04:23:28 (1779697408) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.60854 s, 9.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146073: Mon May 25 04:26:04 2026 read: IOPS=11, BW=44.1KiB/s (45.1kB/s)(5992KiB/135932msec) clat (usec): min=35, max=1042.6k, avg=44163.85, stdev=40755.30 lat (usec): min=35, max=1042.6k, avg=44165.10, stdev=40755.26 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 225], | 20.00th=[ 20841], 30.00th=[ 26346], 40.00th=[ 31851], | 50.00th=[ 37487], 60.00th=[ 44827], 70.00th=[ 52691], | 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[ 102237], | 99.00th=[ 152044], 99.50th=[ 166724], 99.90th=[ 295699], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 7, max= 103, per=25.51%, avg=44.38, stdev=19.30, samples=263 iops : min= 1, max= 25, avg=10.44, stdev= 4.85, samples=263 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6296KiB/135932msec); 0 zone resets clat (usec): min=1014, max=563916, avg=44026.48, stdev=48289.98 lat (usec): min=1014, max=563917, avg=44032.60, stdev=48288.43 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 2114], 20.00th=[ 5342], | 30.00th=[ 9896], 40.00th=[ 21627], 50.00th=[ 32113], 60.00th=[ 43254], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[128451], | 99.00th=[208667], 99.50th=[252707], 99.90th=[534774], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 111, per=25.17%, avg=46.06, stdev=20.32, samples=266 iops : min= 1, max= 27, avg=10.87, stdev= 5.13, samples=266 lat (usec) : 50=0.62%, 100=3.94%, 250=0.33%, 500=0.03%, 750=0.07% lat (msec) : 2=4.92%, 4=3.52%, 10=7.36%, 20=8.20%, 50=37.14% lat (msec) : 100=25.88%, 250=7.68%, 500=0.23%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=4.80%, ctx=6586, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146074: Mon May 25 04:26:04 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(5940KiB/135616msec) clat (usec): min=29, max=268950, avg=44318.51, stdev=31834.53 lat (usec): min=29, max=268952, avg=44321.62, stdev=31835.59 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 3294], 20.00th=[ 21103], | 30.00th=[ 27132], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 65799], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[152044], 99.50th=[189793], 99.90th=[214959], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 112, per=25.10%, avg=43.68, stdev=18.89, samples=264 iops : min= 1, max= 28, avg=10.26, stdev= 4.76, samples=264 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6348KiB/135616msec); 0 zone resets clat (usec): min=1049, max=984613, avg=43696.95, stdev=50411.53 lat (usec): min=1050, max=984614, avg=43703.98, stdev=50411.23 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 2507], 20.00th=[ 5145], | 30.00th=[ 9634], 40.00th=[ 19792], 50.00th=[ 31327], 60.00th=[ 42730], | 70.00th=[ 56361], 80.00th=[ 72877], 90.00th=[101188], 95.00th=[130548], | 99.00th=[189793], 99.50th=[219153], 99.90th=[387974], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 103, per=25.37%, avg=46.43, stdev=19.93, samples=265 iops : min= 1, max= 25, avg=10.96, stdev= 5.01, samples=265 lat (usec) : 50=0.55%, 100=3.87%, 250=0.20%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.17%, 4=3.97%, 10=7.88%, 20=8.76%, 50=35.87% lat (msec) : 100=26.89%, 250=7.49%, 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=4.83%, ctx=6528, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146076: Mon May 25 04:26:04 2026 read: IOPS=10, BW=43.9KiB/s (44.0kB/s)(6028KiB/137301msec) clat (usec): min=34, max=1031.2k, avg=45106.57, stdev=41437.02 lat (usec): min=34, max=1031.2k, avg=45109.60, stdev=41436.69 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 11863], | 20.00th=[ 20317], 30.00th=[ 26608], 40.00th=[ 32637], | 50.00th=[ 38011], 60.00th=[ 45351], 70.00th=[ 54264], | 80.00th=[ 65799], 90.00th=[ 84411], 95.00th=[ 104334], | 99.00th=[ 154141], 99.50th=[ 173016], 99.90th=[ 400557], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 117, per=25.40%, avg=44.19, stdev=19.56, samples=266 iops : min= 1, max= 29, avg=10.39, stdev= 4.94, samples=266 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6260KiB/137301msec); 0 zone resets clat (usec): min=892, max=807950, avg=43991.22, stdev=49428.45 lat (usec): min=893, max=807951, avg=43995.38, stdev=49427.15 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1942], 20.00th=[ 4948], | 30.00th=[ 9503], 40.00th=[ 21365], 50.00th=[ 32375], 60.00th=[ 42206], | 70.00th=[ 55313], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[131597], | 99.00th=[196084], 99.50th=[233833], 99.90th=[476054], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 141, per=24.97%, avg=45.70, stdev=20.30, samples=267 iops : min= 1, max= 35, avg=10.77, stdev= 5.14, samples=267 lat (usec) : 50=0.42%, 100=3.45%, 250=0.07%, 500=0.20%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=5.21%, 4=3.58%, 10=7.26%, 20=9.08%, 50=36.30% lat (msec) : 100=25.94%, 250=8.01%, 500=0.23%, 1000=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.83%, ctx=6720, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146077: Mon May 25 04:26:04 2026 read: IOPS=11, BW=44.1KiB/s (45.1kB/s)(6052KiB/137349msec) clat (usec): min=33, max=440746, avg=45147.12, stdev=37102.08 lat (usec): min=33, max=440746, avg=45149.15, stdev=37102.40 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 100], 20.00th=[ 19268], | 30.00th=[ 26084], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 68682], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[154141], 99.50th=[183501], 99.90th=[358613], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 128, per=25.58%, avg=44.51, stdev=18.49, samples=265 iops : min= 1, max= 32, avg=10.47, stdev= 4.66, samples=265 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6236KiB/137349msec); 0 zone resets clat (usec): min=1074, max=999461, avg=43987.46, stdev=54515.78 lat (usec): min=1076, max=999463, avg=43995.66, stdev=54526.73 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1958], | 20.00th=[ 4752], 30.00th=[ 8979], 40.00th=[ 18744], | 50.00th=[ 31065], 60.00th=[ 41681], 70.00th=[ 54264], | 80.00th=[ 73925], 90.00th=[ 102237], 95.00th=[ 128451], | 99.00th=[ 219153], 99.50th=[ 254804], 99.90th=[ 708838], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 110, per=24.68%, avg=45.16, stdev=20.10, samples=269 iops : min= 1, max= 27, avg=10.64, stdev= 5.08, samples=269 lat (usec) : 50=0.85%, 100=4.10%, 250=0.39%, 500=0.10%, 1000=0.07% lat (msec) : 2=5.24%, 4=3.68%, 10=7.42%, 20=9.24%, 50=34.83% lat (msec) : 100=25.68%, 250=7.88%, 500=0.46%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=4.69%, ctx=6501, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=175KiB/s (179kB/s), 43.8KiB/s-44.1KiB/s (44.9kB/s-45.1kB/s), io=23.4MiB (24.6MB), run=135616-137349msec WRITE: bw=183KiB/s (187kB/s), 45.4KiB/s-46.8KiB/s (46.5kB/s-47.9kB/s), io=24.6MiB (25.7MB), run=135616-137349msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146072: Mon May 25 04:28:17 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(5992KiB/268905msec) clat (msec): min=5, max=1034, avg=35.99, stdev=46.08 lat (msec): min=5, max=1034, avg=35.99, stdev=46.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 48], 90.00th=[ 85], 95.00th=[ 112], | 99.00th=[ 197], 99.50th=[ 253], 99.90th=[ 401], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 95, per=28.89%, avg=25.42, stdev=16.97, samples=456 iops : min= 1, max= 23, avg= 5.72, stdev= 4.29, samples=456 write: IOPS=5, BW=23.4KiB/s (23.0kB/s)(6296KiB/268905msec); 0 zone resets clat (msec): min=37, max=892, avg=136.34, stdev=73.76 lat (msec): min=37, max=892, avg=136.34, stdev=73.76 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 117], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 182], 90.00th=[ 226], 95.00th=[ 284], | 99.00th=[ 409], 99.50th=[ 443], 99.90th=[ 768], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 7, max= 55, per=25.06%, avg=23.31, stdev=11.04, samples=521 iops : min= 1, max= 13, avg= 5.19, stdev= 2.83, samples=521 lat (msec) : 10=3.22%, 20=18.68%, 50=17.87%, 100=24.19%, 250=32.00% lat (msec) : 500=3.94%, 1000=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5265, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146075: Mon May 25 04:28:17 2026 read: IOPS=5, BW=21.0KiB/s (22.5kB/s)(5940KiB/270179msec) clat (msec): min=5, max=1029, avg=35.93, stdev=46.62 lat (msec): min=5, max=1029, avg=35.93, stdev=46.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 80], 95.00th=[ 113], | 99.00th=[ 186], 99.50th=[ 243], 99.90th=[ 393], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 88, per=28.26%, avg=24.87, stdev=17.35, samples=461 iops : min= 1, max= 22, avg= 5.59, stdev= 4.39, samples=461 write: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6348KiB/270179msec); 0 zone resets clat (msec): min=39, max=887, avg=136.41, stdev=74.10 lat (msec): min=39, max=887, avg=136.41, stdev=74.10 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 117], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 226], 95.00th=[ 279], | 99.00th=[ 418], 99.50th=[ 498], 99.90th=[ 609], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 48, per=24.93%, avg=23.18, stdev=11.04, samples=527 iops : min= 1, max= 12, avg= 5.16, stdev= 2.83, samples=527 lat (msec) : 10=2.99%, 20=19.21%, 50=17.48%, 100=24.19%, 250=32.16% lat (msec) : 500=3.71%, 750=0.20%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.27%, ctx=5234, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146078: Mon May 25 04:28:17 2026 read: IOPS=5, BW=22.3KiB/s (22.9kB/s)(6028KiB/269932msec) clat (msec): min=5, max=397, avg=36.04, stdev=37.67 lat (msec): min=5, max=397, avg=36.04, stdev=37.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 169], 99.50th=[ 220], 99.90th=[ 368], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 86, per=28.30%, avg=24.91, stdev=16.47, samples=468 iops : min= 1, max= 21, avg= 5.60, stdev= 4.17, samples=468 write: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6260KiB/269932msec); 0 zone resets clat (msec): min=33, max=1190, avg=137.54, stdev=78.96 lat (msec): min=33, max=1190, avg=137.54, stdev=78.96 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 131], | 70.00th=[ 150], 80.00th=[ 180], 90.00th=[ 230], 95.00th=[ 279], | 99.00th=[ 409], 99.50th=[ 472], 99.90th=[ 969], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 63, per=24.86%, avg=23.12, stdev=11.04, samples=522 iops : min= 1, max= 15, avg= 5.15, stdev= 2.82, samples=522 lat (msec) : 10=3.32%, 20=19.04%, 50=16.93%, 100=24.61%, 250=32.00% lat (msec) : 500=3.94%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.23%, ctx=5162, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146079: Mon May 25 04:28:17 2026 read: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6052KiB/267084msec) clat (msec): min=5, max=365, avg=34.56, stdev=35.88 lat (msec): min=5, max=365, avg=34.57, stdev=35.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 80], 95.00th=[ 110], | 99.00th=[ 176], 99.50th=[ 201], 99.90th=[ 292], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 103, per=29.17%, avg=25.67, stdev=18.37, samples=456 iops : min= 1, max= 25, avg= 5.78, stdev= 4.64, samples=456 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6236KiB/267084msec); 0 zone resets clat (msec): min=39, max=1095, avg=137.51, stdev=72.99 lat (msec): min=39, max=1095, avg=137.51, stdev=72.99 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 94], 40.00th=[ 108], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 153], 80.00th=[ 180], 90.00th=[ 226], 95.00th=[ 284], | 99.00th=[ 380], 99.50th=[ 414], 99.90th=[ 667], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 48, per=24.84%, avg=23.11, stdev=10.74, samples=520 iops : min= 1, max= 12, avg= 5.14, stdev= 2.75, samples=520 lat (msec) : 10=3.87%, 20=18.68%, 50=17.74%, 100=23.60%, 250=32.32% lat (msec) : 500=3.68%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5161, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=88.9KiB/s (91.0kB/s), 21.0KiB/s-22.7KiB/s (22.5kB/s-23.2kB/s), io=23.4MiB (24.6MB), run=267084-270179msec WRITE: bw=93.0KiB/s (95.3kB/s), 23.2KiB/s-23.5KiB/s (23.7kB/s-24.1kB/s), io=24.6MiB (25.7MB), run=267084-270179msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146133: Mon May 25 04:29:00 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(5920KiB/31244msec) clat (usec): min=34, max=219716, avg=43745.42, stdev=32149.91 lat (usec): min=34, max=219718, avg=43746.88, stdev=32149.95 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 71], 20.00th=[ 21103], | 30.00th=[ 28443], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 55313], 80.00th=[ 64226], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[156238], 99.50th=[185598], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 63, max= 467, per=24.35%, avg=186.54, stdev=69.83, samples=61 iops : min= 3, max= 29, avg=10.92, stdev= 4.42, samples=61 write: IOPS=12, BW=204KiB/s (209kB/s)(6368KiB/31244msec); 0 zone resets clat (usec): min=1582, max=328905, avg=37410.95, stdev=38052.04 lat (usec): min=1584, max=328908, avg=37429.47, stdev=38041.56 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1975], 10.00th=[ 3228], 20.00th=[ 6194], | 30.00th=[ 9503], 40.00th=[ 15008], 50.00th=[ 26870], 60.00th=[ 40109], | 70.00th=[ 51643], 80.00th=[ 65274], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[170918], 99.50th=[179307], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 411, per=25.07%, avg=202.08, stdev=81.27, samples=61 iops : min= 1, max= 25, avg=11.90, stdev= 5.15, samples=61 lat (usec) : 50=0.91%, 100=5.73%, 250=0.78%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.73%, 4=4.30%, 10=9.51%, 20=8.07%, 50=32.81% lat (msec) : 100=29.56%, 250=4.95%, 500=0.13% cpu : usr=0.08%, sys=5.79%, ctx=1536, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146134: Mon May 25 04:29:00 2026 read: IOPS=11, BW=184KiB/s (189kB/s)(5744KiB/31161msec) clat (usec): min=38, max=450119, avg=46394.57, stdev=41417.64 lat (usec): min=38, max=450120, avg=46396.57, stdev=41417.52 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 21103], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 50070], | 70.00th=[ 58459], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[198181], 99.50th=[274727], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 63, max= 383, per=23.93%, avg=183.28, stdev=66.24, samples=61 iops : min= 3, max= 23, avg=10.70, stdev= 4.13, samples=61 write: IOPS=13, BW=210KiB/s (215kB/s)(6544KiB/31161msec); 0 zone resets clat (usec): min=1550, max=262978, avg=35242.69, stdev=35856.20 lat (usec): min=1552, max=262981, avg=35247.76, stdev=35855.26 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2114], 10.00th=[ 3392], 20.00th=[ 6194], | 30.00th=[ 9765], 40.00th=[ 14484], 50.00th=[ 21627], 60.00th=[ 30278], | 70.00th=[ 46400], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[147850], 99.50th=[160433], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 576, per=26.32%, avg=212.10, stdev=102.75, samples=60 iops : min= 1, max= 36, avg=12.52, stdev= 6.50, samples=60 lat (usec) : 50=0.65%, 100=6.38%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=2.60%, 4=4.56%, 10=9.24%, 20=10.29%, 50=32.29% lat (msec) : 100=27.73%, 250=5.21%, 500=0.39% cpu : usr=0.08%, sys=5.40%, ctx=1498, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146135: Mon May 25 04:29:00 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30316msec) clat (usec): min=36, max=194107, avg=43393.94, stdev=32300.96 lat (usec): min=36, max=194109, avg=43395.33, stdev=32301.00 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 19530], | 30.00th=[ 27132], 40.00th=[ 32375], 50.00th=[ 40633], 60.00th=[ 45876], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 82314], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[168821], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 61, max= 443, per=27.02%, avg=206.98, stdev=84.03, samples=59 iops : min= 3, max= 27, avg=12.19, stdev= 5.35, samples=59 write: IOPS=12, BW=199KiB/s (204kB/s)(6032KiB/30316msec); 0 zone resets clat (usec): min=1636, max=271668, avg=34950.78, stdev=37040.76 lat (usec): min=1639, max=271671, avg=34953.20, stdev=37040.67 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1909], 10.00th=[ 2802], 20.00th=[ 5211], | 30.00th=[ 8455], 40.00th=[ 13566], 50.00th=[ 22414], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[109577], | 99.00th=[162530], 99.50th=[200279], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 383, per=24.83%, avg=200.16, stdev=70.60, samples=58 iops : min= 3, max= 23, avg=11.76, stdev= 4.44, samples=58 lat (usec) : 50=0.91%, 100=6.77%, 250=0.39%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=3.12%, 4=4.56%, 10=9.11%, 20=8.85%, 50=33.07% lat (msec) : 100=26.69%, 250=5.47%, 500=0.13% cpu : usr=0.05%, sys=5.73%, ctx=1518, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146136: Mon May 25 04:29:00 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30883msec) clat (usec): min=35, max=292035, avg=44900.23, stdev=37454.45 lat (usec): min=36, max=292037, avg=44901.59, stdev=37454.42 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 3949], | 30.00th=[ 26346], 40.00th=[ 33817], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 60031], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[106431], | 99.00th=[173016], 99.50th=[204473], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 347, per=25.22%, avg=193.18, stdev=69.36, samples=60 iops : min= 1, max= 21, avg=11.33, stdev= 4.44, samples=60 write: IOPS=12, BW=203KiB/s (207kB/s)(6256KiB/30883msec); 0 zone resets clat (usec): min=1692, max=269204, avg=35225.56, stdev=37718.18 lat (usec): min=1695, max=269206, avg=35228.36, stdev=37717.81 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2114], 10.00th=[ 3097], 20.00th=[ 5800], | 30.00th=[ 8455], 40.00th=[ 12387], 50.00th=[ 19792], 60.00th=[ 32900], | 70.00th=[ 45351], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[113771], | 99.00th=[164627], 99.50th=[170918], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 411, per=24.94%, avg=201.02, stdev=84.15, samples=60 iops : min= 3, max= 25, avg=11.82, stdev= 5.32, samples=60 lat (usec) : 50=0.91%, 100=7.42%, 250=0.78%, 500=0.13%, 750=0.26% lat (msec) : 2=2.21%, 4=5.08%, 10=11.46%, 20=9.51%, 50=28.91% lat (msec) : 100=26.82%, 250=6.25%, 500=0.26% cpu : usr=0.07%, sys=5.66%, ctx=1515, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=767KiB/s (785kB/s), 184KiB/s-206KiB/s (189kB/s-211kB/s), io=23.4MiB (24.5MB), run=30316-31244msec WRITE: bw=807KiB/s (826kB/s), 199KiB/s-210KiB/s (204kB/s-215kB/s), io=24.6MiB (25.8MB), run=30316-31244msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146139: Mon May 25 04:29:44 2026 read: IOPS=4, BW=79.7KiB/s (81.6kB/s)(5920KiB/74295msec) clat (msec): min=7, max=338, avg=45.28, stdev=47.12 lat (msec): min=7, max=338, avg=45.29, stdev=47.12 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 95], 95.00th=[ 131], | 99.00th=[ 257], 99.50th=[ 309], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 384, per=28.58%, avg=91.17, stdev=56.17, samples=128 iops : min= 1, max= 24, avg= 4.93, stdev= 3.60, samples=128 write: IOPS=5, BW=85.7KiB/s (87.8kB/s)(6368KiB/74295msec); 0 zone resets clat (msec): min=49, max=424, avg=144.36, stdev=57.74 lat (msec): min=49, max=424, avg=144.37, stdev=57.74 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 80], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 124], 50.00th=[ 133], 60.00th=[ 146], | 70.00th=[ 163], 80.00th=[ 180], 90.00th=[ 230], 95.00th=[ 262], | 99.00th=[ 309], 99.50th=[ 363], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 26, max= 222, per=25.73%, avg=86.45, stdev=38.93, samples=145 iops : min= 1, max= 13, avg= 4.63, stdev= 2.49, samples=145 lat (msec) : 10=0.26%, 20=13.28%, 50=22.53%, 100=18.88%, 250=41.28% lat (msec) : 500=3.78% cpu : usr=0.03%, sys=1.34%, ctx=1319, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146140: Mon May 25 04:29:44 2026 read: IOPS=4, BW=76.6KiB/s (78.5kB/s)(5744KiB/74973msec) clat (msec): min=7, max=295, avg=42.14, stdev=41.39 lat (msec): min=7, max=295, avg=42.15, stdev=41.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 93], 95.00th=[ 131], | 99.00th=[ 215], 99.50th=[ 241], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 27, max= 279, per=28.64%, avg=91.35, stdev=59.60, samples=124 iops : min= 1, max= 17, avg= 4.96, stdev= 3.72, samples=124 write: IOPS=5, BW=87.3KiB/s (89.4kB/s)(6544KiB/74973msec); 0 zone resets clat (msec): min=42, max=370, avg=146.12, stdev=60.77 lat (msec): min=42, max=370, avg=146.13, stdev=60.77 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 72], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 107], 40.00th=[ 123], 50.00th=[ 134], 60.00th=[ 148], | 70.00th=[ 169], 80.00th=[ 190], 90.00th=[ 228], 95.00th=[ 266], | 99.00th=[ 338], 99.50th=[ 359], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 27, max= 192, per=26.56%, avg=89.26, stdev=37.46, samples=144 iops : min= 1, max= 12, avg= 4.80, stdev= 2.42, samples=144 lat (msec) : 10=1.17%, 20=12.89%, 50=22.79%, 100=18.36%, 250=41.41% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.27%, ctx=1257, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146141: Mon May 25 04:29:44 2026 read: IOPS=5, BW=87.1KiB/s (89.2kB/s)(6256KiB/71797msec) clat (msec): min=6, max=254, avg=37.04, stdev=33.28 lat (msec): min=6, max=254, avg=37.04, stdev=33.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 169], 99.50th=[ 220], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 30, max= 287, per=30.49%, avg=97.28, stdev=63.58, samples=127 iops : min= 1, max= 17, avg= 5.29, stdev= 4.05, samples=127 write: IOPS=5, BW=84.0KiB/s (86.0kB/s)(6032KiB/71797msec); 0 zone resets clat (msec): min=56, max=498, avg=151.79, stdev=65.44 lat (msec): min=56, max=498, avg=151.81, stdev=65.47 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 75], 10.00th=[ 83], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 157], | 70.00th=[ 176], 80.00th=[ 197], 90.00th=[ 241], 95.00th=[ 262], | 99.00th=[ 393], 99.50th=[ 435], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 26, max= 159, per=24.86%, avg=83.52, stdev=33.83, samples=142 iops : min= 1, max= 9, avg= 4.44, stdev= 2.19, samples=142 lat (msec) : 10=0.65%, 20=14.45%, 50=26.95%, 100=16.67%, 250=37.63% lat (msec) : 500=3.65% cpu : usr=0.03%, sys=1.27%, ctx=1266, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146142: Mon May 25 04:29:44 2026 read: IOPS=5, BW=82.6KiB/s (84.6kB/s)(6032KiB/72998msec) clat (msec): min=8, max=301, avg=40.61, stdev=39.13 lat (msec): min=8, max=301, avg=40.61, stdev=39.13 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 79], 95.00th=[ 127], | 99.00th=[ 218], 99.50th=[ 264], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 281, per=29.29%, avg=93.43, stdev=58.26, samples=126 iops : min= 1, max= 17, avg= 5.07, stdev= 3.67, samples=126 write: IOPS=5, BW=85.7KiB/s (87.8kB/s)(6256KiB/72998msec); 0 zone resets clat (msec): min=46, max=504, avg=147.28, stdev=62.91 lat (msec): min=46, max=504, avg=147.28, stdev=62.91 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 75], 10.00th=[ 83], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 124], 50.00th=[ 133], 60.00th=[ 144], | 70.00th=[ 167], 80.00th=[ 192], 90.00th=[ 228], 95.00th=[ 271], | 99.00th=[ 351], 99.50th=[ 430], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 25, max= 191, per=25.90%, avg=87.04, stdev=35.59, samples=141 iops : min= 1, max= 11, avg= 4.65, stdev= 2.28, samples=141 lat (msec) : 10=0.65%, 20=12.63%, 50=25.65%, 100=18.49%, 250=39.32% lat (msec) : 500=3.12%, 750=0.13% cpu : usr=0.03%, sys=1.32%, ctx=1287, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=319KiB/s (327kB/s), 76.6KiB/s-87.1KiB/s (78.5kB/s-89.2kB/s), io=23.4MiB (24.5MB), run=71797-74973msec WRITE: bw=336KiB/s (344kB/s), 84.0KiB/s-87.3KiB/s (86.0kB/s-89.4kB/s), io=24.6MiB (25.8MB), run=71797-74973msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146162: Mon May 25 04:30:03 2026 read: IOPS=1, BW=1089KiB/s (1116kB/s)(7168KiB/6580msec) clat (msec): min=69, max=2488, avg=525.50, stdev=874.54 lat (msec): min=69, max=2488, avg=525.50, stdev=874.54 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 120], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 146], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 435], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1946, max= 4345, per=100.00%, avg=3454.00, stdev=1313.13, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=778KiB/s (797kB/s)(5120KiB/6580msec); 0 zone resets clat (msec): min=347, max=931, avg=554.85, stdev=226.23 lat (msec): min=348, max=931, avg=555.01, stdev=226.30 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1946, max= 2043, per=57.80%, avg=2017.20, stdev=40.99, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=2.57%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146163: Mon May 25 04:30:03 2026 read: IOPS=0, BW=254KiB/s (260kB/s)(2048KiB/8059msec) clat (msec): min=172, max=372, avg=272.44, stdev=140.88 lat (msec): min=172, max=372, avg=272.44, stdev=140.88 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1475, max= 2019, per=70.08%, avg=1747.00, stdev=384.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1271KiB/s (1301kB/s)(10.0MiB/8059msec); 0 zone resets clat (msec): min=154, max=3197, avg=721.80, stdev=918.12 lat (msec): min=154, max=3197, avg=722.01, stdev=918.09 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 259], | 30.00th=[ 279], 40.00th=[ 313], 50.00th=[ 317], 60.00th=[ 418], | 70.00th=[ 481], 80.00th=[ 600], 90.00th=[ 1200], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 1996, max= 4087, per=74.59%, avg=2603.29, stdev=981.62, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.35%, ctx=70, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146164: Mon May 25 04:30:03 2026 read: IOPS=0, BW=777KiB/s (795kB/s)(6144KiB/7911msec) clat (msec): min=78, max=1058, avg=411.81, stdev=353.97 lat (msec): min=78, max=1058, avg=411.81, stdev=353.97 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 220], 50.00th=[ 220], 60.00th=[ 460], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1996, max= 2043, per=81.44%, avg=2030.40, stdev=19.64, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=777KiB/s (795kB/s)(6144KiB/7911msec); 0 zone resets clat (msec): min=255, max=3422, avg=894.83, stdev=1247.30 lat (msec): min=256, max=3422, avg=895.66, stdev=1247.18 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 451], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1946, max= 2790, per=61.95%, avg=2162.00, stdev=353.16, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.25%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146165: Mon May 25 04:30:03 2026 read: IOPS=0, BW=623KiB/s (638kB/s)(5120KiB/8214msec) clat (msec): min=91, max=523, avg=255.55, stdev=191.62 lat (msec): min=91, max=523, avg=255.56, stdev=191.61 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1996, max= 6107, per=100.00%, avg=4051.50, stdev=2906.92, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=873KiB/s (894kB/s)(7168KiB/8214msec); 0 zone resets clat (msec): min=210, max=4822, avg=969.47, stdev=1701.97 lat (msec): min=210, max=4822, avg=969.57, stdev=1701.98 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 230], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 351], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 493], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 1471, max= 2043, per=54.30%, avg=1895.00, stdev=239.72, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.95%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2493KiB/s (2553kB/s), 254KiB/s-1089KiB/s (260kB/s-1116kB/s), io=20.0MiB (20.0MB), run=6580-8214msec WRITE: bw=3491KiB/s (3574kB/s), 777KiB/s-1271KiB/s (795kB/s-1301kB/s), io=28.0MiB (29.4MB), run=6580-8214msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146166: Mon May 25 04:30:03 2026 read: IOPS=1, BW=1069KiB/s (1095kB/s)(7168KiB/6703msec) clat (usec): min=771, max=2761.4k, avg=627433.02, stdev=950135.98 lat (usec): min=772, max=2761.4k, avg=627434.56, stdev=950135.89 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], | 20.00th=[ 244319], 30.00th=[ 283116], 40.00th=[ 283116], | 50.00th=[ 333448], 60.00th=[ 371196], 70.00th=[ 371196], | 80.00th=[ 396362], 90.00th=[2768241], 95.00th=[2768241], | 99.00th=[2768241], 99.50th=[2768241], 99.90th=[2768241], | 99.95th=[2768241], 99.99th=[2768241] bw ( KiB/s): min= 1580, max= 4023, per=90.80%, avg=2306.20, stdev=975.80, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=764KiB/s (782kB/s)(5120KiB/6703msec); 0 zone resets clat (msec): min=157, max=1077, avg=410.49, stdev=376.69 lat (msec): min=157, max=1077, avg=410.69, stdev=376.61 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1935, max= 4079, per=74.65%, avg=2654.67, stdev=1233.53, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.30%, ctx=667, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146167: Mon May 25 04:30:03 2026 read: IOPS=0, BW=254KiB/s (260kB/s)(2048KiB/8061msec) clat (msec): min=280, max=424, avg=352.58, stdev=101.92 lat (msec): min=280, max=424, avg=352.58, stdev=101.92 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1563, max= 2023, per=70.59%, avg=1793.00, stdev=325.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1270KiB/s (1301kB/s)(10.0MiB/8061msec); 0 zone resets clat (msec): min=187, max=3126, avg=699.99, stdev=911.97 lat (msec): min=187, max=3126, avg=700.11, stdev=911.97 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 197], | 30.00th=[ 220], 40.00th=[ 275], 50.00th=[ 305], 60.00th=[ 414], | 70.00th=[ 485], 80.00th=[ 506], 90.00th=[ 1284], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 2011, max= 4087, per=75.54%, avg=2686.17, stdev=1014.48, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 0.89, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=7.62%, ctx=241, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146168: Mon May 25 04:30:03 2026 read: IOPS=0, BW=923KiB/s (945kB/s)(6144KiB/6656msec) clat (usec): min=603, max=390621, avg=169371.07, stdev=187045.64 lat (usec): min=604, max=390622, avg=169372.41, stdev=187045.48 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 1565], | 30.00th=[ 1565], 40.00th=[ 2409], 50.00th=[ 2409], 60.00th=[283116], | 70.00th=[337642], 80.00th=[337642], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 1935, max= 2043, per=79.13%, avg=2010.00, stdev=50.74, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=923KiB/s (945kB/s)(6144KiB/6656msec); 0 zone resets clat (msec): min=160, max=3919, avg=897.30, stdev=1483.65 lat (msec): min=160, max=3919, avg=897.46, stdev=1483.61 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 334], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1484, max= 2043, per=52.73%, avg=1875.25, stdev=265.58, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=16.67%, 500=50.00%, >=2000=8.33% cpu : usr=0.00%, sys=5.98%, ctx=164, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146169: Mon May 25 04:30:03 2026 read: IOPS=0, BW=810KiB/s (830kB/s)(5120KiB/6318msec) clat (usec): min=553, max=386511, avg=84552.24, stdev=169313.03 lat (usec): min=554, max=386512, avg=84553.30, stdev=169312.97 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 1319], 40.00th=[ 1319], 50.00th=[ 2540], 60.00th=[ 2540], | 70.00th=[ 31851], 80.00th=[ 31851], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 2039, max= 5807, per=100.00%, avg=3923.00, stdev=2664.38, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1135KiB/s (1162kB/s)(7168KiB/6318msec); 0 zone resets clat (msec): min=159, max=3905, avg=823.52, stdev=1362.57 lat (msec): min=160, max=3905, avg=823.90, stdev=1362.43 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 205], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 460], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1490, max= 4079, per=81.97%, avg=2914.75, stdev=1345.03, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 50=8.33%, 250=16.67%, 500=41.67% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=6.08%, ctx=125, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2541KiB/s (2602kB/s), 254KiB/s-1069KiB/s (260kB/s-1095kB/s), io=20.0MiB (20.0MB), run=6318-8061msec WRITE: bw=3557KiB/s (3642kB/s), 764KiB/s-1270KiB/s (782kB/s-1301kB/s), io=28.0MiB (29.4MB), run=6318-8061msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146181: Mon May 25 04:30:20 2026 read: IOPS=1, BW=5001KiB/s (5121kB/s)(12.0MiB/2457msec) clat (msec): min=752, max=936, avg=818.73, stdev=102.43 lat (msec): min=752, max=936, avg=818.73, stdev=102.43 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8031, max= 8094, per=100.00%, avg=8062.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.45%, sys=13.44%, ctx=276, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146182: Mon May 25 04:30:20 2026 read: IOPS=0, BW=1328KiB/s (1360kB/s)(4096KiB/3085msec) clat (nsec): min=727590k, max=727590k, avg=727590245.00, stdev= 0.00 lat (nsec): min=727591k, max=727591k, avg=727590982.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 5461, max= 5461, per=100.00%, avg=5461.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2655KiB/s (2719kB/s)(8192KiB/3085msec); 0 zone resets clat (msec): min=1073, max=1281, avg=1177.65, stdev=147.46 lat (msec): min=1073, max=1282, avg=1178.10, stdev=147.40 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8078, max= 8078, per=82.51%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.53%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146183: Mon May 25 04:30:20 2026 write: IOPS=0, BW=3671KiB/s (3759kB/s)(12.0MiB/3347msec); 0 zone resets clat (msec): min=613, max=1940, avg=1114.05, stdev=721.17 lat (msec): min=614, max=1941, avg=1115.25, stdev=720.76 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8047, max= 8143, per=82.69%, avg=8095.00, stdev=67.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.65%, ctx=40, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146184: Mon May 25 04:30:20 2026 write: IOPS=0, BW=3789KiB/s (3880kB/s)(12.0MiB/3243msec); 0 zone resets clat (msec): min=919, max=1175, avg=1080.11, stdev=139.62 lat (msec): min=920, max=1176, avg=1080.72, stdev=139.71 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8047, max= 8094, per=82.44%, avg=8070.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.98%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5311KiB/s (5438kB/s), 1328KiB/s-5001KiB/s (1360kB/s-5121kB/s), io=16.0MiB (16.8MB), run=2457-3085msec WRITE: bw=9790KiB/s (10.0MB/s), 2655KiB/s-3789KiB/s (2719kB/s-3880kB/s), io=32.0MiB (33.6MB), run=3085-3347msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146176: Mon May 25 04:30:21 2026 read: IOPS=0, BW=3494KiB/s (3578kB/s)(12.0MiB/3517msec) clat (msec): min=617, max=1609, avg=1134.70, stdev=497.18 lat (msec): min=617, max=1609, avg=1134.70, stdev=497.18 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7907, max= 8126, per=100.00%, avg=8016.50, stdev=154.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.76%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146177: Mon May 25 04:30:21 2026 read: IOPS=0, BW=956KiB/s (979kB/s)(4096KiB/4284msec) clat (nsec): min=1609.3M, max=1609.3M, avg=1609334970.00, stdev= 0.00 lat (nsec): min=1609.3M, max=1609.3M, avg=1609336901.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1603], 5.00th=[ 1603], 10.00th=[ 1603], 20.00th=[ 1603], | 30.00th=[ 1603], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1912KiB/s (1958kB/s)(8192KiB/4284msec); 0 zone resets clat (msec): min=271, max=2280, avg=1275.66, stdev=1420.45 lat (msec): min=273, max=2280, avg=1277.00, stdev=1419.15 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.09%, sys=3.36%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146179: Mon May 25 04:30:21 2026 write: IOPS=1, BW=6744KiB/s (6906kB/s)(12.0MiB/1822msec); 0 zone resets clat (msec): min=390, max=752, avg=563.62, stdev=181.70 lat (msec): min=390, max=753, avg=564.30, stdev=181.75 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 5520, max= 8175, per=89.53%, avg=6847.50, stdev=1877.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.22%, sys=5.44%, ctx=52, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146180: Mon May 25 04:30:21 2026 write: IOPS=0, BW=3996KiB/s (4092kB/s)(12.0MiB/3075msec); 0 zone resets clat (msec): min=244, max=2378, avg=1009.35, stdev=1188.27 lat (msec): min=246, max=2378, avg=1010.21, stdev=1187.78 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 6059, max= 8175, per=93.06%, avg=7117.00, stdev=1496.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=2.70%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3824KiB/s (3916kB/s), 956KiB/s-3494KiB/s (979kB/s-3578kB/s), io=16.0MiB (16.8MB), run=3517-4284msec WRITE: bw=7649KiB/s (7833kB/s), 1912KiB/s-6744KiB/s (1958kB/s-6906kB/s), io=32.0MiB (33.6MB), run=1822-4284msec