== sanity test 398b: DIO and buffer IO race ============== 01:30:40 (1773207040) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 9.04812 s, 5.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181518: Wed Mar 11 01:33:57 2026 read: IOPS=8, BW=35.7KiB/s (36.5kB/s)(5992KiB/168027msec) clat (usec): min=217, max=1264.1k, avg=61878.47, stdev=50558.59 lat (usec): min=218, max=1264.1k, avg=61884.78, stdev=50568.78 clat percentiles (usec): | 1.00th=[ 273], 5.00th=[ 17433], 10.00th=[ 23462], | 20.00th=[ 31851], 30.00th=[ 38011], 40.00th=[ 44827], | 50.00th=[ 52691], 60.00th=[ 61604], 70.00th=[ 71828], | 80.00th=[ 85459], 90.00th=[ 108528], 95.00th=[ 131597], | 99.00th=[ 229639], 99.50th=[ 258999], 99.90th=[ 333448], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 7, max= 95, per=25.27%, avg=35.63, stdev=16.30, samples=325 iops : min= 1, max= 23, avg= 8.22, stdev= 4.09, samples=325 write: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6296KiB/168027msec); 0 zone resets clat (usec): min=1006, max=459886, avg=47454.82, stdev=48271.82 lat (usec): min=1008, max=459887, avg=47462.50, stdev=48291.78 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1631], 10.00th=[ 2376], 20.00th=[ 6521], | 30.00th=[ 12649], 40.00th=[ 23200], 50.00th=[ 33817], 60.00th=[ 45351], | 70.00th=[ 61080], 80.00th=[ 81265], 90.00th=[110625], 95.00th=[139461], | 99.00th=[210764], 99.50th=[238027], 99.90th=[371196], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 7, max= 120, per=25.38%, avg=37.56, stdev=17.66, samples=324 iops : min= 1, max= 30, avg= 8.71, stdev= 4.46, samples=324 lat (usec) : 250=0.29%, 500=0.65%, 750=0.10%, 1000=0.10% lat (msec) : 2=4.49%, 4=3.26%, 10=6.38%, 20=6.77%, 50=33.24% lat (msec) : 100=31.71%, 250=12.60%, 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=4.64%, ctx=6886, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181519: Wed Mar 11 01:33:57 2026 read: IOPS=9, BW=36.5KiB/s (37.3kB/s)(5940KiB/162852msec) clat (usec): min=167, max=306574, avg=61812.59, stdev=38494.06 lat (usec): min=167, max=306576, avg=61814.08, stdev=38494.03 clat percentiles (usec): | 1.00th=[ 253], 5.00th=[ 17957], 10.00th=[ 24249], 20.00th=[ 32375], | 30.00th=[ 39060], 40.00th=[ 45876], 50.00th=[ 53740], 60.00th=[ 62129], | 70.00th=[ 72877], 80.00th=[ 86508], 90.00th=[108528], 95.00th=[135267], | 99.00th=[196084], 99.50th=[225444], 99.90th=[263193], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 5, max= 72, per=25.91%, avg=36.54, stdev=14.86, samples=315 iops : min= 1, max= 18, avg= 8.45, stdev= 3.75, samples=315 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6348KiB/162852msec); 0 zone resets clat (usec): min=1184, max=1302.6k, avg=44426.69, stdev=56192.58 lat (usec): min=1185, max=1302.6k, avg=44429.89, stdev=56192.11 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1663], 10.00th=[ 2507], | 20.00th=[ 6259], 30.00th=[ 10683], 40.00th=[ 18744], | 50.00th=[ 28705], 60.00th=[ 40633], 70.00th=[ 54789], | 80.00th=[ 76022], 90.00th=[ 106431], 95.00th=[ 137364], | 99.00th=[ 189793], 99.50th=[ 238027], 99.90th=[ 421528], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 7, max= 103, per=26.25%, avg=38.85, stdev=18.99, samples=317 iops : min= 1, max= 25, avg= 9.03, stdev= 4.79, samples=317 lat (usec) : 250=0.36%, 500=0.68%, 750=0.13%, 1000=0.03% lat (msec) : 2=4.20%, 4=3.81%, 10=7.10%, 20=8.17%, 50=32.42% lat (msec) : 100=30.44%, 250=12.43%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=4.65%, ctx=6703, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181520: Wed Mar 11 01:33:57 2026 read: IOPS=9, BW=36.7KiB/s (37.5kB/s)(6028KiB/164392msec) clat (usec): min=203, max=1289.3k, avg=61165.79, stdev=48192.00 lat (usec): min=204, max=1289.3k, avg=61168.48, stdev=48192.11 clat percentiles (usec): | 1.00th=[ 265], 5.00th=[ 17171], 10.00th=[ 23462], | 20.00th=[ 32113], 30.00th=[ 39584], 40.00th=[ 45876], | 50.00th=[ 52167], 60.00th=[ 62129], 70.00th=[ 71828], | 80.00th=[ 84411], 90.00th=[ 108528], 95.00th=[ 127402], | 99.00th=[ 179307], 99.50th=[ 204473], 99.90th=[ 295699], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 5, max= 95, per=25.79%, avg=36.36, stdev=15.80, samples=321 iops : min= 1, max= 23, avg= 8.40, stdev= 3.97, samples=321 write: IOPS=9, BW=38.1KiB/s (38.0kB/s)(6260KiB/164392msec); 0 zone resets clat (usec): min=1070, max=368172, avg=45819.92, stdev=48373.63 lat (usec): min=1071, max=368174, avg=45825.34, stdev=48371.32 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1663], 10.00th=[ 2376], 20.00th=[ 5997], | 30.00th=[ 11469], 40.00th=[ 20841], 50.00th=[ 31589], 60.00th=[ 42730], | 70.00th=[ 57410], 80.00th=[ 77071], 90.00th=[111674], 95.00th=[145753], | 99.00th=[214959], 99.50th=[240124], 99.90th=[320865], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 94, per=25.63%, avg=37.94, stdev=18.28, samples=319 iops : min= 1, max= 23, avg= 8.80, stdev= 4.62, samples=319 lat (usec) : 250=0.33%, 500=0.91%, 750=0.13%, 1000=0.03% lat (msec) : 2=4.23%, 4=3.42%, 10=7.00%, 20=7.13%, 50=33.11% lat (msec) : 100=30.89%, 250=12.53%, 500=0.26%, 2000=0.03% cpu : usr=0.05%, sys=4.61%, ctx=6678, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181521: Wed Mar 11 01:33:57 2026 read: IOPS=8, BW=35.7KiB/s (36.6kB/s)(6052KiB/169296msec) clat (usec): min=207, max=400921, avg=60611.81, stdev=38907.56 lat (usec): min=208, max=400922, avg=60616.77, stdev=38907.14 clat percentiles (usec): | 1.00th=[ 251], 5.00th=[ 16712], 10.00th=[ 22676], 20.00th=[ 30540], | 30.00th=[ 38011], 40.00th=[ 45351], 50.00th=[ 53216], 60.00th=[ 61080], | 70.00th=[ 71828], 80.00th=[ 84411], 90.00th=[108528], 95.00th=[135267], | 99.00th=[187696], 99.50th=[210764], 99.90th=[304088], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 87, per=25.53%, avg=36.00, stdev=15.81, samples=324 iops : min= 1, max= 21, avg= 8.31, stdev= 3.99, samples=324 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6236KiB/169296msec); 0 zone resets clat (usec): min=792, max=1268.8k, avg=49411.19, stdev=57657.62 lat (usec): min=793, max=1268.8k, avg=49415.47, stdev=57657.64 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1631], 10.00th=[ 2147], | 20.00th=[ 6783], 30.00th=[ 13698], 40.00th=[ 24773], | 50.00th=[ 35914], 60.00th=[ 47449], 70.00th=[ 61604], | 80.00th=[ 83362], 90.00th=[ 114820], 95.00th=[ 143655], | 99.00th=[ 214959], 99.50th=[ 261096], 99.90th=[ 392168], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 7, max= 111, per=24.75%, avg=36.63, stdev=17.46, samples=328 iops : min= 1, max= 27, avg= 8.48, stdev= 4.41, samples=328 lat (usec) : 250=0.49%, 500=0.68%, 750=0.13%, 1000=0.23% lat (msec) : 2=4.46%, 4=2.70%, 10=6.15%, 20=7.16%, 50=31.84% lat (msec) : 100=32.88%, 250=12.96%, 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=4.55%, ctx=6771, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=142KiB/s (145kB/s), 35.7KiB/s-36.7KiB/s (36.5kB/s-37.5kB/s), io=23.4MiB (24.6MB), run=162852-169296msec WRITE: bw=148KiB/s (152kB/s), 36.8KiB/s-38.0KiB/s (37.7kB/s-39.9kB/s), io=24.6MiB (25.7MB), run=162852-169296msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181514: Wed Mar 11 01:34:43 2026 read: IOPS=6, BW=27.9KiB/s (28.6kB/s)(5992KiB/214742msec) clat (msec): min=5, max=1352, avg=56.97, stdev=63.73 lat (msec): min=5, max=1352, avg=56.98, stdev=63.73 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 57], 80.00th=[ 83], 90.00th=[ 130], 95.00th=[ 174], | 99.00th=[ 253], 99.50th=[ 296], 99.90th=[ 493], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 103, per=26.33%, avg=29.23, stdev=21.23, samples=396 iops : min= 1, max= 25, avg= 6.63, stdev= 5.34, samples=396 write: IOPS=7, BW=29.3KiB/s (30.0kB/s)(6296KiB/214742msec); 0 zone resets clat (msec): min=16, max=392, avg=81.85, stdev=59.29 lat (msec): min=16, max=392, avg=81.85, stdev=59.29 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 74], | 70.00th=[ 95], 80.00th=[ 123], 90.00th=[ 163], 95.00th=[ 205], | 99.00th=[ 288], 99.50th=[ 334], 99.90th=[ 380], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 95, per=25.67%, avg=29.77, stdev=19.36, samples=408 iops : min= 1, max= 23, avg= 6.75, stdev= 4.86, samples=408 lat (msec) : 10=0.59%, 20=8.27%, 50=43.36%, 100=26.30%, 250=19.86% lat (msec) : 500=1.60%, 2000=0.03% cpu : usr=0.05%, sys=1.97%, ctx=4994, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181515: Wed Mar 11 01:34:43 2026 read: IOPS=6, BW=27.6KiB/s (28.2kB/s)(5940KiB/215556msec) clat (msec): min=7, max=1330, avg=57.66, stdev=63.50 lat (msec): min=7, max=1330, avg=57.66, stdev=63.50 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 60], 80.00th=[ 82], 90.00th=[ 127], 95.00th=[ 184], | 99.00th=[ 262], 99.50th=[ 300], 99.90th=[ 384], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 109, per=26.08%, avg=28.95, stdev=20.65, samples=394 iops : min= 1, max= 27, avg= 6.55, stdev= 5.19, samples=394 write: IOPS=7, BW=29.4KiB/s (30.2kB/s)(6348KiB/215556msec); 0 zone resets clat (msec): min=13, max=439, avg=81.56, stdev=59.77 lat (msec): min=13, max=439, avg=81.57, stdev=59.76 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 75], | 70.00th=[ 94], 80.00th=[ 122], 90.00th=[ 163], 95.00th=[ 201], | 99.00th=[ 300], 99.50th=[ 342], 99.90th=[ 414], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 101, per=25.74%, avg=29.86, stdev=19.77, samples=408 iops : min= 1, max= 25, avg= 6.78, stdev= 4.97, samples=408 lat (msec) : 10=0.46%, 20=8.85%, 50=42.15%, 100=26.99%, 250=19.73% lat (msec) : 500=1.79%, 2000=0.03% cpu : usr=0.05%, sys=1.92%, ctx=5118, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181516: Wed Mar 11 01:34:43 2026 read: IOPS=7, BW=28.0KiB/s (28.7kB/s)(6028KiB/215238msec) clat (msec): min=6, max=434, avg=57.60, stdev=56.75 lat (msec): min=6, max=434, avg=57.60, stdev=56.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 59], 80.00th=[ 85], 90.00th=[ 131], 95.00th=[ 178], | 99.00th=[ 284], 99.50th=[ 334], 99.90th=[ 426], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 149, per=25.80%, avg=28.64, stdev=20.75, samples=406 iops : min= 1, max= 37, avg= 6.48, stdev= 5.23, samples=406 write: IOPS=7, BW=29.1KiB/s (29.8kB/s)(6260KiB/215238msec); 0 zone resets clat (msec): min=14, max=1346, avg=81.73, stdev=67.76 lat (msec): min=14, max=1346, avg=81.73, stdev=67.76 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 74], | 70.00th=[ 93], 80.00th=[ 117], 90.00th=[ 161], 95.00th=[ 201], | 99.00th=[ 305], 99.50th=[ 338], 99.90th=[ 523], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 119, per=25.40%, avg=29.46, stdev=20.36, samples=410 iops : min= 1, max= 29, avg= 6.68, stdev= 5.12, samples=410 lat (msec) : 10=0.75%, 20=9.77%, 50=41.02%, 100=27.34%, 250=19.24% lat (msec) : 500=1.82%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.93%, ctx=5054, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181517: Wed Mar 11 01:34:43 2026 read: IOPS=7, BW=28.2KiB/s (28.9kB/s)(6052KiB/214487msec) clat (msec): min=6, max=442, avg=58.39, stdev=56.53 lat (msec): min=6, max=442, avg=58.39, stdev=56.53 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 62], 80.00th=[ 90], 90.00th=[ 136], 95.00th=[ 174], | 99.00th=[ 271], 99.50th=[ 347], 99.90th=[ 430], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 119, per=26.91%, avg=29.87, stdev=21.41, samples=390 iops : min= 1, max= 29, avg= 6.79, stdev= 5.38, samples=390 write: IOPS=7, BW=29.1KiB/s (29.8kB/s)(6236KiB/214487msec); 0 zone resets clat (msec): min=12, max=1406, avg=80.54, stdev=65.35 lat (msec): min=12, max=1406, avg=80.54, stdev=65.34 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 52], 50.00th=[ 61], 60.00th=[ 72], | 70.00th=[ 93], 80.00th=[ 121], 90.00th=[ 157], 95.00th=[ 194], | 99.00th=[ 275], 99.50th=[ 309], 99.90th=[ 514], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 7, max= 103, per=25.58%, avg=29.67, stdev=19.67, samples=404 iops : min= 1, max= 25, avg= 6.73, stdev= 4.94, samples=404 lat (msec) : 10=0.55%, 20=9.05%, 50=41.15%, 100=27.05%, 250=20.93% lat (msec) : 500=1.20%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.85%, ctx=4972, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=111KiB/s (114kB/s), 27.6KiB/s-28.2KiB/s (28.2kB/s-28.9kB/s), io=23.4MiB (24.6MB), run=214487-215556msec WRITE: bw=117KiB/s (119kB/s), 29.1KiB/s-29.4KiB/s (29.8kB/s-30.2kB/s), io=24.6MiB (25.7MB), run=214487-215556msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181571: Wed Mar 11 01:35:45 2026 read: IOPS=8, BW=138KiB/s (142kB/s)(5920KiB/42815msec) clat (usec): min=179, max=332290, avg=61591.64, stdev=40653.31 lat (usec): min=180, max=332292, avg=61593.36, stdev=40653.47 clat percentiles (usec): | 1.00th=[ 227], 5.00th=[ 281], 10.00th=[ 11994], 20.00th=[ 33162], | 30.00th=[ 41157], 40.00th=[ 47973], 50.00th=[ 54264], 60.00th=[ 64226], | 70.00th=[ 73925], 80.00th=[ 88605], 90.00th=[116917], 95.00th=[132645], | 99.00th=[177210], 99.50th=[204473], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 30, max= 320, per=26.04%, avg=138.00, stdev=63.55, samples=84 iops : min= 1, max= 20, avg= 7.87, stdev= 4.08, samples=84 write: IOPS=9, BW=149KiB/s (152kB/s)(6368KiB/42815msec); 0 zone resets clat (usec): min=1644, max=443318, avg=49338.55, stdev=52468.34 lat (usec): min=1646, max=443321, avg=49343.88, stdev=52468.27 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2638], 10.00th=[ 5866], 20.00th=[ 9765], | 30.00th=[ 14877], 40.00th=[ 22938], 50.00th=[ 35390], 60.00th=[ 47449], | 70.00th=[ 57410], 80.00th=[ 77071], 90.00th=[114820], 95.00th=[141558], | 99.00th=[283116], 99.50th=[295699], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 29, max= 352, per=26.98%, avg=150.55, stdev=69.97, samples=83 iops : min= 1, max= 22, avg= 8.65, stdev= 4.49, samples=83 lat (usec) : 250=1.04%, 500=2.08%, 750=0.65% lat (msec) : 2=1.04%, 4=3.52%, 10=7.03%, 20=9.24%, 50=28.52% lat (msec) : 100=33.20%, 250=12.89%, 500=0.78% cpu : usr=0.08%, sys=4.74%, ctx=1741, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181573: Wed Mar 11 01:35:45 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(5744KiB/43811msec) clat (usec): min=227, max=234836, avg=65610.92, stdev=40271.82 lat (usec): min=228, max=234837, avg=65622.78, stdev=40270.44 clat percentiles (usec): | 1.00th=[ 241], 5.00th=[ 289], 10.00th=[ 17171], 20.00th=[ 36439], | 30.00th=[ 44827], 40.00th=[ 52167], 50.00th=[ 60556], 60.00th=[ 68682], | 70.00th=[ 78119], 80.00th=[ 96994], 90.00th=[114820], 95.00th=[141558], | 99.00th=[196084], 99.50th=[198181], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 253, per=24.75%, avg=131.20, stdev=48.40, samples=86 iops : min= 1, max= 15, avg= 7.43, stdev= 3.07, samples=86 write: IOPS=9, BW=149KiB/s (153kB/s)(6544KiB/43811msec); 0 zone resets clat (usec): min=1773, max=348323, avg=49201.25, stdev=48600.60 lat (usec): min=1775, max=348326, avg=49244.95, stdev=48571.07 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 5], 20.00th=[ 10], | 30.00th=[ 15], 40.00th=[ 26], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 224], 99.50th=[ 236], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 352, per=26.70%, avg=149.01, stdev=70.93, samples=86 iops : min= 1, max= 22, avg= 8.56, stdev= 4.52, samples=86 lat (usec) : 250=0.65%, 500=2.21%, 750=0.65%, 1000=0.13% lat (msec) : 2=0.65%, 4=4.04%, 10=7.68%, 20=7.81%, 50=27.21% lat (msec) : 100=33.72%, 250=15.10%, 500=0.13% cpu : usr=0.06%, sys=4.89%, ctx=1696, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181575: Wed Mar 11 01:35:45 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(6256KiB/45131msec) clat (usec): min=207, max=399542, avg=64233.62, stdev=48844.25 lat (usec): min=208, max=399544, avg=64252.59, stdev=48851.16 clat percentiles (usec): | 1.00th=[ 237], 5.00th=[ 289], 10.00th=[ 10552], 20.00th=[ 32637], | 30.00th=[ 41157], 40.00th=[ 49021], 50.00th=[ 56886], 60.00th=[ 63177], | 70.00th=[ 72877], 80.00th=[ 89654], 90.00th=[115868], 95.00th=[149947], | 99.00th=[283116], 99.50th=[320865], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 28, max= 316, per=26.47%, avg=140.29, stdev=63.81, samples=87 iops : min= 1, max= 19, avg= 8.00, stdev= 4.07, samples=87 write: IOPS=8, BW=134KiB/s (137kB/s)(6032KiB/45131msec); 0 zone resets clat (usec): min=1811, max=361104, avg=52172.53, stdev=49028.54 lat (usec): min=1813, max=361107, avg=52174.82, stdev=49028.63 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2278], 10.00th=[ 5145], 20.00th=[ 10159], | 30.00th=[ 16581], 40.00th=[ 29230], 50.00th=[ 42730], 60.00th=[ 53740], | 70.00th=[ 65799], 80.00th=[ 80217], 90.00th=[119014], 95.00th=[139461], | 99.00th=[233833], 99.50th=[312476], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 30, max= 379, per=23.82%, avg=132.94, stdev=63.28, samples=87 iops : min= 1, max= 23, avg= 7.54, stdev= 3.98, samples=87 lat (usec) : 250=0.91%, 500=2.86%, 750=0.26%, 1000=0.13% lat (msec) : 2=1.17%, 4=3.78%, 10=5.60%, 20=7.03%, 50=27.34% lat (msec) : 100=35.68%, 250=14.32%, 500=0.91% cpu : usr=0.06%, sys=4.97%, ctx=1819, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181577: Wed Mar 11 01:35:45 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(6032KiB/42607msec) clat (usec): min=158, max=269524, avg=63122.04, stdev=47257.69 lat (usec): min=158, max=269526, avg=63124.72, stdev=47257.12 clat percentiles (usec): | 1.00th=[ 212], 5.00th=[ 253], 10.00th=[ 453], 20.00th=[ 28967], | 30.00th=[ 38536], 40.00th=[ 44827], 50.00th=[ 55313], 60.00th=[ 66847], | 70.00th=[ 79168], 80.00th=[100140], 90.00th=[121111], 95.00th=[143655], | 99.00th=[248513], 99.50th=[256902], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 30, max= 319, per=26.46%, avg=140.25, stdev=63.54, samples=83 iops : min= 1, max= 19, avg= 8.00, stdev= 4.04, samples=83 write: IOPS=9, BW=147KiB/s (150kB/s)(6256KiB/42607msec); 0 zone resets clat (usec): min=1754, max=258165, avg=47435.24, stdev=46551.47 lat (usec): min=1755, max=258167, avg=47438.69, stdev=46551.05 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2966], 10.00th=[ 4621], 20.00th=[ 8979], | 30.00th=[ 13960], 40.00th=[ 21103], 50.00th=[ 31327], 60.00th=[ 43779], | 70.00th=[ 61604], 80.00th=[ 86508], 90.00th=[110625], 95.00th=[131597], | 99.00th=[225444], 99.50th=[246416], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 31, max= 384, per=26.57%, avg=148.28, stdev=73.93, samples=82 iops : min= 1, max= 24, avg= 8.52, stdev= 4.72, samples=82 lat (usec) : 250=2.34%, 500=2.99%, 750=0.65%, 1000=0.13% lat (msec) : 2=0.78%, 4=3.65%, 10=7.94%, 20=8.33%, 50=27.99% lat (msec) : 100=27.99%, 250=16.67%, 500=0.52% cpu : usr=0.05%, sys=4.89%, ctx=1695, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=531KiB/s (543kB/s), 131KiB/s-142KiB/s (134kB/s-145kB/s), io=23.4MiB (24.5MB), run=42607-45131msec WRITE: bw=558KiB/s (572kB/s), 134KiB/s-149KiB/s (137kB/s-153kB/s), io=24.6MiB (25.8MB), run=42607-45131msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181572: Wed Mar 11 01:36:03 2026 read: IOPS=5, BW=94.9KiB/s (97.2kB/s)(5920KiB/62359msec) clat (msec): min=8, max=333, avg=67.26, stdev=55.60 lat (msec): min=8, max=333, avg=67.26, stdev=55.60 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 136], 95.00th=[ 190], | 99.00th=[ 292], 99.50th=[ 309], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 29, max= 320, per=25.93%, avg=99.33, stdev=61.78, samples=115 iops : min= 1, max= 20, avg= 5.37, stdev= 3.91, samples=115 write: IOPS=6, BW=102KiB/s (105kB/s)(6368KiB/62359msec); 0 zone resets clat (msec): min=16, max=363, avg=93.60, stdev=61.70 lat (msec): min=16, max=363, avg=93.61, stdev=61.70 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 47], | 30.00th=[ 55], 40.00th=[ 64], 50.00th=[ 74], 60.00th=[ 86], | 70.00th=[ 107], 80.00th=[ 136], 90.00th=[ 184], 95.00th=[ 213], | 99.00th=[ 313], 99.50th=[ 359], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 287, per=25.75%, avg=103.77, stdev=56.22, samples=119 iops : min= 1, max= 17, avg= 5.66, stdev= 3.57, samples=119 lat (msec) : 10=0.26%, 20=3.52%, 50=32.94%, 100=37.11%, 250=23.70% lat (msec) : 500=2.47% cpu : usr=0.04%, sys=1.76%, ctx=1381, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181574: Wed Mar 11 01:36:03 2026 read: IOPS=5, BW=91.9KiB/s (94.1kB/s)(5744KiB/62528msec) clat (msec): min=9, max=408, avg=66.90, stdev=58.30 lat (msec): min=9, max=408, avg=66.91, stdev=58.30 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 21], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 77], 80.00th=[ 100], 90.00th=[ 132], 95.00th=[ 178], | 99.00th=[ 284], 99.50th=[ 384], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 31, max= 287, per=25.38%, avg=97.22, stdev=63.45, samples=116 iops : min= 1, max= 17, avg= 5.25, stdev= 4.01, samples=116 write: IOPS=6, BW=105KiB/s (107kB/s)(6544KiB/62528msec); 0 zone resets clat (msec): min=18, max=375, avg=93.90, stdev=68.15 lat (msec): min=18, max=375, avg=93.91, stdev=68.15 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 32], 10.00th=[ 38], 20.00th=[ 45], | 30.00th=[ 53], 40.00th=[ 60], 50.00th=[ 70], 60.00th=[ 85], | 70.00th=[ 104], 80.00th=[ 129], 90.00th=[ 190], 95.00th=[ 239], | 99.00th=[ 347], 99.50th=[ 359], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 288, per=26.94%, avg=108.56, stdev=64.30, samples=118 iops : min= 1, max= 18, avg= 5.96, stdev= 4.07, samples=118 lat (msec) : 10=0.26%, 20=4.43%, 50=33.46%, 100=36.20%, 250=22.01% lat (msec) : 500=3.65% cpu : usr=0.05%, sys=1.70%, ctx=1259, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181576: Wed Mar 11 01:36:03 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(6256KiB/61742msec) clat (msec): min=11, max=406, avg=63.73, stdev=57.61 lat (msec): min=11, max=406, avg=63.73, stdev=57.61 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 87], 90.00th=[ 128], 95.00th=[ 192], | 99.00th=[ 300], 99.50th=[ 338], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 351, per=28.88%, avg=110.59, stdev=75.39, samples=111 iops : min= 1, max= 21, avg= 6.08, stdev= 4.74, samples=111 write: IOPS=6, BW=97.7KiB/s (100kB/s)(6032KiB/61742msec); 0 zone resets clat (msec): min=19, max=362, avg=96.71, stdev=65.46 lat (msec): min=19, max=362, avg=96.71, stdev=65.46 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 46], | 30.00th=[ 54], 40.00th=[ 66], 50.00th=[ 78], 60.00th=[ 90], | 70.00th=[ 108], 80.00th=[ 136], 90.00th=[ 192], 95.00th=[ 245], | 99.00th=[ 309], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 29, max= 255, per=24.11%, avg=97.18, stdev=55.04, samples=120 iops : min= 1, max= 15, avg= 5.24, stdev= 3.47, samples=120 lat (msec) : 20=5.34%, 50=36.07%, 100=33.59%, 250=21.74%, 500=3.26% cpu : usr=0.04%, sys=1.90%, ctx=1343, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181578: Wed Mar 11 01:36:03 2026 read: IOPS=6, BW=96.0KiB/s (99.3kB/s)(6032KiB/62211msec) clat (msec): min=8, max=379, avg=66.67, stdev=58.57 lat (msec): min=8, max=379, avg=66.67, stdev=58.58 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 93], 90.00th=[ 155], 95.00th=[ 194], | 99.00th=[ 271], 99.50th=[ 351], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 319, per=27.23%, avg=104.29, stdev=64.24, samples=112 iops : min= 1, max= 19, avg= 5.67, stdev= 4.06, samples=112 write: IOPS=6, BW=101KiB/s (103kB/s)(6256KiB/62211msec); 0 zone resets clat (msec): min=20, max=380, avg=93.82, stdev=66.35 lat (msec): min=20, max=380, avg=93.83, stdev=66.35 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 36], 20.00th=[ 45], | 30.00th=[ 54], 40.00th=[ 59], 50.00th=[ 73], 60.00th=[ 86], | 70.00th=[ 103], 80.00th=[ 130], 90.00th=[ 201], 95.00th=[ 247], | 99.00th=[ 317], 99.50th=[ 376], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 318, per=25.95%, avg=104.58, stdev=63.08, samples=117 iops : min= 1, max= 19, avg= 5.71, stdev= 4.00, samples=117 lat (msec) : 10=0.13%, 20=4.56%, 50=35.42%, 100=34.77%, 250=22.53% lat (msec) : 500=2.60% cpu : usr=0.04%, sys=1.77%, ctx=1346, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=383KiB/s (392kB/s), 91.9KiB/s-101KiB/s (94.1kB/s-104kB/s), io=23.4MiB (24.5MB), run=61742-62528msec WRITE: bw=403KiB/s (413kB/s), 97.7KiB/s-105KiB/s (100kB/s-107kB/s), io=24.6MiB (25.8MB), run=61742-62528msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181594: Wed Mar 11 01:36:27 2026 read: IOPS=0, BW=912KiB/s (934kB/s)(7168KiB/7862msec) clat (msec): min=3, max=4501, avg=838.11, stdev=1618.96 lat (msec): min=3, max=4501, avg=838.11, stdev=1618.96 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 190], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 275], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 338], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1615, max= 4015, per=100.00%, avg=2343.40, stdev=951.66, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=651KiB/s (667kB/s)(5120KiB/7862msec); 0 zone resets clat (msec): min=188, max=515, avg=356.52, stdev=123.22 lat (msec): min=188, max=515, avg=356.87, stdev=123.16 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1969, max= 3984, per=87.92%, avg=2653.33, stdev=1152.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 250=16.67%, 500=58.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.85%, ctx=700, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181595: Wed Mar 11 01:36:27 2026 read: IOPS=0, BW=216KiB/s (221kB/s)(2048KiB/9499msec) clat (msec): min=3, max=272, avg=138.35, stdev=190.34 lat (msec): min=3, max=272, avg=138.36, stdev=190.34 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 4], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1570, max= 1992, per=82.61%, avg=1781.00, stdev=298.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1078KiB/s (1104kB/s)(10.0MiB/9499msec); 0 zone resets clat (msec): min=183, max=4074, avg=902.36, stdev=1166.57 lat (msec): min=183, max=4074, avg=902.54, stdev=1166.61 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 186], | 30.00th=[ 205], 40.00th=[ 409], 50.00th=[ 531], 60.00th=[ 542], | 70.00th=[ 659], 80.00th=[ 1116], 90.00th=[ 1133], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 1935, max= 4015, per=74.29%, avg=2242.12, stdev=717.01, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 4=8.33%, 250=25.00%, 500=16.67%, 750=25.00%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=6.58%, ctx=141, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181596: Wed Mar 11 01:36:27 2026 read: IOPS=0, BW=770KiB/s (789kB/s)(6144KiB/7976msec) clat (usec): min=711, max=407477, avg=145944.03, stdev=171108.94 lat (usec): min=712, max=407479, avg=145945.36, stdev=171109.02 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 766], | 30.00th=[ 766], 40.00th=[ 2671], 50.00th=[ 2671], 60.00th=[217056], | 70.00th=[248513], 80.00th=[248513], 90.00th=[408945], 95.00th=[408945], | 99.00th=[408945], 99.50th=[408945], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 1969, max= 4000, per=100.00%, avg=2669.33, stdev=1152.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=770KiB/s (789kB/s)(6144KiB/7976msec); 0 zone resets clat (msec): min=153, max=5109, avg=1180.28, stdev=1932.45 lat (msec): min=153, max=5109, avg=1180.37, stdev=1932.49 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 575], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 1641, max= 2048, per=63.95%, avg=1930.00, stdev=194.22, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.15%, ctx=112, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181597: Wed Mar 11 01:36:27 2026 read: IOPS=0, BW=662KiB/s (678kB/s)(5120KiB/7733msec) clat (usec): min=1083, max=392332, avg=167629.47, stdev=193446.72 lat (usec): min=1084, max=392334, avg=167630.81, stdev=193446.76 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1090], 10.00th=[ 1090], 20.00th=[ 1090], | 30.00th=[ 5014], 40.00th=[ 5014], 50.00th=[ 79168], 60.00th=[ 79168], | 70.00th=[358613], 80.00th=[358613], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 1969, max= 5976, per=100.00%, avg=3972.50, stdev=2833.38, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=927KiB/s (949kB/s)(7168KiB/7733msec); 0 zone resets clat (msec): min=156, max=4982, avg=957.70, stdev=1776.24 lat (msec): min=156, max=4982, avg=957.80, stdev=1776.23 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 234], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 326], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 397], 90.00th=[ 5000], 95.00th=[ 5000], | 99.00th=[ 5000], 99.50th=[ 5000], 99.90th=[ 5000], 99.95th=[ 5000], | 99.99th=[ 5000] bw ( KiB/s): min= 1648, max= 4079, per=85.42%, avg=2578.00, stdev=1312.24, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 10=8.33%, 100=8.33%, 250=16.67%, 500=50.00% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=6.39%, ctx=156, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2156KiB/s (2208kB/s), 216KiB/s-912KiB/s (221kB/s-934kB/s), io=20.0MiB (20.0MB), run=7733-9499msec WRITE: bw=3018KiB/s (3091kB/s), 651KiB/s-1078KiB/s (667kB/s-1104kB/s), io=28.0MiB (29.4MB), run=7733-9499msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181600: Wed Mar 11 01:36:28 2026 read: IOPS=0, BW=795KiB/s (814kB/s)(7168KiB/9019msec) clat (msec): min=130, max=4584, avg=952.24, stdev=1626.47 lat (msec): min=130, max=4584, avg=952.24, stdev=1626.47 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 155], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 279], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 961], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 1799, max= 2023, per=86.19%, avg=1956.40, stdev=90.87, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=568KiB/s (581kB/s)(5120KiB/9019msec); 0 zone resets clat (msec): min=101, max=1020, avg=413.96, stdev=357.72 lat (msec): min=101, max=1021, avg=414.90, stdev=358.06 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 1984, max= 4031, per=84.28%, avg=2679.33, stdev=1170.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=33.33%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.28%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181601: Wed Mar 11 01:36:28 2026 read: IOPS=0, BW=229KiB/s (235kB/s)(2048KiB/8934msec) clat (msec): min=119, max=719, avg=419.83, stdev=424.06 lat (msec): min=119, max=719, avg=419.83, stdev=424.06 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 121], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2027, max= 2039, per=89.56%, avg=2033.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1146KiB/s (1174kB/s)(10.0MiB/8934msec); 0 zone resets clat (msec): min=108, max=3389, avg=800.36, stdev=1082.77 lat (msec): min=108, max=3389, avg=800.61, stdev=1082.68 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 184], | 30.00th=[ 288], 40.00th=[ 321], 50.00th=[ 342], 60.00th=[ 372], | 70.00th=[ 414], 80.00th=[ 435], 90.00th=[ 2165], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 1984, max= 4079, per=95.04%, avg=3021.33, stdev=1115.56, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=2.50%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181602: Wed Mar 11 01:36:28 2026 read: IOPS=0, BW=684KiB/s (700kB/s)(6144KiB/8982msec) clat (msec): min=127, max=393, avg=250.53, stdev=100.80 lat (msec): min=127, max=393, avg=250.54, stdev=100.78 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 239], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2015, max= 4079, per=100.00%, avg=2535.00, stdev=1029.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=684KiB/s (700kB/s)(6144KiB/8982msec); 0 zone resets clat (msec): min=132, max=4815, avg=1227.49, stdev=1781.90 lat (msec): min=132, max=4816, avg=1227.77, stdev=1782.36 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 709], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 1965, max= 2039, per=63.45%, avg=2017.00, stdev=29.66, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.06%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181603: Wed Mar 11 01:36:28 2026 read: IOPS=0, BW=572KiB/s (586kB/s)(5120KiB/8953msec) clat (msec): min=125, max=556, avg=271.62, stdev=168.90 lat (msec): min=125, max=556, avg=271.62, stdev=168.90 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 220], 60.00th=[ 220], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1950, max= 4015, per=100.00%, avg=2671.00, stdev=1164.97, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=801KiB/s (820kB/s)(7168KiB/8953msec); 0 zone resets clat (msec): min=171, max=3744, avg=1072.00, stdev=1244.12 lat (msec): min=171, max=3744, avg=1072.13, stdev=1244.13 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 380], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 642], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 1401], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 1851, max= 4047, per=72.95%, avg=2319.17, stdev=849.46, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.68%, ctx=119, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2271KiB/s (2325kB/s), 229KiB/s-795KiB/s (235kB/s-814kB/s), io=20.0MiB (20.0MB), run=8934-9019msec WRITE: bw=3179KiB/s (3255kB/s), 568KiB/s-1146KiB/s (581kB/s-1174kB/s), io=28.0MiB (29.4MB), run=8934-9019msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181615: Wed Mar 11 01:36:47 2026 read: IOPS=0, BW=3363KiB/s (3444kB/s)(12.0MiB/3654msec) clat (msec): min=1125, max=1204, avg=1151.80, stdev=45.67 lat (msec): min=1125, max=1204, avg=1151.81, stdev=45.68 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8015, max= 8094, per=100.00%, avg=8054.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=1.94%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181616: Wed Mar 11 01:36:47 2026 read: IOPS=0, BW=933KiB/s (955kB/s)(4096KiB/4392msec) clat (nsec): min=1831.8M, max=1831.8M, avg=1831842492.00, stdev= 0.00 lat (nsec): min=1831.8M, max=1831.8M, avg=1831844652.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1838], 5.00th=[ 1838], 10.00th=[ 1838], 20.00th=[ 1838], | 30.00th=[ 1838], 40.00th=[ 1838], 50.00th=[ 1838], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1865KiB/s (1910kB/s)(8192KiB/4392msec); 0 zone resets clat (msec): min=1113, max=1353, avg=1233.60, stdev=169.92 lat (msec): min=1114, max=1354, avg=1234.45, stdev=169.48 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=2.19%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181617: Wed Mar 11 01:36:47 2026 write: IOPS=0, BW=2739KiB/s (2805kB/s)(12.0MiB/4486msec); 0 zone resets clat (msec): min=398, max=2196, avg=1468.42, stdev=946.37 lat (msec): min=399, max=2196, avg=1468.99, stdev=946.31 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 1804], 50.00th=[ 1804], 60.00th=[ 1804], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 7937, max= 8110, per=100.00%, avg=8023.50, stdev=122.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.68%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181618: Wed Mar 11 01:36:47 2026 write: IOPS=0, BW=2885KiB/s (2954kB/s)(12.0MiB/4259msec); 0 zone resets clat (msec): min=632, max=2119, avg=1405.33, stdev=745.07 lat (msec): min=633, max=2120, avg=1405.93, stdev=745.26 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.23%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3730KiB/s (3820kB/s), 933KiB/s-3363KiB/s (955kB/s-3444kB/s), io=16.0MiB (16.8MB), run=3654-4392msec WRITE: bw=7305KiB/s (7480kB/s), 1865KiB/s-2885KiB/s (1910kB/s-2954kB/s), io=32.0MiB (33.6MB), run=4259-4486msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181611: Wed Mar 11 01:36:48 2026 read: IOPS=0, BW=3236KiB/s (3314kB/s)(12.0MiB/3797msec) clat (msec): min=1018, max=1336, avg=1178.99, stdev=158.99 lat (msec): min=1018, max=1336, avg=1178.99, stdev=158.99 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8031, max= 8143, per=100.00%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=11.17%, ctx=587, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181612: Wed Mar 11 01:36:48 2026 read: IOPS=0, BW=1070KiB/s (1095kB/s)(4096KiB/3829msec) clat (nsec): min=938650k, max=938650k, avg=938650098.00, stdev= 0.00 lat (nsec): min=938652k, max=938652k, avg=938652475.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2139KiB/s (2191kB/s)(8192KiB/3829msec); 0 zone resets clat (msec): min=1218, max=1579, avg=1398.74, stdev=255.57 lat (msec): min=1218, max=1581, avg=1399.73, stdev=256.42 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.80%, ctx=291, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181613: Wed Mar 11 01:36:48 2026 write: IOPS=0, BW=2231KiB/s (2284kB/s)(12.0MiB/5509msec); 0 zone resets clat (msec): min=353, max=3616, avg=1739.87, stdev=1686.07 lat (msec): min=353, max=3617, avg=1740.25, stdev=1685.98 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 7984, max= 8031, per=100.00%, avg=8007.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=1.69%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181614: Wed Mar 11 01:36:48 2026 write: IOPS=0, BW=2965KiB/s (3036kB/s)(12.0MiB/4145msec); 0 zone resets clat (msec): min=987, max=2050, avg=1344.30, stdev=611.83 lat (msec): min=988, max=2051, avg=1344.78, stdev=611.81 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.63%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4279KiB/s (4382kB/s), 1070KiB/s-3236KiB/s (1095kB/s-3314kB/s), io=16.0MiB (16.8MB), run=3797-3829msec WRITE: bw=5948KiB/s (6091kB/s), 2139KiB/s-2965KiB/s (2191kB/s-3036kB/s), io=32.0MiB (33.6MB), run=3829-5509msec