== sanity test 398b: DIO and buffer IO race ============== 01:17:53 (1763878673) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.48401 s, 20.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194133: Sun Nov 23 01:18:52 2025 read: IOPS=30, BW=120KiB/s (123kB/s)(5992KiB/49781msec) clat (usec): min=81, max=671736, avg=17701.96, stdev=19831.47 lat (usec): min=81, max=671736, avg=17702.43, stdev=19831.47 clat percentiles (usec): | 1.00th=[ 310], 5.00th=[ 6194], 10.00th=[ 7832], 20.00th=[ 9503], | 30.00th=[ 11076], 40.00th=[ 12911], 50.00th=[ 15401], 60.00th=[ 18220], | 70.00th=[ 20579], 80.00th=[ 23725], 90.00th=[ 28443], 95.00th=[ 33424], | 99.00th=[ 54789], 99.50th=[ 64226], 99.90th=[117965], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 13, max= 192, per=25.24%, avg=120.63, stdev=29.60, samples=99 iops : min= 3, max= 48, avg=29.88, stdev= 7.40, samples=99 write: IOPS=31, BW=126KiB/s (130kB/s)(6296KiB/49781msec); 0 zone resets clat (usec): min=632, max=158416, avg=14652.31, stdev=13836.82 lat (usec): min=633, max=158416, avg=14652.88, stdev=13836.86 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 848], 10.00th=[ 2114], 20.00th=[ 2999], | 30.00th=[ 4047], 40.00th=[ 8291], 50.00th=[ 11207], 60.00th=[ 14222], | 70.00th=[ 18482], 80.00th=[ 24773], 90.00th=[ 33424], 95.00th=[ 41157], | 99.00th=[ 58459], 99.50th=[ 67634], 99.90th=[107480], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 48, max= 200, per=25.52%, avg=127.86, stdev=32.40, samples=98 iops : min= 12, max= 50, avg=31.68, stdev= 8.11, samples=98 lat (usec) : 100=0.16%, 250=0.13%, 500=1.04%, 750=1.95%, 1000=1.07% lat (msec) : 2=2.34%, 4=10.32%, 10=17.15%, 20=35.84%, 50=28.32% lat (msec) : 100=1.53%, 250=0.10%, 750=0.03% cpu : usr=0.05%, sys=22.60%, ctx=7572, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194134: Sun Nov 23 01:18:52 2025 read: IOPS=29, BW=119KiB/s (122kB/s)(5940KiB/49898msec) clat (usec): min=84, max=126690, avg=17595.80, stdev=10931.53 lat (usec): min=84, max=126690, avg=17596.27, stdev=10931.54 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 6652], 10.00th=[ 8029], 20.00th=[ 9765], | 30.00th=[ 11207], 40.00th=[ 12780], 50.00th=[ 15139], 60.00th=[ 18220], | 70.00th=[ 20841], 80.00th=[ 24249], 90.00th=[ 29230], 95.00th=[ 33817], | 99.00th=[ 59507], 99.50th=[ 69731], 99.90th=[121111], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 6, max= 200, per=24.93%, avg=119.18, stdev=32.66, samples=99 iops : min= 1, max= 50, avg=29.52, stdev= 8.26, samples=99 write: IOPS=31, BW=127KiB/s (130kB/s)(6348KiB/49898msec); 0 zone resets clat (usec): min=631, max=656143, avg=14846.54, stdev=20709.89 lat (usec): min=632, max=656144, avg=14847.22, stdev=20709.92 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 1336], 10.00th=[ 2278], 20.00th=[ 3130], | 30.00th=[ 4228], 40.00th=[ 8586], 50.00th=[ 11600], 60.00th=[ 14353], | 70.00th=[ 18220], 80.00th=[ 23987], 90.00th=[ 32375], 95.00th=[ 38536], | 99.00th=[ 55837], 99.50th=[ 77071], 99.90th=[ 95945], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 6, max= 216, per=25.34%, avg=126.95, stdev=35.65, samples=99 iops : min= 1, max= 54, avg=31.45, stdev= 8.93, samples=99 lat (usec) : 100=0.10%, 250=0.20%, 500=0.72%, 750=1.20%, 1000=0.75% lat (msec) : 2=2.47%, 4=10.68%, 10=17.42%, 20=36.65%, 50=28.16% lat (msec) : 100=1.56%, 250=0.07%, 750=0.03% cpu : usr=0.07%, sys=22.71%, ctx=7752, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194135: Sun Nov 23 01:18:52 2025 read: IOPS=30, BW=123KiB/s (126kB/s)(6028KiB/48819msec) clat (usec): min=75, max=657299, avg=17182.58, stdev=19351.13 lat (usec): min=76, max=657300, avg=17183.10, stdev=19351.13 clat percentiles (usec): | 1.00th=[ 289], 5.00th=[ 5669], 10.00th=[ 7701], 20.00th=[ 9503], | 30.00th=[ 10814], 40.00th=[ 12387], 50.00th=[ 14484], 60.00th=[ 17171], | 70.00th=[ 20055], 80.00th=[ 23462], 90.00th=[ 28443], 95.00th=[ 34341], | 99.00th=[ 52691], 99.50th=[ 56886], 99.90th=[112722], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 13, max= 184, per=25.91%, avg=123.86, stdev=32.97, samples=97 iops : min= 3, max= 46, avg=30.68, stdev= 8.23, samples=97 write: IOPS=32, BW=128KiB/s (131kB/s)(6260KiB/48819msec); 0 zone resets clat (usec): min=582, max=99569, avg=14520.72, stdev=13182.35 lat (usec): min=583, max=99569, avg=14521.35, stdev=13182.47 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 1037], 10.00th=[ 2114], 20.00th=[ 2999], | 30.00th=[ 3752], 40.00th=[ 8291], 50.00th=[11469], 60.00th=[14353], | 70.00th=[18744], 80.00th=[24773], 90.00th=[32900], 95.00th=[39584], | 99.00th=[56886], 99.50th=[63701], 99.90th=[90702], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 26, max= 216, per=25.64%, avg=128.43, stdev=33.46, samples=97 iops : min= 6, max= 54, avg=31.82, stdev= 8.32, samples=97 lat (usec) : 100=0.20%, 250=0.16%, 500=1.40%, 750=1.73%, 1000=0.94% lat (msec) : 2=2.18%, 4=11.72%, 10=15.79%, 20=37.08%, 50=27.31% lat (msec) : 100=1.43%, 250=0.03%, 750=0.03% cpu : usr=0.05%, sys=22.73%, ctx=7553, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194136: Sun Nov 23 01:18:52 2025 read: IOPS=30, BW=121KiB/s (124kB/s)(6052KiB/50135msec) clat (usec): min=80, max=72741, avg=17198.26, stdev=10040.40 lat (usec): min=80, max=72742, avg=17198.70, stdev=10040.40 clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 6194], 10.00th=[ 7832], 20.00th=[ 9503], | 30.00th=[11076], 40.00th=[12780], 50.00th=[15270], 60.00th=[17957], | 70.00th=[20579], 80.00th=[23987], 90.00th=[28705], 95.00th=[33817], | 99.00th=[55837], 99.50th=[61080], 99.90th=[68682], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 55, max= 184, per=25.35%, avg=121.16, stdev=27.97, samples=98 iops : min= 13, max= 46, avg=30.01, stdev= 6.99, samples=98 write: IOPS=31, BW=124KiB/s (127kB/s)(6236KiB/50135msec); 0 zone resets clat (usec): min=639, max=665378, avg=15330.14, stdev=21481.16 lat (usec): min=639, max=665379, avg=15331.27, stdev=21481.10 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 1188], 10.00th=[ 2245], 20.00th=[ 3032], | 30.00th=[ 4228], 40.00th=[ 8291], 50.00th=[ 11600], 60.00th=[ 14615], | 70.00th=[ 19268], 80.00th=[ 25822], 90.00th=[ 33162], 95.00th=[ 40109], | 99.00th=[ 57410], 99.50th=[ 68682], 99.90th=[160433], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 19, max= 224, per=24.74%, avg=123.93, stdev=34.68, samples=99 iops : min= 4, max= 56, avg=30.70, stdev= 8.65, samples=99 lat (usec) : 100=0.10%, 250=0.16%, 500=1.40%, 750=1.50%, 1000=0.85% lat (msec) : 2=1.73%, 4=10.84%, 10=17.32%, 20=35.97%, 50=28.39% lat (msec) : 100=1.66%, 250=0.07%, 750=0.03% cpu : usr=0.05%, sys=22.26%, ctx=7762, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=479KiB/s (490kB/s), 119KiB/s-123KiB/s (122kB/s-126kB/s), io=23.4MiB (24.6MB), run=48819-50135msec WRITE: bw=501KiB/s (513kB/s), 124KiB/s-128KiB/s (127kB/s-131kB/s), io=24.6MiB (25.7MB), run=48819-50135msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194138: Sun Nov 23 01:19:05 2025 read: IOPS=23, BW=94.8KiB/s (97.0kB/s)(5992KiB/63228msec) clat (msec): min=3, max=694, avg=18.17, stdev=22.79 lat (msec): min=3, max=694, avg=18.17, stdev=22.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 49], | 99.00th=[ 73], 99.50th=[ 84], 99.90th=[ 117], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 24, max= 328, per=25.20%, avg=95.24, stdev=62.61, samples=124 iops : min= 6, max= 82, avg=23.63, stdev=15.71, samples=124 write: IOPS=24, BW=99.6KiB/s (102kB/s)(6296KiB/63228msec); 0 zone resets clat (msec): min=4, max=163, avg=22.78, stdev=16.70 lat (msec): min=4, max=163, avg=22.78, stdev=16.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 36], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 79], 99.50th=[ 99], 99.90th=[ 132], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 32, max= 296, per=25.19%, avg=99.76, stdev=61.43, samples=124 iops : min= 8, max= 74, avg=24.76, stdev=15.40, samples=124 lat (msec) : 4=0.59%, 10=28.61%, 20=33.92%, 50=31.41%, 100=5.14% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.06%, sys=10.21%, ctx=5482, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194139: Sun Nov 23 01:19:05 2025 read: IOPS=23, BW=93.6KiB/s (95.9kB/s)(5940KiB/63441msec) clat (msec): min=3, max=673, avg=18.05, stdev=22.62 lat (msec): min=3, max=673, avg=18.05, stdev=22.62 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 80], 99.50th=[ 89], 99.90th=[ 125], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 15, max= 320, per=24.93%, avg=94.22, stdev=63.64, samples=125 iops : min= 3, max= 80, avg=23.38, stdev=15.96, samples=125 write: IOPS=25, BW=100KiB/s (102kB/s)(6348KiB/63441msec); 0 zone resets clat (msec): min=4, max=173, avg=22.99, stdev=16.27 lat (msec): min=4, max=173, avg=22.99, stdev=16.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 78], 99.50th=[ 86], 99.90th=[ 110], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 31, max= 320, per=25.36%, avg=100.43, stdev=60.87, samples=125 iops : min= 7, max= 80, avg=24.93, stdev=15.27, samples=125 lat (msec) : 4=0.33%, 10=29.85%, 20=33.30%, 50=31.09%, 100=5.11% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.07%, sys=10.10%, ctx=5394, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194140: Sun Nov 23 01:19:05 2025 read: IOPS=23, BW=95.3KiB/s (97.6kB/s)(6028KiB/63254msec) clat (msec): min=3, max=104, avg=17.91, stdev=14.21 lat (msec): min=3, max=104, avg=17.91, stdev=14.21 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 68], 99.50th=[ 79], 99.90th=[ 104], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 15, max= 384, per=25.45%, avg=96.21, stdev=60.12, samples=125 iops : min= 3, max= 96, avg=23.87, stdev=15.08, samples=125 write: IOPS=24, BW=98.0KiB/s (101kB/s)(6260KiB/63254msec); 0 zone resets clat (msec): min=4, max=681, avg=23.08, stdev=23.61 lat (msec): min=4, max=681, avg=23.08, stdev=23.61 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 54], | 99.00th=[ 86], 99.50th=[ 104], 99.90th=[ 167], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 23, max= 344, per=25.20%, avg=99.79, stdev=62.99, samples=125 iops : min= 5, max= 86, avg=24.77, stdev=15.80, samples=125 lat (msec) : 4=0.49%, 10=28.22%, 20=34.47%, 50=31.67%, 100=4.79% lat (msec) : 250=0.33%, 750=0.03% cpu : usr=0.06%, sys=10.19%, ctx=5453, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194141: Sun Nov 23 01:19:05 2025 read: IOPS=23, BW=95.4KiB/s (97.6kB/s)(6052KiB/63469msec) clat (msec): min=3, max=118, avg=17.64, stdev=14.59 lat (msec): min=3, max=118, avg=17.64, stdev=14.59 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 38], 95.00th=[ 47], | 99.00th=[ 69], 99.50th=[ 85], 99.90th=[ 112], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 16, max= 392, per=25.52%, avg=96.47, stdev=63.51, samples=124 iops : min= 4, max= 98, avg=23.94, stdev=15.92, samples=124 write: IOPS=24, BW=98.3KiB/s (101kB/s)(6236KiB/63469msec); 0 zone resets clat (msec): min=4, max=672, avg=23.50, stdev=23.69 lat (msec): min=4, max=672, avg=23.50, stdev=23.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 89], 99.50th=[ 106], 99.90th=[ 174], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 31, max= 296, per=24.94%, avg=98.77, stdev=60.65, samples=125 iops : min= 7, max= 74, avg=24.51, stdev=15.20, samples=125 lat (msec) : 4=0.29%, 10=30.70%, 20=31.87%, 50=31.97%, 100=4.69% lat (msec) : 250=0.46%, 750=0.03% cpu : usr=0.06%, sys=10.19%, ctx=5428, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=378KiB/s (387kB/s), 93.6KiB/s-95.4KiB/s (95.9kB/s-97.6kB/s), io=23.4MiB (24.6MB), run=63228-63469msec WRITE: bw=396KiB/s (406kB/s), 98.3KiB/s-100KiB/s (101kB/s-102kB/s), io=24.6MiB (25.7MB), run=63228-63469msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194167: Sun Nov 23 01:19:28 2025 read: IOPS=21, BW=348KiB/s (357kB/s)(5920KiB/16996msec) clat (usec): min=71, max=78376, avg=23238.97, stdev=12099.84 lat (usec): min=71, max=78377, avg=23239.52, stdev=12099.86 clat percentiles (usec): | 1.00th=[ 302], 5.00th=[ 6456], 10.00th=[10814], 20.00th=[13566], | 30.00th=[15664], 40.00th=[19006], 50.00th=[21627], 60.00th=[23987], | 70.00th=[29230], 80.00th=[32637], 90.00th=[38536], 95.00th=[44303], | 99.00th=[53216], 99.50th=[73925], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 191, max= 640, per=24.61%, avg=345.55, stdev=115.65, samples=33 iops : min= 11, max= 40, avg=21.12, stdev= 7.32, samples=33 write: IOPS=23, BW=375KiB/s (384kB/s)(6368KiB/16996msec); 0 zone resets clat (usec): min=849, max=78516, avg=20824.76, stdev=13409.25 lat (usec): min=850, max=78516, avg=20825.70, stdev=13409.31 clat percentiles (usec): | 1.00th=[ 2966], 5.00th=[ 4948], 10.00th=[ 6456], 20.00th=[ 9372], | 30.00th=[12387], 40.00th=[15008], 50.00th=[17171], 60.00th=[21627], | 70.00th=[26608], 80.00th=[30278], 90.00th=[36963], 95.00th=[46924], | 99.00th=[67634], 99.50th=[72877], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 160, max= 697, per=25.41%, avg=375.30, stdev=124.65, samples=33 iops : min= 10, max= 43, avg=23.00, stdev= 7.80, samples=33 lat (usec) : 100=0.13%, 250=0.26%, 500=1.30%, 750=0.65%, 1000=0.13% lat (msec) : 2=0.26%, 4=0.91%, 10=11.59%, 20=34.51%, 50=47.27% lat (msec) : 100=2.99% cpu : usr=0.05%, sys=29.69%, ctx=3108, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194168: Sun Nov 23 01:19:28 2025 read: IOPS=21, BW=337KiB/s (345kB/s)(5744KiB/17051msec) clat (usec): min=336, max=73744, avg=23319.73, stdev=12211.74 lat (usec): min=337, max=73745, avg=23320.27, stdev=12211.79 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 8848], 10.00th=[10683], 20.00th=[13304], | 30.00th=[15664], 40.00th=[18744], 50.00th=[21365], 60.00th=[23725], | 70.00th=[27132], 80.00th=[30278], 90.00th=[40109], 95.00th=[47449], | 99.00th=[60556], 99.50th=[71828], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 127, max= 608, per=23.98%, avg=336.73, stdev=130.36, samples=33 iops : min= 7, max= 38, avg=20.58, stdev= 8.17, samples=33 write: IOPS=23, BW=384KiB/s (393kB/s)(6544KiB/17051msec); 0 zone resets clat (usec): min=1074, max=79723, avg=20843.79, stdev=14827.54 lat (usec): min=1075, max=79723, avg=20844.70, stdev=14827.62 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 4359], 10.00th=[ 5407], 20.00th=[ 8225], | 30.00th=[11731], 40.00th=[13698], 50.00th=[17171], 60.00th=[20579], | 70.00th=[26084], 80.00th=[31851], 90.00th=[41157], 95.00th=[50594], | 99.00th=[68682], 99.50th=[73925], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 191, max= 768, per=25.68%, avg=379.27, stdev=139.62, samples=33 iops : min= 11, max= 48, avg=23.24, stdev= 8.76, samples=33 lat (usec) : 500=0.78% lat (msec) : 2=1.04%, 4=1.30%, 10=13.02%, 20=36.20%, 50=43.23% lat (msec) : 100=4.43% cpu : usr=0.07%, sys=29.41%, ctx=3155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194169: Sun Nov 23 01:19:28 2025 read: IOPS=23, BW=376KiB/s (385kB/s)(6256KiB/16626msec) clat (usec): min=98, max=72061, avg=23209.03, stdev=11925.32 lat (usec): min=98, max=72062, avg=23209.78, stdev=11925.21 clat percentiles (usec): | 1.00th=[ 281], 5.00th=[ 5932], 10.00th=[10290], 20.00th=[13304], | 30.00th=[16057], 40.00th=[19268], 50.00th=[22152], 60.00th=[25035], | 70.00th=[28181], 80.00th=[31851], 90.00th=[38011], 95.00th=[45351], | 99.00th=[61604], 99.50th=[63701], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 190, max= 576, per=26.94%, avg=378.19, stdev=103.62, samples=32 iops : min= 11, max= 36, avg=23.19, stdev= 6.50, samples=32 write: IOPS=22, BW=363KiB/s (372kB/s)(6032KiB/16626msec); 0 zone resets clat (usec): min=2034, max=74902, avg=19918.07, stdev=12843.76 lat (usec): min=2036, max=74903, avg=19919.09, stdev=12843.70 clat percentiles (usec): | 1.00th=[ 2835], 5.00th=[ 4424], 10.00th=[ 5407], 20.00th=[ 9503], | 30.00th=[11994], 40.00th=[14746], 50.00th=[17433], 60.00th=[20317], | 70.00th=[24249], 80.00th=[29230], 90.00th=[35914], 95.00th=[47449], | 99.00th=[63177], 99.50th=[70779], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 159, max= 665, per=24.20%, avg=357.44, stdev=127.17, samples=32 iops : min= 9, max= 41, avg=21.91, stdev= 7.96, samples=32 lat (usec) : 100=0.13%, 250=0.26%, 500=0.78%, 750=0.78%, 1000=0.13% lat (msec) : 2=0.13%, 4=1.95%, 10=10.81%, 20=35.81%, 50=46.09% lat (msec) : 100=3.12% cpu : usr=0.04%, sys=29.11%, ctx=3118, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194170: Sun Nov 23 01:19:28 2025 read: IOPS=23, BW=373KiB/s (382kB/s)(6032KiB/16184msec) clat (usec): min=102, max=75829, avg=21881.20, stdev=12131.37 lat (usec): min=103, max=75830, avg=21881.81, stdev=12131.60 clat percentiles (usec): | 1.00th=[ 306], 5.00th=[ 881], 10.00th=[ 9896], 20.00th=[12780], | 30.00th=[15664], 40.00th=[17957], 50.00th=[20579], 60.00th=[22938], | 70.00th=[25822], 80.00th=[29230], 90.00th=[36439], 95.00th=[44827], | 99.00th=[66847], 99.50th=[73925], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 160, max= 672, per=26.55%, avg=372.72, stdev=124.03, samples=32 iops : min= 10, max= 42, avg=22.84, stdev= 7.73, samples=32 write: IOPS=24, BW=387KiB/s (396kB/s)(6256KiB/16184msec); 0 zone resets clat (usec): min=1048, max=73974, avg=19948.53, stdev=13001.65 lat (usec): min=1049, max=73975, avg=19949.46, stdev=13001.70 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 4686], 10.00th=[ 5538], 20.00th=[ 9110], | 30.00th=[11863], 40.00th=[14091], 50.00th=[16909], 60.00th=[19792], | 70.00th=[24511], 80.00th=[29754], 90.00th=[38011], 95.00th=[45351], | 99.00th=[66323], 99.50th=[69731], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 127, max= 640, per=26.23%, avg=387.38, stdev=118.13, samples=32 iops : min= 7, max= 40, avg=23.75, stdev= 7.54, samples=32 lat (usec) : 250=0.26%, 500=1.30%, 750=0.65%, 1000=0.39% lat (msec) : 2=0.65%, 4=1.17%, 10=11.85%, 20=38.41%, 50=42.58% lat (msec) : 100=2.73% cpu : usr=0.05%, sys=29.63%, ctx=3076, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1405KiB/s (1438kB/s), 337KiB/s-376KiB/s (345kB/s-385kB/s), io=23.4MiB (24.5MB), run=16184-17051msec WRITE: bw=1478KiB/s (1513kB/s), 363KiB/s-387KiB/s (372kB/s-396kB/s), io=24.6MiB (25.8MB), run=16184-17051msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194162: Sun Nov 23 01:19:31 2025 read: IOPS=18, BW=300KiB/s (307kB/s)(5920KiB/19742msec) clat (usec): min=4427, max=86430, avg=24278.65, stdev=16001.49 lat (usec): min=4428, max=86431, avg=24279.42, stdev=16001.38 clat percentiles (usec): | 1.00th=[ 4948], 5.00th=[ 7177], 10.00th=[ 9634], 20.00th=[11863], | 30.00th=[14484], 40.00th=[16450], 50.00th=[20317], 60.00th=[24511], | 70.00th=[27132], 80.00th=[33162], 90.00th=[44827], 95.00th=[58459], | 99.00th=[83362], 99.50th=[86508], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 127, max= 862, per=24.65%, avg=299.03, stdev=133.75, samples=39 iops : min= 7, max= 53, avg=18.08, stdev= 8.39, samples=39 write: IOPS=20, BW=323KiB/s (330kB/s)(6368KiB/19742msec); 0 zone resets clat (usec): min=5221, max=84476, avg=26867.43, stdev=16820.07 lat (usec): min=5222, max=84478, avg=26868.78, stdev=16820.05 clat percentiles (usec): | 1.00th=[ 6587], 5.00th=[ 8291], 10.00th=[ 9765], 20.00th=[11731], | 30.00th=[14615], 40.00th=[18220], 50.00th=[21627], 60.00th=[27132], | 70.00th=[33424], 80.00th=[40109], 90.00th=[51643], 95.00th=[62129], | 99.00th=[77071], 99.50th=[83362], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 159, max= 830, per=25.26%, avg=322.26, stdev=125.42, samples=39 iops : min= 9, max= 51, avg=19.51, stdev= 7.81, samples=39 lat (msec) : 10=11.07%, 20=36.72%, 50=42.84%, 100=9.38% cpu : usr=0.06%, sys=14.48%, ctx=1859, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194163: Sun Nov 23 01:19:31 2025 read: IOPS=18, BW=295KiB/s (303kB/s)(5744KiB/19441msec) clat (msec): min=3, max=105, avg=24.22, stdev=14.83 lat (msec): min=3, max=105, avg=24.22, stdev=14.83 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 56], | 99.00th=[ 74], 99.50th=[ 86], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 127, max= 544, per=24.07%, avg=291.92, stdev=98.28, samples=38 iops : min= 7, max= 34, avg=17.63, stdev= 6.27, samples=38 write: IOPS=21, BW=337KiB/s (345kB/s)(6544KiB/19441msec); 0 zone resets clat (usec): min=5988, max=89543, avg=26057.99, stdev=15905.18 lat (usec): min=5989, max=89544, avg=26059.20, stdev=15905.17 clat percentiles (usec): | 1.00th=[ 7701], 5.00th=[ 9241], 10.00th=[10290], 20.00th=[12649], | 30.00th=[14746], 40.00th=[17957], 50.00th=[21890], 60.00th=[25822], | 70.00th=[30540], 80.00th=[39060], 90.00th=[49021], 95.00th=[61080], | 99.00th=[73925], 99.50th=[86508], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 95, max= 736, per=25.85%, avg=329.82, stdev=124.51, samples=38 iops : min= 5, max= 46, avg=20.00, stdev= 7.83, samples=38 lat (msec) : 4=0.13%, 10=8.72%, 20=38.93%, 50=44.14%, 100=7.94% lat (msec) : 250=0.13% cpu : usr=0.06%, sys=14.62%, ctx=1880, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194164: Sun Nov 23 01:19:31 2025 read: IOPS=19, BW=319KiB/s (327kB/s)(6256KiB/19607msec) clat (usec): min=4337, max=92643, avg=24679.35, stdev=15114.13 lat (usec): min=4338, max=92643, avg=24680.01, stdev=15114.14 clat percentiles (usec): | 1.00th=[ 5211], 5.00th=[ 8455], 10.00th=[10028], 20.00th=[12125], | 30.00th=[14222], 40.00th=[16712], 50.00th=[21103], 60.00th=[24249], | 70.00th=[29754], 80.00th=[35914], 90.00th=[45876], 95.00th=[54264], | 99.00th=[77071], 99.50th=[86508], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 95, max= 704, per=25.97%, avg=314.97, stdev=117.88, samples=38 iops : min= 5, max= 44, avg=19.08, stdev= 7.44, samples=38 write: IOPS=19, BW=308KiB/s (315kB/s)(6032KiB/19607msec); 0 zone resets clat (usec): min=5298, max=87988, avg=26266.27, stdev=15721.35 lat (usec): min=5299, max=87990, avg=26267.62, stdev=15721.39 clat percentiles (usec): | 1.00th=[ 6390], 5.00th=[ 9110], 10.00th=[11076], 20.00th=[12911], | 30.00th=[14877], 40.00th=[17957], 50.00th=[22676], 60.00th=[26346], | 70.00th=[30802], 80.00th=[39060], 90.00th=[49546], 95.00th=[57410], | 99.00th=[79168], 99.50th=[86508], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 95, max= 510, per=23.06%, avg=294.18, stdev=82.52, samples=38 iops : min= 5, max= 31, avg=17.76, stdev= 5.15, samples=38 lat (msec) : 10=8.46%, 20=37.76%, 50=45.70%, 100=8.07% cpu : usr=0.06%, sys=14.89%, ctx=1838, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194165: Sun Nov 23 01:19:31 2025 read: IOPS=19, BW=306KiB/s (313kB/s)(6032KiB/19740msec) clat (msec): min=3, max=104, avg=23.53, stdev=14.96 lat (msec): min=3, max=104, avg=23.53, stdev=14.96 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 44], 95.00th=[ 55], | 99.00th=[ 79], 99.50th=[ 84], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 94, max= 798, per=24.98%, avg=302.97, stdev=131.51, samples=39 iops : min= 5, max= 49, avg=18.31, stdev= 8.21, samples=39 write: IOPS=19, BW=317KiB/s (325kB/s)(6256KiB/19740msec); 0 zone resets clat (usec): min=4935, max=87766, avg=27730.44, stdev=17121.13 lat (usec): min=4936, max=87768, avg=27732.03, stdev=17120.99 clat percentiles (usec): | 1.00th=[ 6521], 5.00th=[ 8717], 10.00th=[10290], 20.00th=[13173], | 30.00th=[16188], 40.00th=[18744], 50.00th=[23200], 60.00th=[27132], | 70.00th=[33162], 80.00th=[42206], 90.00th=[52167], 95.00th=[62129], | 99.00th=[82314], 99.50th=[86508], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 127, max= 734, per=24.81%, avg=316.54, stdev=110.90, samples=39 iops : min= 7, max= 45, avg=19.15, stdev= 6.94, samples=39 lat (msec) : 4=0.13%, 10=10.68%, 20=36.07%, 50=43.88%, 100=9.11% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=14.39%, ctx=1853, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1213KiB/s (1242kB/s), 295KiB/s-319KiB/s (303kB/s-327kB/s), io=23.4MiB (24.5MB), run=19441-19742msec WRITE: bw=1276KiB/s (1307kB/s), 308KiB/s-337KiB/s (315kB/s-345kB/s), io=24.6MiB (25.8MB), run=19441-19742msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194178: Sun Nov 23 01:19:39 2025 read: IOPS=2, BW=3008KiB/s (3080kB/s)(7168KiB/2383msec) clat (msec): min=49, max=369, avg=168.78, stdev=119.06 lat (msec): min=49, max=369, avg=168.78, stdev=119.06 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 56], | 30.00th=[ 74], 40.00th=[ 74], 50.00th=[ 165], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 236], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1988, max= 6595, per=44.49%, avg=3530.00, stdev=2654.38, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 write: IOPS=2, BW=2149KiB/s (2200kB/s)(5120KiB/2383msec); 0 zone resets clat (msec): min=89, max=368, avg=233.34, stdev=106.56 lat (msec): min=89, max=368, avg=233.41, stdev=106.55 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1648, max= 6131, per=35.02%, avg=3889.50, stdev=3169.96, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 50=8.33%, 100=25.00%, 250=41.67%, 500=25.00% cpu : usr=0.04%, sys=14.99%, ctx=87, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194179: Sun Nov 23 01:19:39 2025 read: IOPS=0, BW=793KiB/s (813kB/s)(2048KiB/2581msec) clat (usec): min=49015, max=85597, avg=67306.81, stdev=25867.24 lat (usec): min=49017, max=85598, avg=67307.88, stdev=25867.12 clat percentiles (usec): | 1.00th=[49021], 5.00th=[49021], 10.00th=[49021], 20.00th=[49021], | 30.00th=[49021], 40.00th=[49021], 50.00th=[49021], 60.00th=[85459], | 70.00th=[85459], 80.00th=[85459], 90.00th=[85459], 95.00th=[85459], | 99.00th=[85459], 99.50th=[85459], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 1643, max= 1988, per=22.88%, avg=1815.50, stdev=243.95, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3967KiB/s (4063kB/s)(10.0MiB/2581msec); 0 zone resets clat (msec): min=72, max=522, avg=243.52, stdev=171.14 lat (msec): min=72, max=522, avg=243.58, stdev=171.13 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 153], 50.00th=[ 161], 60.00th=[ 207], | 70.00th=[ 264], 80.00th=[ 401], 90.00th=[ 493], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1988, max= 6574, per=28.38%, avg=3153.00, stdev=2280.78, samples=4 iops : min= 1, max= 6, avg= 2.25, stdev= 2.50, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.12%, sys=19.69%, ctx=132, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194180: Sun Nov 23 01:19:39 2025 read: IOPS=2, BW=2497KiB/s (2556kB/s)(6144KiB/2461msec) clat (msec): min=59, max=294, avg=156.92, stdev=79.12 lat (msec): min=59, max=294, avg=156.92, stdev=79.12 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 2007, max= 4087, per=39.37%, avg=3123.33, stdev=1048.37, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2497KiB/s (2556kB/s)(6144KiB/2461msec); 0 zone resets clat (msec): min=57, max=499, avg=245.29, stdev=199.42 lat (msec): min=57, max=499, avg=245.36, stdev=199.41 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 71], | 30.00th=[ 71], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 296], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1988, max= 4915, per=26.74%, avg=2970.00, stdev=1684.45, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=33.33% cpu : usr=0.04%, sys=16.06%, ctx=90, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194181: Sun Nov 23 01:19:39 2025 read: IOPS=2, BW=2185KiB/s (2238kB/s)(5120KiB/2343msec) clat (msec): min=90, max=241, avg=166.41, stdev=68.97 lat (msec): min=90, max=241, avg=166.41, stdev=68.97 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 1988, max= 6131, per=51.17%, avg=4059.50, stdev=2929.54, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=3059KiB/s (3133kB/s)(7168KiB/2343msec); 0 zone resets clat (msec): min=70, max=395, avg=208.19, stdev=126.78 lat (msec): min=70, max=395, avg=208.27, stdev=126.77 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 249], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 292], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1988, max= 4970, per=26.90%, avg=2988.33, stdev=1716.20, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=41.67%, 250=33.33%, 500=25.00% cpu : usr=0.04%, sys=13.75%, ctx=75, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7935KiB/s (8125kB/s), 793KiB/s-3008KiB/s (813kB/s-3080kB/s), io=20.0MiB (20.0MB), run=2343-2581msec WRITE: bw=10.8MiB/s (11.4MB/s), 2149KiB/s-3967KiB/s (2200kB/s-4063kB/s), io=28.0MiB (29.4MB), run=2343-2581msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194183: Sun Nov 23 01:19:39 2025 read: IOPS=2, BW=2930KiB/s (3001kB/s)(7168KiB/2446msec) clat (msec): min=124, max=286, avg=170.18, stdev=56.60 lat (msec): min=124, max=286, avg=170.18, stdev=56.60 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 199], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1961, max= 5742, per=40.15%, avg=2948.50, stdev=1862.76, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=2, BW=2093KiB/s (2143kB/s)(5120KiB/2446msec); 0 zone resets clat (msec): min=164, max=490, avg=250.53, stdev=137.97 lat (msec): min=164, max=491, avg=250.58, stdev=137.96 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2043, max= 3923, per=25.99%, avg=2671.33, stdev=1083.98, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=83.33%, 500=16.67% cpu : usr=0.00%, sys=55.71%, ctx=1124, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194184: Sun Nov 23 01:19:39 2025 read: IOPS=0, BW=734KiB/s (752kB/s)(2048KiB/2789msec) clat (msec): min=107, max=174, avg=140.55, stdev=47.43 lat (msec): min=107, max=174, avg=140.56, stdev=47.42 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 1906, max= 2048, per=26.92%, avg=1977.00, stdev=100.41, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3672KiB/s (3760kB/s)(10.0MiB/2789msec); 0 zone resets clat (msec): min=95, max=553, avg=250.62, stdev=158.67 lat (msec): min=95, max=553, avg=250.68, stdev=158.66 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 96], | 30.00th=[ 112], 40.00th=[ 161], 50.00th=[ 218], 60.00th=[ 232], | 70.00th=[ 243], 80.00th=[ 313], 90.00th=[ 485], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2048, max= 4087, per=34.11%, avg=3506.50, stdev=974.79, samples=4 iops : min= 2, max= 3, avg= 2.75, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=50.36%, ctx=434, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194185: Sun Nov 23 01:19:39 2025 read: IOPS=2, BW=2267KiB/s (2322kB/s)(6144KiB/2710msec) clat (usec): min=760, max=333807, avg=106376.68, stdev=125296.05 lat (usec): min=761, max=333808, avg=106377.38, stdev=125295.83 clat percentiles (usec): | 1.00th=[ 758], 5.00th=[ 758], 10.00th=[ 758], 20.00th=[ 865], | 30.00th=[ 865], 40.00th=[ 47973], 50.00th=[ 47973], 60.00th=[117965], | 70.00th=[137364], 80.00th=[137364], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 1961, max= 3968, per=36.21%, avg=2659.00, stdev=1134.46, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2267KiB/s (2322kB/s)(6144KiB/2710msec); 0 zone resets clat (msec): min=94, max=978, avg=345.01, stdev=331.22 lat (msec): min=94, max=978, avg=345.05, stdev=331.23 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 317], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1961, max= 3968, per=31.97%, avg=3286.33, stdev=1147.93, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 1000=16.67% lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 1000=8.33% cpu : usr=0.04%, sys=36.21%, ctx=455, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194186: Sun Nov 23 01:19:39 2025 read: IOPS=1, BW=1956KiB/s (2003kB/s)(5120KiB/2617msec) clat (usec): min=795, max=209311, avg=79066.15, stdev=86957.21 lat (usec): min=796, max=209312, avg=79066.91, stdev=86957.17 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 799], 10.00th=[ 799], 20.00th=[ 799], | 30.00th=[ 824], 40.00th=[ 824], 50.00th=[ 73925], 60.00th=[ 73925], | 70.00th=[110625], 80.00th=[110625], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 3968, max= 4096, per=54.91%, avg=4032.00, stdev=90.51, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2739KiB/s (2805kB/s)(7168KiB/2617msec); 0 zone resets clat (msec): min=144, max=773, avg=317.08, stdev=220.80 lat (msec): min=144, max=773, avg=317.13, stdev=220.80 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 150], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 279], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 376], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1946, max= 3968, per=28.90%, avg=2971.25, stdev=1125.89, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (usec) : 1000=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=41.32%, ctx=320, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7343KiB/s (7519kB/s), 734KiB/s-2930KiB/s (752kB/s-3001kB/s), io=20.0MiB (20.0MB), run=2446-2789msec WRITE: bw=10.0MiB/s (10.5MB/s), 2093KiB/s-3672KiB/s (2143kB/s-3760kB/s), io=28.0MiB (29.4MB), run=2446-2789msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194192: Sun Nov 23 01:19:48 2025 read: IOPS=1, BW=5598KiB/s (5733kB/s)(12.0MiB/2195msec) clat (msec): min=293, max=1328, avg=663.04, stdev=577.62 lat (msec): min=293, max=1328, avg=663.05, stdev=577.61 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 5497, max= 5497, per=81.53%, avg=5497.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=35.28%, ctx=2852, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194193: Sun Nov 23 01:19:48 2025 read: IOPS=0, BW=1686KiB/s (1726kB/s)(4096KiB/2430msec) clat (nsec): min=308604k, max=308604k, avg=308603837.00, stdev= 0.00 lat (nsec): min=308606k, max=308606k, avg=308606103.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 5490, max= 5490, per=81.43%, avg=5490.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3371KiB/s (3452kB/s)(8192KiB/2430msec); 0 zone resets clat (msec): min=315, max=1614, avg=964.98, stdev=919.12 lat (msec): min=315, max=1615, avg=965.24, stdev=919.13 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8159, max= 8159, per=67.95%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=15.07%, ctx=737, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194194: Sun Nov 23 01:19:48 2025 write: IOPS=1, BW=4503KiB/s (4611kB/s)(12.0MiB/2729msec); 0 zone resets clat (msec): min=218, max=1570, avg=871.45, stdev=677.26 lat (msec): min=218, max=1570, avg=871.67, stdev=677.33 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8159, max= 8192, per=68.09%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.75%, ctx=41, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194196: Sun Nov 23 01:19:48 2025 write: IOPS=1, BW=6457KiB/s (6612kB/s)(12.0MiB/1903msec); 0 zone resets clat (msec): min=287, max=1166, avg=582.50, stdev=505.98 lat (msec): min=288, max=1167, avg=582.75, stdev=506.00 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 5818, max= 8192, per=58.34%, avg=7005.00, stdev=1678.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=25.18%, ctx=319, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6742KiB/s (6904kB/s), 1686KiB/s-5598KiB/s (1726kB/s-5733kB/s), io=16.0MiB (16.8MB), run=2195-2430msec WRITE: bw=11.7MiB/s (12.3MB/s), 3371KiB/s-6457KiB/s (3452kB/s-6612kB/s), io=32.0MiB (33.6MB), run=1903-2729msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194195: Sun Nov 23 01:19:48 2025 read: IOPS=1, BW=5114KiB/s (5236kB/s)(12.0MiB/2403msec) clat (msec): min=144, max=1488, avg=745.31, stdev=683.40 lat (msec): min=144, max=1488, avg=745.31, stdev=683.40 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.99%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194197: Sun Nov 23 01:19:48 2025 read: IOPS=0, BW=1678KiB/s (1718kB/s)(4096KiB/2441msec) clat (nsec): min=688926k, max=688926k, avg=688926421.00, stdev= 0.00 lat (nsec): min=688927k, max=688927k, avg=688927267.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3356KiB/s (3437kB/s)(8192KiB/2441msec); 0 zone resets clat (msec): min=134, max=1506, avg=820.41, stdev=969.67 lat (msec): min=135, max=1506, avg=820.67, stdev=969.67 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8192, max= 8192, per=69.20%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.06%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194198: Sun Nov 23 01:19:48 2025 write: IOPS=1, BW=5124KiB/s (5247kB/s)(12.0MiB/2398msec); 0 zone resets clat (msec): min=384, max=1452, avg=759.18, stdev=601.06 lat (msec): min=384, max=1452, avg=759.46, stdev=601.05 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 5834, max= 8192, per=59.24%, avg=7013.00, stdev=1667.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=17.90%, ctx=479, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194199: Sun Nov 23 01:19:48 2025 write: IOPS=1, BW=4439KiB/s (4546kB/s)(12.0MiB/2768msec); 0 zone resets clat (msec): min=105, max=2108, avg=883.22, stdev=1073.73 lat (msec): min=106, max=2108, avg=883.63, stdev=1073.64 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 5893, max= 8192, per=59.49%, avg=7042.50, stdev=1625.64, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=12.32%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6712KiB/s (6873kB/s), 1678KiB/s-5114KiB/s (1718kB/s-5236kB/s), io=16.0MiB (16.8MB), run=2403-2441msec WRITE: bw=11.6MiB/s (12.1MB/s), 3356KiB/s-5124KiB/s (3437kB/s-5247kB/s), io=32.0MiB (33.6MB), run=2398-2768msec