== sanity test 398b: DIO and buffer IO race ============== 22:52:32 (1775875952) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.98209 s, 16.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182556: Fri Apr 10 22:53:38 2026 read: IOPS=26, BW=108KiB/s (111kB/s)(5992KiB/55498msec) clat (usec): min=29, max=640129, avg=21121.52, stdev=20023.22 lat (usec): min=30, max=640129, avg=21122.43, stdev=20023.21 clat percentiles (usec): | 1.00th=[ 66], 5.00th=[ 7570], 10.00th=[ 9372], 20.00th=[ 11600], | 30.00th=[ 13698], 40.00th=[ 16188], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 24249], 80.00th=[ 28181], 90.00th=[ 34341], 95.00th=[ 40633], | 99.00th=[ 69731], 99.50th=[ 82314], 99.90th=[106431], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 22, max= 168, per=25.41%, avg=107.74, stdev=26.12, samples=110 iops : min= 5, max= 42, avg=26.43, stdev= 6.49, samples=110 write: IOPS=28, BW=113KiB/s (116kB/s)(6296KiB/55498msec); 0 zone resets clat (usec): min=761, max=120568, avg=15033.21, stdev=14288.39 lat (usec): min=762, max=120570, avg=15034.87, stdev=14288.26 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1467], 10.00th=[ 1926], 20.00th=[ 2737], | 30.00th=[ 4080], 40.00th=[ 7832], 50.00th=[ 11338], 60.00th=[ 14353], | 70.00th=[ 18744], 80.00th=[ 25297], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 63701], 99.50th=[ 66847], 99.90th=[ 90702], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 7, max= 190, per=25.47%, avg=113.08, stdev=34.27, samples=110 iops : min= 1, max= 47, avg=27.77, stdev= 8.59, samples=110 lat (usec) : 50=0.16%, 100=0.85%, 250=0.46%, 500=0.03%, 1000=0.42% lat (msec) : 2=4.92%, 4=9.83%, 10=13.12%, 20=33.63%, 50=34.05% lat (msec) : 100=2.41%, 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=14.80%, ctx=7371, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182557: Fri Apr 10 22:53:38 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(5940KiB/55907msec) clat (usec): min=33, max=145096, avg=20259.71, stdev=12372.13 lat (usec): min=34, max=145096, avg=20261.82, stdev=12371.56 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 7308], 10.00th=[ 8848], 20.00th=[ 11338], | 30.00th=[ 13304], 40.00th=[ 15139], 50.00th=[ 17957], 60.00th=[ 21103], | 70.00th=[ 23987], 80.00th=[ 27919], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 64750], 99.50th=[ 80217], 99.90th=[121111], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 7, max= 176, per=24.94%, avg=105.75, stdev=27.12, samples=111 iops : min= 1, max= 44, avg=25.93, stdev= 6.82, samples=111 write: IOPS=28, BW=114KiB/s (116kB/s)(6348KiB/55907msec); 0 zone resets clat (usec): min=701, max=620065, avg=16140.65, stdev=20841.06 lat (usec): min=702, max=620066, avg=16141.92, stdev=20840.93 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1516], 10.00th=[ 2008], 20.00th=[ 2966], | 30.00th=[ 4424], 40.00th=[ 8455], 50.00th=[ 12518], 60.00th=[ 15795], | 70.00th=[ 20579], 80.00th=[ 26608], 90.00th=[ 35390], 95.00th=[ 43779], | 99.00th=[ 61604], 99.50th=[ 72877], 99.90th=[ 95945], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 14, max= 207, per=25.40%, avg=112.77, stdev=32.44, samples=111 iops : min= 3, max= 51, avg=27.69, stdev= 8.11, samples=111 lat (usec) : 50=0.33%, 100=0.75%, 250=0.29%, 750=0.07%, 1000=0.33% lat (msec) : 2=4.82%, 4=9.11%, 10=13.61%, 20=34.24%, 50=33.89% lat (msec) : 100=2.44%, 250=0.10%, 750=0.03% cpu : usr=0.14%, sys=14.48%, ctx=7573, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182558: Fri Apr 10 22:53:38 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(6028KiB/56561msec) clat (usec): min=37, max=138048, avg=20467.73, stdev=12520.82 lat (usec): min=39, max=138049, avg=20469.17, stdev=12520.76 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 6980], 10.00th=[ 8848], 20.00th=[ 11469], | 30.00th=[ 13566], 40.00th=[ 15664], 50.00th=[ 17957], 60.00th=[ 20841], | 70.00th=[ 23987], 80.00th=[ 27657], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 64226], 99.50th=[ 79168], 99.90th=[111674], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 48, max= 216, per=25.22%, avg=106.94, stdev=28.68, samples=111 iops : min= 12, max= 54, avg=26.23, stdev= 7.19, samples=111 write: IOPS=27, BW=111KiB/s (113kB/s)(6260KiB/56561msec); 0 zone resets clat (usec): min=825, max=635053, avg=16303.13, stdev=21242.71 lat (usec): min=826, max=635054, avg=16304.78, stdev=21242.65 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1434], 10.00th=[ 1926], 20.00th=[ 2900], | 30.00th=[ 4490], 40.00th=[ 8979], 50.00th=[ 12387], 60.00th=[ 16319], | 70.00th=[ 20317], 80.00th=[ 27132], 90.00th=[ 36963], 95.00th=[ 44303], | 99.00th=[ 59507], 99.50th=[ 67634], 99.90th=[125305], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 55, max= 224, per=24.92%, avg=110.67, stdev=29.85, samples=111 iops : min= 13, max= 56, avg=27.16, stdev= 7.45, samples=111 lat (usec) : 50=0.39%, 100=0.94%, 250=0.20%, 500=0.03%, 1000=0.29% lat (msec) : 2=5.24%, 4=8.66%, 10=12.63%, 20=35.12%, 50=33.82% lat (msec) : 100=2.51%, 250=0.13%, 750=0.03% cpu : usr=0.13%, sys=14.23%, ctx=7498, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182560: Fri Apr 10 22:53:38 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(6052KiB/56179msec) clat (usec): min=41, max=562879, avg=20453.05, stdev=18040.32 lat (usec): min=42, max=562880, avg=20461.52, stdev=18037.21 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 6718], 10.00th=[ 8848], 20.00th=[ 11338], | 30.00th=[ 13435], 40.00th=[ 15664], 50.00th=[ 18220], 60.00th=[ 20841], | 70.00th=[ 23725], 80.00th=[ 27919], 90.00th=[ 33424], 95.00th=[ 39584], | 99.00th=[ 56886], 99.50th=[ 73925], 99.90th=[ 87557], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 14, max= 183, per=25.17%, avg=106.70, stdev=28.03, samples=111 iops : min= 3, max= 45, avg=26.16, stdev= 7.00, samples=111 write: IOPS=27, BW=111KiB/s (114kB/s)(6236KiB/56179msec); 0 zone resets clat (usec): min=740, max=134435, avg=16050.70, stdev=14775.67 lat (usec): min=740, max=134436, avg=16052.22, stdev=14775.53 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1450], 10.00th=[ 2114], 20.00th=[ 2900], | 30.00th=[ 4424], 40.00th=[ 8979], 50.00th=[ 12649], 60.00th=[ 15795], | 70.00th=[ 20317], 80.00th=[ 26870], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 62653], 99.50th=[ 70779], 99.90th=[ 83362], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 29, max= 192, per=24.80%, avg=110.13, stdev=30.88, samples=111 iops : min= 7, max= 48, avg=27.03, stdev= 7.71, samples=111 lat (usec) : 50=0.33%, 100=1.04%, 250=0.42%, 750=0.07%, 1000=0.39% lat (msec) : 2=4.13%, 4=9.80%, 10=12.14%, 20=34.96%, 50=33.89% lat (msec) : 100=2.77%, 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=14.63%, ctx=7654, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=425KiB/s (435kB/s), 106KiB/s-108KiB/s (109kB/s-111kB/s), io=23.4MiB (24.6MB), run=55498-56561msec WRITE: bw=444KiB/s (455kB/s), 111KiB/s-114KiB/s (113kB/s-116kB/s), io=24.6MiB (25.7MB), run=55498-56561msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182559: Fri Apr 10 22:53:54 2026 read: IOPS=20, BW=83.5KiB/s (85.5kB/s)(5992KiB/71746msec) clat (msec): min=3, max=640, avg=18.87, stdev=22.12 lat (msec): min=3, max=640, avg=18.87, stdev=22.12 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 41], 95.00th=[ 52], | 99.00th=[ 74], 99.50th=[ 86], 99.90th=[ 142], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 15, max= 254, per=25.25%, avg=83.58, stdev=51.35, samples=141 iops : min= 3, max= 63, avg=20.44, stdev=12.90, samples=141 write: IOPS=21, BW=87.8KiB/s (89.9kB/s)(6296KiB/71746msec); 0 zone resets clat (msec): min=5, max=138, avg=27.52, stdev=19.05 lat (msec): min=5, max=138, avg=27.52, stdev=19.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 65], | 99.00th=[ 97], 99.50th=[ 115], 99.90th=[ 138], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 23, max= 239, per=25.28%, avg=87.73, stdev=49.91, samples=141 iops : min= 5, max= 59, avg=21.48, stdev=12.55, samples=141 lat (msec) : 4=0.13%, 10=20.28%, 20=38.44%, 50=33.07%, 100=7.55% lat (msec) : 250=0.49%, 750=0.03% cpu : usr=0.11%, sys=6.58%, ctx=5201, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182561: Fri Apr 10 22:53:54 2026 read: IOPS=20, BW=82.3KiB/s (84.3kB/s)(5940KiB/72195msec) clat (msec): min=3, max=582, avg=19.17, stdev=21.83 lat (msec): min=3, max=582, avg=19.17, stdev=21.83 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 80], 99.50th=[ 88], 99.90th=[ 136], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 16, max= 280, per=24.84%, avg=82.23, stdev=53.31, samples=142 iops : min= 4, max= 70, avg=20.09, stdev=13.41, samples=142 write: IOPS=21, BW=87.9KiB/s (90.0kB/s)(6348KiB/72195msec); 0 zone resets clat (msec): min=6, max=163, avg=27.45, stdev=18.49 lat (msec): min=6, max=163, avg=27.45, stdev=18.49 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 91], 99.50th=[ 104], 99.90th=[ 133], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 23, max= 239, per=25.20%, avg=87.45, stdev=50.40, samples=142 iops : min= 5, max= 59, avg=21.40, stdev=12.65, samples=142 lat (msec) : 4=0.13%, 10=20.77%, 20=38.18%, 50=31.77%, 100=8.69% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.09%, sys=6.46%, ctx=5123, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182562: Fri Apr 10 22:53:54 2026 read: IOPS=20, BW=83.9KiB/s (85.9kB/s)(6028KiB/71877msec) clat (msec): min=3, max=140, avg=18.74, stdev=15.70 lat (msec): min=3, max=140, avg=18.74, stdev=15.70 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 79], 99.50th=[ 89], 99.90th=[ 104], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 23, max= 261, per=25.41%, avg=84.11, stdev=50.13, samples=142 iops : min= 5, max= 65, avg=20.57, stdev=12.58, samples=142 write: IOPS=21, BW=87.1KiB/s (89.2kB/s)(6260KiB/71877msec); 0 zone resets clat (msec): min=4, max=595, avg=27.77, stdev=23.31 lat (msec): min=4, max=595, avg=27.77, stdev=23.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 54], 95.00th=[ 62], | 99.00th=[ 92], 99.50th=[ 113], 99.90th=[ 155], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 23, max= 247, per=25.19%, avg=87.39, stdev=49.58, samples=142 iops : min= 5, max= 61, avg=21.39, stdev=12.45, samples=142 lat (msec) : 4=0.16%, 10=19.63%, 20=38.83%, 50=32.94%, 100=7.94% lat (msec) : 250=0.46%, 750=0.03% cpu : usr=0.11%, sys=6.53%, ctx=5233, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182563: Fri Apr 10 22:53:54 2026 read: IOPS=20, BW=83.6KiB/s (85.6kB/s)(6052KiB/72419msec) clat (msec): min=3, max=120, avg=19.36, stdev=16.13 lat (msec): min=3, max=120, avg=19.36, stdev=16.13 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 55], | 99.00th=[ 77], 99.50th=[ 86], 99.90th=[ 105], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 16, max= 272, per=25.46%, avg=84.28, stdev=52.37, samples=142 iops : min= 4, max= 68, avg=20.61, stdev=13.14, samples=142 write: IOPS=21, BW=86.1KiB/s (88.2kB/s)(6236KiB/72419msec); 0 zone resets clat (msec): min=6, max=600, avg=27.56, stdev=23.44 lat (msec): min=6, max=600, avg=27.56, stdev=23.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 52], 95.00th=[ 62], | 99.00th=[ 96], 99.50th=[ 108], 99.90th=[ 165], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 23, max= 248, per=24.85%, avg=86.23, stdev=50.48, samples=143 iops : min= 5, max= 62, avg=21.10, stdev=12.68, samples=143 lat (msec) : 4=0.42%, 10=19.66%, 20=37.30%, 50=33.89%, 100=8.30% lat (msec) : 250=0.39%, 750=0.03% cpu : usr=0.07%, sys=6.51%, ctx=5267, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=332KiB/s (340kB/s), 82.3KiB/s-83.9KiB/s (84.3kB/s-85.9kB/s), io=23.4MiB (24.6MB), run=71746-72419msec WRITE: bw=347KiB/s (355kB/s), 86.1KiB/s-87.9KiB/s (88.2kB/s-90.0kB/s), io=24.6MiB (25.7MB), run=71746-72419msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182595: Fri Apr 10 22:54:14 2026 read: IOPS=25, BW=404KiB/s (414kB/s)(5920KiB/14649msec) clat (usec): min=43, max=80497, avg=21144.18, stdev=11812.16 lat (usec): min=44, max=80498, avg=21145.10, stdev=11812.13 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 117], 10.00th=[10028], 20.00th=[12780], | 30.00th=[14877], 40.00th=[16909], 50.00th=[19268], 60.00th=[21890], | 70.00th=[24249], 80.00th=[27919], 90.00th=[35914], 95.00th=[43779], | 99.00th=[57410], 99.50th=[80217], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 254, max= 574, per=24.84%, avg=394.39, stdev=83.50, samples=28 iops : min= 15, max= 35, avg=24.11, stdev= 5.32, samples=28 write: IOPS=27, BW=435KiB/s (445kB/s)(6368KiB/14649msec); 0 zone resets clat (usec): min=1181, max=70722, avg=16979.09, stdev=14139.63 lat (usec): min=1182, max=70725, avg=16982.35, stdev=14139.15 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2212], 10.00th=[ 2933], 20.00th=[ 4047], | 30.00th=[ 6128], 40.00th=[ 9765], 50.00th=[13173], 60.00th=[16581], | 70.00th=[22152], 80.00th=[28443], 90.00th=[39060], 95.00th=[44827], | 99.00th=[55837], 99.50th=[64226], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 223, max= 608, per=25.29%, avg=422.64, stdev=92.08, samples=28 iops : min= 13, max= 38, avg=25.89, stdev= 5.85, samples=28 lat (usec) : 50=0.26%, 100=1.56%, 250=0.65% lat (msec) : 2=2.21%, 4=7.94%, 10=13.15%, 20=33.98%, 50=37.50% lat (msec) : 100=2.73% cpu : usr=0.11%, sys=18.13%, ctx=2254, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182596: Fri Apr 10 22:54:14 2026 read: IOPS=25, BW=410KiB/s (420kB/s)(5744KiB/14016msec) clat (usec): min=44, max=88277, avg=20304.17, stdev=12120.66 lat (usec): min=45, max=88278, avg=20305.01, stdev=12120.67 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 119], 10.00th=[ 8586], 20.00th=[12125], | 30.00th=[14484], 40.00th=[16581], 50.00th=[18482], 60.00th=[20841], | 70.00th=[23987], 80.00th=[27657], 90.00th=[32375], 95.00th=[40109], | 99.00th=[61604], 99.50th=[81265], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 185, max= 637, per=25.94%, avg=411.85, stdev=114.43, samples=27 iops : min= 11, max= 39, avg=25.19, stdev= 7.11, samples=27 write: IOPS=29, BW=467KiB/s (478kB/s)(6544KiB/14016msec); 0 zone resets clat (usec): min=1018, max=87226, avg=16352.81, stdev=14192.28 lat (usec): min=1019, max=87229, avg=16354.59, stdev=14192.51 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2147], 10.00th=[ 3326], 20.00th=[ 4293], | 30.00th=[ 6259], 40.00th=[ 9634], 50.00th=[12911], 60.00th=[15926], | 70.00th=[20579], 80.00th=[26084], 90.00th=[33424], 95.00th=[45351], | 99.00th=[63177], 99.50th=[79168], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 285, max= 800, per=27.68%, avg=462.52, stdev=109.00, samples=27 iops : min= 17, max= 50, avg=28.37, stdev= 6.89, samples=27 lat (usec) : 50=0.39%, 100=1.56%, 250=0.91%, 750=0.13% lat (msec) : 2=2.34%, 4=7.55%, 10=14.97%, 20=34.90%, 50=34.11% lat (msec) : 100=3.12% cpu : usr=0.16%, sys=18.84%, ctx=2168, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182597: Fri Apr 10 22:54:14 2026 read: IOPS=26, BW=424KiB/s (434kB/s)(6256KiB/14769msec) clat (usec): min=40, max=78545, avg=20130.71, stdev=12195.28 lat (usec): min=41, max=78546, avg=20131.59, stdev=12195.28 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 90], 10.00th=[ 153], 20.00th=[11600], | 30.00th=[13698], 40.00th=[16581], 50.00th=[19006], 60.00th=[21627], | 70.00th=[25297], 80.00th=[28705], 90.00th=[34341], 95.00th=[40633], | 99.00th=[59507], 99.50th=[78119], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 192, max= 640, per=26.86%, avg=426.55, stdev=125.23, samples=29 iops : min= 12, max= 40, avg=26.14, stdev= 7.89, samples=29 write: IOPS=25, BW=408KiB/s (418kB/s)(6032KiB/14769msec); 0 zone resets clat (usec): min=1667, max=70327, avg=18064.29, stdev=12946.52 lat (usec): min=1668, max=70328, avg=18069.83, stdev=12952.10 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2835], 10.00th=[ 3982], 20.00th=[ 5604], | 30.00th=[ 9503], 40.00th=[12387], 50.00th=[15270], 60.00th=[18220], | 70.00th=[22676], 80.00th=[29230], 90.00th=[36963], 95.00th=[40633], | 99.00th=[57410], 99.50th=[63177], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 223, max= 701, per=24.39%, avg=407.59, stdev=98.17, samples=29 iops : min= 13, max= 43, avg=24.93, stdev= 6.23, samples=29 lat (usec) : 50=0.26%, 100=3.39%, 250=1.69% lat (msec) : 2=0.52%, 4=4.56%, 10=13.02%, 20=35.29%, 50=39.32% lat (msec) : 100=1.95% cpu : usr=0.12%, sys=18.22%, ctx=2245, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182598: Fri Apr 10 22:54:14 2026 read: IOPS=25, BW=400KiB/s (410kB/s)(6032KiB/15077msec) clat (usec): min=38, max=105813, avg=21392.00, stdev=13196.07 lat (usec): min=39, max=105814, avg=21392.99, stdev=13196.12 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 97], 10.00th=[ 8586], 20.00th=[ 11994], | 30.00th=[ 14877], 40.00th=[ 17695], 50.00th=[ 20055], 60.00th=[ 22938], | 70.00th=[ 26084], 80.00th=[ 29230], 90.00th=[ 35390], 95.00th=[ 43254], | 99.00th=[ 64226], 99.50th=[ 85459], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 221, max= 542, per=24.69%, avg=392.03, stdev=89.46, samples=29 iops : min= 13, max= 33, avg=23.97, stdev= 5.63, samples=29 write: IOPS=25, BW=415KiB/s (425kB/s)(6256KiB/15077msec); 0 zone resets clat (usec): min=1276, max=65235, avg=17571.61, stdev=13337.30 lat (usec): min=1277, max=65236, avg=17573.46, stdev=13337.15 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2999], 10.00th=[ 3851], 20.00th=[ 5145], | 30.00th=[ 8586], 40.00th=[11338], 50.00th=[14484], 60.00th=[17171], | 70.00th=[21890], 80.00th=[27657], 90.00th=[36963], 95.00th=[44303], | 99.00th=[57934], 99.50th=[63701], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 222, max= 605, per=24.55%, avg=410.28, stdev=103.41, samples=29 iops : min= 13, max= 37, avg=25.10, stdev= 6.50, samples=29 lat (usec) : 50=0.26%, 100=2.21%, 250=1.43%, 500=0.13% lat (msec) : 2=1.17%, 4=4.82%, 10=14.84%, 20=33.33%, 50=38.93% lat (msec) : 100=2.73%, 250=0.13% cpu : usr=0.13%, sys=17.87%, ctx=2256, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1589KiB/s (1627kB/s), 400KiB/s-424KiB/s (410kB/s-434kB/s), io=23.4MiB (24.5MB), run=14016-15077msec WRITE: bw=1671KiB/s (1712kB/s), 408KiB/s-467KiB/s (418kB/s-478kB/s), io=24.6MiB (25.8MB), run=14016-15077msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182590: Fri Apr 10 22:54:18 2026 read: IOPS=19, BW=315KiB/s (322kB/s)(5920KiB/18810msec) clat (msec): min=4, max=101, avg=18.91, stdev=13.92 lat (msec): min=4, max=101, avg=18.92, stdev=13.92 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 39], 95.00th=[ 50], | 99.00th=[ 79], 99.50th=[ 84], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 159, max= 734, per=24.80%, avg=311.46, stdev=153.93, samples=37 iops : min= 9, max= 45, avg=18.78, stdev= 9.66, samples=37 write: IOPS=21, BW=339KiB/s (347kB/s)(6368KiB/18810msec); 0 zone resets clat (msec): min=8, max=126, avg=29.50, stdev=17.90 lat (msec): min=8, max=126, avg=29.50, stdev=17.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 54], 95.00th=[ 63], | 99.00th=[ 96], 99.50th=[ 110], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 160, max= 734, per=25.54%, avg=337.68, stdev=143.58, samples=37 iops : min= 10, max= 45, avg=20.43, stdev= 8.94, samples=37 lat (msec) : 10=12.76%, 20=43.23%, 50=34.77%, 100=8.72%, 250=0.52% cpu : usr=0.11%, sys=7.54%, ctx=1356, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182591: Fri Apr 10 22:54:18 2026 read: IOPS=18, BW=301KiB/s (309kB/s)(5744KiB/19059msec) clat (usec): min=3854, max=95841, avg=20387.51, stdev=15881.68 lat (usec): min=3855, max=95841, avg=20388.40, stdev=15881.60 clat percentiles (usec): | 1.00th=[ 5276], 5.00th=[ 6456], 10.00th=[ 7504], 20.00th=[ 8848], | 30.00th=[11076], 40.00th=[12649], 50.00th=[14746], 60.00th=[17695], | 70.00th=[20579], 80.00th=[28967], 90.00th=[42206], 95.00th=[54264], | 99.00th=[85459], 99.50th=[95945], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 95, max= 688, per=23.90%, avg=300.24, stdev=158.22, samples=37 iops : min= 5, max= 43, avg=18.08, stdev= 9.97, samples=37 write: IOPS=21, BW=343KiB/s (352kB/s)(6544KiB/19059msec); 0 zone resets clat (msec): min=8, max=130, avg=28.54, stdev=18.13 lat (msec): min=8, max=130, avg=28.54, stdev=18.13 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 54], 95.00th=[ 64], | 99.00th=[ 85], 99.50th=[ 113], 99.90th=[ 131], 99.95th=[ 131], | 99.99th=[ 131] bw ( KiB/s): min= 127, max= 894, per=25.39%, avg=335.68, stdev=164.99, samples=37 iops : min= 7, max= 55, avg=20.30, stdev=10.24, samples=37 lat (msec) : 4=0.13%, 10=12.63%, 20=42.45%, 50=34.64%, 100=9.77% lat (msec) : 250=0.39% cpu : usr=0.09%, sys=7.37%, ctx=1400, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182592: Fri Apr 10 22:54:18 2026 read: IOPS=20, BW=329KiB/s (336kB/s)(6256KiB/19038msec) clat (msec): min=4, max=102, avg=20.96, stdev=16.31 lat (msec): min=4, max=102, avg=20.96, stdev=16.31 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 47], 95.00th=[ 56], | 99.00th=[ 73], 99.50th=[ 102], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 126, max= 984, per=25.99%, avg=326.38, stdev=187.08, samples=37 iops : min= 7, max= 61, avg=19.73, stdev=11.72, samples=37 write: IOPS=19, BW=317KiB/s (324kB/s)(6032KiB/19038msec); 0 zone resets clat (msec): min=8, max=118, avg=28.67, stdev=16.79 lat (msec): min=8, max=118, avg=28.68, stdev=16.79 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 62], | 99.00th=[ 86], 99.50th=[ 102], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 159, max= 702, per=23.45%, avg=309.97, stdev=149.24, samples=37 iops : min= 9, max= 43, avg=18.68, stdev= 9.35, samples=37 lat (msec) : 10=13.80%, 20=38.28%, 50=38.67%, 100=8.72%, 250=0.52% cpu : usr=0.05%, sys=7.24%, ctx=1389, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182593: Fri Apr 10 22:54:18 2026 read: IOPS=19, BW=318KiB/s (326kB/s)(6032KiB/18966msec) clat (usec): min=4724, max=93541, avg=20248.03, stdev=15719.67 lat (usec): min=4725, max=93542, avg=20248.91, stdev=15719.63 clat percentiles (usec): | 1.00th=[ 5473], 5.00th=[ 6652], 10.00th=[ 7504], 20.00th=[ 8979], | 30.00th=[10683], 40.00th=[12256], 50.00th=[14353], 60.00th=[16909], | 70.00th=[22152], 80.00th=[27395], 90.00th=[44827], 95.00th=[58459], | 99.00th=[71828], 99.50th=[86508], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 126, max= 798, per=25.19%, avg=316.43, stdev=159.96, samples=37 iops : min= 7, max= 49, avg=19.08, stdev= 9.96, samples=37 write: IOPS=20, BW=330KiB/s (338kB/s)(6256KiB/18966msec); 0 zone resets clat (msec): min=9, max=127, avg=28.74, stdev=17.10 lat (msec): min=9, max=127, avg=28.74, stdev=17.10 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 82], 99.50th=[ 118], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 127, max= 720, per=24.73%, avg=326.92, stdev=153.60, samples=37 iops : min= 7, max= 45, avg=19.76, stdev= 9.66, samples=37 lat (msec) : 10=13.02%, 20=41.02%, 50=36.07%, 100=9.64%, 250=0.26% cpu : usr=0.12%, sys=7.40%, ctx=1383, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1257KiB/s (1287kB/s), 301KiB/s-329KiB/s (309kB/s-336kB/s), io=23.4MiB (24.5MB), run=18810-19059msec WRITE: bw=1322KiB/s (1354kB/s), 317KiB/s-343KiB/s (324kB/s-352kB/s), io=24.6MiB (25.8MB), run=18810-19059msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182606: Fri Apr 10 22:54:26 2026 read: IOPS=3, BW=3617KiB/s (3703kB/s)(7168KiB/1982msec) clat (usec): min=574, max=214452, avg=116335.79, stdev=86803.39 lat (usec): min=575, max=214453, avg=116337.55, stdev=86803.57 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 644], | 30.00th=[103285], 40.00th=[103285], 50.00th=[135267], 60.00th=[168821], | 70.00th=[168821], 80.00th=[189793], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 4096, max= 5206, per=60.03%, avg=4651.00, stdev=784.89, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2583KiB/s (2645kB/s)(5120KiB/1982msec); 0 zone resets clat (msec): min=170, max=300, avg=219.27, stdev=51.88 lat (msec): min=170, max=300, avg=219.33, stdev=51.86 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2048, max= 4087, per=28.28%, avg=3067.50, stdev=1441.79, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (usec) : 750=16.67% lat (msec) : 250=75.00%, 500=8.33% cpu : usr=0.05%, sys=46.24%, ctx=1000, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182607: Fri Apr 10 22:54:26 2026 read: IOPS=0, BW=775KiB/s (793kB/s)(2048KiB/2643msec) clat (usec): min=606, max=138667, avg=69637.39, stdev=97623.90 lat (usec): min=608, max=138670, avg=69639.24, stdev=97624.59 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 611], 50.00th=[ 611], 60.00th=[139461], | 70.00th=[139461], 80.00th=[139461], 90.00th=[139461], 95.00th=[139461], | 99.00th=[139461], 99.50th=[139461], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 1780, max= 2043, per=24.67%, avg=1911.50, stdev=185.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3874KiB/s (3967kB/s)(10.0MiB/2643msec); 0 zone resets clat (msec): min=95, max=435, avg=243.78, stdev=117.62 lat (msec): min=95, max=435, avg=243.86, stdev=117.61 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 118], | 30.00th=[ 138], 40.00th=[ 169], 50.00th=[ 226], 60.00th=[ 230], | 70.00th=[ 305], 80.00th=[ 338], 90.00th=[ 388], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2035, max= 6144, per=42.43%, avg=4602.50, stdev=1967.25, samples=4 iops : min= 1, max= 6, avg= 4.00, stdev= 2.45, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=41.48%, ctx=192, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182608: Fri Apr 10 22:54:26 2026 read: IOPS=2, BW=2578KiB/s (2640kB/s)(6144KiB/2383msec) clat (msec): min=29, max=198, avg=109.75, stdev=65.74 lat (msec): min=29, max=198, avg=109.75, stdev=65.74 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 35], 40.00th=[ 127], 50.00th=[ 127], 60.00th=[ 133], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 2035, max= 4096, per=43.96%, avg=3406.00, stdev=1187.33, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2578KiB/s (2640kB/s)(6144KiB/2383msec); 0 zone resets clat (msec): min=132, max=465, avg=283.32, stdev=134.69 lat (msec): min=132, max=465, avg=283.42, stdev=134.66 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 305], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2035, max= 3500, per=22.18%, avg=2406.50, stdev=729.02, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=16.67%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=34.13%, ctx=283, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182609: Fri Apr 10 22:54:26 2026 read: IOPS=2, BW=2545KiB/s (2606kB/s)(5120KiB/2012msec) clat (usec): min=403, max=138705, avg=79958.93, stdev=72894.81 lat (usec): min=405, max=138706, avg=79960.04, stdev=72894.70 clat percentiles (usec): | 1.00th=[ 404], 5.00th=[ 404], 10.00th=[ 404], 20.00th=[ 404], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[122160], 60.00th=[122160], | 70.00th=[137364], 80.00th=[137364], 90.00th=[139461], 95.00th=[139461], | 99.00th=[139461], 99.50th=[139461], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3563KiB/s (3648kB/s)(7168KiB/2012msec); 0 zone resets clat (msec): min=95, max=338, avg=227.19, stdev=95.83 lat (msec): min=95, max=339, avg=227.27, stdev=95.84 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 108], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 264], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 317], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 1831, max= 4096, per=24.49%, avg=2656.67, stdev=1251.00, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=33.33% cpu : usr=0.00%, sys=40.08%, ctx=133, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7749KiB/s (7935kB/s), 775KiB/s-3617KiB/s (793kB/s-3703kB/s), io=20.0MiB (20.0MB), run=1982-2643msec WRITE: bw=10.6MiB/s (11.1MB/s), 2578KiB/s-3874KiB/s (2640kB/s-3967kB/s), io=28.0MiB (29.4MB), run=1982-2643msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182610: Fri Apr 10 22:54:26 2026 read: IOPS=2, BW=2932KiB/s (3002kB/s)(7168KiB/2445msec) clat (msec): min=84, max=336, avg=168.60, stdev=90.09 lat (msec): min=84, max=336, avg=168.61, stdev=90.09 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 92], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 140], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 230], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2039, max= 5206, per=41.87%, avg=3097.67, stdev=1825.88, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2094KiB/s (2144kB/s)(5120KiB/2445msec); 0 zone resets clat (msec): min=77, max=466, avg=246.84, stdev=157.07 lat (msec): min=77, max=466, avg=246.92, stdev=157.07 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1735, max= 4047, per=27.91%, avg=2891.00, stdev=1634.83, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=25.00%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=15.71%, ctx=100, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182611: Fri Apr 10 22:54:26 2026 read: IOPS=0, BW=743KiB/s (761kB/s)(2048KiB/2755msec) clat (msec): min=74, max=419, avg=247.34, stdev=244.09 lat (msec): min=74, max=419, avg=247.34, stdev=244.09 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1747, max= 2023, per=25.48%, avg=1885.00, stdev=195.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3717KiB/s (3806kB/s)(10.0MiB/2755msec); 0 zone resets clat (msec): min=40, max=355, avg=213.48, stdev=115.72 lat (msec): min=40, max=355, avg=213.56, stdev=115.72 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 63], | 30.00th=[ 105], 40.00th=[ 155], 50.00th=[ 226], 60.00th=[ 249], | 70.00th=[ 300], 80.00th=[ 321], 90.00th=[ 321], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2048, max= 4079, per=34.36%, avg=3559.25, stdev=1007.58, samples=4 iops : min= 2, max= 3, avg= 2.75, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=41.67% cpu : usr=0.00%, sys=19.86%, ctx=138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182612: Fri Apr 10 22:54:26 2026 read: IOPS=2, BW=2374KiB/s (2431kB/s)(6144KiB/2588msec) clat (msec): min=61, max=336, avg=192.63, stdev=101.72 lat (msec): min=61, max=336, avg=192.63, stdev=101.72 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 228], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2023, max= 4079, per=45.80%, avg=3388.33, stdev=1182.44, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2374KiB/s (2431kB/s)(6144KiB/2588msec); 0 zone resets clat (msec): min=57, max=387, avg=218.87, stdev=130.25 lat (msec): min=57, max=387, avg=218.96, stdev=130.26 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 186], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2023, max= 4063, per=28.30%, avg=2931.50, stdev=1052.38, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=25.00%, 250=50.00%, 500=25.00% cpu : usr=0.04%, sys=13.18%, ctx=130, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182613: Fri Apr 10 22:54:26 2026 read: IOPS=1, BW=1850KiB/s (1894kB/s)(5120KiB/2768msec) clat (msec): min=37, max=172, avg=94.67, stdev=59.85 lat (msec): min=37, max=172, avg=94.67, stdev=59.85 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 38], 10.00th=[ 38], 20.00th=[ 38], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 63], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 2023, max= 6095, per=54.87%, avg=4059.00, stdev=2879.34, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2590KiB/s (2652kB/s)(7168KiB/2768msec); 0 zone resets clat (msec): min=78, max=727, avg=310.24, stdev=228.55 lat (msec): min=78, max=727, avg=310.31, stdev=228.55 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 88], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 351], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 397], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1799, max= 4047, per=23.95%, avg=2481.25, stdev=1050.00, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=13.19%, ctx=102, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7399KiB/s (7576kB/s), 743KiB/s-2932KiB/s (761kB/s-3002kB/s), io=20.0MiB (20.0MB), run=2445-2768msec WRITE: bw=10.1MiB/s (10.6MB/s), 2094KiB/s-3717KiB/s (2144kB/s-3806kB/s), io=28.0MiB (29.4MB), run=2445-2768msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182624: Fri Apr 10 22:54:34 2026 read: IOPS=2, BW=8451KiB/s (8654kB/s)(12.0MiB/1454msec) clat (msec): min=160, max=696, avg=466.03, stdev=275.63 lat (msec): min=160, max=696, avg=466.03, stdev=275.63 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8192, max= 8192, per=82.21%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=12.94%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182625: Fri Apr 10 22:54:34 2026 read: IOPS=0, BW=2491KiB/s (2551kB/s)(4096KiB/1644msec) clat (nsec): min=446171k, max=446171k, avg=446170882.00, stdev= 0.00 lat (nsec): min=446173k, max=446173k, avg=446172619.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7301, max= 7301, per=73.27%, avg=7301.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4983KiB/s (5103kB/s)(8192KiB/1644msec); 0 zone resets clat (msec): min=423, max=751, avg=587.50, stdev=232.00 lat (msec): min=423, max=751, avg=587.92, stdev=231.93 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8192, max= 8192, per=41.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.47%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182626: Fri Apr 10 22:54:34 2026 write: IOPS=1, BW=7525KiB/s (7705kB/s)(12.0MiB/1633msec); 0 zone resets clat (msec): min=133, max=747, avg=524.48, stdev=339.37 lat (msec): min=134, max=748, avg=524.79, stdev=339.41 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8159, max= 8192, per=41.02%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=10.48%, ctx=75, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182627: Fri Apr 10 22:54:34 2026 write: IOPS=2, BW=9445KiB/s (9672kB/s)(12.0MiB/1301msec); 0 zone resets clat (msec): min=216, max=547, avg=420.80, stdev=178.83 lat (msec): min=216, max=547, avg=421.22, stdev=178.60 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8192, max= 8192, per=41.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.08%, sys=16.46%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9966KiB/s (10.2MB/s), 2491KiB/s-8451KiB/s (2551kB/s-8654kB/s), io=16.0MiB (16.8MB), run=1454-1644msec WRITE: bw=19.5MiB/s (20.4MB/s), 4983KiB/s-9445KiB/s (5103kB/s-9672kB/s), io=32.0MiB (33.6MB), run=1301-1644msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182619: Fri Apr 10 22:54:34 2026 read: IOPS=2, BW=9330KiB/s (9554kB/s)(12.0MiB/1317msec) clat (msec): min=374, max=546, avg=432.32, stdev=99.30 lat (msec): min=374, max=546, avg=432.32, stdev=99.30 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7327, max= 8143, per=72.24%, avg=7735.00, stdev=577.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=36.63%, ctx=2028, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182620: Fri Apr 10 22:54:34 2026 read: IOPS=0, BW=2677KiB/s (2741kB/s)(4096KiB/1530msec) clat (nsec): min=310133k, max=310133k, avg=310132885.00, stdev= 0.00 lat (nsec): min=310136k, max=310136k, avg=310135650.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7585, max= 7585, per=70.83%, avg=7585.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5354KiB/s (5483kB/s)(8192KiB/1530msec); 0 zone resets clat (msec): min=424, max=728, avg=576.50, stdev=215.55 lat (msec): min=424, max=729, avg=576.82, stdev=215.57 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8143, max= 8143, per=46.87%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=18.57%, ctx=616, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182621: Fri Apr 10 22:54:34 2026 write: IOPS=1, BW=6515KiB/s (6672kB/s)(12.0MiB/1886msec); 0 zone resets clat (msec): min=72, max=945, avg=606.04, stdev=467.41 lat (msec): min=73, max=946, avg=606.40, stdev=467.47 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8143, max= 8143, per=46.87%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.19%, ctx=125, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182622: Fri Apr 10 22:54:34 2026 write: IOPS=2, BW=10.1MiB/s (10.6MB/s)(12.0MiB/1188msec); 0 zone resets clat (msec): min=186, max=515, avg=375.35, stdev=169.54 lat (msec): min=187, max=515, avg=375.71, stdev=169.58 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7613, max= 8143, per=45.34%, avg=7878.00, stdev=374.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=26.62%, ctx=121, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.5MiB/s (10.0MB/s), 2677KiB/s-9330KiB/s (2741kB/s-9554kB/s), io=16.0MiB (16.8MB), run=1317-1530msec WRITE: bw=16.0MiB/s (17.8MB/s), 5354KiB/s-10.1MiB/s (5483kB/s-10.6MB/s), io=32.0MiB (33.6MB), run=1188-1886msec