== sanity test 398b: DIO and buffer IO race ============== 13:21:33 (1772475693) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.85047 s, 17.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180873: Mon Mar 2 13:22:40 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(5992KiB/58255msec) clat (usec): min=33, max=690478, avg=21264.29, stdev=20890.03 lat (usec): min=33, max=690480, avg=21265.65, stdev=20890.24 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 7767], 10.00th=[ 9765], 20.00th=[ 12125], | 30.00th=[ 14222], 40.00th=[ 16188], 50.00th=[ 18482], 60.00th=[ 21365], | 70.00th=[ 23987], 80.00th=[ 28181], 90.00th=[ 34341], 95.00th=[ 41681], | 99.00th=[ 62653], 99.50th=[ 77071], 99.90th=[ 99091], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 13, max= 168, per=24.76%, avg=102.03, stdev=26.58, samples=115 iops : min= 3, max= 42, avg=25.12, stdev= 6.69, samples=115 write: IOPS=27, BW=108KiB/s (111kB/s)(6296KiB/58255msec); 0 zone resets clat (usec): min=734, max=121503, avg=16626.46, stdev=13972.68 lat (usec): min=734, max=121503, avg=16627.74, stdev=13972.73 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2040], 10.00th=[ 2802], 20.00th=[ 4015], | 30.00th=[ 7308], 40.00th=[ 10814], 50.00th=[ 13304], 60.00th=[ 16712], | 70.00th=[ 20841], 80.00th=[ 26608], 90.00th=[ 34341], 95.00th=[ 42206], | 99.00th=[ 62129], 99.50th=[ 78119], 99.90th=[101188], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 48, max= 176, per=24.99%, avg=107.69, stdev=28.22, samples=114 iops : min= 12, max= 44, avg=26.54, stdev= 7.13, samples=114 lat (usec) : 50=0.07%, 100=0.55%, 250=0.78%, 750=0.03%, 1000=0.23% lat (msec) : 2=2.25%, 4=7.55%, 10=13.31%, 20=36.75%, 50=35.90% lat (msec) : 100=2.47%, 250=0.07%, 750=0.03% cpu : usr=0.12%, sys=19.62%, ctx=8837, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180874: Mon Mar 2 13:22:40 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(5940KiB/57901msec) clat (usec): min=44, max=111624, avg=21002.42, stdev=12153.62 lat (usec): min=45, max=111625, avg=21003.37, stdev=12153.67 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 8094], 10.00th=[ 9634], 20.00th=[ 11994], | 30.00th=[ 14091], 40.00th=[ 16581], 50.00th=[ 18744], 60.00th=[ 21365], | 70.00th=[ 23987], 80.00th=[ 27919], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 68682], 99.50th=[ 77071], 99.90th=[ 92799], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 6, max= 160, per=24.85%, avg=102.37, stdev=26.74, samples=115 iops : min= 1, max= 40, avg=25.21, stdev= 6.73, samples=115 write: IOPS=27, BW=110KiB/s (112kB/s)(6348KiB/57901msec); 0 zone resets clat (usec): min=849, max=647740, avg=16676.70, stdev=21054.35 lat (usec): min=849, max=647741, avg=16677.97, stdev=21054.41 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1975], 10.00th=[ 2671], 20.00th=[ 3654], | 30.00th=[ 5997], 40.00th=[ 10159], 50.00th=[ 12780], 60.00th=[ 16057], | 70.00th=[ 20579], 80.00th=[ 26870], 90.00th=[ 35390], 95.00th=[ 43254], | 99.00th=[ 60556], 99.50th=[ 74974], 99.90th=[ 89654], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 6, max= 200, per=25.33%, avg=109.18, stdev=33.91, samples=115 iops : min= 1, max= 50, avg=26.91, stdev= 8.51, samples=115 lat (usec) : 50=0.03%, 100=0.46%, 250=0.68%, 750=0.03%, 1000=0.42% lat (msec) : 2=2.38%, 4=8.82%, 10=13.28%, 20=35.68%, 50=35.51% lat (msec) : 100=2.64%, 250=0.03%, 750=0.03% cpu : usr=0.14%, sys=19.87%, ctx=8883, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180875: Mon Mar 2 13:22:40 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(6028KiB/56886msec) clat (usec): min=46, max=83216, avg=20156.12, stdev=11309.57 lat (usec): min=47, max=83217, avg=20157.44, stdev=11309.40 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 7373], 10.00th=[ 9372], 20.00th=[11469], | 30.00th=[13566], 40.00th=[15533], 50.00th=[17957], 60.00th=[20317], | 70.00th=[23462], 80.00th=[27657], 90.00th=[33424], 95.00th=[41157], | 99.00th=[60031], 99.50th=[67634], 99.90th=[78119], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 39, max= 191, per=25.95%, avg=106.92, stdev=31.93, samples=112 iops : min= 9, max= 47, avg=26.36, stdev= 8.00, samples=112 write: IOPS=27, BW=110KiB/s (113kB/s)(6260KiB/56886msec); 0 zone resets clat (usec): min=838, max=671595, avg=16799.28, stdev=21561.46 lat (usec): min=839, max=671597, avg=16800.71, stdev=21561.49 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 2073], 10.00th=[ 2638], 20.00th=[ 3884], | 30.00th=[ 6063], 40.00th=[ 10028], 50.00th=[ 13435], 60.00th=[ 16450], | 70.00th=[ 20579], 80.00th=[ 25822], 90.00th=[ 35390], 95.00th=[ 43254], | 99.00th=[ 65799], 99.50th=[ 74974], 99.90th=[ 98042], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 39, max= 191, per=25.74%, avg=110.92, stdev=25.45, samples=112 iops : min= 9, max= 47, avg=27.36, stdev= 6.37, samples=112 lat (usec) : 50=0.16%, 100=0.55%, 250=0.72%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=2.31%, 4=7.91%, 10=14.62%, 20=37.14%, 50=33.82% lat (msec) : 100=2.47%, 750=0.03% cpu : usr=0.09%, sys=19.93%, ctx=8711, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180876: Mon Mar 2 13:22:40 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(6052KiB/58221msec) clat (usec): min=48, max=111915, avg=20818.92, stdev=11656.03 lat (usec): min=48, max=111917, avg=20820.37, stdev=11656.41 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 7898], 10.00th=[ 9503], 20.00th=[ 11731], | 30.00th=[ 13698], 40.00th=[ 16057], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 24773], 80.00th=[ 28443], 90.00th=[ 34341], 95.00th=[ 41681], | 99.00th=[ 61604], 99.50th=[ 69731], 99.90th=[ 90702], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 55, max= 168, per=25.28%, avg=104.14, stdev=22.62, samples=114 iops : min= 13, max= 42, avg=25.65, stdev= 5.75, samples=114 write: IOPS=26, BW=107KiB/s (110kB/s)(6236KiB/58221msec); 0 zone resets clat (usec): min=838, max=654414, avg=16984.21, stdev=21141.56 lat (usec): min=839, max=654416, avg=16988.56, stdev=21144.14 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 2114], 10.00th=[ 2704], 20.00th=[ 3982], | 30.00th=[ 6194], 40.00th=[ 10552], 50.00th=[ 13566], 60.00th=[ 16909], | 70.00th=[ 21627], 80.00th=[ 27395], 90.00th=[ 36439], 95.00th=[ 43254], | 99.00th=[ 61604], 99.50th=[ 67634], 99.90th=[ 92799], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 13, max= 184, per=24.76%, avg=106.73, stdev=30.84, samples=115 iops : min= 3, max= 46, avg=26.30, stdev= 7.70, samples=115 lat (usec) : 50=0.07%, 100=0.55%, 250=0.65%, 500=0.07%, 1000=0.10% lat (msec) : 2=2.18%, 4=8.01%, 10=14.26%, 20=34.99%, 50=36.65% lat (msec) : 100=2.41%, 250=0.03%, 750=0.03% cpu : usr=0.14%, sys=19.72%, ctx=8899, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=412KiB/s (422kB/s), 103KiB/s-106KiB/s (105kB/s-109kB/s), io=23.4MiB (24.6MB), run=56886-58255msec WRITE: bw=432KiB/s (442kB/s), 107KiB/s-110KiB/s (110kB/s-113kB/s), io=24.6MiB (25.7MB), run=56886-58255msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180878: Mon Mar 2 13:22:56 2026 read: IOPS=20, BW=81.0KiB/s (82.0kB/s)(5992KiB/73947msec) clat (msec): min=3, max=702, avg=20.64, stdev=23.24 lat (msec): min=3, max=702, avg=20.64, stdev=23.24 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 54], | 99.00th=[ 73], 99.50th=[ 80], 99.90th=[ 144], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 15, max= 200, per=25.12%, avg=81.38, stdev=41.64, samples=146 iops : min= 3, max= 50, avg=20.00, stdev=10.49, samples=146 write: IOPS=21, BW=85.1KiB/s (87.2kB/s)(6296KiB/73947msec); 0 zone resets clat (msec): min=6, max=148, avg=27.25, stdev=16.89 lat (msec): min=6, max=148, avg=27.25, stdev=16.89 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 49], 95.00th=[ 60], | 99.00th=[ 89], 99.50th=[ 105], 99.90th=[ 129], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 16, max= 192, per=25.22%, avg=85.49, stdev=40.28, samples=146 iops : min= 4, max= 48, avg=21.03, stdev=10.15, samples=146 lat (msec) : 4=0.07%, 10=13.67%, 20=41.08%, 50=37.37%, 100=7.45% lat (msec) : 250=0.33%, 750=0.03% cpu : usr=0.12%, sys=9.62%, ctx=6013, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180879: Mon Mar 2 13:22:56 2026 read: IOPS=20, BW=80.2KiB/s (82.2kB/s)(5940KiB/74037msec) clat (msec): min=3, max=660, avg=20.40, stdev=22.65 lat (msec): min=3, max=660, avg=20.40, stdev=22.65 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 73], 99.50th=[ 86], 99.90th=[ 144], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8, max= 207, per=24.83%, avg=80.45, stdev=40.98, samples=146 iops : min= 2, max= 51, avg=19.77, stdev=10.30, samples=146 write: IOPS=21, BW=85.7KiB/s (87.8kB/s)(6348KiB/74037msec); 0 zone resets clat (msec): min=5, max=162, avg=27.47, stdev=17.28 lat (msec): min=5, max=162, avg=27.48, stdev=17.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 51], 95.00th=[ 60], | 99.00th=[ 91], 99.50th=[ 105], 99.90th=[ 140], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 23, max= 224, per=25.31%, avg=85.82, stdev=40.50, samples=146 iops : min= 5, max= 56, avg=21.11, stdev=10.22, samples=146 lat (msec) : 4=0.03%, 10=13.83%, 20=40.85%, 50=37.11%, 100=7.65% lat (msec) : 250=0.49%, 750=0.03% cpu : usr=0.11%, sys=9.66%, ctx=6064, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180880: Mon Mar 2 13:22:56 2026 read: IOPS=20, BW=81.4KiB/s (83.3kB/s)(6028KiB/74062msec) clat (msec): min=3, max=106, avg=20.29, stdev=14.94 lat (msec): min=3, max=106, avg=20.29, stdev=14.94 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 53], | 99.00th=[ 70], 99.50th=[ 81], 99.90th=[ 95], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 23, max= 199, per=25.14%, avg=81.44, stdev=40.81, samples=146 iops : min= 5, max= 49, avg=20.01, stdev=10.31, samples=146 write: IOPS=21, BW=84.5KiB/s (86.6kB/s)(6260KiB/74062msec); 0 zone resets clat (msec): min=6, max=661, avg=27.69, stdev=23.57 lat (msec): min=6, max=661, avg=27.69, stdev=23.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 91], 99.50th=[ 108], 99.90th=[ 138], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 31, max= 215, per=24.93%, avg=84.51, stdev=39.75, samples=146 iops : min= 7, max= 53, avg=20.78, stdev= 9.99, samples=146 lat (msec) : 4=0.20%, 10=14.26%, 20=40.72%, 50=36.85%, 100=7.65% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.12%, sys=9.58%, ctx=6076, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180881: Mon Mar 2 13:22:56 2026 read: IOPS=20, BW=82.1KiB/s (84.1kB/s)(6052KiB/73727msec) clat (msec): min=4, max=144, avg=19.80, stdev=15.22 lat (msec): min=4, max=144, avg=19.80, stdev=15.22 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 75], 99.50th=[ 86], 99.90th=[ 142], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 23, max= 224, per=25.38%, avg=82.22, stdev=42.47, samples=145 iops : min= 5, max= 56, avg=20.21, stdev=10.68, samples=145 write: IOPS=21, BW=84.6KiB/s (86.6kB/s)(6236KiB/73727msec); 0 zone resets clat (msec): min=6, max=662, avg=27.98, stdev=23.82 lat (msec): min=6, max=662, avg=27.98, stdev=23.82 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 39], 90.00th=[ 50], 95.00th=[ 62], | 99.00th=[ 94], 99.50th=[ 109], 99.90th=[ 163], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 15, max= 208, per=25.02%, avg=84.81, stdev=41.46, samples=145 iops : min= 3, max= 52, avg=20.86, stdev=10.45, samples=145 lat (msec) : 10=14.32%, 20=41.15%, 50=37.11%, 100=6.90%, 250=0.49% lat (msec) : 750=0.03% cpu : usr=0.11%, sys=9.65%, ctx=6038, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=324KiB/s (332kB/s), 80.2KiB/s-82.1KiB/s (82.2kB/s-84.1kB/s), io=23.4MiB (24.6MB), run=73727-74062msec WRITE: bw=339KiB/s (348kB/s), 84.5KiB/s-85.7KiB/s (86.6kB/s-87.8kB/s), io=24.6MiB (25.7MB), run=73727-74062msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180912: Mon Mar 2 13:23:20 2026 read: IOPS=20, BW=332KiB/s (340kB/s)(5920KiB/17846msec) clat (usec): min=40, max=79587, avg=24314.57, stdev=13333.27 lat (usec): min=41, max=79588, avg=24315.66, stdev=13333.29 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 114], 10.00th=[ 9503], 20.00th=[14091], | 30.00th=[17695], 40.00th=[20317], 50.00th=[22938], 60.00th=[26608], | 70.00th=[29492], 80.00th=[34341], 90.00th=[40109], 95.00th=[46924], | 99.00th=[66847], 99.50th=[74974], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 220, max= 544, per=25.24%, avg=330.11, stdev=83.82, samples=35 iops : min= 13, max= 34, avg=20.03, stdev= 5.45, samples=35 write: IOPS=22, BW=357KiB/s (365kB/s)(6368KiB/17846msec); 0 zone resets clat (usec): min=1550, max=133038, avg=21971.01, stdev=16989.11 lat (usec): min=1551, max=133039, avg=21979.48, stdev=16998.69 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 36], 90.00th=[ 45], 95.00th=[ 55], | 99.00th=[ 72], 99.50th=[ 90], 99.90th=[ 133], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 223, max= 573, per=25.98%, avg=357.71, stdev=91.93, samples=35 iops : min= 13, max= 35, avg=21.77, stdev= 5.62, samples=35 lat (usec) : 50=0.26%, 100=1.82%, 250=1.56%, 500=0.13% lat (msec) : 2=0.39%, 4=3.52%, 10=12.11%, 20=27.08%, 50=47.79% lat (msec) : 100=5.21%, 250=0.13% cpu : usr=0.15%, sys=21.27%, ctx=2666, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180913: Mon Mar 2 13:23:20 2026 read: IOPS=19, BW=316KiB/s (324kB/s)(5744KiB/18153msec) clat (usec): min=39, max=103563, avg=26848.19, stdev=15023.36 lat (usec): min=39, max=103565, avg=26849.32, stdev=15023.39 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 3064], 10.00th=[ 12387], 20.00th=[ 16712], | 30.00th=[ 19268], 40.00th=[ 21890], 50.00th=[ 24249], 60.00th=[ 26346], | 70.00th=[ 31065], 80.00th=[ 36439], 90.00th=[ 43779], 95.00th=[ 51119], | 99.00th=[ 90702], 99.50th=[ 99091], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 222, max= 479, per=24.23%, avg=316.89, stdev=65.84, samples=35 iops : min= 13, max= 29, avg=19.20, stdev= 4.21, samples=35 write: IOPS=22, BW=360KiB/s (369kB/s)(6544KiB/18153msec); 0 zone resets clat (usec): min=1660, max=79949, avg=20728.58, stdev=14272.70 lat (usec): min=1663, max=79951, avg=20730.87, stdev=14272.73 clat percentiles (usec): | 1.00th=[ 2278], 5.00th=[ 3851], 10.00th=[ 4948], 20.00th=[ 8094], | 30.00th=[11338], 40.00th=[14484], 50.00th=[17957], 60.00th=[21627], | 70.00th=[25560], 80.00th=[31851], 90.00th=[40633], 95.00th=[49021], | 99.00th=[62653], 99.50th=[66847], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 188, max= 640, per=25.74%, avg=354.37, stdev=103.47, samples=35 iops : min= 11, max= 40, avg=21.54, stdev= 6.59, samples=35 lat (usec) : 50=0.26%, 100=0.65%, 250=1.04%, 500=0.26% lat (msec) : 2=0.39%, 4=2.73%, 10=11.33%, 20=28.52%, 50=49.87% lat (msec) : 100=4.82%, 250=0.13% cpu : usr=0.10%, sys=21.65%, ctx=2694, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180914: Mon Mar 2 13:23:20 2026 read: IOPS=21, BW=342KiB/s (350kB/s)(6256KiB/18298msec) clat (usec): min=67, max=141875, avg=25264.89, stdev=16110.70 lat (usec): min=69, max=141876, avg=25266.43, stdev=16110.73 clat percentiles (usec): | 1.00th=[ 80], 5.00th=[ 151], 10.00th=[ 10945], 20.00th=[ 14615], | 30.00th=[ 17957], 40.00th=[ 20055], 50.00th=[ 22938], 60.00th=[ 25560], | 70.00th=[ 29492], 80.00th=[ 34866], 90.00th=[ 43254], 95.00th=[ 52691], | 99.00th=[ 69731], 99.50th=[141558], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 125, max= 512, per=26.23%, avg=343.11, stdev=87.01, samples=36 iops : min= 7, max= 32, avg=20.83, stdev= 5.63, samples=36 write: IOPS=20, BW=330KiB/s (338kB/s)(6032KiB/18298msec); 0 zone resets clat (usec): min=1199, max=128968, avg=22104.03, stdev=16501.58 lat (usec): min=1201, max=128971, avg=22106.91, stdev=16501.24 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 71], 99.50th=[ 80], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 128, max= 542, per=23.76%, avg=327.22, stdev=83.58, samples=36 iops : min= 8, max= 33, avg=19.83, stdev= 5.19, samples=36 lat (usec) : 100=1.04%, 250=2.47%, 500=0.26%, 750=0.13% lat (msec) : 2=0.39%, 4=2.47%, 10=11.33%, 20=28.13%, 50=47.66% lat (msec) : 100=5.73%, 250=0.39% cpu : usr=0.17%, sys=20.80%, ctx=2801, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180915: Mon Mar 2 13:23:20 2026 read: IOPS=20, BW=334KiB/s (342kB/s)(6032KiB/18057msec) clat (usec): min=43, max=97165, avg=24267.74, stdev=14473.61 lat (usec): min=44, max=97166, avg=24269.06, stdev=14473.60 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 133], 10.00th=[10290], 20.00th=[13960], | 30.00th=[17171], 40.00th=[19530], 50.00th=[22152], 60.00th=[25035], | 70.00th=[28967], 80.00th=[34341], 90.00th=[41681], 95.00th=[49021], | 99.00th=[81265], 99.50th=[94897], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 189, max= 544, per=25.39%, avg=332.11, stdev=91.14, samples=35 iops : min= 11, max= 34, avg=20.17, stdev= 5.73, samples=35 write: IOPS=21, BW=346KiB/s (355kB/s)(6256KiB/18057msec); 0 zone resets clat (usec): min=1194, max=146360, avg=22362.06, stdev=18050.87 lat (usec): min=1197, max=146362, avg=22403.76, stdev=18084.72 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 4015], 10.00th=[ 5080], 20.00th=[ 7635], | 30.00th=[ 11338], 40.00th=[ 14353], 50.00th=[ 17433], 60.00th=[ 22414], | 70.00th=[ 27919], 80.00th=[ 34341], 90.00th=[ 43779], 95.00th=[ 54264], | 99.00th=[ 91751], 99.50th=[117965], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 160, max= 542, per=25.08%, avg=345.40, stdev=88.33, samples=35 iops : min= 10, max= 33, avg=21.00, stdev= 5.47, samples=35 lat (usec) : 50=0.13%, 100=1.43%, 250=2.08% lat (msec) : 2=0.52%, 4=1.95%, 10=12.11%, 20=30.86%, 50=45.18% lat (msec) : 100=5.34%, 250=0.39% cpu : usr=0.17%, sys=20.74%, ctx=2798, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1309KiB/s (1340kB/s), 316KiB/s-342KiB/s (324kB/s-350kB/s), io=23.4MiB (24.5MB), run=17846-18298msec WRITE: bw=1377KiB/s (1410kB/s), 330KiB/s-360KiB/s (338kB/s-369kB/s), io=24.6MiB (25.8MB), run=17846-18298msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180907: Mon Mar 2 13:23:24 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(5920KiB/22692msec) clat (usec): min=4392, max=99701, avg=25326.24, stdev=19040.20 lat (usec): min=4393, max=99702, avg=25327.50, stdev=19040.19 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 37], 90.00th=[ 52], 95.00th=[ 68], | 99.00th=[ 94], 99.50th=[ 100], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 64, max= 672, per=24.01%, avg=253.27, stdev=140.38, samples=44 iops : min= 4, max= 42, avg=15.27, stdev= 8.85, samples=44 write: IOPS=17, BW=281KiB/s (287kB/s)(6368KiB/22692msec); 0 zone resets clat (msec): min=9, max=142, avg=33.29, stdev=21.50 lat (msec): min=9, max=142, avg=33.30, stdev=21.50 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 50], 90.00th=[ 61], 95.00th=[ 75], | 99.00th=[ 109], 99.50th=[ 133], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 95, max= 704, per=24.93%, avg=276.73, stdev=139.03, samples=44 iops : min= 5, max= 44, avg=16.75, stdev= 8.85, samples=44 lat (msec) : 10=7.94%, 20=34.77%, 50=41.80%, 100=14.84%, 250=0.65% cpu : usr=0.11%, sys=9.18%, ctx=1686, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180908: Mon Mar 2 13:23:24 2026 read: IOPS=15, BW=254KiB/s (260kB/s)(5744KiB/22623msec) clat (msec): min=4, max=114, avg=24.83, stdev=17.83 lat (msec): min=4, max=114, avg=24.83, stdev=17.83 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 53], 95.00th=[ 62], | 99.00th=[ 91], 99.50th=[ 106], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 32, max= 702, per=23.94%, avg=252.57, stdev=138.10, samples=44 iops : min= 2, max= 43, avg=15.23, stdev= 8.73, samples=44 write: IOPS=18, BW=289KiB/s (296kB/s)(6544KiB/22623msec); 0 zone resets clat (msec): min=9, max=137, avg=33.38, stdev=20.88 lat (msec): min=9, max=137, avg=33.38, stdev=20.88 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 63], 95.00th=[ 73], | 99.00th=[ 104], 99.50th=[ 108], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 95, max= 864, per=25.49%, avg=282.95, stdev=144.69, samples=44 iops : min= 5, max= 54, avg=17.14, stdev= 9.20, samples=44 lat (msec) : 10=7.55%, 20=35.94%, 50=40.76%, 100=14.71%, 250=1.04% cpu : usr=0.07%, sys=9.31%, ctx=1644, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180909: Mon Mar 2 13:23:24 2026 read: IOPS=17, BW=277KiB/s (283kB/s)(6256KiB/22602msec) clat (msec): min=5, max=124, avg=25.40, stdev=19.41 lat (msec): min=5, max=124, avg=25.40, stdev=19.41 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 28], 80.00th=[ 37], 90.00th=[ 55], 95.00th=[ 68], | 99.00th=[ 89], 99.50th=[ 118], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 31, max= 672, per=26.07%, avg=275.00, stdev=143.84, samples=44 iops : min= 1, max= 42, avg=16.64, stdev= 9.09, samples=44 write: IOPS=16, BW=267KiB/s (273kB/s)(6032KiB/22602msec); 0 zone resets clat (msec): min=7, max=166, avg=33.51, stdev=21.64 lat (msec): min=7, max=166, avg=33.51, stdev=21.64 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 66], 95.00th=[ 74], | 99.00th=[ 109], 99.50th=[ 140], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 63, max= 768, per=23.62%, avg=262.16, stdev=139.52, samples=44 iops : min= 3, max= 48, avg=15.82, stdev= 8.88, samples=44 lat (msec) : 10=7.68%, 20=36.59%, 50=41.28%, 100=13.54%, 250=0.91% cpu : usr=0.10%, sys=9.30%, ctx=1692, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180910: Mon Mar 2 13:23:24 2026 read: IOPS=16, BW=267KiB/s (273kB/s)(6032KiB/22616msec) clat (msec): min=4, max=137, avg=25.14, stdev=19.16 lat (msec): min=4, max=137, avg=25.14, stdev=19.16 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 38], 90.00th=[ 54], 95.00th=[ 64], | 99.00th=[ 91], 99.50th=[ 103], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 768, per=24.73%, avg=260.91, stdev=140.70, samples=44 iops : min= 3, max= 48, avg=15.75, stdev= 8.94, samples=44 write: IOPS=17, BW=277KiB/s (283kB/s)(6256KiB/22616msec); 0 zone resets clat (msec): min=8, max=165, avg=33.45, stdev=21.66 lat (msec): min=8, max=165, avg=33.45, stdev=21.66 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 62], 95.00th=[ 75], | 99.00th=[ 115], 99.50th=[ 132], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 94, max= 670, per=24.72%, avg=274.43, stdev=134.06, samples=44 iops : min= 5, max= 41, avg=16.59, stdev= 8.52, samples=44 lat (msec) : 10=6.77%, 20=37.11%, 50=41.28%, 100=13.80%, 250=1.04% cpu : usr=0.15%, sys=9.46%, ctx=1667, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1056KiB/s (1081kB/s), 254KiB/s-277KiB/s (260kB/s-283kB/s), io=23.4MiB (24.5MB), run=22602-22692msec WRITE: bw=1111KiB/s (1137kB/s), 267KiB/s-289KiB/s (273kB/s-296kB/s), io=24.6MiB (25.8MB), run=22602-22692msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180924: Mon Mar 2 13:23:35 2026 read: IOPS=2, BW=2379KiB/s (2436kB/s)(7168KiB/3013msec) clat (msec): min=67, max=321, avg=185.22, stdev=94.33 lat (msec): min=67, max=321, avg=185.22, stdev=94.33 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 85], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 171], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 279], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 4096, max= 5731, per=85.66%, avg=4913.50, stdev=1156.12, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1699KiB/s (1740kB/s)(5120KiB/3013msec); 0 zone resets clat (msec): min=189, max=563, avg=327.13, stdev=150.90 lat (msec): min=189, max=563, avg=327.22, stdev=150.88 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2015, max= 4000, per=33.47%, avg=2687.67, stdev=1136.63, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=21.45%, ctx=233, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180925: Mon Mar 2 13:23:35 2026 read: IOPS=0, BW=574KiB/s (587kB/s)(2048KiB/3570msec) clat (usec): min=63088, max=76960, avg=70024.31, stdev=9808.99 lat (usec): min=63089, max=76963, avg=70026.42, stdev=9810.12 clat percentiles (usec): | 1.00th=[63177], 5.00th=[63177], 10.00th=[63177], 20.00th=[63177], | 30.00th=[63177], 40.00th=[63177], 50.00th=[63177], 60.00th=[77071], | 70.00th=[77071], 80.00th=[77071], 90.00th=[77071], 95.00th=[77071], | 99.00th=[77071], 99.50th=[77071], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 1917, max= 2000, per=34.14%, avg=1958.50, stdev=58.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2868KiB/s (2937kB/s)(10.0MiB/3570msec); 0 zone resets clat (msec): min=88, max=906, avg=336.30, stdev=247.01 lat (msec): min=88, max=906, avg=336.49, stdev=246.95 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 103], | 30.00th=[ 167], 40.00th=[ 169], 50.00th=[ 249], 60.00th=[ 359], | 70.00th=[ 380], 80.00th=[ 430], 90.00th=[ 518], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1917, max= 6144, per=37.87%, avg=3041.33, stdev=1736.13, samples=6 iops : min= 1, max= 6, avg= 2.50, stdev= 2.07, samples=6 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.06%, sys=21.04%, ctx=213, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180926: Mon Mar 2 13:23:35 2026 read: IOPS=1, BW=1794KiB/s (1837kB/s)(6144KiB/3424msec) clat (msec): min=68, max=341, avg=202.46, stdev=99.12 lat (msec): min=68, max=341, avg=202.46, stdev=99.12 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 228], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 2043, max= 4031, per=58.54%, avg=3358.00, stdev=1138.93, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1794KiB/s (1837kB/s)(6144KiB/3424msec); 0 zone resets clat (msec): min=77, max=883, avg=364.13, stdev=275.24 lat (msec): min=77, max=883, avg=364.25, stdev=275.24 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 347], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 2000, max= 3828, per=30.88%, avg=2479.75, stdev=899.09, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.03%, sys=11.77%, ctx=357, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180927: Mon Mar 2 13:23:35 2026 read: IOPS=1, BW=1439KiB/s (1474kB/s)(5120KiB/3557msec) clat (msec): min=42, max=437, avg=141.55, stdev=166.59 lat (msec): min=42, max=437, avg=141.55, stdev=166.59 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 43], | 30.00th=[ 67], 40.00th=[ 67], 50.00th=[ 67], 60.00th=[ 67], | 70.00th=[ 95], 80.00th=[ 95], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 4087, max= 4096, per=71.33%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2015KiB/s (2064kB/s)(7168KiB/3557msec); 0 zone resets clat (msec): min=86, max=976, avg=382.46, stdev=350.63 lat (msec): min=86, max=976, avg=382.61, stdev=350.56 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 94], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 275], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 751], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1954, max= 6144, per=44.04%, avg=3536.50, stdev=1977.69, samples=4 iops : min= 1, max= 6, avg= 3.00, stdev= 2.16, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=8.33%, 500=25.00%, 1000=16.67% cpu : usr=0.03%, sys=11.16%, ctx=164, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5737KiB/s (5874kB/s), 574KiB/s-2379KiB/s (587kB/s-2436kB/s), io=20.0MiB (20.0MB), run=3013-3570msec WRITE: bw=8031KiB/s (8224kB/s), 1699KiB/s-2868KiB/s (1740kB/s-2937kB/s), io=28.0MiB (29.4MB), run=3013-3570msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180928: Mon Mar 2 13:23:35 2026 read: IOPS=2, BW=2366KiB/s (2423kB/s)(7168KiB/3029msec) clat (usec): min=595, max=578431, avg=214248.21, stdev=203241.97 lat (usec): min=596, max=578432, avg=214249.90, stdev=203241.96 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 775], | 30.00th=[116917], 40.00th=[116917], 50.00th=[231736], 60.00th=[240124], | 70.00th=[240124], 80.00th=[329253], 90.00th=[574620], 95.00th=[574620], | 99.00th=[574620], 99.50th=[574620], 99.90th=[574620], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 1910, max= 4096, per=44.44%, avg=2501.50, stdev=1064.15, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1690KiB/s (1731kB/s)(5120KiB/3029msec); 0 zone resets clat (msec): min=157, max=399, avg=279.48, stdev=105.77 lat (msec): min=157, max=399, avg=279.55, stdev=105.76 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1969, max= 4063, per=38.27%, avg=3016.00, stdev=1480.68, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=37.75%, ctx=572, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180929: Mon Mar 2 13:23:35 2026 read: IOPS=0, BW=563KiB/s (576kB/s)(2048KiB/3638msec) clat (usec): min=517, max=223571, avg=112044.64, stdev=157722.61 lat (usec): min=518, max=223574, avg=112046.42, stdev=157724.36 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 519], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[ 519], 60.00th=[223347], | 70.00th=[223347], 80.00th=[223347], 90.00th=[223347], 95.00th=[223347], | 99.00th=[223347], 99.50th=[223347], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 1882, max= 2031, per=34.76%, avg=1956.50, stdev=105.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2815KiB/s (2882kB/s)(10.0MiB/3638msec); 0 zone resets clat (msec): min=61, max=709, avg=326.55, stdev=212.32 lat (msec): min=61, max=709, avg=326.63, stdev=212.29 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 68], | 30.00th=[ 155], 40.00th=[ 199], 50.00th=[ 330], 60.00th=[ 338], | 70.00th=[ 368], 80.00th=[ 510], 90.00th=[ 527], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1969, max= 6144, per=38.70%, avg=3049.67, stdev=1721.86, samples=6 iops : min= 1, max= 6, avg= 2.33, stdev= 1.97, samples=6 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=38.63%, ctx=392, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180930: Mon Mar 2 13:23:35 2026 read: IOPS=1, BW=1887KiB/s (1932kB/s)(6144KiB/3256msec) clat (usec): min=600, max=216381, avg=82025.75, stdev=95728.96 lat (usec): min=602, max=216383, avg=82027.15, stdev=95729.00 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 660], | 30.00th=[ 660], 40.00th=[ 668], 50.00th=[ 668], 60.00th=[106431], | 70.00th=[166724], 80.00th=[166724], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 2043, max= 4096, per=60.41%, avg=3400.67, stdev=1175.89, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1887KiB/s (1932kB/s)(6144KiB/3256msec); 0 zone resets clat (msec): min=247, max=977, avg=454.95, stdev=263.15 lat (msec): min=247, max=977, avg=455.02, stdev=263.16 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 388], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1903, max= 2048, per=25.52%, avg=2011.20, stdev=60.94, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=25.00% lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=40.58%, ctx=259, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180931: Mon Mar 2 13:23:35 2026 read: IOPS=2, BW=2128KiB/s (2179kB/s)(5120KiB/2406msec) clat (usec): min=808, max=302853, avg=157399.83, stdev=122758.50 lat (usec): min=810, max=302854, avg=157401.04, stdev=122758.46 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 807], | 30.00th=[ 90702], 40.00th=[ 90702], 50.00th=[137364], 60.00th=[137364], | 70.00th=[254804], 80.00th=[254804], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 1969, max= 6144, per=72.06%, avg=4056.50, stdev=2952.17, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2979KiB/s (3051kB/s)(7168KiB/2406msec); 0 zone resets clat (msec): min=83, max=493, avg=227.99, stdev=146.07 lat (msec): min=83, max=493, avg=228.07, stdev=146.08 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 87], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 192], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 338], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1822, max= 4063, per=33.22%, avg=2618.00, stdev=1253.56, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=25.00%, 250=33.33%, 500=33.33% cpu : usr=0.04%, sys=55.97%, ctx=447, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5629KiB/s (5765kB/s), 563KiB/s-2366KiB/s (576kB/s-2423kB/s), io=20.0MiB (20.0MB), run=2406-3638msec WRITE: bw=7881KiB/s (8070kB/s), 1690KiB/s-2979KiB/s (1731kB/s-3051kB/s), io=28.0MiB (29.4MB), run=2406-3638msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180938: Mon Mar 2 13:23:44 2026 read: IOPS=1, BW=6540KiB/s (6697kB/s)(12.0MiB/1879msec) clat (msec): min=480, max=767, avg=585.38, stdev=158.42 lat (msec): min=480, max=767, avg=585.38, stdev=158.42 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8047, max= 8126, per=100.00%, avg=8086.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=38.29%, ctx=1783, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180940: Mon Mar 2 13:23:44 2026 read: IOPS=0, BW=1832KiB/s (1876kB/s)(4096KiB/2236msec) clat (nsec): min=743475k, max=743475k, avg=743475443.00, stdev= 0.00 lat (nsec): min=743478k, max=743478k, avg=743477998.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3664KiB/s (3752kB/s)(8192KiB/2236msec); 0 zone resets clat (msec): min=373, max=960, avg=666.63, stdev=415.19 lat (msec): min=375, max=960, avg=668.25, stdev=413.40 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 961], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 8047, max= 8047, per=54.91%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.44%, ctx=415, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180942: Mon Mar 2 13:23:44 2026 write: IOPS=1, BW=7022KiB/s (7190kB/s)(12.0MiB/1750msec); 0 zone resets clat (msec): min=462, max=667, avg=541.43, stdev=110.26 lat (msec): min=463, max=667, avg=542.39, stdev=109.75 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8047, max= 8126, per=55.18%, avg=8086.50, stdev=55.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=24.47%, ctx=120, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180944: Mon Mar 2 13:23:44 2026 write: IOPS=1, BW=5699KiB/s (5836kB/s)(12.0MiB/2156msec); 0 zone resets clat (msec): min=278, max=1362, avg=679.69, stdev=593.95 lat (msec): min=279, max=1362, avg=680.08, stdev=594.00 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 6460, max= 8126, per=49.77%, avg=7293.00, stdev=1178.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=15.08%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7327KiB/s (7503kB/s), 1832KiB/s-6540KiB/s (1876kB/s-6697kB/s), io=16.0MiB (16.8MB), run=1879-2236msec WRITE: bw=14.3MiB/s (15.0MB/s), 3664KiB/s-7022KiB/s (3752kB/s-7190kB/s), io=32.0MiB (33.6MB), run=1750-2236msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180937: Mon Mar 2 13:23:44 2026 read: IOPS=1, BW=4832KiB/s (4948kB/s)(12.0MiB/2543msec) clat (msec): min=139, max=1828, avg=802.05, stdev=901.77 lat (msec): min=139, max=1828, avg=802.05, stdev=901.77 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=11.76%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180939: Mon Mar 2 13:23:44 2026 read: IOPS=0, BW=1609KiB/s (1647kB/s)(4096KiB/2546msec) clat (nsec): min=1482.1M, max=1482.1M, avg=1482082380.00, stdev= 0.00 lat (nsec): min=1482.1M, max=1482.1M, avg=1482083535.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1485], 5.00th=[ 1485], 10.00th=[ 1485], 20.00th=[ 1485], | 30.00th=[ 1485], 40.00th=[ 1485], 50.00th=[ 1485], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3218KiB/s (3295kB/s)(8192KiB/2546msec); 0 zone resets clat (msec): min=409, max=502, avg=455.88, stdev=65.39 lat (msec): min=410, max=502, avg=456.27, stdev=65.37 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 8159, max= 8159, per=63.40%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=13.52%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180941: Mon Mar 2 13:23:44 2026 write: IOPS=1, BW=5331KiB/s (5459kB/s)(12.0MiB/2305msec); 0 zone resets clat (msec): min=262, max=1138, avg=729.37, stdev=440.62 lat (msec): min=264, max=1139, avg=730.19, stdev=440.17 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8143, max= 8159, per=63.33%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=9.64%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180943: Mon Mar 2 13:23:44 2026 write: IOPS=1, BW=5205KiB/s (5329kB/s)(12.0MiB/2361msec); 0 zone resets clat (msec): min=624, max=896, avg=746.43, stdev=137.79 lat (msec): min=625, max=896, avg=746.84, stdev=137.89 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8110, max= 8159, per=63.21%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.08%, sys=13.98%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6435KiB/s (6590kB/s), 1609KiB/s-4832KiB/s (1647kB/s-4948kB/s), io=16.0MiB (16.8MB), run=2543-2546msec WRITE: bw=12.6MiB/s (13.2MB/s), 3218KiB/s-5331KiB/s (3295kB/s-5459kB/s), io=32.0MiB (33.6MB), run=2305-2546msec