== sanity test 398b: DIO and buffer IO race ============== 21:24:50 (1777425890) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.56359 s, 19.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189756: Tue Apr 28 21:25:56 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(5992KiB/57354msec) clat (usec): min=33, max=70757, avg=19691.52, stdev=10315.37 lat (usec): min=33, max=70758, avg=19692.29, stdev=10315.47 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 6915], 10.00th=[ 8717], 20.00th=[11207], | 30.00th=[13435], 40.00th=[15795], 50.00th=[17957], 60.00th=[20317], | 70.00th=[23462], 80.00th=[27657], 90.00th=[32637], 95.00th=[38011], | 99.00th=[52167], 99.50th=[60031], 99.90th=[69731], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 39, max= 216, per=25.13%, avg=105.03, stdev=36.96, samples=113 iops : min= 9, max= 54, avg=25.81, stdev= 9.30, samples=113 write: IOPS=27, BW=110KiB/s (112kB/s)(6296KiB/57354msec); 0 zone resets clat (usec): min=692, max=612676, avg=17524.85, stdev=19760.80 lat (usec): min=692, max=612678, avg=17525.79, stdev=19760.84 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 2704], 10.00th=[ 3425], 20.00th=[ 5538], | 30.00th=[ 8356], 40.00th=[ 10814], 50.00th=[ 14222], 60.00th=[ 17957], | 70.00th=[ 21890], 80.00th=[ 26608], 90.00th=[ 35390], 95.00th=[ 41681], | 99.00th=[ 60556], 99.50th=[ 64750], 99.90th=[ 89654], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 8, max= 208, per=24.97%, avg=109.38, stdev=39.99, samples=114 iops : min= 2, max= 52, avg=26.91, stdev=10.05, samples=114 lat (usec) : 50=0.03%, 100=0.29%, 250=0.81%, 750=0.07%, 1000=0.23% lat (msec) : 2=0.68%, 4=5.24%, 10=18.55%, 20=36.39%, 50=35.94% lat (msec) : 100=1.73%, 750=0.03% cpu : usr=0.11%, sys=26.54%, ctx=10078, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189757: Tue Apr 28 21:25:56 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(5940KiB/56785msec) clat (usec): min=69, max=78421, avg=20429.54, stdev=10490.20 lat (usec): min=69, max=78422, avg=20430.49, stdev=10490.14 clat percentiles (usec): | 1.00th=[ 190], 5.00th=[ 7439], 10.00th=[ 8979], 20.00th=[11731], | 30.00th=[13960], 40.00th=[16188], 50.00th=[18482], 60.00th=[21103], | 70.00th=[24249], 80.00th=[28443], 90.00th=[34341], 95.00th=[39060], | 99.00th=[53216], 99.50th=[58983], 99.90th=[65274], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 8, max= 199, per=24.97%, avg=104.35, stdev=35.99, samples=113 iops : min= 2, max= 49, avg=25.65, stdev= 9.05, samples=113 write: IOPS=27, BW=112KiB/s (114kB/s)(6348KiB/56785msec); 0 zone resets clat (usec): min=668, max=572961, avg=16480.81, stdev=18367.50 lat (usec): min=669, max=572961, avg=16483.13, stdev=18366.53 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2737], 10.00th=[ 3490], 20.00th=[ 5538], | 30.00th=[ 7570], 40.00th=[ 10552], 50.00th=[ 13435], 60.00th=[ 16909], | 70.00th=[ 20317], 80.00th=[ 25035], 90.00th=[ 32637], 95.00th=[ 40109], | 99.00th=[ 56361], 99.50th=[ 60031], 99.90th=[ 72877], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 24, max= 238, per=25.45%, avg=111.49, stdev=38.79, samples=113 iops : min= 6, max= 59, avg=27.44, stdev= 9.73, samples=113 lat (usec) : 100=0.13%, 250=0.42%, 500=0.07%, 750=0.03%, 1000=0.20% lat (msec) : 2=0.75%, 4=5.40%, 10=19.43%, 20=36.39%, 50=35.68% lat (msec) : 100=1.46%, 750=0.03% cpu : usr=0.09%, sys=27.08%, ctx=10067, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189758: Tue Apr 28 21:25:56 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(6028KiB/57231msec) clat (usec): min=82, max=85742, avg=20498.98, stdev=11179.92 lat (usec): min=83, max=85743, avg=20499.97, stdev=11180.36 clat percentiles (usec): | 1.00th=[ 180], 5.00th=[ 7439], 10.00th=[ 9110], 20.00th=[11338], | 30.00th=[13698], 40.00th=[15926], 50.00th=[18482], 60.00th=[21365], | 70.00th=[23725], 80.00th=[27919], 90.00th=[35390], 95.00th=[40109], | 99.00th=[58983], 99.50th=[63701], 99.90th=[81265], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 8, max= 192, per=25.11%, avg=104.97, stdev=34.84, samples=113 iops : min= 2, max= 48, avg=25.81, stdev= 8.76, samples=113 write: IOPS=27, BW=109KiB/s (112kB/s)(6260KiB/57231msec); 0 zone resets clat (usec): min=695, max=575530, avg=16657.17, stdev=18542.30 lat (usec): min=696, max=575533, avg=16658.20, stdev=18542.37 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2737], 10.00th=[ 3392], 20.00th=[ 5538], | 30.00th=[ 8094], 40.00th=[ 10683], 50.00th=[ 13435], 60.00th=[ 16581], | 70.00th=[ 20579], 80.00th=[ 25560], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 52167], 99.50th=[ 56361], 99.90th=[ 78119], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 16, max= 224, per=24.81%, avg=108.65, stdev=43.28, samples=113 iops : min= 4, max= 56, avg=26.72, stdev=10.90, samples=113 lat (usec) : 100=0.10%, 250=0.68%, 500=0.07%, 750=0.07%, 1000=0.13% lat (msec) : 2=0.59%, 4=5.60%, 10=18.65%, 20=36.43%, 50=36.04% lat (msec) : 100=1.63%, 750=0.03% cpu : usr=0.11%, sys=26.79%, ctx=10036, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189759: Tue Apr 28 21:25:56 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(6052KiB/57236msec) clat (usec): min=46, max=620040, avg=20378.46, stdev=18644.69 lat (usec): min=46, max=620042, avg=20379.20, stdev=18644.78 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 7570], 10.00th=[ 9110], 20.00th=[ 11600], | 30.00th=[ 13829], 40.00th=[ 15795], 50.00th=[ 17957], 60.00th=[ 20579], | 70.00th=[ 23725], 80.00th=[ 27919], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 53216], 99.50th=[ 58983], 99.90th=[ 76022], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 8, max= 208, per=25.13%, avg=105.04, stdev=32.93, samples=113 iops : min= 2, max= 52, avg=25.82, stdev= 8.28, samples=113 write: IOPS=27, BW=109KiB/s (112kB/s)(6236KiB/57236msec); 0 zone resets clat (usec): min=673, max=109967, avg=16765.32, stdev=12396.78 lat (usec): min=674, max=109968, avg=16766.25, stdev=12396.82 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2900], 10.00th=[ 3785], 20.00th=[ 5735], | 30.00th=[ 7963], 40.00th=[ 11207], 50.00th=[ 13960], 60.00th=[ 17433], | 70.00th=[ 21365], 80.00th=[ 26084], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 54264], 99.50th=[ 62129], 99.90th=[ 84411], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 15, max= 208, per=24.98%, avg=109.43, stdev=36.46, samples=112 iops : min= 3, max= 52, avg=26.92, stdev= 9.17, samples=112 lat (usec) : 50=0.03%, 100=0.49%, 250=0.68%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=0.62%, 4=4.69%, 10=18.39%, 20=37.37%, 50=35.90% lat (msec) : 100=1.53%, 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=26.73%, ctx=9910, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=419KiB/s (429kB/s), 104KiB/s-106KiB/s (107kB/s-108kB/s), io=23.4MiB (24.6MB), run=56785-57354msec WRITE: bw=438KiB/s (449kB/s), 109KiB/s-112KiB/s (112kB/s-114kB/s), io=24.6MiB (25.7MB), run=56785-57354msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189761: Tue Apr 28 21:26:03 2026 read: IOPS=23, BW=94.2KiB/s (96.4kB/s)(5992KiB/63628msec) clat (msec): min=2, max=609, avg=18.63, stdev=20.66 lat (msec): min=2, max=609, avg=18.63, stdev=20.66 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 38], 95.00th=[ 49], | 99.00th=[ 63], 99.50th=[ 69], 99.90th=[ 116], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 23, max= 424, per=25.11%, avg=94.16, stdev=66.71, samples=125 iops : min= 5, max= 106, avg=23.14, stdev=16.78, samples=125 write: IOPS=24, BW=98.9KiB/s (101kB/s)(6296KiB/63628msec); 0 zone resets clat (msec): min=4, max=126, avg=22.65, stdev=15.71 lat (msec): min=4, max=126, avg=22.65, stdev=15.71 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 75], 99.50th=[ 86], 99.90th=[ 101], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 32, max= 344, per=25.08%, avg=98.58, stdev=65.44, samples=125 iops : min= 8, max= 86, avg=24.24, stdev=16.49, samples=125 lat (msec) : 4=1.46%, 10=28.52%, 20=30.14%, 50=34.47%, 100=5.27% lat (msec) : 250=0.10%, 750=0.03% cpu : usr=0.11%, sys=14.61%, ctx=6617, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189762: Tue Apr 28 21:26:03 2026 read: IOPS=23, BW=93.3KiB/s (95.5kB/s)(5940KiB/63679msec) clat (msec): min=2, max=654, avg=18.74, stdev=21.79 lat (msec): min=2, max=654, avg=18.74, stdev=21.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 67], 99.50th=[ 72], 99.90th=[ 95], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 15, max= 384, per=24.86%, avg=93.21, stdev=66.34, samples=125 iops : min= 3, max= 96, avg=22.90, stdev=16.71, samples=125 write: IOPS=24, BW=99.7KiB/s (102kB/s)(6348KiB/63679msec); 0 zone resets clat (msec): min=4, max=126, avg=22.54, stdev=15.12 lat (msec): min=4, max=126, avg=22.54, stdev=15.12 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 51], | 99.00th=[ 74], 99.50th=[ 82], 99.90th=[ 103], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 24, max= 376, per=25.22%, avg=99.10, stdev=63.34, samples=125 iops : min= 6, max= 94, avg=24.37, stdev=15.95, samples=125 lat (msec) : 4=0.98%, 10=28.32%, 20=30.50%, 50=35.03%, 100=5.08% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=14.65%, ctx=6664, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189763: Tue Apr 28 21:26:03 2026 read: IOPS=23, BW=95.1KiB/s (97.4kB/s)(6028KiB/63395msec) clat (msec): min=2, max=123, avg=18.23, stdev=14.47 lat (msec): min=2, max=123, avg=18.23, stdev=14.47 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 38], 95.00th=[ 47], | 99.00th=[ 67], 99.50th=[ 79], 99.90th=[ 113], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 15, max= 400, per=25.45%, avg=95.43, stdev=68.50, samples=125 iops : min= 3, max= 100, avg=23.46, stdev=17.23, samples=125 write: IOPS=24, BW=98.7KiB/s (101kB/s)(6260KiB/63395msec); 0 zone resets clat (msec): min=4, max=682, avg=22.92, stdev=22.77 lat (msec): min=4, max=682, avg=22.92, stdev=22.77 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 45], 95.00th=[ 54], | 99.00th=[ 74], 99.50th=[ 81], 99.90th=[ 115], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 23, max= 360, per=25.18%, avg=98.96, stdev=62.86, samples=125 iops : min= 5, max= 90, avg=24.34, stdev=15.85, samples=125 lat (msec) : 4=0.78%, 10=28.68%, 20=31.12%, 50=34.15%, 100=5.11% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.08%, sys=14.85%, ctx=6786, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189764: Tue Apr 28 21:26:03 2026 read: IOPS=23, BW=94.7KiB/s (97.0kB/s)(6052KiB/63887msec) clat (msec): min=2, max=107, avg=18.62, stdev=15.13 lat (msec): min=2, max=107, avg=18.62, stdev=15.13 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 51], | 99.00th=[ 71], 99.50th=[ 78], 99.90th=[ 100], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 24, max= 352, per=25.06%, avg=93.99, stdev=64.16, samples=126 iops : min= 6, max= 88, avg=23.10, stdev=16.17, samples=126 write: IOPS=24, BW=97.6KiB/s (99.0kB/s)(6236KiB/63887msec); 0 zone resets clat (msec): min=4, max=680, avg=22.88, stdev=22.68 lat (msec): min=4, max=680, avg=22.88, stdev=22.68 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 71], 99.50th=[ 78], 99.90th=[ 125], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 31, max= 376, per=24.72%, avg=97.15, stdev=65.91, samples=126 iops : min= 7, max= 94, avg=23.89, stdev=16.61, samples=126 lat (msec) : 4=1.76%, 10=29.43%, 20=27.99%, 50=35.38%, 100=5.34% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.09%, sys=14.45%, ctx=6695, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=376KiB/s (385kB/s), 93.3KiB/s-95.1KiB/s (95.5kB/s-97.4kB/s), io=23.4MiB (24.6MB), run=63395-63887msec WRITE: bw=394KiB/s (403kB/s), 97.6KiB/s-99.7KiB/s (99.0kB/s-102kB/s), io=24.6MiB (25.7MB), run=63395-63887msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189790: Tue Apr 28 21:26:24 2026 read: IOPS=23, BW=383KiB/s (392kB/s)(5920KiB/15456msec) clat (usec): min=79, max=59582, avg=20241.55, stdev=11308.06 lat (usec): min=80, max=59583, avg=20243.79, stdev=11310.04 clat percentiles (usec): | 1.00th=[ 106], 5.00th=[ 192], 10.00th=[ 8455], 20.00th=[11207], | 30.00th=[13435], 40.00th=[16450], 50.00th=[18744], 60.00th=[21627], | 70.00th=[24773], 80.00th=[28443], 90.00th=[35390], 95.00th=[40633], | 99.00th=[55313], 99.50th=[58459], 99.90th=[59507], 99.95th=[59507], | 99.99th=[59507] bw ( KiB/s): min= 160, max= 704, per=25.21%, avg=377.43, stdev=123.66, samples=30 iops : min= 10, max= 44, avg=23.27, stdev= 7.74, samples=30 write: IOPS=25, BW=412KiB/s (422kB/s)(6368KiB/15456msec); 0 zone resets clat (usec): min=1402, max=67334, avg=19909.02, stdev=12302.53 lat (usec): min=1403, max=67337, avg=19910.41, stdev=12302.78 clat percentiles (usec): | 1.00th=[ 3589], 5.00th=[ 4555], 10.00th=[ 6194], 20.00th=[ 8455], | 30.00th=[11338], 40.00th=[14615], 50.00th=[17957], 60.00th=[20055], | 70.00th=[24773], 80.00th=[29754], 90.00th=[36963], 95.00th=[43779], | 99.00th=[53216], 99.50th=[65274], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 284, max= 638, per=25.99%, avg=409.40, stdev=100.77, samples=30 iops : min= 17, max= 39, avg=25.27, stdev= 6.26, samples=30 lat (usec) : 100=0.39%, 250=2.60%, 500=0.26%, 750=0.13% lat (msec) : 2=0.13%, 4=1.04%, 10=14.84%, 20=37.63%, 50=40.89% lat (msec) : 100=2.08% cpu : usr=0.06%, sys=28.47%, ctx=3198, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189791: Tue Apr 28 21:26:24 2026 read: IOPS=22, BW=359KiB/s (368kB/s)(5744KiB/15996msec) clat (usec): min=81, max=68955, avg=22128.72, stdev=12087.14 lat (usec): min=81, max=68956, avg=22130.30, stdev=12087.77 clat percentiles (usec): | 1.00th=[ 113], 5.00th=[ 6915], 10.00th=[10290], 20.00th=[12911], | 30.00th=[14877], 40.00th=[16712], 50.00th=[19792], 60.00th=[22938], | 70.00th=[26346], 80.00th=[30540], 90.00th=[38011], 95.00th=[44827], | 99.00th=[60556], 99.50th=[68682], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 192, max= 541, per=23.56%, avg=352.65, stdev=92.86, samples=31 iops : min= 12, max= 33, avg=21.71, stdev= 5.80, samples=31 write: IOPS=25, BW=409KiB/s (419kB/s)(6544KiB/15996msec); 0 zone resets clat (usec): min=1585, max=71845, avg=19526.57, stdev=12981.19 lat (usec): min=1586, max=71846, avg=19528.43, stdev=12981.14 clat percentiles (usec): | 1.00th=[ 3392], 5.00th=[ 4359], 10.00th=[ 5932], 20.00th=[ 8455], | 30.00th=[11076], 40.00th=[13435], 50.00th=[16188], 60.00th=[19792], | 70.00th=[24249], 80.00th=[29492], 90.00th=[38011], 95.00th=[44827], | 99.00th=[60556], 99.50th=[66323], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 159, max= 702, per=25.02%, avg=394.06, stdev=130.71, samples=31 iops : min= 9, max= 43, avg=24.29, stdev= 8.21, samples=31 lat (usec) : 100=0.39%, 250=1.04%, 500=0.26% lat (msec) : 2=0.26%, 4=1.43%, 10=14.97%, 20=37.63%, 50=41.15% lat (msec) : 100=2.86% cpu : usr=0.08%, sys=28.00%, ctx=3318, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189792: Tue Apr 28 21:26:24 2026 read: IOPS=24, BW=397KiB/s (407kB/s)(6256KiB/15745msec) clat (usec): min=80, max=66697, avg=21312.21, stdev=11621.10 lat (usec): min=81, max=66698, avg=21313.11, stdev=11621.12 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 6390], 10.00th=[ 9372], 20.00th=[12518], | 30.00th=[15008], 40.00th=[16909], 50.00th=[18744], 60.00th=[22152], | 70.00th=[25560], 80.00th=[29230], 90.00th=[35914], 95.00th=[42206], | 99.00th=[58983], 99.50th=[60031], 99.90th=[66847], 99.95th=[66847], | 99.99th=[66847] bw ( KiB/s): min= 160, max= 636, per=26.57%, avg=397.71, stdev=119.53, samples=31 iops : min= 10, max= 39, avg=24.52, stdev= 7.53, samples=31 write: IOPS=23, BW=383KiB/s (392kB/s)(6032KiB/15745msec); 0 zone resets clat (usec): min=1483, max=85001, avg=19462.11, stdev=13140.80 lat (usec): min=1484, max=85003, avg=19463.49, stdev=13140.88 clat percentiles (usec): | 1.00th=[ 2704], 5.00th=[ 4228], 10.00th=[ 5342], 20.00th=[ 8160], | 30.00th=[11469], 40.00th=[13435], 50.00th=[16319], 60.00th=[20055], | 70.00th=[23462], 80.00th=[28705], 90.00th=[36439], 95.00th=[45351], | 99.00th=[65799], 99.50th=[78119], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 160, max= 576, per=23.87%, avg=376.00, stdev=128.76, samples=31 iops : min= 10, max= 36, avg=23.16, stdev= 8.00, samples=31 lat (usec) : 100=0.78%, 250=1.04%, 500=0.13% lat (msec) : 2=0.26%, 4=1.82%, 10=13.54%, 20=38.93%, 50=40.62% lat (msec) : 100=2.86% cpu : usr=0.11%, sys=27.35%, ctx=3211, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189793: Tue Apr 28 21:26:24 2026 read: IOPS=24, BW=387KiB/s (397kB/s)(6032KiB/15574msec) clat (usec): min=38, max=72415, avg=21176.75, stdev=11626.69 lat (usec): min=38, max=72417, avg=21177.66, stdev=11626.96 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 219], 10.00th=[ 9372], 20.00th=[12387], | 30.00th=[15139], 40.00th=[17433], 50.00th=[19792], 60.00th=[21890], | 70.00th=[25560], 80.00th=[29230], 90.00th=[35390], 95.00th=[43254], | 99.00th=[57410], 99.50th=[64226], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 128, max= 670, per=25.47%, avg=381.30, stdev=122.59, samples=30 iops : min= 8, max= 41, avg=23.50, stdev= 7.56, samples=30 write: IOPS=25, BW=402KiB/s (411kB/s)(6256KiB/15574msec); 0 zone resets clat (usec): min=2057, max=63904, avg=19210.56, stdev=13018.63 lat (usec): min=2057, max=63905, avg=19212.97, stdev=13017.47 clat percentiles (usec): | 1.00th=[ 3425], 5.00th=[ 4490], 10.00th=[ 6194], 20.00th=[ 7898], | 30.00th=[ 9896], 40.00th=[13042], 50.00th=[15664], 60.00th=[19268], | 70.00th=[23200], 80.00th=[28967], 90.00th=[38536], 95.00th=[46400], | 99.00th=[59507], 99.50th=[63701], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 256, max= 604, per=25.27%, avg=397.97, stdev=88.83, samples=30 iops : min= 16, max= 37, avg=24.53, stdev= 5.57, samples=30 lat (usec) : 50=0.13%, 100=0.65%, 250=2.08% lat (msec) : 4=1.43%, 10=16.93%, 20=35.16%, 50=40.89%, 100=2.73% cpu : usr=0.12%, sys=27.85%, ctx=3190, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1497KiB/s (1533kB/s), 359KiB/s-397KiB/s (368kB/s-407kB/s), io=23.4MiB (24.5MB), run=15456-15996msec WRITE: bw=1575KiB/s (1613kB/s), 383KiB/s-412KiB/s (392kB/s-422kB/s), io=24.6MiB (25.8MB), run=15456-15996msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189785: Tue Apr 28 21:26:25 2026 read: IOPS=21, BW=350KiB/s (359kB/s)(5920KiB/16906msec) clat (usec): min=4021, max=73377, avg=18991.89, stdev=13013.21 lat (usec): min=4024, max=73377, avg=18992.64, stdev=13013.29 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 5669], 10.00th=[ 6456], 20.00th=[ 7898], | 30.00th=[10552], 40.00th=[12911], 50.00th=[15008], 60.00th=[17171], | 70.00th=[21890], 80.00th=[28967], 90.00th=[38011], 95.00th=[44827], | 99.00th=[62653], 99.50th=[72877], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 159, max= 992, per=24.04%, avg=338.03, stdev=158.93, samples=33 iops : min= 9, max= 62, avg=20.64, stdev=10.02, samples=33 write: IOPS=23, BW=377KiB/s (386kB/s)(6368KiB/16906msec); 0 zone resets clat (usec): min=6042, max=84503, avg=24773.45, stdev=14586.01 lat (usec): min=6044, max=84505, avg=24775.04, stdev=14586.05 clat percentiles (usec): | 1.00th=[ 6652], 5.00th=[ 7767], 10.00th=[ 8979], 20.00th=[11338], | 30.00th=[14091], 40.00th=[17957], 50.00th=[21890], 60.00th=[26346], | 70.00th=[31065], 80.00th=[35390], 90.00th=[46400], 95.00th=[53740], | 99.00th=[66323], 99.50th=[84411], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 64, max= 1088, per=24.95%, avg=369.03, stdev=178.47, samples=33 iops : min= 4, max= 68, avg=22.58, stdev=11.15, samples=33 lat (msec) : 10=21.74%, 20=33.20%, 50=39.58%, 100=5.47% cpu : usr=0.09%, sys=15.12%, ctx=1805, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189786: Tue Apr 28 21:26:25 2026 read: IOPS=21, BW=337KiB/s (346kB/s)(5744KiB/17023msec) clat (usec): min=3444, max=75302, avg=19853.78, stdev=13235.68 lat (usec): min=3444, max=75303, avg=19854.44, stdev=13235.74 clat percentiles (usec): | 1.00th=[ 4015], 5.00th=[ 5735], 10.00th=[ 6128], 20.00th=[ 8455], | 30.00th=[11731], 40.00th=[13960], 50.00th=[16188], 60.00th=[18744], | 70.00th=[23200], 80.00th=[29230], 90.00th=[40633], 95.00th=[47449], | 99.00th=[61604], 99.50th=[71828], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 95, max= 928, per=22.91%, avg=322.15, stdev=153.73, samples=33 iops : min= 5, max= 58, avg=19.64, stdev= 9.68, samples=33 write: IOPS=24, BW=384KiB/s (394kB/s)(6544KiB/17023msec); 0 zone resets clat (usec): min=4909, max=89150, avg=24109.07, stdev=15214.45 lat (usec): min=4910, max=89151, avg=24110.63, stdev=15214.56 clat percentiles (usec): | 1.00th=[ 5473], 5.00th=[ 7308], 10.00th=[ 7832], 20.00th=[10290], | 30.00th=[13304], 40.00th=[17171], 50.00th=[20579], 60.00th=[24511], | 70.00th=[29754], 80.00th=[35390], 90.00th=[45876], 95.00th=[52691], | 99.00th=[71828], 99.50th=[79168], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 159, max= 1184, per=24.73%, avg=365.73, stdev=194.85, samples=33 iops : min= 9, max= 74, avg=22.36, stdev=12.24, samples=33 lat (msec) : 4=0.39%, 10=21.48%, 20=32.55%, 50=39.97%, 100=5.60% cpu : usr=0.11%, sys=14.88%, ctx=1911, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189787: Tue Apr 28 21:26:25 2026 read: IOPS=22, BW=367KiB/s (376kB/s)(6256KiB/17030msec) clat (usec): min=3868, max=68773, avg=20020.58, stdev=14332.67 lat (usec): min=3869, max=68774, avg=20021.47, stdev=14332.83 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 5669], 10.00th=[ 6259], 20.00th=[ 7504], | 30.00th=[10028], 40.00th=[13435], 50.00th=[15664], 60.00th=[18220], | 70.00th=[22938], 80.00th=[31065], 90.00th=[42730], 95.00th=[50070], | 99.00th=[63177], 99.50th=[66323], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 160, max= 1504, per=25.29%, avg=355.61, stdev=242.85, samples=33 iops : min= 10, max= 94, avg=21.73, stdev=15.23, samples=33 write: IOPS=22, BW=354KiB/s (363kB/s)(6032KiB/17030msec); 0 zone resets clat (usec): min=4684, max=86843, avg=24287.02, stdev=15253.49 lat (usec): min=4686, max=86845, avg=24288.66, stdev=15253.84 clat percentiles (usec): | 1.00th=[ 5342], 5.00th=[ 7046], 10.00th=[ 8160], 20.00th=[10421], | 30.00th=[14484], 40.00th=[17957], 50.00th=[21365], 60.00th=[24511], | 70.00th=[28705], 80.00th=[35914], 90.00th=[46400], 95.00th=[53740], | 99.00th=[72877], 99.50th=[78119], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 127, max= 768, per=22.48%, avg=332.52, stdev=132.53, samples=33 iops : min= 7, max= 48, avg=20.27, stdev= 8.32, samples=33 lat (msec) : 4=0.26%, 10=24.22%, 20=31.77%, 50=36.98%, 100=6.77% cpu : usr=0.08%, sys=14.63%, ctx=1824, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189788: Tue Apr 28 21:26:25 2026 read: IOPS=22, BW=356KiB/s (364kB/s)(6032KiB/16946msec) clat (usec): min=3743, max=76413, avg=19610.39, stdev=14064.11 lat (usec): min=3744, max=76414, avg=19611.41, stdev=14063.85 clat percentiles (usec): | 1.00th=[ 4490], 5.00th=[ 5407], 10.00th=[ 6194], 20.00th=[ 8455], | 30.00th=[10683], 40.00th=[12518], 50.00th=[14746], 60.00th=[17957], | 70.00th=[22938], 80.00th=[28705], 90.00th=[41157], 95.00th=[50594], | 99.00th=[65274], 99.50th=[72877], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 127, max= 1024, per=24.34%, avg=342.21, stdev=189.94, samples=33 iops : min= 7, max= 64, avg=20.88, stdev=11.96, samples=33 write: IOPS=23, BW=369KiB/s (378kB/s)(6256KiB/16946msec); 0 zone resets clat (usec): min=5328, max=91218, avg=24328.95, stdev=14759.74 lat (usec): min=5328, max=91220, avg=24330.54, stdev=14759.86 clat percentiles (usec): | 1.00th=[ 6194], 5.00th=[ 7242], 10.00th=[ 8160], 20.00th=[10421], | 30.00th=[13566], 40.00th=[18220], 50.00th=[21365], 60.00th=[25297], | 70.00th=[30540], 80.00th=[35914], 90.00th=[44303], 95.00th=[53740], | 99.00th=[66323], 99.50th=[79168], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 159, max= 1152, per=24.17%, avg=357.48, stdev=176.10, samples=33 iops : min= 9, max= 72, avg=21.85, stdev=11.08, samples=33 lat (msec) : 4=0.26%, 10=23.05%, 20=32.16%, 50=38.28%, 100=6.25% cpu : usr=0.04%, sys=15.15%, ctx=1902, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1406KiB/s (1440kB/s), 337KiB/s-367KiB/s (346kB/s-376kB/s), io=23.4MiB (24.5MB), run=16906-17030msec WRITE: bw=1480KiB/s (1515kB/s), 354KiB/s-384KiB/s (363kB/s-394kB/s), io=24.6MiB (25.8MB), run=16906-17030msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189805: Tue Apr 28 21:26:33 2026 read: IOPS=3, BW=4034KiB/s (4131kB/s)(7168KiB/1777msec) clat (usec): min=572, max=189200, avg=91104.44, stdev=69281.27 lat (usec): min=572, max=189202, avg=91105.93, stdev=69281.48 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 766], | 30.00th=[ 91751], 40.00th=[ 91751], 50.00th=[106431], 60.00th=[111674], | 70.00th=[111674], 80.00th=[137364], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 2048, max= 5417, per=50.32%, avg=3853.67, stdev=1697.52, samples=3 iops : min= 2, max= 5, avg= 3.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2881KiB/s (2950kB/s)(5120KiB/1777msec); 0 zone resets clat (msec): min=146, max=263, avg=216.12, stdev=47.32 lat (msec): min=147, max=263, avg=216.16, stdev=47.34 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 4096, max= 4096, per=38.20%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33% cpu : usr=0.00%, sys=57.77%, ctx=1056, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189806: Tue Apr 28 21:26:33 2026 read: IOPS=0, BW=766KiB/s (784kB/s)(2048KiB/2674msec) clat (msec): min=100, max=141, avg=120.99, stdev=29.59 lat (msec): min=100, max=141, avg=120.99, stdev=29.59 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 142], 95.00th=[ 142], | 99.00th=[ 142], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 1762, max= 1961, per=24.31%, avg=1861.50, stdev=140.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3829KiB/s (3921kB/s)(10.0MiB/2674msec); 0 zone resets clat (msec): min=91, max=357, avg=237.11, stdev=93.02 lat (msec): min=91, max=357, avg=237.19, stdev=93.03 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 124], | 30.00th=[ 155], 40.00th=[ 209], 50.00th=[ 234], 60.00th=[ 249], | 70.00th=[ 288], 80.00th=[ 321], 90.00th=[ 347], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1762, max= 6144, per=33.69%, avg=3611.80, stdev=2313.90, samples=5 iops : min= 1, max= 6, avg= 3.20, stdev= 2.59, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=47.40%, ctx=533, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189807: Tue Apr 28 21:26:33 2026 read: IOPS=2, BW=2917KiB/s (2987kB/s)(6144KiB/2106msec) clat (msec): min=13, max=237, avg=131.13, stdev=72.54 lat (msec): min=13, max=237, avg=131.13, stdev=72.54 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 14], 10.00th=[ 14], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 133], 50.00th=[ 133], 60.00th=[ 140], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 4096, max= 6144, per=66.86%, avg=5120.00, stdev=1448.15, samples=2 iops : min= 4, max= 6, avg= 5.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2917KiB/s (2987kB/s)(6144KiB/2106msec); 0 zone resets clat (msec): min=101, max=344, avg=216.77, stdev=102.03 lat (msec): min=102, max=344, avg=216.85, stdev=102.03 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 249], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 1961, max= 4096, per=27.15%, avg=2910.50, stdev=1071.35, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (msec) : 20=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.05%, sys=50.83%, ctx=632, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189808: Tue Apr 28 21:26:33 2026 read: IOPS=2, BW=2115KiB/s (2166kB/s)(5120KiB/2421msec) clat (usec): min=540, max=183386, avg=97417.84, stdev=89777.28 lat (usec): min=541, max=183387, avg=97419.03, stdev=89777.26 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[139461], 60.00th=[139461], | 70.00th=[162530], 80.00th=[162530], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2961KiB/s (3032kB/s)(7168KiB/2421msec); 0 zone resets clat (msec): min=116, max=559, avg=266.43, stdev=163.57 lat (msec): min=116, max=559, avg=266.50, stdev=163.59 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 120], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 253], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 376], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 4096, max= 4096, per=38.20%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 lat (usec) : 750=16.67% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=31.20%, ctx=270, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7659KiB/s (7843kB/s), 766KiB/s-4034KiB/s (784kB/s-4131kB/s), io=20.0MiB (20.0MB), run=1777-2674msec WRITE: bw=10.5MiB/s (10.0MB/s), 2881KiB/s-3829KiB/s (2950kB/s-3921kB/s), io=28.0MiB (29.4MB), run=1777-2674msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189800: Tue Apr 28 21:26:34 2026 read: IOPS=3, BW=3785KiB/s (3875kB/s)(7168KiB/1894msec) clat (msec): min=35, max=195, avg=96.42, stdev=68.06 lat (msec): min=35, max=195, avg=96.42, stdev=68.06 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 42], | 30.00th=[ 46], 40.00th=[ 46], 50.00th=[ 77], 60.00th=[ 95], | 70.00th=[ 95], 80.00th=[ 186], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 2043, max= 5120, per=52.54%, avg=3750.00, stdev=1565.94, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2703KiB/s (2768kB/s)(5120KiB/1894msec); 0 zone resets clat (msec): min=129, max=381, avg=237.76, stdev=94.07 lat (msec): min=130, max=381, avg=237.85, stdev=94.09 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1706, max= 4087, per=26.14%, avg=2612.00, stdev=1288.45, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=25.00%, 100=16.67%, 250=41.67%, 500=16.67% cpu : usr=0.05%, sys=18.38%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189801: Tue Apr 28 21:26:34 2026 read: IOPS=0, BW=781KiB/s (800kB/s)(2048KiB/2623msec) clat (msec): min=47, max=260, avg=154.02, stdev=150.32 lat (msec): min=47, max=260, avg=154.03, stdev=150.32 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 48], 40.00th=[ 48], 50.00th=[ 48], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1712, max= 2011, per=26.08%, avg=1861.50, stdev=211.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3904KiB/s (3998kB/s)(10.0MiB/2623msec); 0 zone resets clat (msec): min=55, max=469, avg=229.26, stdev=162.84 lat (msec): min=55, max=469, avg=229.32, stdev=162.85 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 73], | 30.00th=[ 79], 40.00th=[ 109], 50.00th=[ 165], 60.00th=[ 190], | 70.00th=[ 300], 80.00th=[ 409], 90.00th=[ 443], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2011, max= 6144, per=35.44%, avg=3541.80, stdev=1708.24, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=41.67% cpu : usr=0.00%, sys=21.47%, ctx=105, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189802: Tue Apr 28 21:26:34 2026 read: IOPS=2, BW=2897KiB/s (2966kB/s)(6144KiB/2121msec) clat (msec): min=48, max=420, avg=211.44, stdev=166.21 lat (msec): min=48, max=420, avg=211.44, stdev=166.21 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 51], | 30.00th=[ 51], 40.00th=[ 107], 50.00th=[ 107], 60.00th=[ 264], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2043, max= 4087, per=44.54%, avg=3179.00, stdev=1040.90, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2897KiB/s (2966kB/s)(6144KiB/2121msec); 0 zone resets clat (msec): min=39, max=379, avg=140.04, stdev=129.33 lat (msec): min=39, max=379, avg=140.12, stdev=129.33 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 47], | 30.00th=[ 47], 40.00th=[ 77], 50.00th=[ 77], 60.00th=[ 109], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2011, max= 6815, per=36.26%, avg=3623.00, stdev=2764.40, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 lat (msec) : 50=25.00%, 100=16.67%, 250=25.00%, 500=33.33% cpu : usr=0.00%, sys=15.75%, ctx=90, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189803: Tue Apr 28 21:26:34 2026 read: IOPS=1, BW=1785KiB/s (1827kB/s)(5120KiB/2869msec) clat (msec): min=18, max=420, avg=194.95, stdev=174.12 lat (msec): min=18, max=420, avg=194.95, stdev=174.12 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 20], 10.00th=[ 20], 20.00th=[ 20], | 30.00th=[ 44], 40.00th=[ 44], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2011, max= 6144, per=57.12%, avg=4077.50, stdev=2922.47, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2498KiB/s (2558kB/s)(7168KiB/2869msec); 0 zone resets clat (msec): min=60, max=497, avg=265.41, stdev=161.44 lat (msec): min=60, max=497, avg=265.50, stdev=161.43 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 150], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 201], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 414], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2043, max= 3424, per=23.91%, avg=2389.50, stdev=689.67, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 20=8.33%, 50=8.33%, 100=8.33%, 250=33.33%, 500=41.67% cpu : usr=0.00%, sys=23.71%, ctx=111, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7138KiB/s (7310kB/s), 781KiB/s-3785KiB/s (800kB/s-3875kB/s), io=20.0MiB (20.0MB), run=1894-2869msec WRITE: bw=9994KiB/s (10.2MB/s), 2498KiB/s-3904KiB/s (2558kB/s-3998kB/s), io=28.0MiB (29.4MB), run=1894-2869msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189819: Tue Apr 28 21:26:43 2026 read: IOPS=1, BW=5681KiB/s (5817kB/s)(12.0MiB/2163msec) clat (msec): min=388, max=998, avg=711.07, stdev=306.58 lat (msec): min=388, max=998, avg=711.07, stdev=306.58 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7953, max= 8192, per=100.00%, avg=8072.50, stdev=169.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.28%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189820: Tue Apr 28 21:26:43 2026 read: IOPS=0, BW=1738KiB/s (1780kB/s)(4096KiB/2357msec) clat (nsec): min=1181.5M, max=1181.5M, avg=1181483104.00, stdev= 0.00 lat (nsec): min=1181.5M, max=1181.5M, avg=1181486760.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3476KiB/s (3559kB/s)(8192KiB/2357msec); 0 zone resets clat (msec): min=404, max=708, avg=556.50, stdev=215.41 lat (msec): min=404, max=709, avg=556.97, stdev=215.24 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7787, max= 7787, per=56.20%, avg=7787.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.83%, ctx=94, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189821: Tue Apr 28 21:26:43 2026 write: IOPS=1, BW=5196KiB/s (5320kB/s)(12.0MiB/2365msec); 0 zone resets clat (msec): min=190, max=1602, avg=778.94, stdev=735.01 lat (msec): min=190, max=1603, avg=779.29, stdev=735.06 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7787, max= 7953, per=56.80%, avg=7870.00, stdev=117.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=15.23%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189822: Tue Apr 28 21:26:43 2026 write: IOPS=1, BW=5665KiB/s (5801kB/s)(12.0MiB/2169msec); 0 zone resets clat (msec): min=444, max=1085, avg=699.10, stdev=340.55 lat (msec): min=444, max=1086, avg=699.42, stdev=340.55 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 5760, max= 8192, per=50.35%, avg=6976.00, stdev=1719.68, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=24.86%, ctx=256, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6951KiB/s (7118kB/s), 1738KiB/s-5681KiB/s (1780kB/s-5817kB/s), io=16.0MiB (16.8MB), run=2163-2357msec WRITE: bw=13.5MiB/s (14.2MB/s), 3476KiB/s-5665KiB/s (3559kB/s-5801kB/s), io=32.0MiB (33.6MB), run=2169-2365msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189815: Tue Apr 28 21:26:43 2026 read: IOPS=1, BW=7832KiB/s (8020kB/s)(12.0MiB/1569msec) clat (msec): min=466, max=496, avg=482.34, stdev=15.13 lat (msec): min=466, max=496, avg=482.34, stdev=15.13 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 8192, max= 8192, per=88.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=57.59%, ctx=2888, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189816: Tue Apr 28 21:26:43 2026 read: IOPS=0, BW=2327KiB/s (2383kB/s)(4096KiB/1760msec) clat (nsec): min=484928k, max=484928k, avg=484928401.00, stdev= 0.00 lat (nsec): min=484930k, max=484930k, avg=484929586.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 8192, max= 8192, per=88.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4655KiB/s (4766kB/s)(8192KiB/1760msec); 0 zone resets clat (msec): min=555, max=599, avg=577.66, stdev=30.75 lat (msec): min=556, max=599, avg=577.93, stdev=30.59 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 8192, max= 8192, per=63.23%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=26.49%, ctx=987, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189817: Tue Apr 28 21:26:43 2026 write: IOPS=1, BW=4859KiB/s (4975kB/s)(12.0MiB/2529msec); 0 zone resets clat (msec): min=251, max=1684, avg=805.45, stdev=769.65 lat (msec): min=251, max=1684, avg=805.78, stdev=769.73 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 7984, max= 7984, per=61.62%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=15.62%, ctx=100, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189818: Tue Apr 28 21:26:43 2026 write: IOPS=1, BW=6295KiB/s (6446kB/s)(12.0MiB/1952msec); 0 zone resets clat (msec): min=271, max=1272, avg=622.75, stdev=563.27 lat (msec): min=272, max=1272, avg=623.09, stdev=563.13 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min=11070, max=11070, per=85.44%, avg=11070.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=17.43%, ctx=326, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9309KiB/s (9533kB/s), 2327KiB/s-7832KiB/s (2383kB/s-8020kB/s), io=16.0MiB (16.8MB), run=1569-1760msec WRITE: bw=12.7MiB/s (13.3MB/s), 4655KiB/s-6295KiB/s (4766kB/s-6446kB/s), io=32.0MiB (33.6MB), run=1760-2529msec