== sanity test 398b: DIO and buffer IO race ============== 11:18:14 (1775834294) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.54215 s, 19.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149717: Fri Apr 10 11:19:05 2026 read: IOPS=35, BW=141KiB/s (144kB/s)(5992KiB/42466msec) clat (usec): min=38, max=585569, avg=14599.64, stdev=16912.74 lat (usec): min=39, max=585569, avg=14600.29, stdev=16912.78 clat percentiles (usec): | 1.00th=[ 79], 5.00th=[ 3687], 10.00th=[ 6587], 20.00th=[ 8225], | 30.00th=[ 9503], 40.00th=[ 10945], 50.00th=[ 12518], 60.00th=[ 14615], | 70.00th=[ 16909], 80.00th=[ 19792], 90.00th=[ 23987], 95.00th=[ 29230], | 99.00th=[ 43254], 99.50th=[ 52167], 99.90th=[ 74974], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 14, max= 232, per=25.29%, avg=140.61, stdev=36.03, samples=84 iops : min= 3, max= 58, avg=34.80, stdev= 9.05, samples=84 write: IOPS=37, BW=148KiB/s (152kB/s)(6296KiB/42466msec); 0 zone resets clat (usec): min=788, max=86122, avg=12974.66, stdev=11606.72 lat (usec): min=789, max=86123, avg=12975.82, stdev=11606.58 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1991], 10.00th=[ 2442], 20.00th=[ 3097], | 30.00th=[ 4490], 40.00th=[ 7898], 50.00th=[10159], 60.00th=[12649], | 70.00th=[16057], 80.00th=[20317], 90.00th=[27395], 95.00th=[35390], | 99.00th=[57934], 99.50th=[68682], 99.90th=[84411], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 55, max= 247, per=25.64%, avg=149.25, stdev=40.26, samples=83 iops : min= 13, max= 61, avg=36.96, stdev=10.06, samples=83 lat (usec) : 50=0.10%, 100=1.04%, 250=1.04%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=2.21%, 4=11.26%, 10=25.16%, 20=38.44%, 50=19.37% lat (msec) : 100=0.88%, 750=0.03% cpu : usr=0.13%, sys=24.37%, ctx=8123, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149720: Fri Apr 10 11:19:05 2026 read: IOPS=34, BW=138KiB/s (142kB/s)(5940KiB/42913msec) clat (usec): min=33, max=146833, avg=14451.25, stdev=9347.50 lat (usec): min=33, max=146834, avg=14452.49, stdev=9347.14 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 4883], 10.00th=[ 6849], 20.00th=[ 8225], | 30.00th=[ 9634], 40.00th=[ 11076], 50.00th=[ 12780], 60.00th=[ 14746], | 70.00th=[ 16909], 80.00th=[ 19530], 90.00th=[ 23725], 95.00th=[ 28443], | 99.00th=[ 46400], 99.50th=[ 60031], 99.90th=[ 83362], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 7, max= 224, per=24.79%, avg=137.82, stdev=36.20, samples=85 iops : min= 1, max= 56, avg=34.09, stdev= 9.09, samples=85 write: IOPS=36, BW=148KiB/s (151kB/s)(6348KiB/42913msec); 0 zone resets clat (usec): min=722, max=539194, avg=13403.08, stdev=17045.71 lat (usec): min=723, max=539195, avg=13403.84, stdev=17045.72 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1926], 10.00th=[ 2442], 20.00th=[ 3359], | 30.00th=[ 5342], 40.00th=[ 8455], 50.00th=[ 10945], 60.00th=[ 13304], | 70.00th=[ 16450], 80.00th=[ 21103], 90.00th=[ 27132], 95.00th=[ 32900], | 99.00th=[ 49546], 99.50th=[ 55837], 99.90th=[124257], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 247, per=25.20%, avg=146.66, stdev=40.56, samples=85 iops : min= 1, max= 61, avg=36.31, stdev=10.15, samples=85 lat (usec) : 50=0.23%, 100=0.91%, 250=0.81%, 750=0.07%, 1000=0.36% lat (msec) : 2=2.60%, 4=9.70%, 10=25.62%, 20=39.88%, 50=19.04% lat (msec) : 100=0.68%, 250=0.07%, 750=0.03% cpu : usr=0.13%, sys=24.55%, ctx=8211, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149722: Fri Apr 10 11:19:05 2026 read: IOPS=34, BW=140KiB/s (143kB/s)(6028KiB/43152msec) clat (usec): min=26, max=104073, avg=14333.67, stdev=8664.15 lat (usec): min=26, max=104073, avg=14334.47, stdev=8664.22 clat percentiles (usec): | 1.00th=[ 83], 5.00th=[ 4490], 10.00th=[ 6652], 20.00th=[ 8094], | 30.00th=[ 9503], 40.00th=[ 10814], 50.00th=[ 12518], 60.00th=[ 14484], | 70.00th=[ 17171], 80.00th=[ 19792], 90.00th=[ 24773], 95.00th=[ 29230], | 99.00th=[ 44303], 99.50th=[ 49546], 99.90th=[ 74974], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 48, max= 229, per=25.05%, avg=139.27, stdev=37.25, samples=84 iops : min= 12, max= 57, avg=34.46, stdev= 9.31, samples=84 write: IOPS=36, BW=145KiB/s (149kB/s)(6260KiB/43152msec); 0 zone resets clat (usec): min=670, max=572522, avg=13658.42, stdev=18186.50 lat (usec): min=671, max=572524, avg=13659.36, stdev=18186.54 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1942], 10.00th=[ 2507], 20.00th=[ 3195], | 30.00th=[ 4752], 40.00th=[ 8455], 50.00th=[ 10945], 60.00th=[ 13435], | 70.00th=[ 16909], 80.00th=[ 20841], 90.00th=[ 27657], 95.00th=[ 34341], | 99.00th=[ 55313], 99.50th=[ 65274], 99.90th=[ 84411], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 56, max= 223, per=24.78%, avg=144.24, stdev=37.13, samples=84 iops : min= 14, max= 55, avg=35.70, stdev= 9.25, samples=84 lat (usec) : 50=0.13%, 100=1.04%, 250=0.91%, 750=0.13%, 1000=0.29% lat (msec) : 2=2.28%, 4=11.36%, 10=23.99%, 20=39.16%, 50=19.86% lat (msec) : 100=0.78%, 250=0.03%, 750=0.03% cpu : usr=0.10%, sys=24.40%, ctx=8204, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149724: Fri Apr 10 11:19:05 2026 read: IOPS=35, BW=142KiB/s (146kB/s)(6052KiB/42553msec) clat (usec): min=31, max=76707, avg=14296.46, stdev=8527.46 lat (usec): min=31, max=76707, avg=14297.11, stdev=8527.51 clat percentiles (usec): | 1.00th=[ 78], 5.00th=[ 198], 10.00th=[ 6718], 20.00th=[ 8291], | 30.00th=[ 9765], 40.00th=[11207], 50.00th=[12649], 60.00th=[14484], | 70.00th=[16909], 80.00th=[19792], 90.00th=[23462], 95.00th=[28443], | 99.00th=[46924], 99.50th=[53216], 99.90th=[76022], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 71, max= 231, per=25.72%, avg=142.98, stdev=33.74, samples=83 iops : min= 17, max= 57, avg=35.40, stdev= 8.47, samples=83 write: IOPS=36, BW=147KiB/s (150kB/s)(6236KiB/42553msec); 0 zone resets clat (usec): min=768, max=551166, avg=13302.15, stdev=17237.02 lat (usec): min=769, max=551167, avg=13303.18, stdev=17237.11 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1991], 10.00th=[ 2442], 20.00th=[ 3163], | 30.00th=[ 5145], 40.00th=[ 8291], 50.00th=[ 10945], 60.00th=[ 13304], | 70.00th=[ 16712], 80.00th=[ 21103], 90.00th=[ 26608], 95.00th=[ 32900], | 99.00th=[ 43254], 99.50th=[ 53216], 99.90th=[120062], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 22, max= 216, per=25.09%, avg=146.02, stdev=32.22, samples=84 iops : min= 5, max= 54, avg=36.15, stdev= 8.10, samples=84 lat (usec) : 50=0.23%, 100=1.04%, 250=1.20%, 500=0.03%, 1000=0.29% lat (msec) : 2=2.28%, 4=10.68%, 10=23.89%, 20=39.97%, 50=19.56% lat (msec) : 100=0.75%, 250=0.03%, 750=0.03% cpu : usr=0.13%, sys=24.64%, ctx=8202, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=556KiB/s (570kB/s), 138KiB/s-142KiB/s (142kB/s-146kB/s), io=23.4MiB (24.6MB), run=42466-43152msec WRITE: bw=583KiB/s (597kB/s), 145KiB/s-148KiB/s (149kB/s-152kB/s), io=24.6MiB (25.7MB), run=42466-43152msec fio: pid=149723, err=5/file:backend.c:481, func=full resid, error=Input/output error fio: pid=149719, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=149718: Fri Apr 10 11:19:30 2026 read: IOPS=21, BW=87.4KiB/s (89.5kB/s)(5992KiB/68561msec) clat (msec): min=2, max=600, avg=12.72, stdev=18.68 lat (msec): min=2, max=600, avg=12.72, stdev=18.68 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 13], 80.00th=[ 17], 90.00th=[ 26], 95.00th=[ 33], | 99.00th=[ 59], 99.50th=[ 78], 99.90th=[ 108], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 23, max= 232, per=26.32%, avg=87.63, stdev=47.80, samples=135 iops : min= 5, max= 58, avg=21.63, stdev=12.04, samples=135 write: IOPS=22, BW=91.8KiB/s (94.0kB/s)(6296KiB/68561msec); 0 zone resets clat (msec): min=13, max=192, avg=31.34, stdev=15.79 lat (msec): min=13, max=192, avg=31.34, stdev=15.79 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 88], 99.50th=[ 102], 99.90th=[ 157], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 32, max= 176, per=26.46%, avg=92.07, stdev=39.66, samples=135 iops : min= 8, max= 44, avg=22.74, stdev=10.06, samples=135 lat (msec) : 4=3.97%, 10=24.32%, 20=24.67%, 50=41.08%, 100=5.63% lat (msec) : 250=0.29%, 750=0.03% cpu : usr=0.09%, sys=8.38%, ctx=5888, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=149719: Fri Apr 10 11:19:30 2026 read: IOPS=21, BW=85.7KiB/s (87.8kB/s)(5812KiB/67814msec) clat (msec): min=2, max=554, avg=13.08, stdev=18.79 lat (msec): min=2, max=554, avg=13.08, stdev=18.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 11], | 70.00th=[ 13], 80.00th=[ 17], 90.00th=[ 26], 95.00th=[ 36], | 99.00th=[ 69], 99.50th=[ 90], 99.90th=[ 108], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 8, max= 208, per=25.90%, avg=86.25, stdev=47.51, samples=134 iops : min= 2, max= 52, avg=21.28, stdev=11.99, samples=134 write: IOPS=22, BW=90.5KiB/s (92.7kB/s)(6140KiB/67814msec); 0 zone resets clat (msec): min=11, max=144, avg=31.68, stdev=15.39 lat (msec): min=11, max=144, avg=31.68, stdev=15.39 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 51], 95.00th=[ 59], | 99.00th=[ 89], 99.50th=[ 104], 99.90th=[ 136], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 176, per=26.18%, avg=91.09, stdev=38.61, samples=134 iops : min= 7, max= 44, avg=22.49, stdev= 9.80, samples=134 lat (msec) : 4=4.25%, 10=23.35%, 20=24.52%, 50=41.39%, 100=6.02% lat (msec) : 250=0.40%, 750=0.03% cpu : usr=0.08%, sys=8.36%, ctx=5604, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1454,1535,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149721: Fri Apr 10 11:19:30 2026 read: IOPS=21, BW=87.0KiB/s (90.1kB/s)(6028KiB/68516msec) clat (usec): min=2760, max=96103, avg=12649.55, stdev=11262.88 lat (usec): min=2761, max=96104, avg=12650.47, stdev=11262.83 clat percentiles (usec): | 1.00th=[ 3163], 5.00th=[ 3752], 10.00th=[ 4178], 20.00th=[ 5080], | 30.00th=[ 6259], 40.00th=[ 7963], 50.00th=[ 9241], 60.00th=[10814], | 70.00th=[12780], 80.00th=[17171], 90.00th=[25297], 95.00th=[34866], | 99.00th=[56886], 99.50th=[79168], 99.90th=[93848], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 15, max= 216, per=26.56%, avg=88.46, stdev=44.22, samples=135 iops : min= 3, max= 54, avg=21.84, stdev=11.18, samples=135 write: IOPS=22, BW=91.4KiB/s (93.6kB/s)(6260KiB/68516msec); 0 zone resets clat (msec): min=12, max=567, avg=31.49, stdev=20.79 lat (msec): min=12, max=567, avg=31.49, stdev=20.79 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 27], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 41], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 90], 99.50th=[ 103], 99.90th=[ 188], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 24, max= 176, per=26.32%, avg=91.60, stdev=39.85, samples=135 iops : min= 6, max= 44, avg=22.62, stdev=10.09, samples=135 lat (msec) : 4=3.97%, 10=23.37%, 20=24.64%, 50=41.76%, 100=5.96% lat (msec) : 250=0.26%, 750=0.03% cpu : usr=0.09%, sys=8.42%, ctx=5833, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=149723: Fri Apr 10 11:19:30 2026 read: IOPS=20, BW=82.2KiB/s (84.1kB/s)(5032KiB/61240msec) clat (msec): min=2, max=126, avg=13.87, stdev=12.09 lat (msec): min=2, max=126, avg=13.87, stdev=12.09 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 20], 90.00th=[ 31], 95.00th=[ 38], | 99.00th=[ 59], 99.50th=[ 65], 99.90th=[ 97], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 7, max= 232, per=24.84%, avg=82.70, stdev=44.83, samples=121 iops : min= 1, max= 58, avg=20.37, stdev=11.30, samples=121 write: IOPS=21, BW=84.3KiB/s (86.3kB/s)(5164KiB/61240msec); 0 zone resets clat (msec): min=13, max=576, avg=33.78, stdev=22.37 lat (msec): min=13, max=576, avg=33.78, stdev=22.37 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 44], 90.00th=[ 54], 95.00th=[ 65], | 99.00th=[ 92], 99.50th=[ 102], 99.90th=[ 197], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 23, max= 168, per=24.37%, avg=84.82, stdev=36.90, samples=121 iops : min= 5, max= 42, avg=20.90, stdev= 9.36, samples=121 lat (msec) : 4=3.18%, 10=22.12%, 20=22.98%, 50=44.00%, 100=7.37% lat (msec) : 250=0.27%, 750=0.04% cpu : usr=0.08%, sys=8.37%, ctx=4645, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1259,1291,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=333KiB/s (341kB/s), 82.2KiB/s-87.0KiB/s (84.1kB/s-90.1kB/s), io=22.3MiB (23.4MB), run=61240-68561msec WRITE: bw=348KiB/s (356kB/s), 84.3KiB/s-91.8KiB/s (86.3kB/s-94.0kB/s), io=23.3MiB (24.4MB), run=61240-68561msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149754: Fri Apr 10 11:19:48 2026 read: IOPS=29, BW=480KiB/s (491kB/s)(5920KiB/12338msec) clat (usec): min=40, max=104062, avg=17229.62, stdev=12305.73 lat (usec): min=41, max=104063, avg=17230.47, stdev=12305.79 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 102], 10.00th=[ 155], 20.00th=[ 9372], | 30.00th=[ 11863], 40.00th=[ 13304], 50.00th=[ 15664], 60.00th=[ 17433], | 70.00th=[ 20579], 80.00th=[ 23987], 90.00th=[ 31589], 95.00th=[ 41157], | 99.00th=[ 58459], 99.50th=[ 69731], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 191, max= 798, per=25.61%, avg=476.67, stdev=143.84, samples=24 iops : min= 11, max= 49, avg=29.33, stdev= 9.04, samples=24 write: IOPS=32, BW=516KiB/s (529kB/s)(6368KiB/12338msec); 0 zone resets clat (usec): min=990, max=113629, avg=14929.25, stdev=12297.63 lat (usec): min=991, max=113631, avg=14930.94, stdev=12298.03 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2802], 10.00th=[ 3752], 20.00th=[ 4621], | 30.00th=[ 6849], 40.00th=[ 9896], 50.00th=[ 12125], 60.00th=[ 14353], | 70.00th=[ 18482], 80.00th=[ 22414], 90.00th=[ 31065], 95.00th=[ 38011], | 99.00th=[ 54789], 99.50th=[ 69731], 99.90th=[113771], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 223, max= 728, per=26.32%, avg=515.42, stdev=162.32, samples=24 iops : min= 13, max= 45, avg=31.75, stdev=10.27, samples=24 lat (usec) : 50=0.13%, 100=2.08%, 250=3.65%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.30%, 4=5.21%, 10=19.53%, 20=38.28%, 50=27.99% lat (msec) : 100=1.04%, 250=0.26% cpu : usr=0.10%, sys=28.35%, ctx=2367, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149755: Fri Apr 10 11:19:48 2026 read: IOPS=27, BW=446KiB/s (457kB/s)(5744KiB/12869msec) clat (usec): min=40, max=108277, avg=17984.52, stdev=11885.19 lat (usec): min=41, max=108278, avg=17985.41, stdev=11885.30 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 125], 10.00th=[ 7963], 20.00th=[ 10028], | 30.00th=[ 11600], 40.00th=[ 13566], 50.00th=[ 16319], 60.00th=[ 18220], | 70.00th=[ 21103], 80.00th=[ 24511], 90.00th=[ 30540], 95.00th=[ 37487], | 99.00th=[ 64750], 99.50th=[ 76022], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 160, max= 736, per=23.61%, avg=439.44, stdev=143.84, samples=25 iops : min= 10, max= 46, avg=27.00, stdev= 9.06, samples=25 write: IOPS=31, BW=509KiB/s (521kB/s)(6544KiB/12869msec); 0 zone resets clat (usec): min=1227, max=79365, avg=15549.06, stdev=12298.56 lat (usec): min=1228, max=79366, avg=15550.69, stdev=12298.55 clat percentiles (usec): | 1.00th=[ 2147], 5.00th=[ 3163], 10.00th=[ 3785], 20.00th=[ 4948], | 30.00th=[ 7046], 40.00th=[10028], 50.00th=[12649], 60.00th=[15533], | 70.00th=[19268], 80.00th=[23987], 90.00th=[30540], 95.00th=[38011], | 99.00th=[63177], 99.50th=[74974], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 191, max= 832, per=25.21%, avg=493.64, stdev=136.97, samples=25 iops : min= 11, max= 52, avg=30.40, stdev= 8.70, samples=25 lat (usec) : 50=0.39%, 100=1.17%, 250=1.69% lat (msec) : 2=0.52%, 4=5.60%, 10=20.96%, 20=38.41%, 50=29.30% lat (msec) : 100=1.82%, 250=0.13% cpu : usr=0.09%, sys=28.05%, ctx=2416, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149756: Fri Apr 10 11:19:48 2026 read: IOPS=30, BW=495KiB/s (507kB/s)(6256KiB/12645msec) clat (usec): min=40, max=88532, avg=17501.24, stdev=12038.74 lat (usec): min=40, max=88534, avg=17502.08, stdev=12038.81 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 108], 10.00th=[ 223], 20.00th=[ 9110], | 30.00th=[10945], 40.00th=[13566], 50.00th=[15533], 60.00th=[18220], | 70.00th=[21365], 80.00th=[25297], 90.00th=[32375], 95.00th=[39584], | 99.00th=[58983], 99.50th=[71828], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 320, max= 855, per=26.22%, avg=487.92, stdev=123.77, samples=24 iops : min= 20, max= 53, avg=30.04, stdev= 7.69, samples=24 write: IOPS=29, BW=477KiB/s (488kB/s)(6032KiB/12645msec); 0 zone resets clat (usec): min=1518, max=109531, avg=15279.99, stdev=13315.39 lat (usec): min=1519, max=109532, avg=15281.51, stdev=13315.43 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2933], 10.00th=[ 3589], 20.00th=[ 4293], | 30.00th=[ 6128], 40.00th=[ 8848], 50.00th=[ 12125], 60.00th=[ 14877], | 70.00th=[ 18744], 80.00th=[ 24249], 90.00th=[ 30540], 95.00th=[ 38011], | 99.00th=[ 63177], 99.50th=[ 95945], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 159, max= 766, per=23.41%, avg=458.42, stdev=162.41, samples=24 iops : min= 9, max= 47, avg=28.17, stdev=10.20, samples=24 lat (usec) : 50=0.39%, 100=2.08%, 250=2.86%, 500=0.13% lat (msec) : 2=0.91%, 4=6.25%, 10=20.57%, 20=36.07%, 50=28.78% lat (msec) : 100=1.82%, 250=0.13% cpu : usr=0.11%, sys=27.39%, ctx=2426, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149757: Fri Apr 10 11:19:48 2026 read: IOPS=30, BW=485KiB/s (496kB/s)(6032KiB/12447msec) clat (usec): min=46, max=81346, avg=17488.75, stdev=11539.94 lat (usec): min=46, max=81347, avg=17489.63, stdev=11540.00 clat percentiles (usec): | 1.00th=[ 75], 5.00th=[ 109], 10.00th=[ 221], 20.00th=[ 9765], | 30.00th=[11863], 40.00th=[13829], 50.00th=[15664], 60.00th=[17957], | 70.00th=[20055], 80.00th=[24511], 90.00th=[31589], 95.00th=[40633], | 99.00th=[54264], 99.50th=[69731], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 224, max= 640, per=25.59%, avg=476.25, stdev=132.29, samples=24 iops : min= 14, max= 40, avg=29.29, stdev= 8.20, samples=24 write: IOPS=31, BW=503KiB/s (515kB/s)(6256KiB/12447msec); 0 zone resets clat (usec): min=1358, max=104432, avg=14851.41, stdev=12142.42 lat (usec): min=1360, max=104434, avg=14854.09, stdev=12141.96 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 3130], 10.00th=[ 3851], 20.00th=[ 4817], | 30.00th=[ 6390], 40.00th=[ 9110], 50.00th=[ 11994], 60.00th=[ 14484], | 70.00th=[ 18482], 80.00th=[ 22938], 90.00th=[ 30016], 95.00th=[ 37487], | 99.00th=[ 58983], 99.50th=[ 72877], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 159, max= 798, per=25.55%, avg=500.33, stdev=169.72, samples=24 iops : min= 9, max= 49, avg=30.79, stdev=10.69, samples=24 lat (usec) : 50=0.13%, 100=1.69%, 250=3.26% lat (msec) : 2=0.91%, 4=5.08%, 10=21.22%, 20=40.23%, 50=25.91% lat (msec) : 100=1.43%, 250=0.13% cpu : usr=0.10%, sys=28.00%, ctx=2378, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1861KiB/s (1906kB/s), 446KiB/s-495KiB/s (457kB/s-507kB/s), io=23.4MiB (24.5MB), run=12338-12869msec WRITE: bw=1958KiB/s (2005kB/s), 477KiB/s-516KiB/s (488kB/s-529kB/s), io=24.6MiB (25.8MB), run=12338-12869msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149759: Fri Apr 10 11:19:55 2026 read: IOPS=19, BW=312KiB/s (319kB/s)(5920KiB/18982msec) clat (msec): min=3, max=123, avg=14.88, stdev=15.53 lat (msec): min=3, max=123, avg=14.88, stdev=15.53 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 9], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 34], 95.00th=[ 44], | 99.00th=[ 81], 99.50th=[ 114], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 95, max= 768, per=24.07%, avg=302.05, stdev=159.80, samples=37 iops : min= 5, max= 48, avg=18.49, stdev=10.18, samples=37 write: IOPS=20, BW=335KiB/s (344kB/s)(6368KiB/18982msec); 0 zone resets clat (msec): min=14, max=202, avg=33.63, stdev=19.22 lat (msec): min=14, max=202, avg=33.63, stdev=19.22 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 112], 99.50th=[ 136], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 95, max= 608, per=25.08%, avg=331.11, stdev=169.88, samples=37 iops : min= 5, max= 38, avg=20.32, stdev=10.88, samples=37 lat (msec) : 4=1.43%, 10=24.87%, 20=20.96%, 50=42.97%, 100=8.72% lat (msec) : 250=1.04% cpu : usr=0.10%, sys=9.33%, ctx=1604, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149760: Fri Apr 10 11:19:55 2026 read: IOPS=18, BW=301KiB/s (308kB/s)(5744KiB/19082msec) clat (usec): min=3076, max=96920, avg=13899.36, stdev=13806.35 lat (usec): min=3076, max=96921, avg=13900.16, stdev=13806.37 clat percentiles (usec): | 1.00th=[ 3326], 5.00th=[ 3916], 10.00th=[ 4490], 20.00th=[ 5080], | 30.00th=[ 5735], 40.00th=[ 6587], 50.00th=[ 7963], 60.00th=[10421], | 70.00th=[14615], 80.00th=[21103], 90.00th=[33424], 95.00th=[43254], | 99.00th=[65799], 99.50th=[85459], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 704, per=24.32%, avg=305.25, stdev=186.48, samples=36 iops : min= 3, max= 44, avg=18.72, stdev=11.82, samples=36 write: IOPS=21, BW=343KiB/s (351kB/s)(6544KiB/19082msec); 0 zone resets clat (msec): min=12, max=202, avg=34.22, stdev=21.50 lat (msec): min=12, max=202, avg=34.22, stdev=21.50 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 61], 95.00th=[ 69], | 99.00th=[ 102], 99.50th=[ 180], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 158, max= 672, per=25.31%, avg=334.11, stdev=161.22, samples=37 iops : min= 9, max= 42, avg=20.49, stdev=10.37, samples=37 lat (msec) : 4=2.86%, 10=24.74%, 20=19.92%, 50=42.84%, 100=8.98% lat (msec) : 250=0.65% cpu : usr=0.07%, sys=9.34%, ctx=1586, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149761: Fri Apr 10 11:19:55 2026 read: IOPS=20, BW=335KiB/s (343kB/s)(6256KiB/18668msec) clat (msec): min=3, max=133, avg=14.72, stdev=14.95 lat (msec): min=3, max=133, avg=14.72, stdev=14.95 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 47], | 99.00th=[ 67], 99.50th=[ 93], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 95, max= 1024, per=26.74%, avg=335.64, stdev=217.02, samples=36 iops : min= 5, max= 64, avg=20.58, stdev=13.77, samples=36 write: IOPS=20, BW=323KiB/s (331kB/s)(6032KiB/18668msec); 0 zone resets clat (msec): min=14, max=143, avg=34.18, stdev=19.00 lat (msec): min=14, max=143, avg=34.18, stdev=19.00 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 74], | 99.00th=[ 107], 99.50th=[ 133], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 127, max= 640, per=23.94%, avg=315.94, stdev=159.39, samples=36 iops : min= 7, max= 40, avg=19.36, stdev=10.17, samples=36 lat (msec) : 4=1.30%, 10=27.60%, 20=20.18%, 50=41.41%, 100=8.59% lat (msec) : 250=0.91% cpu : usr=0.06%, sys=9.61%, ctx=1539, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149762: Fri Apr 10 11:19:55 2026 read: IOPS=20, BW=321KiB/s (329kB/s)(6032KiB/18763msec) clat (usec): min=3191, max=99499, avg=14899.28, stdev=14355.17 lat (usec): min=3192, max=99500, avg=14900.13, stdev=14355.18 clat percentiles (usec): | 1.00th=[ 3523], 5.00th=[ 4080], 10.00th=[ 4490], 20.00th=[ 5276], | 30.00th=[ 5932], 40.00th=[ 6915], 50.00th=[ 8717], 60.00th=[11207], | 70.00th=[15139], 80.00th=[23200], 90.00th=[35390], 95.00th=[45876], | 99.00th=[60556], 99.50th=[92799], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 95, max= 800, per=25.43%, avg=319.11, stdev=174.43, samples=37 iops : min= 5, max= 50, avg=19.57, stdev=11.12, samples=37 write: IOPS=20, BW=333KiB/s (341kB/s)(6256KiB/18763msec); 0 zone resets clat (msec): min=13, max=196, avg=33.40, stdev=20.18 lat (msec): min=13, max=196, avg=33.40, stdev=20.18 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 54], 95.00th=[ 71], | 99.00th=[ 113], 99.50th=[ 178], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 127, max= 672, per=25.27%, avg=333.57, stdev=173.05, samples=37 iops : min= 7, max= 42, avg=20.46, stdev=11.07, samples=37 lat (msec) : 4=2.08%, 10=24.87%, 20=19.66%, 50=44.27%, 100=8.59% lat (msec) : 250=0.52% cpu : usr=0.09%, sys=9.40%, ctx=1504, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1255KiB/s (1285kB/s), 301KiB/s-335KiB/s (308kB/s-343kB/s), io=23.4MiB (24.5MB), run=18668-19082msec WRITE: bw=1321KiB/s (1352kB/s), 323KiB/s-343KiB/s (331kB/s-351kB/s), io=24.6MiB (25.8MB), run=18668-19082msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149770: Fri Apr 10 11:20:04 2026 read: IOPS=3, BW=3685KiB/s (3774kB/s)(7168KiB/1945msec) clat (usec): min=799, max=203142, avg=115301.52, stdev=62229.29 lat (usec): min=800, max=203143, avg=115302.78, stdev=62229.27 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 799], 10.00th=[ 799], 20.00th=[ 91751], | 30.00th=[ 99091], 40.00th=[ 99091], 50.00th=[129500], 60.00th=[137364], | 70.00th=[137364], 80.00th=[145753], 90.00th=[202376], 95.00th=[202376], | 99.00th=[202376], 99.50th=[202376], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 3976, max= 5314, per=62.74%, avg=4645.00, stdev=946.11, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2632KiB/s (2696kB/s)(5120KiB/1945msec); 0 zone resets clat (msec): min=128, max=358, avg=222.41, stdev=97.68 lat (msec): min=128, max=358, avg=222.47, stdev=97.70 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1771, max= 3737, per=24.11%, avg=2498.67, stdev=1077.90, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=16.67%, 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=55.04%, ctx=1046, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149771: Fri Apr 10 11:20:04 2026 read: IOPS=0, BW=740KiB/s (758kB/s)(2048KiB/2766msec) clat (usec): min=529, max=77164, avg=38847.39, stdev=54189.17 lat (usec): min=530, max=77167, avg=38848.69, stdev=54190.43 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 529], 60.00th=[77071], | 70.00th=[77071], 80.00th=[77071], 90.00th=[77071], 95.00th=[77071], | 99.00th=[77071], 99.50th=[77071], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 1771, max= 2035, per=25.70%, avg=1903.00, stdev=186.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3702KiB/s (3791kB/s)(10.0MiB/2766msec); 0 zone resets clat (msec): min=80, max=508, avg=267.48, stdev=143.17 lat (msec): min=80, max=508, avg=267.55, stdev=143.16 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 97], | 30.00th=[ 169], 40.00th=[ 194], 50.00th=[ 241], 60.00th=[ 262], | 70.00th=[ 288], 80.00th=[ 393], 90.00th=[ 443], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1771, max= 8192, per=34.43%, avg=3568.40, stdev=2739.39, samples=5 iops : min= 1, max= 8, avg= 2.80, stdev= 3.03, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=25.00%, 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=44.01%, ctx=391, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149772: Fri Apr 10 11:20:04 2026 read: IOPS=2, BW=2684KiB/s (2749kB/s)(6144KiB/2289msec) clat (usec): min=548, max=243369, avg=78136.27, stdev=97669.09 lat (usec): min=549, max=243370, avg=78137.15, stdev=97669.36 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[ 15139], 50.00th=[ 15139], 60.00th=[ 65799], | 70.00th=[143655], 80.00th=[143655], 90.00th=[244319], 95.00th=[244319], | 99.00th=[244319], 99.50th=[244319], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 1868, max= 4071, per=44.64%, avg=3305.00, stdev=1245.38, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2684KiB/s (2749kB/s)(6144KiB/2289msec); 0 zone resets clat (msec): min=151, max=585, avg=298.67, stdev=152.07 lat (msec): min=151, max=585, avg=298.73, stdev=152.07 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 279], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1868, max= 4071, per=27.65%, avg=2866.00, stdev=1105.92, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=16.67% lat (msec) : 20=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=40.56%, ctx=372, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149773: Fri Apr 10 11:20:04 2026 read: IOPS=2, BW=2265KiB/s (2320kB/s)(5120KiB/2260msec) clat (usec): min=471, max=258476, avg=104157.64, stdev=130713.63 lat (usec): min=471, max=258477, avg=104158.56, stdev=130713.57 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], 20.00th=[ 474], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 26608], 60.00th=[ 26608], | 70.00th=[233833], 80.00th=[233833], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 3737, max= 4071, per=52.73%, avg=3904.00, stdev=236.17, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3172KiB/s (3248kB/s)(7168KiB/2260msec); 0 zone resets clat (msec): min=132, max=533, avg=245.97, stdev=145.11 lat (msec): min=132, max=533, avg=246.04, stdev=145.12 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 133], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 209], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 317], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1868, max= 4071, per=27.80%, avg=2881.50, stdev=1118.81, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=8.33%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=40.90%, ctx=354, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7404KiB/s (7582kB/s), 740KiB/s-3685KiB/s (758kB/s-3774kB/s), io=20.0MiB (20.0MB), run=1945-2766msec WRITE: bw=10.1MiB/s (10.6MB/s), 2632KiB/s-3702KiB/s (2696kB/s-3791kB/s), io=28.0MiB (29.4MB), run=1945-2766msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149775: Fri Apr 10 11:20:04 2026 read: IOPS=2, BW=2867KiB/s (2936kB/s)(7168KiB/2500msec) clat (msec): min=49, max=557, avg=193.23, stdev=201.34 lat (msec): min=49, max=557, avg=193.23, stdev=201.34 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 79], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 86], 60.00th=[ 99], | 70.00th=[ 99], 80.00th=[ 401], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1855, max= 4047, per=45.26%, avg=3217.33, stdev=1189.12, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2048KiB/s (2097kB/s)(5120KiB/2500msec); 0 zone resets clat (msec): min=137, max=315, avg=213.15, stdev=66.84 lat (msec): min=137, max=315, avg=213.23, stdev=66.84 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1875, max= 4015, per=29.59%, avg=2945.00, stdev=1513.21, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=8.33%, 100=33.33%, 250=33.33%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=15.85%, ctx=159, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149776: Fri Apr 10 11:20:04 2026 read: IOPS=0, BW=726KiB/s (744kB/s)(2048KiB/2820msec) clat (msec): min=173, max=269, avg=221.32, stdev=67.59 lat (msec): min=173, max=269, avg=221.32, stdev=67.59 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1943, max= 2007, per=27.79%, avg=1975.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3631KiB/s (3718kB/s)(10.0MiB/2820msec); 0 zone resets clat (msec): min=46, max=452, avg=220.07, stdev=121.48 lat (msec): min=46, max=452, avg=220.14, stdev=121.48 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 47], 10.00th=[ 47], 20.00th=[ 79], | 30.00th=[ 133], 40.00th=[ 142], 50.00th=[ 239], 60.00th=[ 253], | 70.00th=[ 275], 80.00th=[ 288], 90.00th=[ 296], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2007, max= 4096, per=34.92%, avg=3475.00, stdev=990.53, samples=4 iops : min= 1, max= 4, avg= 2.75, stdev= 1.26, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=50.00% cpu : usr=0.07%, sys=16.64%, ctx=93, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149777: Fri Apr 10 11:20:04 2026 read: IOPS=2, BW=2259KiB/s (2313kB/s)(6144KiB/2720msec) clat (msec): min=45, max=245, avg=103.07, stdev=74.29 lat (msec): min=45, max=245, avg=103.07, stdev=74.29 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 53], | 30.00th=[ 53], 40.00th=[ 68], 50.00th=[ 68], 60.00th=[ 100], | 70.00th=[ 109], 80.00th=[ 109], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 4047, max= 4096, per=57.28%, avg=4071.50, stdev=34.65, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2259KiB/s (2313kB/s)(6144KiB/2720msec); 0 zone resets clat (msec): min=58, max=714, avg=324.55, stdev=230.41 lat (msec): min=58, max=714, avg=324.64, stdev=230.40 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 334], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1875, max= 4096, per=25.04%, avg=2491.75, stdev=1071.27, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=14.01%, ctx=231, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149778: Fri Apr 10 11:20:04 2026 read: IOPS=1, BW=1777KiB/s (1820kB/s)(5120KiB/2881msec) clat (msec): min=25, max=515, avg=202.74, stdev=186.54 lat (msec): min=25, max=515, avg=202.74, stdev=186.54 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 26], 10.00th=[ 26], 20.00th=[ 26], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2048, max= 4015, per=42.65%, avg=3031.50, stdev=1390.88, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2488KiB/s (2548kB/s)(7168KiB/2881msec); 0 zone resets clat (msec): min=49, max=562, avg=257.68, stdev=203.37 lat (msec): min=49, max=563, avg=257.76, stdev=203.37 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 68], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 245], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 409], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1875, max= 2023, per=19.68%, avg=1958.25, stdev=69.32, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=16.67%, 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=14.90%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7109KiB/s (7279kB/s), 726KiB/s-2867KiB/s (744kB/s-2936kB/s), io=20.0MiB (20.0MB), run=2500-2881msec WRITE: bw=9952KiB/s (10.2MB/s), 2048KiB/s-3631KiB/s (2097kB/s-3718kB/s), io=28.0MiB (29.4MB), run=2500-2881msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149788: Fri Apr 10 11:20:12 2026 read: IOPS=2, BW=8629KiB/s (8836kB/s)(12.0MiB/1424msec) clat (msec): min=388, max=481, avg=447.10, stdev=51.28 lat (msec): min=388, max=481, avg=447.11, stdev=51.28 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.07%, sys=47.43%, ctx=2667, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149789: Fri Apr 10 11:20:12 2026 read: IOPS=0, BW=1833KiB/s (1877kB/s)(4096KiB/2234msec) clat (nsec): min=446210k, max=446210k, avg=446209590.00, stdev= 0.00 lat (nsec): min=446212k, max=446212k, avg=446212081.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3667KiB/s (3755kB/s)(8192KiB/2234msec); 0 zone resets clat (msec): min=595, max=1167, avg=881.50, stdev=403.86 lat (msec): min=596, max=1167, avg=881.85, stdev=403.79 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8192, max= 8192, per=55.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.09%, sys=16.66%, ctx=1034, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149790: Fri Apr 10 11:20:12 2026 write: IOPS=1, BW=6861KiB/s (7026kB/s)(12.0MiB/1791msec); 0 zone resets clat (msec): min=207, max=783, avg=568.86, stdev=314.87 lat (msec): min=207, max=783, avg=573.86, stdev=318.16 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8192, max= 8192, per=55.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.06%, sys=18.44%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149791: Fri Apr 10 11:20:12 2026 write: IOPS=1, BW=6269KiB/s (6420kB/s)(12.0MiB/1960msec); 0 zone resets clat (msec): min=204, max=949, avg=627.51, stdev=382.55 lat (msec): min=204, max=949, avg=627.83, stdev=382.53 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8192, max= 8192, per=55.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=14.65%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7334KiB/s (7510kB/s), 1833KiB/s-8629KiB/s (1877kB/s-8836kB/s), io=16.0MiB (16.8MB), run=1424-2234msec WRITE: bw=14.3MiB/s (15.0MB/s), 3667KiB/s-6861KiB/s (3755kB/s-7026kB/s), io=32.0MiB (33.6MB), run=1791-2234msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149783: Fri Apr 10 11:20:12 2026 read: IOPS=1, BW=7928KiB/s (8118kB/s)(12.0MiB/1550msec) clat (msec): min=478, max=538, avg=507.94, stdev=30.39 lat (msec): min=478, max=538, avg=507.94, stdev=30.39 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 5512, max= 8192, per=84.70%, avg=6852.00, stdev=1895.05, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=17.50%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149785: Fri Apr 10 11:20:12 2026 read: IOPS=0, BW=2023KiB/s (2071kB/s)(4096KiB/2025msec) clat (nsec): min=166653k, max=166653k, avg=166653054.00, stdev= 0.00 lat (nsec): min=166657k, max=166657k, avg=166657091.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 167], 95.00th=[ 167], | 99.00th=[ 167], 99.50th=[ 167], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 7529, max= 7529, per=93.07%, avg=7529.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=4045KiB/s (4143kB/s)(8192KiB/2025msec); 0 zone resets clat (msec): min=710, max=1127, avg=919.27, stdev=294.60 lat (msec): min=711, max=1127, avg=919.61, stdev=294.61 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8175, max= 8175, per=57.36%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.48%, ctx=89, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149786: Fri Apr 10 11:20:12 2026 write: IOPS=1, BW=5345KiB/s (5473kB/s)(12.0MiB/2299msec); 0 zone resets clat (msec): min=163, max=1314, avg=755.35, stdev=576.27 lat (msec): min=164, max=1315, avg=755.69, stdev=576.25 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8175, max= 8175, per=57.36%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=12.32%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149787: Fri Apr 10 11:20:12 2026 write: IOPS=1, BW=8106KiB/s (8300kB/s)(12.0MiB/1516msec); 0 zone resets clat (msec): min=377, max=734, avg=499.77, stdev=203.37 lat (msec): min=378, max=734, avg=500.03, stdev=203.30 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 5535, max= 8192, per=48.15%, avg=6863.50, stdev=1878.78, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=21.52%, ctx=87, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8091KiB/s (8285kB/s), 2023KiB/s-7928KiB/s (2071kB/s-8118kB/s), io=16.0MiB (16.8MB), run=1550-2025msec WRITE: bw=13.9MiB/s (14.6MB/s), 4045KiB/s-8106KiB/s (4143kB/s-8300kB/s), io=32.0MiB (33.6MB), run=1516-2299msec