== sanity test 398b: DIO and buffer IO race ============== 20:31:49 (1777422709) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.61198 s, 19.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156536: Tue Apr 28 20:32:55 2026 read: IOPS=25, BW=104KiB/s (106kB/s)(5992KiB/57674msec) clat (usec): min=237, max=893449, avg=20837.45, stdev=25540.18 lat (usec): min=238, max=893450, avg=20841.35, stdev=25540.53 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 6718], 10.00th=[ 8717], 20.00th=[ 11076], | 30.00th=[ 13304], 40.00th=[ 15664], 50.00th=[ 18220], 60.00th=[ 21103], | 70.00th=[ 23987], 80.00th=[ 28181], 90.00th=[ 33817], 95.00th=[ 40633], | 99.00th=[ 66323], 99.50th=[ 76022], 99.90th=[124257], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 200, per=25.20%, avg=103.82, stdev=31.27, samples=113 iops : min= 1, max= 50, avg=25.54, stdev= 7.94, samples=113 write: IOPS=27, BW=109KiB/s (112kB/s)(6296KiB/57674msec); 0 zone resets clat (usec): min=750, max=80157, avg=16599.85, stdev=12468.95 lat (usec): min=751, max=80158, avg=16601.28, stdev=12469.25 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 2769], 10.00th=[ 3490], 20.00th=[ 5407], | 30.00th=[ 7701], 40.00th=[10945], 50.00th=[13960], 60.00th=[17433], | 70.00th=[21103], 80.00th=[25822], 90.00th=[33424], 95.00th=[40633], | 99.00th=[55313], 99.50th=[63701], 99.90th=[77071], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 47, max= 240, per=25.39%, avg=109.69, stdev=36.44, samples=112 iops : min= 11, max= 60, avg=27.01, stdev= 9.16, samples=112 lat (usec) : 250=0.03%, 500=0.29%, 750=0.62%, 1000=0.81% lat (msec) : 2=1.24%, 4=5.57%, 10=17.61%, 20=35.74%, 50=35.97% lat (msec) : 100=2.05%, 250=0.03%, 1000=0.03% cpu : usr=0.11%, sys=29.30%, ctx=10296, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156537: Tue Apr 28 20:32:55 2026 read: IOPS=25, BW=102KiB/s (105kB/s)(5940KiB/58115msec) clat (usec): min=146, max=107152, avg=20448.92, stdev=11656.30 lat (usec): min=147, max=107153, avg=20449.66, stdev=11656.31 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 6718], 10.00th=[ 8717], 20.00th=[ 11076], | 30.00th=[ 13566], 40.00th=[ 15926], 50.00th=[ 18220], 60.00th=[ 20841], | 70.00th=[ 24773], 80.00th=[ 28443], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 57934], 99.50th=[ 65274], 99.90th=[ 90702], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 7, max= 200, per=24.81%, avg=102.23, stdev=30.69, samples=114 iops : min= 1, max= 50, avg=25.14, stdev= 7.80, samples=114 write: IOPS=27, BW=109KiB/s (112kB/s)(6348KiB/58115msec); 0 zone resets clat (usec): min=721, max=899264, avg=17284.54, stdev=25771.44 lat (usec): min=721, max=899265, avg=17289.19, stdev=25769.90 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2704], 10.00th=[ 3392], 20.00th=[ 5342], | 30.00th=[ 7570], 40.00th=[ 10683], 50.00th=[ 13698], 60.00th=[ 16909], | 70.00th=[ 20841], 80.00th=[ 26346], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 59507], 99.50th=[ 66847], 99.90th=[108528], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 39, max= 248, per=25.39%, avg=109.69, stdev=39.27, samples=113 iops : min= 9, max= 62, avg=27.02, stdev= 9.88, samples=113 lat (usec) : 250=0.10%, 500=0.39%, 750=0.52%, 1000=0.81% lat (msec) : 2=1.20%, 4=5.89%, 10=17.35%, 20=36.49%, 50=35.09% lat (msec) : 100=2.05%, 250=0.07%, 1000=0.03% cpu : usr=0.12%, sys=28.70%, ctx=10048, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156539: Tue Apr 28 20:32:55 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(6028KiB/57554msec) clat (usec): min=151, max=125306, avg=20093.68, stdev=12045.99 lat (usec): min=151, max=125308, avg=20094.62, stdev=12046.11 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 6390], 10.00th=[ 8586], 20.00th=[ 10945], | 30.00th=[ 13304], 40.00th=[ 15533], 50.00th=[ 17695], 60.00th=[ 20579], | 70.00th=[ 23462], 80.00th=[ 27657], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 61080], 99.50th=[ 68682], 99.90th=[ 93848], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 47, max= 200, per=25.78%, avg=106.21, stdev=31.46, samples=112 iops : min= 11, max= 50, avg=26.13, stdev= 7.93, samples=112 write: IOPS=27, BW=109KiB/s (111kB/s)(6260KiB/57554msec); 0 zone resets clat (usec): min=848, max=901098, avg=17226.04, stdev=26039.32 lat (usec): min=848, max=901099, avg=17228.07, stdev=26038.93 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2769], 10.00th=[ 3392], 20.00th=[ 5211], | 30.00th=[ 7504], 40.00th=[ 10814], 50.00th=[ 13435], 60.00th=[ 16909], | 70.00th=[ 20317], 80.00th=[ 25822], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 61604], 99.50th=[ 69731], 99.90th=[109577], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 14, max= 215, per=25.26%, avg=109.14, stdev=37.59, samples=113 iops : min= 3, max= 53, avg=26.87, stdev= 9.48, samples=113 lat (usec) : 250=0.10%, 500=0.23%, 750=0.72%, 1000=0.55% lat (msec) : 2=1.43%, 4=5.99%, 10=17.64%, 20=36.88%, 50=34.05% lat (msec) : 100=2.28%, 250=0.10%, 1000=0.03% cpu : usr=0.12%, sys=29.03%, ctx=10089, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156541: Tue Apr 28 20:32:55 2026 read: IOPS=26, BW=104KiB/s (107kB/s)(6052KiB/58157msec) clat (usec): min=263, max=101393, avg=19909.32, stdev=11305.43 lat (usec): min=264, max=101394, avg=19910.09, stdev=11305.48 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 5997], 10.00th=[ 8586], 20.00th=[ 10814], | 30.00th=[ 13173], 40.00th=[ 15664], 50.00th=[ 17957], 60.00th=[ 20317], | 70.00th=[ 23462], 80.00th=[ 28181], 90.00th=[ 34341], 95.00th=[ 40109], | 99.00th=[ 56361], 99.50th=[ 65799], 99.90th=[ 79168], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 40, max= 224, per=25.31%, avg=104.27, stdev=30.59, samples=113 iops : min= 10, max= 56, avg=25.65, stdev= 7.74, samples=113 write: IOPS=26, BW=107KiB/s (110kB/s)(6236KiB/58157msec); 0 zone resets clat (usec): min=682, max=896463, avg=17778.51, stdev=26081.42 lat (usec): min=682, max=896463, avg=17779.85, stdev=26081.57 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2769], 10.00th=[ 3458], 20.00th=[ 5342], | 30.00th=[ 7767], 40.00th=[ 11076], 50.00th=[ 14484], 60.00th=[ 18220], | 70.00th=[ 21627], 80.00th=[ 26346], 90.00th=[ 34341], 95.00th=[ 44303], | 99.00th=[ 59507], 99.50th=[ 68682], 99.90th=[147850], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 216, per=24.68%, avg=106.62, stdev=36.46, samples=114 iops : min= 1, max= 54, avg=26.25, stdev= 9.20, samples=114 lat (usec) : 500=0.36%, 750=0.59%, 1000=0.62% lat (msec) : 2=1.20%, 4=5.79%, 10=18.33%, 20=35.12%, 50=35.81% lat (msec) : 100=2.08%, 250=0.07%, 1000=0.03% cpu : usr=0.11%, sys=28.59%, ctx=10134, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=413KiB/s (423kB/s), 102KiB/s-105KiB/s (105kB/s-107kB/s), io=23.4MiB (24.6MB), run=57554-58157msec WRITE: bw=432KiB/s (443kB/s), 107KiB/s-109KiB/s (110kB/s-112kB/s), io=24.6MiB (25.7MB), run=57554-58157msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156538: Tue Apr 28 20:33:16 2026 read: IOPS=18, BW=75.7KiB/s (77.5kB/s)(5992KiB/79168msec) clat (msec): min=2, max=911, avg=17.53, stdev=28.26 lat (msec): min=2, max=911, avg=17.53, stdev=28.26 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 37], 95.00th=[ 49], | 99.00th=[ 80], 99.50th=[ 107], 99.90th=[ 178], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 224, per=25.45%, avg=77.12, stdev=44.96, samples=153 iops : min= 1, max= 56, avg=18.95, stdev=11.38, samples=153 write: IOPS=19, BW=79.5KiB/s (81.4kB/s)(6296KiB/79168msec); 0 zone resets clat (msec): min=11, max=139, avg=33.43, stdev=17.76 lat (msec): min=11, max=139, avg=33.43, stdev=17.76 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 67], | 99.00th=[ 92], 99.50th=[ 111], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 15, max= 184, per=25.21%, avg=79.90, stdev=42.78, samples=155 iops : min= 3, max= 46, avg=19.63, stdev=10.86, samples=155 lat (msec) : 4=3.58%, 10=17.38%, 20=26.40%, 50=42.15%, 100=9.77% lat (msec) : 250=0.68%, 1000=0.03% cpu : usr=0.08%, sys=11.72%, ctx=6729, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156540: Tue Apr 28 20:33:16 2026 read: IOPS=18, BW=75.2KiB/s (77.0kB/s)(5940KiB/78978msec) clat (msec): min=2, max=887, avg=17.17, stdev=27.49 lat (msec): min=2, max=887, avg=17.17, stdev=27.49 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 46], | 99.00th=[ 81], 99.50th=[ 100], 99.90th=[ 140], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 16, max= 216, per=25.09%, avg=76.01, stdev=47.02, samples=155 iops : min= 4, max= 54, avg=18.66, stdev=11.90, samples=155 write: IOPS=20, BW=80.4KiB/s (82.3kB/s)(6348KiB/78978msec); 0 zone resets clat (msec): min=12, max=165, avg=33.52, stdev=17.98 lat (msec): min=12, max=165, avg=33.52, stdev=17.98 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 57], 95.00th=[ 70], | 99.00th=[ 95], 99.50th=[ 104], 99.90th=[ 148], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 15, max= 184, per=25.56%, avg=81.03, stdev=42.60, samples=155 iops : min= 3, max= 46, avg=19.92, stdev=10.82, samples=155 lat (msec) : 4=3.48%, 10=17.87%, 20=25.23%, 50=43.62%, 100=9.24% lat (msec) : 250=0.52%, 1000=0.03% cpu : usr=0.10%, sys=11.71%, ctx=6696, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156542: Tue Apr 28 20:33:16 2026 read: IOPS=19, BW=76.4KiB/s (78.2kB/s)(6028KiB/78950msec) clat (msec): min=2, max=173, avg=16.63, stdev=15.51 lat (msec): min=2, max=173, avg=16.63, stdev=15.51 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 37], 95.00th=[ 48], | 99.00th=[ 68], 99.50th=[ 85], 99.90th=[ 142], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 15, max= 240, per=25.63%, avg=77.66, stdev=45.04, samples=154 iops : min= 3, max= 60, avg=19.07, stdev=11.42, samples=154 write: IOPS=19, BW=79.3KiB/s (81.2kB/s)(6260KiB/78950msec); 0 zone resets clat (msec): min=12, max=901, avg=34.24, stdev=28.28 lat (msec): min=12, max=901, avg=34.24, stdev=28.28 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 97], 99.50th=[ 111], 99.90th=[ 142], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 15, max= 184, per=25.25%, avg=80.05, stdev=42.65, samples=155 iops : min= 3, max= 46, avg=19.67, stdev=10.82, samples=155 lat (msec) : 4=2.80%, 10=18.72%, 20=24.74%, 50=42.90%, 100=10.29% lat (msec) : 250=0.52%, 1000=0.03% cpu : usr=0.11%, sys=11.76%, ctx=6645, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156543: Tue Apr 28 20:33:16 2026 read: IOPS=19, BW=76.8KiB/s (78.6kB/s)(6052KiB/78845msec) clat (msec): min=2, max=139, avg=16.53, stdev=15.84 lat (msec): min=2, max=139, avg=16.53, stdev=15.84 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 48], | 99.00th=[ 80], 99.50th=[ 97], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 7, max= 264, per=25.60%, avg=77.56, stdev=49.20, samples=155 iops : min= 1, max= 66, avg=19.05, stdev=12.45, samples=155 write: IOPS=19, BW=79.1KiB/s (80.0kB/s)(6236KiB/78845msec); 0 zone resets clat (msec): min=12, max=893, avg=34.34, stdev=28.40 lat (msec): min=12, max=893, avg=34.34, stdev=28.40 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 60], 95.00th=[ 71], | 99.00th=[ 101], 99.50th=[ 115], 99.90th=[ 146], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 23, max= 184, per=25.22%, avg=79.95, stdev=42.07, samples=155 iops : min= 5, max= 46, avg=19.65, stdev=10.68, samples=155 lat (msec) : 4=3.81%, 10=18.62%, 20=24.61%, 50=42.77%, 100=9.57% lat (msec) : 250=0.59%, 1000=0.03% cpu : usr=0.11%, sys=11.62%, ctx=6708, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=303KiB/s (311kB/s), 75.2KiB/s-76.8KiB/s (77.0kB/s-78.6kB/s), io=23.4MiB (24.6MB), run=78845-79168msec WRITE: bw=318KiB/s (325kB/s), 79.1KiB/s-80.4KiB/s (80.0kB/s-82.3kB/s), io=24.6MiB (25.7MB), run=78845-79168msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156576: Tue Apr 28 20:33:41 2026 read: IOPS=21, BW=341KiB/s (349kB/s)(5920KiB/17358msec) clat (usec): min=152, max=132745, avg=23035.04, stdev=14743.26 lat (usec): min=153, max=132746, avg=23035.98, stdev=14743.54 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 881], 10.00th=[ 1287], 20.00th=[ 11600], | 30.00th=[ 15926], 40.00th=[ 19792], 50.00th=[ 22676], 60.00th=[ 25297], | 70.00th=[ 28705], 80.00th=[ 32375], 90.00th=[ 39060], 95.00th=[ 45351], | 99.00th=[ 69731], 99.50th=[ 71828], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 191, max= 573, per=24.93%, avg=338.00, stdev=97.08, samples=34 iops : min= 11, max= 35, avg=20.47, stdev= 6.12, samples=34 write: IOPS=22, BW=367KiB/s (376kB/s)(6368KiB/17358msec); 0 zone resets clat (usec): min=1358, max=67868, avg=21950.44, stdev=13679.01 lat (usec): min=1359, max=67869, avg=21952.10, stdev=13679.03 clat percentiles (usec): | 1.00th=[ 3064], 5.00th=[ 5342], 10.00th=[ 6980], 20.00th=[ 9241], | 30.00th=[13304], 40.00th=[15926], 50.00th=[19268], 60.00th=[23200], | 70.00th=[27132], 80.00th=[32113], 90.00th=[41681], 95.00th=[49546], | 99.00th=[62653], 99.50th=[66847], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 128, max= 540, per=25.60%, avg=365.38, stdev=90.60, samples=34 iops : min= 8, max= 33, avg=22.18, stdev= 5.68, samples=34 lat (usec) : 250=0.13%, 500=0.52%, 750=0.78%, 1000=1.82% lat (msec) : 2=2.08%, 4=1.56%, 10=12.37%, 20=27.86%, 50=48.57% lat (msec) : 100=4.17%, 250=0.13% cpu : usr=0.06%, sys=31.24%, ctx=3087, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156577: Tue Apr 28 20:33:41 2026 read: IOPS=20, BW=325KiB/s (333kB/s)(5744KiB/17655msec) clat (usec): min=284, max=87012, avg=24268.74, stdev=14534.43 lat (usec): min=285, max=87012, avg=24269.65, stdev=14534.60 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 938], 10.00th=[ 5669], 20.00th=[13042], | 30.00th=[16319], 40.00th=[19530], 50.00th=[22414], 60.00th=[26346], | 70.00th=[30802], 80.00th=[34866], 90.00th=[44827], 95.00th=[49021], | 99.00th=[66847], 99.50th=[72877], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 159, max= 447, per=23.44%, avg=317.79, stdev=79.22, samples=34 iops : min= 9, max= 27, avg=19.21, stdev= 4.95, samples=34 write: IOPS=23, BW=371KiB/s (380kB/s)(6544KiB/17655msec); 0 zone resets clat (usec): min=1312, max=82937, avg=21788.46, stdev=14081.18 lat (usec): min=1313, max=82938, avg=21803.23, stdev=14079.67 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 4817], 10.00th=[ 6587], 20.00th=[ 9241], | 30.00th=[11863], 40.00th=[15008], 50.00th=[18482], 60.00th=[22414], | 70.00th=[28181], 80.00th=[34341], 90.00th=[41157], 95.00th=[47449], | 99.00th=[62653], 99.50th=[68682], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 159, max= 733, per=24.92%, avg=355.68, stdev=120.78, samples=34 iops : min= 9, max= 45, avg=21.56, stdev= 7.50, samples=34 lat (usec) : 500=0.52%, 750=0.65%, 1000=1.56% lat (msec) : 2=2.21%, 4=0.91%, 10=14.19%, 20=27.99%, 50=48.31% lat (msec) : 100=3.65% cpu : usr=0.11%, sys=31.36%, ctx=3080, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156578: Tue Apr 28 20:33:41 2026 read: IOPS=22, BW=362KiB/s (371kB/s)(6256KiB/17276msec) clat (usec): min=140, max=76818, avg=23331.90, stdev=13007.88 lat (usec): min=141, max=76819, avg=23332.79, stdev=13007.91 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 873], 10.00th=[ 1614], 20.00th=[13566], | 30.00th=[16909], 40.00th=[20317], 50.00th=[22938], 60.00th=[25297], | 70.00th=[28443], 80.00th=[33162], 90.00th=[39060], 95.00th=[44303], | 99.00th=[62653], 99.50th=[65799], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 156, max= 606, per=26.80%, avg=363.47, stdev=97.75, samples=34 iops : min= 9, max= 37, avg=22.06, stdev= 6.09, samples=34 write: IOPS=21, BW=349KiB/s (358kB/s)(6032KiB/17276msec); 0 zone resets clat (usec): min=1704, max=68042, avg=21411.58, stdev=13201.53 lat (usec): min=1706, max=68042, avg=21413.27, stdev=13201.55 clat percentiles (usec): | 1.00th=[ 3982], 5.00th=[ 5080], 10.00th=[ 6915], 20.00th=[ 9372], | 30.00th=[12256], 40.00th=[16057], 50.00th=[19006], 60.00th=[22152], | 70.00th=[26084], 80.00th=[31589], 90.00th=[40109], 95.00th=[47449], | 99.00th=[61604], 99.50th=[66323], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 158, max= 574, per=24.31%, avg=346.97, stdev=116.35, samples=34 iops : min= 9, max= 35, avg=21.03, stdev= 7.23, samples=34 lat (usec) : 250=0.13%, 500=0.13%, 750=1.04%, 1000=1.69% lat (msec) : 2=2.34%, 4=0.52%, 10=11.46%, 20=28.26%, 50=50.78% lat (msec) : 100=3.65% cpu : usr=0.12%, sys=32.06%, ctx=3134, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156579: Tue Apr 28 20:33:41 2026 read: IOPS=22, BW=352KiB/s (361kB/s)(6032KiB/17113msec) clat (usec): min=377, max=61892, avg=22899.43, stdev=13185.29 lat (usec): min=377, max=61893, avg=22900.36, stdev=13185.42 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 766], 10.00th=[ 1139], 20.00th=[12780], | 30.00th=[16450], 40.00th=[20317], 50.00th=[22938], 60.00th=[25822], | 70.00th=[28443], 80.00th=[33162], 90.00th=[39584], 95.00th=[44827], | 99.00th=[58983], 99.50th=[61604], 99.90th=[62129], 99.95th=[62129], | 99.99th=[62129] bw ( KiB/s): min= 190, max= 509, per=25.74%, avg=349.09, stdev=81.55, samples=33 iops : min= 11, max= 31, avg=21.15, stdev= 5.04, samples=33 write: IOPS=22, BW=366KiB/s (374kB/s)(6256KiB/17113msec); 0 zone resets clat (usec): min=1193, max=85022, avg=21460.20, stdev=14444.74 lat (usec): min=1195, max=85025, avg=21462.43, stdev=14445.30 clat percentiles (usec): | 1.00th=[ 2835], 5.00th=[ 4948], 10.00th=[ 6980], 20.00th=[ 8979], | 30.00th=[11076], 40.00th=[14615], 50.00th=[17957], 60.00th=[21627], | 70.00th=[26608], 80.00th=[33424], 90.00th=[41681], 95.00th=[46400], | 99.00th=[69731], 99.50th=[71828], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 159, max= 670, per=25.53%, avg=364.27, stdev=125.46, samples=33 iops : min= 9, max= 41, avg=22.12, stdev= 7.87, samples=33 lat (usec) : 500=0.78%, 750=1.43%, 1000=1.82% lat (msec) : 2=2.21%, 4=1.30%, 10=12.50%, 20=27.34%, 50=48.70% lat (msec) : 100=3.91% cpu : usr=0.07%, sys=31.55%, ctx=2996, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1357KiB/s (1389kB/s), 325KiB/s-362KiB/s (333kB/s-371kB/s), io=23.4MiB (24.5MB), run=17113-17655msec WRITE: bw=1427KiB/s (1462kB/s), 349KiB/s-371KiB/s (358kB/s-380kB/s), io=24.6MiB (25.8MB), run=17113-17655msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156571: Tue Apr 28 20:33:46 2026 read: IOPS=16, BW=258KiB/s (264kB/s)(5920KiB/22975msec) clat (msec): min=3, max=126, avg=21.43, stdev=18.94 lat (msec): min=3, max=126, avg=21.43, stdev=18.94 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 33], 90.00th=[ 43], 95.00th=[ 64], | 99.00th=[ 94], 99.50th=[ 123], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 63, max= 608, per=24.44%, avg=253.98, stdev=129.01, samples=45 iops : min= 3, max= 38, avg=15.24, stdev= 8.34, samples=45 write: IOPS=17, BW=277KiB/s (284kB/s)(6368KiB/22975msec); 0 zone resets clat (msec): min=15, max=127, avg=37.66, stdev=17.68 lat (msec): min=15, max=127, avg=37.66, stdev=17.68 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 41], 80.00th=[ 49], 90.00th=[ 62], 95.00th=[ 72], | 99.00th=[ 104], 99.50th=[ 121], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 126, max= 544, per=25.20%, avg=275.44, stdev=120.20, samples=45 iops : min= 7, max= 34, avg=16.60, stdev= 7.78, samples=45 lat (msec) : 4=0.52%, 10=13.54%, 20=19.40%, 50=53.13%, 100=12.63% lat (msec) : 250=0.78% cpu : usr=0.08%, sys=13.40%, ctx=2029, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156572: Tue Apr 28 20:33:46 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(5744KiB/23045msec) clat (usec): min=3499, max=97170, avg=21192.39, stdev=17007.13 lat (usec): min=3500, max=97170, avg=21193.49, stdev=17007.04 clat percentiles (usec): | 1.00th=[ 3687], 5.00th=[ 4948], 10.00th=[ 5669], 20.00th=[ 7308], | 30.00th=[ 9896], 40.00th=[12780], 50.00th=[16450], 60.00th=[20055], | 70.00th=[23987], 80.00th=[31589], 90.00th=[44827], 95.00th=[59507], | 99.00th=[80217], 99.50th=[90702], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 63, max= 704, per=23.84%, avg=247.73, stdev=135.52, samples=45 iops : min= 3, max= 44, avg=14.87, stdev= 8.69, samples=45 write: IOPS=17, BW=284KiB/s (291kB/s)(6544KiB/23045msec); 0 zone resets clat (msec): min=14, max=167, avg=37.62, stdev=18.79 lat (msec): min=14, max=167, avg=37.62, stdev=18.79 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 42], 80.00th=[ 49], 90.00th=[ 62], 95.00th=[ 79], | 99.00th=[ 97], 99.50th=[ 110], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 127, max= 608, per=25.57%, avg=279.47, stdev=127.37, samples=45 iops : min= 7, max= 38, avg=16.84, stdev= 8.24, samples=45 lat (msec) : 4=0.78%, 10=13.41%, 20=18.49%, 50=53.91%, 100=12.89% lat (msec) : 250=0.52% cpu : usr=0.08%, sys=12.90%, ctx=1989, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156573: Tue Apr 28 20:33:46 2026 read: IOPS=17, BW=273KiB/s (280kB/s)(6256KiB/22919msec) clat (msec): min=3, max=128, avg=21.39, stdev=18.89 lat (msec): min=3, max=128, avg=21.40, stdev=18.89 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 61], | 99.00th=[ 97], 99.50th=[ 108], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 94, max= 768, per=26.38%, avg=274.09, stdev=150.69, samples=45 iops : min= 5, max= 48, avg=16.51, stdev= 9.65, samples=45 write: IOPS=16, BW=263KiB/s (270kB/s)(6032KiB/22919msec); 0 zone resets clat (msec): min=13, max=112, avg=38.53, stdev=18.26 lat (msec): min=13, max=112, avg=38.54, stdev=18.26 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 45], 80.00th=[ 53], 90.00th=[ 64], 95.00th=[ 79], | 99.00th=[ 101], 99.50th=[ 110], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 94, max= 576, per=23.77%, avg=259.76, stdev=120.84, samples=45 iops : min= 5, max= 36, avg=15.62, stdev= 7.87, samples=45 lat (msec) : 4=0.39%, 10=13.67%, 20=21.74%, 50=48.44%, 100=14.97% lat (msec) : 250=0.78% cpu : usr=0.10%, sys=13.08%, ctx=2005, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156574: Tue Apr 28 20:33:46 2026 read: IOPS=16, BW=263KiB/s (269kB/s)(6032KiB/22925msec) clat (usec): min=3680, max=96809, avg=22078.98, stdev=17981.22 lat (usec): min=3681, max=96810, avg=22080.17, stdev=17981.14 clat percentiles (usec): | 1.00th=[ 4047], 5.00th=[ 4948], 10.00th=[ 5866], 20.00th=[ 8160], | 30.00th=[10421], 40.00th=[13042], 50.00th=[16319], 60.00th=[21103], | 70.00th=[26346], 80.00th=[33424], 90.00th=[41157], 95.00th=[59507], | 99.00th=[91751], 99.50th=[95945], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 94, max= 640, per=25.02%, avg=260.00, stdev=135.73, samples=45 iops : min= 5, max= 40, avg=15.62, stdev= 8.76, samples=45 write: IOPS=17, BW=273KiB/s (279kB/s)(6256KiB/22925msec); 0 zone resets clat (msec): min=13, max=166, avg=37.21, stdev=18.95 lat (msec): min=13, max=166, avg=37.22, stdev=18.95 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 49], 90.00th=[ 61], 95.00th=[ 75], | 99.00th=[ 110], 99.50th=[ 122], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 94, max= 608, per=24.86%, avg=271.76, stdev=126.40, samples=45 iops : min= 5, max= 38, avg=16.38, stdev= 8.15, samples=45 lat (msec) : 4=0.26%, 10=13.41%, 20=18.88%, 50=54.43%, 100=12.11% lat (msec) : 250=0.91% cpu : usr=0.10%, sys=13.03%, ctx=1953, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1039KiB/s (1064kB/s), 249KiB/s-273KiB/s (255kB/s-280kB/s), io=23.4MiB (24.5MB), run=22919-23045msec WRITE: bw=1094KiB/s (1120kB/s), 263KiB/s-284KiB/s (270kB/s-291kB/s), io=24.6MiB (25.8MB), run=22919-23045msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156587: Tue Apr 28 20:33:55 2026 read: IOPS=2, BW=2658KiB/s (2722kB/s)(7168KiB/2697msec) clat (msec): min=75, max=370, avg=157.27, stdev=105.84 lat (msec): min=75, max=370, avg=157.27, stdev=105.84 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 96], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 107], 60.00th=[ 126], | 70.00th=[ 126], 80.00th=[ 226], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2048, max= 5260, per=70.76%, avg=3798.33, stdev=1625.34, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1898KiB/s (1944kB/s)(5120KiB/2697msec); 0 zone resets clat (msec): min=208, max=427, avg=309.74, stdev=94.99 lat (msec): min=208, max=427, avg=309.81, stdev=95.00 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1753, max= 3930, per=31.98%, avg=2403.25, stdev=1024.97, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=33.33% cpu : usr=0.11%, sys=21.51%, ctx=139, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156588: Tue Apr 28 20:33:55 2026 read: IOPS=0, BW=537KiB/s (550kB/s)(2048KiB/3815msec) clat (msec): min=98, max=401, avg=250.27, stdev=213.97 lat (msec): min=98, max=401, avg=250.27, stdev=213.97 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 1738, max= 2048, per=35.26%, avg=1893.00, stdev=219.20, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2684KiB/s (2749kB/s)(10.0MiB/3815msec); 0 zone resets clat (msec): min=47, max=777, avg=328.60, stdev=266.54 lat (msec): min=47, max=777, avg=328.69, stdev=266.54 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 51], | 30.00th=[ 136], 40.00th=[ 155], 50.00th=[ 176], 60.00th=[ 368], | 70.00th=[ 376], 80.00th=[ 464], 90.00th=[ 743], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1738, max= 4096, per=36.43%, avg=2737.80, stdev=1101.81, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=16.75%, ctx=322, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156589: Tue Apr 28 20:33:55 2026 read: IOPS=1, BW=1734KiB/s (1776kB/s)(6144KiB/3543msec) clat (msec): min=74, max=426, avg=224.86, stdev=145.37 lat (msec): min=74, max=426, avg=224.86, stdev=145.37 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 257], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2048, max= 3930, per=49.84%, avg=2675.33, stdev=1086.57, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 write: IOPS=1, BW=1734KiB/s (1776kB/s)(6144KiB/3543msec); 0 zone resets clat (msec): min=80, max=979, avg=363.22, stdev=333.53 lat (msec): min=80, max=979, avg=363.29, stdev=333.54 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 368], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1882, max= 3488, per=32.90%, avg=2472.67, stdev=883.21, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, 1000=8.33% cpu : usr=0.08%, sys=17.79%, ctx=216, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156590: Tue Apr 28 20:33:55 2026 read: IOPS=1, BW=1732KiB/s (1774kB/s)(5120KiB/2956msec) clat (msec): min=118, max=556, avg=237.06, stdev=181.76 lat (msec): min=118, max=556, avg=237.06, stdev=181.76 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 3764, max= 3930, per=71.67%, avg=3847.00, stdev=117.38, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2425KiB/s (2483kB/s)(7168KiB/2956msec); 0 zone resets clat (msec): min=69, max=440, avg=247.58, stdev=158.15 lat (msec): min=69, max=440, avg=247.66, stdev=158.13 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 101], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 192], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 405], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2048, max= 4087, per=42.74%, avg=3211.67, stdev=1049.63, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=15.57%, ctx=131, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5368KiB/s (5497kB/s), 537KiB/s-2658KiB/s (550kB/s-2722kB/s), io=20.0MiB (20.0MB), run=2697-3815msec WRITE: bw=7516KiB/s (7696kB/s), 1734KiB/s-2684KiB/s (1776kB/s-2749kB/s), io=28.0MiB (29.4MB), run=2697-3815msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156592: Tue Apr 28 20:33:55 2026 read: IOPS=2, BW=2436KiB/s (2494kB/s)(7168KiB/2943msec) clat (msec): min=149, max=320, avg=227.02, stdev=61.92 lat (msec): min=149, max=320, avg=227.03, stdev=61.92 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 157], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 243], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 1815, max= 4063, per=52.19%, avg=2977.00, stdev=1229.16, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1740KiB/s (1781kB/s)(5120KiB/2943msec); 0 zone resets clat (msec): min=202, max=273, avg=245.30, stdev=28.16 lat (msec): min=202, max=273, avg=245.37, stdev=28.15 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2007, max= 4096, per=33.88%, avg=2706.00, stdev=1203.78, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=50.00%, 500=50.00% cpu : usr=0.00%, sys=52.28%, ctx=1307, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156593: Tue Apr 28 20:33:55 2026 read: IOPS=0, BW=570KiB/s (584kB/s)(2048KiB/3590msec) clat (usec): min=1043, max=458983, avg=230013.52, stdev=323812.73 lat (usec): min=1044, max=458986, avg=230015.86, stdev=323813.78 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[459277], | 70.00th=[459277], 80.00th=[459277], 90.00th=[459277], 95.00th=[459277], | 99.00th=[459277], 99.50th=[459277], 99.90th=[459277], 99.95th=[459277], | 99.99th=[459277] bw ( KiB/s): min= 2007, max= 2015, per=35.26%, avg=2011.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2852KiB/s (2921kB/s)(10.0MiB/3590msec); 0 zone resets clat (msec): min=154, max=519, avg=302.42, stdev=133.98 lat (msec): min=154, max=519, avg=302.49, stdev=133.98 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 165], | 30.00th=[ 203], 40.00th=[ 218], 50.00th=[ 228], 60.00th=[ 321], | 70.00th=[ 334], 80.00th=[ 376], 90.00th=[ 514], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 2015, max= 4096, per=46.00%, avg=3673.20, stdev=927.07, samples=5 iops : min= 1, max= 4, avg= 3.20, stdev= 1.30, samples=5 lat (msec) : 2=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.08%, sys=45.17%, ctx=336, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156594: Tue Apr 28 20:33:55 2026 read: IOPS=2, BW=2173KiB/s (2225kB/s)(6144KiB/2827msec) clat (usec): min=742, max=260298, avg=49521.23, stdev=104083.88 lat (usec): min=742, max=260299, avg=49522.18, stdev=104083.96 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 840], | 30.00th=[ 840], 40.00th=[ 857], 50.00th=[ 857], 60.00th=[ 873], | 70.00th=[ 33424], 80.00th=[ 33424], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 2015, max= 8192, per=89.47%, avg=5103.50, stdev=4367.80, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 write: IOPS=2, BW=2173KiB/s (2225kB/s)(6144KiB/2827msec); 0 zone resets clat (msec): min=137, max=998, avg=399.29, stdev=315.48 lat (msec): min=137, max=998, avg=399.34, stdev=315.48 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 334], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 4015, max= 4096, per=50.68%, avg=4047.33, stdev=42.90, samples=3 iops : min= 3, max= 4, avg= 3.33, stdev= 0.58, samples=3 lat (usec) : 750=8.33%, 1000=25.00% lat (msec) : 50=8.33%, 250=16.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=36.31%, ctx=303, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156595: Tue Apr 28 20:33:55 2026 read: IOPS=1, BW=1610KiB/s (1648kB/s)(5120KiB/3181msec) clat (usec): min=884, max=209654, avg=109919.29, stdev=102133.52 lat (usec): min=885, max=209655, avg=109920.54, stdev=102133.53 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 881], | 30.00th=[ 1844], 40.00th=[ 1844], 50.00th=[143655], 60.00th=[143655], | 70.00th=[193987], 80.00th=[193987], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2253KiB/s (2307kB/s)(7168KiB/3181msec); 0 zone resets clat (msec): min=157, max=853, avg=370.49, stdev=260.85 lat (msec): min=157, max=853, avg=370.71, stdev=261.03 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 203], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 245], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 617], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1762, max= 4096, per=37.52%, avg=2996.25, stdev=1274.62, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.06%, sys=42.45%, ctx=414, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5705KiB/s (5842kB/s), 570KiB/s-2436KiB/s (584kB/s-2494kB/s), io=20.0MiB (20.0MB), run=2827-3590msec WRITE: bw=7987KiB/s (8178kB/s), 1740KiB/s-2852KiB/s (1781kB/s-2921kB/s), io=28.0MiB (29.4MB), run=2827-3590msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156604: Tue Apr 28 20:34:04 2026 read: IOPS=1, BW=6427KiB/s (6581kB/s)(12.0MiB/1912msec) clat (msec): min=547, max=735, avg=610.87, stdev=107.99 lat (msec): min=547, max=735, avg=610.87, stdev=107.99 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8192, max= 8192, per=95.60%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=61.17%, ctx=2616, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156606: Tue Apr 28 20:34:04 2026 read: IOPS=0, BW=2160KiB/s (2212kB/s)(4096KiB/1896msec) clat (nsec): min=707549k, max=707549k, avg=707548528.00, stdev= 0.00 lat (nsec): min=707550k, max=707550k, avg=707549836.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8192, max= 8192, per=95.60%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4321KiB/s (4424kB/s)(8192KiB/1896msec); 0 zone resets clat (msec): min=426, max=736, avg=581.61, stdev=219.54 lat (msec): min=426, max=737, avg=581.97, stdev=219.53 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8192, max= 8192, per=67.30%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=27.97%, ctx=468, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156607: Tue Apr 28 20:34:04 2026 write: IOPS=1, BW=4565KiB/s (4674kB/s)(12.0MiB/2692msec); 0 zone resets clat (msec): min=212, max=2115, avg=885.14, stdev=1067.19 lat (msec): min=213, max=2115, avg=885.53, stdev=1067.12 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8159, max= 8192, per=67.17%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=14.16%, ctx=75, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156609: Tue Apr 28 20:34:04 2026 write: IOPS=1, BW=5069KiB/s (5191kB/s)(12.0MiB/2424msec); 0 zone resets clat (msec): min=214, max=1910, avg=794.47, stdev=966.67 lat (msec): min=214, max=1910, avg=794.82, stdev=966.68 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min=11770, max=11770, per=96.70%, avg=11770.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.72%, ctx=98, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8569KiB/s (8775kB/s), 2160KiB/s-6427KiB/s (2212kB/s-6581kB/s), io=16.0MiB (16.8MB), run=1896-1912msec WRITE: bw=11.9MiB/s (12.5MB/s), 4321KiB/s-5069KiB/s (4424kB/s-5191kB/s), io=32.0MiB (33.6MB), run=1896-2692msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156602: Tue Apr 28 20:34:04 2026 read: IOPS=1, BW=6282KiB/s (6433kB/s)(12.0MiB/1956msec) clat (msec): min=524, max=810, avg=626.79, stdev=159.58 lat (msec): min=524, max=810, avg=626.80, stdev=159.58 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=23.07%, ctx=94, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156603: Tue Apr 28 20:34:04 2026 read: IOPS=0, BW=1524KiB/s (1560kB/s)(4096KiB/2688msec) clat (nsec): min=1871.4M, max=1871.4M, avg=1871428281.00, stdev= 0.00 lat (nsec): min=1871.4M, max=1871.4M, avg=1871430121.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1871], 5.00th=[ 1871], 10.00th=[ 1871], 20.00th=[ 1871], | 30.00th=[ 1871], 40.00th=[ 1871], 50.00th=[ 1871], 60.00th=[ 1871], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3048KiB/s (3121kB/s)(8192KiB/2688msec); 0 zone resets clat (msec): min=269, max=479, avg=374.39, stdev=148.30 lat (msec): min=269, max=479, avg=374.64, stdev=148.19 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 8192, max= 8192, per=67.28%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.89%, ctx=89, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156605: Tue Apr 28 20:34:04 2026 write: IOPS=1, BW=4955KiB/s (5074kB/s)(12.0MiB/2480msec); 0 zone resets clat (msec): min=324, max=1316, avg=807.36, stdev=496.67 lat (msec): min=324, max=1317, avg=807.68, stdev=496.64 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8192, max= 8192, per=67.28%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=17.95%, ctx=106, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156608: Tue Apr 28 20:34:04 2026 write: IOPS=1, BW=4566KiB/s (4676kB/s)(12.0MiB/2691msec); 0 zone resets clat (msec): min=218, max=1816, avg=881.31, stdev=833.55 lat (msec): min=218, max=1817, avg=881.74, stdev=833.52 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 5793, max= 8175, per=57.36%, avg=6984.00, stdev=1684.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.24%, ctx=100, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6095KiB/s (6242kB/s), 1524KiB/s-6282KiB/s (1560kB/s-6433kB/s), io=16.0MiB (16.8MB), run=1956-2688msec WRITE: bw=11.9MiB/s (12.5MB/s), 3048KiB/s-4955KiB/s (3121kB/s-5074kB/s), io=32.0MiB (33.6MB), run=2480-2691msec