== sanity test 398b: DIO and buffer IO race ============== 21:21:56 (1773105716) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.79748 s, 13.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183524: Mon Mar 9 21:23:27 2026 read: IOPS=19, BW=76.5KiB/s (78.3kB/s)(5992KiB/78312msec) clat (usec): min=51, max=917808, avg=27683.11, stdev=27195.54 lat (usec): min=53, max=917810, avg=27684.18, stdev=27195.62 clat percentiles (usec): | 1.00th=[ 125], 5.00th=[ 9765], 10.00th=[ 11994], 20.00th=[ 15401], | 30.00th=[ 18744], 40.00th=[ 21103], 50.00th=[ 24511], 60.00th=[ 27919], | 70.00th=[ 32637], 80.00th=[ 37487], 90.00th=[ 46400], 95.00th=[ 52691], | 99.00th=[ 74974], 99.50th=[ 80217], 99.90th=[124257], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 14, max= 128, per=25.56%, avg=76.43, stdev=22.83, samples=154 iops : min= 3, max= 32, avg=18.61, stdev= 5.82, samples=154 write: IOPS=20, BW=80.4KiB/s (82.3kB/s)(6296KiB/78312msec); 0 zone resets clat (usec): min=795, max=139526, avg=23233.54, stdev=18139.31 lat (usec): min=795, max=139528, avg=23234.89, stdev=18139.46 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 3097], 10.00th=[ 4228], 20.00th=[ 6915], | 30.00th=[ 10683], 40.00th=[ 15008], 50.00th=[ 19268], 60.00th=[ 23725], | 70.00th=[ 30016], 80.00th=[ 36963], 90.00th=[ 47449], 95.00th=[ 57410], | 99.00th=[ 82314], 99.50th=[ 95945], 99.90th=[112722], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 31, max= 168, per=25.83%, avg=80.86, stdev=24.47, samples=153 iops : min= 7, max= 42, avg=19.72, stdev= 6.21, samples=153 lat (usec) : 100=0.23%, 250=0.72%, 500=0.33%, 1000=0.07% lat (msec) : 2=0.85%, 4=3.68%, 10=11.17%, 20=26.50%, 50=48.93% lat (msec) : 100=7.26%, 250=0.26%, 1000=0.03% cpu : usr=0.11%, sys=22.05%, ctx=10169, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183525: Mon Mar 9 21:23:27 2026 read: IOPS=19, BW=76.8KiB/s (78.6kB/s)(5940KiB/77338msec) clat (usec): min=40, max=133265, avg=27151.43, stdev=14863.68 lat (usec): min=41, max=133266, avg=27152.65, stdev=14863.60 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 9241], 10.00th=[ 12256], 20.00th=[ 15401], | 30.00th=[ 18482], 40.00th=[ 21365], 50.00th=[ 25035], 60.00th=[ 28181], | 70.00th=[ 32375], 80.00th=[ 37487], 90.00th=[ 44303], 95.00th=[ 53216], | 99.00th=[ 76022], 99.50th=[ 85459], 99.90th=[132645], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 7, max= 151, per=25.66%, avg=76.72, stdev=25.02, samples=152 iops : min= 1, max= 37, avg=18.67, stdev= 6.32, samples=152 write: IOPS=20, BW=82.1KiB/s (84.1kB/s)(6348KiB/77338msec); 0 zone resets clat (usec): min=985, max=868775, avg=23171.22, stdev=27834.84 lat (usec): min=986, max=868776, avg=23172.49, stdev=27834.77 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 3097], 10.00th=[ 4146], 20.00th=[ 6325], | 30.00th=[ 10028], 40.00th=[ 15008], 50.00th=[ 18744], 60.00th=[ 22938], | 70.00th=[ 28443], 80.00th=[ 35390], 90.00th=[ 46924], 95.00th=[ 56886], | 99.00th=[ 82314], 99.50th=[ 85459], 99.90th=[141558], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 175, per=26.12%, avg=81.75, stdev=28.23, samples=152 iops : min= 1, max= 43, avg=19.93, stdev= 7.14, samples=152 lat (usec) : 50=0.07%, 100=0.39%, 250=0.68%, 500=0.29%, 1000=0.03% lat (msec) : 2=0.98%, 4=3.87%, 10=12.11%, 20=26.17%, 50=48.18% lat (msec) : 100=6.97%, 250=0.23%, 1000=0.03% cpu : usr=0.10%, sys=22.07%, ctx=10028, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183526: Mon Mar 9 21:23:27 2026 read: IOPS=18, BW=75.2KiB/s (76.0kB/s)(6028KiB/80202msec) clat (usec): min=50, max=163516, avg=28171.47, stdev=16612.32 lat (usec): min=51, max=163518, avg=28172.63, stdev=16612.39 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 9110], 10.00th=[ 11731], 20.00th=[ 15401], | 30.00th=[ 18482], 40.00th=[ 21890], 50.00th=[ 25560], 60.00th=[ 28967], | 70.00th=[ 33817], 80.00th=[ 39584], 90.00th=[ 47449], 95.00th=[ 55837], | 99.00th=[ 82314], 99.50th=[ 98042], 99.90th=[156238], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 31, max= 200, per=25.22%, avg=75.40, stdev=24.24, samples=157 iops : min= 7, max= 50, avg=18.36, stdev= 6.16, samples=157 write: IOPS=19, BW=78.1KiB/s (79.9kB/s)(6260KiB/80202msec); 0 zone resets clat (usec): min=888, max=896291, avg=23955.30, stdev=28239.38 lat (usec): min=889, max=896292, avg=23957.12, stdev=28239.74 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2999], 10.00th=[ 3949], 20.00th=[ 6718], | 30.00th=[ 11600], 40.00th=[ 15926], 50.00th=[ 19792], 60.00th=[ 24773], | 70.00th=[ 30278], 80.00th=[ 36963], 90.00th=[ 47973], 95.00th=[ 58459], | 99.00th=[ 78119], 99.50th=[ 85459], 99.90th=[113771], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 23, max= 216, per=24.95%, avg=78.11, stdev=26.59, samples=157 iops : min= 5, max= 54, avg=19.04, stdev= 6.71, samples=157 lat (usec) : 100=0.42%, 250=0.94%, 500=0.10%, 1000=0.10% lat (msec) : 2=1.01%, 4=4.20%, 10=10.48%, 20=24.97%, 50=49.35% lat (msec) : 100=8.11%, 250=0.29%, 1000=0.03% cpu : usr=0.09%, sys=21.30%, ctx=10151, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183528: Mon Mar 9 21:23:27 2026 read: IOPS=19, BW=76.7KiB/s (78.6kB/s)(6052KiB/78859msec) clat (usec): min=43, max=116744, avg=28223.54, stdev=16021.73 lat (usec): min=44, max=116745, avg=28227.12, stdev=16023.38 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 9241], 10.00th=[ 12256], 20.00th=[ 15533], | 30.00th=[ 18482], 40.00th=[ 21627], 50.00th=[ 25822], 60.00th=[ 29492], | 70.00th=[ 33817], 80.00th=[ 39584], 90.00th=[ 47973], 95.00th=[ 56361], | 99.00th=[ 80217], 99.50th=[ 93848], 99.90th=[113771], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 31, max= 144, per=25.78%, avg=77.08, stdev=20.47, samples=154 iops : min= 7, max= 36, avg=18.77, stdev= 5.21, samples=154 write: IOPS=19, BW=79.1KiB/s (80.0kB/s)(6236KiB/78859msec); 0 zone resets clat (usec): min=915, max=903463, avg=23026.51, stdev=28528.86 lat (usec): min=916, max=903465, avg=23027.91, stdev=28528.79 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2737], 10.00th=[ 3785], 20.00th=[ 5800], | 30.00th=[ 9503], 40.00th=[ 13960], 50.00th=[ 18744], 60.00th=[ 23200], | 70.00th=[ 29492], 80.00th=[ 37487], 90.00th=[ 46924], 95.00th=[ 56361], | 99.00th=[ 73925], 99.50th=[ 91751], 99.90th=[114820], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 160, per=25.43%, avg=79.61, stdev=29.11, samples=154 iops : min= 1, max= 40, avg=19.41, stdev= 7.38, samples=154 lat (usec) : 50=0.03%, 100=0.62%, 250=0.98%, 500=0.23%, 1000=0.03% lat (msec) : 2=1.66%, 4=4.07%, 10=10.97%, 20=25.46%, 50=47.23% lat (msec) : 100=8.37%, 250=0.33%, 1000=0.03% cpu : usr=0.08%, sys=21.45%, ctx=10000, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=299KiB/s (307kB/s), 75.2KiB/s-76.8KiB/s (76.0kB/s-78.6kB/s), io=23.4MiB (24.6MB), run=77338-80202msec WRITE: bw=313KiB/s (321kB/s), 78.1KiB/s-82.1KiB/s (79.9kB/s-84.1kB/s), io=24.6MiB (25.7MB), run=77338-80202msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183527: Mon Mar 9 21:23:39 2026 read: IOPS=16, BW=65.8KiB/s (67.4kB/s)(5992KiB/91070msec) clat (msec): min=3, max=923, avg=25.28, stdev=30.19 lat (msec): min=3, max=923, avg=25.29, stdev=30.19 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 52], 95.00th=[ 65], | 99.00th=[ 94], 99.50th=[ 102], 99.90th=[ 138], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 256, per=25.36%, avg=66.20, stdev=44.39, samples=179 iops : min= 1, max= 64, avg=16.09, stdev=11.18, samples=179 write: IOPS=17, BW=69.1KiB/s (70.8kB/s)(6296KiB/91070msec); 0 zone resets clat (msec): min=6, max=196, avg=33.65, stdev=22.68 lat (msec): min=6, max=196, avg=33.65, stdev=22.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 64], 95.00th=[ 78], | 99.00th=[ 103], 99.50th=[ 116], 99.90th=[ 186], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 15, max= 240, per=25.38%, avg=69.54, stdev=44.64, samples=179 iops : min= 3, max= 60, avg=16.93, stdev=11.24, samples=179 lat (msec) : 4=0.03%, 10=12.89%, 20=31.84%, 50=39.03%, 100=15.33% lat (msec) : 250=0.85%, 1000=0.03% cpu : usr=0.09%, sys=11.30%, ctx=6870, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183529: Mon Mar 9 21:23:39 2026 read: IOPS=16, BW=65.1KiB/s (66.7kB/s)(5940KiB/91234msec) clat (msec): min=3, max=882, avg=25.18, stdev=30.46 lat (msec): min=3, max=882, avg=25.18, stdev=30.47 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 36], 90.00th=[ 52], 95.00th=[ 67], | 99.00th=[ 109], 99.50th=[ 118], 99.90th=[ 176], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 264, per=25.04%, avg=65.35, stdev=46.31, samples=179 iops : min= 1, max= 66, avg=15.88, stdev=11.67, samples=179 write: IOPS=17, BW=69.6KiB/s (71.2kB/s)(6348KiB/91234msec); 0 zone resets clat (msec): min=6, max=195, avg=33.78, stdev=23.13 lat (msec): min=6, max=195, avg=33.78, stdev=23.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 79], | 99.00th=[ 115], 99.50th=[ 130], 99.90th=[ 163], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 23, max= 216, per=25.45%, avg=69.73, stdev=44.91, samples=179 iops : min= 5, max= 54, avg=16.98, stdev=11.32, samples=179 lat (msec) : 4=0.03%, 10=13.70%, 20=31.05%, 50=39.75%, 100=14.16% lat (msec) : 250=1.27%, 1000=0.03% cpu : usr=0.10%, sys=11.11%, ctx=6724, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183530: Mon Mar 9 21:23:39 2026 read: IOPS=16, BW=66.1KiB/s (67.7kB/s)(6028KiB/91139msec) clat (msec): min=3, max=190, avg=24.82, stdev=20.80 lat (msec): min=3, max=190, avg=24.83, stdev=20.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 37], 90.00th=[ 51], 95.00th=[ 68], | 99.00th=[ 103], 99.50th=[ 116], 99.90th=[ 165], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 15, max= 255, per=25.47%, avg=66.46, stdev=45.83, samples=179 iops : min= 3, max= 63, avg=16.16, stdev=11.52, samples=179 write: IOPS=17, BW=68.7KiB/s (70.3kB/s)(6260KiB/91139msec); 0 zone resets clat (msec): min=6, max=893, avg=34.18, stdev=30.70 lat (msec): min=6, max=893, avg=34.19, stdev=30.71 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 74], | 99.00th=[ 101], 99.50th=[ 113], 99.90th=[ 186], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 15, max= 216, per=25.20%, avg=69.06, stdev=43.93, samples=179 iops : min= 3, max= 54, avg=16.81, stdev=11.09, samples=179 lat (msec) : 4=0.07%, 10=13.54%, 20=30.40%, 50=40.46%, 100=14.42% lat (msec) : 250=1.07%, 1000=0.03% cpu : usr=0.09%, sys=11.24%, ctx=6835, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183531: Mon Mar 9 21:23:39 2026 read: IOPS=16, BW=65.0KiB/s (67.6kB/s)(6052KiB/91707msec) clat (msec): min=3, max=184, avg=25.03, stdev=21.34 lat (msec): min=3, max=184, avg=25.03, stdev=21.34 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 52], 95.00th=[ 70], | 99.00th=[ 104], 99.50th=[ 121], 99.90th=[ 159], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 8, max= 264, per=25.31%, avg=66.07, stdev=45.31, samples=179 iops : min= 2, max= 66, avg=16.07, stdev=11.43, samples=179 write: IOPS=16, BW=67.0KiB/s (69.6kB/s)(6236KiB/91707msec); 0 zone resets clat (msec): min=5, max=895, avg=34.38, stdev=31.57 lat (msec): min=5, max=895, avg=34.38, stdev=31.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 22], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 65], 95.00th=[ 79], | 99.00th=[ 112], 99.50th=[ 125], 99.90th=[ 159], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 15, max= 240, per=24.74%, avg=67.78, stdev=45.51, samples=180 iops : min= 3, max= 60, avg=16.49, stdev=11.46, samples=180 lat (msec) : 4=0.36%, 10=14.65%, 20=30.60%, 50=38.09%, 100=14.91% lat (msec) : 250=1.37%, 1000=0.03% cpu : usr=0.09%, sys=11.07%, ctx=6778, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=262KiB/s (268kB/s), 65.1KiB/s-66.1KiB/s (66.7kB/s-67.7kB/s), io=23.4MiB (24.6MB), run=91070-91707msec WRITE: bw=274KiB/s (281kB/s), 67.0KiB/s-69.6KiB/s (69.6kB/s-71.2kB/s), io=24.6MiB (25.7MB), run=91070-91707msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183560: Mon Mar 9 21:24:06 2026 read: IOPS=18, BW=299KiB/s (306kB/s)(5920KiB/19821msec) clat (usec): min=54, max=115207, avg=26832.11, stdev=16602.63 lat (usec): min=55, max=115209, avg=26833.02, stdev=16602.68 clat percentiles (usec): | 1.00th=[ 71], 5.00th=[ 133], 10.00th=[ 10683], 20.00th=[ 15926], | 30.00th=[ 19268], 40.00th=[ 21627], 50.00th=[ 24249], 60.00th=[ 27395], | 70.00th=[ 32637], 80.00th=[ 37487], 90.00th=[ 45876], 95.00th=[ 52691], | 99.00th=[ 79168], 99.50th=[110625], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 128, max= 557, per=24.50%, avg=295.97, stdev=87.87, samples=39 iops : min= 8, max= 34, avg=17.79, stdev= 5.49, samples=39 write: IOPS=20, BW=321KiB/s (329kB/s)(6368KiB/19821msec); 0 zone resets clat (usec): min=1829, max=95851, avg=24679.63, stdev=17134.33 lat (usec): min=1831, max=95853, avg=24682.01, stdev=17134.08 clat percentiles (usec): | 1.00th=[ 2606], 5.00th=[ 5342], 10.00th=[ 6390], 20.00th=[ 8717], | 30.00th=[12780], 40.00th=[16188], 50.00th=[21365], 60.00th=[25560], | 70.00th=[30802], 80.00th=[38536], 90.00th=[48497], 95.00th=[58459], | 99.00th=[76022], 99.50th=[84411], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 63, max= 613, per=25.20%, avg=320.31, stdev=109.64, samples=39 iops : min= 3, max= 38, avg=19.33, stdev= 6.87, samples=39 lat (usec) : 100=0.78%, 250=2.99%, 500=0.91% lat (msec) : 2=0.13%, 4=1.04%, 10=10.81%, 20=24.22%, 50=51.69% lat (msec) : 100=7.03%, 250=0.39% cpu : usr=0.06%, sys=25.82%, ctx=2918, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183561: Mon Mar 9 21:24:06 2026 read: IOPS=18, BW=293KiB/s (300kB/s)(5744KiB/19575msec) clat (usec): min=56, max=130399, avg=27795.38, stdev=15189.29 lat (usec): min=57, max=130400, avg=27797.47, stdev=15188.46 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 10290], 10.00th=[ 13566], 20.00th=[ 17171], | 30.00th=[ 19792], 40.00th=[ 21627], 50.00th=[ 24511], 60.00th=[ 28443], | 70.00th=[ 32637], 80.00th=[ 37487], 90.00th=[ 47449], 95.00th=[ 53740], | 99.00th=[ 74974], 99.50th=[ 98042], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 95, max= 475, per=24.17%, avg=291.95, stdev=86.26, samples=38 iops : min= 5, max= 29, avg=17.55, stdev= 5.45, samples=38 write: IOPS=20, BW=334KiB/s (342kB/s)(6544KiB/19575msec); 0 zone resets clat (usec): min=1637, max=94475, avg=23322.77, stdev=16949.84 lat (usec): min=1639, max=94476, avg=23324.42, stdev=16949.85 clat percentiles (usec): | 1.00th=[ 3720], 5.00th=[ 5211], 10.00th=[ 6194], 20.00th=[ 8160], | 30.00th=[10945], 40.00th=[14615], 50.00th=[19268], 60.00th=[24511], | 70.00th=[29754], 80.00th=[34866], 90.00th=[47449], 95.00th=[52691], | 99.00th=[76022], 99.50th=[85459], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 128, max= 696, per=25.65%, avg=326.00, stdev=111.56, samples=38 iops : min= 8, max= 43, avg=19.68, stdev= 6.99, samples=38 lat (usec) : 100=0.39%, 250=1.30%, 500=0.13% lat (msec) : 2=0.13%, 4=0.78%, 10=13.54%, 20=25.39%, 50=50.91% lat (msec) : 100=7.29%, 250=0.13% cpu : usr=0.09%, sys=25.79%, ctx=2976, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183562: Mon Mar 9 21:24:06 2026 read: IOPS=19, BW=317KiB/s (325kB/s)(6256KiB/19741msec) clat (usec): min=69, max=129663, avg=27367.04, stdev=15224.58 lat (usec): min=70, max=129664, avg=27367.97, stdev=15224.62 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 351], 10.00th=[ 12780], 20.00th=[ 16712], | 30.00th=[ 19268], 40.00th=[ 22152], 50.00th=[ 25035], 60.00th=[ 27919], | 70.00th=[ 31851], 80.00th=[ 38011], 90.00th=[ 44303], 95.00th=[ 53216], | 99.00th=[ 82314], 99.50th=[ 87557], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 128, max= 669, per=26.28%, avg=317.44, stdev=110.04, samples=39 iops : min= 8, max= 41, avg=19.13, stdev= 6.84, samples=39 write: IOPS=19, BW=306KiB/s (313kB/s)(6032KiB/19741msec); 0 zone resets clat (usec): min=2257, max=92722, avg=23864.53, stdev=16586.31 lat (usec): min=2257, max=92723, avg=23866.80, stdev=16586.09 clat percentiles (usec): | 1.00th=[ 3589], 5.00th=[ 5538], 10.00th=[ 6390], 20.00th=[ 9241], | 30.00th=[12649], 40.00th=[16712], 50.00th=[20579], 60.00th=[24511], | 70.00th=[28705], 80.00th=[36439], 90.00th=[46924], 95.00th=[57934], | 99.00th=[81265], 99.50th=[90702], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 159, max= 611, per=23.79%, avg=302.31, stdev=105.51, samples=39 iops : min= 9, max= 38, avg=18.21, stdev= 6.66, samples=39 lat (usec) : 100=0.39%, 250=1.95%, 500=0.26% lat (msec) : 4=0.65%, 10=10.81%, 20=26.04%, 50=52.73%, 100=7.03% lat (msec) : 250=0.13% cpu : usr=0.09%, sys=25.60%, ctx=3060, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183563: Mon Mar 9 21:24:06 2026 read: IOPS=19, BW=320KiB/s (327kB/s)(6032KiB/18864msec) clat (usec): min=38, max=101423, avg=25670.23, stdev=16707.67 lat (usec): min=39, max=101424, avg=25671.10, stdev=16707.70 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 120], 10.00th=[ 322], 20.00th=[ 15008], | 30.00th=[ 17695], 40.00th=[ 20317], 50.00th=[ 22676], 60.00th=[ 26870], | 70.00th=[ 30802], 80.00th=[ 36963], 90.00th=[ 46924], 95.00th=[ 56361], | 99.00th=[ 83362], 99.50th=[ 95945], 99.90th=[101188], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 159, max= 576, per=26.13%, avg=315.70, stdev=90.44, samples=37 iops : min= 9, max= 36, avg=19.05, stdev= 5.77, samples=37 write: IOPS=20, BW=332KiB/s (340kB/s)(6256KiB/18864msec); 0 zone resets clat (usec): min=1350, max=131660, avg=23270.55, stdev=17345.53 lat (usec): min=1352, max=131663, avg=23272.10, stdev=17345.58 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 35], 90.00th=[ 46], 95.00th=[ 57], | 99.00th=[ 79], 99.50th=[ 102], 99.90th=[ 132], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 63, max= 672, per=25.75%, avg=327.32, stdev=120.22, samples=37 iops : min= 3, max= 42, avg=19.78, stdev= 7.58, samples=37 lat (usec) : 50=0.13%, 100=0.91%, 250=3.65%, 500=0.78% lat (msec) : 2=0.26%, 4=1.82%, 10=10.68%, 20=28.13%, 50=46.22% lat (msec) : 100=7.03%, 250=0.39% cpu : usr=0.06%, sys=26.23%, ctx=2714, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1208KiB/s (1237kB/s), 293KiB/s-320KiB/s (300kB/s-327kB/s), io=23.4MiB (24.5MB), run=18864-19821msec WRITE: bw=1271KiB/s (1302kB/s), 306KiB/s-334KiB/s (313kB/s-342kB/s), io=24.6MiB (25.8MB), run=18864-19821msec fio: pid=183565, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=183565: Mon Mar 9 21:24:09 2026 read: IOPS=14, BW=229KiB/s (235kB/s)(4704KiB/20497msec) clat (msec): min=4, max=139, avg=30.01, stdev=20.73 lat (msec): min=4, max=139, avg=30.01, stdev=20.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 69], | 99.00th=[ 121], 99.50th=[ 121], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 94, max= 672, per=22.25%, avg=225.60, stdev=108.31, samples=40 iops : min= 5, max= 42, avg=13.55, stdev= 6.91, samples=40 write: IOPS=15, BW=248KiB/s (254kB/s)(5088KiB/20497msec); 0 zone resets clat (msec): min=8, max=122, avg=36.45, stdev=21.20 lat (msec): min=8, max=122, avg=36.45, stdev=21.20 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 50], 90.00th=[ 67], 95.00th=[ 84], | 99.00th=[ 112], 99.50th=[ 120], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 96, max= 608, per=22.92%, avg=244.60, stdev=85.18, samples=40 iops : min= 6, max= 38, avg=14.75, stdev= 5.48, samples=40 lat (msec) : 10=3.43%, 20=27.73%, 50=51.06%, 100=15.82%, 250=1.79% cpu : usr=0.08%, sys=11.99%, ctx=1504, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=295,318,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183566: Mon Mar 9 21:24:09 2026 read: IOPS=16, BW=256KiB/s (262kB/s)(5744KiB/22408msec) clat (msec): min=3, max=129, avg=25.88, stdev=21.02 lat (msec): min=3, max=129, avg=25.89, stdev=21.02 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 38], 90.00th=[ 56], 95.00th=[ 69], | 99.00th=[ 112], 99.50th=[ 122], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 91, max= 768, per=25.09%, avg=254.36, stdev=151.64, samples=44 iops : min= 5, max= 48, avg=15.39, stdev= 9.77, samples=44 write: IOPS=18, BW=292KiB/s (299kB/s)(6544KiB/22408msec); 0 zone resets clat (msec): min=6, max=133, avg=31.90, stdev=22.21 lat (msec): min=6, max=133, avg=31.90, stdev=22.21 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 48], 90.00th=[ 59], 95.00th=[ 75], | 99.00th=[ 105], 99.50th=[ 118], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 126, max= 864, per=26.83%, avg=286.32, stdev=177.19, samples=44 iops : min= 7, max= 54, avg=17.39, stdev=11.28, samples=44 lat (msec) : 4=0.13%, 10=11.59%, 20=32.55%, 50=40.62%, 100=13.15% lat (msec) : 250=1.95% cpu : usr=0.10%, sys=12.12%, ctx=1784, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183567: Mon Mar 9 21:24:09 2026 read: IOPS=17, BW=281KiB/s (288kB/s)(6256KiB/22234msec) clat (msec): min=4, max=121, avg=24.02, stdev=18.70 lat (msec): min=4, max=121, avg=24.02, stdev=18.70 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 37], 90.00th=[ 48], 95.00th=[ 63], | 99.00th=[ 100], 99.50th=[ 113], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 95, max= 1024, per=27.58%, avg=279.70, stdev=195.54, samples=43 iops : min= 5, max= 64, avg=16.98, stdev=12.39, samples=43 write: IOPS=16, BW=271KiB/s (278kB/s)(6032KiB/22234msec); 0 zone resets clat (msec): min=7, max=122, avg=33.78, stdev=21.88 lat (msec): min=7, max=122, avg=33.78, stdev=21.88 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 68], 95.00th=[ 81], | 99.00th=[ 102], 99.50th=[ 109], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 63, max= 768, per=24.57%, avg=262.12, stdev=153.75, samples=43 iops : min= 3, max= 48, avg=15.86, stdev= 9.83, samples=43 lat (msec) : 10=12.89%, 20=32.03%, 50=40.10%, 100=14.06%, 250=0.91% cpu : usr=0.04%, sys=12.33%, ctx=1879, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183568: Mon Mar 9 21:24:09 2026 read: IOPS=17, BW=272KiB/s (279kB/s)(6032KiB/22163msec) clat (msec): min=3, max=122, avg=25.27, stdev=19.54 lat (msec): min=3, max=122, avg=25.27, stdev=19.54 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 55], 95.00th=[ 68], | 99.00th=[ 91], 99.50th=[ 113], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 95, max= 832, per=26.30%, avg=266.70, stdev=168.63, samples=43 iops : min= 5, max= 52, avg=16.16, stdev=10.72, samples=43 write: IOPS=17, BW=282KiB/s (289kB/s)(6256KiB/22163msec); 0 zone resets clat (msec): min=6, max=133, avg=32.07, stdev=21.65 lat (msec): min=6, max=133, avg=32.07, stdev=21.65 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 84], | 99.00th=[ 108], 99.50th=[ 127], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 127, max= 768, per=26.14%, avg=278.86, stdev=150.87, samples=43 iops : min= 7, max= 48, avg=16.93, stdev= 9.61, samples=43 lat (msec) : 4=0.13%, 10=11.20%, 20=32.16%, 50=42.84%, 100=12.37% lat (msec) : 250=1.30% cpu : usr=0.07%, sys=12.56%, ctx=1833, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1015KiB/s (1039kB/s), 229KiB/s-281KiB/s (235kB/s-288kB/s), io=22.2MiB (23.3MB), run=20497-22408msec WRITE: bw=1067KiB/s (1093kB/s), 248KiB/s-292KiB/s (254kB/s-299kB/s), io=23.4MiB (24.5MB), run=20497-22408msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183576: Mon Mar 9 21:24:20 2026 read: IOPS=2, BW=2073KiB/s (2123kB/s)(7168KiB/3458msec) clat (usec): min=792, max=225654, avg=130499.78, stdev=79646.41 lat (usec): min=793, max=225655, avg=130501.04, stdev=79646.22 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 86508], | 30.00th=[100140], 40.00th=[100140], 50.00th=[107480], 60.00th=[191890], | 70.00th=[191890], 80.00th=[200279], 90.00th=[225444], 95.00th=[225444], | 99.00th=[225444], 99.50th=[225444], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 4096, max= 5314, per=100.00%, avg=4705.00, stdev=861.26, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1481KiB/s (1516kB/s)(5120KiB/3458msec); 0 zone resets clat (msec): min=153, max=1290, avg=505.92, stdev=469.35 lat (msec): min=153, max=1291, avg=506.01, stdev=469.40 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 2011, max= 4096, per=46.92%, avg=2718.33, stdev=1193.24, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=37.29%, ctx=1106, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183577: Mon Mar 9 21:24:20 2026 read: IOPS=0, BW=414KiB/s (424kB/s)(2048KiB/4948msec) clat (usec): min=475, max=1309.9k, avg=655169.29, stdev=925876.67 lat (usec): min=487, max=1309.9k, avg=655176.31, stdev=925869.73 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], | 20.00th=[ 478], 30.00th=[ 478], 40.00th=[ 478], | 50.00th=[ 478], 60.00th=[1317012], 70.00th=[1317012], | 80.00th=[1317012], 90.00th=[1317012], 95.00th=[1317012], | 99.00th=[1317012], 99.50th=[1317012], 99.90th=[1317012], | 99.95th=[1317012], 99.99th=[1317012] bw ( KiB/s): min= 1973, max= 2048, per=48.57%, avg=2010.50, stdev=53.03, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2070KiB/s (2119kB/s)(10.0MiB/4948msec); 0 zone resets clat (msec): min=151, max=807, avg=359.95, stdev=229.67 lat (msec): min=151, max=807, avg=360.01, stdev=229.68 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 194], | 30.00th=[ 211], 40.00th=[ 224], 50.00th=[ 239], 60.00th=[ 241], | 70.00th=[ 305], 80.00th=[ 600], 90.00th=[ 625], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2011, max= 6144, per=56.15%, avg=3253.20, stdev=1829.29, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 1.92, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=8.33%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=34.99%, ctx=622, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183578: Mon Mar 9 21:24:20 2026 read: IOPS=1, BW=1522KiB/s (1559kB/s)(6144KiB/4036msec) clat (usec): min=518, max=305781, avg=187573.17, stdev=109549.93 lat (usec): min=519, max=305783, avg=187574.23, stdev=109549.91 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[158335], | 30.00th=[158335], 40.00th=[164627], 50.00th=[164627], 60.00th=[214959], | 70.00th=[283116], 80.00th=[283116], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2011, max= 3806, per=63.34%, avg=2621.67, stdev=1025.83, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1522KiB/s (1558kB/s)(6144KiB/4037msec); 0 zone resets clat (msec): min=182, max=1597, avg=476.09, stdev=553.46 lat (msec): min=182, max=1597, avg=476.14, stdev=553.47 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 264], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1903, max= 4096, per=43.40%, avg=2514.50, stdev=1056.13, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=38.68%, ctx=488, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183579: Mon Mar 9 21:24:20 2026 read: IOPS=1, BW=1215KiB/s (1244kB/s)(5120KiB/4215msec) clat (usec): min=986, max=248127, avg=131329.75, stdev=119974.01 lat (usec): min=987, max=248128, avg=131330.60, stdev=119973.76 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 988], | 30.00th=[ 2245], 40.00th=[ 2245], 50.00th=[196084], 60.00th=[196084], | 70.00th=[210764], 80.00th=[210764], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 2048, max= 5710, per=93.72%, avg=3879.00, stdev=2589.43, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1701KiB/s (1741kB/s)(7168KiB/4215msec); 0 zone resets clat (msec): min=182, max=1556, avg=501.61, stdev=479.42 lat (msec): min=182, max=1556, avg=501.68, stdev=479.44 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 226], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 405], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 485], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 1903, max= 4096, per=41.79%, avg=2421.20, stdev=938.12, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.22, samples=5 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=34.91%, ctx=426, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4139KiB/s (4238kB/s), 414KiB/s-2073KiB/s (424kB/s-2123kB/s), io=20.0MiB (20.0MB), run=3458-4948msec WRITE: bw=5795KiB/s (5934kB/s), 1481KiB/s-2070KiB/s (1516kB/s-2119kB/s), io=28.0MiB (29.4MB), run=3458-4948msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183581: Mon Mar 9 21:24:20 2026 read: IOPS=1, BW=1580KiB/s (1617kB/s)(7168KiB/4538msec) clat (msec): min=44, max=535, avg=162.58, stdev=168.83 lat (msec): min=44, max=535, avg=162.58, stdev=168.83 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 74], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 106], 60.00th=[ 111], | 70.00th=[ 111], 80.00th=[ 171], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 4079, max= 5242, per=100.00%, avg=4660.50, stdev=822.37, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1128KiB/s (1155kB/s)(5120KiB/4538msec); 0 zone resets clat (msec): min=81, max=1578, avg=662.27, stdev=572.95 lat (msec): min=81, max=1578, avg=662.34, stdev=572.95 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 401], 40.00th=[ 401], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1899, max= 2035, per=34.07%, avg=1951.67, stdev=73.00, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.87%, ctx=144, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183582: Mon Mar 9 21:24:20 2026 read: IOPS=0, BW=409KiB/s (419kB/s)(2048KiB/5005msec) clat (msec): min=55, max=1227, avg=641.58, stdev=828.49 lat (msec): min=55, max=1227, avg=641.58, stdev=828.49 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 56], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 2011, max= 2048, per=49.61%, avg=2029.50, stdev=26.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2046KiB/s (2095kB/s)(10.0MiB/5005msec); 0 zone resets clat (msec): min=30, max=1150, avg=364.65, stdev=351.04 lat (msec): min=30, max=1150, avg=364.72, stdev=351.04 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 59], | 30.00th=[ 142], 40.00th=[ 159], 50.00th=[ 163], 60.00th=[ 305], | 70.00th=[ 388], 80.00th=[ 550], 90.00th=[ 701], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1899, max= 4023, per=42.05%, avg=2408.80, stdev=904.46, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=16.67%, 750=16.67% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=14.47%, ctx=164, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183583: Mon Mar 9 21:24:20 2026 read: IOPS=1, BW=1298KiB/s (1329kB/s)(6144KiB/4734msec) clat (msec): min=77, max=639, avg=246.47, stdev=234.54 lat (msec): min=77, max=639, avg=246.47, stdev=234.54 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 88], 50.00th=[ 88], 60.00th=[ 171], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1899, max= 4096, per=61.36%, avg=2510.25, stdev=1058.83, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1298KiB/s (1329kB/s)(6144KiB/4734msec); 0 zone resets clat (msec): min=71, max=1859, avg=530.13, stdev=662.24 lat (msec): min=71, max=1860, avg=530.19, stdev=662.24 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 355], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 1921, max= 4079, per=52.63%, avg=3014.50, stdev=1197.97, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=33.33%, 250=16.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.04%, ctx=296, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183584: Mon Mar 9 21:24:20 2026 read: IOPS=1, BW=1059KiB/s (1084kB/s)(5120KiB/4837msec) clat (msec): min=53, max=371, avg=188.44, stdev=120.10 lat (msec): min=53, max=371, avg=188.44, stdev=120.10 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2035, max= 6144, per=99.96%, avg=4089.50, stdev=2905.50, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1482KiB/s (1517kB/s)(7168KiB/4837msec); 0 zone resets clat (msec): min=157, max=2099, avg=546.20, stdev=695.33 lat (msec): min=157, max=2099, avg=546.27, stdev=695.34 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 194], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 268], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 514], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 1899, max= 4079, per=52.53%, avg=3009.00, stdev=1204.70, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=15.03%, ctx=187, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4092KiB/s (4190kB/s), 409KiB/s-1580KiB/s (419kB/s-1617kB/s), io=20.0MiB (20.0MB), run=4538-5005msec WRITE: bw=5729KiB/s (5866kB/s), 1128KiB/s-2046KiB/s (1155kB/s-2095kB/s), io=28.0MiB (29.4MB), run=4538-5005msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=183590: Mon Mar 9 21:24:30 2026 read: IOPS=1, BW=5925KiB/s (6067kB/s)(12.0MiB/2074msec) clat (msec): min=537, max=757, avg=668.76, stdev=115.84 lat (msec): min=537, max=757, avg=668.76, stdev=115.84 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=16.64%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183591: Mon Mar 9 21:24:30 2026 read: IOPS=0, BW=1652KiB/s (1692kB/s)(4096KiB/2479msec) clat (nsec): min=1323.9M, max=1323.9M, avg=1323946610.00, stdev= 0.00 lat (nsec): min=1323.9M, max=1323.9M, avg=1323947732.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3305KiB/s (3384kB/s)(8192KiB/2479msec); 0 zone resets clat (msec): min=172, max=905, avg=539.01, stdev=517.95 lat (msec): min=173, max=905, avg=539.42, stdev=517.83 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=14.49%, ctx=55, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183592: Mon Mar 9 21:24:30 2026 write: IOPS=1, BW=7178KiB/s (7350kB/s)(12.0MiB/1712msec); 0 zone resets clat (msec): min=404, max=777, avg=546.76, stdev=201.99 lat (msec): min=404, max=778, avg=547.05, stdev=201.84 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7585, max= 8192, per=59.68%, avg=7888.50, stdev=429.21, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.41%, ctx=85, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183593: Mon Mar 9 21:24:30 2026 write: IOPS=1, BW=6430KiB/s (6584kB/s)(12.0MiB/1911msec); 0 zone resets clat (msec): min=191, max=1440, avg=614.50, stdev=715.00 lat (msec): min=191, max=1440, avg=614.84, stdev=715.05 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min=15544, max=15544, per=100.00%, avg=15544.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.05%, sys=16.60%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6609KiB/s (6768kB/s), 1652KiB/s-5925KiB/s (1692kB/s-6067kB/s), io=16.0MiB (16.8MB), run=2074-2479msec WRITE: bw=12.9MiB/s (13.5MB/s), 3305KiB/s-7178KiB/s (3384kB/s-7350kB/s), io=32.0MiB (33.6MB), run=1712-2479msec rand-rw: (groupid=0, jobs=1): err= 0: pid=183595: Mon Mar 9 21:24:30 2026 read: IOPS=1, BW=6589KiB/s (6747kB/s)(12.0MiB/1865msec) clat (msec): min=517, max=680, avg=597.50, stdev=81.36 lat (msec): min=517, max=680, avg=597.50, stdev=81.36 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5497, max= 8192, per=86.19%, avg=6844.50, stdev=1905.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=40.08%, ctx=1953, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183596: Mon Mar 9 21:24:30 2026 read: IOPS=0, BW=1985KiB/s (2033kB/s)(4096KiB/2063msec) clat (nsec): min=650493k, max=650493k, avg=650493324.00, stdev= 0.00 lat (nsec): min=650495k, max=650495k, avg=650495183.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3971KiB/s (4066kB/s)(8192KiB/2063msec); 0 zone resets clat (msec): min=419, max=967, avg=693.62, stdev=387.06 lat (msec): min=420, max=967, avg=693.92, stdev=387.05 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8192, max= 8192, per=59.23%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=24.01%, ctx=779, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183597: Mon Mar 9 21:24:30 2026 write: IOPS=1, BW=5187KiB/s (5311kB/s)(12.0MiB/2369msec); 0 zone resets clat (msec): min=183, max=1544, avg=774.91, stdev=697.72 lat (msec): min=183, max=1544, avg=775.36, stdev=697.72 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8175, max= 8192, per=59.17%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=11.69%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=183598: Mon Mar 9 21:24:30 2026 write: IOPS=1, BW=5965KiB/s (6108kB/s)(12.0MiB/2060msec); 0 zone resets clat (msec): min=206, max=1258, avg=680.70, stdev=533.56 lat (msec): min=207, max=1258, avg=681.05, stdev=533.51 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8192, max= 8192, per=59.23%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.32%, ctx=152, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7942KiB/s (8132kB/s), 1985KiB/s-6589KiB/s (2033kB/s-6747kB/s), io=16.0MiB (16.8MB), run=1865-2063msec WRITE: bw=13.5MiB/s (14.2MB/s), 3971KiB/s-5965KiB/s (4066kB/s-6108kB/s), io=32.0MiB (33.6MB), run=2060-2369msec