== sanity test 398b: DIO and buffer IO race ============== 06:27:09 (1777026429) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.75041 s, 18.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194510: Fri Apr 24 06:28:14 2026 read: IOPS=27, BW=111KiB/s (113kB/s)(5992KiB/54060msec) clat (usec): min=33, max=419323, avg=19682.01, stdev=14717.78 lat (usec): min=34, max=419323, avg=19686.31, stdev=14717.77 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 7242], 10.00th=[ 9241], 20.00th=[ 11207], | 30.00th=[ 13304], 40.00th=[ 15533], 50.00th=[ 18220], 60.00th=[ 20317], | 70.00th=[ 22938], 80.00th=[ 26346], 90.00th=[ 31589], 95.00th=[ 37487], | 99.00th=[ 53216], 99.50th=[ 58459], 99.90th=[105382], 99.95th=[417334], | 99.99th=[417334] bw ( KiB/s): min= 33, max= 168, per=25.08%, avg=110.37, stdev=24.19, samples=107 iops : min= 8, max= 42, avg=27.20, stdev= 6.01, samples=107 write: IOPS=29, BW=116KiB/s (119kB/s)(6296KiB/54060msec); 0 zone resets clat (usec): min=830, max=72686, avg=15509.00, stdev=12880.91 lat (usec): min=830, max=72687, avg=15510.13, stdev=12881.01 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1991], 10.00th=[ 2573], 20.00th=[ 3523], | 30.00th=[ 5669], 40.00th=[ 9634], 50.00th=[12518], 60.00th=[15664], | 70.00th=[19792], 80.00th=[25822], 90.00th=[33424], 95.00th=[40109], | 99.00th=[56886], 99.50th=[60031], 99.90th=[65274], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 19, max= 208, per=25.13%, avg=115.86, stdev=32.95, samples=107 iops : min= 4, max= 52, avg=28.56, stdev= 8.29, samples=107 lat (usec) : 50=0.07%, 100=0.36%, 250=1.11%, 500=0.03%, 1000=0.13% lat (msec) : 2=2.47%, 4=9.44%, 10=14.16%, 20=36.82%, 50=33.59% lat (msec) : 100=1.73%, 250=0.07%, 500=0.03% cpu : usr=0.12%, sys=20.23%, ctx=8342, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194511: Fri Apr 24 06:28:14 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(5940KiB/54319msec) clat (usec): min=49, max=84682, avg=19458.94, stdev=10340.24 lat (usec): min=50, max=84683, avg=19462.86, stdev=10338.99 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 7832], 10.00th=[ 9241], 20.00th=[11207], | 30.00th=[13173], 40.00th=[15270], 50.00th=[17695], 60.00th=[20055], | 70.00th=[22676], 80.00th=[26346], 90.00th=[32375], 95.00th=[39060], | 99.00th=[54264], 99.50th=[61080], 99.90th=[78119], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 13, max= 168, per=24.81%, avg=109.17, stdev=25.88, samples=108 iops : min= 3, max= 42, avg=26.89, stdev= 6.47, samples=108 write: IOPS=29, BW=117KiB/s (120kB/s)(6348KiB/54319msec); 0 zone resets clat (usec): min=885, max=403368, avg=15915.30, stdev=15987.83 lat (usec): min=886, max=403369, avg=15916.54, stdev=15987.81 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1991], 10.00th=[ 2606], 20.00th=[ 3589], | 30.00th=[ 6194], 40.00th=[ 10028], 50.00th=[ 12649], 60.00th=[ 16057], | 70.00th=[ 20055], 80.00th=[ 26084], 90.00th=[ 33424], 95.00th=[ 41157], | 99.00th=[ 55837], 99.50th=[ 60031], 99.90th=[ 71828], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 63, max= 216, per=25.20%, avg=116.19, stdev=34.77, samples=108 iops : min= 15, max= 54, avg=28.64, stdev= 8.71, samples=108 lat (usec) : 50=0.03%, 100=0.59%, 250=0.46%, 1000=0.10% lat (msec) : 2=2.51%, 4=8.85%, 10=14.65%, 20=37.66%, 50=33.46% lat (msec) : 100=1.66%, 500=0.03% cpu : usr=0.13%, sys=20.11%, ctx=8469, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194512: Fri Apr 24 06:28:14 2026 read: IOPS=27, BW=111KiB/s (113kB/s)(6028KiB/54499msec) clat (usec): min=37, max=74281, avg=19322.12, stdev=10289.04 lat (usec): min=37, max=74282, avg=19323.18, stdev=10289.04 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 7439], 10.00th=[ 8848], 20.00th=[11076], | 30.00th=[13173], 40.00th=[15270], 50.00th=[17695], 60.00th=[20317], | 70.00th=[22938], 80.00th=[26084], 90.00th=[32113], 95.00th=[39060], | 99.00th=[52691], 99.50th=[58459], 99.90th=[70779], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 47, max= 167, per=25.25%, avg=111.11, stdev=27.07, samples=107 iops : min= 11, max= 41, avg=27.37, stdev= 6.76, samples=107 write: IOPS=28, BW=115KiB/s (118kB/s)(6260KiB/54499msec); 0 zone resets clat (usec): min=808, max=435863, avg=16124.51, stdev=17174.42 lat (usec): min=809, max=435865, avg=16125.82, stdev=17174.44 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1958], 10.00th=[ 2507], 20.00th=[ 3458], | 30.00th=[ 5735], 40.00th=[ 9765], 50.00th=[ 12256], 60.00th=[ 15795], | 70.00th=[ 20317], 80.00th=[ 26084], 90.00th=[ 34866], 95.00th=[ 42730], | 99.00th=[ 58459], 99.50th=[ 67634], 99.90th=[ 79168], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 20, max= 192, per=24.72%, avg=113.98, stdev=28.58, samples=108 iops : min= 5, max= 48, avg=28.09, stdev= 7.19, samples=108 lat (usec) : 50=0.13%, 100=0.62%, 250=0.68%, 1000=0.20% lat (msec) : 2=2.54%, 4=9.08%, 10=15.01%, 20=35.68%, 50=34.11% lat (msec) : 100=1.92%, 500=0.03% cpu : usr=0.12%, sys=19.82%, ctx=8399, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194513: Fri Apr 24 06:28:14 2026 read: IOPS=28, BW=112KiB/s (115kB/s)(6052KiB/53924msec) clat (usec): min=34, max=103020, avg=19753.88, stdev=11264.72 lat (usec): min=34, max=103022, avg=19754.95, stdev=11264.79 clat percentiles (usec): | 1.00th=[ 84], 5.00th=[ 7504], 10.00th=[ 9110], 20.00th=[ 11207], | 30.00th=[ 13304], 40.00th=[ 15270], 50.00th=[ 17957], 60.00th=[ 20055], | 70.00th=[ 22938], 80.00th=[ 26870], 90.00th=[ 33817], 95.00th=[ 38536], | 99.00th=[ 58983], 99.50th=[ 74974], 99.90th=[ 93848], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 26, max= 183, per=25.50%, avg=112.21, stdev=28.52, samples=107 iops : min= 6, max= 45, avg=27.64, stdev= 7.14, samples=107 write: IOPS=28, BW=116KiB/s (118kB/s)(6236KiB/53924msec); 0 zone resets clat (usec): min=832, max=414949, avg=15322.58, stdev=16292.34 lat (usec): min=834, max=414950, avg=15323.86, stdev=16292.35 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1975], 10.00th=[ 2442], 20.00th=[ 3490], | 30.00th=[ 5342], 40.00th=[ 9241], 50.00th=[ 11994], 60.00th=[ 15139], | 70.00th=[ 18744], 80.00th=[ 24773], 90.00th=[ 33162], 95.00th=[ 41157], | 99.00th=[ 55313], 99.50th=[ 62129], 99.90th=[ 77071], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 46, max= 199, per=25.04%, avg=115.45, stdev=31.58, samples=107 iops : min= 11, max= 49, avg=28.46, stdev= 7.89, samples=107 lat (usec) : 50=0.13%, 100=0.62%, 250=0.62%, 1000=0.07% lat (msec) : 2=2.60%, 4=9.47%, 10=14.84%, 20=38.31%, 50=31.61% lat (msec) : 100=1.66%, 250=0.03%, 500=0.03% cpu : usr=0.12%, sys=20.21%, ctx=8364, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=441KiB/s (451kB/s), 109KiB/s-112KiB/s (112kB/s-115kB/s), io=23.4MiB (24.6MB), run=53924-54499msec WRITE: bw=461KiB/s (472kB/s), 115KiB/s-117KiB/s (118kB/s-120kB/s), io=24.6MiB (25.7MB), run=53924-54499msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194505: Fri Apr 24 06:28:29 2026 read: IOPS=21, BW=85.0KiB/s (88.0kB/s)(5992KiB/69701msec) clat (msec): min=3, max=433, avg=19.01, stdev=17.80 lat (msec): min=3, max=433, avg=19.01, stdev=17.80 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 70], 99.50th=[ 82], 99.90th=[ 104], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 6, max= 247, per=24.90%, avg=85.42, stdev=48.79, samples=138 iops : min= 1, max= 63, avg=21.01, stdev=12.25, samples=138 write: IOPS=22, BW=90.3KiB/s (92.5kB/s)(6296KiB/69701msec); 0 zone resets clat (msec): min=4, max=125, avg=26.06, stdev=15.87 lat (msec): min=4, max=125, avg=26.07, stdev=15.87 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 47], 95.00th=[ 56], | 99.00th=[ 87], 99.50th=[ 95], 99.90th=[ 112], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 15, max= 240, per=25.18%, avg=90.39, stdev=45.64, samples=137 iops : min= 3, max= 60, avg=22.25, stdev=11.49, samples=137 lat (msec) : 4=0.07%, 10=17.45%, 20=39.62%, 50=37.04%, 100=5.57% lat (msec) : 250=0.23%, 500=0.03% cpu : usr=0.11%, sys=9.33%, ctx=5779, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194506: Fri Apr 24 06:28:29 2026 read: IOPS=21, BW=84.0KiB/s (87.0kB/s)(5940KiB/69909msec) clat (msec): min=3, max=419, avg=18.95, stdev=17.67 lat (msec): min=3, max=419, avg=18.95, stdev=17.66 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 49], | 99.00th=[ 69], 99.50th=[ 89], 99.90th=[ 102], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 6, max= 295, per=24.73%, avg=84.81, stdev=49.21, samples=139 iops : min= 1, max= 73, avg=20.85, stdev=12.35, samples=139 write: IOPS=22, BW=90.8KiB/s (92.0kB/s)(6348KiB/69909msec); 0 zone resets clat (msec): min=6, max=133, avg=26.19, stdev=16.01 lat (msec): min=6, max=133, avg=26.19, stdev=16.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 47], 95.00th=[ 57], | 99.00th=[ 86], 99.50th=[ 94], 99.90th=[ 124], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 6, max= 255, per=25.16%, avg=90.33, stdev=45.44, samples=139 iops : min= 1, max= 63, avg=22.23, stdev=11.40, samples=139 lat (msec) : 4=0.07%, 10=17.61%, 20=38.64%, 50=37.57%, 100=5.89% lat (msec) : 250=0.20%, 500=0.03% cpu : usr=0.10%, sys=9.26%, ctx=5744, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194507: Fri Apr 24 06:28:29 2026 read: IOPS=21, BW=86.2KiB/s (88.3kB/s)(6028KiB/69904msec) clat (usec): min=3482, max=97648, avg=18811.15, stdev=14167.55 lat (usec): min=3482, max=97649, avg=18812.10, stdev=14167.56 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5473], 10.00th=[ 6259], 20.00th=[ 8225], | 30.00th=[10028], 40.00th=[12125], 50.00th=[14353], 60.00th=[17171], | 70.00th=[20055], 80.00th=[26608], 90.00th=[39584], 95.00th=[48497], | 99.00th=[68682], 99.50th=[74974], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 15, max= 280, per=25.22%, avg=86.52, stdev=46.08, samples=138 iops : min= 3, max= 70, avg=21.28, stdev=11.58, samples=138 write: IOPS=22, BW=89.6KiB/s (91.7kB/s)(6260KiB/69904msec); 0 zone resets clat (msec): min=7, max=420, avg=26.43, stdev=18.79 lat (msec): min=7, max=420, avg=26.43, stdev=18.79 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 83], 99.50th=[ 92], 99.90th=[ 115], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 6, max= 247, per=24.84%, avg=89.18, stdev=46.33, samples=139 iops : min= 1, max= 61, avg=21.94, stdev=11.64, samples=139 lat (msec) : 4=0.33%, 10=17.02%, 20=40.23%, 50=35.90%, 100=6.28% lat (msec) : 250=0.20%, 500=0.03% cpu : usr=0.12%, sys=9.27%, ctx=5842, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194508: Fri Apr 24 06:28:29 2026 read: IOPS=21, BW=87.3KiB/s (89.3kB/s)(6052KiB/69362msec) clat (msec): min=3, max=103, avg=18.31, stdev=13.96 lat (msec): min=3, max=103, avg=18.32, stdev=13.96 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 68], 99.50th=[ 78], 99.90th=[ 101], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 23, max= 303, per=25.58%, avg=87.75, stdev=46.43, samples=137 iops : min= 5, max= 75, avg=21.59, stdev=11.67, samples=137 write: IOPS=22, BW=89.9KiB/s (92.1kB/s)(6236KiB/69362msec); 0 zone resets clat (msec): min=6, max=425, avg=26.59, stdev=18.55 lat (msec): min=6, max=425, avg=26.59, stdev=18.55 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 38], 90.00th=[ 48], 95.00th=[ 57], | 99.00th=[ 80], 99.50th=[ 90], 99.90th=[ 116], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 6, max= 224, per=24.99%, avg=89.72, stdev=43.87, samples=138 iops : min= 1, max= 56, avg=22.08, stdev=11.05, samples=138 lat (msec) : 4=0.13%, 10=17.35%, 20=40.14%, 50=36.04%, 100=6.15% lat (msec) : 250=0.16%, 500=0.03% cpu : usr=0.11%, sys=9.35%, ctx=5746, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=343KiB/s (352kB/s), 84.0KiB/s-87.3KiB/s (87.0kB/s-89.3kB/s), io=23.4MiB (24.6MB), run=69362-69909msec WRITE: bw=360KiB/s (368kB/s), 89.6KiB/s-90.8KiB/s (91.7kB/s-92.0kB/s), io=24.6MiB (25.7MB), run=69362-69909msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194536: Fri Apr 24 06:28:51 2026 read: IOPS=22, BW=363KiB/s (372kB/s)(5920KiB/16298msec) clat (usec): min=32, max=94132, avg=23140.80, stdev=14358.69 lat (usec): min=32, max=94133, avg=23141.79, stdev=14358.76 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 113], 10.00th=[ 8356], 20.00th=[12911], | 30.00th=[15795], 40.00th=[18220], 50.00th=[21627], 60.00th=[24249], | 70.00th=[27657], 80.00th=[31065], 90.00th=[40109], 95.00th=[46924], | 99.00th=[74974], 99.50th=[85459], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 222, max= 576, per=24.98%, avg=364.19, stdev=97.47, samples=32 iops : min= 13, max= 36, avg=22.28, stdev= 6.10, samples=32 write: IOPS=24, BW=391KiB/s (400kB/s)(6368KiB/16298msec); 0 zone resets clat (usec): min=1644, max=91090, avg=19268.11, stdev=16005.11 lat (usec): min=1645, max=91093, avg=19272.80, stdev=16006.92 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 2966], 10.00th=[ 3982], 20.00th=[ 5473], | 30.00th=[ 7701], 40.00th=[10945], 50.00th=[14615], 60.00th=[18482], | 70.00th=[23462], 80.00th=[31851], 90.00th=[41681], 95.00th=[47973], | 99.00th=[78119], 99.50th=[85459], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 160, max= 669, per=25.51%, avg=391.25, stdev=115.73, samples=32 iops : min= 10, max= 41, avg=23.97, stdev= 7.23, samples=32 lat (usec) : 50=0.26%, 100=1.82%, 250=1.95%, 500=0.13% lat (msec) : 2=0.39%, 4=4.95%, 10=15.63%, 20=29.04%, 50=41.80% lat (msec) : 100=4.04% cpu : usr=0.12%, sys=22.06%, ctx=2463, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194537: Fri Apr 24 06:28:51 2026 read: IOPS=21, BW=350KiB/s (358kB/s)(5744KiB/16424msec) clat (usec): min=61, max=65434, avg=23951.81, stdev=12428.47 lat (usec): min=61, max=65435, avg=23953.12, stdev=12428.22 clat percentiles (usec): | 1.00th=[ 79], 5.00th=[ 7701], 10.00th=[10945], 20.00th=[14222], | 30.00th=[16909], 40.00th=[18744], 50.00th=[22152], 60.00th=[25297], | 70.00th=[28705], 80.00th=[32900], 90.00th=[40109], 95.00th=[50594], | 99.00th=[61604], 99.50th=[63701], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 160, max= 512, per=23.86%, avg=347.94, stdev=84.84, samples=32 iops : min= 10, max= 32, avg=21.28, stdev= 5.29, samples=32 write: IOPS=24, BW=398KiB/s (408kB/s)(6544KiB/16424msec); 0 zone resets clat (usec): min=1251, max=86470, avg=18975.88, stdev=14785.37 lat (usec): min=1251, max=86472, avg=18978.55, stdev=14785.25 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 3228], 10.00th=[ 3982], 20.00th=[ 6456], | 30.00th=[ 9110], 40.00th=[11863], 50.00th=[14222], 60.00th=[18482], | 70.00th=[23462], 80.00th=[30278], 90.00th=[40633], 95.00th=[49546], | 99.00th=[64226], 99.50th=[66323], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 159, max= 670, per=25.77%, avg=395.28, stdev=127.90, samples=32 iops : min= 9, max= 41, avg=24.22, stdev= 8.11, samples=32 lat (usec) : 100=0.78%, 250=0.91%, 500=0.13% lat (msec) : 2=0.78%, 4=4.69%, 10=13.41%, 20=33.85%, 50=40.49% lat (msec) : 100=4.95% cpu : usr=0.12%, sys=22.58%, ctx=2413, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194538: Fri Apr 24 06:28:51 2026 read: IOPS=23, BW=382KiB/s (391kB/s)(6256KiB/16379msec) clat (usec): min=51, max=73543, avg=22950.86, stdev=12705.70 lat (usec): min=51, max=73543, avg=22951.94, stdev=12705.87 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 129], 10.00th=[ 9896], 20.00th=[13435], | 30.00th=[16319], 40.00th=[18744], 50.00th=[21890], 60.00th=[24773], | 70.00th=[28443], 80.00th=[32375], 90.00th=[38536], 95.00th=[45876], | 99.00th=[62653], 99.50th=[68682], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 191, max= 541, per=26.37%, avg=384.53, stdev=92.89, samples=32 iops : min= 11, max= 33, avg=23.56, stdev= 5.84, samples=32 write: IOPS=23, BW=368KiB/s (377kB/s)(6032KiB/16379msec); 0 zone resets clat (usec): min=1342, max=123932, avg=19461.87, stdev=14429.40 lat (usec): min=1344, max=123933, avg=19476.95, stdev=14422.62 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 3621], 10.00th=[ 4555], 20.00th=[ 6718], | 30.00th=[ 9896], 40.00th=[ 12780], 50.00th=[ 15270], 60.00th=[ 20841], | 70.00th=[ 25035], 80.00th=[ 30278], 90.00th=[ 39584], 95.00th=[ 46400], | 99.00th=[ 56886], 99.50th=[ 68682], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 158, max= 591, per=23.65%, avg=362.84, stdev=105.40, samples=32 iops : min= 9, max= 36, avg=22.19, stdev= 6.61, samples=32 lat (usec) : 100=2.08%, 250=1.82%, 500=0.26% lat (msec) : 2=0.65%, 4=2.34%, 10=13.02%, 20=31.12%, 50=45.57% lat (msec) : 100=2.99%, 250=0.13% cpu : usr=0.07%, sys=22.11%, ctx=2465, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194539: Fri Apr 24 06:28:51 2026 read: IOPS=24, BW=388KiB/s (398kB/s)(6032KiB/15539msec) clat (usec): min=46, max=97090, avg=22462.62, stdev=13207.95 lat (usec): min=47, max=97092, avg=22463.62, stdev=13207.98 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 126], 10.00th=[ 9503], 20.00th=[13435], | 30.00th=[16057], 40.00th=[18744], 50.00th=[21103], 60.00th=[23725], | 70.00th=[26870], 80.00th=[30540], 90.00th=[37487], 95.00th=[44827], | 99.00th=[66847], 99.50th=[85459], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 125, max= 640, per=26.52%, avg=386.70, stdev=99.55, samples=30 iops : min= 7, max= 40, avg=23.67, stdev= 6.39, samples=30 write: IOPS=25, BW=403KiB/s (412kB/s)(6256KiB/15539msec); 0 zone resets clat (usec): min=1369, max=85406, avg=18022.67, stdev=13866.54 lat (usec): min=1371, max=85408, avg=18024.67, stdev=13866.73 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 3359], 10.00th=[ 4359], 20.00th=[ 5800], | 30.00th=[ 7635], 40.00th=[11076], 50.00th=[13960], 60.00th=[18482], | 70.00th=[23200], 80.00th=[29492], 90.00th=[38011], 95.00th=[45351], | 99.00th=[60031], 99.50th=[71828], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 224, max= 647, per=26.19%, avg=401.70, stdev=105.13, samples=30 iops : min= 14, max= 40, avg=24.63, stdev= 6.53, samples=30 lat (usec) : 50=0.26%, 100=1.43%, 250=2.34% lat (msec) : 2=0.52%, 4=3.78%, 10=15.76%, 20=31.38%, 50=41.15% lat (msec) : 100=3.39% cpu : usr=0.12%, sys=22.78%, ctx=2395, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1458KiB/s (1493kB/s), 350KiB/s-388KiB/s (358kB/s-398kB/s), io=23.4MiB (24.5MB), run=15539-16424msec WRITE: bw=1534KiB/s (1571kB/s), 368KiB/s-403KiB/s (377kB/s-412kB/s), io=24.6MiB (25.8MB), run=15539-16424msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194541: Fri Apr 24 06:28:55 2026 read: IOPS=18, BW=292KiB/s (299kB/s)(5920KiB/20300msec) clat (usec): min=4472, max=85089, avg=22386.86, stdev=16628.64 lat (usec): min=4473, max=85092, avg=22388.04, stdev=16628.65 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 6915], 10.00th=[ 7767], 20.00th=[ 9896], | 30.00th=[12518], 40.00th=[14484], 50.00th=[16581], 60.00th=[19792], | 70.00th=[23987], 80.00th=[32900], 90.00th=[45876], 95.00th=[61080], | 99.00th=[78119], 99.50th=[84411], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 95, max= 768, per=24.41%, avg=285.85, stdev=156.45, samples=40 iops : min= 5, max= 48, avg=17.38, stdev= 9.92, samples=40 write: IOPS=19, BW=314KiB/s (321kB/s)(6368KiB/20300msec); 0 zone resets clat (msec): min=6, max=137, avg=30.10, stdev=19.88 lat (msec): min=6, max=137, avg=30.11, stdev=19.89 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 56], 95.00th=[ 69], | 99.00th=[ 103], 99.50th=[ 123], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 63, max= 672, per=25.29%, avg=311.55, stdev=155.04, samples=40 iops : min= 3, max= 42, avg=18.97, stdev= 9.90, samples=40 lat (msec) : 10=11.07%, 20=40.10%, 50=36.85%, 100=11.46%, 250=0.52% cpu : usr=0.07%, sys=10.11%, ctx=1584, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194542: Fri Apr 24 06:28:55 2026 read: IOPS=17, BW=281KiB/s (288kB/s)(5744KiB/20451msec) clat (usec): min=4625, max=87343, avg=21152.13, stdev=15177.29 lat (usec): min=4626, max=87344, avg=21153.29, stdev=15177.30 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 6521], 10.00th=[ 8160], 20.00th=[10159], | 30.00th=[11994], 40.00th=[13829], 50.00th=[16057], 60.00th=[19006], | 70.00th=[22676], 80.00th=[28967], 90.00th=[43254], 95.00th=[55837], | 99.00th=[73925], 99.50th=[86508], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 95, max= 736, per=23.68%, avg=277.35, stdev=159.75, samples=40 iops : min= 5, max= 46, avg=16.85, stdev=10.16, samples=40 write: IOPS=19, BW=320KiB/s (328kB/s)(6544KiB/20451msec); 0 zone resets clat (msec): min=8, max=139, avg=31.35, stdev=20.25 lat (msec): min=8, max=139, avg=31.35, stdev=20.25 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 70], | 99.00th=[ 104], 99.50th=[ 108], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 64, max= 736, per=25.25%, avg=311.10, stdev=149.72, samples=40 iops : min= 4, max= 46, avg=18.95, stdev= 9.52, samples=40 lat (msec) : 10=9.90%, 20=39.45%, 50=38.67%, 100=11.07%, 250=0.91% cpu : usr=0.06%, sys=9.98%, ctx=1558, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194543: Fri Apr 24 06:28:55 2026 read: IOPS=19, BW=310KiB/s (317kB/s)(6256KiB/20206msec) clat (msec): min=4, max=120, avg=22.13, stdev=17.45 lat (msec): min=4, max=120, avg=22.13, stdev=17.45 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 85], 99.50th=[ 120], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 126, max= 830, per=26.52%, avg=310.50, stdev=174.15, samples=40 iops : min= 7, max= 51, avg=18.93, stdev=10.98, samples=40 write: IOPS=18, BW=299KiB/s (306kB/s)(6032KiB/20206msec); 0 zone resets clat (msec): min=5, max=104, avg=30.57, stdev=18.93 lat (msec): min=5, max=104, avg=30.58, stdev=18.93 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 44], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 103], 99.50th=[ 105], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 95, max= 672, per=24.03%, avg=296.10, stdev=147.20, samples=40 iops : min= 5, max= 42, avg=18.00, stdev= 9.45, samples=40 lat (msec) : 10=11.07%, 20=39.58%, 50=37.37%, 100=11.07%, 250=0.91% cpu : usr=0.11%, sys=10.27%, ctx=1596, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194544: Fri Apr 24 06:28:55 2026 read: IOPS=18, BW=298KiB/s (305kB/s)(6032KiB/20243msec) clat (usec): min=4894, max=81045, avg=22161.97, stdev=15903.12 lat (usec): min=4894, max=81046, avg=22163.15, stdev=15903.23 clat percentiles (usec): | 1.00th=[ 5342], 5.00th=[ 6718], 10.00th=[ 7898], 20.00th=[ 9896], | 30.00th=[11994], 40.00th=[13698], 50.00th=[16712], 60.00th=[20317], | 70.00th=[24773], 80.00th=[31327], 90.00th=[46924], 95.00th=[59507], | 99.00th=[72877], 99.50th=[80217], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 95, max= 800, per=25.16%, avg=294.62, stdev=163.96, samples=40 iops : min= 5, max= 50, avg=17.92, stdev=10.38, samples=40 write: IOPS=19, BW=309KiB/s (316kB/s)(6256KiB/20243msec); 0 zone resets clat (msec): min=6, max=126, avg=30.32, stdev=18.75 lat (msec): min=6, max=126, avg=30.33, stdev=18.75 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 44], 90.00th=[ 56], 95.00th=[ 65], | 99.00th=[ 102], 99.50th=[ 120], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 126, max= 832, per=25.00%, avg=308.02, stdev=153.88, samples=40 iops : min= 7, max= 52, avg=18.75, stdev= 9.81, samples=40 lat (msec) : 10=11.07%, 20=37.11%, 50=40.36%, 100=10.94%, 250=0.52% cpu : usr=0.10%, sys=10.32%, ctx=1608, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1171KiB/s (1199kB/s), 281KiB/s-310KiB/s (288kB/s-317kB/s), io=23.4MiB (24.5MB), run=20206-20451msec WRITE: bw=1232KiB/s (1262kB/s), 299KiB/s-320KiB/s (306kB/s-328kB/s), io=24.6MiB (25.8MB), run=20206-20451msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194554: Fri Apr 24 06:29:04 2026 read: IOPS=2, BW=2832KiB/s (2900kB/s)(7168KiB/2531msec) clat (usec): min=545, max=440892, avg=130397.91, stdev=175788.76 lat (usec): min=546, max=440895, avg=130399.29, stdev=175789.12 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 553], | 30.00th=[ 742], 40.00th=[ 742], 50.00th=[ 938], 60.00th=[231736], | 70.00th=[231736], 80.00th=[238027], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 4079, max= 6144, per=77.51%, avg=5111.50, stdev=1460.18, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=1, BW=2023KiB/s (2071kB/s)(5120KiB/2531msec); 0 zone resets clat (msec): min=162, max=509, avg=282.84, stdev=137.22 lat (msec): min=162, max=509, avg=282.91, stdev=137.20 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2048, max= 4087, per=33.22%, avg=3067.50, stdev=1441.79, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (usec) : 750=25.00%, 1000=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=41.30%, ctx=499, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194555: Fri Apr 24 06:29:04 2026 read: IOPS=0, BW=660KiB/s (675kB/s)(2048KiB/3105msec) clat (msec): min=133, max=261, avg=197.56, stdev=90.19 lat (msec): min=133, max=261, avg=197.56, stdev=90.19 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1732, max= 2043, per=28.62%, avg=1887.50, stdev=219.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3298KiB/s (3377kB/s)(10.0MiB/3105msec); 0 zone resets clat (msec): min=106, max=478, avg=258.37, stdev=113.52 lat (msec): min=106, max=478, avg=258.45, stdev=113.52 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 138], | 30.00th=[ 150], 40.00th=[ 228], 50.00th=[ 239], 60.00th=[ 271], | 70.00th=[ 279], 80.00th=[ 342], 90.00th=[ 355], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2043, max= 6144, per=39.87%, avg=3682.00, stdev=1713.67, samples=5 iops : min= 1, max= 6, avg= 3.20, stdev= 1.92, samples=5 lat (msec) : 250=50.00%, 500=50.00% cpu : usr=0.03%, sys=49.10%, ctx=225, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194556: Fri Apr 24 06:29:04 2026 read: IOPS=2, BW=2576KiB/s (2638kB/s)(6144KiB/2385msec) clat (usec): min=637, max=180990, avg=68005.55, stdev=84930.45 lat (usec): min=638, max=180991, avg=68006.75, stdev=84930.38 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[ 1745], 50.00th=[ 1745], 60.00th=[ 57410], | 70.00th=[166724], 80.00th=[166724], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 2039, max= 8192, per=77.57%, avg=5115.50, stdev=4350.83, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 write: IOPS=2, BW=2576KiB/s (2638kB/s)(6144KiB/2385msec); 0 zone resets clat (msec): min=112, max=1002, avg=325.20, stdev=341.64 lat (msec): min=113, max=1002, avg=325.75, stdev=341.29 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 194], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 2039, max= 5111, per=33.20%, avg=3066.00, stdev=1771.03, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 100=8.33%, 250=50.00%, 500=8.33%, 2000=8.33% cpu : usr=0.04%, sys=38.88%, ctx=366, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194557: Fri Apr 24 06:29:04 2026 read: IOPS=2, BW=2405KiB/s (2463kB/s)(5120KiB/2129msec) clat (usec): min=450, max=297401, avg=121099.62, stdev=124860.24 lat (usec): min=450, max=297403, avg=121100.72, stdev=124860.93 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 449], | 30.00th=[ 461], 40.00th=[ 461], 50.00th=[147850], 60.00th=[147850], | 70.00th=[158335], 80.00th=[158335], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3367KiB/s (3448kB/s)(7168KiB/2129msec); 0 zone resets clat (msec): min=128, max=331, avg=211.91, stdev=76.84 lat (msec): min=129, max=331, avg=211.99, stdev=76.82 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 142], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 215], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 288], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 2039, max= 5398, per=36.74%, avg=3393.00, stdev=1647.62, samples=4 iops : min= 1, max= 5, avg= 2.75, stdev= 1.71, samples=4 lat (usec) : 500=16.67% lat (msec) : 250=58.33%, 500=25.00% cpu : usr=0.05%, sys=57.80%, ctx=208, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6596KiB/s (6754kB/s), 660KiB/s-2832KiB/s (675kB/s-2900kB/s), io=20.0MiB (20.0MB), run=2129-3105msec WRITE: bw=9234KiB/s (9456kB/s), 2023KiB/s-3367KiB/s (2071kB/s-3448kB/s), io=28.0MiB (29.4MB), run=2129-3105msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194558: Fri Apr 24 06:29:05 2026 read: IOPS=2, BW=2204KiB/s (2256kB/s)(7168KiB/3253msec) clat (msec): min=34, max=508, avg=248.47, stdev=202.16 lat (msec): min=34, max=508, avg=248.47, stdev=202.16 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 50], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 205], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 481], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1969, max= 4096, per=41.34%, avg=2534.75, stdev=1041.34, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1574KiB/s (1612kB/s)(5120KiB/3253msec); 0 zone resets clat (msec): min=81, max=361, avg=253.11, stdev=107.53 lat (msec): min=81, max=362, avg=253.19, stdev=107.54 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2043, max= 4096, per=35.76%, avg=3069.50, stdev=1451.69, samples=2 iops : min= 1, max= 4, avg= 2.50, stdev= 2.12, samples=2 lat (msec) : 50=16.67%, 100=16.67%, 250=16.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=16.91%, ctx=135, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194559: Fri Apr 24 06:29:05 2026 read: IOPS=0, BW=613KiB/s (628kB/s)(2048KiB/3340msec) clat (msec): min=188, max=302, avg=245.33, stdev=80.42 lat (msec): min=188, max=302, avg=245.33, stdev=80.42 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1812, max= 2048, per=31.48%, avg=1930.00, stdev=166.88, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=3066KiB/s (3139kB/s)(10.0MiB/3340msec); 0 zone resets clat (msec): min=69, max=770, avg=273.62, stdev=217.57 lat (msec): min=69, max=770, avg=273.71, stdev=217.56 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 90], | 30.00th=[ 112], 40.00th=[ 128], 50.00th=[ 222], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 388], 90.00th=[ 468], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2043, max= 5907, per=41.05%, avg=3523.50, stdev=1859.91, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.83, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=18.09%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194560: Fri Apr 24 06:29:05 2026 read: IOPS=2, BW=2093KiB/s (2143kB/s)(6144KiB/2936msec) clat (msec): min=61, max=468, avg=191.40, stdev=151.72 lat (msec): min=61, max=468, avg=191.40, stdev=151.72 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 215], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2043, max= 3938, per=43.65%, avg=2676.33, stdev=1092.64, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2093KiB/s (2143kB/s)(6144KiB/2936msec); 0 zone resets clat (msec): min=149, max=476, avg=294.38, stdev=129.39 lat (msec): min=149, max=476, avg=294.50, stdev=129.41 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 271], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1771, max= 4063, per=28.91%, avg=2481.25, stdev=1062.41, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=12.71%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194561: Fri Apr 24 06:29:05 2026 read: IOPS=1, BW=1594KiB/s (1632kB/s)(5120KiB/3213msec) clat (msec): min=48, max=238, avg=119.40, stdev=70.84 lat (msec): min=48, max=238, avg=119.40, stdev=70.84 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 49], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 105], 60.00th=[ 105], | 70.00th=[ 107], 80.00th=[ 107], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 4096, max= 4096, per=66.81%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2231KiB/s (2284kB/s)(7168KiB/3213msec); 0 zone resets clat (msec): min=85, max=836, avg=357.79, stdev=251.92 lat (msec): min=85, max=836, avg=357.88, stdev=251.92 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 169], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 355], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 485], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1783, max= 4096, per=27.79%, avg=2385.40, stdev=962.01, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=19.58%, ctx=209, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6132KiB/s (6279kB/s), 613KiB/s-2204KiB/s (628kB/s-2256kB/s), io=20.0MiB (20.0MB), run=2936-3340msec WRITE: bw=8584KiB/s (8790kB/s), 1574KiB/s-3066KiB/s (1612kB/s-3139kB/s), io=28.0MiB (29.4MB), run=2936-3340msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=194566: Fri Apr 24 06:29:12 2026 read: IOPS=1, BW=6253KiB/s (6404kB/s)(12.0MiB/1965msec) clat (msec): min=370, max=826, avg=643.45, stdev=241.26 lat (msec): min=370, max=826, avg=643.45, stdev=241.26 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8159, max= 8159, per=97.86%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=10.64%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194567: Fri Apr 24 06:29:12 2026 read: IOPS=0, BW=2359KiB/s (2416kB/s)(4096KiB/1736msec) clat (nsec): min=454179k, max=454179k, avg=454179253.00, stdev= 0.00 lat (nsec): min=454182k, max=454182k, avg=454181954.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7488, max= 7488, per=89.82%, avg=7488.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4719KiB/s (4832kB/s)(8192KiB/1736msec); 0 zone resets clat (msec): min=531, max=715, avg=623.32, stdev=129.65 lat (msec): min=531, max=715, avg=623.68, stdev=129.65 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8192, max= 8192, per=43.40%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=13.72%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194568: Fri Apr 24 06:29:12 2026 write: IOPS=1, BW=7398KiB/s (7576kB/s)(12.0MiB/1661msec); 0 zone resets clat (msec): min=101, max=1112, avg=547.93, stdev=515.40 lat (msec): min=102, max=1112, avg=548.43, stdev=515.35 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min=14894, max=14894, per=78.91%, avg=14894.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.06%, sys=13.01%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194569: Fri Apr 24 06:29:12 2026 write: IOPS=2, BW=8269KiB/s (8468kB/s)(12.0MiB/1486msec); 0 zone resets clat (msec): min=207, max=695, avg=485.52, stdev=251.25 lat (msec): min=207, max=695, avg=485.96, stdev=251.28 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7861, max= 8159, per=42.44%, avg=8010.00, stdev=210.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.07%, sys=15.76%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8338KiB/s (8538kB/s), 2359KiB/s-6253KiB/s (2416kB/s-6404kB/s), io=16.0MiB (16.8MB), run=1736-1965msec WRITE: bw=18.4MiB/s (19.3MB/s), 4719KiB/s-8269KiB/s (4832kB/s-8468kB/s), io=32.0MiB (33.6MB), run=1486-1736msec rand-rw: (groupid=0, jobs=1): err= 0: pid=194571: Fri Apr 24 06:29:12 2026 read: IOPS=2, BW=9722KiB/s (9955kB/s)(12.0MiB/1264msec) clat (msec): min=372, max=451, avg=409.43, stdev=39.81 lat (msec): min=372, max=451, avg=409.44, stdev=39.81 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 5728, max= 8047, per=77.14%, avg=6887.50, stdev=1639.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.08%, sys=47.98%, ctx=1794, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194572: Fri Apr 24 06:29:12 2026 read: IOPS=0, BW=2232KiB/s (2286kB/s)(4096KiB/1835msec) clat (nsec): min=434292k, max=434292k, avg=434292089.00, stdev= 0.00 lat (nsec): min=434296k, max=434296k, avg=434295799.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7876, max= 7876, per=88.22%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4464KiB/s (4571kB/s)(8192KiB/1835msec); 0 zone resets clat (msec): min=120, max=1250, avg=685.74, stdev=799.22 lat (msec): min=120, max=1251, avg=686.04, stdev=799.11 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=13.96%, ctx=809, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194573: Fri Apr 24 06:29:12 2026 write: IOPS=1, BW=6621KiB/s (6780kB/s)(12.0MiB/1856msec); 0 zone resets clat (msec): min=242, max=1124, avg=608.51, stdev=459.62 lat (msec): min=242, max=1124, avg=608.98, stdev=459.57 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8047, max= 8175, per=45.94%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.87%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=194574: Fri Apr 24 06:29:12 2026 write: IOPS=2, BW=8733KiB/s (8943kB/s)(12.0MiB/1407msec); 0 zone resets clat (msec): min=294, max=618, avg=464.48, stdev=162.64 lat (msec): min=295, max=619, avg=464.95, stdev=162.58 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 6005, max= 8047, per=39.80%, avg=7026.00, stdev=1443.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.14%, sys=17.78%, ctx=79, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8929KiB/s (9143kB/s), 2232KiB/s-9722KiB/s (2286kB/s-9955kB/s), io=16.0MiB (16.8MB), run=1264-1835msec WRITE: bw=17.2MiB/s (18.1MB/s), 4464KiB/s-8733KiB/s (4571kB/s-8943kB/s), io=32.0MiB (33.6MB), run=1407-1856msec