== sanity test 398b: DIO and buffer IO race ============== 15:07:31 (1773688051) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.06547 s, 16.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180436: Mon Mar 16 15:08:34 2026 read: IOPS=28, BW=113KiB/s (116kB/s)(5992KiB/53026msec) clat (usec): min=237, max=695188, avg=19082.05, stdev=20347.47 lat (usec): min=239, max=695188, avg=19095.03, stdev=20349.86 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 6456], 10.00th=[ 8586], 20.00th=[ 10552], | 30.00th=[ 12256], 40.00th=[ 14484], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 22152], 80.00th=[ 25822], 90.00th=[ 32113], 95.00th=[ 37487], | 99.00th=[ 55313], 99.50th=[ 62653], 99.90th=[ 85459], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 6, max= 191, per=25.53%, avg=112.57, stdev=30.14, samples=105 iops : min= 1, max= 47, avg=27.71, stdev= 7.56, samples=105 write: IOPS=29, BW=119KiB/s (122kB/s)(6296KiB/53026msec); 0 zone resets clat (usec): min=871, max=142911, avg=15388.75, stdev=13114.38 lat (usec): min=872, max=142914, avg=15390.53, stdev=13113.98 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 2343], 10.00th=[ 3032], 20.00th=[ 3949], | 30.00th=[ 6128], 40.00th=[ 9372], 50.00th=[ 12256], 60.00th=[ 15664], | 70.00th=[ 19792], 80.00th=[ 23987], 90.00th=[ 31851], 95.00th=[ 38536], | 99.00th=[ 58459], 99.50th=[ 64226], 99.90th=[120062], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 39, max= 216, per=25.91%, avg=119.45, stdev=35.81, samples=104 iops : min= 9, max= 54, avg=29.43, stdev= 9.05, samples=104 lat (usec) : 250=0.03%, 500=0.46%, 750=0.78%, 1000=0.52% lat (msec) : 2=1.95%, 4=8.89%, 10=17.25%, 20=37.27%, 50=31.09% lat (msec) : 100=1.66%, 250=0.07%, 750=0.03% cpu : usr=0.14%, sys=27.19%, ctx=9250, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180437: Mon Mar 16 15:08:34 2026 read: IOPS=27, BW=110KiB/s (113kB/s)(5940KiB/53926msec) clat (usec): min=128, max=88668, avg=18336.82, stdev=10552.18 lat (usec): min=129, max=88668, avg=18338.54, stdev=10552.15 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 6259], 10.00th=[ 8356], 20.00th=[10290], | 30.00th=[12125], 40.00th=[14091], 50.00th=[16581], 60.00th=[18744], | 70.00th=[21890], 80.00th=[25560], 90.00th=[31589], 95.00th=[35914], | 99.00th=[55837], 99.50th=[63701], 99.90th=[88605], 99.95th=[88605], | 99.99th=[88605] bw ( KiB/s): min= 6, max= 199, per=24.98%, avg=110.17, stdev=34.29, samples=107 iops : min= 1, max= 49, avg=27.12, stdev= 8.64, samples=107 write: IOPS=29, BW=118KiB/s (121kB/s)(6348KiB/53926msec); 0 zone resets clat (usec): min=817, max=686743, avg=16706.24, stdev=21651.16 lat (usec): min=818, max=686744, avg=16707.88, stdev=21651.17 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 2540], 10.00th=[ 3130], 20.00th=[ 4359], | 30.00th=[ 6849], 40.00th=[ 10290], 50.00th=[ 13435], 60.00th=[ 16450], | 70.00th=[ 20579], 80.00th=[ 25297], 90.00th=[ 33424], 95.00th=[ 42730], | 99.00th=[ 60556], 99.50th=[ 72877], 99.90th=[158335], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 39, max= 224, per=25.71%, avg=118.53, stdev=35.86, samples=106 iops : min= 9, max= 56, avg=29.22, stdev= 8.97, samples=106 lat (usec) : 250=0.10%, 500=0.52%, 750=0.85%, 1000=0.36% lat (msec) : 2=1.69%, 4=8.20%, 10=17.32%, 20=37.73%, 50=31.28% lat (msec) : 100=1.89%, 250=0.03%, 750=0.03% cpu : usr=0.11%, sys=27.04%, ctx=9352, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180438: Mon Mar 16 15:08:34 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(6028KiB/54118msec) clat (usec): min=142, max=118094, avg=18377.85, stdev=11059.66 lat (usec): min=143, max=118095, avg=18379.86, stdev=11059.79 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 2180], 10.00th=[ 8094], 20.00th=[ 10421], | 30.00th=[ 11994], 40.00th=[ 13960], 50.00th=[ 16057], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 25560], 90.00th=[ 31065], 95.00th=[ 38536], | 99.00th=[ 54264], 99.50th=[ 66847], 99.90th=[ 78119], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 47, max= 184, per=25.33%, avg=111.70, stdev=31.73, samples=106 iops : min= 11, max= 46, avg=27.50, stdev= 7.99, samples=106 write: IOPS=28, BW=116KiB/s (118kB/s)(6260KiB/54118msec); 0 zone resets clat (usec): min=856, max=701768, avg=16753.85, stdev=21738.14 lat (usec): min=857, max=701771, avg=16756.26, stdev=21739.10 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 2474], 10.00th=[ 3064], 20.00th=[ 4359], | 30.00th=[ 7111], 40.00th=[ 10552], 50.00th=[ 13435], 60.00th=[ 16909], | 70.00th=[ 20579], 80.00th=[ 25822], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 60556], 99.50th=[ 73925], 99.90th=[ 87557], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 39, max= 183, per=25.07%, avg=115.59, stdev=33.00, samples=106 iops : min= 9, max= 45, avg=28.48, stdev= 8.29, samples=106 lat (usec) : 250=0.16%, 500=0.72%, 750=0.88%, 1000=0.29% lat (msec) : 2=1.50%, 4=8.11%, 10=16.67%, 20=37.96%, 50=31.77% lat (msec) : 100=1.89%, 250=0.03%, 750=0.03% cpu : usr=0.13%, sys=26.65%, ctx=9324, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180439: Mon Mar 16 15:08:34 2026 read: IOPS=27, BW=111KiB/s (114kB/s)(6052KiB/54418msec) clat (usec): min=177, max=141477, avg=18651.17, stdev=11270.86 lat (usec): min=177, max=141479, avg=18652.35, stdev=11270.96 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 5932], 10.00th=[ 8356], 20.00th=[ 10028], | 30.00th=[ 11994], 40.00th=[ 14222], 50.00th=[ 16450], 60.00th=[ 19006], | 70.00th=[ 22152], 80.00th=[ 25822], 90.00th=[ 32637], 95.00th=[ 39584], | 99.00th=[ 50594], 99.50th=[ 61080], 99.90th=[ 88605], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 47, max= 216, per=25.36%, avg=111.83, stdev=31.39, samples=107 iops : min= 11, max= 54, avg=27.54, stdev= 7.90, samples=107 write: IOPS=28, BW=115KiB/s (117kB/s)(6236KiB/54418msec); 0 zone resets clat (usec): min=844, max=667465, avg=16679.63, stdev=21262.50 lat (usec): min=844, max=667466, avg=16681.18, stdev=21262.59 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 2507], 10.00th=[ 3064], 20.00th=[ 4424], | 30.00th=[ 7046], 40.00th=[ 10159], 50.00th=[ 13304], 60.00th=[ 16712], | 70.00th=[ 20841], 80.00th=[ 25560], 90.00th=[ 33162], 95.00th=[ 39584], | 99.00th=[ 65274], 99.50th=[ 84411], 99.90th=[113771], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 19, max= 240, per=24.74%, avg=114.07, stdev=36.32, samples=108 iops : min= 4, max= 60, avg=28.10, stdev= 9.13, samples=108 lat (usec) : 250=0.13%, 500=0.52%, 750=0.85%, 1000=0.39% lat (msec) : 2=1.73%, 4=7.42%, 10=18.62%, 20=35.97%, 50=32.88% lat (msec) : 100=1.40%, 250=0.07%, 750=0.03% cpu : usr=0.13%, sys=26.57%, ctx=9541, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=441KiB/s (452kB/s), 110KiB/s-113KiB/s (113kB/s-116kB/s), io=23.4MiB (24.6MB), run=53026-54418msec WRITE: bw=462KiB/s (473kB/s), 115KiB/s-119KiB/s (117kB/s-122kB/s), io=24.6MiB (25.7MB), run=53026-54418msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180431: Mon Mar 16 15:09:03 2026 read: IOPS=18, BW=72.5KiB/s (74.3kB/s)(5992KiB/82628msec) clat (msec): min=3, max=699, avg=17.94, stdev=22.89 lat (msec): min=3, max=699, avg=17.94, stdev=22.89 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 47], | 99.00th=[ 77], 99.50th=[ 87], 99.90th=[ 148], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 192, per=25.26%, avg=72.99, stdev=36.67, samples=162 iops : min= 1, max= 48, avg=17.93, stdev= 9.30, samples=162 write: IOPS=19, BW=76.2KiB/s (78.0kB/s)(6296KiB/82628msec); 0 zone resets clat (msec): min=12, max=169, avg=35.29, stdev=17.40 lat (msec): min=12, max=169, avg=35.29, stdev=17.40 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 59], 95.00th=[ 69], | 99.00th=[ 94], 99.50th=[ 104], 99.90th=[ 148], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 15, max= 152, per=25.18%, avg=76.28, stdev=33.61, samples=163 iops : min= 3, max= 38, avg=18.75, stdev= 8.57, samples=163 lat (msec) : 4=0.62%, 10=16.02%, 20=24.90%, 50=47.82%, 100=10.19% lat (msec) : 250=0.42%, 750=0.03% cpu : usr=0.11%, sys=10.24%, ctx=6720, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180433: Mon Mar 16 15:09:03 2026 read: IOPS=17, BW=71.7KiB/s (73.4kB/s)(5940KiB/82898msec) clat (msec): min=3, max=677, avg=17.54, stdev=21.99 lat (msec): min=3, max=677, avg=17.55, stdev=21.99 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 43], | 99.00th=[ 73], 99.50th=[ 82], 99.90th=[ 125], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8, max= 200, per=25.02%, avg=72.31, stdev=38.97, samples=163 iops : min= 2, max= 50, avg=17.75, stdev= 9.86, samples=163 write: IOPS=19, BW=76.6KiB/s (78.4kB/s)(6348KiB/82898msec); 0 zone resets clat (msec): min=14, max=169, avg=35.69, stdev=18.56 lat (msec): min=14, max=169, avg=35.69, stdev=18.56 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 48], 90.00th=[ 59], 95.00th=[ 72], | 99.00th=[ 102], 99.50th=[ 121], 99.90th=[ 163], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 23, max= 168, per=25.36%, avg=76.84, stdev=33.99, samples=164 iops : min= 5, max= 42, avg=18.89, stdev= 8.68, samples=164 lat (msec) : 4=0.94%, 10=16.02%, 20=25.20%, 50=46.91%, 100=10.19% lat (msec) : 250=0.72%, 750=0.03% cpu : usr=0.09%, sys=10.16%, ctx=6689, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180434: Mon Mar 16 15:09:03 2026 read: IOPS=18, BW=73.0KiB/s (74.8kB/s)(6028KiB/82572msec) clat (msec): min=3, max=125, avg=17.39, stdev=13.75 lat (msec): min=3, max=125, avg=17.39, stdev=13.75 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 71], 99.50th=[ 79], 99.90th=[ 104], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 16, max= 184, per=25.34%, avg=73.23, stdev=36.89, samples=163 iops : min= 4, max= 46, avg=17.99, stdev= 9.35, samples=163 write: IOPS=18, BW=75.8KiB/s (77.6kB/s)(6260KiB/82572msec); 0 zone resets clat (msec): min=13, max=700, avg=35.88, stdev=24.51 lat (msec): min=13, max=700, avg=35.88, stdev=24.51 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 94], 99.50th=[ 109], 99.90th=[ 176], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 15, max= 160, per=25.08%, avg=75.99, stdev=34.73, samples=163 iops : min= 3, max= 40, avg=18.67, stdev= 8.85, samples=163 lat (msec) : 4=0.65%, 10=16.15%, 20=24.97%, 50=47.66%, 100=10.16% lat (msec) : 250=0.39%, 750=0.03% cpu : usr=0.12%, sys=10.23%, ctx=6676, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180435: Mon Mar 16 15:09:03 2026 read: IOPS=18, BW=74.1KiB/s (75.9kB/s)(6052KiB/81700msec) clat (msec): min=3, max=103, avg=16.98, stdev=12.84 lat (msec): min=3, max=103, avg=16.98, stdev=12.84 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 24], 90.00th=[ 34], 95.00th=[ 43], | 99.00th=[ 67], 99.50th=[ 73], 99.90th=[ 99], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 7, max= 232, per=25.78%, avg=74.50, stdev=38.72, samples=161 iops : min= 1, max= 58, avg=18.30, stdev= 9.83, samples=161 write: IOPS=19, BW=76.3KiB/s (78.2kB/s)(6236KiB/81700msec); 0 zone resets clat (msec): min=14, max=685, avg=35.79, stdev=24.23 lat (msec): min=14, max=685, avg=35.79, stdev=24.23 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 58], 95.00th=[ 70], | 99.00th=[ 104], 99.50th=[ 118], 99.90th=[ 167], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 23, max= 152, per=25.26%, avg=76.54, stdev=33.01, samples=161 iops : min= 5, max= 38, avg=18.81, stdev= 8.41, samples=161 lat (msec) : 4=0.78%, 10=16.60%, 20=24.54%, 50=48.34%, 100=9.11% lat (msec) : 250=0.59%, 750=0.03% cpu : usr=0.11%, sys=10.34%, ctx=6665, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=290KiB/s (297kB/s), 71.7KiB/s-74.1KiB/s (73.4kB/s-75.9kB/s), io=23.4MiB (24.6MB), run=81700-82898msec WRITE: bw=303KiB/s (311kB/s), 75.8KiB/s-76.6KiB/s (77.6kB/s-78.4kB/s), io=24.6MiB (25.7MB), run=81700-82898msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180467: Mon Mar 16 15:09:24 2026 read: IOPS=23, BW=383KiB/s (392kB/s)(5920KiB/15460msec) clat (usec): min=278, max=137569, avg=20776.84, stdev=14503.03 lat (usec): min=278, max=137570, avg=20777.66, stdev=14503.09 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 668], 10.00th=[ 8586], 20.00th=[ 11338], | 30.00th=[ 13698], 40.00th=[ 16057], 50.00th=[ 18220], 60.00th=[ 21365], | 70.00th=[ 23987], 80.00th=[ 27657], 90.00th=[ 36439], 95.00th=[ 43254], | 99.00th=[ 80217], 99.50th=[105382], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 190, max= 605, per=25.06%, avg=381.20, stdev=128.76, samples=30 iops : min= 11, max= 37, avg=23.27, stdev= 8.16, samples=30 write: IOPS=25, BW=412KiB/s (422kB/s)(6368KiB/15460msec); 0 zone resets clat (usec): min=1414, max=97263, avg=19441.00, stdev=14739.36 lat (usec): min=1415, max=97264, avg=19442.58, stdev=14739.41 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3523], 10.00th=[ 4490], 20.00th=[ 6194], | 30.00th=[ 9241], 40.00th=[12780], 50.00th=[16581], 60.00th=[20579], | 70.00th=[24249], 80.00th=[30278], 90.00th=[38011], 95.00th=[47449], | 99.00th=[76022], 99.50th=[92799], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 222, max= 638, per=25.89%, avg=414.17, stdev=103.28, samples=30 iops : min= 13, max= 39, avg=25.30, stdev= 6.50, samples=30 lat (usec) : 500=1.43%, 750=1.56%, 1000=0.78% lat (msec) : 2=1.04%, 4=2.99%, 10=15.89%, 20=33.46%, 50=39.45% lat (msec) : 100=3.12%, 250=0.26% cpu : usr=0.19%, sys=28.13%, ctx=2557, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180468: Mon Mar 16 15:09:24 2026 read: IOPS=22, BW=365KiB/s (374kB/s)(5744KiB/15746msec) clat (usec): min=236, max=105236, avg=22283.14, stdev=13635.87 lat (usec): min=236, max=105237, avg=22287.57, stdev=13641.99 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 562], 10.00th=[ 8586], 20.00th=[ 12256], | 30.00th=[ 14484], 40.00th=[ 17695], 50.00th=[ 20055], 60.00th=[ 23462], | 70.00th=[ 27132], 80.00th=[ 31327], 90.00th=[ 39584], 95.00th=[ 44303], | 99.00th=[ 65274], 99.50th=[ 67634], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 58, max= 670, per=23.87%, avg=363.00, stdev=142.08, samples=31 iops : min= 3, max= 41, avg=22.10, stdev= 8.89, samples=31 write: IOPS=25, BW=416KiB/s (426kB/s)(6544KiB/15746msec); 0 zone resets clat (usec): min=1431, max=103803, avg=18642.08, stdev=15769.51 lat (usec): min=1432, max=103805, avg=18643.77, stdev=15769.65 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 3261], 10.00th=[ 4359], 20.00th=[ 5997], | 30.00th=[ 8225], 40.00th=[ 11076], 50.00th=[ 13960], 60.00th=[ 17433], | 70.00th=[ 21103], 80.00th=[ 29230], 90.00th=[ 39584], 95.00th=[ 51643], | 99.00th=[ 68682], 99.50th=[ 73925], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 159, max= 702, per=25.80%, avg=412.77, stdev=134.11, samples=31 iops : min= 9, max= 43, avg=25.23, stdev= 8.42, samples=31 lat (usec) : 250=0.13%, 500=1.30%, 750=1.43%, 1000=0.39% lat (msec) : 2=1.43%, 4=3.52%, 10=16.93%, 20=34.11%, 50=36.07% lat (msec) : 100=4.43%, 250=0.26% cpu : usr=0.15%, sys=27.69%, ctx=2670, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180471: Mon Mar 16 15:09:24 2026 read: IOPS=26, BW=417KiB/s (427kB/s)(6256KiB/14989msec) clat (usec): min=183, max=79781, avg=21769.05, stdev=12465.61 lat (usec): min=184, max=79782, avg=21770.02, stdev=12465.69 clat percentiles (usec): | 1.00th=[ 265], 5.00th=[ 898], 10.00th=[ 9372], 20.00th=[12387], | 30.00th=[15533], 40.00th=[17433], 50.00th=[20317], 60.00th=[22152], | 70.00th=[25297], 80.00th=[29492], 90.00th=[38011], 95.00th=[44827], | 99.00th=[61604], 99.50th=[71828], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 222, max= 544, per=27.55%, avg=419.10, stdev=81.93, samples=29 iops : min= 13, max= 34, avg=25.62, stdev= 5.09, samples=29 write: IOPS=25, BW=402KiB/s (412kB/s)(6032KiB/14989msec); 0 zone resets clat (usec): min=1184, max=91263, avg=16888.79, stdev=12953.06 lat (usec): min=1184, max=91264, avg=16891.10, stdev=12953.26 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 3490], 10.00th=[ 4424], 20.00th=[ 5997], | 30.00th=[ 8094], 40.00th=[10552], 50.00th=[13960], 60.00th=[17171], | 70.00th=[21365], 80.00th=[25560], 90.00th=[31065], 95.00th=[42730], | 99.00th=[64226], 99.50th=[81265], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 127, max= 734, per=24.88%, avg=398.07, stdev=136.14, samples=29 iops : min= 7, max= 45, avg=24.28, stdev= 8.55, samples=29 lat (usec) : 250=0.26%, 500=0.91%, 750=0.91%, 1000=0.91% lat (msec) : 2=1.30%, 4=1.95%, 10=17.71%, 20=33.59%, 50=39.32% lat (msec) : 100=3.12% cpu : usr=0.16%, sys=28.82%, ctx=2620, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180473: Mon Mar 16 15:09:24 2026 read: IOPS=24, BW=390KiB/s (399kB/s)(6032KiB/15475msec) clat (usec): min=186, max=107344, avg=21006.42, stdev=13189.25 lat (usec): min=187, max=107345, avg=21014.71, stdev=13201.42 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 611], 10.00th=[ 7308], 20.00th=[ 11994], | 30.00th=[ 14091], 40.00th=[ 16909], 50.00th=[ 19268], 60.00th=[ 22152], | 70.00th=[ 25035], 80.00th=[ 29492], 90.00th=[ 35390], 95.00th=[ 41681], | 99.00th=[ 66323], 99.50th=[ 88605], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 191, max= 573, per=25.38%, avg=385.97, stdev=106.92, samples=30 iops : min= 11, max= 35, avg=23.57, stdev= 6.73, samples=30 write: IOPS=25, BW=404KiB/s (414kB/s)(6256KiB/15475msec); 0 zone resets clat (usec): min=1464, max=102629, avg=19029.61, stdev=15948.96 lat (usec): min=1465, max=102630, avg=19031.36, stdev=15949.05 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3654], 10.00th=[ 4424], 20.00th=[ 5538], | 30.00th=[ 8225], 40.00th=[ 11469], 50.00th=[ 14746], 60.00th=[ 18220], | 70.00th=[ 23200], 80.00th=[ 29492], 90.00th=[ 39584], 95.00th=[ 47973], | 99.00th=[ 80217], 99.50th=[ 98042], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 158, max= 830, per=25.25%, avg=404.03, stdev=132.03, samples=30 iops : min= 9, max= 51, avg=24.67, stdev= 8.31, samples=30 lat (usec) : 250=0.13%, 500=1.17%, 750=1.82%, 1000=0.78% lat (msec) : 2=1.56%, 4=2.60%, 10=16.41%, 20=33.72%, 50=38.15% lat (msec) : 100=3.39%, 250=0.26% cpu : usr=0.14%, sys=27.90%, ctx=2665, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1521KiB/s (1558kB/s), 365KiB/s-417KiB/s (374kB/s-427kB/s), io=23.4MiB (24.5MB), run=14989-15746msec WRITE: bw=1600KiB/s (1639kB/s), 402KiB/s-416KiB/s (412kB/s-426kB/s), io=24.6MiB (25.8MB), run=14989-15746msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180465: Mon Mar 16 15:09:30 2026 read: IOPS=16, BW=268KiB/s (275kB/s)(5920KiB/22076msec) clat (msec): min=3, max=112, avg=18.35, stdev=17.26 lat (msec): min=3, max=112, avg=18.35, stdev=17.26 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 45], 95.00th=[ 59], | 99.00th=[ 74], 99.50th=[ 88], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 95, max= 640, per=23.83%, avg=258.30, stdev=137.51, samples=43 iops : min= 5, max= 40, avg=15.65, stdev= 8.84, samples=43 write: IOPS=18, BW=288KiB/s (295kB/s)(6368KiB/22076msec); 0 zone resets clat (msec): min=16, max=152, avg=38.24, stdev=21.90 lat (msec): min=16, max=152, avg=38.24, stdev=21.90 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 70], 95.00th=[ 81], | 99.00th=[ 116], 99.50th=[ 150], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 95, max= 640, per=24.87%, avg=283.81, stdev=151.83, samples=43 iops : min= 5, max= 40, avg=17.23, stdev= 9.78, samples=43 lat (msec) : 4=1.30%, 10=19.53%, 20=19.92%, 50=44.14%, 100=13.93% lat (msec) : 250=1.17% cpu : usr=0.12%, sys=10.61%, ctx=1714, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180466: Mon Mar 16 15:09:30 2026 read: IOPS=16, BW=260KiB/s (266kB/s)(5744KiB/22075msec) clat (msec): min=3, max=119, avg=18.06, stdev=17.95 lat (msec): min=3, max=119, avg=18.07, stdev=17.95 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 43], 95.00th=[ 60], | 99.00th=[ 87], 99.50th=[ 110], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 58, max= 640, per=23.94%, avg=259.49, stdev=165.60, samples=43 iops : min= 3, max= 40, avg=15.72, stdev=10.56, samples=43 write: IOPS=18, BW=296KiB/s (304kB/s)(6544KiB/22075msec); 0 zone resets clat (msec): min=15, max=139, avg=37.88, stdev=22.47 lat (msec): min=15, max=139, avg=37.88, stdev=22.47 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 70], 95.00th=[ 83], | 99.00th=[ 132], 99.50th=[ 136], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 95, max= 608, per=25.38%, avg=289.53, stdev=145.28, samples=43 iops : min= 5, max= 38, avg=17.60, stdev= 9.34, samples=43 lat (msec) : 4=0.26%, 10=22.79%, 20=15.76%, 50=47.92%, 100=11.33% lat (msec) : 250=1.95% cpu : usr=0.05%, sys=10.56%, ctx=1762, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180469: Mon Mar 16 15:09:30 2026 read: IOPS=17, BW=287KiB/s (294kB/s)(6256KiB/21809msec) clat (msec): min=3, max=113, avg=17.54, stdev=16.83 lat (msec): min=3, max=113, avg=17.54, stdev=16.83 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 38], 95.00th=[ 53], | 99.00th=[ 103], 99.50th=[ 112], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 63, max= 832, per=26.66%, avg=288.95, stdev=192.64, samples=43 iops : min= 3, max= 52, avg=17.56, stdev=12.25, samples=43 write: IOPS=17, BW=277KiB/s (283kB/s)(6032KiB/21809msec); 0 zone resets clat (msec): min=15, max=195, avg=39.40, stdev=22.61 lat (msec): min=15, max=195, avg=39.41, stdev=22.61 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 55], 90.00th=[ 67], 95.00th=[ 79], | 99.00th=[ 136], 99.50th=[ 136], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 95, max= 576, per=24.09%, avg=274.84, stdev=138.76, samples=43 iops : min= 5, max= 36, avg=16.67, stdev= 8.93, samples=43 lat (msec) : 4=0.39%, 10=23.57%, 20=18.75%, 50=43.23%, 100=12.11% lat (msec) : 250=1.95% cpu : usr=0.12%, sys=10.67%, ctx=1708, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180472: Mon Mar 16 15:09:30 2026 read: IOPS=17, BW=276KiB/s (283kB/s)(6032KiB/21831msec) clat (msec): min=4, max=148, avg=18.51, stdev=18.71 lat (msec): min=4, max=148, avg=18.51, stdev=18.71 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 56], | 99.00th=[ 95], 99.50th=[ 128], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 63, max= 672, per=25.21%, avg=273.33, stdev=152.16, samples=43 iops : min= 3, max= 42, avg=16.58, stdev= 9.78, samples=43 write: IOPS=17, BW=287KiB/s (293kB/s)(6256KiB/21831msec); 0 zone resets clat (msec): min=16, max=152, avg=37.87, stdev=22.30 lat (msec): min=16, max=152, avg=37.87, stdev=22.30 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 66], 95.00th=[ 81], | 99.00th=[ 136], 99.50th=[ 146], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 96, max= 640, per=25.05%, avg=285.81, stdev=156.93, samples=43 iops : min= 6, max= 40, avg=17.37, stdev=10.05, samples=43 lat (msec) : 10=21.22%, 20=19.40%, 50=45.83%, 100=11.72%, 250=1.82% cpu : usr=0.15%, sys=10.98%, ctx=1780, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1085KiB/s (1111kB/s), 260KiB/s-287KiB/s (266kB/s-294kB/s), io=23.4MiB (24.5MB), run=21809-22076msec WRITE: bw=1142KiB/s (1169kB/s), 277KiB/s-296KiB/s (283kB/s-304kB/s), io=24.6MiB (25.8MB), run=21809-22076msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180489: Mon Mar 16 15:09:39 2026 read: IOPS=2, BW=2130KiB/s (2181kB/s)(7168KiB/3365msec) clat (msec): min=101, max=1117, avg=291.33, stdev=367.21 lat (msec): min=101, max=1117, avg=291.33, stdev=367.21 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 110], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 157], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 247], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1747, max= 4096, per=55.46%, avg=2986.50, stdev=1263.57, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=1, BW=1522KiB/s (1558kB/s)(5120KiB/3365msec); 0 zone resets clat (msec): min=71, max=529, avg=249.35, stdev=172.30 lat (msec): min=71, max=529, avg=249.42, stdev=172.30 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2048, max= 6144, per=54.33%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=41.85%, ctx=1411, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180490: Mon Mar 16 15:09:39 2026 read: IOPS=0, BW=539KiB/s (551kB/s)(2048KiB/3803msec) clat (usec): min=1103, max=298510, avg=149807.35, stdev=210298.36 lat (usec): min=1105, max=298512, avg=149808.91, stdev=210298.97 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1106], 10.00th=[ 1106], 20.00th=[ 1106], | 30.00th=[ 1106], 40.00th=[ 1106], 50.00th=[ 1106], 60.00th=[299893], | 70.00th=[299893], 80.00th=[299893], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 1723, max= 2048, per=35.01%, avg=1885.50, stdev=229.81, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2693KiB/s (2757kB/s)(10.0MiB/3803msec); 0 zone resets clat (msec): min=79, max=1642, avg=339.86, stdev=466.25 lat (msec): min=79, max=1642, avg=339.95, stdev=466.24 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 85], | 30.00th=[ 136], 40.00th=[ 159], 50.00th=[ 188], 60.00th=[ 207], | 70.00th=[ 236], 80.00th=[ 326], 90.00th=[ 347], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 1723, max= 6144, per=42.34%, avg=3192.20, stdev=1906.62, samples=5 iops : min= 1, max= 6, avg= 2.80, stdev= 2.17, samples=5 lat (msec) : 2=8.33%, 100=16.67%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.03%, sys=32.46%, ctx=287, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180491: Mon Mar 16 15:09:39 2026 read: IOPS=1, BW=1695KiB/s (1736kB/s)(6144KiB/3625msec) clat (usec): min=1208, max=318105, avg=136560.20, stdev=120013.62 lat (usec): min=1209, max=318107, avg=136561.57, stdev=120013.74 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1205], 10.00th=[ 1205], 20.00th=[ 7963], | 30.00th=[ 7963], 40.00th=[131597], 50.00th=[131597], 60.00th=[168821], | 70.00th=[191890], 80.00th=[191890], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 2027, max= 4096, per=63.26%, avg=3406.33, stdev=1194.54, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1695KiB/s (1736kB/s)(6144KiB/3625msec); 0 zone resets clat (msec): min=138, max=1550, avg=465.17, stdev=539.43 lat (msec): min=138, max=1550, avg=465.25, stdev=539.42 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 266], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 2027, max= 3430, per=31.68%, avg=2388.25, stdev=694.57, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 2=8.33%, 10=8.33%, 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.06%, sys=28.89%, ctx=530, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180492: Mon Mar 16 15:09:39 2026 read: IOPS=1, BW=1410KiB/s (1444kB/s)(5120KiB/3631msec) clat (usec): min=1044, max=325750, avg=104460.84, stdev=145975.01 lat (usec): min=1045, max=325751, avg=104461.90, stdev=145975.01 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1172], 40.00th=[ 1172], 50.00th=[ 11207], 60.00th=[ 11207], | 70.00th=[183501], 80.00th=[183501], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 2048, max= 6144, per=76.06%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1974KiB/s (2021kB/s)(7168KiB/3631msec); 0 zone resets clat (msec): min=109, max=1294, avg=427.83, stdev=401.78 lat (msec): min=109, max=1294, avg=427.91, stdev=401.77 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 199], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 334], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 485], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1744, max= 4055, per=38.95%, avg=2936.75, stdev=1209.80, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 2=16.67%, 20=8.33%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=29.26%, ctx=476, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5385KiB/s (5514kB/s), 539KiB/s-2130KiB/s (551kB/s-2181kB/s), io=20.0MiB (20.0MB), run=3365-3803msec WRITE: bw=7539KiB/s (7720kB/s), 1522KiB/s-2693KiB/s (1558kB/s-2757kB/s), io=28.0MiB (29.4MB), run=3365-3803msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180484: Mon Mar 16 15:09:40 2026 read: IOPS=2, BW=2668KiB/s (2732kB/s)(7168KiB/2687msec) clat (msec): min=59, max=872, avg=263.55, stdev=295.00 lat (msec): min=59, max=872, avg=263.55, stdev=295.00 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 61], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 131], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 388], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1992, max= 4995, per=71.83%, avg=3694.33, stdev=1541.27, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1905KiB/s (1951kB/s)(5120KiB/2687msec); 0 zone resets clat (msec): min=84, max=219, avg=157.44, stdev=53.64 lat (msec): min=84, max=219, avg=157.54, stdev=53.63 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 220], 95.00th=[ 220], | 99.00th=[ 220], 99.50th=[ 220], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 1665, max= 4096, per=34.03%, avg=2450.25, stdev=1110.09, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=33.33%, 250=41.67%, 500=16.67%, 1000=8.33% cpu : usr=0.04%, sys=12.62%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180485: Mon Mar 16 15:09:40 2026 read: IOPS=0, BW=514KiB/s (527kB/s)(2048KiB/3982msec) clat (msec): min=51, max=433, avg=242.48, stdev=270.14 lat (msec): min=51, max=433, avg=242.48, stdev=270.14 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 52], 50.00th=[ 52], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 1665, max= 1932, per=34.97%, avg=1798.50, stdev=188.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2572KiB/s (2633kB/s)(10.0MiB/3982msec); 0 zone resets clat (msec): min=45, max=1559, avg=344.90, stdev=460.63 lat (msec): min=45, max=1559, avg=344.99, stdev=460.64 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 46], 10.00th=[ 46], 20.00th=[ 59], | 30.00th=[ 66], 40.00th=[ 71], 50.00th=[ 120], 60.00th=[ 213], | 70.00th=[ 355], 80.00th=[ 443], 90.00th=[ 518], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 1665, max= 6144, per=41.12%, avg=2961.00, stdev=2128.60, samples=4 iops : min= 1, max= 6, avg= 2.25, stdev= 2.50, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=16.67%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=12.08%, ctx=126, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180487: Mon Mar 16 15:09:40 2026 read: IOPS=1, BW=1786KiB/s (1829kB/s)(6144KiB/3440msec) clat (msec): min=51, max=466, avg=169.35, stdev=159.39 lat (msec): min=51, max=466, avg=169.35, stdev=159.39 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 82], 50.00th=[ 82], 60.00th=[ 108], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1992, max= 4096, per=64.50%, avg=3317.33, stdev=1153.62, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1786KiB/s (1829kB/s)(6144KiB/3440msec); 0 zone resets clat (msec): min=60, max=1160, avg=400.20, stdev=403.02 lat (msec): min=60, max=1160, avg=400.29, stdev=403.01 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 326], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1932, max= 3330, per=32.30%, avg=2325.50, stdev=671.34, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=41.67%, 250=16.67%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=12.97%, ctx=166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180488: Mon Mar 16 15:09:40 2026 read: IOPS=1, BW=1307KiB/s (1338kB/s)(5120KiB/3918msec) clat (msec): min=29, max=334, avg=202.71, stdev=112.26 lat (msec): min=29, max=334, avg=202.71, stdev=112.26 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 31], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 3864, max= 3984, per=76.30%, avg=3924.00, stdev=84.85, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1830KiB/s (1873kB/s)(7168KiB/3918msec); 0 zone resets clat (msec): min=84, max=1237, avg=406.00, stdev=398.92 lat (msec): min=84, max=1237, avg=406.08, stdev=398.92 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 163], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 251], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 584], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1665, max= 4096, per=34.21%, avg=2463.00, stdev=1103.35, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=12.36%, ctx=107, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5143KiB/s (5267kB/s), 514KiB/s-2668KiB/s (527kB/s-2732kB/s), io=20.0MiB (20.0MB), run=2687-3982msec WRITE: bw=7200KiB/s (7373kB/s), 1786KiB/s-2572KiB/s (1829kB/s-2633kB/s), io=28.0MiB (29.4MB), run=2687-3982msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180498: Mon Mar 16 15:09:48 2026 read: IOPS=2, BW=11.4MiB/s (11.0MB/s)(12.0MiB/1049msec) clat (msec): min=196, max=574, avg=330.67, stdev=211.18 lat (msec): min=196, max=574, avg=330.67, stdev=211.18 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min=16031, max=16031, per=100.00%, avg=16031.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 750=33.33% cpu : usr=0.00%, sys=34.45%, ctx=100, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180499: Mon Mar 16 15:09:48 2026 read: IOPS=0, BW=1509KiB/s (1545kB/s)(4096KiB/2714msec) clat (nsec): min=684984k, max=684984k, avg=684984069.00, stdev= 0.00 lat (nsec): min=684986k, max=684986k, avg=684985615.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5673, max= 5673, per=93.99%, avg=5673.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3018KiB/s (3091kB/s)(8192KiB/2714msec); 0 zone resets clat (msec): min=496, max=1508, avg=1002.77, stdev=715.53 lat (msec): min=497, max=1509, avg=1003.15, stdev=715.43 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 498], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8192, max= 8192, per=67.85%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=16.88%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180501: Mon Mar 16 15:09:48 2026 write: IOPS=1, BW=4965KiB/s (5084kB/s)(12.0MiB/2475msec); 0 zone resets clat (msec): min=282, max=1354, avg=807.51, stdev=536.45 lat (msec): min=282, max=1354, avg=807.84, stdev=536.37 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7801, max= 8192, per=66.23%, avg=7996.50, stdev=276.48, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=23.97%, ctx=106, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180503: Mon Mar 16 15:09:48 2026 write: IOPS=1, BW=7398KiB/s (7576kB/s)(12.0MiB/1661msec); 0 zone resets clat (msec): min=241, max=987, avg=542.66, stdev=393.36 lat (msec): min=241, max=987, avg=542.98, stdev=393.29 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 401], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min=11145, max=11145, per=92.31%, avg=11145.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=19.70%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6037KiB/s (6182kB/s), 1509KiB/s-11.4MiB/s (1545kB/s-11.0MB/s), io=16.0MiB (16.8MB), run=1049-2714msec WRITE: bw=11.8MiB/s (12.4MB/s), 3018KiB/s-7398KiB/s (3091kB/s-7576kB/s), io=32.0MiB (33.6MB), run=1661-2714msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180500: Mon Mar 16 15:09:48 2026 read: IOPS=1, BW=6035KiB/s (6180kB/s)(12.0MiB/2036msec) clat (msec): min=586, max=782, avg=669.58, stdev=101.77 lat (msec): min=586, max=782, avg=669.58, stdev=101.76 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 5550, max= 8078, per=84.68%, avg=6814.00, stdev=1787.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=54.55%, ctx=2295, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180502: Mon Mar 16 15:09:48 2026 read: IOPS=0, BW=2295KiB/s (2350kB/s)(4096KiB/1785msec) clat (nsec): min=542606k, max=542606k, avg=542605954.00, stdev= 0.00 lat (nsec): min=542608k, max=542608k, avg=542608366.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 5885, max= 5885, per=73.13%, avg=5885.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4589KiB/s (4700kB/s)(8192KiB/1785msec); 0 zone resets clat (msec): min=416, max=796, avg=606.61, stdev=269.21 lat (msec): min=416, max=797, avg=607.01, stdev=269.22 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8078, max= 8078, per=65.82%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=21.18%, ctx=932, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180504: Mon Mar 16 15:09:48 2026 write: IOPS=1, BW=4602KiB/s (4713kB/s)(12.0MiB/2670msec); 0 zone resets clat (msec): min=197, max=2120, avg=882.03, stdev=1074.34 lat (msec): min=197, max=2120, avg=882.32, stdev=1074.32 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8047, max= 8047, per=65.57%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=19.60%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180505: Mon Mar 16 15:09:48 2026 write: IOPS=1, BW=4993KiB/s (5113kB/s)(12.0MiB/2461msec); 0 zone resets clat (msec): min=489, max=965, avg=797.07, stdev=266.49 lat (msec): min=490, max=966, avg=797.34, stdev=266.50 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 5673, max= 8078, per=56.03%, avg=6875.50, stdev=1700.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.04%, sys=23.50%, ctx=126, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8047KiB/s (8240kB/s), 2295KiB/s-6035KiB/s (2350kB/s-6180kB/s), io=16.0MiB (16.8MB), run=1785-2036msec WRITE: bw=11.0MiB/s (12.6MB/s), 4589KiB/s-4993KiB/s (4700kB/s-5113kB/s), io=32.0MiB (33.6MB), run=1785-2670msec