== sanity test 398b: DIO and buffer IO race ============== 12:38:02 (1777912682) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.77913 s, 18.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148236: Mon May 4 12:39:14 2026 read: IOPS=24, BW=97.6KiB/s (99.0kB/s)(5992KiB/61380msec) clat (usec): min=39, max=970533, avg=22113.42, stdev=28080.94 lat (usec): min=40, max=970534, avg=22120.36, stdev=28081.72 clat percentiles (usec): | 1.00th=[ 110], 5.00th=[ 6390], 10.00th=[ 8455], 20.00th=[ 11207], | 30.00th=[ 13698], 40.00th=[ 16319], 50.00th=[ 19006], 60.00th=[ 21890], | 70.00th=[ 25297], 80.00th=[ 30540], 90.00th=[ 38011], 95.00th=[ 43779], | 99.00th=[ 74974], 99.50th=[ 85459], 99.90th=[135267], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 14, max= 215, per=25.08%, avg=97.79, stdev=32.41, samples=121 iops : min= 3, max= 53, avg=23.98, stdev= 8.14, samples=121 write: IOPS=25, BW=103KiB/s (105kB/s)(6296KiB/61380msec); 0 zone resets clat (usec): min=887, max=121333, avg=17742.81, stdev=13996.55 lat (usec): min=888, max=121335, avg=17744.87, stdev=13996.22 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 2507], 10.00th=[ 3326], 20.00th=[ 5342], | 30.00th=[ 7439], 40.00th=[ 10945], 50.00th=[ 14484], 60.00th=[ 18220], | 70.00th=[ 22938], 80.00th=[ 29230], 90.00th=[ 35390], 95.00th=[ 44303], | 99.00th=[ 62129], 99.50th=[ 72877], 99.90th=[ 89654], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 39, max= 247, per=25.36%, avg=103.72, stdev=34.55, samples=120 iops : min= 9, max= 61, avg=25.45, stdev= 8.68, samples=120 lat (usec) : 50=0.03%, 100=0.26%, 250=1.46%, 500=0.13%, 1000=0.10% lat (msec) : 2=1.33%, 4=5.44%, 10=17.94%, 20=32.10%, 50=38.41% lat (msec) : 100=2.67%, 250=0.10%, 1000=0.03% cpu : usr=0.16%, sys=27.30%, ctx=9842, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148238: Mon May 4 12:39:14 2026 read: IOPS=24, BW=97.2KiB/s (99.6kB/s)(5940KiB/61082msec) clat (usec): min=37, max=112513, avg=20870.33, stdev=12125.26 lat (usec): min=38, max=112514, avg=20871.48, stdev=12125.35 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 6587], 10.00th=[ 8848], 20.00th=[ 11863], | 30.00th=[ 14222], 40.00th=[ 16712], 50.00th=[ 18744], 60.00th=[ 21103], | 70.00th=[ 24511], 80.00th=[ 29492], 90.00th=[ 35390], 95.00th=[ 40633], | 99.00th=[ 61080], 99.50th=[ 73925], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 7, max= 192, per=24.98%, avg=97.43, stdev=31.74, samples=120 iops : min= 1, max= 48, avg=23.88, stdev= 8.04, samples=120 write: IOPS=25, BW=104KiB/s (106kB/s)(6348KiB/61082msec); 0 zone resets clat (usec): min=823, max=945103, avg=18759.19, stdev=27438.49 lat (usec): min=823, max=945104, avg=18760.53, stdev=27438.50 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 2606], 10.00th=[ 3425], 20.00th=[ 5407], | 30.00th=[ 8455], 40.00th=[ 11994], 50.00th=[ 15008], 60.00th=[ 18482], | 70.00th=[ 22938], 80.00th=[ 29230], 90.00th=[ 36439], 95.00th=[ 43779], | 99.00th=[ 69731], 99.50th=[ 81265], 99.90th=[143655], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 192, per=25.37%, avg=103.78, stdev=33.32, samples=120 iops : min= 1, max= 48, avg=25.47, stdev= 8.36, samples=120 lat (usec) : 50=0.07%, 100=0.59%, 250=1.07%, 500=0.16%, 1000=0.23% lat (msec) : 2=1.20%, 4=5.31%, 10=15.98%, 20=34.93%, 50=37.79% lat (msec) : 100=2.47%, 250=0.16%, 1000=0.03% cpu : usr=0.15%, sys=27.54%, ctx=9873, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148240: Mon May 4 12:39:14 2026 read: IOPS=24, BW=98.8KiB/s (101kB/s)(6028KiB/61015msec) clat (usec): min=52, max=92895, avg=20677.24, stdev=11991.66 lat (usec): min=54, max=92897, avg=20678.57, stdev=11991.69 clat percentiles (usec): | 1.00th=[ 102], 5.00th=[ 6521], 10.00th=[ 8455], 20.00th=[11338], | 30.00th=[13829], 40.00th=[16057], 50.00th=[18482], 60.00th=[21103], | 70.00th=[24773], 80.00th=[29492], 90.00th=[36439], 95.00th=[41681], | 99.00th=[60556], 99.50th=[68682], 99.90th=[83362], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 48, max= 176, per=25.63%, avg=99.94, stdev=28.58, samples=119 iops : min= 12, max= 44, avg=24.51, stdev= 7.15, samples=119 write: IOPS=25, BW=103KiB/s (105kB/s)(6260KiB/61015msec); 0 zone resets clat (usec): min=732, max=976039, avg=18889.27, stdev=28543.63 lat (usec): min=733, max=976041, avg=18891.31, stdev=28544.19 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 2737], 10.00th=[ 3687], 20.00th=[ 5538], | 30.00th=[ 7701], 40.00th=[ 11600], 50.00th=[ 15270], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 28443], 90.00th=[ 37487], 95.00th=[ 47973], | 99.00th=[ 66847], 99.50th=[ 80217], 99.90th=[179307], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 23, max= 199, per=25.34%, avg=103.64, stdev=36.28, samples=119 iops : min= 5, max= 49, avg=25.44, stdev= 9.10, samples=119 lat (usec) : 100=0.49%, 250=1.30%, 500=0.20%, 750=0.07%, 1000=0.16% lat (msec) : 2=0.94%, 4=4.79%, 10=18.36%, 20=33.89%, 50=36.78% lat (msec) : 100=2.93%, 250=0.07%, 1000=0.03% cpu : usr=0.15%, sys=27.45%, ctx=9926, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148242: Mon May 4 12:39:14 2026 read: IOPS=24, BW=98.5KiB/s (101kB/s)(6052KiB/61439msec) clat (usec): min=52, max=107530, avg=20763.46, stdev=12258.77 lat (usec): min=53, max=107531, avg=20764.62, stdev=12258.83 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 4621], 10.00th=[ 8455], 20.00th=[ 11600], | 30.00th=[ 13960], 40.00th=[ 16319], 50.00th=[ 18744], 60.00th=[ 21365], | 70.00th=[ 24773], 80.00th=[ 29492], 90.00th=[ 35914], 95.00th=[ 42206], | 99.00th=[ 61604], 99.50th=[ 74974], 99.90th=[100140], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 24, max= 216, per=25.40%, avg=99.04, stdev=31.29, samples=120 iops : min= 6, max= 54, avg=24.28, stdev= 7.80, samples=120 write: IOPS=25, BW=101KiB/s (104kB/s)(6236KiB/61439msec); 0 zone resets clat (usec): min=893, max=969258, avg=19059.62, stdev=28509.91 lat (usec): min=893, max=969260, avg=19061.24, stdev=28509.94 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2704], 10.00th=[ 3523], 20.00th=[ 5473], | 30.00th=[ 7832], 40.00th=[ 11731], 50.00th=[ 15008], 60.00th=[ 19006], | 70.00th=[ 23462], 80.00th=[ 28443], 90.00th=[ 37487], 95.00th=[ 46924], | 99.00th=[ 71828], 99.50th=[ 87557], 99.90th=[143655], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 40, max= 207, per=25.01%, avg=102.30, stdev=31.55, samples=120 iops : min= 10, max= 51, avg=25.10, stdev= 7.92, samples=120 lat (usec) : 100=0.59%, 250=1.60%, 500=0.20%, 1000=0.07% lat (msec) : 2=1.11%, 4=5.34%, 10=16.37%, 20=33.56%, 50=38.02% lat (msec) : 100=2.96%, 250=0.16%, 1000=0.03% cpu : usr=0.16%, sys=27.05%, ctx=9812, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=391KiB/s (400kB/s), 97.2KiB/s-98.8KiB/s (99.6kB/s-101kB/s), io=23.4MiB (24.6MB), run=61015-61439msec WRITE: bw=409KiB/s (419kB/s), 101KiB/s-104KiB/s (104kB/s-106kB/s), io=24.6MiB (25.7MB), run=61015-61439msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148235: Mon May 4 12:39:41 2026 read: IOPS=16, BW=67.5KiB/s (69.2kB/s)(5992KiB/88715msec) clat (msec): min=2, max=988, avg=18.20, stdev=30.55 lat (msec): min=2, max=988, avg=18.20, stdev=30.55 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 38], 95.00th=[ 52], | 99.00th=[ 84], 99.50th=[ 109], 99.90th=[ 163], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 16, max= 200, per=25.53%, avg=68.67, stdev=36.88, samples=172 iops : min= 4, max= 50, avg=16.83, stdev= 9.34, samples=172 write: IOPS=17, BW=70.0KiB/s (72.7kB/s)(6296KiB/88715msec); 0 zone resets clat (msec): min=13, max=193, avg=38.86, stdev=19.21 lat (msec): min=13, max=193, avg=38.86, stdev=19.21 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 63], 95.00th=[ 75], | 99.00th=[ 108], 99.50th=[ 120], 99.90th=[ 186], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 7, max= 168, per=25.29%, avg=71.31, stdev=35.03, samples=174 iops : min= 1, max= 42, avg=17.49, stdev= 8.92, samples=174 lat (msec) : 4=1.66%, 10=20.25%, 20=16.80%, 50=47.59%, 100=12.70% lat (msec) : 250=0.98%, 1000=0.03% cpu : usr=0.11%, sys=9.68%, ctx=6382, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148237: Mon May 4 12:39:41 2026 read: IOPS=16, BW=66.7KiB/s (68.3kB/s)(5940KiB/89031msec) clat (msec): min=3, max=953, avg=17.64, stdev=29.36 lat (msec): min=3, max=953, avg=17.64, stdev=29.36 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 9], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 82], 99.50th=[ 101], 99.90th=[ 148], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 224, per=24.98%, avg=67.21, stdev=41.20, samples=175 iops : min= 1, max= 56, avg=16.46, stdev=10.42, samples=175 write: IOPS=17, BW=71.3KiB/s (73.0kB/s)(6348KiB/89031msec); 0 zone resets clat (msec): min=12, max=202, avg=39.41, stdev=21.16 lat (msec): min=12, max=202, avg=39.41, stdev=21.16 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 53], 90.00th=[ 67], 95.00th=[ 82], | 99.00th=[ 111], 99.50th=[ 130], 99.90th=[ 184], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 23, max= 160, per=25.39%, avg=71.59, stdev=35.31, samples=175 iops : min= 5, max= 40, avg=17.56, stdev= 8.99, samples=175 lat (msec) : 4=1.30%, 10=20.87%, 20=17.77%, 50=45.83%, 100=13.02% lat (msec) : 250=1.17%, 1000=0.03% cpu : usr=0.11%, sys=9.77%, ctx=6303, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148239: Mon May 4 12:39:41 2026 read: IOPS=17, BW=68.1KiB/s (69.7kB/s)(6028KiB/88510msec) clat (msec): min=2, max=136, avg=17.25, stdev=15.97 lat (msec): min=2, max=136, avg=17.25, stdev=15.97 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 37], 95.00th=[ 49], | 99.00th=[ 78], 99.50th=[ 90], 99.90th=[ 134], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 15, max= 184, per=25.65%, avg=69.01, stdev=37.67, samples=173 iops : min= 3, max= 46, avg=16.91, stdev= 9.54, samples=173 write: IOPS=17, BW=70.7KiB/s (72.4kB/s)(6260KiB/88510msec); 0 zone resets clat (msec): min=14, max=962, avg=39.77, stdev=30.84 lat (msec): min=14, max=962, avg=39.77, stdev=30.84 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 34], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 51], 90.00th=[ 67], 95.00th=[ 79], | 99.00th=[ 111], 99.50th=[ 132], 99.90th=[ 188], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 16, max= 160, per=25.25%, avg=71.21, stdev=34.82, samples=174 iops : min= 4, max= 40, avg=17.47, stdev= 8.86, samples=174 lat (msec) : 4=1.37%, 10=19.60%, 20=18.00%, 50=48.05%, 100=11.88% lat (msec) : 250=1.07%, 1000=0.03% cpu : usr=0.12%, sys=9.77%, ctx=6221, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148241: Mon May 4 12:39:41 2026 read: IOPS=17, BW=68.9KiB/s (70.6kB/s)(6052KiB/87777msec) clat (msec): min=3, max=144, avg=17.34, stdev=17.55 lat (msec): min=3, max=144, avg=17.34, stdev=17.55 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 52], | 99.00th=[ 91], 99.50th=[ 105], 99.90th=[ 138], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 7, max= 248, per=25.80%, avg=69.39, stdev=41.08, samples=172 iops : min= 1, max= 62, avg=17.01, stdev=10.39, samples=172 write: IOPS=17, BW=71.0KiB/s (72.7kB/s)(6236KiB/87777msec); 0 zone resets clat (msec): min=14, max=962, avg=39.30, stdev=30.61 lat (msec): min=14, max=962, avg=39.30, stdev=30.61 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 78], | 99.00th=[ 110], 99.50th=[ 125], 99.90th=[ 201], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 23, max= 144, per=25.36%, avg=71.53, stdev=34.57, samples=172 iops : min= 5, max= 36, avg=17.54, stdev= 8.79, samples=172 lat (msec) : 4=2.15%, 10=20.35%, 20=16.50%, 50=47.72%, 100=12.04% lat (msec) : 250=1.20%, 1000=0.03% cpu : usr=0.12%, sys=9.88%, ctx=6380, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=270KiB/s (276kB/s), 66.7KiB/s-68.9KiB/s (68.3kB/s-70.6kB/s), io=23.4MiB (24.6MB), run=87777-89031msec WRITE: bw=282KiB/s (289kB/s), 70.7KiB/s-71.3KiB/s (72.4kB/s-73.0kB/s), io=24.6MiB (25.7MB), run=87777-89031msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148270: Mon May 4 12:40:03 2026 read: IOPS=23, BW=380KiB/s (389kB/s)(5920KiB/15572msec) clat (usec): min=56, max=79320, avg=20249.64, stdev=12611.86 lat (usec): min=56, max=79322, avg=20250.75, stdev=12611.93 clat percentiles (usec): | 1.00th=[ 85], 5.00th=[ 135], 10.00th=[ 412], 20.00th=[10814], | 30.00th=[14353], 40.00th=[17171], 50.00th=[19006], 60.00th=[21365], | 70.00th=[24511], 80.00th=[29754], 90.00th=[35390], 95.00th=[41681], | 99.00th=[63177], 99.50th=[71828], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 159, max= 605, per=25.45%, avg=376.97, stdev=107.94, samples=30 iops : min= 9, max= 37, avg=22.83, stdev= 6.68, samples=30 write: IOPS=25, BW=409KiB/s (419kB/s)(6368KiB/15572msec); 0 zone resets clat (usec): min=1444, max=70825, avg=20125.36, stdev=13579.42 lat (usec): min=1446, max=70827, avg=20127.31, stdev=13579.48 clat percentiles (usec): | 1.00th=[ 2999], 5.00th=[ 4293], 10.00th=[ 5800], 20.00th=[ 8455], | 30.00th=[11338], 40.00th=[14353], 50.00th=[17171], 60.00th=[20055], | 70.00th=[23200], 80.00th=[29754], 90.00th=[38536], 95.00th=[47973], | 99.00th=[65799], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 159, max= 603, per=26.20%, avg=408.20, stdev=91.60, samples=30 iops : min= 9, max= 37, avg=24.80, stdev= 5.79, samples=30 lat (usec) : 100=0.91%, 250=3.26%, 500=0.65%, 750=0.13% lat (msec) : 2=0.65%, 4=1.43%, 10=14.97%, 20=34.24%, 50=40.49% lat (msec) : 100=3.26% cpu : usr=0.08%, sys=31.30%, ctx=2920, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148271: Mon May 4 12:40:03 2026 read: IOPS=22, BW=361KiB/s (370kB/s)(5744KiB/15905msec) clat (usec): min=64, max=77122, avg=21457.15, stdev=12003.49 lat (usec): min=66, max=77122, avg=21458.62, stdev=12003.54 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 194], 10.00th=[ 8455], 20.00th=[12649], | 30.00th=[15270], 40.00th=[17695], 50.00th=[20317], 60.00th=[23200], | 70.00th=[26870], 80.00th=[30278], 90.00th=[35390], 95.00th=[41157], | 99.00th=[56361], 99.50th=[69731], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 191, max= 608, per=24.40%, avg=361.29, stdev=98.97, samples=31 iops : min= 11, max= 38, avg=21.84, stdev= 6.30, samples=31 write: IOPS=25, BW=411KiB/s (421kB/s)(6544KiB/15905msec); 0 zone resets clat (usec): min=1181, max=83523, avg=19833.40, stdev=12976.70 lat (usec): min=1182, max=83525, avg=19835.40, stdev=12976.75 clat percentiles (usec): | 1.00th=[ 2507], 5.00th=[ 4883], 10.00th=[ 5932], 20.00th=[ 8356], | 30.00th=[10814], 40.00th=[13304], 50.00th=[16712], 60.00th=[20579], | 70.00th=[25560], 80.00th=[30540], 90.00th=[38011], 95.00th=[44827], | 99.00th=[54789], 99.50th=[62129], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 191, max= 670, per=26.33%, avg=410.26, stdev=118.25, samples=31 iops : min= 11, max= 41, avg=24.94, stdev= 7.38, samples=31 lat (usec) : 100=0.13%, 250=2.86%, 500=0.78%, 750=0.13% lat (msec) : 2=0.52%, 4=1.17%, 10=14.06%, 20=34.38%, 50=43.62% lat (msec) : 100=2.34% cpu : usr=0.13%, sys=31.98%, ctx=2981, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148272: Mon May 4 12:40:03 2026 read: IOPS=24, BW=387KiB/s (396kB/s)(6256KiB/16166msec) clat (usec): min=57, max=89850, avg=22150.74, stdev=13616.48 lat (usec): min=58, max=89851, avg=22152.44, stdev=13616.57 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 165], 10.00th=[ 7177], 20.00th=[12125], | 30.00th=[14484], 40.00th=[17957], 50.00th=[20579], 60.00th=[22414], | 70.00th=[26870], 80.00th=[32637], 90.00th=[39060], 95.00th=[46400], | 99.00th=[69731], 99.50th=[73925], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 160, max= 634, per=26.13%, avg=387.00, stdev=106.94, samples=32 iops : min= 10, max= 39, avg=23.50, stdev= 6.64, samples=32 write: IOPS=23, BW=373KiB/s (382kB/s)(6032KiB/16166msec); 0 zone resets clat (usec): min=1300, max=80504, avg=19759.30, stdev=13404.35 lat (usec): min=1302, max=80506, avg=19761.25, stdev=13404.43 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 4359], 10.00th=[ 5538], 20.00th=[ 8455], | 30.00th=[10945], 40.00th=[14091], 50.00th=[16909], 60.00th=[20579], | 70.00th=[24249], 80.00th=[29230], 90.00th=[38011], 95.00th=[44827], | 99.00th=[66847], 99.50th=[74974], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 95, max= 768, per=23.85%, avg=371.63, stdev=126.62, samples=32 iops : min= 5, max= 48, avg=22.53, stdev= 8.03, samples=32 lat (usec) : 100=0.91%, 250=2.60%, 500=0.39% lat (msec) : 2=0.91%, 4=1.30%, 10=14.32%, 20=33.07%, 50=43.62% lat (msec) : 100=2.86% cpu : usr=0.09%, sys=30.87%, ctx=2946, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148273: Mon May 4 12:40:03 2026 read: IOPS=24, BW=394KiB/s (403kB/s)(6032KiB/15315msec) clat (usec): min=43, max=77312, avg=20996.71, stdev=12500.93 lat (usec): min=44, max=77313, avg=20997.82, stdev=12500.96 clat percentiles (usec): | 1.00th=[ 89], 5.00th=[ 141], 10.00th=[ 235], 20.00th=[11731], | 30.00th=[15139], 40.00th=[17957], 50.00th=[19792], 60.00th=[23200], | 70.00th=[26346], 80.00th=[30540], 90.00th=[36963], 95.00th=[41157], | 99.00th=[56886], 99.50th=[67634], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 223, max= 576, per=26.28%, avg=389.13, stdev=101.85, samples=30 iops : min= 13, max= 36, avg=23.63, stdev= 6.37, samples=30 write: IOPS=25, BW=408KiB/s (418kB/s)(6256KiB/15315msec); 0 zone resets clat (usec): min=1519, max=103429, avg=18853.82, stdev=13957.09 lat (usec): min=1520, max=103430, avg=18855.79, stdev=13957.19 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 4228], 10.00th=[ 5735], 20.00th=[ 7898], | 30.00th=[ 10028], 40.00th=[ 12780], 50.00th=[ 15401], 60.00th=[ 18220], | 70.00th=[ 21365], 80.00th=[ 27132], 90.00th=[ 38536], 95.00th=[ 48497], | 99.00th=[ 66847], 99.50th=[ 73925], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 191, max= 606, per=25.97%, avg=404.63, stdev=104.35, samples=30 iops : min= 11, max= 37, avg=24.60, stdev= 6.47, samples=30 lat (usec) : 50=0.26%, 100=0.52%, 250=4.30%, 500=0.39%, 750=0.13% lat (msec) : 2=0.65%, 4=1.30%, 10=15.49%, 20=35.94%, 50=38.02% lat (msec) : 100=2.86%, 250=0.13% cpu : usr=0.16%, sys=31.83%, ctx=2867, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1482KiB/s (1517kB/s), 361KiB/s-394KiB/s (370kB/s-403kB/s), io=23.4MiB (24.5MB), run=15315-16166msec WRITE: bw=1559KiB/s (1596kB/s), 373KiB/s-411KiB/s (382kB/s-421kB/s), io=24.6MiB (25.8MB), run=15315-16166msec fio: pid=148277, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=148275: Mon May 4 12:40:09 2026 read: IOPS=16, BW=270KiB/s (277kB/s)(5920KiB/21918msec) clat (msec): min=3, max=129, avg=19.72, stdev=16.68 lat (msec): min=3, max=129, avg=19.72, stdev=16.68 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 40], 95.00th=[ 52], | 99.00th=[ 96], 99.50th=[ 102], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 95, max= 608, per=26.93%, avg=266.56, stdev=128.78, samples=43 iops : min= 5, max= 38, avg=16.07, stdev= 8.26, samples=43 write: IOPS=18, BW=291KiB/s (298kB/s)(6368KiB/21918msec); 0 zone resets clat (msec): min=14, max=109, avg=36.45, stdev=17.22 lat (msec): min=14, max=109, avg=36.45, stdev=17.22 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 74], | 99.00th=[ 93], 99.50th=[ 106], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 63, max= 576, per=27.52%, avg=289.21, stdev=130.02, samples=43 iops : min= 3, max= 36, avg=17.49, stdev= 8.37, samples=43 lat (msec) : 4=0.65%, 10=12.11%, 20=25.00%, 50=51.30%, 100=10.42% lat (msec) : 250=0.52% cpu : usr=0.09%, sys=12.00%, ctx=1878, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148276: Mon May 4 12:40:09 2026 read: IOPS=16, BW=262KiB/s (268kB/s)(5744KiB/21925msec) clat (msec): min=3, max=105, avg=19.53, stdev=16.10 lat (msec): min=3, max=105, avg=19.53, stdev=16.10 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 30], 90.00th=[ 44], 95.00th=[ 55], | 99.00th=[ 72], 99.50th=[ 91], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 63, max= 608, per=26.30%, avg=260.42, stdev=138.44, samples=43 iops : min= 3, max= 38, avg=15.70, stdev= 8.84, samples=43 write: IOPS=18, BW=298KiB/s (306kB/s)(6544KiB/21925msec); 0 zone resets clat (msec): min=13, max=148, avg=36.31, stdev=19.38 lat (msec): min=13, max=148, avg=36.32, stdev=19.38 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 41], 80.00th=[ 48], 90.00th=[ 61], 95.00th=[ 72], | 99.00th=[ 111], 99.50th=[ 122], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 95, max= 608, per=28.03%, avg=294.60, stdev=135.53, samples=43 iops : min= 5, max= 38, avg=17.81, stdev= 8.70, samples=43 lat (msec) : 4=0.13%, 10=13.41%, 20=24.35%, 50=49.09%, 100=11.98% lat (msec) : 250=1.04% cpu : usr=0.12%, sys=11.80%, ctx=1781, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=148277: Mon May 4 12:40:09 2026 read: IOPS=14, BW=235KiB/s (241kB/s)(4016KiB/17099msec) clat (msec): min=3, max=111, avg=25.48, stdev=18.93 lat (msec): min=3, max=111, avg=25.48, stdev=18.93 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 63], | 99.00th=[ 88], 99.50th=[ 91], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 95, max= 896, per=23.01%, avg=227.76, stdev=144.79, samples=33 iops : min= 5, max= 56, avg=13.55, stdev= 9.16, samples=33 write: IOPS=14, BW=227KiB/s (233kB/s)(3888KiB/17099msec); 0 zone resets clat (msec): min=16, max=144, avg=43.66, stdev=19.49 lat (msec): min=16, max=144, avg=43.67, stdev=19.49 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 40], 60.00th=[ 45], | 70.00th=[ 51], 80.00th=[ 59], 90.00th=[ 69], 95.00th=[ 79], | 99.00th=[ 107], 99.50th=[ 110], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 63, max= 480, per=20.99%, avg=220.64, stdev=81.67, samples=33 iops : min= 3, max= 30, avg=13.12, stdev= 5.29, samples=33 lat (msec) : 4=0.40%, 10=9.09%, 20=17.78%, 50=52.12%, 100=19.39% lat (msec) : 250=1.01% cpu : usr=0.08%, sys=12.90%, ctx=1267, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=252,243,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148278: Mon May 4 12:40:09 2026 read: IOPS=17, BW=278KiB/s (285kB/s)(6032KiB/21684msec) clat (msec): min=3, max=126, avg=19.52, stdev=18.03 lat (msec): min=3, max=126, avg=19.52, stdev=18.03 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 43], 95.00th=[ 59], | 99.00th=[ 95], 99.50th=[ 123], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 127, max= 704, per=28.09%, avg=278.09, stdev=142.51, samples=43 iops : min= 7, max= 44, avg=16.79, stdev= 9.09, samples=43 write: IOPS=18, BW=289KiB/s (295kB/s)(6256KiB/21684msec); 0 zone resets clat (msec): min=15, max=109, avg=36.42, stdev=18.54 lat (msec): min=15, max=109, avg=36.42, stdev=18.54 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 49], 90.00th=[ 62], 95.00th=[ 80], | 99.00th=[ 102], 99.50th=[ 109], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 127, max= 640, per=27.49%, avg=288.95, stdev=138.59, samples=43 iops : min= 7, max= 40, avg=17.47, stdev= 8.89, samples=43 lat (msec) : 4=0.65%, 10=14.32%, 20=25.91%, 50=46.61%, 100=11.59% lat (msec) : 250=0.91% cpu : usr=0.13%, sys=12.36%, ctx=1915, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=990KiB/s (1014kB/s), 235KiB/s-278KiB/s (241kB/s-285kB/s), io=21.2MiB (22.2MB), run=17099-21925msec WRITE: bw=1052KiB/s (1077kB/s), 227KiB/s-298KiB/s (233kB/s-306kB/s), io=22.5MiB (23.6MB), run=17099-21925msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148289: Mon May 4 12:40:17 2026 read: IOPS=2, BW=2403KiB/s (2461kB/s)(7168KiB/2983msec) clat (usec): min=623, max=971719, avg=260565.22, stdev=327303.35 lat (usec): min=624, max=971722, avg=260566.69, stdev=327304.01 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 78119], | 30.00th=[ 87557], 40.00th=[ 87557], 50.00th=[187696], 60.00th=[231736], | 70.00th=[231736], 80.00th=[267387], 90.00th=[968885], 95.00th=[968885], | 99.00th=[968885], 99.50th=[968885], 99.90th=[968885], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 2048, max= 4063, per=62.18%, avg=3359.67, stdev=1136.93, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1716KiB/s (1758kB/s)(5120KiB/2983msec); 0 zone resets clat (msec): min=150, max=278, avg=227.69, stdev=59.74 lat (msec): min=151, max=278, avg=227.76, stdev=59.72 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1984, max= 6144, per=53.72%, avg=4064.00, stdev=2941.56, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 1000=8.33% cpu : usr=0.03%, sys=44.10%, ctx=1297, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148291: Mon May 4 12:40:17 2026 read: IOPS=0, BW=540KiB/s (553kB/s)(2048KiB/3790msec) clat (msec): min=115, max=167, avg=141.13, stdev=36.94 lat (msec): min=115, max=167, avg=141.13, stdev=36.94 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 167], 95.00th=[ 167], | 99.00th=[ 167], 99.50th=[ 167], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 1374, max= 2048, per=31.67%, avg=1711.00, stdev=476.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2702KiB/s (2767kB/s)(10.0MiB/3790msec); 0 zone resets clat (msec): min=142, max=1172, avg=344.78, stdev=300.69 lat (msec): min=142, max=1172, avg=344.87, stdev=300.68 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 144], | 30.00th=[ 180], 40.00th=[ 239], 50.00th=[ 262], 60.00th=[ 300], | 70.00th=[ 330], 80.00th=[ 334], 90.00th=[ 347], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 2048, max= 4096, per=48.24%, avg=3649.40, stdev=897.00, samples=5 iops : min= 2, max= 4, avg= 3.00, stdev= 0.71, samples=5 lat (msec) : 250=50.00%, 500=41.67%, 2000=8.33% cpu : usr=0.00%, sys=40.63%, ctx=492, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148293: Mon May 4 12:40:17 2026 read: IOPS=1, BW=1899KiB/s (1945kB/s)(6144KiB/3235msec) clat (usec): min=586, max=272803, avg=134020.25, stdev=103942.71 lat (usec): min=587, max=272803, avg=134021.24, stdev=103942.67 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 52167], | 30.00th=[ 52167], 40.00th=[ 96994], 50.00th=[ 96994], 60.00th=[154141], | 70.00th=[225444], 80.00th=[225444], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 4096, max= 6107, per=94.42%, avg=5101.50, stdev=1421.99, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1899KiB/s (1945kB/s)(6144KiB/3235msec); 0 zone resets clat (msec): min=104, max=1323, avg=386.82, stdev=465.48 lat (msec): min=104, max=1323, avg=386.89, stdev=465.47 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 266], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1976, max= 2748, per=29.10%, avg=2201.75, stdev=365.51, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.03%, sys=30.30%, ctx=186, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148295: Mon May 4 12:40:17 2026 read: IOPS=1, BW=1410KiB/s (1444kB/s)(5120KiB/3631msec) clat (usec): min=383, max=169897, avg=66152.76, stdev=84658.18 lat (usec): min=384, max=169898, avg=66154.11, stdev=84658.69 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 383], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 13304], 60.00th=[ 13304], | 70.00th=[145753], 80.00th=[145753], 90.00th=[170918], 95.00th=[170918], | 99.00th=[170918], 99.50th=[170918], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1974KiB/s (2021kB/s)(7168KiB/3631msec); 0 zone resets clat (msec): min=116, max=1589, avg=454.86, stdev=514.29 lat (msec): min=116, max=1589, avg=454.94, stdev=514.30 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 182], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 251], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 451], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1374, max= 4096, per=31.57%, avg=2388.25, stdev=1181.20, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 20=8.33%, 250=50.00%, 500=16.67%, 2000=8.33% cpu : usr=0.03%, sys=29.04%, ctx=348, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5404KiB/s (5533kB/s), 540KiB/s-2403KiB/s (553kB/s-2461kB/s), io=20.0MiB (20.0MB), run=2983-3790msec WRITE: bw=7565KiB/s (7747kB/s), 1716KiB/s-2702KiB/s (1758kB/s-2767kB/s), io=28.0MiB (29.4MB), run=2983-3790msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148288: Mon May 4 12:40:17 2026 read: IOPS=1, BW=1801KiB/s (1844kB/s)(7168KiB/3981msec) clat (msec): min=33, max=1138, avg=419.49, stdev=468.62 lat (msec): min=33, max=1138, avg=419.50, stdev=468.62 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 35], | 30.00th=[ 51], 40.00th=[ 51], 50.00th=[ 226], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 995], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2039, max= 4096, per=65.89%, avg=3367.67, stdev=1152.44, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1286KiB/s (1317kB/s)(5120KiB/3981msec); 0 zone resets clat (msec): min=65, max=455, avg=196.24, stdev=153.22 lat (msec): min=65, max=455, avg=196.42, stdev=153.15 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2000, max= 2000, per=27.95%, avg=2000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 50=16.67%, 100=16.67%, 250=33.33%, 500=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=11.01%, ctx=92, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148290: Mon May 4 12:40:17 2026 read: IOPS=0, BW=511KiB/s (523kB/s)(2048KiB/4007msec) clat (msec): min=65, max=115, avg=90.48, stdev=35.56 lat (msec): min=65, max=115, avg=90.48, stdev=35.56 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 66], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 66], 60.00th=[ 116], | 70.00th=[ 116], 80.00th=[ 116], 90.00th=[ 116], 95.00th=[ 116], | 99.00th=[ 116], 99.50th=[ 116], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 1370, max= 1984, per=32.81%, avg=1677.00, stdev=434.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2556KiB/s (2617kB/s)(10.0MiB/4007msec); 0 zone resets clat (msec): min=56, max=1635, avg=370.90, stdev=474.31 lat (msec): min=56, max=1635, avg=371.01, stdev=474.35 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 59], | 30.00th=[ 62], 40.00th=[ 65], 50.00th=[ 255], 60.00th=[ 326], | 70.00th=[ 330], 80.00th=[ 401], 90.00th=[ 518], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 1996, max= 4087, per=42.27%, avg=3024.75, stdev=1159.09, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=41.67%, 250=8.33%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=12.13%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148292: Mon May 4 12:40:17 2026 read: IOPS=2, BW=2156KiB/s (2208kB/s)(6144KiB/2850msec) clat (msec): min=81, max=207, avg=149.70, stdev=45.77 lat (msec): min=81, max=207, avg=149.70, stdev=45.77 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 148], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 2039, max= 4096, per=66.67%, avg=3407.33, stdev=1185.02, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=2, BW=2156KiB/s (2208kB/s)(6144KiB/2850msec); 0 zone resets clat (msec): min=83, max=939, avg=319.94, stdev=314.04 lat (msec): min=83, max=939, avg=320.04, stdev=314.04 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 203], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 2039, max= 4007, per=35.42%, avg=2534.25, stdev=981.84, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=66.67%, 500=8.33%, 1000=8.33% cpu : usr=0.11%, sys=17.37%, ctx=142, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148294: Mon May 4 12:40:17 2026 read: IOPS=1, BW=1601KiB/s (1639kB/s)(5120KiB/3198msec) clat (msec): min=64, max=408, avg=165.08, stdev=139.71 lat (msec): min=64, max=408, avg=165.08, stdev=139.71 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 138], 80.00th=[ 138], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2000, max= 6144, per=79.67%, avg=4072.00, stdev=2930.25, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2241KiB/s (2295kB/s)(7168KiB/3198msec); 0 zone resets clat (msec): min=123, max=1083, avg=328.50, stdev=345.78 lat (msec): min=124, max=1083, avg=328.60, stdev=345.79 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 134], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 188], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 401], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2003, max= 4087, per=42.38%, avg=3032.25, stdev=1168.32, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=13.89%, ctx=114, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5111KiB/s (5234kB/s), 511KiB/s-2156KiB/s (523kB/s-2208kB/s), io=20.0MiB (20.0MB), run=2850-4007msec WRITE: bw=7155KiB/s (7327kB/s), 1286KiB/s-2556KiB/s (1317kB/s-2617kB/s), io=28.0MiB (29.4MB), run=2850-4007msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148301: Mon May 4 12:40:26 2026 read: IOPS=0, BW=4005KiB/s (4101kB/s)(12.0MiB/3068msec) clat (msec): min=582, max=1452, avg=1011.93, stdev=434.90 lat (msec): min=582, max=1452, avg=1011.93, stdev=434.90 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=31.37%, ctx=2458, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148302: Mon May 4 12:40:26 2026 read: IOPS=0, BW=1736KiB/s (1777kB/s)(4096KiB/2360msec) clat (nsec): min=318619k, max=318619k, avg=318619259.00, stdev= 0.00 lat (nsec): min=318622k, max=318622k, avg=318621892.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7393, max= 7393, per=100.00%, avg=7393.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3471KiB/s (3554kB/s)(8192KiB/2360msec); 0 zone resets clat (msec): min=632, max=1394, avg=1013.26, stdev=539.08 lat (msec): min=632, max=1394, avg=1013.58, stdev=538.83 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8126, max= 8126, per=83.21%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=13.35%, ctx=904, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148303: Mon May 4 12:40:26 2026 write: IOPS=0, BW=3663KiB/s (3750kB/s)(12.0MiB/3355msec); 0 zone resets clat (msec): min=583, max=1832, avg=1108.19, stdev=648.24 lat (msec): min=583, max=1833, avg=1108.84, stdev=648.47 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8126, max= 8159, per=83.38%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.06%, sys=7.04%, ctx=171, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148304: Mon May 4 12:40:26 2026 write: IOPS=0, BW=3783KiB/s (3874kB/s)(12.0MiB/3248msec); 0 zone resets clat (msec): min=551, max=1445, avg=1069.56, stdev=463.94 lat (msec): min=551, max=1446, avg=1069.99, stdev=464.11 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8126, max= 8192, per=83.54%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=12.20%, ctx=101, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5340KiB/s (5468kB/s), 1736KiB/s-4005KiB/s (1777kB/s-4101kB/s), io=16.0MiB (16.8MB), run=2360-3068msec WRITE: bw=9767KiB/s (10.0MB/s), 3471KiB/s-3783KiB/s (3554kB/s-3874kB/s), io=32.0MiB (33.6MB), run=2360-3355msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148305: Mon May 4 12:40:26 2026 read: IOPS=0, BW=3892KiB/s (3986kB/s)(12.0MiB/3157msec) clat (msec): min=735, max=1400, avg=1037.62, stdev=336.81 lat (msec): min=735, max=1400, avg=1037.62, stdev=336.81 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.49%, ctx=95, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148306: Mon May 4 12:40:26 2026 read: IOPS=0, BW=1620KiB/s (1659kB/s)(4096KiB/2528msec) clat (nsec): min=1188.4M, max=1188.4M, avg=1188406034.00, stdev= 0.00 lat (nsec): min=1188.4M, max=1188.4M, avg=1188408682.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3241KiB/s (3318kB/s)(8192KiB/2528msec); 0 zone resets clat (msec): min=270, max=1040, avg=655.42, stdev=544.07 lat (msec): min=271, max=1040, avg=655.89, stdev=544.01 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=13.06%, ctx=112, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148307: Mon May 4 12:40:26 2026 write: IOPS=0, BW=3636KiB/s (3723kB/s)(12.0MiB/3380msec); 0 zone resets clat (msec): min=386, max=2076, avg=1122.05, stdev=866.08 lat (msec): min=386, max=2077, avg=1122.50, stdev=866.18 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=5.80%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148308: Mon May 4 12:40:26 2026 write: IOPS=0, BW=3711KiB/s (3800kB/s)(12.0MiB/3311msec); 0 zone resets clat (msec): min=609, max=1383, avg=1087.58, stdev=417.89 lat (msec): min=609, max=1383, avg=1088.03, stdev=417.86 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8175, max= 8192, per=84.42%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=8.52%, ctx=93, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5190KiB/s (5314kB/s), 1620KiB/s-3892KiB/s (1659kB/s-3986kB/s), io=16.0MiB (16.8MB), run=2528-3157msec WRITE: bw=9695KiB/s (9927kB/s), 3241KiB/s-3711KiB/s (3318kB/s-3800kB/s), io=32.0MiB (33.6MB), run=2528-3380msec