== sanity test 398b: DIO and buffer IO race ============== 14:28:23 (1788892103) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.05408 s, 16.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191912: Tue Sep 8 14:29:37 2026 read: IOPS=23, BW=94.2KiB/s (96.5kB/s)(5992KiB/63600msec) clat (usec): min=58, max=1081.7k, avg=23033.78, stdev=29560.34 lat (usec): min=59, max=1081.8k, avg=23035.79, stdev=29560.13 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 8717], 10.00th=[ 10814], | 20.00th=[ 13173], 30.00th=[ 15664], 40.00th=[ 18220], | 50.00th=[ 20841], 60.00th=[ 23462], 70.00th=[ 26608], | 80.00th=[ 30540], 90.00th=[ 35914], 95.00th=[ 41157], | 99.00th=[ 58983], 99.50th=[ 70779], 99.90th=[ 89654], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 13, max= 192, per=25.03%, avg=94.36, stdev=25.30, samples=125 iops : min= 3, max= 48, avg=23.16, stdev= 6.38, samples=125 write: IOPS=24, BW=98.0KiB/s (101kB/s)(6296KiB/63600msec); 0 zone resets clat (usec): min=720, max=103141, avg=18286.64, stdev=14123.49 lat (usec): min=721, max=103141, avg=18288.16, stdev=14123.45 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2376], 10.00th=[ 3425], 20.00th=[ 5080], | 30.00th=[ 8225], 40.00th=[ 12256], 50.00th=[ 15401], 60.00th=[ 19006], | 70.00th=[ 23200], 80.00th=[ 29754], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 61080], 99.50th=[ 66847], 99.90th=[102237], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 47, max= 199, per=25.37%, avg=99.94, stdev=28.77, samples=124 iops : min= 11, max= 49, avg=24.55, stdev= 7.23, samples=124 lat (usec) : 100=0.10%, 250=1.07%, 500=0.10%, 750=0.03%, 1000=0.13% lat (msec) : 2=1.50%, 4=4.85%, 10=13.12%, 20=34.15%, 50=42.35% lat (msec) : 100=2.51%, 250=0.07%, 2000=0.03% cpu : usr=0.15%, sys=23.62%, ctx=9680, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191913: Tue Sep 8 14:29:37 2026 read: IOPS=23, BW=94.5KiB/s (96.8kB/s)(5940KiB/62838msec) clat (usec): min=47, max=80912, avg=22505.55, stdev=11990.20 lat (usec): min=48, max=80914, avg=22506.65, stdev=11990.22 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 8455], 10.00th=[10421], 20.00th=[13173], | 30.00th=[15139], 40.00th=[17433], 50.00th=[20055], 60.00th=[23200], | 70.00th=[26870], 80.00th=[31065], 90.00th=[38011], 95.00th=[43779], | 99.00th=[64226], 99.50th=[70779], 99.90th=[77071], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 6, max= 176, per=25.23%, avg=95.13, stdev=27.89, samples=124 iops : min= 1, max= 44, avg=23.35, stdev= 7.02, samples=124 write: IOPS=25, BW=101KiB/s (103kB/s)(6348KiB/62838msec); 0 zone resets clat (usec): min=792, max=1035.5k, avg=18330.59, stdev=29053.93 lat (usec): min=792, max=1035.5k, avg=18331.95, stdev=29053.95 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2606], 10.00th=[ 3621], | 20.00th=[ 5014], 30.00th=[ 7111], 40.00th=[ 11600], | 50.00th=[ 15008], 60.00th=[ 18482], 70.00th=[ 22152], | 80.00th=[ 28443], 90.00th=[ 36963], 95.00th=[ 44303], | 99.00th=[ 58459], 99.50th=[ 68682], 99.90th=[ 112722], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 6, max= 232, per=25.80%, avg=101.65, stdev=32.01, samples=124 iops : min= 1, max= 58, avg=24.98, stdev= 8.05, samples=124 lat (usec) : 50=0.03%, 100=0.13%, 250=0.91%, 500=0.07%, 1000=0.16% lat (msec) : 2=1.33%, 4=4.72%, 10=15.89%, 20=34.21%, 50=39.45% lat (msec) : 100=3.03%, 250=0.03%, 2000=0.03% cpu : usr=0.11%, sys=23.92%, ctx=9506, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191914: Tue Sep 8 14:29:37 2026 read: IOPS=23, BW=94.8KiB/s (97.1kB/s)(6028KiB/63579msec) clat (usec): min=61, max=1061.2k, avg=23186.33, stdev=29249.64 lat (usec): min=63, max=1061.2k, avg=23187.60, stdev=29249.66 clat percentiles (usec): | 1.00th=[ 121], 5.00th=[ 8586], 10.00th=[ 10683], | 20.00th=[ 13435], 30.00th=[ 15401], 40.00th=[ 17695], | 50.00th=[ 20579], 60.00th=[ 23725], 70.00th=[ 26870], | 80.00th=[ 30802], 90.00th=[ 36963], 95.00th=[ 43779], | 99.00th=[ 59507], 99.50th=[ 69731], 99.90th=[ 135267], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 47, max= 174, per=25.41%, avg=95.79, stdev=24.06, samples=124 iops : min= 11, max= 43, avg=23.52, stdev= 6.05, samples=124 write: IOPS=24, BW=98.5KiB/s (101kB/s)(6260KiB/63579msec); 0 zone resets clat (usec): min=905, max=81588, avg=18100.86, stdev=13483.36 lat (usec): min=907, max=81590, avg=18102.40, stdev=13483.46 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2769], 10.00th=[ 3654], 20.00th=[ 5211], | 30.00th=[ 8094], 40.00th=[12518], 50.00th=[15795], 60.00th=[18744], | 70.00th=[23200], 80.00th=[28705], 90.00th=[36439], 95.00th=[43254], | 99.00th=[60556], 99.50th=[69731], 99.90th=[79168], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 20, max= 176, per=25.04%, avg=98.64, stdev=30.13, samples=125 iops : min= 5, max= 44, avg=24.23, stdev= 7.59, samples=125 lat (usec) : 100=0.33%, 250=0.75%, 500=0.16%, 1000=0.03% lat (msec) : 2=1.01%, 4=5.11%, 10=13.48%, 20=34.96%, 50=41.70% lat (msec) : 100=2.41%, 250=0.03%, 2000=0.03% cpu : usr=0.14%, sys=24.21%, ctx=9688, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191915: Tue Sep 8 14:29:37 2026 read: IOPS=23, BW=95.1KiB/s (97.4kB/s)(6052KiB/63653msec) clat (usec): min=64, max=71799, avg=22377.87, stdev=10744.85 lat (usec): min=65, max=71801, avg=22382.14, stdev=10743.59 clat percentiles (usec): | 1.00th=[ 172], 5.00th=[ 8979], 10.00th=[10683], 20.00th=[13698], | 30.00th=[15664], 40.00th=[17957], 50.00th=[20579], 60.00th=[23462], | 70.00th=[26608], 80.00th=[30540], 90.00th=[36439], 95.00th=[42206], | 99.00th=[54789], 99.50th=[60556], 99.90th=[70779], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 31, max= 176, per=25.47%, avg=96.02, stdev=26.95, samples=124 iops : min= 7, max= 44, avg=23.56, stdev= 6.77, samples=124 write: IOPS=24, BW=97.0KiB/s (100kB/s)(6236KiB/63653msec); 0 zone resets clat (usec): min=839, max=1068.5k, avg=18891.50, stdev=30003.42 lat (usec): min=840, max=1068.5k, avg=18896.61, stdev=30002.37 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 2704], 10.00th=[ 3556], | 20.00th=[ 5014], 30.00th=[ 7898], 40.00th=[ 12256], | 50.00th=[ 15533], 60.00th=[ 19006], 70.00th=[ 23987], | 80.00th=[ 29754], 90.00th=[ 36963], 95.00th=[ 43779], | 99.00th=[ 60031], 99.50th=[ 73925], 99.90th=[ 96994], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 39, max= 208, per=25.15%, avg=99.07, stdev=28.15, samples=124 iops : min= 9, max= 52, avg=24.34, stdev= 7.11, samples=124 lat (usec) : 100=0.10%, 250=0.81%, 500=0.13%, 1000=0.23% lat (msec) : 2=1.11%, 4=5.27%, 10=13.83%, 20=33.63%, 50=42.71% lat (msec) : 100=2.15%, 2000=0.03% cpu : usr=0.15%, sys=24.06%, ctx=9683, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=377KiB/s (386kB/s), 94.2KiB/s-95.1KiB/s (96.5kB/s-97.4kB/s), io=23.4MiB (24.6MB), run=62838-63653msec WRITE: bw=395KiB/s (404kB/s), 97.0KiB/s-101KiB/s (100kB/s-103kB/s), io=24.6MiB (25.7MB), run=62838-63653msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191908: Tue Sep 8 14:29:46 2026 read: IOPS=20, BW=82.2KiB/s (84.2kB/s)(5992KiB/72894msec) clat (msec): min=2, max=1092, avg=20.66, stdev=32.31 lat (msec): min=2, max=1092, avg=20.66, stdev=32.31 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 45], 95.00th=[ 55], | 99.00th=[ 74], 99.50th=[ 96], 99.90th=[ 110], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 16, max= 304, per=25.44%, avg=83.17, stdev=55.41, samples=143 iops : min= 4, max= 76, avg=20.33, stdev=13.99, samples=143 write: IOPS=21, BW=86.4KiB/s (88.4kB/s)(6296KiB/72894msec); 0 zone resets clat (msec): min=4, max=139, avg=26.44, stdev=17.24 lat (msec): min=4, max=139, avg=26.45, stdev=17.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 40], 90.00th=[ 50], 95.00th=[ 58], | 99.00th=[ 84], 99.50th=[ 93], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 23, max= 272, per=25.44%, avg=87.25, stdev=55.31, samples=143 iops : min= 5, max= 68, avg=21.35, stdev=13.97, samples=143 lat (msec) : 4=0.42%, 10=22.72%, 20=32.36%, 50=36.30%, 100=7.81% lat (msec) : 250=0.36%, 2000=0.03% cpu : usr=0.11%, sys=10.46%, ctx=5903, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191909: Tue Sep 8 14:29:46 2026 read: IOPS=20, BW=81.1KiB/s (83.1kB/s)(5940KiB/73214msec) clat (msec): min=2, max=1047, avg=20.33, stdev=31.19 lat (msec): min=2, max=1047, avg=20.33, stdev=31.19 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 79], 99.50th=[ 93], 99.90th=[ 112], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 16, max= 296, per=24.92%, avg=81.50, stdev=57.06, samples=143 iops : min= 4, max= 74, avg=19.91, stdev=14.40, samples=143 write: IOPS=21, BW=86.7KiB/s (88.8kB/s)(6348KiB/73214msec); 0 zone resets clat (msec): min=5, max=139, avg=26.91, stdev=17.94 lat (msec): min=5, max=139, avg=26.91, stdev=17.94 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 59], | 99.00th=[ 90], 99.50th=[ 100], 99.90th=[ 118], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 256, per=25.27%, avg=86.69, stdev=54.34, samples=143 iops : min= 7, max= 64, avg=21.21, stdev=13.73, samples=143 lat (msec) : 4=0.42%, 10=22.46%, 20=32.81%, 50=36.23%, 100=7.65% lat (msec) : 250=0.39%, 2000=0.03% cpu : usr=0.13%, sys=10.18%, ctx=5741, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191910: Tue Sep 8 14:29:46 2026 read: IOPS=20, BW=82.5KiB/s (84.5kB/s)(6028KiB/73023msec) clat (msec): min=2, max=111, avg=19.75, stdev=15.96 lat (msec): min=2, max=111, avg=19.76, stdev=15.96 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 53], | 99.00th=[ 74], 99.50th=[ 80], 99.90th=[ 112], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 15, max= 304, per=25.49%, avg=83.34, stdev=56.50, samples=143 iops : min= 3, max= 76, avg=20.37, stdev=14.28, samples=143 write: IOPS=21, BW=85.7KiB/s (87.8kB/s)(6260KiB/73023msec); 0 zone resets clat (msec): min=4, max=1058, avg=27.44, stdev=31.83 lat (msec): min=4, max=1058, avg=27.44, stdev=31.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 95], 99.50th=[ 107], 99.90th=[ 138], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 16, max= 270, per=25.19%, avg=86.40, stdev=54.41, samples=143 iops : min= 4, max= 67, avg=21.14, stdev=13.74, samples=143 lat (msec) : 4=0.49%, 10=21.32%, 20=35.61%, 50=34.24%, 100=7.85% lat (msec) : 250=0.46%, 2000=0.03% cpu : usr=0.12%, sys=10.35%, ctx=5894, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191911: Tue Sep 8 14:29:46 2026 read: IOPS=20, BW=82.0KiB/s (84.9kB/s)(6052KiB/72957msec) clat (msec): min=3, max=114, avg=19.81, stdev=15.69 lat (msec): min=3, max=114, avg=19.81, stdev=15.69 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 72], 99.50th=[ 78], 99.90th=[ 114], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 7, max= 280, per=25.65%, avg=83.89, stdev=54.49, samples=143 iops : min= 1, max= 70, avg=20.51, stdev=13.75, samples=143 write: IOPS=21, BW=85.5KiB/s (87.5kB/s)(6236KiB/72957msec); 0 zone resets clat (msec): min=6, max=1061, avg=27.37, stdev=31.79 lat (msec): min=6, max=1061, avg=27.37, stdev=31.79 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 52], 95.00th=[ 61], | 99.00th=[ 90], 99.50th=[ 106], 99.90th=[ 140], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 23, max= 280, per=25.18%, avg=86.36, stdev=54.21, samples=143 iops : min= 5, max= 70, avg=21.13, stdev=13.70, samples=143 lat (msec) : 4=0.39%, 10=19.99%, 20=36.72%, 50=34.41%, 100=8.14% lat (msec) : 250=0.33%, 2000=0.03% cpu : usr=0.12%, sys=10.42%, ctx=5833, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=328KiB/s (336kB/s), 81.1KiB/s-82.0KiB/s (83.1kB/s-84.9kB/s), io=23.4MiB (24.6MB), run=72894-73214msec WRITE: bw=343KiB/s (352kB/s), 85.5KiB/s-86.7KiB/s (87.5kB/s-88.8kB/s), io=24.6MiB (25.7MB), run=72894-73214msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191944: Tue Sep 8 14:30:07 2026 read: IOPS=24, BW=395KiB/s (404kB/s)(5920KiB/15006msec) clat (usec): min=83, max=72452, avg=20459.01, stdev=12203.94 lat (usec): min=84, max=72453, avg=20459.88, stdev=12203.97 clat percentiles (usec): | 1.00th=[ 108], 5.00th=[ 208], 10.00th=[ 9241], 20.00th=[11994], | 30.00th=[13829], 40.00th=[16188], 50.00th=[18744], 60.00th=[21103], | 70.00th=[23987], 80.00th=[27132], 90.00th=[34866], 95.00th=[42730], | 99.00th=[67634], 99.50th=[69731], 99.90th=[72877], 99.95th=[72877], | 99.99th=[72877] bw ( KiB/s): min= 192, max= 573, per=24.15%, avg=385.41, stdev=87.44, samples=29 iops : min= 12, max= 35, avg=23.59, stdev= 5.41, samples=29 write: IOPS=26, BW=424KiB/s (435kB/s)(6368KiB/15006msec); 0 zone resets clat (usec): min=1301, max=84913, avg=18406.49, stdev=13848.07 lat (usec): min=1303, max=84916, avg=18408.21, stdev=13848.14 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 3556], 10.00th=[ 4490], 20.00th=[ 6390], | 30.00th=[ 9372], 40.00th=[12518], 50.00th=[15139], 60.00th=[18482], | 70.00th=[22676], 80.00th=[28181], 90.00th=[35390], 95.00th=[44303], | 99.00th=[68682], 99.50th=[80217], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 184, max= 608, per=25.21%, avg=423.34, stdev=111.00, samples=29 iops : min= 11, max= 38, avg=25.97, stdev= 6.93, samples=29 lat (usec) : 100=0.39%, 250=2.34%, 500=0.52% lat (msec) : 2=0.78%, 4=3.12%, 10=14.71%, 20=36.72%, 50=37.76% lat (msec) : 100=3.65% cpu : usr=0.13%, sys=24.25%, ctx=2690, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191945: Tue Sep 8 14:30:07 2026 read: IOPS=24, BW=387KiB/s (396kB/s)(5744KiB/14843msec) clat (usec): min=54, max=91975, avg=20504.57, stdev=11294.04 lat (usec): min=55, max=91977, avg=20505.43, stdev=11294.06 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 6783], 10.00th=[10159], 20.00th=[12256], | 30.00th=[14091], 40.00th=[16581], 50.00th=[19006], 60.00th=[21890], | 70.00th=[23987], 80.00th=[27395], 90.00th=[32375], 95.00th=[39060], | 99.00th=[57934], 99.50th=[79168], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 159, max= 544, per=24.15%, avg=385.48, stdev=105.64, samples=29 iops : min= 9, max= 34, avg=23.59, stdev= 6.53, samples=29 write: IOPS=27, BW=441KiB/s (451kB/s)(6544KiB/14843msec); 0 zone resets clat (usec): min=1136, max=99465, avg=18130.49, stdev=14726.82 lat (usec): min=1137, max=99467, avg=18132.26, stdev=14727.05 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 3064], 10.00th=[ 4178], 20.00th=[ 5407], | 30.00th=[ 8979], 40.00th=[11600], 50.00th=[14484], 60.00th=[16909], | 70.00th=[21365], 80.00th=[28967], 90.00th=[37487], 95.00th=[46924], | 99.00th=[67634], 99.50th=[78119], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 192, max= 640, per=25.95%, avg=435.76, stdev=114.20, samples=29 iops : min= 12, max= 40, avg=26.72, stdev= 7.06, samples=29 lat (usec) : 100=0.26%, 250=1.95% lat (msec) : 2=0.91%, 4=3.52%, 10=15.63%, 20=39.06%, 50=35.42% lat (msec) : 100=3.26% cpu : usr=0.09%, sys=24.72%, ctx=2701, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191946: Tue Sep 8 14:30:07 2026 read: IOPS=26, BW=426KiB/s (436kB/s)(6256KiB/14677msec) clat (usec): min=43, max=70270, avg=19825.57, stdev=11509.19 lat (usec): min=44, max=70271, avg=19826.54, stdev=11509.24 clat percentiles (usec): | 1.00th=[ 81], 5.00th=[ 147], 10.00th=[ 8225], 20.00th=[12125], | 30.00th=[13960], 40.00th=[15795], 50.00th=[18220], 60.00th=[20841], | 70.00th=[24249], 80.00th=[27395], 90.00th=[33162], 95.00th=[41157], | 99.00th=[57410], 99.50th=[65799], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 256, max= 736, per=26.82%, avg=428.10, stdev=115.70, samples=29 iops : min= 16, max= 46, avg=26.28, stdev= 7.31, samples=29 write: IOPS=25, BW=411KiB/s (421kB/s)(6032KiB/14677msec); 0 zone resets clat (usec): min=1178, max=93551, avg=18276.08, stdev=13999.16 lat (usec): min=1179, max=93552, avg=18278.77, stdev=14001.13 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 3130], 10.00th=[ 4113], 20.00th=[ 5538], | 30.00th=[ 8717], 40.00th=[11994], 50.00th=[14615], 60.00th=[18220], | 70.00th=[22938], 80.00th=[30278], 90.00th=[36963], 95.00th=[44303], | 99.00th=[64750], 99.50th=[76022], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 191, max= 640, per=24.45%, avg=410.52, stdev=101.90, samples=29 iops : min= 11, max= 40, avg=25.17, stdev= 6.38, samples=29 lat (usec) : 50=0.13%, 100=0.65%, 250=2.99%, 500=0.39% lat (msec) : 2=0.78%, 4=3.78%, 10=14.19%, 20=37.37%, 50=37.11% lat (msec) : 100=2.60% cpu : usr=0.14%, sys=24.48%, ctx=2678, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191947: Tue Sep 8 14:30:07 2026 read: IOPS=26, BW=420KiB/s (430kB/s)(6032KiB/14353msec) clat (usec): min=63, max=75664, avg=19940.08, stdev=11790.42 lat (usec): min=64, max=75665, avg=19940.94, stdev=11790.48 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 131], 10.00th=[ 8848], 20.00th=[11994], | 30.00th=[13960], 40.00th=[15926], 50.00th=[17957], 60.00th=[21103], | 70.00th=[23725], 80.00th=[27132], 90.00th=[34866], 95.00th=[39584], | 99.00th=[65274], 99.50th=[71828], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 192, max= 576, per=26.23%, avg=418.57, stdev=107.98, samples=28 iops : min= 12, max= 36, avg=25.68, stdev= 6.78, samples=28 write: IOPS=27, BW=436KiB/s (446kB/s)(6256KiB/14353msec); 0 zone resets clat (usec): min=1436, max=60984, avg=17267.89, stdev=13461.12 lat (usec): min=1437, max=60985, avg=17270.21, stdev=13461.26 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 3228], 10.00th=[ 3949], 20.00th=[ 4883], | 30.00th=[ 6980], 40.00th=[10552], 50.00th=[13698], 60.00th=[17695], | 70.00th=[22676], 80.00th=[27919], 90.00th=[37487], 95.00th=[45876], | 99.00th=[58983], 99.50th=[59507], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 192, max= 672, per=25.93%, avg=435.39, stdev=121.33, samples=28 iops : min= 12, max= 42, avg=26.75, stdev= 7.53, samples=28 lat (usec) : 100=0.65%, 250=3.12%, 500=0.13% lat (msec) : 2=0.39%, 4=5.21%, 10=16.28%, 20=36.20%, 50=35.29% lat (msec) : 100=2.73% cpu : usr=0.13%, sys=24.97%, ctx=2641, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1596KiB/s (1634kB/s), 387KiB/s-426KiB/s (396kB/s-436kB/s), io=23.4MiB (24.5MB), run=14353-15006msec WRITE: bw=1679KiB/s (1720kB/s), 411KiB/s-441KiB/s (421kB/s-451kB/s), io=24.6MiB (25.8MB), run=14353-15006msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191939: Tue Sep 8 14:30:10 2026 read: IOPS=20, BW=321KiB/s (328kB/s)(5920KiB/18466msec) clat (msec): min=4, max=116, avg=19.80, stdev=15.31 lat (msec): min=4, max=116, avg=19.80, stdev=15.31 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 43], 95.00th=[ 53], | 99.00th=[ 79], 99.50th=[ 94], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 159, max= 864, per=24.19%, avg=313.00, stdev=157.16, samples=36 iops : min= 9, max= 54, avg=19.08, stdev= 9.96, samples=36 write: IOPS=21, BW=345KiB/s (353kB/s)(6368KiB/18466msec); 0 zone resets clat (usec): min=7303, max=83377, avg=27821.34, stdev=16147.78 lat (usec): min=7304, max=83380, avg=27823.89, stdev=16147.60 clat percentiles (usec): | 1.00th=[ 7832], 5.00th=[10159], 10.00th=[11338], 20.00th=[14091], | 30.00th=[16319], 40.00th=[18482], 50.00th=[22414], 60.00th=[28443], | 70.00th=[34341], 80.00th=[42206], 90.00th=[51119], 95.00th=[57410], | 99.00th=[79168], 99.50th=[79168], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 127, max= 672, per=25.02%, avg=340.81, stdev=144.23, samples=36 iops : min= 7, max= 42, avg=20.83, stdev= 9.16, samples=36 lat (msec) : 10=14.71%, 20=41.80%, 50=35.55%, 100=7.81%, 250=0.13% cpu : usr=0.14%, sys=9.54%, ctx=1536, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191940: Tue Sep 8 14:30:10 2026 read: IOPS=19, BW=311KiB/s (318kB/s)(5744KiB/18497msec) clat (msec): min=4, max=100, avg=21.06, stdev=17.98 lat (msec): min=4, max=100, avg=21.07, stdev=17.98 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 30], 90.00th=[ 52], 95.00th=[ 64], | 99.00th=[ 81], 99.50th=[ 88], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 95, max= 928, per=23.83%, avg=308.33, stdev=169.46, samples=36 iops : min= 5, max= 58, avg=18.81, stdev=10.75, samples=36 write: IOPS=22, BW=354KiB/s (362kB/s)(6544KiB/18497msec); 0 zone resets clat (usec): min=6394, max=95506, avg=26660.17, stdev=15973.94 lat (usec): min=6396, max=95508, avg=26662.50, stdev=15973.87 clat percentiles (usec): | 1.00th=[ 7701], 5.00th=[ 9765], 10.00th=[11207], 20.00th=[13435], | 30.00th=[15795], 40.00th=[18744], 50.00th=[21627], 60.00th=[25822], | 70.00th=[31327], 80.00th=[39584], 90.00th=[49546], 95.00th=[59507], | 99.00th=[76022], 99.50th=[82314], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 191, max= 800, per=25.30%, avg=344.58, stdev=158.68, samples=36 iops : min= 11, max= 50, avg=21.08, stdev=10.01, samples=36 lat (msec) : 10=16.54%, 20=39.71%, 50=33.98%, 100=9.64%, 250=0.13% cpu : usr=0.14%, sys=9.27%, ctx=1395, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191941: Tue Sep 8 14:30:10 2026 read: IOPS=21, BW=343KiB/s (352kB/s)(6256KiB/18221msec) clat (msec): min=4, max=112, avg=21.33, stdev=15.60 lat (msec): min=4, max=112, avg=21.33, stdev=15.60 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 32], 90.00th=[ 44], 95.00th=[ 54], | 99.00th=[ 75], 99.50th=[ 89], 99.90th=[ 113], 99.95th=[ 113], | 99.99th=[ 113] bw ( KiB/s): min= 159, max= 800, per=26.60%, avg=344.22, stdev=172.25, samples=36 iops : min= 9, max= 50, avg=21.06, stdev=10.85, samples=36 write: IOPS=20, BW=331KiB/s (339kB/s)(6032KiB/18221msec); 0 zone resets clat (usec): min=6848, max=95831, avg=26029.22, stdev=15620.19 lat (usec): min=6850, max=95832, avg=26031.65, stdev=15620.01 clat percentiles (usec): | 1.00th=[ 7635], 5.00th=[ 9241], 10.00th=[10945], 20.00th=[13304], | 30.00th=[15008], 40.00th=[18482], 50.00th=[21890], 60.00th=[25560], | 70.00th=[29754], 80.00th=[36439], 90.00th=[49546], 95.00th=[60556], | 99.00th=[73925], 99.50th=[89654], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 127, max= 896, per=24.16%, avg=329.06, stdev=160.98, samples=36 iops : min= 7, max= 56, avg=20.11, stdev=10.19, samples=36 lat (msec) : 10=14.45%, 20=39.97%, 50=38.15%, 100=7.29%, 250=0.13% cpu : usr=0.12%, sys=9.74%, ctx=1542, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191942: Tue Sep 8 14:30:10 2026 read: IOPS=20, BW=328KiB/s (336kB/s)(6032KiB/18369msec) clat (msec): min=4, max=117, avg=20.98, stdev=16.07 lat (msec): min=4, max=117, avg=20.99, stdev=16.07 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 29], 90.00th=[ 43], 95.00th=[ 52], | 99.00th=[ 86], 99.50th=[ 102], 99.90th=[ 117], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 159, max= 736, per=25.17%, avg=325.75, stdev=155.76, samples=36 iops : min= 9, max= 46, avg=19.89, stdev= 9.87, samples=36 write: IOPS=21, BW=341KiB/s (349kB/s)(6256KiB/18369msec); 0 zone resets clat (usec): min=6506, max=96044, avg=26544.58, stdev=15760.65 lat (usec): min=6507, max=96045, avg=26547.00, stdev=15760.63 clat percentiles (usec): | 1.00th=[ 7046], 5.00th=[ 9110], 10.00th=[11338], 20.00th=[13829], | 30.00th=[16188], 40.00th=[18744], 50.00th=[21365], 60.00th=[26084], | 70.00th=[32375], 80.00th=[37487], 90.00th=[47449], 95.00th=[58459], | 99.00th=[78119], 99.50th=[85459], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 159, max= 1024, per=24.75%, avg=337.14, stdev=164.38, samples=36 iops : min= 9, max= 64, avg=20.61, stdev=10.41, samples=36 lat (msec) : 10=15.23%, 20=37.89%, 50=39.58%, 100=7.03%, 250=0.26% cpu : usr=0.09%, sys=9.69%, ctx=1492, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1295KiB/s (1326kB/s), 311KiB/s-343KiB/s (318kB/s-352kB/s), io=23.4MiB (24.5MB), run=18221-18497msec WRITE: bw=1362KiB/s (1395kB/s), 331KiB/s-354KiB/s (339kB/s-362kB/s), io=24.6MiB (25.8MB), run=18221-18497msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191957: Tue Sep 8 14:30:21 2026 read: IOPS=2, BW=2370KiB/s (2427kB/s)(7168KiB/3024msec) clat (usec): min=607, max=1199.6k, avg=293029.72, stdev=411005.99 lat (usec): min=609, max=1199.6k, avg=293031.59, stdev=411005.91 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], | 20.00th=[ 79168], 30.00th=[ 135267], 40.00th=[ 135267], | 50.00th=[ 145753], 60.00th=[ 179307], 70.00th=[ 179307], | 80.00th=[ 312476], 90.00th=[1199571], 95.00th=[1199571], | 99.00th=[1199571], 99.50th=[1199571], 99.90th=[1199571], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 2015, max= 4087, per=62.07%, avg=3039.00, stdev=1178.02, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1693KiB/s (1734kB/s)(5120KiB/3024msec); 0 zone resets clat (msec): min=94, max=295, avg=190.34, stdev=77.34 lat (msec): min=94, max=295, avg=190.42, stdev=77.31 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 95], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 2043, max= 6047, per=59.02%, avg=4045.00, stdev=2831.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 2000=8.33% cpu : usr=0.03%, sys=40.06%, ctx=1587, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191959: Tue Sep 8 14:30:21 2026 read: IOPS=0, BW=490KiB/s (501kB/s)(2048KiB/4183msec) clat (msec): min=153, max=273, avg=213.50, stdev=84.88 lat (msec): min=153, max=273, avg=213.51, stdev=84.88 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2039, max= 2048, per=41.74%, avg=2043.50, stdev= 6.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2448KiB/s (2507kB/s)(10.0MiB/4183msec); 0 zone resets clat (msec): min=65, max=1819, avg=368.37, stdev=530.09 lat (msec): min=65, max=1820, avg=368.51, stdev=530.11 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 68], | 30.00th=[ 126], 40.00th=[ 138], 50.00th=[ 169], 60.00th=[ 188], | 70.00th=[ 194], 80.00th=[ 397], 90.00th=[ 523], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 2048, max= 8192, per=79.68%, avg=5461.33, stdev=3128.37, samples=3 iops : min= 2, max= 8, avg= 5.33, stdev= 3.06, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=27.91%, ctx=457, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191962: Tue Sep 8 14:30:21 2026 read: IOPS=1, BW=1760KiB/s (1802kB/s)(6144KiB/3491msec) clat (usec): min=659, max=207994, avg=114253.21, stdev=75207.28 lat (usec): min=661, max=207995, avg=114254.28, stdev=75207.00 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 52691], | 30.00th=[ 52691], 40.00th=[125305], 50.00th=[125305], 60.00th=[139461], | 70.00th=[160433], 80.00th=[160433], 90.00th=[208667], 95.00th=[208667], | 99.00th=[208667], 99.50th=[208667], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 2043, max= 4096, per=69.24%, avg=3390.00, stdev=1166.99, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1760KiB/s (1802kB/s)(6144KiB/3491msec); 0 zone resets clat (msec): min=158, max=1518, avg=452.76, stdev=535.36 lat (msec): min=158, max=1518, avg=452.84, stdev=535.36 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 201], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 2015, max= 4047, per=37.03%, avg=2538.25, stdev=1005.94, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=36.62%, ctx=308, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191963: Tue Sep 8 14:30:21 2026 read: IOPS=1, BW=1350KiB/s (1382kB/s)(5120KiB/3793msec) clat (usec): min=601, max=199315, avg=96844.19, stdev=91003.15 lat (usec): min=602, max=199316, avg=96845.56, stdev=91003.16 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 881], 40.00th=[ 881], 50.00th=[133694], 60.00th=[133694], | 70.00th=[149947], 80.00th=[149947], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 4096, max= 4096, per=83.66%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1890KiB/s (1935kB/s)(7168KiB/3793msec); 0 zone resets clat (msec): min=138, max=1688, avg=456.60, stdev=554.96 lat (msec): min=138, max=1688, avg=456.70, stdev=554.97 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 148], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 205], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 409], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1365, max= 4096, per=33.75%, avg=2313.40, stdev=1037.99, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.03%, sys=33.70%, ctx=753, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4896KiB/s (5014kB/s), 490KiB/s-2370KiB/s (501kB/s-2427kB/s), io=20.0MiB (20.0MB), run=3024-4183msec WRITE: bw=6854KiB/s (7019kB/s), 1693KiB/s-2448KiB/s (1734kB/s-2507kB/s), io=28.0MiB (29.4MB), run=3024-4183msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191956: Tue Sep 8 14:30:21 2026 read: IOPS=2, BW=2128KiB/s (2179kB/s)(7168KiB/3368msec) clat (msec): min=53, max=1080, avg=276.97, stdev=365.25 lat (msec): min=53, max=1080, avg=276.97, stdev=365.25 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 88], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 115], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 313], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 2039, max= 5785, per=83.47%, avg=3973.33, stdev=1876.01, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=1520KiB/s (1557kB/s)(5120KiB/3368msec); 0 zone resets clat (msec): min=110, max=752, avg=282.26, stdev=267.73 lat (msec): min=110, max=752, avg=282.38, stdev=267.73 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1928, max= 4079, per=40.29%, avg=2685.00, stdev=1208.73, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=16.78%, ctx=138, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191958: Tue Sep 8 14:30:21 2026 read: IOPS=0, BW=505KiB/s (518kB/s)(2048KiB/4052msec) clat (msec): min=77, max=403, avg=240.35, stdev=230.98 lat (msec): min=77, max=403, avg=240.36, stdev=230.98 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 78], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1899, max= 2048, per=41.46%, avg=1973.50, stdev=105.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2527KiB/s (2588kB/s)(10.0MiB/4052msec); 0 zone resets clat (msec): min=38, max=1689, avg=349.43, stdev=492.82 lat (msec): min=38, max=1689, avg=349.53, stdev=492.82 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 39], 10.00th=[ 39], 20.00th=[ 55], | 30.00th=[ 125], 40.00th=[ 144], 50.00th=[ 178], 60.00th=[ 182], | 70.00th=[ 184], 80.00th=[ 388], 90.00th=[ 514], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 2039, max= 8175, per=69.05%, avg=4601.50, stdev=3067.90, samples=4 iops : min= 1, max= 7, avg= 4.00, stdev= 2.94, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=14.22%, ctx=308, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191960: Tue Sep 8 14:30:21 2026 read: IOPS=1, BW=1900KiB/s (1945kB/s)(6144KiB/3234msec) clat (msec): min=50, max=270, avg=127.31, stdev=78.56 lat (msec): min=50, max=270, avg=127.31, stdev=78.56 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 122], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 2048, max= 4096, per=71.59%, avg=3407.67, stdev=1177.54, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1900KiB/s (1945kB/s)(6144KiB/3234msec); 0 zone resets clat (msec): min=78, max=1271, avg=408.29, stdev=466.65 lat (msec): min=78, max=1272, avg=408.39, stdev=466.65 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 211], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 2048, max= 4079, per=50.58%, avg=3370.33, stdev=1146.16, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (msec) : 100=33.33%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=15.13%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191961: Tue Sep 8 14:30:21 2026 read: IOPS=1, BW=1190KiB/s (1219kB/s)(5120KiB/4302msec) clat (msec): min=21, max=590, avg=267.25, stdev=240.79 lat (msec): min=21, max=590, avg=267.25, stdev=240.79 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 22], 10.00th=[ 22], 20.00th=[ 22], | 30.00th=[ 55], 40.00th=[ 55], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 4096, max= 4096, per=86.05%, avg=4096.00, stdev= 0.00, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1666KiB/s (1706kB/s)(7168KiB/4302msec); 0 zone resets clat (msec): min=124, max=1487, avg=414.95, stdev=482.90 lat (msec): min=124, max=1487, avg=415.06, stdev=482.91 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 146], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 255], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 418], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 2011, max= 4079, per=38.21%, avg=2546.50, stdev=1021.82, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=15.18%, ctx=114, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4761KiB/s (4875kB/s), 505KiB/s-2128KiB/s (518kB/s-2179kB/s), io=20.0MiB (20.0MB), run=3234-4302msec WRITE: bw=6665KiB/s (6825kB/s), 1520KiB/s-2527KiB/s (1557kB/s-2588kB/s), io=28.0MiB (29.4MB), run=3234-4302msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=191971: Tue Sep 8 14:30:29 2026 read: IOPS=2, BW=8308KiB/s (8508kB/s)(12.0MiB/1479msec) clat (msec): min=431, max=514, avg=466.91, stdev=42.58 lat (msec): min=431, max=514, avg=466.92, stdev=42.58 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 6770, max= 8159, per=87.16%, avg=7464.50, stdev=982.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=17.12%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191973: Tue Sep 8 14:30:29 2026 read: IOPS=0, BW=2141KiB/s (2193kB/s)(4096KiB/1913msec) clat (nsec): min=955157k, max=955157k, avg=955157229.00, stdev= 0.00 lat (nsec): min=955161k, max=955161k, avg=955160661.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8159, max= 8159, per=95.27%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4282KiB/s (4385kB/s)(8192KiB/1913msec); 0 zone resets clat (msec): min=287, max=651, avg=469.54, stdev=257.19 lat (msec): min=287, max=651, avg=469.88, stdev=257.29 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=14.54%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191975: Tue Sep 8 14:30:29 2026 write: IOPS=1, BW=6295KiB/s (6446kB/s)(12.0MiB/1952msec); 0 zone resets clat (msec): min=209, max=1447, avg=630.17, stdev=707.92 lat (msec): min=209, max=1448, avg=630.79, stdev=708.27 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8143, max= 8143, per=50.35%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.05%, sys=16.76%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191976: Tue Sep 8 14:30:29 2026 write: IOPS=1, BW=6065KiB/s (6211kB/s)(12.0MiB/2026msec); 0 zone resets clat (msec): min=511, max=778, avg=669.75, stdev=140.19 lat (msec): min=512, max=779, avg=670.14, stdev=140.18 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8143, max= 8159, per=50.40%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.10%, sys=12.54%, ctx=79, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8565KiB/s (8770kB/s), 2141KiB/s-8308KiB/s (2193kB/s-8508kB/s), io=16.0MiB (16.8MB), run=1479-1913msec WRITE: bw=15.8MiB/s (16.6MB/s), 4282KiB/s-6295KiB/s (4385kB/s-6446kB/s), io=32.0MiB (33.6MB), run=1913-2026msec rand-rw: (groupid=0, jobs=1): err= 0: pid=191970: Tue Sep 8 14:30:29 2026 read: IOPS=2, BW=9170KiB/s (9390kB/s)(12.0MiB/1340msec) clat (msec): min=396, max=457, avg=430.69, stdev=30.84 lat (msec): min=396, max=457, avg=430.69, stdev=30.84 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7086, max= 8015, per=69.96%, avg=7550.50, stdev=656.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=53.40%, ctx=2225, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191972: Tue Sep 8 14:30:29 2026 read: IOPS=0, BW=2698KiB/s (2763kB/s)(4096KiB/1518msec) clat (nsec): min=457089k, max=457089k, avg=457088919.00, stdev= 0.00 lat (nsec): min=457090k, max=457090k, avg=457090264.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 6895, max= 6895, per=63.88%, avg=6895.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5397KiB/s (5526kB/s)(8192KiB/1518msec); 0 zone resets clat (msec): min=462, max=532, avg=497.59, stdev=49.08 lat (msec): min=463, max=532, avg=497.91, stdev=49.08 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 8015, max= 8015, per=55.21%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=23.53%, ctx=584, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191974: Tue Sep 8 14:30:29 2026 write: IOPS=1, BW=5444KiB/s (5575kB/s)(12.0MiB/2257msec); 0 zone resets clat (msec): min=93, max=1738, avg=709.71, stdev=896.39 lat (msec): min=94, max=1739, avg=710.33, stdev=897.00 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.04%, sys=12.72%, ctx=93, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=191977: Tue Sep 8 14:30:29 2026 write: IOPS=1, BW=6231KiB/s (6381kB/s)(12.0MiB/1972msec); 0 zone resets clat (msec): min=192, max=1341, avg=627.63, stdev=623.44 lat (msec): min=193, max=1342, avg=628.16, stdev=623.30 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 6627, max= 8015, per=50.43%, avg=7321.00, stdev=981.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.10%, sys=14.36%, ctx=100, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.5MiB/s (11.1MB/s), 2698KiB/s-9170KiB/s (2763kB/s-9390kB/s), io=16.0MiB (16.8MB), run=1340-1518msec WRITE: bw=14.2MiB/s (14.9MB/s), 5397KiB/s-6231KiB/s (5526kB/s-6381kB/s), io=32.0MiB (33.6MB), run=1518-2257msec