== sanity test 398b: DIO and buffer IO race ============== 02:34:05 (1788849245) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.43709 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145451: Tue Sep 8 02:36:03 2026 read: IOPS=15, BW=60.2KiB/s (61.7kB/s)(5992KiB/99456msec) clat (usec): min=26, max=823219, avg=32838.23, stdev=32089.48 lat (usec): min=26, max=823222, avg=32840.94, stdev=32089.12 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 123], 20.00th=[ 15533], | 30.00th=[ 19268], 40.00th=[ 23462], 50.00th=[ 27919], 60.00th=[ 33162], | 70.00th=[ 40109], 80.00th=[ 48497], 90.00th=[ 61604], 95.00th=[ 72877], | 99.00th=[119014], 99.50th=[135267], 99.90th=[379585], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 7, max= 128, per=25.27%, avg=59.89, stdev=26.54, samples=195 iops : min= 1, max= 32, avg=14.34, stdev= 6.68, samples=195 write: IOPS=15, BW=63.3KiB/s (64.8kB/s)(6296KiB/99456msec); 0 zone resets clat (usec): min=827, max=389110, avg=31761.74, stdev=33560.37 lat (usec): min=828, max=389112, avg=31766.88, stdev=33562.78 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1450], 20.00th=[ 3556], | 30.00th=[ 6849], 40.00th=[ 16188], 50.00th=[ 24511], 60.00th=[ 32113], | 70.00th=[ 41681], 80.00th=[ 53216], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[141558], 99.50th=[177210], 99.90th=[274727], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 15, max= 167, per=25.43%, avg=63.31, stdev=24.81, samples=194 iops : min= 3, max= 41, avg=15.20, stdev= 6.23, samples=194 lat (usec) : 50=0.42%, 100=4.17%, 250=0.42%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.36% lat (msec) : 2=6.80%, 4=4.17%, 10=7.16%, 20=14.81%, 50=40.98% lat (msec) : 100=18.16%, 250=2.25%, 500=0.16%, 1000=0.03% cpu : usr=0.11%, sys=6.14%, ctx=6520, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145452: Tue Sep 8 02:36:03 2026 read: IOPS=15, BW=60.0KiB/s (61.5kB/s)(5940KiB/98920msec) clat (usec): min=36, max=275421, avg=32739.87, stdev=24305.10 lat (usec): min=36, max=275422, avg=32744.22, stdev=24303.54 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 67], 10.00th=[ 7439], 20.00th=[ 15926], | 30.00th=[ 19792], 40.00th=[ 23462], 50.00th=[ 27657], 60.00th=[ 32900], | 70.00th=[ 39584], 80.00th=[ 48497], 90.00th=[ 61604], 95.00th=[ 73925], | 99.00th=[107480], 99.50th=[131597], 99.90th=[223347], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 5, max= 127, per=25.18%, avg=59.68, stdev=23.58, samples=195 iops : min= 1, max= 31, avg=14.29, stdev= 5.92, samples=195 write: IOPS=16, BW=64.2KiB/s (65.7kB/s)(6348KiB/98920msec); 0 zone resets clat (usec): min=823, max=807677, avg=31551.19, stdev=38173.20 lat (usec): min=824, max=807679, avg=31559.30, stdev=38176.00 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1270], 10.00th=[ 1647], 20.00th=[ 3490], | 30.00th=[ 6849], 40.00th=[ 13698], 50.00th=[ 22414], 60.00th=[ 30802], | 70.00th=[ 40109], 80.00th=[ 54264], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[145753], 99.50th=[183501], 99.90th=[304088], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 15, max= 144, per=25.74%, avg=64.09, stdev=25.37, samples=194 iops : min= 3, max= 36, avg=15.41, stdev= 6.38, samples=194 lat (usec) : 50=0.52%, 100=3.16%, 250=0.62%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=6.38%, 4=5.08%, 10=7.29%, 20=15.72%, 50=40.23% lat (msec) : 100=18.10%, 250=2.31%, 500=0.10%, 1000=0.03% cpu : usr=0.12%, sys=6.20%, ctx=6476, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145453: Tue Sep 8 02:36:03 2026 read: IOPS=15, BW=60.6KiB/s (62.1kB/s)(6028KiB/99446msec) clat (usec): min=30, max=173532, avg=31225.05, stdev=23217.30 lat (usec): min=31, max=173534, avg=31230.46, stdev=23214.29 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 125], 20.00th=[ 14877], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 26346], 60.00th=[ 31589], | 70.00th=[ 38536], 80.00th=[ 47973], 90.00th=[ 59507], 95.00th=[ 70779], | 99.00th=[116917], 99.50th=[133694], 99.90th=[166724], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 7, max= 128, per=25.73%, avg=60.99, stdev=25.05, samples=193 iops : min= 1, max= 32, avg=14.62, stdev= 6.30, samples=193 write: IOPS=15, BW=62.9KiB/s (64.5kB/s)(6260KiB/99446msec); 0 zone resets clat (usec): min=644, max=1030.1k, avg=33304.35, stdev=42465.88 lat (usec): min=644, max=1030.1k, avg=33316.13, stdev=42469.79 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1532], | 20.00th=[ 3458], 30.00th=[ 8586], 40.00th=[ 16909], | 50.00th=[ 25035], 60.00th=[ 33162], 70.00th=[ 42206], | 80.00th=[ 54264], 90.00th=[ 73925], 95.00th=[ 92799], | 99.00th=[ 154141], 99.50th=[ 189793], 99.90th=[ 400557], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 15, max= 127, per=25.28%, avg=62.96, stdev=24.09, samples=194 iops : min= 3, max= 31, avg=15.12, stdev= 6.06, samples=194 lat (usec) : 50=0.62%, 100=4.04%, 250=0.52%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=6.48%, 4=4.33%, 10=6.54%, 20=15.63%, 50=40.53% lat (msec) : 100=17.94%, 250=2.77%, 500=0.07%, 2000=0.03% cpu : usr=0.11%, sys=6.03%, ctx=6537, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145454: Tue Sep 8 02:36:03 2026 read: IOPS=14, BW=59.0KiB/s (61.4kB/s)(6052KiB/100925msec) clat (usec): min=27, max=358179, avg=31870.95, stdev=25960.75 lat (usec): min=28, max=358181, avg=31872.49, stdev=25960.74 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 110], 20.00th=[ 14615], | 30.00th=[ 19268], 40.00th=[ 23462], 50.00th=[ 27657], 60.00th=[ 32375], | 70.00th=[ 38536], 80.00th=[ 46924], 90.00th=[ 60556], 95.00th=[ 72877], | 99.00th=[113771], 99.50th=[135267], 99.90th=[256902], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 159, per=25.35%, avg=60.08, stdev=26.51, samples=196 iops : min= 1, max= 39, avg=14.39, stdev= 6.65, samples=196 write: IOPS=15, BW=61.8KiB/s (63.3kB/s)(6236KiB/100925msec); 0 zone resets clat (usec): min=803, max=960769, avg=33647.52, stdev=41455.46 lat (usec): min=805, max=960773, avg=33650.01, stdev=41455.68 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1303], 10.00th=[ 1696], 20.00th=[ 3392], | 30.00th=[ 6849], 40.00th=[ 15139], 50.00th=[ 23725], 60.00th=[ 32375], | 70.00th=[ 44303], 80.00th=[ 57410], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[147850], 99.50th=[168821], 99.90th=[304088], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 190, per=24.76%, avg=61.64, stdev=26.84, samples=197 iops : min= 1, max= 47, avg=14.78, stdev= 6.73, samples=197 lat (usec) : 50=0.49%, 100=4.30%, 250=0.59%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=5.99%, 4=5.34%, 10=7.32%, 20=14.26%, 50=40.17% lat (msec) : 100=17.77%, 250=3.19%, 500=0.10%, 1000=0.03% cpu : usr=0.11%, sys=6.07%, ctx=6609, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=238KiB/s (244kB/s), 59.0KiB/s-60.6KiB/s (61.4kB/s-62.1kB/s), io=23.4MiB (24.6MB), run=98920-100925msec WRITE: bw=249KiB/s (255kB/s), 61.8KiB/s-64.2KiB/s (63.3kB/s-65.7kB/s), io=24.6MiB (25.7MB), run=98920-100925msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145446: Tue Sep 8 02:37:40 2026 read: IOPS=7, BW=30.2KiB/s (30.9kB/s)(5992KiB/198588msec) clat (msec): min=4, max=863, avg=27.11, stdev=35.68 lat (msec): min=4, max=863, avg=27.11, stdev=35.68 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 36], 90.00th=[ 59], 95.00th=[ 83], | 99.00th=[ 133], 99.50th=[ 199], 99.90th=[ 326], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 103, per=26.97%, avg=32.37, stdev=21.24, samples=361 iops : min= 1, max= 25, avg= 7.50, stdev= 5.35, samples=361 write: IOPS=7, BW=31.7KiB/s (32.5kB/s)(6296KiB/198588msec); 0 zone resets clat (msec): min=30, max=480, avg=100.13, stdev=51.26 lat (msec): min=30, max=480, avg=100.14, stdev=51.26 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 61], | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 86], 60.00th=[ 100], | 70.00th=[ 114], 80.00th=[ 136], 90.00th=[ 169], 95.00th=[ 199], | 99.00th=[ 271], 99.50th=[ 334], 99.90th=[ 414], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 71, per=24.88%, avg=31.35, stdev=15.21, samples=391 iops : min= 1, max= 17, avg= 7.24, stdev= 3.88, samples=391 lat (msec) : 10=8.66%, 20=20.87%, 50=17.61%, 100=31.58%, 250=20.41% lat (msec) : 500=0.85%, 1000=0.03% cpu : usr=0.06%, sys=1.43%, ctx=5317, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145447: Tue Sep 8 02:37:40 2026 read: IOPS=7, BW=29.9KiB/s (30.6kB/s)(5940KiB/198686msec) clat (msec): min=4, max=913, avg=26.70, stdev=35.06 lat (msec): min=4, max=913, avg=26.70, stdev=35.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 37], 90.00th=[ 58], 95.00th=[ 84], | 99.00th=[ 132], 99.50th=[ 153], 99.90th=[ 228], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 111, per=26.68%, avg=32.02, stdev=21.31, samples=361 iops : min= 1, max= 27, avg= 7.41, stdev= 5.37, samples=361 write: IOPS=7, BW=31.9KiB/s (32.7kB/s)(6348KiB/198686msec); 0 zone resets clat (msec): min=29, max=450, avg=100.02, stdev=48.98 lat (msec): min=29, max=450, avg=100.03, stdev=48.98 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 62], | 30.00th=[ 70], 40.00th=[ 78], 50.00th=[ 88], 60.00th=[ 100], | 70.00th=[ 114], 80.00th=[ 136], 90.00th=[ 165], 95.00th=[ 197], | 99.00th=[ 266], 99.50th=[ 313], 99.90th=[ 351], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 72, per=25.00%, avg=31.49, stdev=15.05, samples=392 iops : min= 1, max= 18, avg= 7.27, stdev= 3.85, samples=392 lat (msec) : 10=9.73%, 20=19.86%, 50=16.73%, 100=31.80%, 250=21.29% lat (msec) : 500=0.55%, 1000=0.03% cpu : usr=0.05%, sys=1.42%, ctx=5338, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145448: Tue Sep 8 02:37:40 2026 read: IOPS=7, BW=30.3KiB/s (31.1kB/s)(6028KiB/198641msec) clat (msec): min=4, max=278, avg=26.57, stdev=27.05 lat (msec): min=4, max=278, avg=26.58, stdev=27.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 39], 90.00th=[ 58], 95.00th=[ 80], | 99.00th=[ 127], 99.50th=[ 159], 99.90th=[ 266], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 119, per=26.38%, avg=31.66, stdev=21.67, samples=371 iops : min= 1, max= 29, avg= 7.32, stdev= 5.49, samples=371 write: IOPS=7, BW=31.5KiB/s (32.3kB/s)(6260KiB/198641msec); 0 zone resets clat (msec): min=27, max=1001, avg=101.14, stdev=55.38 lat (msec): min=27, max=1001, avg=101.14, stdev=55.38 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 62], | 30.00th=[ 69], 40.00th=[ 79], 50.00th=[ 88], 60.00th=[ 99], | 70.00th=[ 114], 80.00th=[ 134], 90.00th=[ 165], 95.00th=[ 201], | 99.00th=[ 271], 99.50th=[ 300], 99.90th=[ 485], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 71, per=24.65%, avg=31.06, stdev=15.14, samples=392 iops : min= 1, max= 17, avg= 7.16, stdev= 3.86, samples=392 lat (msec) : 10=8.76%, 20=20.54%, 50=17.48%, 100=32.10%, 250=20.25% lat (msec) : 500=0.85%, 2000=0.03% cpu : usr=0.05%, sys=1.39%, ctx=5152, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145449: Tue Sep 8 02:37:40 2026 read: IOPS=7, BW=30.7KiB/s (31.5kB/s)(6052KiB/197048msec) clat (msec): min=4, max=333, avg=25.81, stdev=28.07 lat (msec): min=4, max=333, avg=25.82, stdev=28.07 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 33], 90.00th=[ 59], 95.00th=[ 79], | 99.00th=[ 132], 99.50th=[ 197], 99.90th=[ 271], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 135, per=26.66%, avg=31.99, stdev=21.83, samples=368 iops : min= 1, max= 33, avg= 7.40, stdev= 5.54, samples=368 write: IOPS=7, BW=31.6KiB/s (32.4kB/s)(6236KiB/197048msec); 0 zone resets clat (msec): min=30, max=979, avg=101.14, stdev=54.33 lat (msec): min=30, max=979, avg=101.14, stdev=54.33 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 46], 10.00th=[ 52], 20.00th=[ 62], | 30.00th=[ 69], 40.00th=[ 77], 50.00th=[ 88], 60.00th=[ 101], | 70.00th=[ 116], 80.00th=[ 136], 90.00th=[ 167], 95.00th=[ 199], | 99.00th=[ 271], 99.50th=[ 321], 99.90th=[ 363], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 72, per=24.91%, avg=31.38, stdev=14.65, samples=386 iops : min= 1, max= 18, avg= 7.24, stdev= 3.75, samples=386 lat (msec) : 10=8.98%, 20=21.55%, 50=17.09%, 100=30.96%, 250=20.67% lat (msec) : 500=0.72%, 1000=0.03% cpu : usr=0.06%, sys=1.40%, ctx=5189, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=121KiB/s (124kB/s), 29.9KiB/s-30.7KiB/s (30.6kB/s-31.5kB/s), io=23.4MiB (24.6MB), run=197048-198686msec WRITE: bw=127KiB/s (130kB/s), 31.5KiB/s-31.9KiB/s (32.3kB/s-32.7kB/s), io=24.6MiB (25.7MB), run=197048-198686msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145503: Tue Sep 8 02:38:16 2026 read: IOPS=15, BW=250KiB/s (256kB/s)(5920KiB/23669msec) clat (usec): min=38, max=182279, avg=31735.19, stdev=28597.39 lat (usec): min=38, max=182280, avg=31736.56, stdev=28597.38 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 84], | 30.00th=[ 15401], 40.00th=[ 23462], 50.00th=[ 28967], 60.00th=[ 35914], | 70.00th=[ 42206], 80.00th=[ 52691], 90.00th=[ 65274], 95.00th=[ 79168], | 99.00th=[131597], 99.50th=[160433], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 93, max= 477, per=26.48%, avg=245.17, stdev=99.14, samples=46 iops : min= 5, max= 29, avg=14.61, stdev= 6.31, samples=46 write: IOPS=16, BW=269KiB/s (276kB/s)(6368KiB/23669msec); 0 zone resets clat (usec): min=1208, max=257480, avg=29100.18, stdev=36534.63 lat (usec): min=1210, max=257484, avg=29102.53, stdev=36534.54 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1745], 10.00th=[ 1975], 20.00th=[ 3589], | 30.00th=[ 5735], 40.00th=[ 8225], 50.00th=[ 14877], 60.00th=[ 24249], | 70.00th=[ 33817], 80.00th=[ 47973], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[179307], 99.50th=[233833], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 480, per=27.38%, avg=266.65, stdev=111.83, samples=46 iops : min= 1, max= 30, avg=15.98, stdev= 7.08, samples=46 lat (usec) : 50=1.30%, 100=9.90%, 250=1.30%, 500=0.26%, 750=0.26% lat (msec) : 2=5.47%, 4=6.12%, 10=11.20%, 20=9.51%, 50=34.38% lat (msec) : 100=16.54%, 250=3.65%, 500=0.13% cpu : usr=0.06%, sys=6.31%, ctx=1398, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145504: Tue Sep 8 02:38:16 2026 read: IOPS=14, BW=230KiB/s (236kB/s)(5744KiB/24929msec) clat (usec): min=38, max=334441, avg=37106.38, stdev=32729.03 lat (usec): min=38, max=334442, avg=37108.17, stdev=32729.25 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 130], | 30.00th=[ 22414], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 46924], 80.00th=[ 59507], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[124257], 99.50th=[175113], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 61, max= 415, per=24.73%, avg=228.96, stdev=83.82, samples=49 iops : min= 3, max= 25, avg=13.61, stdev= 5.29, samples=49 write: IOPS=16, BW=263KiB/s (269kB/s)(6544KiB/24929msec); 0 zone resets clat (usec): min=1193, max=193951, avg=28058.19, stdev=31190.66 lat (usec): min=1195, max=193954, avg=28060.54, stdev=31190.87 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1729], 10.00th=[ 2057], 20.00th=[ 3982], | 30.00th=[ 6325], 40.00th=[ 8848], 50.00th=[ 16319], 60.00th=[ 23987], | 70.00th=[ 35390], 80.00th=[ 51119], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[141558], 99.50th=[143655], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 508, per=26.95%, avg=262.51, stdev=114.11, samples=49 iops : min= 1, max= 31, avg=15.71, stdev= 7.22, samples=49 lat (usec) : 50=1.04%, 100=7.68%, 250=1.17%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.56%, 4=6.12%, 10=11.33%, 20=10.81%, 50=33.07% lat (msec) : 100=20.83%, 250=2.86%, 500=0.13% cpu : usr=0.08%, sys=6.23%, ctx=1454, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145505: Tue Sep 8 02:38:16 2026 read: IOPS=15, BW=242KiB/s (248kB/s)(6256KiB/25849msec) clat (usec): min=36, max=541123, avg=34706.53, stdev=37845.16 lat (usec): min=36, max=541124, avg=34707.93, stdev=37845.16 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 103], | 30.00th=[ 20317], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 44303], 80.00th=[ 54789], 90.00th=[ 66323], 95.00th=[ 82314], | 99.00th=[113771], 99.50th=[193987], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 31, max= 480, per=26.21%, avg=242.69, stdev=104.13, samples=51 iops : min= 1, max= 30, avg=14.45, stdev= 6.55, samples=51 write: IOPS=14, BW=233KiB/s (239kB/s)(6032KiB/25849msec); 0 zone resets clat (usec): min=1209, max=252073, avg=31739.88, stdev=33661.46 lat (usec): min=1211, max=252076, avg=31745.38, stdev=33664.53 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1926], 10.00th=[ 2507], 20.00th=[ 4883], | 30.00th=[ 8848], 40.00th=[ 15664], 50.00th=[ 22676], 60.00th=[ 30540], | 70.00th=[ 40633], 80.00th=[ 52167], 90.00th=[ 71828], 95.00th=[ 96994], | 99.00th=[154141], 99.50th=[221250], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 63, max= 447, per=23.93%, avg=233.04, stdev=94.14, samples=51 iops : min= 3, max= 27, avg=13.86, stdev= 5.93, samples=51 lat (usec) : 50=1.17%, 100=8.59%, 250=1.17%, 500=0.78%, 1000=0.26% lat (msec) : 2=3.65%, 4=4.56%, 10=8.20%, 20=9.64%, 50=39.45% lat (msec) : 100=19.27%, 250=2.99%, 500=0.13%, 750=0.13% cpu : usr=0.12%, sys=6.17%, ctx=1483, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145506: Tue Sep 8 02:38:16 2026 read: IOPS=14, BW=238KiB/s (244kB/s)(6032KiB/25364msec) clat (usec): min=36, max=269612, avg=34697.29, stdev=34570.82 lat (usec): min=37, max=269613, avg=34707.42, stdev=34562.49 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 82], | 30.00th=[ 18220], 40.00th=[ 25297], 50.00th=[ 30802], 60.00th=[ 35914], | 70.00th=[ 42206], 80.00th=[ 51119], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[187696], 99.50th=[244319], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 479, per=26.19%, avg=242.55, stdev=113.54, samples=49 iops : min= 1, max= 29, avg=14.47, stdev= 7.15, samples=49 write: IOPS=15, BW=247KiB/s (253kB/s)(6256KiB/25364msec); 0 zone resets clat (usec): min=1290, max=314040, avg=30408.84, stdev=35371.47 lat (usec): min=1292, max=314043, avg=30411.48, stdev=35372.11 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1778], 10.00th=[ 2278], 20.00th=[ 4293], | 30.00th=[ 6194], 40.00th=[ 9372], 50.00th=[ 17695], 60.00th=[ 27657], | 70.00th=[ 39060], 80.00th=[ 52691], 90.00th=[ 72877], 95.00th=[100140], | 99.00th=[156238], 99.50th=[177210], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 500, per=25.39%, avg=247.30, stdev=111.85, samples=50 iops : min= 1, max= 31, avg=14.76, stdev= 7.08, samples=50 lat (usec) : 50=1.04%, 100=10.29%, 250=0.65%, 500=0.26% lat (msec) : 2=4.56%, 4=5.34%, 10=11.59%, 20=9.24%, 50=35.29% lat (msec) : 100=17.32%, 250=4.17%, 500=0.26% cpu : usr=0.07%, sys=6.19%, ctx=1440, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=927KiB/s (949kB/s), 230KiB/s-250KiB/s (236kB/s-256kB/s), io=23.4MiB (24.5MB), run=23669-25849msec WRITE: bw=975KiB/s (998kB/s), 233KiB/s-269KiB/s (239kB/s-276kB/s), io=24.6MiB (25.8MB), run=23669-25849msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145499: Tue Sep 8 02:38:43 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(5920KiB/52380msec) clat (msec): min=6, max=374, avg=31.31, stdev=38.08 lat (msec): min=6, max=374, avg=31.31, stdev=38.08 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 45], 90.00th=[ 65], 95.00th=[ 95], | 99.00th=[ 239], 99.50th=[ 342], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 30, max= 414, per=25.64%, avg=116.15, stdev=78.86, samples=99 iops : min= 1, max= 25, avg= 6.52, stdev= 4.99, samples=99 write: IOPS=7, BW=122KiB/s (124kB/s)(6368KiB/52380msec); 0 zone resets clat (msec): min=31, max=533, avg=102.04, stdev=59.99 lat (msec): min=31, max=533, avg=102.04, stdev=59.99 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 47], 10.00th=[ 52], 20.00th=[ 58], | 30.00th=[ 65], 40.00th=[ 73], 50.00th=[ 83], 60.00th=[ 99], | 70.00th=[ 112], 80.00th=[ 138], 90.00th=[ 180], 95.00th=[ 211], | 99.00th=[ 317], 99.50th=[ 355], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 29, max= 255, per=25.82%, avg=123.14, stdev=63.70, samples=101 iops : min= 1, max= 15, avg= 6.93, stdev= 4.05, samples=101 lat (msec) : 10=6.77%, 20=18.88%, 50=19.27%, 100=33.20%, 250=19.92% lat (msec) : 500=1.82%, 750=0.13% cpu : usr=0.05%, sys=1.48%, ctx=1234, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145500: Tue Sep 8 02:38:43 2026 read: IOPS=6, BW=109KiB/s (111kB/s)(5744KiB/52790msec) clat (msec): min=5, max=422, avg=30.63, stdev=42.24 lat (msec): min=5, max=422, avg=30.63, stdev=42.24 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 37], 90.00th=[ 71], 95.00th=[ 105], | 99.00th=[ 192], 99.50th=[ 338], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 29, max= 415, per=26.59%, avg=120.44, stdev=86.61, samples=93 iops : min= 1, max= 25, avg= 6.76, stdev= 5.46, samples=93 write: IOPS=7, BW=124KiB/s (127kB/s)(6544KiB/52790msec); 0 zone resets clat (msec): min=34, max=376, avg=101.49, stdev=53.96 lat (msec): min=34, max=376, avg=101.50, stdev=53.96 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 45], 10.00th=[ 50], 20.00th=[ 60], | 30.00th=[ 69], 40.00th=[ 75], 50.00th=[ 84], 60.00th=[ 96], | 70.00th=[ 115], 80.00th=[ 146], 90.00th=[ 180], 95.00th=[ 203], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 256, per=26.20%, avg=124.97, stdev=62.52, samples=102 iops : min= 1, max= 16, avg= 7.05, stdev= 3.99, samples=102 lat (msec) : 10=8.46%, 20=19.27%, 50=17.45%, 100=32.81%, 250=20.44% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.49%, ctx=1352, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145501: Tue Sep 8 02:38:43 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/52180msec) clat (msec): min=6, max=184, avg=28.17, stdev=27.37 lat (msec): min=6, max=184, avg=28.18, stdev=27.37 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 41], 90.00th=[ 60], 95.00th=[ 92], | 99.00th=[ 140], 99.50th=[ 174], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 415, per=28.51%, avg=129.16, stdev=92.24, samples=96 iops : min= 1, max= 25, avg= 7.31, stdev= 5.81, samples=96 write: IOPS=7, BW=116KiB/s (118kB/s)(6032KiB/52180msec); 0 zone resets clat (msec): min=33, max=412, avg=109.00, stdev=62.01 lat (msec): min=33, max=412, avg=109.00, stdev=62.01 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 62], | 30.00th=[ 70], 40.00th=[ 79], 50.00th=[ 88], 60.00th=[ 99], | 70.00th=[ 128], 80.00th=[ 150], 90.00th=[ 199], 95.00th=[ 247], | 99.00th=[ 300], 99.50th=[ 313], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 31, max= 255, per=24.29%, avg=115.86, stdev=60.43, samples=102 iops : min= 1, max= 15, avg= 6.48, stdev= 3.84, samples=102 lat (msec) : 10=7.81%, 20=19.92%, 50=19.14%, 100=32.16%, 250=19.01% lat (msec) : 500=1.95% cpu : usr=0.05%, sys=1.51%, ctx=1301, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145502: Tue Sep 8 02:38:43 2026 read: IOPS=7, BW=115KiB/s (117kB/s)(6032KiB/52585msec) clat (msec): min=5, max=269, avg=30.40, stdev=36.94 lat (msec): min=5, max=269, avg=30.40, stdev=36.94 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 64], 95.00th=[ 94], | 99.00th=[ 234], 99.50th=[ 247], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 380, per=26.77%, avg=121.28, stdev=82.35, samples=97 iops : min= 1, max= 23, avg= 6.84, stdev= 5.23, samples=97 write: IOPS=7, BW=119KiB/s (122kB/s)(6256KiB/52585msec); 0 zone resets clat (msec): min=32, max=528, avg=104.58, stdev=58.94 lat (msec): min=32, max=528, avg=104.59, stdev=58.95 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 47], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 70], 40.00th=[ 79], 50.00th=[ 86], 60.00th=[ 94], | 70.00th=[ 117], 80.00th=[ 146], 90.00th=[ 184], 95.00th=[ 220], | 99.00th=[ 296], 99.50th=[ 347], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 31, max= 255, per=25.29%, avg=120.65, stdev=62.55, samples=102 iops : min= 1, max= 15, avg= 6.77, stdev= 3.97, samples=102 lat (msec) : 10=7.68%, 20=19.79%, 50=19.14%, 100=31.90%, 250=19.92% lat (msec) : 500=1.43%, 750=0.13% cpu : usr=0.04%, sys=1.51%, ctx=1297, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=454KiB/s (465kB/s), 109KiB/s-120KiB/s (111kB/s-123kB/s), io=23.4MiB (24.5MB), run=52180-52790msec WRITE: bw=477KiB/s (489kB/s), 116KiB/s-124KiB/s (118kB/s-127kB/s), io=24.6MiB (25.8MB), run=52180-52790msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145523: Tue Sep 8 02:38:59 2026 read: IOPS=1, BW=1110KiB/s (1137kB/s)(7168KiB/6458msec) clat (msec): min=99, max=329, avg=180.47, stdev=82.07 lat (msec): min=99, max=329, avg=180.47, stdev=82.07 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 101], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 163], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 232], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1892, max= 5720, per=100.00%, avg=2889.75, stdev=1888.20, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=0, BW=793KiB/s (812kB/s)(5120KiB/6458msec); 0 zone resets clat (msec): min=169, max=1936, avg=1015.94, stdev=840.84 lat (msec): min=169, max=1936, avg=1016.10, stdev=840.85 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 1899, max= 2048, per=53.45%, avg=1992.25, stdev=64.57, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=9.37%, ctx=379, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145524: Tue Sep 8 02:38:59 2026 read: IOPS=0, BW=266KiB/s (273kB/s)(2048KiB/7691msec) clat (usec): min=812, max=2072.5k, avg=1036646.06, stdev=1464890.02 lat (usec): min=814, max=2072.5k, avg=1036648.29, stdev=1464890.65 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 816], 10.00th=[ 816], | 20.00th=[ 816], 30.00th=[ 816], 40.00th=[ 816], | 50.00th=[ 816], 60.00th=[2071987], 70.00th=[2071987], | 80.00th=[2071987], 90.00th=[2071987], 95.00th=[2071987], | 99.00th=[2071987], 99.50th=[2071987], 99.90th=[2071987], | 99.95th=[2071987], 99.99th=[2071987] bw ( KiB/s): min= 1899, max= 2039, per=73.97%, avg=1969.00, stdev=98.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1331KiB/s (1363kB/s)(10.0MiB/7691msec); 0 zone resets clat (msec): min=99, max=2598, avg=559.67, stdev=752.31 lat (msec): min=99, max=2598, avg=559.93, stdev=752.21 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 163], | 30.00th=[ 165], 40.00th=[ 271], 50.00th=[ 288], 60.00th=[ 305], | 70.00th=[ 342], 80.00th=[ 447], 90.00th=[ 919], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1899, max= 6119, per=80.99%, avg=3018.33, stdev=1727.02, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 1000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=11.30%, ctx=650, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145525: Tue Sep 8 02:38:59 2026 read: IOPS=0, BW=891KiB/s (913kB/s)(6144KiB/6893msec) clat (usec): min=570, max=2406.6k, avg=513845.82, stdev=936327.51 lat (usec): min=571, max=2406.6k, avg=513847.34, stdev=936327.39 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], | 20.00th=[ 4424], 30.00th=[ 4424], 40.00th=[ 152044], | 50.00th=[ 152044], 60.00th=[ 164627], 70.00th=[ 354419], | 80.00th=[ 354419], 90.00th=[2399142], 95.00th=[2399142], | 99.00th=[2399142], 99.50th=[2399142], 99.90th=[2399142], | 99.95th=[2399142], 99.99th=[2399142] bw ( KiB/s): min= 1892, max= 4063, per=94.05%, avg=2503.50, stdev=1041.79, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=891KiB/s (913kB/s)(6144KiB/6893msec); 0 zone resets clat (msec): min=155, max=2319, avg=619.64, stdev=836.06 lat (msec): min=155, max=2319, avg=619.78, stdev=836.06 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 338], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1899, max= 3785, per=65.24%, avg=2431.50, stdev=904.20, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=41.67%, >=2000=16.67% cpu : usr=0.04%, sys=10.46%, ctx=586, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145526: Tue Sep 8 02:38:59 2026 read: IOPS=1, BW=1097KiB/s (1123kB/s)(5120KiB/4669msec) clat (usec): min=504, max=216066, avg=95008.29, stdev=96469.61 lat (usec): min=505, max=216067, avg=95009.69, stdev=96469.56 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 586], 40.00th=[ 586], 50.00th=[ 93848], 60.00th=[ 93848], | 70.00th=[164627], 80.00th=[164627], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1535KiB/s (1572kB/s)(7168KiB/4669msec); 0 zone resets clat (msec): min=64, max=2278, avg=582.84, stdev=809.25 lat (msec): min=64, max=2278, avg=582.96, stdev=809.26 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 66], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 150], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 860], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 2011, max= 4096, per=79.94%, avg=2979.25, stdev=1124.59, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=33.33%, 250=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=11.83%, ctx=177, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2663KiB/s (2727kB/s), 266KiB/s-1110KiB/s (273kB/s-1137kB/s), io=20.0MiB (20.0MB), run=4669-7691msec WRITE: bw=3728KiB/s (3817kB/s), 793KiB/s-1535KiB/s (812kB/s-1572kB/s), io=28.0MiB (29.4MB), run=4669-7691msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145528: Tue Sep 8 02:39:00 2026 read: IOPS=1, BW=1052KiB/s (1077kB/s)(7168KiB/6814msec) clat (msec): min=90, max=172, avg=129.53, stdev=31.13 lat (msec): min=90, max=172, avg=129.53, stdev=31.13 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 102], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 122], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 159], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 1965, max= 5785, per=100.00%, avg=2959.25, stdev=1884.20, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=0, BW=751KiB/s (769kB/s)(5120KiB/6814msec); 0 zone resets clat (msec): min=206, max=2549, avg=1173.33, stdev=1237.18 lat (msec): min=206, max=2549, avg=1173.45, stdev=1237.16 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1965, max= 4096, per=74.75%, avg=2693.33, stdev=1215.04, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=4.42%, ctx=81, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145529: Tue Sep 8 02:39:00 2026 read: IOPS=0, BW=259KiB/s (266kB/s)(2048KiB/7897msec) clat (msec): min=39, max=1986, avg=1012.71, stdev=1376.65 lat (msec): min=39, max=1986, avg=1012.71, stdev=1376.65 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 40], | 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 40], 60.00th=[ 1989], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 2027, max= 2043, per=79.06%, avg=2035.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1297KiB/s (1328kB/s)(10.0MiB/7897msec); 0 zone resets clat (msec): min=98, max=2592, avg=576.22, stdev=759.67 lat (msec): min=98, max=2592, avg=576.40, stdev=759.71 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 118], | 30.00th=[ 155], 40.00th=[ 218], 50.00th=[ 245], 60.00th=[ 296], | 70.00th=[ 376], 80.00th=[ 743], 90.00th=[ 927], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1965, max= 4087, per=78.63%, avg=2833.20, stdev=1123.19, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.12%, ctx=110, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145530: Tue Sep 8 02:39:00 2026 read: IOPS=0, BW=817KiB/s (837kB/s)(6144KiB/7517msec) clat (msec): min=87, max=2412, avg=541.10, stdev=918.69 lat (msec): min=87, max=2412, avg=541.10, stdev=918.69 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 228], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 4039, max= 4055, per=100.00%, avg=4047.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=817KiB/s (837kB/s)(6144KiB/7517msec); 0 zone resets clat (msec): min=146, max=2557, avg=681.59, stdev=934.44 lat (msec): min=146, max=2557, avg=681.83, stdev=934.61 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 422], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1965, max= 2048, per=56.05%, avg=2019.60, stdev=32.48, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, >=2000=16.67% cpu : usr=0.04%, sys=3.75%, ctx=83, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145531: Tue Sep 8 02:39:00 2026 read: IOPS=0, BW=644KiB/s (659kB/s)(5120KiB/7956msec) clat (msec): min=50, max=298, avg=188.06, stdev=111.45 lat (msec): min=50, max=298, avg=188.07, stdev=111.45 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 51], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2027, max= 4087, per=100.00%, avg=2720.67, stdev=1183.33, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=901KiB/s (923kB/s)(7168KiB/7956msec); 0 zone resets clat (msec): min=160, max=2740, avg=989.22, stdev=1203.06 lat (msec): min=160, max=2740, avg=989.32, stdev=1203.05 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 163], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 321], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1965, max= 4096, per=70.38%, avg=2535.75, stdev=1040.78, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=16.67% cpu : usr=0.01%, sys=3.86%, ctx=110, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2574KiB/s (2636kB/s), 259KiB/s-1052KiB/s (266kB/s-1077kB/s), io=20.0MiB (20.0MB), run=6814-7956msec WRITE: bw=3604KiB/s (3690kB/s), 751KiB/s-1297KiB/s (769kB/s-1328kB/s), io=28.0MiB (29.4MB), run=6814-7956msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145537: Tue Sep 8 02:39:11 2026 read: IOPS=1, BW=6234KiB/s (6384kB/s)(12.0MiB/1971msec) clat (msec): min=523, max=770, avg=632.65, stdev=125.77 lat (msec): min=523, max=770, avg=632.66, stdev=125.77 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 5970, max= 8015, per=100.00%, avg=6992.50, stdev=1446.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=20.61%, ctx=666, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145538: Tue Sep 8 02:39:11 2026 read: IOPS=0, BW=1620KiB/s (1659kB/s)(4096KiB/2528msec) clat (nsec): min=579704k, max=579704k, avg=579703856.00, stdev= 0.00 lat (nsec): min=579708k, max=579708k, avg=579707886.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 5665, max= 5665, per=87.41%, avg=5665.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3241KiB/s (3318kB/s)(8192KiB/2528msec); 0 zone resets clat (msec): min=692, max=1200, avg=946.40, stdev=359.08 lat (msec): min=692, max=1201, avg=947.25, stdev=359.67 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8015, max= 8015, per=61.83%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.17%, ctx=312, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145539: Tue Sep 8 02:39:11 2026 write: IOPS=1, BW=4987KiB/s (5107kB/s)(12.0MiB/2464msec); 0 zone resets clat (msec): min=540, max=1160, avg=810.82, stdev=317.39 lat (msec): min=541, max=1160, avg=811.45, stdev=317.09 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7892, max= 8159, per=61.92%, avg=8025.50, stdev=188.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=7.92%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145540: Tue Sep 8 02:39:11 2026 write: IOPS=1, BW=6308KiB/s (6459kB/s)(12.0MiB/1948msec); 0 zone resets clat (msec): min=262, max=1168, avg=633.64, stdev=474.81 lat (msec): min=262, max=1169, avg=634.00, stdev=474.94 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 5979, max= 8159, per=54.54%, avg=7069.00, stdev=1541.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.12%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6481KiB/s (6637kB/s), 1620KiB/s-6234KiB/s (1659kB/s-6384kB/s), io=16.0MiB (16.8MB), run=1971-2528msec WRITE: bw=12.7MiB/s (13.3MB/s), 3241KiB/s-6308KiB/s (3318kB/s-6459kB/s), io=32.0MiB (33.6MB), run=1948-2528msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145542: Tue Sep 8 02:39:11 2026 read: IOPS=1, BW=4627KiB/s (4738kB/s)(12.0MiB/2656msec) clat (msec): min=206, max=1303, avg=856.11, stdev=575.75 lat (msec): min=206, max=1303, avg=856.11, stdev=575.75 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.29%, ctx=71, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145543: Tue Sep 8 02:39:11 2026 read: IOPS=0, BW=1538KiB/s (1574kB/s)(4096KiB/2664msec) clat (nsec): min=1050.2M, max=1050.2M, avg=1050216822.00, stdev= 0.00 lat (nsec): min=1050.2M, max=1050.2M, avg=1050218948.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1053], 5.00th=[ 1053], 10.00th=[ 1053], 20.00th=[ 1053], | 30.00th=[ 1053], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3075KiB/s (3149kB/s)(8192KiB/2664msec); 0 zone resets clat (msec): min=685, max=839, avg=762.74, stdev=108.56 lat (msec): min=686, max=840, avg=763.35, stdev=108.50 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8175, max= 8175, per=66.46%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.70%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145544: Tue Sep 8 02:39:11 2026 write: IOPS=1, BW=4989KiB/s (5109kB/s)(12.0MiB/2463msec); 0 zone resets clat (msec): min=472, max=1027, avg=793.86, stdev=287.95 lat (msec): min=473, max=1027, avg=794.64, stdev=287.29 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8175, max= 8192, per=66.53%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.44%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145545: Tue Sep 8 02:39:11 2026 write: IOPS=1, BW=6169KiB/s (6317kB/s)(12.0MiB/1992msec); 0 zone resets clat (msec): min=534, max=744, avg=654.41, stdev=107.79 lat (msec): min=535, max=744, avg=654.86, stdev=107.82 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 6511, max= 8175, per=59.70%, avg=7343.00, stdev=1176.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=10.90%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6150KiB/s (6298kB/s), 1538KiB/s-4627KiB/s (1574kB/s-4738kB/s), io=16.0MiB (16.8MB), run=2656-2664msec WRITE: bw=12.0MiB/s (12.6MB/s), 3075KiB/s-6169KiB/s (3149kB/s-6317kB/s), io=32.0MiB (33.6MB), run=1992-2664msec