== sanity test 398b: DIO and buffer IO race ============== 16:46:05 (1784234765) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.36737 s, 14.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=151972: Thu Jul 16 16:47:14 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(5992KiB/58319msec) clat (usec): min=30, max=1237.6k, avg=21289.54, stdev=33729.50 lat (usec): min=30, max=1237.6k, avg=21290.21, stdev=33729.52 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 5669], 10.00th=[ 8717], | 20.00th=[ 11469], 30.00th=[ 13698], 40.00th=[ 16319], | 50.00th=[ 18482], 60.00th=[ 21103], 70.00th=[ 24511], | 80.00th=[ 28705], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 62653], 99.50th=[ 67634], 99.90th=[ 158335], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 6, max= 200, per=25.45%, avg=103.60, stdev=33.53, samples=115 iops : min= 1, max= 50, avg=25.50, stdev= 8.43, samples=115 write: IOPS=26, BW=108KiB/s (111kB/s)(6296KiB/58319msec); 0 zone resets clat (usec): min=655, max=99326, avg=16652.23, stdev=12912.59 lat (usec): min=656, max=99326, avg=16653.06, stdev=12912.63 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 2737], 10.00th=[ 3589], 20.00th=[ 5407], | 30.00th=[ 7308], 40.00th=[10421], 50.00th=[13698], 60.00th=[16712], | 70.00th=[21103], 80.00th=[26346], 90.00th=[34341], 95.00th=[41157], | 99.00th=[55313], 99.50th=[66323], 99.90th=[99091], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 31, max= 240, per=25.74%, avg=109.66, stdev=37.89, samples=114 iops : min= 7, max= 60, avg=27.02, stdev= 9.57, samples=114 lat (usec) : 50=0.10%, 100=0.49%, 250=1.46%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.23% lat (msec) : 2=0.78%, 4=4.92%, 10=18.03%, 20=35.55%, 50=35.94% lat (msec) : 100=2.18%, 250=0.03%, 2000=0.03% cpu : usr=0.07%, sys=28.94%, ctx=9642, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151973: Thu Jul 16 16:47:14 2026 read: IOPS=25, BW=101KiB/s (104kB/s)(5940KiB/58764msec) clat (usec): min=29, max=139758, avg=20801.08, stdev=12192.99 lat (usec): min=29, max=139759, avg=20801.78, stdev=12193.00 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 6325], 10.00th=[ 8586], 20.00th=[ 11469], | 30.00th=[ 14091], 40.00th=[ 16450], 50.00th=[ 19006], 60.00th=[ 21890], | 70.00th=[ 25035], 80.00th=[ 28705], 90.00th=[ 34341], 95.00th=[ 40109], | 99.00th=[ 60031], 99.50th=[ 73925], 99.90th=[103285], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 6, max= 192, per=24.96%, avg=101.60, stdev=33.52, samples=115 iops : min= 1, max= 48, avg=25.00, stdev= 8.48, samples=115 write: IOPS=27, BW=108KiB/s (111kB/s)(6348KiB/58764msec); 0 zone resets clat (usec): min=643, max=1235.1k, avg=17428.82, stdev=33579.21 lat (usec): min=644, max=1235.1k, avg=17429.62, stdev=33579.21 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 2737], 10.00th=[ 3621], | 20.00th=[ 5080], 30.00th=[ 6849], 40.00th=[ 10290], | 50.00th=[ 13566], 60.00th=[ 16581], 70.00th=[ 20841], | 80.00th=[ 26084], 90.00th=[ 34341], 95.00th=[ 42730], | 99.00th=[ 64226], 99.50th=[ 76022], 99.90th=[ 119014], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 47, max= 208, per=25.62%, avg=109.16, stdev=36.29, samples=114 iops : min= 11, max= 52, avg=26.89, stdev= 9.17, samples=114 lat (usec) : 50=0.03%, 100=0.23%, 250=1.30%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.33% lat (msec) : 2=0.91%, 4=4.98%, 10=19.17%, 20=34.21%, 50=36.17% lat (msec) : 100=2.18%, 250=0.20%, 2000=0.03% cpu : usr=0.09%, sys=28.48%, ctx=9752, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151974: Thu Jul 16 16:47:14 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(6028KiB/58684msec) clat (usec): min=26, max=80397, avg=20143.76, stdev=11159.09 lat (usec): min=27, max=80397, avg=20144.46, stdev=11159.12 clat percentiles (usec): | 1.00th=[ 101], 5.00th=[ 4948], 10.00th=[ 8848], 20.00th=[11600], | 30.00th=[13829], 40.00th=[15926], 50.00th=[18482], 60.00th=[21365], | 70.00th=[24511], 80.00th=[28181], 90.00th=[33424], 95.00th=[39584], | 99.00th=[57934], 99.50th=[64750], 99.90th=[76022], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 39, max= 207, per=25.57%, avg=104.05, stdev=34.09, samples=114 iops : min= 9, max= 51, avg=25.61, stdev= 8.63, samples=114 write: IOPS=26, BW=107KiB/s (109kB/s)(6260KiB/58684msec); 0 zone resets clat (usec): min=645, max=1237.8k, avg=17968.20, stdev=33941.00 lat (usec): min=646, max=1237.8k, avg=17969.05, stdev=33941.02 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 2638], 10.00th=[ 3392], | 20.00th=[ 4948], 30.00th=[ 7635], 40.00th=[ 11207], | 50.00th=[ 14353], 60.00th=[ 17695], 70.00th=[ 21365], | 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 66847], 99.50th=[ 92799], 99.90th=[ 129500], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 13, max= 264, per=25.08%, avg=106.86, stdev=40.83, samples=115 iops : min= 3, max= 66, avg=26.32, stdev=10.26, samples=115 lat (usec) : 50=0.10%, 100=0.39%, 250=1.79%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=1.07%, 4=5.34%, 10=16.76%, 20=35.61%, 50=36.62% lat (msec) : 100=1.89%, 250=0.13%, 2000=0.03% cpu : usr=0.08%, sys=28.52%, ctx=9636, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151975: Thu Jul 16 16:47:14 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(6052KiB/58947msec) clat (usec): min=31, max=127777, avg=20238.54, stdev=11762.53 lat (usec): min=31, max=127778, avg=20239.22, stdev=11762.57 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 5014], 10.00th=[ 8225], 20.00th=[ 11338], | 30.00th=[ 13566], 40.00th=[ 16319], 50.00th=[ 18744], 60.00th=[ 21365], | 70.00th=[ 24511], 80.00th=[ 28181], 90.00th=[ 34341], 95.00th=[ 39584], | 99.00th=[ 54264], 99.50th=[ 71828], 99.90th=[121111], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 15, max= 216, per=25.53%, avg=103.90, stdev=29.37, samples=115 iops : min= 3, max= 54, avg=25.58, stdev= 7.43, samples=115 write: IOPS=26, BW=106KiB/s (108kB/s)(6236KiB/58947msec); 0 zone resets clat (usec): min=653, max=1199.3k, avg=18032.15, stdev=33104.51 lat (usec): min=654, max=1199.3k, avg=18032.99, stdev=33104.54 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 2704], 10.00th=[ 3687], | 20.00th=[ 5604], 30.00th=[ 7767], 40.00th=[ 11076], | 50.00th=[ 14091], 60.00th=[ 17433], 70.00th=[ 21890], | 80.00th=[ 27132], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 63177], 99.50th=[ 84411], 99.90th=[ 139461], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 31, max= 208, per=25.14%, avg=107.10, stdev=33.80, samples=115 iops : min= 7, max= 52, avg=26.38, stdev= 8.53, samples=115 lat (usec) : 50=0.13%, 100=0.65%, 250=1.37%, 500=0.23%, 750=0.13% lat (usec) : 1000=0.23% lat (msec) : 2=1.17%, 4=4.26%, 10=17.97%, 20=34.93%, 50=37.14% lat (msec) : 100=1.53%, 250=0.23%, 2000=0.03% cpu : usr=0.09%, sys=28.57%, ctx=9850, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=407KiB/s (417kB/s), 101KiB/s-103KiB/s (104kB/s-105kB/s), io=23.4MiB (24.6MB), run=58319-58947msec WRITE: bw=426KiB/s (437kB/s), 106KiB/s-108KiB/s (108kB/s-111kB/s), io=24.6MiB (25.7MB), run=58319-58947msec rand-rw: (groupid=0, jobs=1): err= 0: pid=151967: Thu Jul 16 16:47:39 2026 read: IOPS=17, BW=71.0KiB/s (73.7kB/s)(5992KiB/83270msec) clat (msec): min=2, max=1248, avg=17.63, stdev=36.02 lat (msec): min=2, max=1248, avg=17.63, stdev=36.02 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 38], 95.00th=[ 50], | 99.00th=[ 82], 99.50th=[ 114], 99.90th=[ 136], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 23, max= 200, per=25.13%, avg=72.38, stdev=39.42, samples=163 iops : min= 5, max= 50, avg=17.76, stdev=10.02, samples=163 write: IOPS=18, BW=75.6KiB/s (77.4kB/s)(6296KiB/83270msec); 0 zone resets clat (msec): min=14, max=198, avg=35.94, stdev=17.17 lat (msec): min=14, max=198, avg=35.94, stdev=17.17 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 67], | 99.00th=[ 96], 99.50th=[ 120], 99.90th=[ 157], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 23, max= 152, per=25.39%, avg=76.44, stdev=34.05, samples=162 iops : min= 5, max= 38, avg=18.77, stdev= 8.72, samples=162 lat (msec) : 4=3.91%, 10=19.92%, 20=13.74%, 50=52.08%, 100=9.57% lat (msec) : 250=0.75%, 2000=0.03% cpu : usr=0.07%, sys=11.01%, ctx=6473, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151968: Thu Jul 16 16:47:39 2026 read: IOPS=17, BW=71.3KiB/s (73.0kB/s)(5940KiB/83267msec) clat (msec): min=2, max=1184, avg=16.73, stdev=33.84 lat (msec): min=2, max=1184, avg=16.74, stdev=33.84 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 46], | 99.00th=[ 70], 99.50th=[ 96], 99.90th=[ 134], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8, max= 208, per=24.98%, avg=71.94, stdev=39.84, samples=163 iops : min= 2, max= 52, avg=17.65, stdev=10.11, samples=163 write: IOPS=19, BW=76.2KiB/s (78.1kB/s)(6348KiB/83267msec); 0 zone resets clat (msec): min=15, max=186, avg=36.62, stdev=17.54 lat (msec): min=15, max=186, avg=36.62, stdev=17.54 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 103], 99.50th=[ 122], 99.90th=[ 157], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 8, max= 160, per=25.47%, avg=76.65, stdev=33.31, samples=163 iops : min= 2, max= 40, avg=18.83, stdev= 8.53, samples=163 lat (msec) : 4=2.60%, 10=21.19%, 20=14.06%, 50=51.69%, 100=9.70% lat (msec) : 250=0.72%, 2000=0.03% cpu : usr=0.08%, sys=10.96%, ctx=6472, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151969: Thu Jul 16 16:47:39 2026 read: IOPS=18, BW=72.3KiB/s (74.1kB/s)(6028KiB/83340msec) clat (msec): min=2, max=129, avg=17.03, stdev=16.22 lat (msec): min=2, max=129, avg=17.04, stdev=16.22 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 12], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 50], | 99.00th=[ 74], 99.50th=[ 87], 99.90th=[ 129], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 15, max= 208, per=25.39%, avg=73.13, stdev=36.88, samples=162 iops : min= 3, max= 52, avg=17.94, stdev= 9.38, samples=162 write: IOPS=18, BW=75.1KiB/s (76.9kB/s)(6260KiB/83340msec); 0 zone resets clat (msec): min=12, max=1211, avg=36.66, stdev=34.01 lat (msec): min=12, max=1211, avg=36.66, stdev=34.01 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 68], | 99.00th=[ 96], 99.50th=[ 116], 99.90th=[ 197], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 23, max= 152, per=25.03%, avg=75.33, stdev=33.70, samples=163 iops : min= 5, max= 38, avg=18.50, stdev= 8.62, samples=163 lat (msec) : 4=4.00%, 10=19.37%, 20=13.38%, 50=53.39%, 100=9.28% lat (msec) : 250=0.55%, 2000=0.03% cpu : usr=0.07%, sys=11.04%, ctx=6394, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=151970: Thu Jul 16 16:47:39 2026 read: IOPS=18, BW=72.8KiB/s (74.5kB/s)(6052KiB/83159msec) clat (msec): min=2, max=155, avg=16.75, stdev=16.73 lat (msec): min=2, max=155, avg=16.76, stdev=16.73 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 81], 99.50th=[ 101], 99.90th=[ 132], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 15, max= 232, per=25.87%, avg=74.50, stdev=39.58, samples=160 iops : min= 3, max= 58, avg=18.29, stdev=10.06, samples=160 write: IOPS=18, BW=74.0KiB/s (76.8kB/s)(6236KiB/83159msec); 0 zone resets clat (msec): min=14, max=1194, avg=36.89, stdev=33.98 lat (msec): min=14, max=1194, avg=36.89, stdev=33.98 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 108], 99.50th=[ 134], 99.90th=[ 186], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 15, max= 152, per=25.08%, avg=75.48, stdev=32.86, samples=163 iops : min= 3, max= 38, avg=18.53, stdev= 8.42, samples=163 lat (msec) : 4=3.55%, 10=20.67%, 20=13.38%, 50=52.67%, 100=8.89% lat (msec) : 250=0.81%, 2000=0.03% cpu : usr=0.06%, sys=10.99%, ctx=6491, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=288KiB/s (295kB/s), 71.3KiB/s-72.8KiB/s (73.0kB/s-74.5kB/s), io=23.4MiB (24.6MB), run=83159-83340msec WRITE: bw=302KiB/s (309kB/s), 74.0KiB/s-76.2KiB/s (76.8kB/s-78.1kB/s), io=24.6MiB (25.7MB), run=83159-83340msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152014: Thu Jul 16 16:48:05 2026 read: IOPS=19, BW=314KiB/s (321kB/s)(5920KiB/18872msec) clat (usec): min=62, max=79135, avg=24497.55, stdev=13309.11 lat (usec): min=62, max=79136, avg=24498.47, stdev=13309.16 clat percentiles (usec): | 1.00th=[ 91], 5.00th=[ 182], 10.00th=[ 9765], 20.00th=[15401], | 30.00th=[18220], 40.00th=[20317], 50.00th=[22938], 60.00th=[26084], | 70.00th=[30016], 80.00th=[34341], 90.00th=[41157], 95.00th=[47973], | 99.00th=[63701], 99.50th=[71828], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 190, max= 480, per=25.41%, avg=313.03, stdev=85.27, samples=37 iops : min= 11, max= 30, avg=19.00, stdev= 5.50, samples=37 write: IOPS=21, BW=337KiB/s (346kB/s)(6368KiB/18872msec); 0 zone resets clat (usec): min=1072, max=165185, avg=24586.03, stdev=18054.12 lat (usec): min=1073, max=165186, avg=24587.68, stdev=18054.02 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 5473], 10.00th=[ 7046], 20.00th=[ 9765], | 30.00th=[ 12256], 40.00th=[ 16712], 50.00th=[ 19792], 60.00th=[ 24773], | 70.00th=[ 30802], 80.00th=[ 37487], 90.00th=[ 46924], 95.00th=[ 58459], | 99.00th=[ 80217], 99.50th=[ 93848], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 640, per=26.13%, avg=338.70, stdev=111.19, samples=37 iops : min= 3, max= 40, avg=20.62, stdev= 7.12, samples=37 lat (usec) : 100=0.78%, 250=2.60%, 500=0.78% lat (msec) : 2=0.52%, 4=0.26%, 10=11.07%, 20=28.13%, 50=49.61% lat (msec) : 100=6.12%, 250=0.13% cpu : usr=0.05%, sys=31.51%, ctx=3018, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152015: Thu Jul 16 16:48:05 2026 read: IOPS=18, BW=303KiB/s (310kB/s)(5744KiB/18968msec) clat (usec): min=27, max=123158, avg=25899.46, stdev=15512.80 lat (usec): min=27, max=123159, avg=25900.32, stdev=15512.87 clat percentiles (usec): | 1.00th=[ 76], 5.00th=[ 165], 10.00th=[ 6915], 20.00th=[ 15008], | 30.00th=[ 18744], 40.00th=[ 21103], 50.00th=[ 24773], 60.00th=[ 28705], | 70.00th=[ 32113], 80.00th=[ 36439], 90.00th=[ 44827], 95.00th=[ 51119], | 99.00th=[ 76022], 99.50th=[ 78119], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 78, max= 608, per=24.55%, avg=302.46, stdev=116.45, samples=37 iops : min= 4, max= 38, avg=18.32, stdev= 7.46, samples=37 write: IOPS=21, BW=345KiB/s (353kB/s)(6544KiB/18968msec); 0 zone resets clat (usec): min=1315, max=121152, avg=23438.35, stdev=16591.94 lat (usec): min=1316, max=121154, avg=23439.83, stdev=16592.04 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 47], 95.00th=[ 56], | 99.00th=[ 77], 99.50th=[ 82], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 127, max= 576, per=26.55%, avg=344.05, stdev=121.36, samples=37 iops : min= 7, max= 36, avg=20.95, stdev= 7.77, samples=37 lat (usec) : 50=0.26%, 100=0.65%, 250=2.99%, 500=0.52% lat (msec) : 2=0.52%, 4=0.26%, 10=12.24%, 20=25.91%, 50=49.09% lat (msec) : 100=7.29%, 250=0.26% cpu : usr=0.07%, sys=31.96%, ctx=2949, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152016: Thu Jul 16 16:48:05 2026 read: IOPS=20, BW=322KiB/s (330kB/s)(6256KiB/19431msec) clat (usec): min=35, max=141042, avg=25796.22, stdev=15691.70 lat (usec): min=36, max=141043, avg=25797.13, stdev=15691.74 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 194], 10.00th=[ 10290], 20.00th=[ 14615], | 30.00th=[ 17695], 40.00th=[ 21103], 50.00th=[ 23987], 60.00th=[ 27395], | 70.00th=[ 31851], 80.00th=[ 36439], 90.00th=[ 44303], 95.00th=[ 52167], | 99.00th=[ 71828], 99.50th=[104334], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 126, max= 576, per=26.07%, avg=321.16, stdev=107.36, samples=38 iops : min= 7, max= 36, avg=19.50, stdev= 6.88, samples=38 write: IOPS=19, BW=310KiB/s (318kB/s)(6032KiB/19431msec); 0 zone resets clat (usec): min=1047, max=114726, avg=24578.43, stdev=17223.86 lat (usec): min=1048, max=114729, avg=24579.94, stdev=17223.84 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 4752], 10.00th=[ 6980], 20.00th=[ 9634], | 30.00th=[ 12911], 40.00th=[ 16450], 50.00th=[ 20579], 60.00th=[ 25035], | 70.00th=[ 31327], 80.00th=[ 37487], 90.00th=[ 50070], 95.00th=[ 56361], | 99.00th=[ 85459], 99.50th=[ 96994], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 95, max= 479, per=23.48%, avg=304.26, stdev=85.65, samples=38 iops : min= 5, max= 29, avg=18.45, stdev= 5.49, samples=38 lat (usec) : 50=0.13%, 100=0.39%, 250=3.26%, 500=0.39% lat (msec) : 2=0.52%, 4=1.30%, 10=9.11%, 20=28.26%, 50=48.70% lat (msec) : 100=7.55%, 250=0.39% cpu : usr=0.06%, sys=31.07%, ctx=3078, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152017: Thu Jul 16 16:48:05 2026 read: IOPS=20, BW=331KiB/s (339kB/s)(6032KiB/18245msec) clat (usec): min=39, max=123980, avg=24262.07, stdev=15756.46 lat (usec): min=40, max=123980, avg=24262.90, stdev=15756.49 clat percentiles (usec): | 1.00th=[ 82], 5.00th=[ 141], 10.00th=[ 215], 20.00th=[ 12780], | 30.00th=[ 17171], 40.00th=[ 20317], 50.00th=[ 23462], 60.00th=[ 27132], | 70.00th=[ 30802], 80.00th=[ 36963], 90.00th=[ 43254], 95.00th=[ 51119], | 99.00th=[ 61604], 99.50th=[ 65274], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 183, max= 640, per=26.78%, avg=329.94, stdev=101.42, samples=36 iops : min= 11, max= 40, avg=20.06, stdev= 6.51, samples=36 write: IOPS=21, BW=343KiB/s (351kB/s)(6256KiB/18245msec); 0 zone resets clat (usec): min=1194, max=176291, avg=22948.91, stdev=17926.30 lat (usec): min=1194, max=176292, avg=22950.54, stdev=17926.29 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 5473], 10.00th=[ 7046], 20.00th=[ 9241], | 30.00th=[ 11469], 40.00th=[ 14222], 50.00th=[ 18220], 60.00th=[ 23462], | 70.00th=[ 27919], 80.00th=[ 33817], 90.00th=[ 42206], 95.00th=[ 54789], | 99.00th=[ 99091], 99.50th=[100140], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 127, max= 704, per=26.61%, avg=344.83, stdev=112.00, samples=36 iops : min= 7, max= 44, avg=21.00, stdev= 7.19, samples=36 lat (usec) : 50=0.26%, 100=0.65%, 250=5.08%, 500=1.30% lat (msec) : 2=0.52%, 4=0.78%, 10=11.46%, 20=25.91%, 50=47.92% lat (msec) : 100=5.86%, 250=0.26% cpu : usr=0.09%, sys=31.53%, ctx=2955, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1233KiB/s (1262kB/s), 303KiB/s-331KiB/s (310kB/s-339kB/s), io=23.4MiB (24.5MB), run=18245-19431msec WRITE: bw=1297KiB/s (1328kB/s), 310KiB/s-345KiB/s (318kB/s-353kB/s), io=24.6MiB (25.8MB), run=18245-19431msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152009: Thu Jul 16 16:48:12 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(5920KiB/26316msec) clat (msec): min=3, max=122, avg=23.79, stdev=20.84 lat (msec): min=3, max=122, avg=23.79, stdev=20.84 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 51], 95.00th=[ 74], | 99.00th=[ 99], 99.50th=[ 113], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 63, max= 512, per=25.13%, avg=226.94, stdev=111.90, samples=51 iops : min= 3, max= 32, avg=13.71, stdev= 7.23, samples=51 write: IOPS=15, BW=242KiB/s (248kB/s)(6368KiB/26316msec); 0 zone resets clat (msec): min=14, max=222, avg=43.83, stdev=24.21 lat (msec): min=14, max=222, avg=43.83, stdev=24.21 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 48], 80.00th=[ 57], 90.00th=[ 71], 95.00th=[ 81], | 99.00th=[ 150], 99.50th=[ 207], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 62, max= 576, per=25.40%, avg=241.35, stdev=111.09, samples=52 iops : min= 3, max= 36, avg=14.60, stdev= 7.24, samples=52 lat (msec) : 4=0.65%, 10=9.38%, 20=21.61%, 50=49.22%, 100=17.06% lat (msec) : 250=2.08% cpu : usr=0.08%, sys=12.05%, ctx=1966, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152010: Thu Jul 16 16:48:12 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5744KiB/26523msec) clat (msec): min=3, max=128, avg=24.24, stdev=21.64 lat (msec): min=3, max=128, avg=24.24, stdev=21.64 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 52], 95.00th=[ 74], | 99.00th=[ 106], 99.50th=[ 112], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 32, max= 480, per=24.20%, avg=218.55, stdev=114.91, samples=51 iops : min= 2, max= 30, avg=13.18, stdev= 7.42, samples=51 write: IOPS=15, BW=247KiB/s (253kB/s)(6544KiB/26523msec); 0 zone resets clat (msec): min=12, max=224, avg=43.44, stdev=23.27 lat (msec): min=12, max=224, avg=43.44, stdev=23.27 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 58], 90.00th=[ 77], 95.00th=[ 90], | 99.00th=[ 106], 99.50th=[ 150], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 63, max= 544, per=25.24%, avg=239.83, stdev=112.29, samples=52 iops : min= 3, max= 34, avg=14.50, stdev= 7.31, samples=52 lat (msec) : 4=0.78%, 10=10.16%, 20=19.66%, 50=50.13%, 100=17.45% lat (msec) : 250=1.82% cpu : usr=0.09%, sys=11.99%, ctx=1976, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152011: Thu Jul 16 16:48:12 2026 read: IOPS=15, BW=244KiB/s (249kB/s)(6256KiB/25686msec) clat (msec): min=3, max=129, avg=23.85, stdev=18.65 lat (msec): min=3, max=129, avg=23.85, stdev=18.65 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 36], 90.00th=[ 50], 95.00th=[ 61], | 99.00th=[ 97], 99.50th=[ 103], 99.90th=[ 130], 99.95th=[ 130], | 99.99th=[ 130] bw ( KiB/s): min= 63, max= 704, per=27.00%, avg=243.78, stdev=129.73, samples=50 iops : min= 3, max= 44, avg=14.72, stdev= 8.36, samples=50 write: IOPS=14, BW=235KiB/s (240kB/s)(6032KiB/25686msec); 0 zone resets clat (msec): min=18, max=178, avg=43.32, stdev=20.51 lat (msec): min=18, max=178, avg=43.33, stdev=20.51 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 35], 50.00th=[ 37], 60.00th=[ 41], | 70.00th=[ 47], 80.00th=[ 54], 90.00th=[ 73], 95.00th=[ 86], | 99.00th=[ 110], 99.50th=[ 118], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 63, max= 480, per=24.37%, avg=231.48, stdev=95.74, samples=50 iops : min= 3, max= 30, avg=13.96, stdev= 6.25, samples=50 lat (msec) : 4=0.13%, 10=9.11%, 20=20.31%, 50=52.99%, 100=16.02% lat (msec) : 250=1.43% cpu : usr=0.05%, sys=12.82%, ctx=2047, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152012: Thu Jul 16 16:48:12 2026 read: IOPS=14, BW=232KiB/s (237kB/s)(6032KiB/26048msec) clat (msec): min=4, max=192, avg=24.11, stdev=22.35 lat (msec): min=4, max=192, avg=24.11, stdev=22.35 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 35], 90.00th=[ 48], 95.00th=[ 71], | 99.00th=[ 111], 99.50th=[ 136], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 63, max= 608, per=25.24%, avg=227.94, stdev=129.22, samples=51 iops : min= 3, max= 38, avg=13.75, stdev= 8.28, samples=51 write: IOPS=15, BW=240KiB/s (246kB/s)(6256KiB/26048msec); 0 zone resets clat (msec): min=17, max=218, avg=43.26, stdev=22.07 lat (msec): min=17, max=218, avg=43.26, stdev=22.07 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 28], | 30.00th=[ 30], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 41], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 71], 95.00th=[ 84], | 99.00th=[ 114], 99.50th=[ 163], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 63, max= 544, per=24.97%, avg=237.22, stdev=106.50, samples=51 iops : min= 3, max= 34, avg=14.33, stdev= 6.95, samples=51 lat (msec) : 10=9.77%, 20=21.74%, 50=49.87%, 100=16.93%, 250=1.69% cpu : usr=0.07%, sys=12.54%, ctx=2039, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=903KiB/s (925kB/s), 217KiB/s-244KiB/s (222kB/s-249kB/s), io=23.4MiB (24.5MB), run=25686-26523msec WRITE: bw=950KiB/s (973kB/s), 235KiB/s-247KiB/s (240kB/s-253kB/s), io=24.6MiB (25.8MB), run=25686-26523msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152031: Thu Jul 16 16:48:24 2026 read: IOPS=1, BW=1424KiB/s (1458kB/s)(7168KiB/5034msec) clat (msec): min=128, max=353, avg=225.15, stdev=91.53 lat (msec): min=128, max=353, avg=225.15, stdev=91.53 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 142], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 186], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 309], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1984, max= 4096, per=74.82%, avg=2925.50, stdev=1071.92, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=0, BW=1017KiB/s (1041kB/s)(5120KiB/5034msec); 0 zone resets clat (msec): min=286, max=1836, avg=672.89, stdev=666.15 lat (msec): min=286, max=1836, avg=672.96, stdev=666.13 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1984, max= 4096, per=49.49%, avg=2709.33, stdev=1201.31, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=38.53%, ctx=1332, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152032: Thu Jul 16 16:48:24 2026 read: IOPS=0, BW=391KiB/s (400kB/s)(2048KiB/5237msec) clat (msec): min=3, max=755, avg=379.29, stdev=531.34 lat (msec): min=3, max=755, avg=379.29, stdev=531.34 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 4], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1984, max= 2048, per=51.56%, avg=2016.00, stdev=45.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1955KiB/s (2002kB/s)(10.0MiB/5237msec); 0 zone resets clat (msec): min=97, max=980, avg=439.05, stdev=282.85 lat (msec): min=97, max=980, avg=439.14, stdev=282.86 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 101], | 30.00th=[ 271], 40.00th=[ 313], 50.00th=[ 326], 60.00th=[ 418], | 70.00th=[ 518], 80.00th=[ 625], 90.00th=[ 751], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 2039, max= 6144, per=56.09%, avg=3070.50, stdev=1714.56, samples=6 iops : min= 1, max= 6, avg= 2.83, stdev= 1.83, samples=6 lat (msec) : 4=8.33%, 100=8.33%, 250=8.33%, 500=33.33%, 750=25.00% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=35.14%, ctx=446, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152033: Thu Jul 16 16:48:24 2026 read: IOPS=1, BW=1334KiB/s (1366kB/s)(6144KiB/4605msec) clat (usec): min=637, max=1629.0k, avg=426059.82, stdev=615403.01 lat (usec): min=638, max=1629.0k, avg=426060.91, stdev=615403.03 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], | 20.00th=[ 693], 30.00th=[ 693], 40.00th=[ 206570], | 50.00th=[ 206570], 60.00th=[ 242222], 70.00th=[ 476054], | 80.00th=[ 476054], 90.00th=[1635779], 95.00th=[1635779], | 99.00th=[1635779], 99.50th=[1635779], 99.90th=[1635779], | 99.95th=[1635779], 99.99th=[1635779] bw ( KiB/s): min= 2043, max= 2048, per=52.34%, avg=2046.33, stdev= 2.89, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1334KiB/s (1366kB/s)(6144KiB/4605msec); 0 zone resets clat (msec): min=60, max=810, avg=338.16, stdev=273.99 lat (msec): min=60, max=811, avg=338.23, stdev=274.00 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 376], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1759, max= 2048, per=35.80%, avg=1959.75, stdev=137.19, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=39.42%, ctx=817, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152034: Thu Jul 16 16:48:24 2026 read: IOPS=0, BW=1010KiB/s (1035kB/s)(5120KiB/5067msec) clat (usec): min=469, max=878522, avg=226848.33, stdev=380481.35 lat (usec): min=469, max=878523, avg=226849.79, stdev=380481.36 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 469], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 652], 60.00th=[ 652], | 70.00th=[254804], 80.00th=[254804], 90.00th=[876610], 95.00th=[876610], | 99.00th=[876610], 99.50th=[876610], 99.90th=[876610], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 2039, max= 6144, per=100.00%, avg=4091.50, stdev=2902.67, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1415KiB/s (1449kB/s)(7168KiB/5067msec); 0 zone resets clat (msec): min=162, max=1368, avg=546.52, stdev=486.15 lat (msec): min=162, max=1368, avg=546.59, stdev=486.17 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 176], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 279], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 1036], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1984, max= 4079, per=49.39%, avg=2703.67, stdev=1191.50, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=25.00%, 500=16.67%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.06%, sys=28.72%, ctx=384, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3911KiB/s (4004kB/s), 391KiB/s-1424KiB/s (400kB/s-1458kB/s), io=20.0MiB (20.0MB), run=4605-5237msec WRITE: bw=5475KiB/s (5606kB/s), 1017KiB/s-1955KiB/s (1041kB/s-2002kB/s), io=28.0MiB (29.4MB), run=4605-5237msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152027: Thu Jul 16 16:48:24 2026 read: IOPS=1, BW=1559KiB/s (1597kB/s)(7168KiB/4597msec) clat (msec): min=78, max=632, avg=253.79, stdev=195.45 lat (msec): min=79, max=632, avg=253.79, stdev=195.45 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 100], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 178], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 376], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1957, max= 5242, per=98.35%, avg=3765.00, stdev=1667.33, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 write: IOPS=1, BW=1114KiB/s (1141kB/s)(5120KiB/4597msec); 0 zone resets clat (msec): min=143, max=1868, avg=561.21, stdev=738.76 lat (msec): min=143, max=1868, avg=561.30, stdev=738.77 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1747, max= 4096, per=49.00%, avg=2626.00, stdev=1281.18, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.62%, ctx=181, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152028: Thu Jul 16 16:48:24 2026 read: IOPS=0, BW=423KiB/s (433kB/s)(2048KiB/4843msec) clat (msec): min=377, max=458, avg=418.01, stdev=57.02 lat (msec): min=377, max=458, avg=418.01, stdev=57.02 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1747, max= 2048, per=49.57%, avg=1897.50, stdev=212.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2114KiB/s (2165kB/s)(10.0MiB/4843msec); 0 zone resets clat (msec): min=177, max=726, avg=394.26, stdev=194.04 lat (msec): min=177, max=726, avg=394.34, stdev=194.04 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 236], | 30.00th=[ 253], 40.00th=[ 275], 50.00th=[ 309], 60.00th=[ 334], | 70.00th=[ 409], 80.00th=[ 518], 90.00th=[ 709], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1957, max= 4071, per=48.48%, avg=2598.14, stdev=974.63, samples=7 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=7 lat (msec) : 250=16.67%, 500=58.33%, 750=25.00% cpu : usr=0.02%, sys=16.75%, ctx=462, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152029: Thu Jul 16 16:48:24 2026 read: IOPS=1, BW=1149KiB/s (1176kB/s)(6144KiB/5349msec) clat (msec): min=30, max=1180, avg=410.46, stdev=465.94 lat (msec): min=30, max=1180, avg=410.46, stdev=465.93 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 31], 10.00th=[ 31], 20.00th=[ 54], | 30.00th=[ 54], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 355], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1988, max= 4079, per=70.27%, avg=2690.00, stdev=1202.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1149KiB/s (1176kB/s)(6144KiB/5349msec); 0 zone resets clat (msec): min=52, max=1453, avg=464.06, stdev=522.07 lat (msec): min=52, max=1453, avg=464.13, stdev=522.07 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 397], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1957, max= 4096, per=50.39%, avg=2700.33, stdev=1209.54, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 50=8.33%, 100=33.33%, 250=8.33%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=14.29%, ctx=203, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152030: Thu Jul 16 16:48:24 2026 read: IOPS=0, BW=957KiB/s (980kB/s)(5120KiB/5350msec) clat (msec): min=22, max=1502, avg=640.84, stdev=705.17 lat (msec): min=22, max=1502, avg=640.84, stdev=705.17 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 23], 10.00th=[ 23], 20.00th=[ 23], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 1988, max= 4007, per=69.96%, avg=2678.00, stdev=1151.23, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1340KiB/s (1372kB/s)(7168KiB/5350msec); 0 zone resets clat (msec): min=100, max=613, avg=303.67, stdev=199.32 lat (msec): min=100, max=613, avg=303.75, stdev=199.31 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 110], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 226], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 518], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1802, max= 4071, per=46.30%, avg=2481.00, stdev=1065.38, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 250=50.00%, 500=8.33%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=11.37%, ctx=288, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3828KiB/s (3920kB/s), 423KiB/s-1559KiB/s (433kB/s-1597kB/s), io=20.0MiB (20.0MB), run=4597-5350msec WRITE: bw=5359KiB/s (5488kB/s), 1114KiB/s-2114KiB/s (1141kB/s-2165kB/s), io=28.0MiB (29.4MB), run=4597-5350msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152045: Thu Jul 16 16:48:33 2026 read: IOPS=1, BW=7817KiB/s (8004kB/s)(12.0MiB/1572msec) clat (msec): min=409, max=575, avg=496.05, stdev=83.40 lat (msec): min=409, max=575, avg=496.05, stdev=83.40 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=56.46%, ctx=2966, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152046: Thu Jul 16 16:48:33 2026 read: IOPS=0, BW=1899KiB/s (1945kB/s)(4096KiB/2157msec) clat (nsec): min=462727k, max=462727k, avg=462726542.00, stdev= 0.00 lat (nsec): min=462730k, max=462730k, avg=462729664.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 5512, max= 5512, per=72.57%, avg=5512.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3798KiB/s (3889kB/s)(8192KiB/2157msec); 0 zone resets clat (msec): min=711, max=890, avg=800.69, stdev=126.32 lat (msec): min=711, max=890, avg=800.95, stdev=126.33 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=55.43%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=10.16%, ctx=875, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152047: Thu Jul 16 16:48:33 2026 write: IOPS=1, BW=5543KiB/s (5676kB/s)(12.0MiB/2217msec); 0 zone resets clat (msec): min=231, max=1271, avg=733.62, stdev=521.18 lat (msec): min=231, max=1272, avg=733.96, stdev=521.18 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8192, max= 8192, per=55.43%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=17.91%, ctx=97, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152048: Thu Jul 16 16:48:33 2026 write: IOPS=1, BW=6804KiB/s (6967kB/s)(12.0MiB/1806msec); 0 zone resets clat (msec): min=391, max=918, avg=590.81, stdev=285.71 lat (msec): min=392, max=918, avg=591.07, stdev=285.71 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7984, max= 8192, per=54.72%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=15.79%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7596KiB/s (7778kB/s), 1899KiB/s-7817KiB/s (1945kB/s-8004kB/s), io=16.0MiB (16.8MB), run=1572-2157msec WRITE: bw=14.4MiB/s (15.1MB/s), 3798KiB/s-6804KiB/s (3889kB/s-6967kB/s), io=32.0MiB (33.6MB), run=1806-2217msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152041: Thu Jul 16 16:48:33 2026 read: IOPS=3, BW=13.4MiB/s (14.0MB/s)(12.0MiB/897msec) clat (msec): min=104, max=621, avg=286.71, stdev=290.04 lat (msec): min=104, max=621, avg=286.71, stdev=290.03 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min=15693, max=15693, per=100.00%, avg=15693.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 750=33.33% cpu : usr=0.00%, sys=24.67%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152042: Thu Jul 16 16:48:33 2026 read: IOPS=0, BW=1747KiB/s (1789kB/s)(4096KiB/2345msec) clat (nsec): min=643248k, max=643248k, avg=643247649.00, stdev= 0.00 lat (nsec): min=643249k, max=643249k, avg=643248579.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3493KiB/s (3577kB/s)(8192KiB/2345msec); 0 zone resets clat (msec): min=514, max=1122, avg=818.63, stdev=430.35 lat (msec): min=514, max=1123, avg=818.95, stdev=430.29 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8078, max= 8078, per=57.81%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=13.99%, ctx=75, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152043: Thu Jul 16 16:48:33 2026 write: IOPS=1, BW=6053KiB/s (6198kB/s)(12.0MiB/2030msec); 0 zone resets clat (msec): min=292, max=1015, avg=666.06, stdev=361.84 lat (msec): min=293, max=1015, avg=666.34, stdev=361.88 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8078, max= 8078, per=57.81%, avg=8078.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.24%, ctx=97, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152044: Thu Jul 16 16:48:33 2026 write: IOPS=1, BW=7670KiB/s (7855kB/s)(12.0MiB/1602msec); 0 zone resets clat (msec): min=161, max=1016, avg=512.91, stdev=447.60 lat (msec): min=161, max=1017, avg=513.22, stdev=447.55 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7557, max= 8192, per=56.36%, avg=7874.50, stdev=449.01, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.12%, sys=18.30%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6987KiB/s (7154kB/s), 1747KiB/s-13.4MiB/s (1789kB/s-14.0MB/s), io=16.0MiB (16.8MB), run=897-2345msec WRITE: bw=13.6MiB/s (14.3MB/s), 3493KiB/s-7670KiB/s (3577kB/s-7855kB/s), io=32.0MiB (33.6MB), run=1602-2345msec