== sanity test 398b: DIO and buffer IO race ============== 21:31:27 (1789522287) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.06191 s, 9.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144834: Tue Sep 15 21:34:11 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(5992KiB/143806msec) clat (usec): min=33, max=905555, avg=45718.29, stdev=44951.65 lat (usec): min=33, max=905557, avg=45721.34, stdev=44950.60 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 16909], | 30.00th=[ 23200], 40.00th=[ 29230], 50.00th=[ 36439], 60.00th=[ 45351], | 70.00th=[ 57410], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[117965], | 99.00th=[179307], 99.50th=[221250], 99.90th=[358613], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 111, per=25.33%, avg=42.05, stdev=20.18, samples=277 iops : min= 1, max= 27, avg= 9.87, stdev= 5.10, samples=277 write: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6296KiB/143806msec); 0 zone resets clat (usec): min=974, max=604916, avg=47452.65, stdev=55430.80 lat (usec): min=975, max=604917, avg=47455.11, stdev=55430.77 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1483], 20.00th=[ 4228], | 30.00th=[ 8225], 40.00th=[ 19006], 50.00th=[ 31851], 60.00th=[ 45876], | 70.00th=[ 61604], 80.00th=[ 82314], 90.00th=[111674], 95.00th=[145753], | 99.00th=[246416], 99.50th=[320865], 99.90th=[513803], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 150, per=25.21%, avg=43.87, stdev=21.31, samples=279 iops : min= 1, max= 37, avg=10.33, stdev= 5.37, samples=279 lat (usec) : 50=1.07%, 100=5.05%, 250=0.65%, 500=0.23%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=6.09%, 4=3.74%, 10=7.03%, 20=8.17%, 50=30.76% lat (msec) : 100=26.43%, 250=9.93%, 500=0.49%, 750=0.07%, 1000=0.03% cpu : usr=0.07%, sys=4.88%, ctx=6300, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144835: Tue Sep 15 21:34:11 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(5940KiB/142625msec) clat (usec): min=27, max=390848, avg=43705.34, stdev=35747.97 lat (usec): min=27, max=390850, avg=43709.93, stdev=35749.20 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 17695], | 30.00th=[ 24249], 40.00th=[ 30016], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 54264], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[162530], 99.50th=[185598], 99.90th=[246416], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 5, max= 103, per=25.22%, avg=41.87, stdev=19.95, samples=274 iops : min= 1, max= 25, avg= 9.84, stdev= 5.03, samples=274 write: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6348KiB/142625msec); 0 zone resets clat (usec): min=975, max=965895, avg=48651.96, stdev=57776.33 lat (usec): min=976, max=965897, avg=48654.61, stdev=57775.90 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1516], 20.00th=[ 4146], | 30.00th=[ 8848], 40.00th=[ 20841], 50.00th=[ 33162], 60.00th=[ 45876], | 70.00th=[ 63701], 80.00th=[ 83362], 90.00th=[115868], 95.00th=[149947], | 99.00th=[231736], 99.50th=[299893], 99.90th=[450888], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 123, per=25.21%, avg=43.87, stdev=20.74, samples=279 iops : min= 1, max= 30, avg=10.33, stdev= 5.21, samples=279 lat (usec) : 50=0.75%, 100=5.31%, 250=0.72%, 500=0.07%, 1000=0.16% lat (msec) : 2=6.61%, 4=3.55%, 10=6.35%, 20=7.71%, 50=32.45% lat (msec) : 100=25.78%, 250=10.06%, 500=0.46%, 1000=0.03% cpu : usr=0.08%, sys=4.89%, ctx=6219, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Tue Sep 15 21:34:11 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6028KiB/143861msec) clat (usec): min=29, max=371824, avg=41507.05, stdev=37083.72 lat (usec): min=29, max=371825, avg=41509.06, stdev=37083.67 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 14353], | 30.00th=[ 21890], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 41157], | 70.00th=[ 51643], 80.00th=[ 64226], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[166724], 99.50th=[219153], 99.90th=[308282], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 120, per=25.55%, avg=42.41, stdev=22.60, samples=276 iops : min= 1, max= 30, avg= 9.95, stdev= 5.70, samples=276 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6260KiB/143861msec); 0 zone resets clat (usec): min=924, max=1346.2k, avg=51622.48, stdev=67966.39 lat (usec): min=925, max=1346.2k, avg=51625.17, stdev=67966.54 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1516], | 20.00th=[ 4146], 30.00th=[ 9241], 40.00th=[ 22676], | 50.00th=[ 35914], 60.00th=[ 48497], 70.00th=[ 63701], | 80.00th=[ 84411], 90.00th=[ 120062], 95.00th=[ 156238], | 99.00th=[ 265290], 99.50th=[ 341836], 99.90th=[ 666895], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 128, per=25.13%, avg=43.73, stdev=21.86, samples=278 iops : min= 1, max= 32, avg=10.29, stdev= 5.50, samples=278 lat (usec) : 50=0.98%, 100=6.12%, 250=0.49%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=6.25%, 4=3.71%, 10=6.09%, 20=8.92%, 50=31.48% lat (msec) : 100=25.10%, 250=9.73%, 500=0.68%, 750=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.82%, ctx=6264, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Tue Sep 15 21:34:11 2026 read: IOPS=10, BW=42.0KiB/s (44.0kB/s)(6052KiB/140837msec) clat (usec): min=30, max=1016.8k, avg=43492.79, stdev=46713.22 lat (usec): min=31, max=1016.8k, avg=43497.04, stdev=46713.99 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 64], | 20.00th=[ 15533], 30.00th=[ 22676], 40.00th=[ 28967], | 50.00th=[ 34866], 60.00th=[ 42206], 70.00th=[ 52691], | 80.00th=[ 65274], 90.00th=[ 88605], 95.00th=[ 112722], | 99.00th=[ 175113], 99.50th=[ 198181], 99.90th=[ 608175], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 5, max= 103, per=26.10%, avg=43.33, stdev=20.59, samples=272 iops : min= 1, max= 25, avg=10.20, stdev= 5.18, samples=272 write: IOPS=11, BW=44.3KiB/s (45.3kB/s)(6236KiB/140837msec); 0 zone resets clat (usec): min=943, max=518957, avg=47803.53, stdev=51237.45 lat (usec): min=944, max=518958, avg=47806.45, stdev=51237.57 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1450], 20.00th=[ 4080], | 30.00th=[ 8979], 40.00th=[ 21627], 50.00th=[ 34341], 60.00th=[ 45876], | 70.00th=[ 63177], 80.00th=[ 83362], 90.00th=[112722], 95.00th=[143655], | 99.00th=[219153], 99.50th=[263193], 99.90th=[304088], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 143, per=25.47%, avg=44.32, stdev=21.51, samples=274 iops : min= 1, max= 35, avg=10.44, stdev= 5.39, samples=274 lat (usec) : 50=0.94%, 100=5.96%, 250=0.59%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=6.51%, 4=3.65%, 10=5.86%, 20=8.92%, 50=32.00% lat (msec) : 100=24.41%, 250=10.42%, 500=0.29%, 750=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.93%, ctx=6182, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=167KiB/s (171kB/s), 41.6KiB/s-42.0KiB/s (42.6kB/s-44.0kB/s), io=23.4MiB (24.6MB), run=140837-143861msec WRITE: bw=175KiB/s (179kB/s), 43.5KiB/s-44.5KiB/s (44.6kB/s-45.6kB/s), io=24.6MiB (25.7MB), run=140837-143861msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144836: Tue Sep 15 21:36:22 2026 read: IOPS=5, BW=21.8KiB/s (22.4kB/s)(5992KiB/274489msec) clat (msec): min=5, max=1030, avg=35.78, stdev=52.81 lat (msec): min=5, max=1030, avg=35.78, stdev=52.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 31], 80.00th=[ 49], 90.00th=[ 86], 95.00th=[ 118], | 99.00th=[ 199], 99.50th=[ 236], 99.90th=[ 768], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 96, per=29.23%, avg=25.43, stdev=18.46, samples=457 iops : min= 1, max= 24, avg= 5.77, stdev= 4.67, samples=457 write: IOPS=5, BW=22.9KiB/s (23.5kB/s)(6296KiB/274489msec); 0 zone resets clat (msec): min=40, max=638, avg=140.05, stdev=89.49 lat (msec): min=40, max=638, avg=140.06, stdev=89.49 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 77], | 30.00th=[ 88], 40.00th=[ 97], 50.00th=[ 109], 60.00th=[ 125], | 70.00th=[ 148], 80.00th=[ 192], 90.00th=[ 257], 95.00th=[ 334], | 99.00th=[ 477], 99.50th=[ 523], 99.90th=[ 634], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 56, per=25.41%, avg=23.13, stdev=12.97, samples=526 iops : min= 1, max= 14, avg= 5.19, stdev= 3.31, samples=526 lat (msec) : 10=5.27%, 20=20.61%, 50=14.36%, 100=27.28%, 250=26.60% lat (msec) : 500=5.47%, 750=0.36%, 1000=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.02%, ctx=5409, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144838: Tue Sep 15 21:36:22 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(5940KiB/274820msec) clat (msec): min=5, max=1009, avg=35.19, stdev=53.92 lat (msec): min=5, max=1009, avg=35.20, stdev=53.91 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 44], 90.00th=[ 78], 95.00th=[ 114], | 99.00th=[ 209], 99.50th=[ 243], 99.90th=[ 768], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 112, per=30.12%, avg=26.21, stdev=18.79, samples=439 iops : min= 1, max= 28, avg= 5.96, stdev= 4.76, samples=439 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6348KiB/274820msec); 0 zone resets clat (msec): min=36, max=826, avg=139.93, stdev=91.11 lat (msec): min=36, max=826, avg=139.93, stdev=91.11 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 97], 50.00th=[ 108], 60.00th=[ 123], | 70.00th=[ 150], 80.00th=[ 194], 90.00th=[ 262], 95.00th=[ 326], | 99.00th=[ 481], 99.50th=[ 531], 99.90th=[ 659], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 63, per=25.68%, avg=23.37, stdev=12.89, samples=524 iops : min= 1, max= 15, avg= 5.25, stdev= 3.30, samples=524 lat (msec) : 10=5.47%, 20=19.37%, 50=16.08%, 100=26.69%, 250=26.11% lat (msec) : 500=5.79%, 750=0.39%, 1000=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5415, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Tue Sep 15 21:36:22 2026 read: IOPS=5, BW=21.0KiB/s (22.5kB/s)(6028KiB/274564msec) clat (msec): min=5, max=357, avg=37.14, stdev=43.88 lat (msec): min=5, max=357, avg=37.14, stdev=43.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 54], 90.00th=[ 89], 95.00th=[ 125], | 99.00th=[ 220], 99.50th=[ 268], 99.90th=[ 347], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 7, max= 118, per=28.89%, avg=25.13, stdev=18.59, samples=465 iops : min= 1, max= 29, avg= 5.70, stdev= 4.71, samples=465 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6260KiB/274564msec); 0 zone resets clat (msec): min=33, max=1305, avg=139.40, stdev=94.11 lat (msec): min=33, max=1305, avg=139.41, stdev=94.11 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 96], 50.00th=[ 110], 60.00th=[ 124], | 70.00th=[ 146], 80.00th=[ 184], 90.00th=[ 264], 95.00th=[ 334], | 99.00th=[ 485], 99.50th=[ 535], 99.90th=[ 743], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7, max= 63, per=25.41%, avg=23.12, stdev=13.10, samples=523 iops : min= 1, max= 15, avg= 5.18, stdev= 3.35, samples=523 lat (msec) : 10=5.66%, 20=18.82%, 50=15.17%, 100=27.38%, 250=26.76% lat (msec) : 500=5.83%, 750=0.36%, 2000=0.03% cpu : usr=0.03%, sys=1.12%, ctx=5392, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144841: Tue Sep 15 21:36:22 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6052KiB/272710msec) clat (msec): min=5, max=454, avg=34.87, stdev=41.02 lat (msec): min=5, max=454, avg=34.87, stdev=41.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 48], 90.00th=[ 84], 95.00th=[ 117], | 99.00th=[ 186], 99.50th=[ 226], 99.90th=[ 397], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 96, per=29.83%, avg=25.95, stdev=18.84, samples=452 iops : min= 1, max= 24, avg= 5.89, stdev= 4.76, samples=452 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6236KiB/272710msec); 0 zone resets clat (msec): min=29, max=1163, avg=140.80, stdev=93.27 lat (msec): min=29, max=1163, avg=140.80, stdev=93.27 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 87], 40.00th=[ 99], 50.00th=[ 110], 60.00th=[ 127], | 70.00th=[ 150], 80.00th=[ 194], 90.00th=[ 262], 95.00th=[ 321], | 99.00th=[ 477], 99.50th=[ 575], 99.90th=[ 726], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 55, per=25.43%, avg=23.14, stdev=12.79, samples=520 iops : min= 1, max= 13, avg= 5.19, stdev= 3.27, samples=520 lat (msec) : 10=5.50%, 20=19.63%, 50=15.98%, 100=25.65%, 250=27.54% lat (msec) : 500=5.27%, 750=0.39%, 2000=0.03% cpu : usr=0.04%, sys=1.08%, ctx=5288, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=87.4KiB/s (89.5kB/s), 21.6KiB/s-22.2KiB/s (22.1kB/s-22.7kB/s), io=23.4MiB (24.6MB), run=272710-274820msec WRITE: bw=91.5KiB/s (93.7kB/s), 22.8KiB/s-23.1KiB/s (23.3kB/s-23.7kB/s), io=24.6MiB (25.7MB), run=272710-274820msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144901: Tue Sep 15 21:36:54 2026 read: IOPS=17, BW=276KiB/s (283kB/s)(5920KiB/21417msec) clat (usec): min=35, max=156048, avg=27958.88, stdev=26052.21 lat (usec): min=35, max=156049, avg=27960.81, stdev=26051.93 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 83], | 30.00th=[ 971], 40.00th=[ 19792], 50.00th=[ 26870], 60.00th=[ 32375], | 70.00th=[ 38536], 80.00th=[ 48497], 90.00th=[ 57410], 95.00th=[ 71828], | 99.00th=[116917], 99.50th=[143655], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 93, max= 600, per=25.11%, avg=276.71, stdev=117.11, samples=42 iops : min= 5, max= 37, avg=16.57, stdev= 7.42, samples=42 write: IOPS=18, BW=297KiB/s (304kB/s)(6368KiB/21417msec); 0 zone resets clat (usec): min=1435, max=214228, avg=27759.91, stdev=29704.05 lat (usec): min=1437, max=214230, avg=27761.88, stdev=29704.05 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1762], 10.00th=[ 2343], 20.00th=[ 4359], | 30.00th=[ 6718], 40.00th=[ 9372], 50.00th=[ 16057], 60.00th=[ 24511], | 70.00th=[ 35914], 80.00th=[ 50070], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[117965], 99.50th=[154141], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 93, max= 606, per=25.76%, avg=298.81, stdev=122.99, samples=42 iops : min= 5, max= 37, avg=17.95, stdev= 7.77, samples=42 lat (usec) : 50=1.69%, 100=9.51%, 250=2.08%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.39% lat (msec) : 2=3.91%, 4=5.73%, 10=12.63%, 20=10.94%, 50=32.81% lat (msec) : 100=17.71%, 250=1.82% cpu : usr=0.07%, sys=7.40%, ctx=1409, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144902: Tue Sep 15 21:36:54 2026 read: IOPS=16, BW=268KiB/s (275kB/s)(5744KiB/21404msec) clat (usec): min=37, max=160819, avg=28772.11, stdev=27799.62 lat (usec): min=37, max=160820, avg=28773.29, stdev=27799.59 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 60], 20.00th=[ 71], | 30.00th=[ 396], 40.00th=[ 19792], 50.00th=[ 26084], 60.00th=[ 33817], | 70.00th=[ 39584], 80.00th=[ 49021], 90.00th=[ 65274], 95.00th=[ 76022], | 99.00th=[121111], 99.50th=[156238], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 54, max= 510, per=24.85%, avg=273.88, stdev=106.50, samples=41 iops : min= 3, max= 31, avg=16.37, stdev= 6.74, samples=41 write: IOPS=19, BW=306KiB/s (313kB/s)(6544KiB/21404msec); 0 zone resets clat (usec): min=1402, max=274819, avg=26994.26, stdev=33075.62 lat (usec): min=1403, max=274822, avg=26999.26, stdev=33073.61 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1795], 10.00th=[ 2442], 20.00th=[ 4424], | 30.00th=[ 6980], 40.00th=[ 10814], 50.00th=[ 14746], 60.00th=[ 23462], | 70.00th=[ 31589], 80.00th=[ 44303], 90.00th=[ 67634], 95.00th=[ 85459], | 99.00th=[143655], 99.50th=[191890], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 63, max= 760, per=26.24%, avg=304.36, stdev=138.43, samples=42 iops : min= 3, max= 47, avg=18.29, stdev= 8.74, samples=42 lat (usec) : 50=2.34%, 100=10.03%, 250=1.43%, 500=0.26%, 750=0.52% lat (usec) : 1000=0.13% lat (msec) : 2=3.65%, 4=6.90%, 10=10.55%, 20=13.54%, 50=33.07% lat (msec) : 100=14.97%, 250=2.47%, 500=0.13% cpu : usr=0.09%, sys=7.83%, ctx=1384, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144903: Tue Sep 15 21:36:54 2026 read: IOPS=18, BW=288KiB/s (295kB/s)(6256KiB/21720msec) clat (usec): min=35, max=122672, avg=28015.44, stdev=24872.86 lat (usec): min=35, max=122673, avg=28016.73, stdev=24872.80 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 80], | 30.00th=[ 10159], 40.00th=[ 19792], 50.00th=[ 26346], 60.00th=[ 31851], | 70.00th=[ 38536], 80.00th=[ 47973], 90.00th=[ 63177], 95.00th=[ 73925], | 99.00th=[102237], 99.50th=[117965], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 94, max= 665, per=26.07%, avg=287.24, stdev=105.60, samples=42 iops : min= 5, max= 41, avg=17.21, stdev= 6.72, samples=42 write: IOPS=17, BW=278KiB/s (284kB/s)(6032KiB/21720msec); 0 zone resets clat (usec): min=1445, max=156602, avg=28452.97, stdev=29438.30 lat (usec): min=1448, max=156603, avg=28456.19, stdev=29437.62 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1827], 10.00th=[ 2671], 20.00th=[ 4686], | 30.00th=[ 6587], 40.00th=[ 10290], 50.00th=[ 17957], 60.00th=[ 26346], | 70.00th=[ 35914], 80.00th=[ 53216], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[127402], 99.50th=[143655], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 63, max= 415, per=23.53%, avg=272.93, stdev=88.21, samples=42 iops : min= 3, max= 25, avg=16.31, stdev= 5.48, samples=42 lat (usec) : 50=1.95%, 100=10.81%, 250=1.56%, 500=0.26% lat (msec) : 2=2.99%, 4=5.34%, 10=11.59%, 20=12.24%, 50=33.33% lat (msec) : 100=17.58%, 250=2.34% cpu : usr=0.11%, sys=7.64%, ctx=1431, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144904: Tue Sep 15 21:36:54 2026 read: IOPS=17, BW=282KiB/s (289kB/s)(6032KiB/21385msec) clat (usec): min=34, max=164406, avg=25793.97, stdev=26148.80 lat (usec): min=34, max=164407, avg=25795.29, stdev=26148.92 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 51], 10.00th=[ 60], 20.00th=[ 69], | 30.00th=[ 115], 40.00th=[ 16188], 50.00th=[ 24773], 60.00th=[ 30016], | 70.00th=[ 36439], 80.00th=[ 44303], 90.00th=[ 60031], 95.00th=[ 70779], | 99.00th=[104334], 99.50th=[139461], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 458, per=25.46%, avg=280.62, stdev=97.16, samples=42 iops : min= 3, max= 28, avg=16.79, stdev= 6.16, samples=42 write: IOPS=18, BW=293KiB/s (300kB/s)(6256KiB/21385msec); 0 zone resets clat (usec): min=1273, max=165669, avg=29729.99, stdev=30836.39 lat (usec): min=1274, max=165671, avg=29744.82, stdev=30838.12 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1991], 10.00th=[ 2900], 20.00th=[ 4686], | 30.00th=[ 7832], 40.00th=[ 10552], 50.00th=[ 16319], 60.00th=[ 26346], | 70.00th=[ 37487], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[128451], 99.50th=[156238], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 158, max= 508, per=25.21%, avg=292.43, stdev=90.89, samples=42 iops : min= 9, max= 31, avg=17.57, stdev= 5.70, samples=42 lat (usec) : 50=2.34%, 100=11.72%, 250=1.82%, 500=0.91%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=5.99%, 10=11.72%, 20=10.03%, 50=33.59% lat (msec) : 100=16.02%, 250=2.47% cpu : usr=0.09%, sys=7.50%, ctx=1403, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1103KiB/s (1129kB/s), 268KiB/s-288KiB/s (275kB/s-295kB/s), io=23.4MiB (24.5MB), run=21385-21720msec WRITE: bw=1160KiB/s (1188kB/s), 278KiB/s-306KiB/s (284kB/s-313kB/s), io=24.6MiB (25.8MB), run=21385-21720msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144896: Tue Sep 15 21:37:35 2026 read: IOPS=5, BW=94.0KiB/s (96.3kB/s)(5920KiB/62970msec) clat (msec): min=7, max=276, avg=33.99, stdev=29.74 lat (msec): min=7, max=276, avg=33.99, stdev=29.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 63], 95.00th=[ 87], | 99.00th=[ 155], 99.50th=[ 253], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 349, per=26.39%, avg=100.03, stdev=58.86, samples=116 iops : min= 1, max= 21, avg= 5.53, stdev= 3.70, samples=116 write: IOPS=6, BW=101KiB/s (104kB/s)(6368KiB/62970msec); 0 zone resets clat (msec): min=44, max=325, avg=126.25, stdev=47.60 lat (msec): min=44, max=325, avg=126.26, stdev=47.60 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 108], 50.00th=[ 120], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 190], 95.00th=[ 213], | 99.00th=[ 279], 99.50th=[ 309], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 191, per=25.56%, avg=101.75, stdev=36.36, samples=123 iops : min= 1, max= 11, avg= 5.64, stdev= 2.31, samples=123 lat (msec) : 10=1.17%, 20=14.06%, 50=26.43%, 100=20.96%, 250=35.81% lat (msec) : 500=1.56% cpu : usr=0.03%, sys=1.39%, ctx=1317, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144897: Tue Sep 15 21:37:35 2026 read: IOPS=5, BW=90.9KiB/s (93.1kB/s)(5744KiB/63164msec) clat (msec): min=6, max=204, avg=32.50, stdev=29.94 lat (msec): min=6, max=204, avg=32.50, stdev=29.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 70], 95.00th=[ 102], | 99.00th=[ 161], 99.50th=[ 190], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 21, max= 318, per=26.45%, avg=100.26, stdev=62.86, samples=112 iops : min= 1, max= 19, avg= 5.54, stdev= 3.97, samples=112 write: IOPS=6, BW=104KiB/s (106kB/s)(6544KiB/63164msec); 0 zone resets clat (msec): min=48, max=372, avg=125.82, stdev=46.42 lat (msec): min=48, max=372, avg=125.82, stdev=46.42 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 109], 50.00th=[ 120], 60.00th=[ 129], | 70.00th=[ 142], 80.00th=[ 159], 90.00th=[ 186], 95.00th=[ 207], | 99.00th=[ 279], 99.50th=[ 288], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 160, per=25.83%, avg=102.81, stdev=34.21, samples=124 iops : min= 1, max= 10, avg= 5.70, stdev= 2.23, samples=124 lat (msec) : 10=1.69%, 20=17.84%, 50=20.05%, 100=22.14%, 250=37.24% lat (msec) : 500=1.04% cpu : usr=0.03%, sys=1.39%, ctx=1237, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144898: Tue Sep 15 21:37:35 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(6256KiB/60568msec) clat (msec): min=6, max=252, avg=31.17, stdev=25.39 lat (msec): min=6, max=252, avg=31.17, stdev=25.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 58], 95.00th=[ 78], | 99.00th=[ 142], 99.50th=[ 144], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 30, max= 415, per=29.06%, avg=110.14, stdev=72.12, samples=112 iops : min= 1, max= 25, avg= 6.15, stdev= 4.59, samples=112 write: IOPS=6, BW=99.6KiB/s (102kB/s)(6032KiB/60568msec); 0 zone resets clat (msec): min=44, max=390, avg=127.85, stdev=51.48 lat (msec): min=44, max=390, avg=127.85, stdev=51.48 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 87], | 30.00th=[ 95], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 163], 90.00th=[ 188], 95.00th=[ 222], | 99.00th=[ 300], 99.50th=[ 359], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 160, per=24.73%, avg=98.44, stdev=34.30, samples=119 iops : min= 1, max= 10, avg= 5.42, stdev= 2.18, samples=119 lat (msec) : 10=1.95%, 20=17.97%, 50=24.87%, 100=21.61%, 250=31.90% lat (msec) : 500=1.69% cpu : usr=0.02%, sys=1.44%, ctx=1409, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144899: Tue Sep 15 21:37:35 2026 read: IOPS=6, BW=97.3KiB/s (99.7kB/s)(6032KiB/61968msec) clat (msec): min=6, max=239, avg=34.94, stdev=32.94 lat (msec): min=6, max=239, avg=34.94, stdev=32.94 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 71], 95.00th=[ 109], | 99.00th=[ 180], 99.50th=[ 203], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 30, max= 349, per=26.43%, avg=100.18, stdev=60.03, samples=117 iops : min= 1, max= 21, avg= 5.55, stdev= 3.75, samples=117 write: IOPS=6, BW=101KiB/s (103kB/s)(6256KiB/61968msec); 0 zone resets clat (msec): min=36, max=311, avg=124.40, stdev=44.58 lat (msec): min=36, max=311, avg=124.41, stdev=44.58 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 75], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 130], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 186], 95.00th=[ 213], | 99.00th=[ 257], 99.50th=[ 271], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 192, per=25.45%, avg=101.27, stdev=36.12, samples=121 iops : min= 1, max= 12, avg= 5.60, stdev= 2.31, samples=121 lat (msec) : 10=2.34%, 20=16.80%, 50=22.53%, 100=22.14%, 250=35.68% lat (msec) : 500=0.52% cpu : usr=0.03%, sys=1.38%, ctx=1359, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=379KiB/s (388kB/s), 90.9KiB/s-103KiB/s (93.1kB/s-106kB/s), io=23.4MiB (24.5MB), run=60568-63164msec WRITE: bw=399KiB/s (409kB/s), 99.6KiB/s-104KiB/s (102kB/s-106kB/s), io=24.6MiB (25.8MB), run=60568-63164msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144927: Tue Sep 15 21:37:48 2026 read: IOPS=1, BW=1650KiB/s (1689kB/s)(7168KiB/4345msec) clat (usec): min=469, max=330539, avg=237136.00, stdev=114857.45 lat (usec): min=471, max=330541, avg=237137.53, stdev=114857.43 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[219153], | 30.00th=[227541], 40.00th=[227541], 50.00th=[242222], 60.00th=[316670], | 70.00th=[316670], 80.00th=[325059], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 1822, max= 4071, per=59.58%, avg=2367.60, stdev=956.90, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1178KiB/s (1207kB/s)(5120KiB/4345msec); 0 zone resets clat (msec): min=226, max=709, avg=491.51, stdev=192.53 lat (msec): min=226, max=709, avg=491.59, stdev=192.52 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1812, max= 2019, per=34.67%, avg=1929.00, stdev=100.79, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=9.55%, ctx=292, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144928: Tue Sep 15 21:37:48 2026 read: IOPS=0, BW=404KiB/s (413kB/s)(2048KiB/5072msec) clat (usec): min=919, max=293412, avg=147165.93, stdev=206823.18 lat (usec): min=921, max=293414, avg=147167.74, stdev=206823.52 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 922], 10.00th=[ 922], 20.00th=[ 922], | 30.00th=[ 922], 40.00th=[ 922], 50.00th=[ 922], 60.00th=[291505], | 70.00th=[291505], 80.00th=[291505], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 1812, max= 1835, per=45.89%, avg=1823.50, stdev=16.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2019KiB/s (2067kB/s)(10.0MiB/5072msec); 0 zone resets clat (msec): min=138, max=1120, avg=452.38, stdev=305.61 lat (msec): min=138, max=1120, avg=452.47, stdev=305.59 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 167], | 30.00th=[ 239], 40.00th=[ 347], 50.00th=[ 393], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 443], 90.00th=[ 844], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1812, max= 4087, per=40.77%, avg=2268.43, stdev=806.77, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (usec) : 1000=8.33% lat (msec) : 250=25.00%, 500=50.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.96%, ctx=162, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144929: Tue Sep 15 21:37:48 2026 read: IOPS=1, BW=1192KiB/s (1221kB/s)(6144KiB/5153msec) clat (usec): min=484, max=405149, avg=208052.15, stdev=142381.16 lat (usec): min=485, max=405150, avg=208053.20, stdev=142381.16 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[141558], | 30.00th=[141558], 40.00th=[177210], 50.00th=[177210], 60.00th=[198181], | 70.00th=[325059], 80.00th=[325059], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 2007, max= 3757, per=62.00%, avg=2463.75, stdev=862.36, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1192KiB/s (1221kB/s)(6144KiB/5153msec); 0 zone resets clat (msec): min=107, max=1043, avg=643.25, stdev=349.16 lat (msec): min=107, max=1043, avg=643.33, stdev=349.16 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 860], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 2007, max= 4071, per=45.56%, avg=2535.00, stdev=1024.11, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=33.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.04%, sys=10.07%, ctx=194, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144930: Tue Sep 15 21:37:48 2026 read: IOPS=1, BW=1256KiB/s (1286kB/s)(5120KiB/4076msec) clat (usec): min=605, max=408507, avg=214260.95, stdev=197979.32 lat (usec): min=606, max=408508, avg=214262.14, stdev=197979.44 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 857], 40.00th=[ 857], 50.00th=[312476], 60.00th=[312476], | 70.00th=[350225], 80.00th=[350225], 90.00th=[408945], 95.00th=[408945], | 99.00th=[408945], 99.50th=[408945], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 1878, max= 3624, per=63.09%, avg=2507.00, stdev=969.92, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1759KiB/s (1801kB/s)(7168KiB/4076msec); 0 zone resets clat (msec): min=206, max=832, avg=403.30, stdev=216.31 lat (msec): min=206, max=832, avg=403.38, stdev=216.32 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 220], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 430], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 443], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1812, max= 2035, per=34.86%, avg=1939.40, stdev=108.55, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=16.67%, 500=58.33%, 1000=8.33% cpu : usr=0.12%, sys=12.25%, ctx=194, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3974KiB/s (4070kB/s), 404KiB/s-1650KiB/s (413kB/s-1689kB/s), io=20.0MiB (20.0MB), run=4076-5153msec WRITE: bw=5564KiB/s (5698kB/s), 1178KiB/s-2019KiB/s (1207kB/s-2067kB/s), io=28.0MiB (29.4MB), run=4076-5153msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144923: Tue Sep 15 21:37:49 2026 read: IOPS=1, BW=1850KiB/s (1895kB/s)(7168KiB/3874msec) clat (msec): min=106, max=249, avg=182.21, stdev=55.84 lat (msec): min=106, max=249, avg=182.22, stdev=55.84 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 144], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 163], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 247], 90.00th=[ 251], 95.00th=[ 251], | 99.00th=[ 251], 99.50th=[ 251], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 1976, max= 5224, per=97.44%, avg=3610.33, stdev=1624.10, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1322KiB/s (1353kB/s)(5120KiB/3874msec); 0 zone resets clat (msec): min=368, max=576, avg=501.42, stdev=90.25 lat (msec): min=368, max=576, avg=501.60, stdev=90.34 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1965, max= 2039, per=38.75%, avg=2010.00, stdev=36.30, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=58.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=4.47%, ctx=92, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144924: Tue Sep 15 21:37:49 2026 read: IOPS=0, BW=408KiB/s (418kB/s)(2048KiB/5018msec) clat (msec): min=108, max=192, avg=150.36, stdev=59.05 lat (msec): min=108, max=192, avg=150.36, stdev=59.05 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 1735, max= 2035, per=50.88%, avg=1885.00, stdev=212.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2041KiB/s (2090kB/s)(10.0MiB/5018msec); 0 zone resets clat (msec): min=154, max=1242, avg=468.31, stdev=369.33 lat (msec): min=154, max=1242, avg=468.41, stdev=369.33 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 199], | 30.00th=[ 224], 40.00th=[ 230], 50.00th=[ 257], 60.00th=[ 271], | 70.00th=[ 468], 80.00th=[ 776], 90.00th=[ 869], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1735, max= 4079, per=59.96%, avg=3110.20, stdev=1134.43, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 1000=16.67%, 2000=8.33% cpu : usr=0.08%, sys=5.20%, ctx=97, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144925: Tue Sep 15 21:37:49 2026 read: IOPS=1, BW=1217KiB/s (1246kB/s)(6144KiB/5049msec) clat (msec): min=146, max=571, avg=306.50, stdev=173.52 lat (msec): min=146, max=571, avg=306.50, stdev=173.52 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 363], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1976, max= 2043, per=54.65%, avg=2024.80, stdev=27.64, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1217KiB/s (1246kB/s)(6144KiB/5049msec); 0 zone resets clat (msec): min=385, max=852, avg=528.76, stdev=168.66 lat (msec): min=385, max=852, avg=528.84, stdev=168.66 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 472], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1560, max= 2031, per=36.04%, avg=1869.40, stdev=190.59, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=4.44%, ctx=119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144926: Tue Sep 15 21:37:49 2026 read: IOPS=0, BW=926KiB/s (949kB/s)(5120KiB/5527msec) clat (msec): min=49, max=578, avg=222.84, stdev=235.69 lat (msec): min=49, max=578, avg=222.84, stdev=235.69 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 70], 60.00th=[ 70], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2031, max= 4063, per=73.21%, avg=2712.33, stdev=1169.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1297KiB/s (1328kB/s)(7168KiB/5527msec); 0 zone resets clat (msec): min=126, max=1384, avg=588.08, stdev=430.90 lat (msec): min=126, max=1384, avg=588.50, stdev=431.10 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 157], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 558], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 827], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1965, max= 2043, per=38.98%, avg=2021.80, stdev=32.05, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=16.67%, 750=25.00% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.04%, sys=4.02%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3705KiB/s (3794kB/s), 408KiB/s-1850KiB/s (418kB/s-1895kB/s), io=20.0MiB (20.0MB), run=3874-5527msec WRITE: bw=5188KiB/s (5312kB/s), 1217KiB/s-2041KiB/s (1246kB/s-2090kB/s), io=28.0MiB (29.4MB), run=3874-5527msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144937: Tue Sep 15 21:38:03 2026 read: IOPS=1, BW=4236KiB/s (4337kB/s)(12.0MiB/2901msec) clat (msec): min=759, max=1102, avg=954.58, stdev=176.35 lat (msec): min=759, max=1102, avg=954.58, stdev=176.35 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7953, max= 8110, per=100.00%, avg=8031.50, stdev=111.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.07%, sys=11.97%, ctx=221, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144938: Tue Sep 15 21:38:03 2026 read: IOPS=0, BW=1549KiB/s (1586kB/s)(4096KiB/2645msec) clat (nsec): min=1024.1M, max=1024.1M, avg=1024062537.00, stdev= 0.00 lat (nsec): min=1024.1M, max=1024.1M, avg=1024065617.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3097KiB/s (3171kB/s)(8192KiB/2645msec); 0 zone resets clat (msec): min=705, max=841, avg=773.31, stdev=96.32 lat (msec): min=706, max=847, avg=777.05, stdev=100.09 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8110, max= 8110, per=89.94%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.26%, ctx=116, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144939: Tue Sep 15 21:38:03 2026 write: IOPS=0, BW=3381KiB/s (3463kB/s)(12.0MiB/3634msec); 0 zone resets clat (msec): min=416, max=1799, avg=1186.52, stdev=704.77 lat (msec): min=418, max=1827, avg=1196.68, stdev=716.11 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8110, max= 8110, per=89.94%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=6.28%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144940: Tue Sep 15 21:38:03 2026 write: IOPS=0, BW=3616KiB/s (3703kB/s)(12.0MiB/3398msec); 0 zone resets clat (msec): min=462, max=2148, avg=1093.12, stdev=919.74 lat (msec): min=464, max=2148, avg=1094.16, stdev=919.24 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7656, max= 8192, per=87.88%, avg=7924.00, stdev=379.01, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.41%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5648KiB/s (5783kB/s), 1549KiB/s-4236KiB/s (1586kB/s-4337kB/s), io=16.0MiB (16.8MB), run=2645-2901msec WRITE: bw=9017KiB/s (9233kB/s), 3097KiB/s-3616KiB/s (3171kB/s-3703kB/s), io=32.0MiB (33.6MB), run=2645-3634msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Tue Sep 15 21:38:04 2026 read: IOPS=1, BW=7319KiB/s (7494kB/s)(12.0MiB/1679msec) clat (msec): min=164, max=1100, avg=517.20, stdev=508.71 lat (msec): min=164, max=1100, avg=517.20, stdev=508.71 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min=12860, max=12860, per=100.00%, avg=12860.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.39%, ctx=61, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144942: Tue Sep 15 21:38:04 2026 read: IOPS=0, BW=1106KiB/s (1132kB/s)(4096KiB/3704msec) clat (nsec): min=1216.6M, max=1216.6M, avg=1216638792.00, stdev= 0.00 lat (nsec): min=1216.6M, max=1216.6M, avg=1216641367.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2212KiB/s (2265kB/s)(8192KiB/3704msec); 0 zone resets clat (msec): min=1134, max=1311, avg=1222.59, stdev=125.27 lat (msec): min=1135, max=1311, avg=1223.51, stdev=124.37 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.03%, sys=3.08%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144943: Tue Sep 15 21:38:04 2026 write: IOPS=0, BW=2860KiB/s (2929kB/s)(12.0MiB/4296msec); 0 zone resets clat (msec): min=300, max=2978, avg=1416.99, stdev=1393.21 lat (msec): min=301, max=2979, avg=1417.59, stdev=1393.44 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 8062, max= 8143, per=100.00%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=2.12%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144944: Tue Sep 15 21:38:04 2026 write: IOPS=0, BW=3477KiB/s (3561kB/s)(12.0MiB/3534msec); 0 zone resets clat (msec): min=931, max=1387, avg=1159.81, stdev=228.28 lat (msec): min=931, max=1390, avg=1160.98, stdev=229.40 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.42%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4423KiB/s (4529kB/s), 1106KiB/s-7319KiB/s (1132kB/s-7494kB/s), io=16.0MiB (16.8MB), run=1679-3704msec WRITE: bw=7628KiB/s (7811kB/s), 2212KiB/s-3477KiB/s (2265kB/s-3561kB/s), io=32.0MiB (33.6MB), run=3534-4296msec