== sanity test 398b: DIO and buffer IO race ============== 04:30:48 (1781685048) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.43645 s, 20.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189990: Wed Jun 17 04:31:54 2026 read: IOPS=26, BW=105KiB/s (107kB/s)(5992KiB/57316msec) clat (usec): min=50, max=454942, avg=20298.27, stdev=15741.38 lat (usec): min=51, max=454944, avg=20298.89, stdev=15741.43 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 7308], 10.00th=[ 8848], 20.00th=[ 11207], | 30.00th=[ 13435], 40.00th=[ 15664], 50.00th=[ 17957], 60.00th=[ 20055], | 70.00th=[ 23462], 80.00th=[ 27919], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 52691], 99.50th=[ 64750], 99.90th=[100140], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 38, max= 200, per=25.12%, avg=104.25, stdev=37.02, samples=114 iops : min= 9, max= 50, avg=25.68, stdev= 9.34, samples=114 write: IOPS=27, BW=110KiB/s (112kB/s)(6296KiB/57316msec); 0 zone resets clat (usec): min=697, max=85632, avg=17061.29, stdev=12443.08 lat (usec): min=697, max=85633, avg=17062.10, stdev=12443.16 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 2933], 10.00th=[ 3621], 20.00th=[ 5997], | 30.00th=[ 8848], 40.00th=[11469], 50.00th=[14091], 60.00th=[17433], | 70.00th=[21103], 80.00th=[26870], 90.00th=[34341], 95.00th=[41157], | 99.00th=[53216], 99.50th=[60031], 99.90th=[81265], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 7, max= 192, per=25.14%, avg=109.36, stdev=34.58, samples=114 iops : min= 1, max= 48, avg=26.96, stdev= 8.67, samples=114 lat (usec) : 100=0.29%, 250=0.75%, 500=0.10%, 750=0.07%, 1000=0.20% lat (msec) : 2=0.75%, 4=4.82%, 10=18.16%, 20=37.92%, 50=35.35% lat (msec) : 100=1.53%, 250=0.03%, 500=0.03% cpu : usr=0.09%, sys=26.34%, ctx=10124, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189991: Wed Jun 17 04:31:54 2026 read: IOPS=25, BW=103KiB/s (105kB/s)(5940KiB/57747msec) clat (usec): min=42, max=481571, avg=20903.78, stdev=16103.75 lat (usec): min=42, max=481572, avg=20907.89, stdev=16105.98 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 7767], 10.00th=[ 9241], 20.00th=[ 11731], | 30.00th=[ 13960], 40.00th=[ 16319], 50.00th=[ 18220], 60.00th=[ 20841], | 70.00th=[ 24249], 80.00th=[ 28443], 90.00th=[ 35390], 95.00th=[ 41157], | 99.00th=[ 53740], 99.50th=[ 61080], 99.90th=[ 77071], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 208, per=24.70%, avg=102.51, stdev=34.77, samples=115 iops : min= 1, max= 52, avg=25.25, stdev= 8.74, samples=115 write: IOPS=27, BW=110KiB/s (113kB/s)(6348KiB/57747msec); 0 zone resets clat (usec): min=687, max=101167, avg=16791.93, stdev=12579.44 lat (usec): min=687, max=101168, avg=16792.72, stdev=12579.48 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2737], 10.00th=[ 3261], 20.00th=[ 5407], | 30.00th=[ 8586], 40.00th=[ 11207], 50.00th=[ 13829], 60.00th=[ 17171], | 70.00th=[ 21103], 80.00th=[ 26346], 90.00th=[ 34341], 95.00th=[ 40633], | 99.00th=[ 54789], 99.50th=[ 62129], 99.90th=[ 83362], 99.95th=[101188], | 99.99th=[101188] bw ( KiB/s): min= 15, max= 312, per=25.12%, avg=109.25, stdev=41.43, samples=115 iops : min= 3, max= 78, avg=26.94, stdev=10.44, samples=115 lat (usec) : 50=0.03%, 100=0.16%, 250=0.68%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=0.78%, 4=6.25%, 10=16.05%, 20=38.02%, 50=36.13% lat (msec) : 100=1.56%, 250=0.03%, 500=0.03% cpu : usr=0.08%, sys=26.18%, ctx=10019, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189992: Wed Jun 17 04:31:54 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(6028KiB/57189msec) clat (usec): min=26, max=95648, avg=20733.18, stdev=11260.62 lat (usec): min=27, max=95648, avg=20734.20, stdev=11260.72 clat percentiles (usec): | 1.00th=[ 122], 5.00th=[ 7570], 10.00th=[ 9372], 20.00th=[11994], | 30.00th=[14353], 40.00th=[16450], 50.00th=[18744], 60.00th=[20841], | 70.00th=[24249], 80.00th=[28181], 90.00th=[34866], 95.00th=[42206], | 99.00th=[57410], 99.50th=[63701], 99.90th=[80217], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 39, max= 207, per=25.58%, avg=106.17, stdev=32.39, samples=113 iops : min= 9, max= 51, avg=26.17, stdev= 8.12, samples=113 write: IOPS=27, BW=109KiB/s (112kB/s)(6260KiB/57189msec); 0 zone resets clat (usec): min=665, max=488370, avg=16536.51, stdev=16734.77 lat (usec): min=665, max=488371, avg=16541.46, stdev=16737.59 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2868], 10.00th=[ 3425], 20.00th=[ 5604], | 30.00th=[ 8455], 40.00th=[ 11076], 50.00th=[ 13829], 60.00th=[ 17171], | 70.00th=[ 20317], 80.00th=[ 24773], 90.00th=[ 32375], 95.00th=[ 39060], | 99.00th=[ 54264], 99.50th=[ 59507], 99.90th=[ 74974], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 15, max= 208, per=25.11%, avg=109.25, stdev=40.83, samples=114 iops : min= 3, max= 52, avg=26.93, stdev=10.30, samples=114 lat (usec) : 50=0.03%, 100=0.23%, 250=0.78%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=0.49%, 4=6.18%, 10=16.47%, 20=38.54%, 50=35.25% lat (msec) : 100=1.79%, 500=0.03% cpu : usr=0.09%, sys=26.28%, ctx=10080, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189993: Wed Jun 17 04:31:54 2026 read: IOPS=26, BW=106KiB/s (108kB/s)(6052KiB/57155msec) clat (usec): min=43, max=81188, avg=20396.58, stdev=11014.64 lat (usec): min=43, max=81189, avg=20397.29, stdev=11014.68 clat percentiles (usec): | 1.00th=[ 105], 5.00th=[ 7570], 10.00th=[ 9241], 20.00th=[11469], | 30.00th=[13829], 40.00th=[16057], 50.00th=[18220], 60.00th=[20841], | 70.00th=[24249], 80.00th=[28181], 90.00th=[35390], 95.00th=[40633], | 99.00th=[55837], 99.50th=[61604], 99.90th=[76022], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 40, max= 192, per=25.61%, avg=106.27, stdev=34.40, samples=112 iops : min= 10, max= 48, avg=26.19, stdev= 8.64, samples=112 write: IOPS=27, BW=109KiB/s (112kB/s)(6236KiB/57155msec); 0 zone resets clat (usec): min=725, max=485891, avg=16834.16, stdev=17040.43 lat (usec): min=725, max=485892, avg=16835.02, stdev=17040.57 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 2835], 10.00th=[ 3392], 20.00th=[ 5473], | 30.00th=[ 8586], 40.00th=[ 11076], 50.00th=[ 13829], 60.00th=[ 16712], | 70.00th=[ 20579], 80.00th=[ 25560], 90.00th=[ 33424], 95.00th=[ 40633], | 99.00th=[ 53740], 99.50th=[ 60031], 99.90th=[ 71828], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 15, max= 216, per=25.01%, avg=108.79, stdev=39.30, samples=113 iops : min= 3, max= 54, avg=26.81, stdev= 9.88, samples=113 lat (usec) : 50=0.07%, 100=0.20%, 250=1.07%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.42% lat (msec) : 2=0.49%, 4=5.44%, 10=17.12%, 20=38.12%, 50=35.09% lat (msec) : 100=1.79%, 500=0.03% cpu : usr=0.11%, sys=26.26%, ctx=9942, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=416KiB/s (426kB/s), 103KiB/s-106KiB/s (105kB/s-108kB/s), io=23.4MiB (24.6MB), run=57155-57747msec WRITE: bw=435KiB/s (446kB/s), 109KiB/s-110KiB/s (112kB/s-113kB/s), io=24.6MiB (25.7MB), run=57155-57747msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189985: Wed Jun 17 04:31:59 2026 read: IOPS=23, BW=94.7KiB/s (96.0kB/s)(5992KiB/63262msec) clat (msec): min=2, max=604, avg=18.41, stdev=20.87 lat (msec): min=2, max=604, avg=18.41, stdev=20.87 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 47], | 99.00th=[ 69], 99.50th=[ 84], 99.90th=[ 106], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 23, max= 376, per=24.93%, avg=94.49, stdev=68.76, samples=124 iops : min= 5, max= 94, avg=23.19, stdev=17.34, samples=124 write: IOPS=24, BW=99.5KiB/s (102kB/s)(6296KiB/63262msec); 0 zone resets clat (msec): min=4, max=118, avg=22.56, stdev=15.88 lat (msec): min=4, max=118, avg=22.57, stdev=15.88 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 45], 95.00th=[ 53], | 99.00th=[ 70], 99.50th=[ 86], 99.90th=[ 106], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 23, max= 400, per=24.91%, avg=98.89, stdev=71.82, samples=124 iops : min= 5, max= 100, avg=24.28, stdev=18.10, samples=124 lat (msec) : 4=1.79%, 10=28.94%, 20=29.59%, 50=34.67%, 100=4.75% lat (msec) : 250=0.23%, 750=0.03% cpu : usr=0.06%, sys=14.99%, ctx=6811, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189986: Wed Jun 17 04:31:59 2026 read: IOPS=23, BW=94.1KiB/s (96.3kB/s)(5940KiB/63151msec) clat (msec): min=2, max=630, avg=18.43, stdev=21.04 lat (msec): min=2, max=630, avg=18.43, stdev=21.04 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 38], 95.00th=[ 47], | 99.00th=[ 65], 99.50th=[ 74], 99.90th=[ 91], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 31, max= 416, per=24.85%, avg=94.18, stdev=72.59, samples=124 iops : min= 7, max= 104, avg=23.10, stdev=18.29, samples=124 write: IOPS=25, BW=101KiB/s (103kB/s)(6348KiB/63151msec); 0 zone resets clat (msec): min=3, max=123, avg=22.44, stdev=16.16 lat (msec): min=3, max=123, avg=22.44, stdev=16.16 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 75], 99.50th=[ 102], 99.90th=[ 115], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 39, max= 384, per=25.27%, avg=100.31, stdev=70.41, samples=124 iops : min= 9, max= 96, avg=24.64, stdev=17.75, samples=124 lat (msec) : 4=1.37%, 10=28.68%, 20=30.18%, 50=34.83%, 100=4.65% lat (msec) : 250=0.26%, 750=0.03% cpu : usr=0.08%, sys=14.95%, ctx=6725, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189987: Wed Jun 17 04:31:59 2026 read: IOPS=23, BW=95.4KiB/s (97.7kB/s)(6028KiB/63175msec) clat (msec): min=2, max=107, avg=18.46, stdev=14.62 lat (msec): min=2, max=107, avg=18.46, stdev=14.62 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 68], 99.50th=[ 75], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 24, max= 392, per=25.19%, avg=95.46, stdev=72.92, samples=124 iops : min= 6, max= 98, avg=23.43, stdev=18.36, samples=124 write: IOPS=24, BW=99.1KiB/s (101kB/s)(6260KiB/63175msec); 0 zone resets clat (msec): min=4, max=637, avg=22.48, stdev=22.09 lat (msec): min=4, max=637, avg=22.48, stdev=22.09 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 52], | 99.00th=[ 71], 99.50th=[ 90], 99.90th=[ 140], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 31, max= 384, per=24.91%, avg=98.89, stdev=69.64, samples=124 iops : min= 7, max= 96, avg=24.28, stdev=17.54, samples=124 lat (msec) : 4=1.66%, 10=27.77%, 20=30.73%, 50=35.06%, 100=4.59% lat (msec) : 250=0.16%, 750=0.03% cpu : usr=0.08%, sys=15.05%, ctx=6697, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189988: Wed Jun 17 04:31:59 2026 read: IOPS=23, BW=95.6KiB/s (97.9kB/s)(6052KiB/63319msec) clat (usec): min=2269, max=98483, avg=18655.46, stdev=14483.79 lat (usec): min=2269, max=98484, avg=18656.20, stdev=14483.86 clat percentiles (usec): | 1.00th=[ 3130], 5.00th=[ 4228], 10.00th=[ 4752], 20.00th=[ 5932], | 30.00th=[ 9110], 40.00th=[11863], 50.00th=[14615], 60.00th=[17695], | 70.00th=[22414], 80.00th=[28705], 90.00th=[39060], 95.00th=[49021], | 99.00th=[64750], 99.50th=[74974], 99.90th=[93848], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 16, max= 400, per=25.02%, avg=94.81, stdev=69.49, samples=124 iops : min= 4, max= 100, avg=23.27, stdev=17.50, samples=124 write: IOPS=24, BW=98.5KiB/s (101kB/s)(6236KiB/63319msec); 0 zone resets clat (msec): min=3, max=639, avg=22.40, stdev=22.08 lat (msec): min=3, max=639, avg=22.40, stdev=22.08 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 51], | 99.00th=[ 72], 99.50th=[ 87], 99.90th=[ 129], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 31, max= 384, per=24.57%, avg=97.53, stdev=72.06, samples=124 iops : min= 7, max= 96, avg=23.94, stdev=18.16, samples=124 lat (msec) : 4=1.89%, 10=28.65%, 20=28.65%, 50=35.74%, 100=4.92% lat (msec) : 250=0.13%, 750=0.03% cpu : usr=0.09%, sys=14.90%, ctx=6714, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=379KiB/s (388kB/s), 94.1KiB/s-95.6KiB/s (96.3kB/s-97.9kB/s), io=23.4MiB (24.6MB), run=63151-63319msec WRITE: bw=397KiB/s (407kB/s), 98.5KiB/s-101KiB/s (101kB/s-103kB/s), io=24.6MiB (25.7MB), run=63151-63319msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190012: Wed Jun 17 04:32:18 2026 read: IOPS=27, BW=437KiB/s (448kB/s)(5920KiB/13533msec) clat (usec): min=59, max=54699, avg=18273.67, stdev=9244.45 lat (usec): min=60, max=54699, avg=18274.39, stdev=9244.46 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 7046], 10.00th=[ 9372], 20.00th=[11338], | 30.00th=[12780], 40.00th=[14746], 50.00th=[16909], 60.00th=[18744], | 70.00th=[20841], 80.00th=[24511], 90.00th=[31065], 95.00th=[35390], | 99.00th=[47449], 99.50th=[54789], 99.90th=[54789], 99.95th=[54789], | 99.99th=[54789] bw ( KiB/s): min= 285, max= 672, per=24.28%, avg=429.54, stdev=90.78, samples=26 iops : min= 17, max= 42, avg=26.42, stdev= 5.81, samples=26 write: IOPS=29, BW=471KiB/s (482kB/s)(6368KiB/13533msec); 0 zone resets clat (usec): min=1872, max=70379, avg=16680.72, stdev=11493.33 lat (usec): min=1872, max=70381, avg=16681.59, stdev=11493.42 clat percentiles (usec): | 1.00th=[ 3195], 5.00th=[ 4178], 10.00th=[ 4555], 20.00th=[ 6259], | 30.00th=[ 9896], 40.00th=[11731], 50.00th=[13698], 60.00th=[16581], | 70.00th=[20579], 80.00th=[25035], 90.00th=[32375], 95.00th=[36963], | 99.00th=[58983], 99.50th=[67634], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 254, max= 640, per=25.15%, avg=468.27, stdev=107.41, samples=26 iops : min= 15, max= 40, avg=28.85, stdev= 6.78, samples=26 lat (usec) : 100=0.78%, 250=0.78%, 500=0.13% lat (msec) : 2=0.13%, 4=1.95%, 10=18.62%, 20=44.66%, 50=31.90% lat (msec) : 100=1.04% cpu : usr=0.04%, sys=27.00%, ctx=2833, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190013: Wed Jun 17 04:32:18 2026 read: IOPS=26, BW=429KiB/s (440kB/s)(5744KiB/13378msec) clat (usec): min=47, max=63586, avg=18822.42, stdev=9655.17 lat (usec): min=48, max=63587, avg=18822.93, stdev=9655.21 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 130], 10.00th=[ 9765], 20.00th=[11600], | 30.00th=[13829], 40.00th=[15533], 50.00th=[17695], 60.00th=[19792], | 70.00th=[22152], 80.00th=[24511], 90.00th=[30802], 95.00th=[37487], | 99.00th=[46400], 99.50th=[55837], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 224, max= 636, per=24.18%, avg=427.77, stdev=114.73, samples=26 iops : min= 14, max= 39, avg=26.31, stdev= 7.25, samples=26 write: IOPS=30, BW=489KiB/s (501kB/s)(6544KiB/13378msec); 0 zone resets clat (usec): min=1027, max=63712, avg=15898.69, stdev=10951.58 lat (usec): min=1028, max=63714, avg=15899.59, stdev=10951.58 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 3752], 10.00th=[ 4490], 20.00th=[ 6259], | 30.00th=[ 8848], 40.00th=[11076], 50.00th=[12911], 60.00th=[15926], | 70.00th=[19530], 80.00th=[24773], 90.00th=[30540], 95.00th=[35914], | 99.00th=[51643], 99.50th=[57934], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 224, max= 733, per=25.78%, avg=480.08, stdev=115.33, samples=26 iops : min= 14, max= 45, avg=29.58, stdev= 7.31, samples=26 lat (usec) : 50=0.13%, 100=1.04%, 250=1.30% lat (msec) : 2=1.30%, 4=1.82%, 10=18.75%, 20=42.45%, 50=32.16% lat (msec) : 100=1.04% cpu : usr=0.04%, sys=27.28%, ctx=2787, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190014: Wed Jun 17 04:32:18 2026 read: IOPS=29, BW=472KiB/s (484kB/s)(6256KiB/13243msec) clat (usec): min=84, max=63851, avg=18823.64, stdev=9303.78 lat (usec): min=85, max=63851, avg=18845.22, stdev=9312.55 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 7242], 10.00th=[ 9634], 20.00th=[11469], | 30.00th=[13566], 40.00th=[15795], 50.00th=[18220], 60.00th=[19530], | 70.00th=[22414], 80.00th=[24511], 90.00th=[29492], 95.00th=[37487], | 99.00th=[47973], 99.50th=[51119], 99.90th=[63701], 99.95th=[63701], | 99.99th=[63701] bw ( KiB/s): min= 254, max= 640, per=26.82%, avg=474.50, stdev=99.94, samples=26 iops : min= 15, max= 40, avg=29.23, stdev= 6.41, samples=26 write: IOPS=28, BW=455KiB/s (466kB/s)(6032KiB/13243msec); 0 zone resets clat (usec): min=1023, max=47625, avg=15401.05, stdev=10303.44 lat (usec): min=1024, max=47626, avg=15402.00, stdev=10303.48 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3949], 10.00th=[ 4424], 20.00th=[ 5538], | 30.00th=[ 8455], 40.00th=[10683], 50.00th=[12911], 60.00th=[15139], | 70.00th=[18744], 80.00th=[24773], 90.00th=[30802], 95.00th=[35914], | 99.00th=[46924], 99.50th=[46924], 99.90th=[47449], 99.95th=[47449], | 99.99th=[47449] bw ( KiB/s): min= 192, max= 640, per=24.10%, avg=448.73, stdev=132.13, samples=26 iops : min= 12, max= 40, avg=27.62, stdev= 8.32, samples=26 lat (usec) : 100=0.65%, 250=1.43% lat (msec) : 2=0.52%, 4=2.08%, 10=19.92%, 20=41.54%, 50=33.59% lat (msec) : 100=0.26% cpu : usr=0.02%, sys=27.41%, ctx=2909, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190015: Wed Jun 17 04:32:18 2026 read: IOPS=28, BW=457KiB/s (468kB/s)(6032KiB/13187msec) clat (usec): min=78, max=53482, avg=17935.86, stdev=9452.20 lat (usec): min=79, max=53482, avg=17936.42, stdev=9452.26 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 145], 10.00th=[ 8848], 20.00th=[11207], | 30.00th=[12649], 40.00th=[14746], 50.00th=[17171], 60.00th=[19268], | 70.00th=[21103], 80.00th=[23725], 90.00th=[29754], 95.00th=[36439], | 99.00th=[49021], 99.50th=[51643], 99.90th=[53740], 99.95th=[53740], | 99.99th=[53740] bw ( KiB/s): min= 223, max= 640, per=25.63%, avg=453.35, stdev=93.41, samples=26 iops : min= 13, max= 40, avg=27.92, stdev= 5.85, samples=26 write: IOPS=29, BW=474KiB/s (486kB/s)(6256KiB/13187msec); 0 zone resets clat (usec): min=1520, max=76323, avg=16366.72, stdev=11502.50 lat (usec): min=1520, max=76324, avg=16367.72, stdev=11502.50 clat percentiles (usec): | 1.00th=[ 3589], 5.00th=[ 4359], 10.00th=[ 4621], 20.00th=[ 5932], | 30.00th=[ 9241], 40.00th=[10945], 50.00th=[13304], 60.00th=[16319], | 70.00th=[20055], 80.00th=[24773], 90.00th=[32637], 95.00th=[39060], | 99.00th=[53740], 99.50th=[55313], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 223, max= 672, per=25.45%, avg=473.81, stdev=120.05, samples=26 iops : min= 13, max= 42, avg=29.19, stdev= 7.68, samples=26 lat (usec) : 100=1.30%, 250=1.43%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.13%, 4=1.43%, 10=19.40%, 20=43.49%, 50=31.25% lat (msec) : 100=1.30% cpu : usr=0.08%, sys=27.44%, ctx=2770, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1770KiB/s (1812kB/s), 429KiB/s-472KiB/s (440kB/s-484kB/s), io=23.4MiB (24.5MB), run=13187-13533msec WRITE: bw=1862KiB/s (1907kB/s), 455KiB/s-489KiB/s (466kB/s-501kB/s), io=24.6MiB (25.8MB), run=13187-13533msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190016: Wed Jun 17 04:32:19 2026 read: IOPS=24, BW=397KiB/s (407kB/s)(5920KiB/14912msec) clat (usec): min=3322, max=64967, avg=17357.60, stdev=12453.61 lat (usec): min=3323, max=64968, avg=17358.12, stdev=12453.62 clat percentiles (usec): | 1.00th=[ 3720], 5.00th=[ 5145], 10.00th=[ 5604], 20.00th=[ 7570], | 30.00th=[ 9241], 40.00th=[11076], 50.00th=[12780], 60.00th=[15139], | 70.00th=[20055], 80.00th=[26346], 90.00th=[34341], 95.00th=[44303], | 99.00th=[60556], 99.50th=[64226], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 191, max= 1056, per=23.87%, avg=383.17, stdev=188.92, samples=29 iops : min= 11, max= 66, avg=23.52, stdev=11.97, samples=29 write: IOPS=26, BW=427KiB/s (437kB/s)(6368KiB/14912msec); 0 zone resets clat (usec): min=5556, max=73402, avg=21281.48, stdev=13514.66 lat (usec): min=5558, max=73403, avg=21282.69, stdev=13514.67 clat percentiles (usec): | 1.00th=[ 5800], 5.00th=[ 6783], 10.00th=[ 7898], 20.00th=[ 9765], | 30.00th=[11994], 40.00th=[14222], 50.00th=[17695], 60.00th=[22152], | 70.00th=[25560], 80.00th=[30802], 90.00th=[40109], 95.00th=[47973], | 99.00th=[68682], 99.50th=[72877], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 223, max= 1120, per=24.85%, avg=419.79, stdev=215.80, samples=29 iops : min= 13, max= 70, avg=25.83, stdev=13.63, samples=29 lat (msec) : 4=0.52%, 10=26.43%, 20=35.29%, 50=34.24%, 100=3.52% cpu : usr=0.07%, sys=13.71%, ctx=1622, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190017: Wed Jun 17 04:32:19 2026 read: IOPS=24, BW=385KiB/s (394kB/s)(5744KiB/14917msec) clat (usec): min=3432, max=86826, avg=17452.38, stdev=12636.93 lat (usec): min=3432, max=86827, avg=17452.92, stdev=12636.98 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5080], 10.00th=[ 5997], 20.00th=[ 7701], | 30.00th=[ 9372], 40.00th=[10814], 50.00th=[13173], 60.00th=[15401], | 70.00th=[19792], 80.00th=[26346], 90.00th=[35914], 95.00th=[41681], | 99.00th=[60556], 99.50th=[64750], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 159, max= 960, per=23.58%, avg=378.38, stdev=181.63, samples=29 iops : min= 9, max= 60, avg=23.24, stdev=11.47, samples=29 write: IOPS=27, BW=439KiB/s (449kB/s)(6544KiB/14917msec); 0 zone resets clat (msec): min=5, max=103, avg=20.98, stdev=14.29 lat (msec): min=5, max=103, avg=20.98, stdev=14.29 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 71], 99.50th=[ 80], 99.90th=[ 104], 99.95th=[ 104], | 99.99th=[ 104] bw ( KiB/s): min= 191, max= 1312, per=25.22%, avg=425.93, stdev=230.18, samples=29 iops : min= 11, max= 82, avg=26.21, stdev=14.58, samples=29 lat (msec) : 4=0.39%, 10=27.47%, 20=36.33%, 50=32.03%, 100=3.65% lat (msec) : 250=0.13% cpu : usr=0.08%, sys=13.76%, ctx=1695, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190018: Wed Jun 17 04:32:19 2026 read: IOPS=26, BW=425KiB/s (435kB/s)(6256KiB/14731msec) clat (usec): min=3895, max=75107, avg=16830.22, stdev=11855.92 lat (usec): min=3896, max=75108, avg=16830.83, stdev=11856.01 clat percentiles (usec): | 1.00th=[ 4228], 5.00th=[ 5276], 10.00th=[ 6063], 20.00th=[ 7635], | 30.00th=[10028], 40.00th=[11207], 50.00th=[12387], 60.00th=[15139], | 70.00th=[18744], 80.00th=[23725], 90.00th=[34341], 95.00th=[41681], | 99.00th=[55837], 99.50th=[62653], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 127, max= 1248, per=26.57%, avg=426.41, stdev=237.11, samples=29 iops : min= 7, max= 78, avg=26.24, stdev=14.99, samples=29 write: IOPS=25, BW=409KiB/s (419kB/s)(6032KiB/14731msec); 0 zone resets clat (msec): min=5, max=106, avg=21.39, stdev=13.61 lat (msec): min=5, max=106, avg=21.39, stdev=13.61 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 41], 95.00th=[ 46], | 99.00th=[ 66], 99.50th=[ 84], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 190, max= 992, per=23.87%, avg=403.10, stdev=169.40, samples=29 iops : min= 11, max= 62, avg=24.76, stdev=10.75, samples=29 lat (msec) : 4=0.13%, 10=25.00%, 20=39.97%, 50=32.29%, 100=2.47% lat (msec) : 250=0.13% cpu : usr=0.05%, sys=14.23%, ctx=1652, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190019: Wed Jun 17 04:32:19 2026 read: IOPS=25, BW=406KiB/s (416kB/s)(6032KiB/14859msec) clat (msec): min=3, max=121, avg=17.17, stdev=13.56 lat (msec): min=3, max=121, avg=17.17, stdev=13.56 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 41], | 99.00th=[ 63], 99.50th=[ 93], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 126, max= 1184, per=24.67%, avg=395.90, stdev=225.55, samples=29 iops : min= 7, max= 74, avg=24.31, stdev=14.22, samples=29 write: IOPS=26, BW=421KiB/s (431kB/s)(6256KiB/14859msec); 0 zone resets clat (usec): min=5078, max=92964, avg=21240.18, stdev=13971.66 lat (usec): min=5079, max=92965, avg=21241.45, stdev=13971.62 clat percentiles (usec): | 1.00th=[ 6063], 5.00th=[ 7242], 10.00th=[ 8356], 20.00th=[10159], | 30.00th=[11731], 40.00th=[13698], 50.00th=[16909], 60.00th=[20055], | 70.00th=[24773], 80.00th=[31589], 90.00th=[39584], 95.00th=[49546], | 99.00th=[67634], 99.50th=[72877], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 191, max= 1024, per=24.53%, avg=414.34, stdev=183.64, samples=29 iops : min= 11, max= 64, avg=25.48, stdev=11.69, samples=29 lat (msec) : 4=0.26%, 10=26.56%, 20=39.06%, 50=30.73%, 100=3.26% lat (msec) : 250=0.13% cpu : usr=0.07%, sys=13.90%, ctx=1696, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1606KiB/s (1644kB/s), 385KiB/s-425KiB/s (394kB/s-435kB/s), io=23.4MiB (24.5MB), run=14731-14917msec WRITE: bw=1689KiB/s (1730kB/s), 409KiB/s-439KiB/s (419kB/s-449kB/s), io=24.6MiB (25.8MB), run=14731-14917msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190027: Wed Jun 17 04:32:28 2026 read: IOPS=2, BW=2293KiB/s (2348kB/s)(7168KiB/3126msec) clat (usec): min=544, max=865048, avg=206011.84, stdev=294161.34 lat (usec): min=545, max=865050, avg=206013.01, stdev=294161.79 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 89654], | 30.00th=[104334], 40.00th=[104334], 50.00th=[112722], 60.00th=[132645], | 70.00th=[132645], 80.00th=[135267], 90.00th=[868221], 95.00th=[868221], | 99.00th=[868221], 99.50th=[868221], 99.90th=[868221], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 2048, max= 6144, per=72.48%, avg=4096.00, stdev=2048.00, samples=3 iops : min= 2, max= 6, avg= 4.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1638KiB/s (1677kB/s)(5120KiB/3126msec); 0 zone resets clat (msec): min=154, max=624, avg=326.62, stdev=186.53 lat (msec): min=154, max=624, avg=326.68, stdev=186.53 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2048, max= 4096, per=34.52%, avg=2730.67, stdev=1182.41, samples=3 iops : min= 2, max= 4, avg= 2.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=37.25%, ctx=1051, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190028: Wed Jun 17 04:32:28 2026 read: IOPS=0, BW=657KiB/s (672kB/s)(2048KiB/3119msec) clat (msec): min=112, max=901, avg=506.70, stdev=558.14 lat (msec): min=112, max=901, avg=506.70, stdev=558.14 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 112], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2048, max= 2048, per=36.24%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3283KiB/s (3362kB/s)(10.0MiB/3119msec); 0 zone resets clat (msec): min=62, max=466, avg=206.82, stdev=148.33 lat (msec): min=62, max=466, avg=206.88, stdev=148.33 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 101], | 30.00th=[ 109], 40.00th=[ 111], 50.00th=[ 138], 60.00th=[ 161], | 70.00th=[ 174], 80.00th=[ 288], 90.00th=[ 460], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2048, max= 6144, per=58.25%, avg=4608.00, stdev=1960.81, samples=4 iops : min= 2, max= 6, avg= 4.50, stdev= 1.91, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.03%, sys=45.16%, ctx=742, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190030: Wed Jun 17 04:32:28 2026 read: IOPS=1, BW=1695KiB/s (1736kB/s)(6144KiB/3624msec) clat (usec): min=484, max=1016.4k, avg=225866.74, stdev=391997.19 lat (usec): min=486, max=1016.4k, avg=225867.67, stdev=391997.10 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], | 20.00th=[ 529], 30.00th=[ 529], 40.00th=[ 76022], | 50.00th=[ 76022], 60.00th=[ 104334], 70.00th=[ 156238], | 80.00th=[ 156238], 90.00th=[1019216], 95.00th=[1019216], | 99.00th=[1019216], 99.50th=[1019216], 99.90th=[1019216], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 2048, max= 4096, per=60.40%, avg=3413.33, stdev=1182.41, samples=3 iops : min= 2, max= 4, avg= 3.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1695KiB/s (1736kB/s)(6144KiB/3624msec); 0 zone resets clat (msec): min=124, max=1316, avg=376.45, stdev=464.36 lat (msec): min=125, max=1316, avg=376.51, stdev=464.37 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 249], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 3799, max= 4096, per=50.52%, avg=3997.00, stdev=171.47, samples=3 iops : min= 3, max= 4, avg= 3.67, stdev= 0.58, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 2000=16.67% cpu : usr=0.03%, sys=24.73%, ctx=710, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190032: Wed Jun 17 04:32:28 2026 read: IOPS=1, BW=2044KiB/s (2093kB/s)(5120KiB/2505msec) clat (usec): min=467, max=125158, avg=57726.44, stdev=61073.40 lat (usec): min=469, max=125158, avg=57727.55, stdev=61073.26 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 469], | 30.00th=[ 586], 40.00th=[ 586], 50.00th=[ 44303], 60.00th=[ 44303], | 70.00th=[117965], 80.00th=[117965], 90.00th=[125305], 95.00th=[125305], | 99.00th=[125305], 99.50th=[125305], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2861KiB/s (2930kB/s)(7168KiB/2505msec); 0 zone resets clat (msec): min=112, max=1144, avg=314.50, stdev=368.89 lat (msec): min=112, max=1144, avg=314.56, stdev=368.90 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 140], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 190], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 241], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1957, max= 4096, per=34.13%, avg=2700.33, stdev=1209.54, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 50=8.33%, 250=66.67%, 2000=8.33% cpu : usr=0.04%, sys=41.45%, ctx=183, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5651KiB/s (5787kB/s), 657KiB/s-2293KiB/s (672kB/s-2348kB/s), io=20.0MiB (20.0MB), run=2505-3624msec WRITE: bw=7912KiB/s (8102kB/s), 1638KiB/s-3283KiB/s (1677kB/s-3362kB/s), io=28.0MiB (29.4MB), run=2505-3624msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190029: Wed Jun 17 04:32:29 2026 read: IOPS=3, BW=3650KiB/s (3737kB/s)(7168KiB/1964msec) clat (msec): min=48, max=897, avg=229.10, stdev=305.37 lat (msec): min=48, max=897, avg=229.10, stdev=305.37 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 57], | 30.00th=[ 57], 40.00th=[ 57], 50.00th=[ 85], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 239], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1957, max= 6144, per=63.02%, avg=3383.00, stdev=2391.53, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 write: IOPS=2, BW=2607KiB/s (2669kB/s)(5120KiB/1964msec); 0 zone resets clat (usec): min=58934, max=90818, avg=68497.50, stdev=12795.98 lat (usec): min=59020, max=90879, avg=68562.12, stdev=12790.73 clat percentiles (usec): | 1.00th=[58983], 5.00th=[58983], 10.00th=[58983], 20.00th=[58983], | 30.00th=[61604], 40.00th=[61604], 50.00th=[64750], 60.00th=[64750], | 70.00th=[66323], 80.00th=[66323], 90.00th=[90702], 95.00th=[90702], | 99.00th=[90702], 99.50th=[90702], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 lat (msec) : 50=8.33%, 100=66.67%, 250=16.67%, 1000=8.33% cpu : usr=0.10%, sys=12.84%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190031: Wed Jun 17 04:32:29 2026 read: IOPS=0, BW=538KiB/s (551kB/s)(2048KiB/3804msec) clat (msec): min=135, max=1067, avg=601.24, stdev=658.70 lat (msec): min=135, max=1067, avg=601.25, stdev=658.70 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 2035, max= 2048, per=38.03%, avg=2041.50, stdev= 9.19, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2692KiB/s (2757kB/s)(10.0MiB/3804msec); 0 zone resets clat (msec): min=39, max=739, avg=256.23, stdev=236.32 lat (msec): min=39, max=739, avg=256.29, stdev=236.32 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 43], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 153], 60.00th=[ 305], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 502], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 2048, max= 6107, per=54.34%, avg=4083.67, stdev=2029.53, samples=3 iops : min= 2, max= 5, avg= 3.67, stdev= 1.53, samples=3 lat (msec) : 50=25.00%, 100=8.33%, 250=16.67%, 500=25.00%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=14.54%, ctx=121, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190033: Wed Jun 17 04:32:29 2026 read: IOPS=1, BW=1671KiB/s (1711kB/s)(6144KiB/3676msec) clat (msec): min=38, max=488, avg=220.86, stdev=166.84 lat (msec): min=38, max=488, avg=220.86, stdev=166.84 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 211], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2048, max= 6107, per=63.36%, avg=3401.00, stdev=2343.46, samples=3 iops : min= 2, max= 5, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1671KiB/s (1711kB/s)(6144KiB/3676msec); 0 zone resets clat (msec): min=35, max=952, avg=363.83, stdev=374.50 lat (msec): min=35, max=952, avg=363.91, stdev=374.51 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 271], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1988, max= 4096, per=33.82%, avg=2541.75, stdev=1036.49, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 50=16.67%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=13.88%, ctx=130, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190034: Wed Jun 17 04:32:29 2026 read: IOPS=1, BW=1342KiB/s (1374kB/s)(5120KiB/3815msec) clat (msec): min=25, max=150, avg=62.72, stdev=49.88 lat (msec): min=25, max=150, avg=62.72, stdev=49.88 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 26], 10.00th=[ 26], 20.00th=[ 26], | 30.00th=[ 41], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 46], | 70.00th=[ 52], 80.00th=[ 52], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 2035, max= 2035, per=37.91%, avg=2035.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1879KiB/s (1924kB/s)(7168KiB/3815msec); 0 zone resets clat (msec): min=29, max=1161, avg=475.85, stdev=470.00 lat (msec): min=29, max=1161, avg=475.91, stdev=469.99 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 30], 10.00th=[ 30], 20.00th=[ 43], | 30.00th=[ 58], 40.00th=[ 58], 50.00th=[ 393], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 969], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1988, max= 2048, per=27.01%, avg=2029.75, stdev=28.50, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 50=41.67%, 100=16.67%, 250=8.33%, 500=8.33%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=14.76%, ctx=174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5368KiB/s (5497kB/s), 538KiB/s-3650KiB/s (551kB/s-3737kB/s), io=20.0MiB (20.0MB), run=1964-3815msec WRITE: bw=7516KiB/s (7696kB/s), 1671KiB/s-2692KiB/s (1711kB/s-2757kB/s), io=28.0MiB (29.4MB), run=1964-3815msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=190041: Wed Jun 17 04:32:36 2026 read: IOPS=2, BW=8399KiB/s (8601kB/s)(12.0MiB/1463msec) clat (msec): min=179, max=645, avg=474.65, stdev=256.75 lat (msec): min=179, max=645, avg=474.65, stdev=256.75 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 5728, max= 5728, per=61.78%, avg=5728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=16.07%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190042: Wed Jun 17 04:32:36 2026 read: IOPS=0, BW=2318KiB/s (2374kB/s)(4096KiB/1767msec) clat (nsec): min=457352k, max=457352k, avg=457352170.00, stdev= 0.00 lat (nsec): min=457354k, max=457354k, avg=457354073.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 5626, max= 5626, per=60.68%, avg=5626.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4636KiB/s (4747kB/s)(8192KiB/1767msec); 0 zone resets clat (msec): min=606, max=671, avg=639.08, stdev=46.13 lat (msec): min=606, max=671, avg=639.33, stdev=46.10 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8175, max= 8175, per=44.08%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=14.21%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190044: Wed Jun 17 04:32:36 2026 write: IOPS=1, BW=7224KiB/s (7397kB/s)(12.0MiB/1701msec); 0 zone resets clat (msec): min=128, max=1391, avg=559.30, stdev=720.98 lat (msec): min=128, max=1391, avg=559.58, stdev=720.96 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7728, max= 7728, per=41.67%, avg=7728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.12%, sys=17.12%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190046: Wed Jun 17 04:32:36 2026 write: IOPS=2, BW=8956KiB/s (9171kB/s)(12.0MiB/1372msec); 0 zone resets clat (msec): min=134, max=771, avg=450.00, stdev=318.80 lat (msec): min=134, max=771, avg=450.26, stdev=318.71 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7757, max= 8192, per=43.00%, avg=7974.50, stdev=307.59, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.78%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9272KiB/s (9495kB/s), 2318KiB/s-8399KiB/s (2374kB/s-8601kB/s), io=16.0MiB (16.8MB), run=1463-1767msec WRITE: bw=18.1MiB/s (18.0MB/s), 4636KiB/s-8956KiB/s (4747kB/s-9171kB/s), io=32.0MiB (33.6MB), run=1372-1767msec rand-rw: (groupid=0, jobs=1): err= 0: pid=190043: Wed Jun 17 04:32:36 2026 read: IOPS=2, BW=9966KiB/s (10.2MB/s)(12.0MiB/1233msec) clat (msec): min=357, max=428, avg=383.66, stdev=39.13 lat (msec): min=357, max=428, avg=383.66, stdev=39.13 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 5520, max= 5520, per=49.66%, avg=5520.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=56.57%, ctx=2996, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190045: Wed Jun 17 04:32:36 2026 read: IOPS=0, BW=2779KiB/s (2846kB/s)(4096KiB/1474msec) clat (nsec): min=341320k, max=341320k, avg=341320042.00, stdev= 0.00 lat (nsec): min=341322k, max=341322k, avg=341322290.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 5680, max= 5680, per=51.10%, avg=5680.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5558KiB/s (5691kB/s)(8192KiB/1474msec); 0 zone resets clat (msec): min=295, max=751, avg=523.44, stdev=322.83 lat (msec): min=295, max=751, avg=523.68, stdev=322.87 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 5680, max= 5680, per=29.90%, avg=5680.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.65%, ctx=1157, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190047: Wed Jun 17 04:32:36 2026 write: IOPS=1, BW=7123KiB/s (7294kB/s)(12.0MiB/1725msec); 0 zone resets clat (msec): min=126, max=857, avg=552.30, stdev=379.96 lat (msec): min=127, max=857, avg=552.55, stdev=379.95 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8192, max= 8192, per=43.13%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.26%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=190048: Wed Jun 17 04:32:36 2026 write: IOPS=2, BW=8654KiB/s (8861kB/s)(12.0MiB/1420msec); 0 zone resets clat (msec): min=304, max=611, avg=446.79, stdev=154.71 lat (msec): min=304, max=611, avg=447.04, stdev=154.71 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 6077, max= 8192, per=37.56%, avg=7134.50, stdev=1495.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=19.37%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.9MiB/s (11.4MB/s), 2779KiB/s-9966KiB/s (2846kB/s-10.2MB/s), io=16.0MiB (16.8MB), run=1233-1474msec WRITE: bw=18.5MiB/s (19.5MB/s), 5558KiB/s-8654KiB/s (5691kB/s-8861kB/s), io=32.0MiB (33.6MB), run=1420-1725msec