== sanity test 398b: DIO and buffer IO race ============== 19:25:29 (1775863529) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.79131 s, 18.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159648: Fri Apr 10 19:26:41 2026 read: IOPS=24, BW=96.4KiB/s (98.8kB/s)(5992KiB/62127msec) clat (usec): min=29, max=604662, avg=20404.73, stdev=22630.39 lat (usec): min=30, max=604663, avg=20405.69, stdev=22630.43 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 88], 10.00th=[ 6652], 20.00th=[ 8848], | 30.00th=[ 10683], 40.00th=[ 13304], 50.00th=[ 16057], 60.00th=[ 19006], | 70.00th=[ 22414], 80.00th=[ 27919], 90.00th=[ 39584], 95.00th=[ 53740], | 99.00th=[ 81265], 99.50th=[ 98042], 99.90th=[225444], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 6, max= 216, per=25.34%, avg=96.28, stdev=41.04, samples=123 iops : min= 1, max= 54, avg=23.67, stdev=10.38, samples=123 write: IOPS=25, BW=101KiB/s (104kB/s)(6296KiB/62127msec); 0 zone resets clat (usec): min=807, max=261274, avg=19912.19, stdev=22482.78 lat (usec): min=809, max=261275, avg=19913.42, stdev=22482.81 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1467], 10.00th=[ 2180], 20.00th=[ 3294], | 30.00th=[ 5080], 40.00th=[ 9896], 50.00th=[ 13698], 60.00th=[ 17957], | 70.00th=[ 23462], 80.00th=[ 31851], 90.00th=[ 45876], 95.00th=[ 60556], | 99.00th=[101188], 99.50th=[141558], 99.90th=[204473], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 15, max= 216, per=25.69%, avg=101.98, stdev=47.35, samples=122 iops : min= 3, max= 54, avg=25.11, stdev=11.96, samples=122 lat (usec) : 50=0.75%, 100=2.02%, 250=0.75%, 500=0.16%, 1000=0.23% lat (msec) : 2=4.04%, 4=9.02%, 10=16.24%, 20=30.47%, 50=29.33% lat (msec) : 100=6.22%, 250=0.72%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=15.35%, ctx=7852, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159649: Fri Apr 10 19:26:41 2026 read: IOPS=23, BW=95.4KiB/s (97.7kB/s)(5940KiB/62254msec) clat (usec): min=29, max=203645, avg=20328.05, stdev=17519.53 lat (usec): min=29, max=203646, avg=20329.00, stdev=17519.56 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 89], 10.00th=[ 6259], 20.00th=[ 8979], | 30.00th=[ 10814], 40.00th=[ 13173], 50.00th=[ 15926], 60.00th=[ 19268], | 70.00th=[ 23462], 80.00th=[ 29230], 90.00th=[ 40109], 95.00th=[ 52167], | 99.00th=[ 84411], 99.50th=[100140], 99.90th=[137364], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 6, max= 216, per=24.97%, avg=94.90, stdev=42.22, samples=123 iops : min= 1, max= 54, avg=23.33, stdev=10.67, samples=123 write: IOPS=25, BW=102KiB/s (104kB/s)(6348KiB/62254msec); 0 zone resets clat (usec): min=770, max=607328, avg=20077.09, stdev=25403.47 lat (usec): min=771, max=607329, avg=20078.21, stdev=25403.50 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1565], 10.00th=[ 2212], 20.00th=[ 3458], | 30.00th=[ 5342], 40.00th=[ 9634], 50.00th=[ 14091], 60.00th=[ 18482], | 70.00th=[ 23987], 80.00th=[ 30802], 90.00th=[ 44827], 95.00th=[ 59507], | 99.00th=[ 99091], 99.50th=[116917], 99.90th=[179307], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 24, max= 200, per=25.66%, avg=101.86, stdev=43.93, samples=122 iops : min= 6, max= 50, avg=25.07, stdev=11.08, samples=122 lat (usec) : 50=0.98%, 100=1.95%, 250=1.07%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.42% lat (msec) : 2=3.97%, 4=8.11%, 10=17.06%, 20=28.94%, 50=30.70% lat (msec) : 100=5.92%, 250=0.68%, 750=0.03% cpu : usr=0.10%, sys=15.64%, ctx=7756, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159650: Fri Apr 10 19:26:41 2026 read: IOPS=23, BW=95.4KiB/s (97.7kB/s)(6028KiB/63175msec) clat (usec): min=31, max=243293, avg=20114.04, stdev=17372.83 lat (usec): min=31, max=243295, avg=20116.68, stdev=17372.22 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 86], 10.00th=[ 5604], 20.00th=[ 8979], | 30.00th=[ 10814], 40.00th=[ 13304], 50.00th=[ 16319], 60.00th=[ 19530], | 70.00th=[ 23462], 80.00th=[ 28705], 90.00th=[ 38536], 95.00th=[ 50594], | 99.00th=[ 85459], 99.50th=[ 95945], 99.90th=[156238], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 23, max= 279, per=25.34%, avg=96.29, stdev=46.27, samples=123 iops : min= 5, max= 69, avg=23.67, stdev=11.64, samples=123 write: IOPS=24, BW=99.1KiB/s (101kB/s)(6260KiB/63175msec); 0 zone resets clat (usec): min=672, max=619013, avg=20863.44, stdev=26967.59 lat (usec): min=673, max=619014, avg=20865.49, stdev=26967.67 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1336], 10.00th=[ 1893], 20.00th=[ 3130], | 30.00th=[ 5145], 40.00th=[ 9110], 50.00th=[ 13960], 60.00th=[ 19006], | 70.00th=[ 25035], 80.00th=[ 32900], 90.00th=[ 47973], 95.00th=[ 64226], | 99.00th=[113771], 99.50th=[127402], 99.90th=[177210], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 31, max= 303, per=24.93%, avg=98.96, stdev=42.87, samples=124 iops : min= 7, max= 75, avg=24.35, stdev=10.77, samples=124 lat (usec) : 50=0.78%, 100=2.08%, 250=1.17%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.36% lat (msec) : 2=5.24%, 4=7.03%, 10=16.93%, 20=27.90%, 50=31.22% lat (msec) : 100=6.25%, 250=0.88%, 750=0.03% cpu : usr=0.09%, sys=15.12%, ctx=7749, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159651: Fri Apr 10 19:26:41 2026 read: IOPS=24, BW=96.9KiB/s (99.3kB/s)(6052KiB/62431msec) clat (usec): min=32, max=215340, avg=19641.17, stdev=16939.58 lat (usec): min=32, max=215342, avg=19645.64, stdev=16939.67 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 88], 10.00th=[ 5866], 20.00th=[ 8848], | 30.00th=[ 10814], 40.00th=[ 12780], 50.00th=[ 15533], 60.00th=[ 18482], | 70.00th=[ 22414], 80.00th=[ 28181], 90.00th=[ 38536], 95.00th=[ 50594], | 99.00th=[ 83362], 99.50th=[ 96994], 99.90th=[125305], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 198, per=25.58%, avg=97.20, stdev=41.45, samples=122 iops : min= 7, max= 49, avg=23.91, stdev=10.48, samples=122 write: IOPS=24, BW=99.9KiB/s (102kB/s)(6236KiB/62431msec); 0 zone resets clat (usec): min=862, max=625984, avg=20846.25, stdev=26230.92 lat (usec): min=863, max=625985, avg=20850.54, stdev=26231.92 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1582], 10.00th=[ 2343], 20.00th=[ 3425], | 30.00th=[ 5604], 40.00th=[ 10421], 50.00th=[ 14484], 60.00th=[ 19006], | 70.00th=[ 25297], 80.00th=[ 32900], 90.00th=[ 47449], 95.00th=[ 62129], | 99.00th=[ 94897], 99.50th=[103285], 99.90th=[229639], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 31, max= 224, per=25.30%, avg=100.46, stdev=45.44, samples=122 iops : min= 7, max= 56, avg=24.73, stdev=11.45, samples=122 lat (usec) : 50=0.94%, 100=2.12%, 250=1.24%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=3.48%, 4=8.11%, 10=16.63%, 20=29.95%, 50=30.18% lat (msec) : 100=6.51%, 250=0.52%, 750=0.03% cpu : usr=0.08%, sys=15.36%, ctx=7769, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=380KiB/s (389kB/s), 95.4KiB/s-96.9KiB/s (97.7kB/s-99.3kB/s), io=23.4MiB (24.6MB), run=62127-63175msec WRITE: bw=398KiB/s (407kB/s), 99.1KiB/s-102KiB/s (101kB/s-104kB/s), io=24.6MiB (25.7MB), run=62127-63175msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159652: Fri Apr 10 19:27:17 2026 read: IOPS=15, BW=60.9KiB/s (62.3kB/s)(5992KiB/98428msec) clat (msec): min=3, max=611, avg=17.25, stdev=23.31 lat (msec): min=3, max=611, avg=17.25, stdev=23.31 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 39], 95.00th=[ 52], | 99.00th=[ 93], 99.50th=[ 104], 99.90th=[ 169], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 184, per=25.73%, avg=62.26, stdev=44.38, samples=189 iops : min= 1, max= 46, avg=15.16, stdev=11.27, samples=189 write: IOPS=15, BW=63.0KiB/s (65.5kB/s)(6296KiB/98428msec); 0 zone resets clat (msec): min=14, max=332, avg=45.99, stdev=38.01 lat (msec): min=14, max=332, avg=46.00, stdev=38.01 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 90], 95.00th=[ 129], | 99.00th=[ 199], 99.50th=[ 226], 99.90th=[ 309], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 152, per=25.29%, avg=63.98, stdev=39.47, samples=193 iops : min= 1, max= 38, avg=15.59, stdev=10.06, samples=193 lat (msec) : 4=1.20%, 10=21.35%, 20=18.49%, 50=43.03%, 100=11.23% lat (msec) : 250=4.52%, 500=0.13%, 750=0.03% cpu : usr=0.09%, sys=5.39%, ctx=5948, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159653: Fri Apr 10 19:27:17 2026 read: IOPS=15, BW=60.0KiB/s (61.4kB/s)(5940KiB/98996msec) clat (msec): min=2, max=595, avg=17.14, stdev=24.10 lat (msec): min=2, max=595, avg=17.14, stdev=24.10 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 39], 95.00th=[ 54], | 99.00th=[ 92], 99.50th=[ 127], 99.90th=[ 234], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 168, per=25.48%, avg=61.65, stdev=43.71, samples=191 iops : min= 1, max= 42, avg=15.02, stdev=11.09, samples=191 write: IOPS=16, BW=64.1KiB/s (65.7kB/s)(6348KiB/98996msec); 0 zone resets clat (msec): min=13, max=255, avg=46.22, stdev=37.85 lat (msec): min=13, max=255, avg=46.23, stdev=37.85 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 132], | 99.00th=[ 205], 99.50th=[ 241], 99.90th=[ 251], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 151, per=25.37%, avg=64.18, stdev=40.03, samples=196 iops : min= 1, max= 37, avg=15.64, stdev=10.20, samples=196 lat (msec) : 4=1.07%, 10=21.22%, 20=18.98%, 50=42.64%, 100=10.94% lat (msec) : 250=5.05%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=5.32%, ctx=5952, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159654: Fri Apr 10 19:27:17 2026 read: IOPS=15, BW=61.1KiB/s (62.6kB/s)(6028KiB/98592msec) clat (msec): min=2, max=169, avg=16.91, stdev=17.95 lat (msec): min=2, max=170, avg=16.91, stdev=17.95 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 39], 95.00th=[ 51], | 99.00th=[ 93], 99.50th=[ 118], 99.90th=[ 167], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 7, max= 200, per=26.10%, avg=63.16, stdev=42.19, samples=189 iops : min= 1, max= 50, avg=15.39, stdev=10.73, samples=189 write: IOPS=15, BW=63.5KiB/s (65.0kB/s)(6260KiB/98592msec); 0 zone resets clat (msec): min=13, max=622, avg=46.60, stdev=41.85 lat (msec): min=13, max=622, avg=46.60, stdev=41.85 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 95], 95.00th=[ 133], | 99.00th=[ 205], 99.50th=[ 249], 99.90th=[ 372], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 160, per=25.21%, avg=63.78, stdev=40.36, samples=194 iops : min= 1, max= 40, avg=15.54, stdev=10.28, samples=194 lat (msec) : 4=1.20%, 10=20.44%, 20=19.56%, 50=43.95%, 100=9.90% lat (msec) : 250=4.72%, 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=5.44%, ctx=5867, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159655: Fri Apr 10 19:27:17 2026 read: IOPS=15, BW=61.9KiB/s (63.4kB/s)(6052KiB/97773msec) clat (msec): min=3, max=174, avg=16.96, stdev=18.53 lat (msec): min=3, max=174, avg=16.96, stdev=18.53 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 37], 95.00th=[ 53], | 99.00th=[ 99], 99.50th=[ 125], 99.90th=[ 163], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 7, max= 224, per=26.43%, avg=63.97, stdev=44.00, samples=187 iops : min= 1, max= 56, avg=15.59, stdev=11.17, samples=187 write: IOPS=15, BW=63.8KiB/s (65.3kB/s)(6236KiB/97773msec); 0 zone resets clat (msec): min=13, max=620, avg=46.14, stdev=41.71 lat (msec): min=13, max=620, avg=46.14, stdev=41.71 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 89], 95.00th=[ 127], | 99.00th=[ 215], 99.50th=[ 262], 99.90th=[ 368], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 152, per=25.33%, avg=64.07, stdev=39.49, samples=192 iops : min= 1, max= 38, avg=15.61, stdev=10.06, samples=192 lat (msec) : 4=1.27%, 10=20.80%, 20=18.75%, 50=44.24%, 100=10.19% lat (msec) : 250=4.43%, 500=0.29%, 750=0.03% cpu : usr=0.07%, sys=5.45%, ctx=5846, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=243KiB/s (248kB/s), 60.0KiB/s-61.9KiB/s (61.4kB/s-63.4kB/s), io=23.4MiB (24.6MB), run=97773-98996msec WRITE: bw=254KiB/s (260kB/s), 63.5KiB/s-64.1KiB/s (65.0kB/s-65.7kB/s), io=24.6MiB (25.7MB), run=97773-98996msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159681: Fri Apr 10 19:27:34 2026 read: IOPS=32, BW=514KiB/s (526kB/s)(5920KiB/11518msec) clat (usec): min=46, max=74616, avg=15409.95, stdev=10388.95 lat (usec): min=47, max=74616, avg=15410.69, stdev=10389.00 clat percentiles (usec): | 1.00th=[ 67], 5.00th=[ 97], 10.00th=[ 122], 20.00th=[ 8848], | 30.00th=[10814], 40.00th=[12518], 50.00th=[14615], 60.00th=[16450], | 70.00th=[19268], 80.00th=[21627], 90.00th=[26346], 95.00th=[31327], | 99.00th=[55313], 99.50th=[60556], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 319, max= 704, per=25.10%, avg=504.23, stdev=119.14, samples=22 iops : min= 19, max= 44, avg=31.23, stdev= 7.60, samples=22 write: IOPS=34, BW=553KiB/s (566kB/s)(6368KiB/11518msec); 0 zone resets clat (usec): min=1209, max=66120, avg=14538.42, stdev=11078.36 lat (usec): min=1209, max=66121, avg=14540.41, stdev=11079.31 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 3064], 10.00th=[ 3851], 20.00th=[ 4686], | 30.00th=[ 6063], 40.00th=[ 8979], 50.00th=[11731], 60.00th=[15270], | 70.00th=[18220], 80.00th=[22938], 90.00th=[29754], 95.00th=[35914], | 99.00th=[48497], 99.50th=[64750], 99.90th=[66323], 99.95th=[66323], | 99.99th=[66323] bw ( KiB/s): min= 256, max= 768, per=26.11%, avg=551.86, stdev=131.19, samples=22 iops : min= 16, max= 48, avg=34.18, stdev= 8.16, samples=22 lat (usec) : 50=0.13%, 100=2.34%, 250=3.91%, 500=0.13% lat (msec) : 2=0.78%, 4=5.73%, 10=22.27%, 20=38.28%, 50=25.52% lat (msec) : 100=0.91% cpu : usr=0.15%, sys=28.24%, ctx=2443, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159683: Fri Apr 10 19:27:34 2026 read: IOPS=30, BW=482KiB/s (494kB/s)(5744KiB/11918msec) clat (usec): min=40, max=81210, avg=16450.07, stdev=10793.12 lat (usec): min=40, max=81211, avg=16450.90, stdev=10793.03 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 104], 10.00th=[ 243], 20.00th=[ 8717], | 30.00th=[10683], 40.00th=[13173], 50.00th=[15270], 60.00th=[17957], | 70.00th=[20317], 80.00th=[23725], 90.00th=[29230], 95.00th=[33817], | 99.00th=[57934], 99.50th=[65274], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 264, max= 672, per=23.74%, avg=476.96, stdev=113.23, samples=23 iops : min= 16, max= 42, avg=29.52, stdev= 7.10, samples=23 write: IOPS=34, BW=549KiB/s (562kB/s)(6544KiB/11918msec); 0 zone resets clat (usec): min=995, max=68606, avg=14508.75, stdev=11386.48 lat (usec): min=996, max=68608, avg=14510.25, stdev=11386.74 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2671], 10.00th=[ 3752], 20.00th=[ 4555], | 30.00th=[ 6521], 40.00th=[ 8979], 50.00th=[11207], 60.00th=[14091], | 70.00th=[18482], 80.00th=[22938], 90.00th=[30802], 95.00th=[37487], | 99.00th=[51119], 99.50th=[56361], 99.90th=[68682], 99.95th=[68682], | 99.99th=[68682] bw ( KiB/s): min= 287, max= 800, per=25.22%, avg=533.17, stdev=111.05, samples=23 iops : min= 17, max= 50, avg=33.04, stdev= 7.08, samples=23 lat (usec) : 50=0.13%, 100=1.69%, 250=2.86%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.17%, 4=6.38%, 10=23.18%, 20=35.94%, 50=26.95% lat (msec) : 100=1.30% cpu : usr=0.13%, sys=27.88%, ctx=2559, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159685: Fri Apr 10 19:27:34 2026 read: IOPS=33, BW=538KiB/s (551kB/s)(6256KiB/11631msec) clat (usec): min=56, max=103117, avg=15922.62, stdev=11529.27 lat (usec): min=58, max=103119, avg=15923.35, stdev=11529.31 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 95], 10.00th=[ 122], 20.00th=[ 8717], | 30.00th=[ 11338], 40.00th=[ 12649], 50.00th=[ 14222], 60.00th=[ 16909], | 70.00th=[ 19268], 80.00th=[ 22152], 90.00th=[ 27132], 95.00th=[ 36963], | 99.00th=[ 58459], 99.50th=[ 70779], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 383, max= 800, per=26.89%, avg=540.22, stdev=105.70, samples=23 iops : min= 23, max= 50, avg=33.48, stdev= 6.72, samples=23 write: IOPS=32, BW=519KiB/s (531kB/s)(6032KiB/11631msec); 0 zone resets clat (usec): min=1393, max=82468, avg=14169.38, stdev=10753.10 lat (usec): min=1394, max=82470, avg=14172.13, stdev=10753.18 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 3359], 10.00th=[ 3785], 20.00th=[ 4883], | 30.00th=[ 7570], 40.00th=[ 9503], 50.00th=[11469], 60.00th=[13042], | 70.00th=[16712], 80.00th=[22152], 90.00th=[28443], 95.00th=[35390], | 99.00th=[47973], 99.50th=[55837], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 224, max= 701, per=24.28%, avg=513.17, stdev=135.90, samples=23 iops : min= 14, max= 43, avg=31.78, stdev= 8.35, samples=23 lat (usec) : 100=3.12%, 250=3.78%, 500=0.13% lat (msec) : 2=0.91%, 4=5.47%, 10=19.66%, 20=41.93%, 50=23.96% lat (msec) : 100=0.91%, 250=0.13% cpu : usr=0.15%, sys=27.89%, ctx=2425, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159687: Fri Apr 10 19:27:34 2026 read: IOPS=33, BW=532KiB/s (545kB/s)(6032KiB/11342msec) clat (usec): min=35, max=64885, avg=15314.44, stdev=10626.05 lat (usec): min=36, max=64886, avg=15315.10, stdev=10626.08 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 99], 10.00th=[ 120], 20.00th=[ 8586], | 30.00th=[10290], 40.00th=[12518], 50.00th=[14615], 60.00th=[16581], | 70.00th=[18482], 80.00th=[22152], 90.00th=[27657], 95.00th=[32637], | 99.00th=[60556], 99.50th=[64750], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 293, max= 768, per=26.40%, avg=530.45, stdev=124.23, samples=22 iops : min= 18, max= 48, avg=32.86, stdev= 7.80, samples=22 write: IOPS=34, BW=552KiB/s (565kB/s)(6256KiB/11342msec); 0 zone resets clat (usec): min=1368, max=108165, avg=14010.58, stdev=12323.24 lat (usec): min=1369, max=108167, avg=14012.16, stdev=12323.14 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 3064], 10.00th=[ 3589], 20.00th=[ 4359], | 30.00th=[ 5473], 40.00th=[ 8160], 50.00th=[ 10552], 60.00th=[ 13566], | 70.00th=[ 16909], 80.00th=[ 22152], 90.00th=[ 29754], 95.00th=[ 36963], | 99.00th=[ 56886], 99.50th=[ 79168], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 320, max= 733, per=26.18%, avg=553.55, stdev=116.01, samples=22 iops : min= 20, max= 45, avg=34.32, stdev= 7.16, samples=22 lat (usec) : 50=0.26%, 100=2.47%, 250=4.43% lat (msec) : 2=1.04%, 4=7.68%, 10=21.35%, 20=38.93%, 50=22.14% lat (msec) : 100=1.56%, 250=0.13% cpu : usr=0.10%, sys=28.00%, ctx=2431, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2010KiB/s (2058kB/s), 482KiB/s-538KiB/s (494kB/s-551kB/s), io=23.4MiB (24.5MB), run=11342-11918msec WRITE: bw=2114KiB/s (2165kB/s), 519KiB/s-553KiB/s (531kB/s-566kB/s), io=24.6MiB (25.8MB), run=11342-11918msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159682: Fri Apr 10 19:27:42 2026 read: IOPS=18, BW=300KiB/s (307kB/s)(5920KiB/19749msec) clat (usec): min=3537, max=81176, avg=15694.00, stdev=13564.77 lat (usec): min=3538, max=81177, avg=15694.82, stdev=13564.74 clat percentiles (usec): | 1.00th=[ 3982], 5.00th=[ 4752], 10.00th=[ 5538], 20.00th=[ 6915], | 30.00th=[ 8029], 40.00th=[ 9503], 50.00th=[10945], 60.00th=[12518], | 70.00th=[15270], 80.00th=[20579], 90.00th=[34341], 95.00th=[49546], | 99.00th=[67634], 99.50th=[77071], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 95, max= 606, per=24.33%, avg=294.82, stdev=128.24, samples=39 iops : min= 5, max= 37, avg=18.05, stdev= 8.11, samples=39 write: IOPS=20, BW=322KiB/s (330kB/s)(6368KiB/19749msec); 0 zone resets clat (msec): min=15, max=135, avg=34.97, stdev=17.11 lat (msec): min=15, max=135, avg=34.97, stdev=17.11 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 33], | 70.00th=[ 37], 80.00th=[ 43], 90.00th=[ 57], 95.00th=[ 71], | 99.00th=[ 96], 99.50th=[ 136], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 32, max= 576, per=25.06%, avg=319.77, stdev=134.44, samples=39 iops : min= 2, max= 36, avg=19.62, stdev= 8.60, samples=39 lat (msec) : 4=0.65%, 10=21.09%, 20=20.05%, 50=48.70%, 100=9.11% lat (msec) : 250=0.39% cpu : usr=0.10%, sys=9.11%, ctx=1626, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159684: Fri Apr 10 19:27:42 2026 read: IOPS=18, BW=291KiB/s (298kB/s)(5744KiB/19712msec) clat (msec): min=3, max=104, avg=14.48, stdev=12.71 lat (msec): min=3, max=104, avg=14.48, stdev=12.71 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 30], 95.00th=[ 39], | 99.00th=[ 67], 99.50th=[ 85], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 58, max= 672, per=23.92%, avg=289.90, stdev=157.71, samples=39 iops : min= 3, max= 42, avg=17.74, stdev=10.02, samples=39 write: IOPS=20, BW=332KiB/s (340kB/s)(6544KiB/19712msec); 0 zone resets clat (msec): min=14, max=164, avg=35.35, stdev=17.65 lat (msec): min=14, max=164, avg=35.35, stdev=17.65 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 38], 80.00th=[ 44], 90.00th=[ 57], 95.00th=[ 66], | 99.00th=[ 104], 99.50th=[ 133], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 127, max= 640, per=25.88%, avg=330.21, stdev=122.26, samples=39 iops : min= 7, max= 40, avg=20.28, stdev= 7.82, samples=39 lat (msec) : 4=1.04%, 10=21.35%, 20=19.53%, 50=49.35%, 100=7.94% lat (msec) : 250=0.78% cpu : usr=0.07%, sys=9.16%, ctx=1643, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159686: Fri Apr 10 19:27:42 2026 read: IOPS=20, BW=322KiB/s (329kB/s)(6256KiB/19446msec) clat (msec): min=3, max=101, avg=15.49, stdev=13.80 lat (msec): min=3, max=101, avg=15.49, stdev=13.80 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 34], 95.00th=[ 48], | 99.00th=[ 70], 99.50th=[ 73], 99.90th=[ 102], 99.95th=[ 102], | 99.99th=[ 102] bw ( KiB/s): min= 127, max= 832, per=26.46%, avg=320.66, stdev=164.91, samples=38 iops : min= 7, max= 52, avg=19.66, stdev=10.50, samples=38 write: IOPS=19, BW=310KiB/s (318kB/s)(6032KiB/19446msec); 0 zone resets clat (msec): min=15, max=143, avg=35.30, stdev=15.89 lat (msec): min=15, max=143, avg=35.30, stdev=15.89 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 56], 95.00th=[ 64], | 99.00th=[ 92], 99.50th=[ 116], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 95, max= 542, per=23.87%, avg=304.58, stdev=115.40, samples=38 iops : min= 5, max= 33, avg=18.66, stdev= 7.39, samples=38 lat (msec) : 4=0.91%, 10=23.31%, 20=19.01%, 50=47.53%, 100=8.72% lat (msec) : 250=0.52% cpu : usr=0.09%, sys=9.24%, ctx=1661, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159688: Fri Apr 10 19:27:42 2026 read: IOPS=19, BW=308KiB/s (316kB/s)(6032KiB/19560msec) clat (msec): min=2, max=106, avg=15.12, stdev=13.69 lat (msec): min=2, max=106, avg=15.12, stdev=13.69 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 67], 99.50th=[ 102], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 95, max= 640, per=24.86%, avg=301.29, stdev=135.78, samples=38 iops : min= 5, max= 40, avg=18.45, stdev= 8.62, samples=38 write: IOPS=19, BW=320KiB/s (328kB/s)(6256KiB/19560msec); 0 zone resets clat (msec): min=14, max=133, avg=35.23, stdev=16.75 lat (msec): min=14, max=133, avg=35.24, stdev=16.75 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 45], 90.00th=[ 56], 95.00th=[ 70], | 99.00th=[ 106], 99.50th=[ 114], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 128, max= 576, per=24.67%, avg=314.79, stdev=131.62, samples=38 iops : min= 8, max= 36, avg=19.29, stdev= 8.45, samples=38 lat (msec) : 4=0.52%, 10=21.61%, 20=21.48%, 50=47.79%, 100=7.55% lat (msec) : 250=1.04% cpu : usr=0.10%, sys=9.20%, ctx=1621, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1213KiB/s (1242kB/s), 291KiB/s-322KiB/s (298kB/s-329kB/s), io=23.4MiB (24.5MB), run=19446-19749msec WRITE: bw=1276KiB/s (1307kB/s), 310KiB/s-332KiB/s (318kB/s-340kB/s), io=24.6MiB (25.8MB), run=19446-19749msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159697: Fri Apr 10 19:27:50 2026 read: IOPS=3, BW=3908KiB/s (4002kB/s)(7168KiB/1834msec) clat (usec): min=536, max=253781, avg=106238.73, stdev=87977.89 lat (usec): min=537, max=253782, avg=106239.79, stdev=87977.69 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 9896], | 30.00th=[ 92799], 40.00th=[ 92799], 50.00th=[102237], 60.00th=[114820], | 70.00th=[114820], 80.00th=[168821], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 4096, max= 5189, per=61.89%, avg=4642.50, stdev=772.87, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2792KiB/s (2859kB/s)(5120KiB/1834msec); 0 zone resets clat (msec): min=158, max=290, avg=212.61, stdev=57.17 lat (msec): min=158, max=290, avg=212.67, stdev=57.17 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 4079, max= 4096, per=38.92%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 100=8.33%, 250=50.00%, 500=25.00% cpu : usr=0.00%, sys=47.74%, ctx=599, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159698: Fri Apr 10 19:27:50 2026 read: IOPS=0, BW=750KiB/s (768kB/s)(2048KiB/2730msec) clat (usec): min=594, max=92086, avg=46340.13, stdev=64694.62 lat (usec): min=594, max=92087, avg=46341.18, stdev=64695.46 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 594], | 30.00th=[ 594], 40.00th=[ 594], 50.00th=[ 594], 60.00th=[91751], | 70.00th=[91751], 80.00th=[91751], 90.00th=[91751], 95.00th=[91751], | 99.00th=[91751], 99.50th=[91751], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 1723, max= 2039, per=25.08%, avg=1881.00, stdev=223.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3751KiB/s (3841kB/s)(10.0MiB/2730msec); 0 zone resets clat (msec): min=123, max=555, avg=263.07, stdev=151.47 lat (msec): min=123, max=555, avg=263.15, stdev=151.50 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 142], | 30.00th=[ 157], 40.00th=[ 163], 50.00th=[ 178], 60.00th=[ 232], | 70.00th=[ 262], 80.00th=[ 330], 90.00th=[ 493], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1723, max= 6144, per=34.28%, avg=3600.60, stdev=1813.62, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 2.12, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=41.11%, ctx=367, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159699: Fri Apr 10 19:27:50 2026 read: IOPS=2, BW=3013KiB/s (3086kB/s)(6144KiB/2039msec) clat (msec): min=35, max=272, avg=132.43, stdev=81.56 lat (msec): min=35, max=272, avg=132.43, stdev=81.56 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 144], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 4079, max= 4096, per=54.49%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=3013KiB/s (3086kB/s)(6144KiB/2039msec); 0 zone resets clat (msec): min=129, max=261, avg=201.20, stdev=55.60 lat (msec): min=129, max=261, avg=201.25, stdev=55.60 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 234], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 2039, max= 4096, per=30.38%, avg=3190.33, stdev=1050.27, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=66.67%, 500=16.67% cpu : usr=0.00%, sys=45.29%, ctx=924, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159700: Fri Apr 10 19:27:50 2026 read: IOPS=2, BW=2138KiB/s (2189kB/s)(5120KiB/2395msec) clat (usec): min=465, max=435115, avg=189825.49, stdev=172775.28 lat (usec): min=466, max=435116, avg=189826.40, stdev=172775.12 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 465], | 30.00th=[107480], 40.00th=[107480], 50.00th=[113771], 60.00th=[113771], | 70.00th=[291505], 80.00th=[291505], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 3923, max= 4079, per=53.34%, avg=4001.00, stdev=110.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2993KiB/s (3065kB/s)(7168KiB/2395msec); 0 zone resets clat (msec): min=68, max=513, avg=203.27, stdev=161.74 lat (msec): min=68, max=513, avg=203.34, stdev=161.74 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 89], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 121], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 305], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1961, max= 3459, per=22.63%, avg=2376.75, stdev=722.56, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=37.89%, ctx=510, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7502KiB/s (7682kB/s), 750KiB/s-3908KiB/s (768kB/s-4002kB/s), io=20.0MiB (20.0MB), run=1834-2730msec WRITE: bw=10.3MiB/s (10.8MB/s), 2792KiB/s-3751KiB/s (2859kB/s-3841kB/s), io=28.0MiB (29.4MB), run=1834-2730msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159702: Fri Apr 10 19:27:50 2026 read: IOPS=2, BW=2747KiB/s (2813kB/s)(7168KiB/2609msec) clat (msec): min=64, max=517, avg=183.81, stdev=157.75 lat (msec): min=64, max=517, avg=183.81, stdev=157.75 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 138], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 211], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1996, max= 5003, per=40.00%, avg=3015.67, stdev=1721.28, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1962KiB/s (2010kB/s)(5120KiB/2609msec); 0 zone resets clat (msec): min=67, max=511, avg=255.23, stdev=185.81 lat (msec): min=67, max=511, avg=255.30, stdev=185.81 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 178], 60.00th=[ 178], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1996, max= 4055, per=28.66%, avg=3025.50, stdev=1455.93, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=33.33%, 250=41.67%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=14.69%, ctx=322, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159703: Fri Apr 10 19:27:50 2026 read: IOPS=0, BW=754KiB/s (772kB/s)(2048KiB/2716msec) clat (msec): min=68, max=370, avg=219.31, stdev=213.75 lat (msec): min=68, max=370, avg=219.32, stdev=213.75 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 69], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1689, max= 2027, per=24.64%, avg=1858.00, stdev=239.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3770KiB/s (3861kB/s)(10.0MiB/2716msec); 0 zone resets clat (msec): min=44, max=672, avg=219.69, stdev=199.30 lat (msec): min=44, max=673, avg=219.75, stdev=199.30 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 64], | 30.00th=[ 90], 40.00th=[ 108], 50.00th=[ 109], 60.00th=[ 182], | 70.00th=[ 188], 80.00th=[ 313], 90.00th=[ 430], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1689, max= 6131, per=37.58%, avg=3966.75, stdev=1814.80, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=16.54%, ctx=359, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159704: Fri Apr 10 19:27:50 2026 read: IOPS=2, BW=2417KiB/s (2475kB/s)(6144KiB/2542msec) clat (msec): min=51, max=304, avg=155.40, stdev=110.11 lat (msec): min=51, max=304, avg=155.40, stdev=110.11 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 55], | 30.00th=[ 55], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 186], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 4055, max= 4096, per=54.05%, avg=4075.50, stdev=28.99, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2417KiB/s (2475kB/s)(6144KiB/2542msec); 0 zone resets clat (msec): min=76, max=405, avg=255.70, stdev=154.33 lat (msec): min=76, max=405, avg=255.75, stdev=154.35 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 79], | 30.00th=[ 79], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 380], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1703, max= 3992, per=24.38%, avg=2574.00, stdev=1238.66, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=41.67%, 250=16.67%, 500=41.67% cpu : usr=0.00%, sys=13.50%, ctx=124, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159705: Fri Apr 10 19:27:50 2026 read: IOPS=1, BW=1935KiB/s (1981kB/s)(5120KiB/2646msec) clat (msec): min=36, max=154, avg=79.06, stdev=52.04 lat (msec): min=36, max=154, avg=79.06, stdev=52.04 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 37], | 30.00th=[ 45], 40.00th=[ 45], 50.00th=[ 47], 60.00th=[ 47], | 70.00th=[ 114], 80.00th=[ 114], 90.00th=[ 155], 95.00th=[ 155], | 99.00th=[ 155], 99.50th=[ 155], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 2027, max= 6131, per=54.10%, avg=4079.00, stdev=2901.97, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2709KiB/s (2774kB/s)(7168KiB/2646msec); 0 zone resets clat (msec): min=65, max=744, avg=309.94, stdev=242.52 lat (msec): min=65, max=744, avg=310.00, stdev=242.51 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 87], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 388], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1686, max= 6131, per=26.31%, avg=2777.60, stdev=1880.39, samples=5 iops : min= 1, max= 5, avg= 2.00, stdev= 1.73, samples=5 lat (msec) : 50=25.00%, 100=16.67%, 250=25.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=17.32%, ctx=436, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7541KiB/s (7721kB/s), 754KiB/s-2747KiB/s (772kB/s-2813kB/s), io=20.0MiB (20.0MB), run=2542-2716msec WRITE: bw=10.3MiB/s (10.8MB/s), 1962KiB/s-3770KiB/s (2010kB/s-3861kB/s), io=28.0MiB (29.4MB), run=2542-2716msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=159710: Fri Apr 10 19:27:57 2026 read: IOPS=2, BW=11.6MiB/s (12.2MB/s)(12.0MiB/1034msec) clat (msec): min=203, max=450, avg=340.46, stdev=125.89 lat (msec): min=203, max=450, avg=340.46, stdev=125.89 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7501, max= 7501, per=47.34%, avg=7501.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=20.62%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159711: Fri Apr 10 19:27:57 2026 read: IOPS=1, BW=5461KiB/s (5592kB/s)(4096KiB/750msec) clat (nsec): min=241057k, max=241057k, avg=241057456.00, stdev= 0.00 lat (nsec): min=241060k, max=241060k, avg=241059563.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 7198, max= 7198, per=45.43%, avg=7198.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=2, BW=10.7MiB/s (11.2MB/s)(8192KiB/750msec); 0 zone resets clat (msec): min=161, max=323, avg=242.51, stdev=114.79 lat (msec): min=161, max=323, avg=242.81, stdev=114.79 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.27%, sys=30.57%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159712: Fri Apr 10 19:27:57 2026 write: IOPS=7, BW=28.6MiB/s (30.0MB/s)(12.0MiB/419msec); 0 zone resets clat (msec): min=120, max=162, avg=136.79, stdev=22.57 lat (msec): min=120, max=162, avg=137.07, stdev=22.67 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 128], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] lat (msec) : 250=100.00% cpu : usr=0.00%, sys=46.65%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159713: Fri Apr 10 19:27:57 2026 write: IOPS=5, BW=20.3MiB/s (21.3MB/s)(12.0MiB/591msec); 0 zone resets clat (msec): min=121, max=265, avg=192.99, stdev=72.32 lat (msec): min=121, max=265, avg=193.17, stdev=72.24 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 192], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 266], 95.00th=[ 266], | 99.00th=[ 266], 99.50th=[ 266], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min=15515, max=15515, per=35.51%, avg=15515.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=36.95%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=15.5MiB/s (16.2MB/s), 5461KiB/s-11.6MiB/s (5592kB/s-12.2MB/s), io=16.0MiB (16.8MB), run=750-1034msec WRITE: bw=42.7MiB/s (44.7MB/s), 10.7MiB/s-28.6MiB/s (11.2MB/s-30.0MB/s), io=32.0MiB (33.6MB), run=419-750msec rand-rw: (groupid=0, jobs=1): err= 0: pid=159715: Fri Apr 10 19:27:58 2026 read: IOPS=2, BW=10.3MiB/s (10.8MB/s)(12.0MiB/1169msec) clat (msec): min=336, max=436, avg=389.10, stdev=50.08 lat (msec): min=336, max=436, avg=389.10, stdev=50.08 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7529, max= 8192, per=56.09%, avg=7860.50, stdev=468.81, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.09%, sys=44.69%, ctx=2558, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159716: Fri Apr 10 19:27:58 2026 read: IOPS=0, BW=3587KiB/s (3673kB/s)(4096KiB/1142msec) clat (nsec): min=397304k, max=397304k, avg=397304216.00, stdev= 0.00 lat (nsec): min=397305k, max=397305k, avg=397304858.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7488, max= 7488, per=53.43%, avg=7488.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=7173KiB/s (7346kB/s)(8192KiB/1142msec); 0 zone resets clat (msec): min=251, max=491, avg=371.74, stdev=169.62 lat (msec): min=252, max=491, avg=371.95, stdev=169.53 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 8192, max= 8192, per=31.35%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=31.26%, ctx=1086, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159717: Fri Apr 10 19:27:58 2026 write: IOPS=2, BW=9799KiB/s (10.0MB/s)(12.0MiB/1254msec); 0 zone resets clat (msec): min=332, max=553, avg=417.52, stdev=119.07 lat (msec): min=332, max=553, avg=417.77, stdev=119.00 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min=16384, max=16384, per=62.70%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.08%, sys=35.99%, ctx=117, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=159718: Fri Apr 10 19:27:58 2026 write: IOPS=3, BW=15.3MiB/s (16.1MB/s)(12.0MiB/782msec); 0 zone resets clat (msec): min=193, max=369, avg=259.95, stdev=95.39 lat (msec): min=193, max=369, avg=260.21, stdev=95.41 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min=13861, max=13861, per=53.05%, avg=13861.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=32.01%, ctx=62, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=13.7MiB/s (14.4MB/s), 3587KiB/s-10.3MiB/s (3673kB/s-10.8MB/s), io=16.0MiB (16.8MB), run=1142-1169msec WRITE: bw=25.5MiB/s (26.8MB/s), 7173KiB/s-15.3MiB/s (7346kB/s-16.1MB/s), io=32.0MiB (33.6MB), run=782-1254msec