== sanity test 398b: DIO and buffer IO race ============== 03:22:53 (1753428173) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.72649 s, 18.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156786: Fri Jul 25 03:23:55 2025 read: IOPS=27, BW=112KiB/s (115kB/s)(5992KiB/53543msec) clat (usec): min=82, max=773531, avg=19049.41, stdev=22669.94 lat (usec): min=82, max=773532, avg=19050.60, stdev=22670.04 clat percentiles (usec): | 1.00th=[ 314], 5.00th=[ 5604], 10.00th=[ 7635], 20.00th=[ 10028], | 30.00th=[ 12125], 40.00th=[ 14222], 50.00th=[ 16319], 60.00th=[ 19006], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32113], 95.00th=[ 37487], | 99.00th=[ 59507], 99.50th=[ 66847], 99.90th=[125305], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 6, max= 216, per=24.95%, avg=111.53, stdev=36.46, samples=106 iops : min= 1, max= 54, avg=27.50, stdev= 9.18, samples=106 write: IOPS=29, BW=118KiB/s (120kB/s)(6296KiB/53543msec); 0 zone resets clat (usec): min=587, max=120299, avg=15716.60, stdev=13092.38 lat (usec): min=588, max=120300, avg=15717.67, stdev=13092.49 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 2212], 10.00th=[ 2900], 20.00th=[ 4555], | 30.00th=[ 6783], 40.00th=[ 9765], 50.00th=[ 12780], 60.00th=[ 16057], | 70.00th=[ 19792], 80.00th=[ 24511], 90.00th=[ 32113], 95.00th=[ 39060], | 99.00th=[ 60556], 99.50th=[ 74974], 99.90th=[ 99091], 99.95th=[120062], | 99.99th=[120062] bw ( KiB/s): min= 32, max= 240, per=25.30%, avg=118.38, stdev=38.05, samples=105 iops : min= 8, max= 60, avg=29.22, stdev= 9.61, samples=105 lat (usec) : 100=0.10%, 250=0.13%, 500=1.07%, 750=0.59%, 1000=0.55% lat (msec) : 2=1.50%, 4=7.00%, 10=19.60%, 20=36.46%, 50=31.35% lat (msec) : 100=1.50%, 250=0.13%, 1000=0.03% cpu : usr=0.16%, sys=28.84%, ctx=8483, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156787: Fri Jul 25 03:23:55 2025 read: IOPS=27, BW=112KiB/s (115kB/s)(5940KiB/53044msec) clat (usec): min=79, max=110129, avg=18370.30, stdev=10939.63 lat (usec): min=79, max=110130, avg=18373.07, stdev=10943.17 clat percentiles (usec): | 1.00th=[ 318], 5.00th=[ 5604], 10.00th=[ 7963], 20.00th=[ 10159], | 30.00th=[ 12256], 40.00th=[ 14353], 50.00th=[ 16581], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 25822], 90.00th=[ 30802], 95.00th=[ 36963], | 99.00th=[ 54789], 99.50th=[ 68682], 99.90th=[ 88605], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 6, max= 231, per=25.00%, avg=111.75, stdev=39.40, samples=105 iops : min= 1, max= 57, avg=27.55, stdev= 9.93, samples=105 write: IOPS=29, BW=120KiB/s (123kB/s)(6348KiB/53044msec); 0 zone resets clat (usec): min=652, max=777800, avg=16066.34, stdev=23557.54 lat (usec): min=652, max=777801, avg=16072.10, stdev=23561.63 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 2245], 10.00th=[ 2900], 20.00th=[ 4359], | 30.00th=[ 6259], 40.00th=[ 9372], 50.00th=[ 11994], 60.00th=[ 15533], | 70.00th=[ 19268], 80.00th=[ 25297], 90.00th=[ 32900], 95.00th=[ 40109], | 99.00th=[ 59507], 99.50th=[ 88605], 99.90th=[125305], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 39, max= 224, per=25.69%, avg=120.22, stdev=37.74, samples=104 iops : min= 9, max= 56, avg=29.67, stdev= 9.50, samples=104 lat (usec) : 100=0.07%, 250=0.26%, 500=0.75%, 750=0.78%, 1000=0.75% lat (msec) : 2=1.43%, 4=7.32%, 10=20.02%, 20=37.43%, 50=29.39% lat (msec) : 100=1.60%, 250=0.16%, 1000=0.03% cpu : usr=0.13%, sys=29.03%, ctx=8604, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156788: Fri Jul 25 03:23:55 2025 read: IOPS=28, BW=113KiB/s (115kB/s)(6028KiB/53457msec) clat (usec): min=79, max=121396, avg=18173.77, stdev=11013.52 lat (usec): min=80, max=121396, avg=18174.69, stdev=11013.60 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 5604], 10.00th=[ 7701], 20.00th=[ 9896], | 30.00th=[ 11994], 40.00th=[ 13960], 50.00th=[ 16319], 60.00th=[ 18744], | 70.00th=[ 21365], 80.00th=[ 25297], 90.00th=[ 30802], 95.00th=[ 36963], | 99.00th=[ 58459], 99.50th=[ 69731], 99.90th=[ 89654], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 32, max= 216, per=25.47%, avg=113.85, stdev=34.91, samples=105 iops : min= 8, max= 54, avg=28.08, stdev= 8.78, samples=105 write: IOPS=29, BW=117KiB/s (120kB/s)(6260KiB/53457msec); 0 zone resets clat (usec): min=548, max=772320, avg=16489.07, stdev=22933.06 lat (usec): min=548, max=772322, avg=16490.26, stdev=22933.11 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 2212], 10.00th=[ 2966], 20.00th=[ 4817], | 30.00th=[ 7308], 40.00th=[ 10552], 50.00th=[ 13566], 60.00th=[ 16712], | 70.00th=[ 20317], 80.00th=[ 25035], 90.00th=[ 31851], 95.00th=[ 39584], | 99.00th=[ 56361], 99.50th=[ 71828], 99.90th=[112722], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 32, max= 240, per=25.23%, avg=118.10, stdev=38.15, samples=105 iops : min= 8, max= 60, avg=29.14, stdev= 9.60, samples=105 lat (usec) : 100=0.03%, 250=0.26%, 500=0.88%, 750=0.72%, 1000=0.52% lat (msec) : 2=1.79%, 4=5.50%, 10=19.56%, 20=37.92%, 50=31.15% lat (msec) : 100=1.56%, 250=0.07%, 1000=0.03% cpu : usr=0.13%, sys=28.80%, ctx=8589, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156789: Fri Jul 25 03:23:55 2025 read: IOPS=28, BW=113KiB/s (116kB/s)(6052KiB/53616msec) clat (usec): min=74, max=109188, avg=18253.86, stdev=11037.02 lat (usec): min=74, max=109190, avg=18255.92, stdev=11036.89 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 4424], 10.00th=[ 7373], 20.00th=[ 9896], | 30.00th=[ 12256], 40.00th=[ 14222], 50.00th=[ 16319], 60.00th=[ 18744], | 70.00th=[ 21890], 80.00th=[ 25560], 90.00th=[ 31327], 95.00th=[ 37487], | 99.00th=[ 57934], 99.50th=[ 64750], 99.90th=[ 79168], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 32, max= 208, per=25.36%, avg=113.38, stdev=34.45, samples=105 iops : min= 8, max= 52, avg=27.96, stdev= 8.71, samples=105 write: IOPS=29, BW=116KiB/s (119kB/s)(6236KiB/53616msec); 0 zone resets clat (usec): min=608, max=772307, avg=16503.13, stdev=23467.36 lat (usec): min=609, max=772308, avg=16504.28, stdev=23467.39 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 2212], 10.00th=[ 2835], 20.00th=[ 4490], | 30.00th=[ 6456], 40.00th=[ 9634], 50.00th=[ 12911], 60.00th=[ 16712], | 70.00th=[ 20579], 80.00th=[ 25297], 90.00th=[ 33162], 95.00th=[ 40109], | 99.00th=[ 64750], 99.50th=[ 77071], 99.90th=[110625], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 32, max= 208, per=25.01%, avg=117.05, stdev=36.77, samples=105 iops : min= 8, max= 52, avg=28.88, stdev= 9.26, samples=105 lat (usec) : 100=0.10%, 250=0.10%, 500=1.04%, 750=0.85%, 1000=0.59% lat (msec) : 2=1.60%, 4=6.93%, 10=19.53%, 20=35.48%, 50=31.67% lat (msec) : 100=1.99%, 250=0.10%, 1000=0.03% cpu : usr=0.15%, sys=28.65%, ctx=8504, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=448KiB/s (459kB/s), 112KiB/s-113KiB/s (115kB/s-116kB/s), io=23.4MiB (24.6MB), run=53044-53616msec WRITE: bw=469KiB/s (480kB/s), 116KiB/s-120KiB/s (119kB/s-123kB/s), io=24.6MiB (25.7MB), run=53044-53616msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156781: Fri Jul 25 03:24:24 2025 read: IOPS=18, BW=72.2KiB/s (73.9kB/s)(5992KiB/82990msec) clat (msec): min=2, max=781, avg=18.71, stdev=24.22 lat (msec): min=2, max=781, avg=18.71, stdev=24.22 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 25], 90.00th=[ 34], 95.00th=[ 47], | 99.00th=[ 74], 99.50th=[ 92], 99.90th=[ 153], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8, max= 184, per=25.00%, avg=72.24, stdev=34.43, samples=164 iops : min= 2, max= 46, avg=17.80, stdev= 8.75, samples=164 write: IOPS=18, BW=75.9KiB/s (77.7kB/s)(6296KiB/82990msec); 0 zone resets clat (msec): min=11, max=195, avg=34.71, stdev=18.47 lat (msec): min=11, max=195, avg=34.72, stdev=18.47 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 57], 95.00th=[ 67], | 99.00th=[ 107], 99.50th=[ 132], 99.90th=[ 171], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 23, max= 168, per=25.32%, avg=76.47, stdev=32.59, samples=163 iops : min= 5, max= 42, avg=18.86, stdev= 8.29, samples=163 lat (msec) : 4=0.91%, 10=13.51%, 20=26.95%, 50=48.70%, 100=9.21% lat (msec) : 250=0.68%, 1000=0.03% cpu : usr=0.12%, sys=11.20%, ctx=4841, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156782: Fri Jul 25 03:24:24 2025 read: IOPS=17, BW=71.8KiB/s (73.5kB/s)(5940KiB/82733msec) clat (msec): min=2, max=763, avg=18.80, stdev=24.35 lat (msec): min=2, max=763, avg=18.80, stdev=24.35 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 26], 90.00th=[ 34], 95.00th=[ 45], | 99.00th=[ 80], 99.50th=[ 104], 99.90th=[ 148], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8, max= 184, per=25.09%, avg=72.50, stdev=35.57, samples=162 iops : min= 2, max= 46, avg=17.87, stdev= 9.02, samples=162 write: IOPS=19, BW=76.7KiB/s (78.6kB/s)(6348KiB/82733msec); 0 zone resets clat (msec): min=13, max=172, avg=34.34, stdev=17.37 lat (msec): min=13, max=172, avg=34.34, stdev=17.37 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 68], | 99.00th=[ 100], 99.50th=[ 111], 99.90th=[ 155], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 8, max= 160, per=25.43%, avg=76.81, stdev=32.59, samples=163 iops : min= 2, max= 40, avg=18.94, stdev= 8.29, samples=163 lat (msec) : 4=1.24%, 10=13.74%, 20=24.97%, 50=50.68%, 100=8.63% lat (msec) : 250=0.72%, 1000=0.03% cpu : usr=0.11%, sys=11.30%, ctx=4751, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156783: Fri Jul 25 03:24:24 2025 read: IOPS=18, BW=72.9KiB/s (74.6kB/s)(6028KiB/82704msec) clat (msec): min=2, max=148, avg=18.26, stdev=13.79 lat (msec): min=2, max=148, avg=18.26, stdev=13.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 26], 90.00th=[ 33], 95.00th=[ 42], | 99.00th=[ 70], 99.50th=[ 93], 99.90th=[ 130], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 16, max= 184, per=25.48%, avg=73.63, stdev=34.27, samples=162 iops : min= 4, max= 46, avg=18.15, stdev= 8.71, samples=162 write: IOPS=18, BW=75.7KiB/s (77.5kB/s)(6260KiB/82704msec); 0 zone resets clat (msec): min=12, max=768, avg=35.06, stdev=25.44 lat (msec): min=12, max=768, avg=35.06, stdev=25.44 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 58], 95.00th=[ 69], | 99.00th=[ 99], 99.50th=[ 110], 99.90th=[ 153], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 23, max= 168, per=25.11%, avg=75.83, stdev=32.29, samples=163 iops : min= 5, max= 42, avg=18.70, stdev= 8.20, samples=163 lat (msec) : 4=1.07%, 10=13.15%, 20=25.94%, 50=49.77%, 100=9.57% lat (msec) : 250=0.46%, 1000=0.03% cpu : usr=0.10%, sys=11.52%, ctx=4872, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156784: Fri Jul 25 03:24:24 2025 read: IOPS=18, BW=73.3KiB/s (75.1kB/s)(6052KiB/82545msec) clat (msec): min=3, max=132, avg=17.79, stdev=13.03 lat (msec): min=3, max=132, avg=17.79, stdev=13.03 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 25], 90.00th=[ 33], 95.00th=[ 44], | 99.00th=[ 67], 99.50th=[ 83], 99.90th=[ 103], 99.95th=[ 133], | 99.99th=[ 133] bw ( KiB/s): min= 15, max= 208, per=25.65%, avg=74.12, stdev=34.86, samples=162 iops : min= 3, max= 52, avg=18.27, stdev= 8.83, samples=162 write: IOPS=18, BW=75.5KiB/s (77.4kB/s)(6236KiB/82545msec); 0 zone resets clat (msec): min=13, max=772, avg=35.48, stdev=26.10 lat (msec): min=13, max=772, avg=35.48, stdev=26.10 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 58], 95.00th=[ 70], | 99.00th=[ 108], 99.50th=[ 136], 99.90th=[ 199], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 16, max= 152, per=25.08%, avg=75.73, stdev=31.15, samples=163 iops : min= 4, max= 38, avg=18.67, stdev= 7.95, samples=163 lat (msec) : 4=1.30%, 10=13.67%, 20=24.64%, 50=50.85%, 100=8.85% lat (msec) : 250=0.65%, 1000=0.03% cpu : usr=0.09%, sys=11.38%, ctx=4805, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=289KiB/s (296kB/s), 71.8KiB/s-73.3KiB/s (73.5kB/s-75.1kB/s), io=23.4MiB (24.6MB), run=82545-82990msec WRITE: bw=303KiB/s (310kB/s), 75.5KiB/s-76.7KiB/s (77.4kB/s-78.6kB/s), io=24.6MiB (25.7MB), run=82545-82990msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156830: Fri Jul 25 03:24:48 2025 read: IOPS=20, BW=328KiB/s (336kB/s)(5920KiB/18060msec) clat (usec): min=404, max=98234, avg=25283.29, stdev=12799.68 lat (usec): min=405, max=98235, avg=25284.42, stdev=12799.68 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 873], 10.00th=[12518], 20.00th=[16581], | 30.00th=[19268], 40.00th=[21103], 50.00th=[23725], 60.00th=[26870], | 70.00th=[29754], 80.00th=[33424], 90.00th=[40109], 95.00th=[49021], | 99.00th=[65799], 99.50th=[69731], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 192, max= 443, per=24.76%, avg=324.89, stdev=63.71, samples=35 iops : min= 12, max= 27, avg=19.74, stdev= 3.96, samples=35 write: IOPS=22, BW=353KiB/s (361kB/s)(6368KiB/18060msec); 0 zone resets clat (usec): min=1512, max=76676, avg=21667.29, stdev=13689.74 lat (usec): min=1513, max=76678, avg=21669.40, stdev=13689.94 clat percentiles (usec): | 1.00th=[ 3556], 5.00th=[ 6063], 10.00th=[ 6980], 20.00th=[ 8848], | 30.00th=[11863], 40.00th=[15795], 50.00th=[18482], 60.00th=[22414], | 70.00th=[26870], 80.00th=[32900], 90.00th=[40109], 95.00th=[46400], | 99.00th=[69731], 99.50th=[72877], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 126, max= 608, per=25.58%, avg=353.03, stdev=102.08, samples=35 iops : min= 7, max= 38, avg=21.49, stdev= 6.55, samples=35 lat (usec) : 500=0.65%, 750=1.30%, 1000=0.65% lat (msec) : 2=0.13%, 4=0.39%, 10=13.80%, 20=27.99%, 50=51.04% lat (msec) : 100=4.04% cpu : usr=0.10%, sys=32.32%, ctx=2842, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156831: Fri Jul 25 03:24:48 2025 read: IOPS=19, BW=315KiB/s (322kB/s)(5744KiB/18248msec) clat (usec): min=427, max=89740, avg=25397.60, stdev=12917.53 lat (usec): min=428, max=89741, avg=25405.08, stdev=12918.93 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 701], 10.00th=[11994], 20.00th=[16712], | 30.00th=[19530], 40.00th=[21627], 50.00th=[24249], 60.00th=[27132], | 70.00th=[30540], 80.00th=[34341], 90.00th=[38011], 95.00th=[47449], | 99.00th=[66847], 99.50th=[86508], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 105, max= 510, per=23.89%, avg=313.39, stdev=83.74, samples=36 iops : min= 6, max= 31, avg=19.00, stdev= 5.31, samples=36 write: IOPS=22, BW=359KiB/s (367kB/s)(6544KiB/18248msec); 0 zone resets clat (usec): min=1346, max=79210, avg=22076.16, stdev=13998.85 lat (usec): min=1348, max=79212, avg=22078.13, stdev=13998.84 clat percentiles (usec): | 1.00th=[ 4080], 5.00th=[ 5604], 10.00th=[ 6915], 20.00th=[ 8586], | 30.00th=[11863], 40.00th=[16319], 50.00th=[20055], 60.00th=[23462], | 70.00th=[27395], 80.00th=[33817], 90.00th=[41157], 95.00th=[47449], | 99.00th=[61080], 99.50th=[71828], 99.90th=[79168], 99.95th=[79168], | 99.99th=[79168] bw ( KiB/s): min= 127, max= 606, per=25.96%, avg=358.22, stdev=103.78, samples=36 iops : min= 7, max= 37, avg=21.83, stdev= 6.53, samples=36 lat (usec) : 500=0.91%, 750=1.82%, 1000=0.39% lat (msec) : 2=0.13%, 4=0.26%, 10=13.54%, 20=24.48%, 50=54.69% lat (msec) : 100=3.78% cpu : usr=0.12%, sys=32.03%, ctx=2795, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156834: Fri Jul 25 03:24:48 2025 read: IOPS=21, BW=344KiB/s (352kB/s)(6256KiB/18184msec) clat (usec): min=149, max=127262, avg=26117.53, stdev=14183.17 lat (usec): min=150, max=127263, avg=26118.60, stdev=14183.15 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 6652], 10.00th=[ 12649], 20.00th=[ 16450], | 30.00th=[ 19268], 40.00th=[ 21890], 50.00th=[ 25035], 60.00th=[ 27395], | 70.00th=[ 30802], 80.00th=[ 33817], 90.00th=[ 40633], 95.00th=[ 48497], | 99.00th=[ 70779], 99.50th=[119014], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 223, max= 447, per=26.17%, avg=343.34, stdev=51.65, samples=35 iops : min= 13, max= 27, avg=20.89, stdev= 3.29, samples=35 write: IOPS=20, BW=332KiB/s (340kB/s)(6032KiB/18184msec); 0 zone resets clat (usec): min=1686, max=91131, avg=21073.09, stdev=13068.17 lat (usec): min=1688, max=91133, avg=21075.15, stdev=13068.17 clat percentiles (usec): | 1.00th=[ 3490], 5.00th=[ 6063], 10.00th=[ 7504], 20.00th=[ 9765], | 30.00th=[12256], 40.00th=[15664], 50.00th=[18744], 60.00th=[21103], | 70.00th=[26346], 80.00th=[30802], 90.00th=[40109], 95.00th=[45351], | 99.00th=[61080], 99.50th=[70779], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 126, max= 527, per=23.57%, avg=325.23, stdev=91.06, samples=35 iops : min= 7, max= 32, avg=19.74, stdev= 5.72, samples=35 lat (usec) : 250=0.13%, 500=0.26%, 750=1.30%, 1000=0.26% lat (msec) : 2=0.39%, 4=0.65%, 10=11.20%, 20=29.69%, 50=52.99% lat (msec) : 100=2.86%, 250=0.26% cpu : usr=0.15%, sys=31.92%, ctx=2831, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156836: Fri Jul 25 03:24:48 2025 read: IOPS=21, BW=338KiB/s (346kB/s)(6032KiB/17872msec) clat (usec): min=163, max=80937, avg=24992.73, stdev=13671.40 lat (usec): min=164, max=80937, avg=24993.77, stdev=13671.43 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 652], 10.00th=[11600], 20.00th=[15533], | 30.00th=[17957], 40.00th=[20317], 50.00th=[23987], 60.00th=[26870], | 70.00th=[30016], 80.00th=[33817], 90.00th=[42206], 95.00th=[49546], | 99.00th=[64750], 99.50th=[74974], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 222, max= 540, per=25.74%, avg=337.74, stdev=68.48, samples=35 iops : min= 13, max= 33, avg=20.54, stdev= 4.37, samples=35 write: IOPS=21, BW=350KiB/s (358kB/s)(6256KiB/17872msec); 0 zone resets clat (msec): min=2, max=136, avg=21.24, stdev=14.05 lat (msec): min=2, max=136, avg=21.24, stdev=14.05 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 32], 90.00th=[ 40], 95.00th=[ 46], | 99.00th=[ 65], 99.50th=[ 71], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 157, max= 574, per=25.52%, avg=352.14, stdev=87.36, samples=35 iops : min= 9, max= 35, avg=21.46, stdev= 5.41, samples=35 lat (usec) : 250=0.13%, 500=0.65%, 750=2.60%, 1000=0.65% lat (msec) : 2=0.13%, 4=1.17%, 10=10.81%, 20=29.43%, 50=50.78% lat (msec) : 100=3.52%, 250=0.13% cpu : usr=0.11%, sys=31.92%, ctx=2853, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1313KiB/s (1344kB/s), 315KiB/s-344KiB/s (322kB/s-352kB/s), io=23.4MiB (24.5MB), run=17872-18248msec WRITE: bw=1381KiB/s (1414kB/s), 332KiB/s-359KiB/s (340kB/s-367kB/s), io=24.6MiB (25.8MB), run=17872-18248msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156829: Fri Jul 25 03:24:54 2025 read: IOPS=15, BW=250KiB/s (256kB/s)(5920KiB/23667msec) clat (msec): min=3, max=109, avg=22.07, stdev=19.55 lat (msec): min=3, max=109, avg=22.07, stdev=19.55 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 24], 80.00th=[ 36], 90.00th=[ 55], 95.00th=[ 64], | 99.00th=[ 85], 99.50th=[ 92], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 31, max= 640, per=23.78%, avg=240.65, stdev=144.91, samples=46 iops : min= 1, max= 40, avg=14.54, stdev= 9.23, samples=46 write: IOPS=16, BW=269KiB/s (276kB/s)(6368KiB/23667msec); 0 zone resets clat (msec): min=12, max=142, avg=38.76, stdev=20.71 lat (msec): min=12, max=142, avg=38.76, stdev=20.71 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 69], 95.00th=[ 78], | 99.00th=[ 110], 99.50th=[ 111], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 127, max= 576, per=24.75%, avg=263.35, stdev=135.65, samples=46 iops : min= 7, max= 36, avg=15.98, stdev= 8.69, samples=46 lat (msec) : 4=1.56%, 10=14.71%, 20=20.44%, 50=44.40%, 100=17.97% lat (msec) : 250=0.91% cpu : usr=0.09%, sys=12.58%, ctx=1300, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156832: Fri Jul 25 03:24:54 2025 read: IOPS=15, BW=246KiB/s (251kB/s)(5744KiB/23389msec) clat (msec): min=2, max=107, avg=21.03, stdev=19.00 lat (msec): min=2, max=107, avg=21.03, stdev=19.00 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 32], 90.00th=[ 51], 95.00th=[ 62], | 99.00th=[ 89], 99.50th=[ 99], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 63, max= 800, per=24.14%, avg=244.26, stdev=154.75, samples=46 iops : min= 3, max= 50, avg=14.78, stdev= 9.87, samples=46 write: IOPS=17, BW=280KiB/s (287kB/s)(6544KiB/23389msec); 0 zone resets clat (msec): min=14, max=134, avg=38.54, stdev=20.72 lat (msec): min=14, max=134, avg=38.54, stdev=20.72 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 55], 90.00th=[ 67], 95.00th=[ 84], | 99.00th=[ 108], 99.50th=[ 113], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 96, max= 640, per=26.15%, avg=278.28, stdev=142.01, samples=46 iops : min= 6, max= 40, avg=16.91, stdev= 9.11, samples=46 lat (msec) : 4=1.56%, 10=14.84%, 20=20.83%, 50=45.83%, 100=15.89% lat (msec) : 250=1.04% cpu : usr=0.11%, sys=12.57%, ctx=1281, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156833: Fri Jul 25 03:24:54 2025 read: IOPS=16, BW=265KiB/s (272kB/s)(6256KiB/23564msec) clat (msec): min=3, max=124, avg=20.69, stdev=19.41 lat (msec): min=3, max=124, avg=20.69, stdev=19.41 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 48], 95.00th=[ 61], | 99.00th=[ 103], 99.50th=[ 122], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 63, max= 832, per=26.16%, avg=264.72, stdev=184.56, samples=46 iops : min= 3, max= 52, avg=16.04, stdev=11.76, samples=46 write: IOPS=15, BW=256KiB/s (262kB/s)(6032KiB/23564msec); 0 zone resets clat (msec): min=14, max=142, avg=40.95, stdev=22.54 lat (msec): min=14, max=142, avg=40.96, stdev=22.54 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 59], 90.00th=[ 73], 95.00th=[ 87], | 99.00th=[ 115], 99.50th=[ 115], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 95, max= 672, per=23.62%, avg=251.28, stdev=134.11, samples=46 iops : min= 5, max= 42, avg=15.22, stdev= 8.56, samples=46 lat (msec) : 4=1.17%, 10=16.93%, 20=21.88%, 50=41.67%, 100=16.80% lat (msec) : 250=1.56% cpu : usr=0.09%, sys=12.48%, ctx=1296, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156835: Fri Jul 25 03:24:54 2025 read: IOPS=15, BW=256KiB/s (262kB/s)(6032KiB/23585msec) clat (usec): min=3059, max=99769, avg=21573.02, stdev=19229.67 lat (usec): min=3060, max=99771, avg=21574.17, stdev=19229.67 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 53], 95.00th=[ 66], | 99.00th=[ 95], 99.50th=[ 100], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 63, max= 734, per=24.66%, avg=249.59, stdev=145.83, samples=46 iops : min= 3, max= 45, avg=15.11, stdev= 9.23, samples=46 write: IOPS=16, BW=265KiB/s (272kB/s)(6256KiB/23585msec); 0 zone resets clat (msec): min=11, max=119, avg=39.26, stdev=21.41 lat (msec): min=11, max=119, avg=39.27, stdev=21.41 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 56], 90.00th=[ 71], 95.00th=[ 84], | 99.00th=[ 111], 99.50th=[ 114], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 95, max= 640, per=24.62%, avg=262.00, stdev=140.39, samples=46 iops : min= 5, max= 40, avg=15.89, stdev= 9.01, samples=46 lat (msec) : 4=2.47%, 10=13.28%, 20=20.57%, 50=45.57%, 100=17.06% lat (msec) : 250=1.04% cpu : usr=0.11%, sys=12.56%, ctx=1334, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1012KiB/s (1036kB/s), 246KiB/s-265KiB/s (251kB/s-272kB/s), io=23.4MiB (24.5MB), run=23389-23667msec WRITE: bw=1065KiB/s (1090kB/s), 256KiB/s-280KiB/s (262kB/s-287kB/s), io=24.6MiB (25.8MB), run=23389-23667msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156845: Fri Jul 25 03:25:05 2025 read: IOPS=1, BW=1910KiB/s (1956kB/s)(7168KiB/3753msec) clat (usec): min=1235, max=491615, avg=254063.92, stdev=160208.85 lat (usec): min=1237, max=491616, avg=254065.55, stdev=160208.81 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1237], 10.00th=[ 1237], 20.00th=[149947], | 30.00th=[202376], 40.00th=[202376], 50.00th=[240124], 60.00th=[308282], | 70.00th=[308282], 80.00th=[383779], 90.00th=[492831], 95.00th=[492831], | 99.00th=[492831], 99.50th=[492831], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 1855, max= 3650, per=58.87%, avg=2325.40, stdev=744.84, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1364KiB/s (1397kB/s)(5120KiB/3753msec); 0 zone resets clat (msec): min=339, max=469, avg=389.62, stdev=54.83 lat (msec): min=339, max=469, avg=389.69, stdev=54.81 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2043, max= 4096, per=49.35%, avg=2729.00, stdev=1183.86, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 2=8.33%, 250=25.00%, 500=66.67% cpu : usr=0.03%, sys=50.91%, ctx=827, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156846: Fri Jul 25 03:25:05 2025 read: IOPS=0, BW=395KiB/s (405kB/s)(2048KiB/5184msec) clat (usec): min=1102, max=122152, avg=61627.40, stdev=85594.72 lat (usec): min=1104, max=122154, avg=61629.32, stdev=85595.27 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1106], 10.00th=[ 1106], 20.00th=[ 1106], | 30.00th=[ 1106], 40.00th=[ 1106], 50.00th=[ 1106], 60.00th=[122160], | 70.00th=[122160], 80.00th=[122160], 90.00th=[122160], 95.00th=[122160], | 99.00th=[122160], 99.50th=[122160], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 1783, max= 2035, per=48.33%, avg=1909.00, stdev=178.19, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1975KiB/s (2023kB/s)(10.0MiB/5184msec); 0 zone resets clat (msec): min=172, max=1145, avg=504.77, stdev=303.13 lat (msec): min=172, max=1145, avg=504.84, stdev=303.13 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 236], | 30.00th=[ 259], 40.00th=[ 384], 50.00th=[ 401], 60.00th=[ 418], | 70.00th=[ 510], 80.00th=[ 693], 90.00th=[ 827], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 2035, max= 4096, per=46.56%, avg=2574.86, stdev=914.13, samples=7 iops : min= 1, max= 4, avg= 2.14, stdev= 1.07, samples=7 lat (msec) : 2=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=38.32%, ctx=350, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156847: Fri Jul 25 03:25:05 2025 read: IOPS=1, BW=1410KiB/s (1444kB/s)(6144KiB/4358msec) clat (usec): min=1277, max=341725, avg=177621.87, stdev=159599.09 lat (usec): min=1278, max=341726, avg=177623.14, stdev=159599.08 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1270], 10.00th=[ 1270], 20.00th=[ 2802], | 30.00th=[ 2802], 40.00th=[112722], 50.00th=[112722], 60.00th=[265290], | 70.00th=[341836], 80.00th=[341836], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 1855, max= 4096, per=63.47%, avg=2507.25, stdev=1062.72, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1410KiB/s (1444kB/s)(6144KiB/4358msec); 0 zone resets clat (msec): min=186, max=1080, avg=543.77, stdev=311.56 lat (msec): min=186, max=1081, avg=543.84, stdev=311.54 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 600], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1793, max= 2048, per=35.63%, avg=1970.33, stdev=115.13, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 2=8.33%, 4=8.33%, 250=16.67%, 500=41.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=40.92%, ctx=595, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156848: Fri Jul 25 03:25:05 2025 read: IOPS=1, BW=1380KiB/s (1413kB/s)(5120KiB/3710msec) clat (usec): min=961, max=382075, avg=152554.25, stdev=207298.21 lat (usec): min=962, max=382077, avg=152555.47, stdev=207298.38 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 963], 10.00th=[ 963], 20.00th=[ 963], | 30.00th=[ 1156], 40.00th=[ 1156], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[375391], 80.00th=[375391], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 2043, max= 6144, per=100.00%, avg=4093.50, stdev=2899.84, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1932KiB/s (1978kB/s)(7168KiB/3710msec); 0 zone resets clat (msec): min=241, max=674, avg=415.59, stdev=155.27 lat (msec): min=241, max=674, avg=415.66, stdev=155.27 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 249], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 447], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 510], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1812, max= 4071, per=42.77%, avg=2365.00, stdev=959.57, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=16.67%, 250=16.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=46.56%, ctx=246, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3951KiB/s (4045kB/s), 395KiB/s-1910KiB/s (405kB/s-1956kB/s), io=20.0MiB (20.0MB), run=3710-5184msec WRITE: bw=5531KiB/s (5664kB/s), 1364KiB/s-1975KiB/s (1397kB/s-2023kB/s), io=28.0MiB (29.4MB), run=3710-5184msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156850: Fri Jul 25 03:25:05 2025 read: IOPS=1, BW=1472KiB/s (1508kB/s)(7168KiB/4868msec) clat (msec): min=107, max=910, avg=435.39, stdev=328.67 lat (msec): min=107, max=910, avg=435.39, stdev=328.67 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 110], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 292], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 735], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1780, max= 3703, per=57.60%, avg=2301.80, stdev=789.72, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1052KiB/s (1077kB/s)(5120KiB/4868msec); 0 zone resets clat (msec): min=221, max=585, avg=343.86, stdev=146.47 lat (msec): min=221, max=585, avg=343.94, stdev=146.47 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1868, max= 4096, per=47.34%, avg=2648.00, stdev=1255.25, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=41.67%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=17.42%, ctx=189, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156851: Fri Jul 25 03:25:05 2025 read: IOPS=0, BW=400KiB/s (409kB/s)(2048KiB/5125msec) clat (msec): min=97, max=735, avg=416.29, stdev=451.07 lat (msec): min=97, max=735, avg=416.30, stdev=451.07 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 97], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1906, max= 2048, per=49.47%, avg=1977.00, stdev=100.41, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1998KiB/s (2046kB/s)(10.0MiB/5125msec); 0 zone resets clat (msec): min=56, max=970, avg=418.47, stdev=276.31 lat (msec): min=56, max=970, avg=418.55, stdev=276.32 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 127], | 30.00th=[ 133], 40.00th=[ 305], 50.00th=[ 447], 60.00th=[ 456], | 70.00th=[ 531], 80.00th=[ 535], 90.00th=[ 625], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1868, max= 4071, per=41.75%, avg=2335.50, stdev=852.63, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 100=16.67%, 250=16.67%, 500=25.00%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=22.54%, ctx=242, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156852: Fri Jul 25 03:25:05 2025 read: IOPS=1, BW=1302KiB/s (1333kB/s)(6144KiB/4720msec) clat (msec): min=114, max=471, avg=212.63, stdev=142.56 lat (msec): min=114, max=471, avg=212.63, stdev=142.56 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 148], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 2035, max= 3703, per=64.95%, avg=2595.33, stdev=959.29, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1302KiB/s (1333kB/s)(6144KiB/4720msec); 0 zone resets clat (msec): min=268, max=885, avg=554.71, stdev=255.44 lat (msec): min=268, max=885, avg=554.81, stdev=255.45 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 575], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1868, max= 2048, per=35.32%, avg=1976.00, stdev=82.82, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=15.34%, ctx=181, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156853: Fri Jul 25 03:25:05 2025 read: IOPS=0, BW=1014KiB/s (1039kB/s)(5120KiB/5047msec) clat (msec): min=68, max=585, avg=230.40, stdev=206.39 lat (msec): min=68, max=585, avg=230.40, stdev=206.39 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1980, max= 4096, per=67.66%, avg=2703.67, stdev=1206.11, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1420KiB/s (1454kB/s)(7168KiB/5047msec); 0 zone resets clat (msec): min=123, max=1246, avg=539.95, stdev=412.20 lat (msec): min=124, max=1246, avg=540.05, stdev=412.20 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 157], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 384], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 810], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1851, max= 3737, per=42.34%, avg=2368.50, stdev=913.86, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=17.88%, ctx=226, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3996KiB/s (4092kB/s), 400KiB/s-1472KiB/s (409kB/s-1508kB/s), io=20.0MiB (20.0MB), run=4720-5125msec WRITE: bw=5595KiB/s (5729kB/s), 1052KiB/s-1998KiB/s (1077kB/s-2046kB/s), io=28.0MiB (29.4MB), run=4720-5125msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=156860: Fri Jul 25 03:25:16 2025 read: IOPS=0, BW=3541KiB/s (3626kB/s)(12.0MiB/3470msec) clat (msec): min=814, max=1824, avg=1152.81, stdev=582.03 lat (msec): min=814, max=1824, avg=1152.82, stdev=582.03 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 7787, max= 8062, per=100.00%, avg=7924.50, stdev=194.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=15.42%, ctx=93, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156861: Fri Jul 25 03:25:16 2025 read: IOPS=0, BW=911KiB/s (932kB/s)(4096KiB/4498msec) clat (nsec): min=418358k, max=418358k, avg=418357848.00, stdev= 0.00 lat (nsec): min=418360k, max=418360k, avg=418360160.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7684, max= 7684, per=100.00%, avg=7684.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1821KiB/s (1865kB/s)(8192KiB/4498msec); 0 zone resets clat (msec): min=381, max=3671, avg=2026.29, stdev=2326.32 lat (msec): min=381, max=3671, avg=2026.67, stdev=2326.36 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 3675], | 70.00th=[ 3675], 80.00th=[ 3675], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=14.57%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156862: Fri Jul 25 03:25:16 2025 write: IOPS=0, BW=3220KiB/s (3297kB/s)(12.0MiB/3816msec); 0 zone resets clat (msec): min=713, max=1734, avg=1262.96, stdev=515.15 lat (msec): min=713, max=1734, avg=1263.21, stdev=515.16 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 7787, max= 8192, per=100.00%, avg=7989.50, stdev=286.38, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=16.57%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156863: Fri Jul 25 03:25:16 2025 write: IOPS=0, BW=4076KiB/s (4173kB/s)(12.0MiB/3015msec); 0 zone resets clat (msec): min=297, max=2168, avg=995.02, stdev=1022.65 lat (msec): min=298, max=2169, avg=995.33, stdev=1022.76 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7713, max= 8062, per=100.00%, avg=7887.50, stdev=246.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=19.64%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3643KiB/s (3730kB/s), 911KiB/s-3541KiB/s (932kB/s-3626kB/s), io=16.0MiB (16.8MB), run=3470-4498msec WRITE: bw=7285KiB/s (7460kB/s), 1821KiB/s-4076KiB/s (1865kB/s-4173kB/s), io=32.0MiB (33.6MB), run=3015-4498msec rand-rw: (groupid=0, jobs=1): err= 0: pid=156864: Fri Jul 25 03:25:16 2025 read: IOPS=1, BW=5608KiB/s (5743kB/s)(12.0MiB/2191msec) clat (msec): min=573, max=812, avg=694.54, stdev=119.43 lat (msec): min=573, max=812, avg=694.54, stdev=119.43 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 5641, max= 8031, per=100.00%, avg=6836.00, stdev=1689.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=56.67%, ctx=2018, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156865: Fri Jul 25 03:25:16 2025 read: IOPS=0, BW=1009KiB/s (1033kB/s)(4096KiB/4059msec) clat (nsec): min=675276k, max=675276k, avg=675275630.00, stdev= 0.00 lat (nsec): min=675278k, max=675278k, avg=675278366.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 5785, max= 5785, per=100.00%, avg=5785.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2018KiB/s (2067kB/s)(8192KiB/4059msec); 0 zone resets clat (msec): min=1030, max=2333, avg=1682.36, stdev=921.17 lat (msec): min=1031, max=2334, avg=1682.80, stdev=921.47 clat percentiles (msec): | 1.00th=[ 1028], 5.00th=[ 1028], 10.00th=[ 1028], 20.00th=[ 1028], | 30.00th=[ 1028], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 2333], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=30.56%, ctx=529, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156866: Fri Jul 25 03:25:16 2025 write: IOPS=0, BW=2754KiB/s (2820kB/s)(12.0MiB/4462msec); 0 zone resets clat (msec): min=787, max=2385, avg=1465.80, stdev=825.94 lat (msec): min=788, max=2385, avg=1466.09, stdev=825.83 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 7742, max= 8192, per=100.00%, avg=7967.00, stdev=318.20, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=38.13%, ctx=236, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=156867: Fri Jul 25 03:25:16 2025 write: IOPS=0, BW=3159KiB/s (3235kB/s)(12.0MiB/3890msec); 0 zone resets clat (msec): min=677, max=1763, avg=1266.82, stdev=548.91 lat (msec): min=678, max=1764, avg=1267.08, stdev=548.91 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=52.84%, ctx=138, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4036KiB/s (4133kB/s), 1009KiB/s-5608KiB/s (1033kB/s-5743kB/s), io=16.0MiB (16.8MB), run=2191-4059msec WRITE: bw=7344KiB/s (7520kB/s), 2018KiB/s-3159KiB/s (2067kB/s-3235kB/s), io=32.0MiB (33.6MB), run=3890-4462msec