== sanity test 398b: DIO and buffer IO race ============== 10:25:17 (1783952717) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.48875 s, 9.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179224: Mon Jul 13 10:27:23 2026 read: IOPS=14, BW=56.7KiB/s (58.1kB/s)(5992KiB/105689msec) clat (usec): min=33, max=964445, avg=39476.00, stdev=34116.32 lat (usec): min=33, max=964446, avg=39478.33, stdev=34115.64 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10683], 10.00th=[ 15401], 20.00th=[ 20579], | 30.00th=[ 25035], 40.00th=[ 29492], 50.00th=[ 34341], 60.00th=[ 39584], | 70.00th=[ 46400], 80.00th=[ 53740], 90.00th=[ 68682], 95.00th=[ 85459], | 99.00th=[123208], 99.50th=[145753], 99.90th=[250610], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 6, max= 125, per=25.01%, avg=56.51, stdev=19.98, samples=208 iops : min= 1, max= 31, avg=13.50, stdev= 5.05, samples=208 write: IOPS=14, BW=59.6KiB/s (61.0kB/s)(6296KiB/105689msec); 0 zone resets clat (usec): min=662, max=247939, avg=29336.28, stdev=29475.76 lat (usec): min=662, max=247941, avg=29338.44, stdev=29475.54 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1319], 10.00th=[ 1467], 20.00th=[ 3195], | 30.00th=[ 6063], 40.00th=[ 14222], 50.00th=[ 22152], 60.00th=[ 29230], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[124257], 99.50th=[139461], 99.90th=[177210], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 15, max= 151, per=25.16%, avg=59.64, stdev=26.06, samples=207 iops : min= 3, max= 37, avg=14.28, stdev= 6.54, samples=207 lat (usec) : 50=0.26%, 100=1.63%, 250=0.07%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.46% lat (msec) : 2=6.80%, 4=4.52%, 10=6.80%, 20=13.02%, 50=43.78% lat (msec) : 100=19.89%, 250=2.60%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.58%, ctx=6556, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179226: Mon Jul 13 10:27:23 2026 read: IOPS=14, BW=56.4KiB/s (57.8kB/s)(5940KiB/105292msec) clat (usec): min=36, max=1035.6k, avg=39429.27, stdev=35493.06 lat (usec): min=37, max=1035.6k, avg=39435.89, stdev=35495.49 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11338], 10.00th=[ 15795], | 20.00th=[ 20579], 30.00th=[ 24511], 40.00th=[ 28967], | 50.00th=[ 33817], 60.00th=[ 39060], 70.00th=[ 45876], | 80.00th=[ 54789], 90.00th=[ 66323], 95.00th=[ 82314], | 99.00th=[ 125305], 99.50th=[ 154141], 99.90th=[ 214959], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 119, per=25.00%, avg=56.49, stdev=20.18, samples=206 iops : min= 1, max= 29, avg=13.49, stdev= 5.06, samples=206 write: IOPS=15, BW=60.3KiB/s (61.7kB/s)(6348KiB/105292msec); 0 zone resets clat (usec): min=789, max=181990, avg=29202.09, stdev=30118.64 lat (usec): min=790, max=181991, avg=29204.08, stdev=30119.61 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1319], 10.00th=[ 1500], 20.00th=[ 3294], | 30.00th=[ 6456], 40.00th=[ 13829], 50.00th=[ 20841], 60.00th=[ 28181], | 70.00th=[ 36963], 80.00th=[ 49546], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[135267], 99.50th=[147850], 99.90th=[175113], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 15, max= 167, per=25.53%, avg=60.50, stdev=24.33, samples=206 iops : min= 3, max= 41, avg=14.49, stdev= 6.10, samples=206 lat (usec) : 50=0.33%, 100=1.30%, 250=0.03%, 1000=0.39% lat (msec) : 2=6.05%, 4=5.44%, 10=7.16%, 20=13.64%, 50=42.81% lat (msec) : 100=19.92%, 250=2.90%, 2000=0.03% cpu : usr=0.08%, sys=5.60%, ctx=6550, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179228: Mon Jul 13 10:27:23 2026 read: IOPS=14, BW=56.0KiB/s (58.3kB/s)(6028KiB/105845msec) clat (usec): min=27, max=221319, avg=37876.53, stdev=24103.22 lat (usec): min=27, max=221321, avg=37880.73, stdev=24105.05 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9896], 10.00th=[ 15401], 20.00th=[ 20055], | 30.00th=[ 24511], 40.00th=[ 28967], 50.00th=[ 33162], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 52167], 90.00th=[ 66847], 95.00th=[ 81265], | 99.00th=[124257], 99.50th=[139461], 99.90th=[183501], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 7, max= 124, per=25.19%, avg=56.92, stdev=22.40, samples=207 iops : min= 1, max= 31, avg=13.60, stdev= 5.66, samples=207 write: IOPS=14, BW=59.1KiB/s (60.6kB/s)(6260KiB/105845msec); 0 zone resets clat (usec): min=701, max=1118.7k, avg=30928.86, stdev=41963.51 lat (usec): min=701, max=1118.7k, avg=30932.08, stdev=41962.33 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1303], 10.00th=[ 1500], | 20.00th=[ 3490], 30.00th=[ 6718], 40.00th=[ 13829], | 50.00th=[ 22152], 60.00th=[ 29492], 70.00th=[ 39060], | 80.00th=[ 51119], 90.00th=[ 70779], 95.00th=[ 92799], | 99.00th=[ 141558], 99.50th=[ 162530], 99.90th=[ 263193], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 15, max= 127, per=24.97%, avg=59.17, stdev=20.79, samples=207 iops : min= 3, max= 31, avg=14.16, stdev= 5.23, samples=207 lat (usec) : 50=0.46%, 100=1.40%, 250=0.13%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.42% lat (msec) : 2=6.54%, 4=4.36%, 10=7.13%, 20=13.12%, 50=44.66% lat (msec) : 100=18.46%, 250=3.06%, 500=0.07%, 2000=0.03% cpu : usr=0.09%, sys=5.51%, ctx=6532, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179229: Mon Jul 13 10:27:23 2026 read: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6052KiB/106005msec) clat (usec): min=34, max=1020.8k, avg=39442.38, stdev=35527.72 lat (usec): min=34, max=1020.8k, avg=39444.15, stdev=35527.44 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10159], 10.00th=[ 15270], | 20.00th=[ 20317], 30.00th=[ 25035], 40.00th=[ 29492], | 50.00th=[ 34341], 60.00th=[ 39584], 70.00th=[ 45351], | 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[ 126354], 99.50th=[ 175113], 99.90th=[ 229639], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 127, per=25.23%, avg=57.03, stdev=19.17, samples=207 iops : min= 1, max= 31, avg=13.63, stdev= 4.85, samples=207 write: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6236KiB/106005msec); 0 zone resets clat (usec): min=832, max=187962, avg=29464.19, stdev=28801.36 lat (usec): min=832, max=187964, avg=29466.20, stdev=28801.40 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1500], 20.00th=[ 3458], | 30.00th=[ 7308], 40.00th=[ 15139], 50.00th=[ 22676], 60.00th=[ 29492], | 70.00th=[ 38011], 80.00th=[ 51119], 90.00th=[ 68682], 95.00th=[ 86508], | 99.00th=[126354], 99.50th=[135267], 99.90th=[149947], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7, max= 135, per=24.65%, avg=58.41, stdev=22.66, samples=208 iops : min= 1, max= 33, avg=13.98, stdev= 5.72, samples=208 lat (usec) : 50=0.39%, 100=1.73%, 250=0.07%, 500=0.03%, 1000=0.16% lat (msec) : 2=7.00%, 4=4.10%, 10=5.96%, 20=13.35%, 50=44.60% lat (msec) : 100=19.89%, 250=2.70%, 2000=0.03% cpu : usr=0.08%, sys=5.68%, ctx=6572, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=227KiB/s (232kB/s), 56.4KiB/s-57.1KiB/s (57.8kB/s-58.5kB/s), io=23.4MiB (24.6MB), run=105292-106005msec WRITE: bw=237KiB/s (243kB/s), 58.8KiB/s-60.3KiB/s (60.2kB/s-61.7kB/s), io=24.6MiB (25.7MB), run=105292-106005msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179225: Mon Jul 13 10:28:00 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(5992KiB/143608msec) clat (msec): min=4, max=1031, avg=38.26, stdev=39.39 lat (msec): min=4, max=1031, avg=38.26, stdev=39.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 104], | 99.00th=[ 144], 99.50th=[ 150], 99.90th=[ 182], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 166, per=25.11%, avg=41.94, stdev=26.92, samples=279 iops : min= 1, max= 41, avg= 9.82, stdev= 6.77, samples=279 write: IOPS=10, BW=43.8KiB/s (44.9kB/s)(6296KiB/143608msec); 0 zone resets clat (msec): min=9, max=280, avg=54.63, stdev=37.48 lat (msec): min=9, max=280, avg=54.64, stdev=37.48 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 106], 95.00th=[ 127], | 99.00th=[ 190], 99.50th=[ 213], 99.90th=[ 255], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 135, per=25.03%, avg=43.56, stdev=25.30, samples=282 iops : min= 1, max= 33, avg=10.23, stdev= 6.36, samples=282 lat (msec) : 10=2.96%, 20=17.15%, 50=47.53%, 100=23.60%, 250=8.63% lat (msec) : 500=0.10%, 2000=0.03% cpu : usr=0.06%, sys=2.25%, ctx=4968, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179227: Mon Jul 13 10:28:00 2026 read: IOPS=10, BW=41.4KiB/s (42.4kB/s)(5940KiB/143407msec) clat (msec): min=4, max=1046, avg=36.94, stdev=40.52 lat (msec): min=4, max=1046, avg=36.95, stdev=40.52 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 106], | 99.00th=[ 146], 99.50th=[ 176], 99.90th=[ 249], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 175, per=25.30%, avg=42.25, stdev=27.86, samples=274 iops : min= 1, max= 43, avg= 9.91, stdev= 7.00, samples=274 write: IOPS=11, BW=44.3KiB/s (45.3kB/s)(6348KiB/143407msec); 0 zone resets clat (msec): min=9, max=289, avg=55.59, stdev=36.95 lat (msec): min=9, max=289, avg=55.60, stdev=36.96 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 80], 90.00th=[ 105], 95.00th=[ 129], | 99.00th=[ 192], 99.50th=[ 222], 99.90th=[ 257], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 143, per=25.32%, avg=44.05, stdev=25.27, samples=281 iops : min= 1, max= 35, avg=10.35, stdev= 6.35, samples=281 lat (msec) : 10=3.71%, 20=18.33%, 50=44.01%, 100=25.20%, 250=8.59% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.07%, sys=2.28%, ctx=4872, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179230: Mon Jul 13 10:28:00 2026 read: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6028KiB/143745msec) clat (msec): min=5, max=238, avg=38.11, stdev=32.44 lat (msec): min=5, max=238, avg=38.11, stdev=32.44 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 109], | 99.00th=[ 150], 99.50th=[ 169], 99.90th=[ 232], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7, max= 158, per=25.08%, avg=41.88, stdev=26.46, samples=280 iops : min= 1, max= 39, avg= 9.80, stdev= 6.64, samples=280 write: IOPS=10, BW=43.5KiB/s (44.6kB/s)(6260KiB/143745msec); 0 zone resets clat (msec): min=9, max=1077, avg=54.96, stdev=45.15 lat (msec): min=9, max=1077, avg=54.97, stdev=45.16 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 78], 90.00th=[ 106], 95.00th=[ 130], | 99.00th=[ 186], 99.50th=[ 211], 99.90th=[ 300], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 135, per=24.90%, avg=43.32, stdev=26.81, samples=281 iops : min= 1, max= 33, avg=10.17, stdev= 6.74, samples=281 lat (msec) : 10=3.68%, 20=18.68%, 50=44.47%, 100=24.25%, 250=8.85% lat (msec) : 500=0.03%, 2000=0.03% cpu : usr=0.06%, sys=2.09%, ctx=4829, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179231: Mon Jul 13 10:28:00 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6052KiB/141813msec) clat (msec): min=5, max=265, avg=38.32, stdev=33.09 lat (msec): min=5, max=265, avg=38.32, stdev=33.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 163], 99.50th=[ 178], 99.90th=[ 236], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 7, max= 159, per=25.75%, avg=43.00, stdev=26.92, samples=274 iops : min= 1, max= 39, avg=10.09, stdev= 6.76, samples=274 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6236KiB/141813msec); 0 zone resets clat (msec): min=5, max=1046, avg=53.62, stdev=43.23 lat (msec): min=5, max=1046, avg=53.63, stdev=43.22 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 78], 90.00th=[ 100], 95.00th=[ 121], | 99.00th=[ 176], 99.50th=[ 224], 99.90th=[ 284], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 143, per=25.24%, avg=43.91, stdev=25.66, samples=276 iops : min= 1, max= 35, avg=10.32, stdev= 6.45, samples=276 lat (msec) : 10=3.29%, 20=17.68%, 50=47.14%, 100=23.80%, 250=7.98% lat (msec) : 500=0.10%, 2000=0.03% cpu : usr=0.06%, sys=2.31%, ctx=4969, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=167KiB/s (171kB/s), 41.4KiB/s-42.7KiB/s (42.4kB/s-43.7kB/s), io=23.4MiB (24.6MB), run=141813-143745msec WRITE: bw=175KiB/s (179kB/s), 43.5KiB/s-44.3KiB/s (44.6kB/s-45.3kB/s), io=24.6MiB (25.7MB), run=141813-143745msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179272: Mon Jul 13 10:28:37 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(5920KiB/26953msec) clat (usec): min=27, max=272859, avg=38010.56, stdev=28813.52 lat (usec): min=27, max=272860, avg=38014.40, stdev=28813.13 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 515], 20.00th=[ 18482], | 30.00th=[ 23987], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 45876], 80.00th=[ 53216], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[139461], 99.50th=[156238], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 63, max= 478, per=24.51%, avg=217.65, stdev=87.39, samples=52 iops : min= 3, max= 29, avg=12.77, stdev= 5.49, samples=52 write: IOPS=14, BW=236KiB/s (242kB/s)(6368KiB/26953msec); 0 zone resets clat (usec): min=1094, max=220579, avg=31792.25, stdev=30213.69 lat (usec): min=1096, max=220580, avg=31794.09, stdev=30213.73 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 2073], 10.00th=[ 3097], 20.00th=[ 5473], | 30.00th=[ 9372], 40.00th=[ 17433], 50.00th=[ 23987], 60.00th=[ 32113], | 70.00th=[ 40633], 80.00th=[ 55313], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[149947], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 414, per=25.46%, avg=237.77, stdev=96.54, samples=52 iops : min= 1, max= 25, avg=14.04, stdev= 6.09, samples=52 lat (usec) : 50=1.04%, 100=3.52%, 250=0.13%, 750=0.13% lat (msec) : 2=2.08%, 4=4.82%, 10=9.77%, 20=11.59%, 50=42.58% lat (msec) : 100=21.35%, 250=2.86%, 500=0.13% cpu : usr=0.07%, sys=6.35%, ctx=1740, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179273: Mon Jul 13 10:28:37 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(5744KiB/26812msec) clat (usec): min=44, max=169723, avg=38495.41, stdev=24745.67 lat (usec): min=46, max=169724, avg=38496.71, stdev=24745.63 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 14091], 20.00th=[ 21103], | 30.00th=[ 25035], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 40633], | 70.00th=[ 46400], 80.00th=[ 56361], 90.00th=[ 66323], 95.00th=[ 80217], | 99.00th=[117965], 99.50th=[168821], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 32, max= 446, per=24.43%, avg=216.98, stdev=79.69, samples=52 iops : min= 2, max= 27, avg=12.85, stdev= 4.99, samples=52 write: IOPS=15, BW=244KiB/s (250kB/s)(6544KiB/26812msec); 0 zone resets clat (usec): min=1298, max=194264, avg=30858.53, stdev=31184.90 lat (usec): min=1299, max=194267, avg=30860.60, stdev=31184.98 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1958], 10.00th=[ 2802], 20.00th=[ 5407], | 30.00th=[ 8291], 40.00th=[ 15533], 50.00th=[ 21365], 60.00th=[ 28181], | 70.00th=[ 40109], 80.00th=[ 51643], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[123208], 99.50th=[166724], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 62, max= 704, per=26.07%, avg=243.51, stdev=112.29, samples=53 iops : min= 3, max= 44, avg=14.51, stdev= 7.06, samples=53 lat (usec) : 50=0.39%, 100=3.52%, 250=0.13% lat (msec) : 2=3.26%, 4=4.82%, 10=9.51%, 20=12.24%, 50=42.45% lat (msec) : 100=20.31%, 250=3.39% cpu : usr=0.07%, sys=6.32%, ctx=1752, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179275: Mon Jul 13 10:28:37 2026 read: IOPS=15, BW=241KiB/s (246kB/s)(6256KiB/26000msec) clat (usec): min=41, max=183116, avg=38260.19, stdev=24395.85 lat (usec): min=42, max=183117, avg=38261.39, stdev=24395.83 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 11076], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 39584], | 70.00th=[ 45351], 80.00th=[ 54264], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[113771], 99.50th=[133694], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 414, per=27.18%, avg=241.35, stdev=73.81, samples=51 iops : min= 3, max= 25, avg=14.27, stdev= 4.67, samples=51 write: IOPS=14, BW=232KiB/s (238kB/s)(6032KiB/26000msec); 0 zone resets clat (usec): min=1240, max=217759, avg=28945.52, stdev=28905.15 lat (usec): min=1241, max=217761, avg=28947.52, stdev=28905.15 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1958], 10.00th=[ 2540], 20.00th=[ 4817], | 30.00th=[ 7963], 40.00th=[ 13435], 50.00th=[ 21627], 60.00th=[ 28443], | 70.00th=[ 36963], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[123208], 99.50th=[168821], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 447, per=24.83%, avg=231.94, stdev=91.14, samples=51 iops : min= 1, max= 27, avg=13.67, stdev= 5.72, samples=51 lat (usec) : 50=0.26%, 100=4.30%, 250=0.26%, 1000=0.26% lat (msec) : 2=2.60%, 4=5.47%, 10=9.11%, 20=8.98%, 50=46.48% lat (msec) : 100=20.18%, 250=2.08% cpu : usr=0.08%, sys=6.08%, ctx=1725, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179277: Mon Jul 13 10:28:37 2026 read: IOPS=14, BW=234KiB/s (239kB/s)(6032KiB/25818msec) clat (usec): min=37, max=154993, avg=35139.51, stdev=25875.65 lat (usec): min=39, max=154995, avg=35140.70, stdev=25875.64 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 17695], | 30.00th=[ 22676], 40.00th=[ 27657], 50.00th=[ 32375], 60.00th=[ 36963], | 70.00th=[ 41681], 80.00th=[ 50594], 90.00th=[ 63177], 95.00th=[ 81265], | 99.00th=[139461], 99.50th=[147850], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 21, max= 415, per=26.30%, avg=233.58, stdev=83.01, samples=50 iops : min= 1, max= 25, avg=13.78, stdev= 5.18, samples=50 write: IOPS=15, BW=242KiB/s (248kB/s)(6256KiB/25818msec); 0 zone resets clat (usec): min=1351, max=167902, avg=31364.45, stdev=31322.08 lat (usec): min=1353, max=167904, avg=31368.19, stdev=31323.93 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2057], 10.00th=[ 2868], 20.00th=[ 5014], | 30.00th=[ 8455], 40.00th=[ 14877], 50.00th=[ 20579], 60.00th=[ 30540], | 70.00th=[ 39060], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 98042], | 99.00th=[132645], 99.50th=[156238], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 85, max= 444, per=25.88%, avg=241.72, stdev=90.24, samples=50 iops : min= 5, max= 27, avg=14.30, stdev= 5.71, samples=50 lat (usec) : 50=0.52%, 100=5.47%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=2.47%, 4=5.86%, 10=8.59%, 20=12.89%, 50=41.28% lat (msec) : 100=18.23%, 250=3.78% cpu : usr=0.08%, sys=6.70%, ctx=1714, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=889KiB/s (910kB/s), 214KiB/s-241KiB/s (219kB/s-246kB/s), io=23.4MiB (24.5MB), run=25818-26953msec WRITE: bw=935KiB/s (957kB/s), 232KiB/s-244KiB/s (238kB/s-250kB/s), io=24.6MiB (25.8MB), run=25818-26953msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179274: Mon Jul 13 10:28:46 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(5920KiB/35896msec) clat (msec): min=6, max=222, avg=37.10, stdev=32.01 lat (msec): min=6, max=222, avg=37.10, stdev=32.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 96], | 99.00th=[ 161], 99.50th=[ 188], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 30, max= 539, per=24.70%, avg=164.23, stdev=109.01, samples=71 iops : min= 1, max= 33, avg= 9.46, stdev= 6.87, samples=71 write: IOPS=11, BW=177KiB/s (182kB/s)(6368KiB/35896msec); 0 zone resets clat (msec): min=12, max=208, avg=55.14, stdev=37.26 lat (msec): min=12, max=208, avg=55.14, stdev=37.26 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 130], | 99.00th=[ 178], 99.50th=[ 199], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 30, max= 512, per=25.26%, avg=176.82, stdev=110.56, samples=71 iops : min= 1, max= 32, avg=10.25, stdev= 7.00, samples=71 lat (msec) : 10=3.39%, 20=18.49%, 50=45.44%, 100=23.31%, 250=9.38% cpu : usr=0.07%, sys=2.41%, ctx=1272, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179276: Mon Jul 13 10:28:46 2026 read: IOPS=9, BW=160KiB/s (164kB/s)(5744KiB/35971msec) clat (msec): min=6, max=201, avg=36.69, stdev=31.22 lat (msec): min=6, max=201, avg=36.69, stdev=31.22 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 55], 90.00th=[ 86], 95.00th=[ 108], | 99.00th=[ 150], 99.50th=[ 159], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 30, max= 510, per=24.50%, avg=162.91, stdev=104.51, samples=69 iops : min= 1, max= 31, avg= 9.39, stdev= 6.61, samples=69 write: IOPS=11, BW=182KiB/s (186kB/s)(6544KiB/35971msec); 0 zone resets clat (msec): min=12, max=268, avg=55.57, stdev=38.95 lat (msec): min=12, max=268, avg=55.57, stdev=38.95 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 108], 95.00th=[ 134], | 99.00th=[ 194], 99.50th=[ 241], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 576, per=25.84%, avg=180.86, stdev=113.85, samples=71 iops : min= 1, max= 36, avg=10.51, stdev= 7.20, samples=71 lat (msec) : 10=2.73%, 20=19.53%, 50=45.05%, 100=23.57%, 250=8.98% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=2.30%, ctx=1256, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179278: Mon Jul 13 10:28:46 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(6256KiB/34418msec) clat (msec): min=4, max=209, avg=35.35, stdev=28.87 lat (msec): min=4, max=209, avg=35.35, stdev=28.87 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 146], 99.50th=[ 157], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 30, max= 670, per=27.83%, avg=185.09, stdev=125.60, samples=67 iops : min= 1, max= 41, avg=10.78, stdev= 7.92, samples=67 write: IOPS=10, BW=175KiB/s (179kB/s)(6032KiB/34418msec); 0 zone resets clat (msec): min=13, max=241, avg=53.91, stdev=36.04 lat (msec): min=13, max=241, avg=53.91, stdev=36.04 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 102], 95.00th=[ 124], | 99.00th=[ 188], 99.50th=[ 234], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 62, max= 479, per=24.82%, avg=173.74, stdev=99.70, samples=68 iops : min= 3, max= 29, avg=10.07, stdev= 6.32, samples=68 lat (msec) : 10=2.73%, 20=19.27%, 50=46.61%, 100=23.96%, 250=7.42% cpu : usr=0.07%, sys=2.38%, ctx=1167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179279: Mon Jul 13 10:28:46 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(6032KiB/35440msec) clat (msec): min=5, max=206, avg=38.15, stdev=31.98 lat (msec): min=5, max=206, avg=38.15, stdev=31.98 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 103], | 99.00th=[ 153], 99.50th=[ 174], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 512, per=25.78%, avg=171.42, stdev=105.63, samples=69 iops : min= 1, max= 32, avg= 9.91, stdev= 6.70, samples=69 write: IOPS=11, BW=177KiB/s (181kB/s)(6256KiB/35440msec); 0 zone resets clat (msec): min=10, max=268, avg=53.05, stdev=34.53 lat (msec): min=10, max=268, avg=53.06, stdev=34.53 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 64], 80.00th=[ 78], 90.00th=[ 97], 95.00th=[ 117], | 99.00th=[ 171], 99.50th=[ 201], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 510, per=25.16%, avg=176.13, stdev=106.61, samples=70 iops : min= 1, max= 31, avg=10.21, stdev= 6.74, samples=70 lat (msec) : 10=2.21%, 20=19.66%, 50=45.57%, 100=24.74%, 250=7.68% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.43%, ctx=1244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=666KiB/s (682kB/s), 160KiB/s-182KiB/s (164kB/s-186kB/s), io=23.4MiB (24.5MB), run=34418-35971msec WRITE: bw=701KiB/s (717kB/s), 175KiB/s-182KiB/s (179kB/s-186kB/s), io=24.6MiB (25.8MB), run=34418-35971msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179290: Mon Jul 13 10:29:00 2026 read: IOPS=2, BW=2768KiB/s (2834kB/s)(7168KiB/2590msec) clat (usec): min=455, max=259252, avg=139439.49, stdev=78569.80 lat (usec): min=457, max=259255, avg=139441.21, stdev=78569.91 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[121111], | 30.00th=[126354], 40.00th=[126354], 50.00th=[137364], 60.00th=[139461], | 70.00th=[139461], 80.00th=[191890], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 2027, max= 4196, per=62.32%, avg=3291.00, stdev=1128.18, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1977KiB/s (2024kB/s)(5120KiB/2590msec); 0 zone resets clat (msec): min=141, max=518, avg=310.61, stdev=151.81 lat (msec): min=141, max=518, avg=310.67, stdev=151.82 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1825, max= 4055, per=35.65%, avg=2635.67, stdev=1233.32, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=15.10%, ctx=209, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179292: Mon Jul 13 10:29:00 2026 read: IOPS=0, BW=528KiB/s (541kB/s)(2048KiB/3878msec) clat (msec): min=191, max=425, avg=308.39, stdev=165.24 lat (msec): min=191, max=425, avg=308.39, stdev=165.24 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1408, max= 2027, per=32.52%, avg=1717.50, stdev=437.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2641KiB/s (2704kB/s)(10.0MiB/3878msec); 0 zone resets clat (msec): min=65, max=688, avg=307.84, stdev=182.78 lat (msec): min=65, max=688, avg=307.96, stdev=182.80 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 176], | 30.00th=[ 178], 40.00th=[ 186], 50.00th=[ 251], 60.00th=[ 334], | 70.00th=[ 347], 80.00th=[ 351], 90.00th=[ 506], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2007, max= 7301, per=47.23%, avg=3491.40, stdev=2309.59, samples=5 iops : min= 1, max= 7, avg= 2.60, stdev= 2.61, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=13.36%, ctx=195, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179294: Mon Jul 13 10:29:00 2026 read: IOPS=1, BW=1830KiB/s (1874kB/s)(6144KiB/3358msec) clat (usec): min=1584, max=233991, avg=150060.41, stdev=80376.98 lat (usec): min=1585, max=233993, avg=150061.84, stdev=80377.23 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1582], 10.00th=[ 1582], 20.00th=[143655], | 30.00th=[143655], 40.00th=[156238], 50.00th=[156238], 60.00th=[160433], | 70.00th=[204473], 80.00th=[204473], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 4015, max= 6083, per=95.61%, avg=5049.00, stdev=1462.30, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1830KiB/s (1874kB/s)(6144KiB/3358msec); 0 zone resets clat (msec): min=126, max=1007, avg=378.42, stdev=339.56 lat (msec): min=126, max=1007, avg=378.49, stdev=339.56 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 393], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1458, max= 2035, per=25.65%, avg=1896.50, stdev=229.28, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 2=8.33%, 250=66.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=11.56%, ctx=203, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179296: Mon Jul 13 10:29:00 2026 read: IOPS=2, BW=2431KiB/s (2489kB/s)(5120KiB/2106msec) clat (usec): min=469, max=184607, avg=60949.51, stdev=84593.88 lat (usec): min=469, max=184609, avg=60950.78, stdev=84594.20 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 469], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 4686], 60.00th=[ 4686], | 70.00th=[114820], 80.00th=[114820], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 7301, max= 7301, per=100.00%, avg=7301.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3404KiB/s (3485kB/s)(7168KiB/2106msec); 0 zone resets clat (msec): min=95, max=469, avg=242.64, stdev=122.50 lat (msec): min=95, max=469, avg=242.83, stdev=122.42 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 159], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 222], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 330], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1542, max= 5475, per=40.78%, avg=3014.67, stdev=2144.47, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 100=8.33%, 250=50.00%, 500=16.67% cpu : usr=0.00%, sys=20.14%, ctx=145, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5281KiB/s (5408kB/s), 528KiB/s-2768KiB/s (541kB/s-2834kB/s), io=20.0MiB (20.0MB), run=2106-3878msec WRITE: bw=7394KiB/s (7571kB/s), 1830KiB/s-3404KiB/s (1874kB/s-3485kB/s), io=28.0MiB (29.4MB), run=2106-3878msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179291: Mon Jul 13 10:29:00 2026 read: IOPS=1, BW=1931KiB/s (1977kB/s)(7168KiB/3713msec) clat (msec): min=94, max=900, avg=339.18, stdev=294.88 lat (msec): min=94, max=900, avg=339.18, stdev=294.88 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 138], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 523], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1861, max= 4079, per=47.45%, avg=2387.00, stdev=947.85, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1379KiB/s (1412kB/s)(5120KiB/3713msec); 0 zone resets clat (msec): min=60, max=508, avg=218.41, stdev=179.96 lat (msec): min=60, max=508, avg=218.58, stdev=179.92 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 144], 60.00th=[ 144], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2023, max= 5965, per=47.43%, avg=3341.00, stdev=2272.46, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=3.48%, ctx=66, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179293: Mon Jul 13 10:29:00 2026 read: IOPS=0, BW=503KiB/s (515kB/s)(2048KiB/4070msec) clat (msec): min=204, max=443, avg=324.06, stdev=169.48 lat (msec): min=204, max=443, avg=324.06, stdev=169.48 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 2039, max= 2043, per=40.57%, avg=2041.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2516KiB/s (2576kB/s)(10.0MiB/4070msec); 0 zone resets clat (msec): min=50, max=688, avg=325.08, stdev=193.46 lat (msec): min=50, max=689, avg=325.28, stdev=193.69 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 133], | 30.00th=[ 155], 40.00th=[ 218], 50.00th=[ 284], 60.00th=[ 393], | 70.00th=[ 409], 80.00th=[ 439], 90.00th=[ 485], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1988, max= 5953, per=39.86%, avg=2807.60, stdev=1758.45, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=4.99%, ctx=164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179295: Mon Jul 13 10:29:00 2026 read: IOPS=1, BW=1654KiB/s (1694kB/s)(6144KiB/3715msec) clat (msec): min=88, max=189, avg=128.26, stdev=38.18 lat (msec): min=88, max=189, avg=128.26, stdev=38.18 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 130], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 2035, max= 4079, per=66.85%, avg=3363.33, stdev=1151.52, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1654KiB/s (1694kB/s)(6144KiB/3715msec); 0 zone resets clat (msec): min=171, max=986, avg=440.94, stdev=299.98 lat (msec): min=171, max=986, avg=441.46, stdev=299.97 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 477], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1984, max= 4071, per=34.43%, avg=2425.00, stdev=920.55, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=5.95%, ctx=92, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179297: Mon Jul 13 10:29:00 2026 read: IOPS=1, BW=1330KiB/s (1361kB/s)(5120KiB/3851msec) clat (msec): min=48, max=317, avg=164.76, stdev=131.09 lat (msec): min=48, max=317, avg=164.76, stdev=131.09 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 93], 60.00th=[ 93], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 3976, max= 4079, per=80.05%, avg=4027.50, stdev=72.83, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1861KiB/s (1906kB/s)(7168KiB/3851msec); 0 zone resets clat (msec): min=144, max=991, avg=393.60, stdev=307.82 lat (msec): min=144, max=991, avg=393.68, stdev=307.82 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 197], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 288], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 625], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1774, max= 4047, per=34.76%, avg=2448.25, stdev=1070.51, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=4.52%, ctx=131, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5032KiB/s (5153kB/s), 503KiB/s-1931KiB/s (515kB/s-1977kB/s), io=20.0MiB (20.0MB), run=3713-4070msec WRITE: bw=7045KiB/s (7214kB/s), 1379KiB/s-2516KiB/s (1412kB/s-2576kB/s), io=28.0MiB (29.4MB), run=3713-4070msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179304: Mon Jul 13 10:29:17 2026 read: IOPS=0, BW=2218KiB/s (2271kB/s)(12.0MiB/5541msec) clat (msec): min=726, max=3989, avg=1836.42, stdev=1865.17 lat (msec): min=726, max=3989, avg=1836.42, stdev=1865.17 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min= 7984, max= 8062, per=100.00%, avg=8023.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.32%, ctx=45, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179305: Mon Jul 13 10:29:17 2026 read: IOPS=0, BW=3973KiB/s (4068kB/s)(4096KiB/1031msec) clat (nsec): min=198010k, max=198010k, avg=198009912.00, stdev= 0.00 lat (nsec): min=198012k, max=198012k, avg=198011522.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 199], 90.00th=[ 199], 95.00th=[ 199], | 99.00th=[ 199], 99.50th=[ 199], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 7288, max= 7288, per=100.00%, avg=7288.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=7946KiB/s (8136kB/s)(8192KiB/1031msec); 0 zone resets clat (msec): min=260, max=490, avg=375.61, stdev=162.25 lat (msec): min=261, max=490, avg=375.99, stdev=162.35 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=10.49%, ctx=49, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179306: Mon Jul 13 10:29:17 2026 write: IOPS=0, BW=2530KiB/s (2591kB/s)(12.0MiB/4856msec); 0 zone resets clat (msec): min=473, max=3285, avg=1540.76, stdev=1523.81 lat (msec): min=473, max=3286, avg=1541.02, stdev=1523.83 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.47%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179307: Mon Jul 13 10:29:17 2026 write: IOPS=0, BW=2647KiB/s (2711kB/s)(12.0MiB/4642msec); 0 zone resets clat (msec): min=290, max=3962, avg=1516.03, stdev=2118.33 lat (msec): min=291, max=3962, avg=1516.38, stdev=2118.28 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 3977], 80.00th=[ 3977], 90.00th=[ 3977], 95.00th=[ 3977], | 99.00th=[ 3977], 99.50th=[ 3977], 99.90th=[ 3977], 99.95th=[ 3977], | 99.99th=[ 3977] bw ( KiB/s): min=11603, max=11603, per=100.00%, avg=11603.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.96%, ctx=32, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2957KiB/s (3028kB/s), 2218KiB/s-3973KiB/s (2271kB/s-4068kB/s), io=16.0MiB (16.8MB), run=1031-5541msec WRITE: bw=6748KiB/s (6910kB/s), 2530KiB/s-7946KiB/s (2591kB/s-8136kB/s), io=32.0MiB (33.6MB), run=1031-4856msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179308: Mon Jul 13 10:29:17 2026 read: IOPS=0, BW=2308KiB/s (2363kB/s)(12.0MiB/5325msec) clat (msec): min=727, max=3512, avg=1689.08, stdev=1579.78 lat (msec): min=727, max=3512, avg=1689.09, stdev=1579.78 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 7968, max= 8126, per=100.00%, avg=8047.00, stdev=111.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.95%, ctx=290, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179309: Mon Jul 13 10:29:17 2026 read: IOPS=0, BW=777KiB/s (795kB/s)(4096KiB/5274msec) clat (nsec): min=3232.8M, max=3232.8M, avg=3232777681.00, stdev= 0.00 lat (nsec): min=3232.8M, max=3232.8M, avg=3232780860.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3239], 5.00th=[ 3239], 10.00th=[ 3239], 20.00th=[ 3239], | 30.00th=[ 3239], 40.00th=[ 3239], 50.00th=[ 3239], 60.00th=[ 3239], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1553KiB/s (1591kB/s)(8192KiB/5274msec); 0 zone resets clat (msec): min=644, max=1221, avg=933.28, stdev=408.02 lat (msec): min=645, max=1222, avg=933.97, stdev=407.44 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.34%, ctx=559, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179310: Mon Jul 13 10:29:17 2026 write: IOPS=0, BW=2169KiB/s (2221kB/s)(12.0MiB/5666msec); 0 zone resets clat (msec): min=199, max=4288, avg=1864.80, stdev=2147.71 lat (msec): min=199, max=4289, avg=1865.50, stdev=2147.55 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 4279], 80.00th=[ 4279], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.96%, ctx=45, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179311: Mon Jul 13 10:29:17 2026 write: IOPS=0, BW=2397KiB/s (2454kB/s)(12.0MiB/5127msec); 0 zone resets clat (msec): min=178, max=4103, avg=1630.43, stdev=2152.73 lat (msec): min=178, max=4103, avg=1630.84, stdev=2152.66 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 4111], 80.00th=[ 4111], 90.00th=[ 4111], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min=16189, max=16189, per=100.00%, avg=16189.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.60%, ctx=42, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3077KiB/s (3151kB/s), 777KiB/s-2308KiB/s (795kB/s-2363kB/s), io=16.0MiB (16.8MB), run=5274-5325msec WRITE: bw=5783KiB/s (5922kB/s), 1553KiB/s-2397KiB/s (1591kB/s-2454kB/s), io=32.0MiB (33.6MB), run=5127-5666msec