== sanity test 398b: DIO and buffer IO race ============== 02:08:15 (1789020495) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 9.37733 s, 5.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144551: Thu Sep 10 02:10:58 2026 read: IOPS=11, BW=44.4KiB/s (45.5kB/s)(5992KiB/134968msec) clat (usec): min=33, max=1287.8k, avg=42700.75, stdev=47636.01 lat (usec): min=33, max=1287.8k, avg=42716.04, stdev=47640.20 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 64], | 20.00th=[ 16450], 30.00th=[ 23200], 40.00th=[ 28443], | 50.00th=[ 34341], 60.00th=[ 42730], 70.00th=[ 52167], | 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[ 101188], | 99.00th=[ 156238], 99.50th=[ 181404], 99.90th=[ 417334], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 7, max= 119, per=25.25%, avg=44.44, stdev=21.52, samples=262 iops : min= 1, max= 29, avg=10.48, stdev= 5.44, samples=262 write: IOPS=11, BW=46.6KiB/s (47.8kB/s)(6296KiB/134968msec); 0 zone resets clat (usec): min=733, max=368206, avg=45006.84, stdev=46736.46 lat (usec): min=735, max=368208, avg=45018.28, stdev=46740.77 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1123], 10.00th=[ 1254], 20.00th=[ 4424], | 30.00th=[ 9896], 40.00th=[ 20579], 50.00th=[ 32375], 60.00th=[ 44827], | 70.00th=[ 58459], 80.00th=[ 77071], 90.00th=[107480], 95.00th=[135267], | 99.00th=[206570], 99.50th=[231736], 99.90th=[278922], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 125, per=25.26%, avg=46.47, stdev=20.97, samples=263 iops : min= 1, max= 31, avg=10.99, stdev= 5.30, samples=263 lat (usec) : 50=1.07%, 100=5.01%, 250=0.16%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.49% lat (msec) : 2=6.84%, 4=2.60%, 10=6.02%, 20=10.16%, 50=33.27% lat (msec) : 100=25.36%, 250=8.69%, 500=0.16%, 2000=0.03% cpu : usr=0.08%, sys=4.88%, ctx=6263, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144552: Thu Sep 10 02:10:58 2026 read: IOPS=10, BW=43.6KiB/s (44.7kB/s)(5940KiB/136199msec) clat (usec): min=26, max=1172.9k, avg=43165.34, stdev=45351.06 lat (usec): min=26, max=1172.9k, avg=43169.88, stdev=45349.53 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 67], | 20.00th=[ 17433], 30.00th=[ 23200], 40.00th=[ 29492], | 50.00th=[ 34866], 60.00th=[ 42206], 70.00th=[ 52167], | 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[ 103285], | 99.00th=[ 154141], 99.50th=[ 175113], 99.90th=[ 459277], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 112, per=25.24%, avg=44.43, stdev=19.87, samples=260 iops : min= 1, max= 28, avg=10.48, stdev= 5.02, samples=260 write: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6348KiB/136199msec); 0 zone resets clat (usec): min=630, max=486672, avg=45328.24, stdev=52353.09 lat (usec): min=631, max=486673, avg=45337.51, stdev=52356.42 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1401], 20.00th=[ 4047], | 30.00th=[ 8717], 40.00th=[ 19268], 50.00th=[ 29492], 60.00th=[ 42206], | 70.00th=[ 57410], 80.00th=[ 78119], 90.00th=[109577], 95.00th=[139461], | 99.00th=[254804], 99.50th=[283116], 99.90th=[442500], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 7, max= 152, per=25.29%, avg=46.52, stdev=23.09, samples=265 iops : min= 1, max= 38, avg=11.00, stdev= 5.84, samples=265 lat (usec) : 50=1.04%, 100=4.39%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=6.58%, 4=3.52%, 10=6.67%, 20=10.09%, 50=33.56% lat (msec) : 100=24.38%, 250=8.63%, 500=0.59%, 2000=0.03% cpu : usr=0.07%, sys=4.70%, ctx=6172, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144553: Thu Sep 10 02:10:58 2026 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6028KiB/135040msec) clat (usec): min=32, max=446207, avg=41763.85, stdev=35306.35 lat (usec): min=33, max=446209, avg=41765.37, stdev=35306.33 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 15533], | 30.00th=[ 22414], 40.00th=[ 28443], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 52167], 80.00th=[ 64226], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[158335], 99.50th=[179307], 99.90th=[217056], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 128, per=25.39%, avg=44.69, stdev=21.29, samples=261 iops : min= 1, max= 32, avg=10.55, stdev= 5.37, samples=261 write: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6260KiB/135040msec); 0 zone resets clat (usec): min=796, max=1332.9k, avg=45991.56, stdev=56979.70 lat (usec): min=797, max=1332.9k, avg=45995.23, stdev=56979.92 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1139], 10.00th=[ 1270], | 20.00th=[ 3294], 30.00th=[ 9110], 40.00th=[ 22414], | 50.00th=[ 34866], 60.00th=[ 45876], 70.00th=[ 59507], | 80.00th=[ 77071], 90.00th=[ 105382], 95.00th=[ 139461], | 99.00th=[ 202376], 99.50th=[ 238027], 99.90th=[ 434111], | 99.95th=[1333789], 99.99th=[1333789] bw ( KiB/s): min= 7, max= 168, per=25.05%, avg=46.10, stdev=22.25, samples=263 iops : min= 1, max= 42, avg=10.89, stdev= 5.62, samples=263 lat (usec) : 50=1.24%, 100=4.88%, 250=0.23%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.46% lat (msec) : 2=7.75%, 4=2.99%, 10=5.27%, 20=9.54%, 50=32.78% lat (msec) : 100=26.04%, 250=8.33%, 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=4.85%, ctx=6213, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144554: Thu Sep 10 02:10:58 2026 read: IOPS=11, BW=44.9KiB/s (45.9kB/s)(6052KiB/134912msec) clat (usec): min=31, max=359738, avg=42014.98, stdev=34564.35 lat (usec): min=31, max=359740, avg=42016.41, stdev=34564.18 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 55], 10.00th=[ 69], 20.00th=[ 16712], | 30.00th=[ 22414], 40.00th=[ 28443], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 52167], 80.00th=[ 65274], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[154141], 99.50th=[183501], 99.90th=[316670], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 127, per=25.81%, avg=45.43, stdev=21.55, samples=260 iops : min= 1, max= 31, avg=10.72, stdev= 5.40, samples=260 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6236KiB/134912msec); 0 zone resets clat (usec): min=580, max=1299.7k, avg=45687.35, stdev=57717.69 lat (usec): min=581, max=1299.7k, avg=45690.44, stdev=57717.98 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1123], 10.00th=[ 1237], | 20.00th=[ 3687], 30.00th=[ 8455], 40.00th=[ 20055], | 50.00th=[ 31851], 60.00th=[ 45351], 70.00th=[ 57410], | 80.00th=[ 77071], 90.00th=[ 105382], 95.00th=[ 141558], | 99.00th=[ 212861], 99.50th=[ 235930], 99.90th=[ 467665], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 7, max= 110, per=25.21%, avg=46.39, stdev=20.19, samples=262 iops : min= 1, max= 27, avg=10.97, stdev= 5.10, samples=262 lat (usec) : 50=1.40%, 100=4.43%, 250=0.29%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.72% lat (msec) : 2=6.77%, 4=2.90%, 10=6.25%, 20=9.51%, 50=34.02% lat (msec) : 100=24.48%, 250=8.72%, 500=0.26%, 2000=0.03% cpu : usr=0.07%, sys=4.89%, ctx=6111, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=176KiB/s (181kB/s), 43.6KiB/s-44.9KiB/s (44.7kB/s-45.9kB/s), io=23.4MiB (24.6MB), run=134912-136199msec WRITE: bw=185KiB/s (189kB/s), 46.2KiB/s-46.6KiB/s (47.3kB/s-47.8kB/s), io=24.6MiB (25.7MB), run=134912-136199msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144546: Thu Sep 10 02:13:14 2026 read: IOPS=5, BW=21.0KiB/s (22.5kB/s)(5992KiB/272531msec) clat (msec): min=4, max=1352, avg=35.96, stdev=52.64 lat (msec): min=4, max=1352, avg=35.96, stdev=52.64 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 49], 90.00th=[ 79], 95.00th=[ 110], | 99.00th=[ 197], 99.50th=[ 264], 99.90th=[ 634], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 96, per=29.30%, avg=25.78, stdev=18.54, samples=450 iops : min= 1, max= 24, avg= 5.83, stdev= 4.69, samples=450 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6296KiB/272531msec); 0 zone resets clat (msec): min=34, max=653, avg=138.58, stdev=78.90 lat (msec): min=34, max=653, avg=138.59, stdev=78.90 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 117], 60.00th=[ 133], | 70.00th=[ 157], 80.00th=[ 184], 90.00th=[ 236], 95.00th=[ 300], | 99.00th=[ 414], 99.50th=[ 472], 99.90th=[ 642], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 64, per=25.09%, avg=23.08, stdev=11.69, samples=526 iops : min= 1, max= 16, avg= 5.16, stdev= 2.97, samples=526 lat (msec) : 10=5.24%, 20=17.22%, 50=18.39%, 100=23.76%, 250=30.70% lat (msec) : 500=4.46%, 750=0.20%, 2000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5082, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144547: Thu Sep 10 02:13:14 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(5940KiB/272683msec) clat (msec): min=4, max=1280, avg=35.58, stdev=48.49 lat (msec): min=4, max=1280, avg=35.58, stdev=48.49 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 48], 90.00th=[ 82], 95.00th=[ 114], | 99.00th=[ 190], 99.50th=[ 222], 99.90th=[ 284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 96, per=28.59%, avg=25.16, stdev=17.42, samples=456 iops : min= 1, max= 24, avg= 5.68, stdev= 4.40, samples=456 write: IOPS=5, BW=23.3KiB/s (23.8kB/s)(6348KiB/272683msec); 0 zone resets clat (msec): min=31, max=839, avg=138.22, stdev=79.02 lat (msec): min=31, max=839, avg=138.22, stdev=79.02 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 79], | 30.00th=[ 91], 40.00th=[ 104], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 236], 95.00th=[ 292], | 99.00th=[ 435], 99.50th=[ 489], 99.90th=[ 600], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 64, per=25.35%, avg=23.33, stdev=12.00, samples=524 iops : min= 1, max= 16, avg= 5.22, stdev= 3.06, samples=524 lat (msec) : 10=5.21%, 20=17.12%, 50=18.20%, 100=23.70%, 250=31.64% lat (msec) : 500=3.91%, 750=0.16%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.04%, ctx=5054, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144548: Thu Sep 10 02:13:14 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6028KiB/270781msec) clat (msec): min=5, max=636, avg=36.01, stdev=39.43 lat (msec): min=5, max=636, avg=36.01, stdev=39.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 37], 80.00th=[ 54], 90.00th=[ 82], 95.00th=[ 110], | 99.00th=[ 182], 99.50th=[ 222], 99.90th=[ 326], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 103, per=28.34%, avg=24.94, stdev=17.37, samples=467 iops : min= 1, max= 25, avg= 5.62, stdev= 4.37, samples=467 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6260KiB/270781msec); 0 zone resets clat (msec): min=25, max=1385, avg=138.02, stdev=84.74 lat (msec): min=25, max=1385, avg=138.03, stdev=84.74 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 102], 50.00th=[ 116], 60.00th=[ 132], | 70.00th=[ 153], 80.00th=[ 186], 90.00th=[ 243], 95.00th=[ 296], | 99.00th=[ 426], 99.50th=[ 456], 99.90th=[ 642], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 64, per=25.18%, avg=23.17, stdev=12.45, samples=520 iops : min= 1, max= 16, avg= 5.18, stdev= 3.17, samples=520 lat (msec) : 10=5.21%, 20=17.61%, 50=16.96%, 100=25.75%, 250=29.79% lat (msec) : 500=4.49%, 750=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.04%, ctx=5242, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144549: Thu Sep 10 02:13:14 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(6052KiB/272641msec) clat (msec): min=5, max=518, avg=34.99, stdev=38.66 lat (msec): min=5, max=518, avg=34.99, stdev=38.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 116], | 99.00th=[ 182], 99.50th=[ 228], 99.90th=[ 330], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 103, per=29.13%, avg=25.63, stdev=17.30, samples=457 iops : min= 1, max= 25, avg= 5.80, stdev= 4.38, samples=457 write: IOPS=5, BW=22.9KiB/s (23.4kB/s)(6236KiB/272641msec); 0 zone resets clat (msec): min=28, max=1382, avg=140.59, stdev=85.83 lat (msec): min=28, max=1382, avg=140.59, stdev=85.84 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 186], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 447], 99.50th=[ 481], 99.90th=[ 693], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7, max= 63, per=24.87%, avg=22.88, stdev=11.90, samples=525 iops : min= 1, max= 15, avg= 5.10, stdev= 3.03, samples=525 lat (msec) : 10=5.44%, 20=18.20%, 50=16.86%, 100=24.28%, 250=30.31% lat (msec) : 500=4.69%, 750=0.20%, 2000=0.03% cpu : usr=0.04%, sys=1.01%, ctx=4973, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=88.1KiB/s (90.2kB/s), 21.8KiB/s-22.3KiB/s (22.3kB/s-22.8kB/s), io=23.4MiB (24.6MB), run=270781-272683msec WRITE: bw=92.2KiB/s (94.4kB/s), 22.9KiB/s-23.3KiB/s (23.4kB/s-23.8kB/s), io=24.6MiB (25.7MB), run=270781-272683msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144606: Thu Sep 10 02:13:46 2026 read: IOPS=17, BW=276KiB/s (282kB/s)(5920KiB/21485msec) clat (usec): min=31, max=155109, avg=28745.96, stdev=26040.04 lat (usec): min=31, max=155110, avg=28746.96, stdev=26040.05 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 74], | 30.00th=[ 15795], 40.00th=[ 21365], 50.00th=[ 25297], 60.00th=[ 30802], | 70.00th=[ 38011], 80.00th=[ 45351], 90.00th=[ 58459], 95.00th=[ 70779], | 99.00th=[143655], 99.50th=[143655], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 31, max= 415, per=24.79%, avg=274.40, stdev=93.97, samples=42 iops : min= 1, max= 25, avg=16.38, stdev= 5.87, samples=42 write: IOPS=18, BW=296KiB/s (304kB/s)(6368KiB/21485msec); 0 zone resets clat (usec): min=1107, max=154875, avg=26568.71, stdev=27228.70 lat (usec): min=1109, max=154878, avg=26572.00, stdev=27228.32 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1549], 10.00th=[ 1827], 20.00th=[ 3982], | 30.00th=[ 6980], 40.00th=[ 11076], 50.00th=[ 17171], 60.00th=[ 24773], | 70.00th=[ 33817], 80.00th=[ 46400], 90.00th=[ 63701], 95.00th=[ 83362], | 99.00th=[120062], 99.50th=[149947], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 120, max= 542, per=25.43%, avg=296.21, stdev=102.45, samples=42 iops : min= 7, max= 33, avg=17.76, stdev= 6.42, samples=42 lat (usec) : 50=2.21%, 100=8.85%, 250=0.65%, 500=0.13% lat (msec) : 2=6.12%, 4=4.82%, 10=9.51%, 20=14.06%, 50=37.63% lat (msec) : 100=14.19%, 250=1.82% cpu : usr=0.08%, sys=7.12%, ctx=1352, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144607: Thu Sep 10 02:13:46 2026 read: IOPS=16, BW=266KiB/s (272kB/s)(5744KiB/21625msec) clat (usec): min=35, max=250836, avg=28891.11, stdev=27533.36 lat (usec): min=36, max=250836, avg=28892.07, stdev=27533.33 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 13042], 40.00th=[ 21890], 50.00th=[ 26346], 60.00th=[ 32113], | 70.00th=[ 39060], 80.00th=[ 45876], 90.00th=[ 58459], 95.00th=[ 79168], | 99.00th=[107480], 99.50th=[132645], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 29, max= 447, per=23.74%, avg=262.86, stdev=108.06, samples=42 iops : min= 1, max= 27, avg=15.69, stdev= 6.86, samples=42 write: IOPS=18, BW=303KiB/s (310kB/s)(6544KiB/21625msec); 0 zone resets clat (usec): min=1258, max=197631, avg=26866.04, stdev=29285.52 lat (usec): min=1260, max=197633, avg=26867.96, stdev=29285.80 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1631], 10.00th=[ 1811], 20.00th=[ 3458], | 30.00th=[ 5014], 40.00th=[ 8848], 50.00th=[ 15008], 60.00th=[ 25560], | 70.00th=[ 37487], 80.00th=[ 49021], 90.00th=[ 65274], 95.00th=[ 81265], | 99.00th=[129500], 99.50th=[152044], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 59, max= 542, per=25.56%, avg=297.76, stdev=100.37, samples=42 iops : min= 3, max= 33, avg=17.88, stdev= 6.29, samples=42 lat (usec) : 50=1.17%, 100=10.81%, 250=0.39%, 500=0.13%, 1000=0.26% lat (msec) : 2=7.03%, 4=6.12%, 10=10.16%, 20=10.81%, 50=35.55% lat (msec) : 100=15.76%, 250=1.69%, 500=0.13% cpu : usr=0.09%, sys=7.17%, ctx=1373, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144608: Thu Sep 10 02:13:46 2026 read: IOPS=18, BW=292KiB/s (299kB/s)(6256KiB/21422msec) clat (usec): min=37, max=161464, avg=28571.92, stdev=24185.31 lat (usec): min=38, max=161465, avg=28572.99, stdev=24185.37 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 78], | 30.00th=[ 15401], 40.00th=[ 22152], 50.00th=[ 27657], 60.00th=[ 32113], | 70.00th=[ 38011], 80.00th=[ 45351], 90.00th=[ 60031], 95.00th=[ 69731], | 99.00th=[107480], 99.50th=[123208], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 127, max= 447, per=26.51%, avg=293.45, stdev=87.43, samples=42 iops : min= 7, max= 27, avg=17.62, stdev= 5.52, samples=42 write: IOPS=17, BW=282KiB/s (288kB/s)(6032KiB/21422msec); 0 zone resets clat (usec): min=1322, max=146822, avg=26964.90, stdev=28118.58 lat (usec): min=1323, max=146824, avg=26971.33, stdev=28114.51 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1614], 10.00th=[ 1778], 20.00th=[ 3556], | 30.00th=[ 5669], 40.00th=[ 9503], 50.00th=[ 16581], 60.00th=[ 25035], | 70.00th=[ 35914], 80.00th=[ 46924], 90.00th=[ 66323], 95.00th=[ 88605], | 99.00th=[124257], 99.50th=[133694], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 63, max= 509, per=24.03%, avg=280.00, stdev=114.93, samples=42 iops : min= 3, max= 31, avg=16.74, stdev= 7.23, samples=42 lat (usec) : 50=1.56%, 100=9.77%, 250=0.52%, 500=0.26%, 1000=0.13% lat (msec) : 2=6.25%, 4=4.43%, 10=9.64%, 20=11.72%, 50=39.32% lat (msec) : 100=14.97%, 250=1.43% cpu : usr=0.08%, sys=7.18%, ctx=1418, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144609: Thu Sep 10 02:13:46 2026 read: IOPS=17, BW=286KiB/s (293kB/s)(6032KiB/21103msec) clat (usec): min=31, max=195225, avg=27500.20, stdev=26500.12 lat (usec): min=31, max=195226, avg=27501.14, stdev=26500.11 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 65], | 30.00th=[ 219], 40.00th=[ 18482], 50.00th=[ 24511], 60.00th=[ 31327], | 70.00th=[ 38011], 80.00th=[ 48497], 90.00th=[ 61080], 95.00th=[ 69731], | 99.00th=[113771], 99.50th=[147850], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 95, max= 658, per=26.30%, avg=291.18, stdev=103.52, samples=40 iops : min= 5, max= 41, avg=17.45, stdev= 6.57, samples=40 write: IOPS=18, BW=296KiB/s (304kB/s)(6256KiB/21103msec); 0 zone resets clat (usec): min=1057, max=163440, avg=26570.41, stdev=29449.96 lat (usec): min=1058, max=163442, avg=26572.21, stdev=29449.90 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1549], 10.00th=[ 1696], 20.00th=[ 2999], | 30.00th=[ 5669], 40.00th=[ 9765], 50.00th=[ 15139], 60.00th=[ 23462], | 70.00th=[ 33424], 80.00th=[ 49021], 90.00th=[ 64226], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[145753], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 29, max= 476, per=25.26%, avg=294.27, stdev=101.06, samples=41 iops : min= 1, max= 29, avg=17.63, stdev= 6.35, samples=41 lat (usec) : 50=2.47%, 100=11.85%, 250=0.52%, 500=0.26%, 750=0.26% lat (msec) : 2=7.68%, 4=4.43%, 10=9.24%, 20=12.37%, 50=32.16% lat (msec) : 100=16.41%, 250=2.34% cpu : usr=0.09%, sys=7.42%, ctx=1332, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1108KiB/s (1134kB/s), 266KiB/s-292KiB/s (272kB/s-299kB/s), io=23.4MiB (24.5MB), run=21103-21625msec WRITE: bw=1165KiB/s (1193kB/s), 282KiB/s-303KiB/s (288kB/s-310kB/s), io=24.6MiB (25.8MB), run=21103-21625msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144610: Thu Sep 10 02:14:25 2026 read: IOPS=6, BW=97.9KiB/s (100kB/s)(5920KiB/60479msec) clat (msec): min=4, max=163, avg=31.22, stdev=25.25 lat (msec): min=4, max=163, avg=31.22, stdev=25.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 61], 95.00th=[ 87], | 99.00th=[ 144], 99.50th=[ 155], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 30, max= 412, per=26.33%, avg=102.95, stdev=66.16, samples=112 iops : min= 1, max= 25, avg= 5.71, stdev= 4.18, samples=112 write: IOPS=6, BW=105KiB/s (108kB/s)(6368KiB/60479msec); 0 zone resets clat (msec): min=44, max=385, avg=122.24, stdev=46.89 lat (msec): min=44, max=385, avg=122.24, stdev=46.89 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 127], | 70.00th=[ 140], 80.00th=[ 159], 90.00th=[ 182], 95.00th=[ 211], | 99.00th=[ 255], 99.50th=[ 313], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 191, per=25.68%, avg=105.55, stdev=36.30, samples=118 iops : min= 1, max= 11, avg= 5.86, stdev= 2.32, samples=118 lat (msec) : 10=2.47%, 20=16.80%, 50=23.05%, 100=23.70%, 250=33.33% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.35%, ctx=1261, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144611: Thu Sep 10 02:14:25 2026 read: IOPS=5, BW=93.8KiB/s (96.1kB/s)(5744KiB/61222msec) clat (msec): min=5, max=203, avg=30.43, stdev=24.99 lat (msec): min=5, max=203, avg=30.43, stdev=24.99 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 58], 95.00th=[ 84], | 99.00th=[ 144], 99.50th=[ 165], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 27, max= 286, per=27.13%, avg=106.09, stdev=59.92, samples=107 iops : min= 1, max= 17, avg= 5.90, stdev= 3.71, samples=107 write: IOPS=6, BW=107KiB/s (109kB/s)(6544KiB/61222msec); 0 zone resets clat (msec): min=38, max=342, avg=122.70, stdev=47.36 lat (msec): min=38, max=342, avg=122.71, stdev=47.36 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 94], 40.00th=[ 103], 50.00th=[ 113], 60.00th=[ 126], | 70.00th=[ 140], 80.00th=[ 155], 90.00th=[ 184], 95.00th=[ 213], | 99.00th=[ 268], 99.50th=[ 300], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 189, per=25.88%, avg=106.35, stdev=34.82, samples=121 iops : min= 1, max= 11, avg= 5.92, stdev= 2.27, samples=121 lat (msec) : 10=2.60%, 20=16.02%, 50=23.31%, 100=23.18%, 250=33.85% lat (msec) : 500=1.04% cpu : usr=0.03%, sys=1.31%, ctx=1251, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144612: Thu Sep 10 02:14:25 2026 read: IOPS=6, BW=108KiB/s (110kB/s)(6256KiB/58084msec) clat (msec): min=7, max=172, avg=30.32, stdev=24.80 lat (msec): min=7, max=172, avg=30.33, stdev=24.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 58], 95.00th=[ 81], | 99.00th=[ 146], 99.50th=[ 165], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 30, max= 319, per=28.95%, avg=113.18, stdev=68.48, samples=109 iops : min= 1, max= 19, avg= 6.34, stdev= 4.29, samples=109 write: IOPS=6, BW=104KiB/s (106kB/s)(6032KiB/58084msec); 0 zone resets clat (msec): min=32, max=338, avg=121.94, stdev=45.66 lat (msec): min=32, max=338, avg=121.95, stdev=45.67 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 107], 50.00th=[ 114], 60.00th=[ 126], | 70.00th=[ 140], 80.00th=[ 150], 90.00th=[ 176], 95.00th=[ 203], | 99.00th=[ 288], 99.50th=[ 330], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 191, per=25.31%, avg=104.01, stdev=34.14, samples=113 iops : min= 1, max= 11, avg= 5.76, stdev= 2.22, samples=113 lat (msec) : 10=1.82%, 20=19.01%, 50=23.70%, 100=21.88%, 250=32.55% lat (msec) : 500=1.04% cpu : usr=0.03%, sys=1.36%, ctx=1292, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144613: Thu Sep 10 02:14:25 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59754msec) clat (msec): min=6, max=189, avg=32.17, stdev=26.75 lat (msec): min=6, max=189, avg=32.17, stdev=26.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 63], 95.00th=[ 92], | 99.00th=[ 144], 99.50th=[ 182], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 284, per=27.41%, avg=107.17, stdev=60.41, samples=110 iops : min= 1, max= 17, avg= 5.96, stdev= 3.82, samples=110 write: IOPS=6, BW=105KiB/s (107kB/s)(6256KiB/59754msec); 0 zone resets clat (msec): min=38, max=305, avg=121.13, stdev=45.23 lat (msec): min=38, max=305, avg=121.13, stdev=45.23 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 112], 60.00th=[ 125], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 178], 95.00th=[ 209], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 191, per=25.42%, avg=104.48, stdev=36.97, samples=118 iops : min= 1, max= 11, avg= 5.79, stdev= 2.37, samples=118 lat (msec) : 10=2.73%, 20=15.89%, 50=23.31%, 100=24.09%, 250=33.07% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.46%, ctx=1259, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=391KiB/s (401kB/s), 93.8KiB/s-108KiB/s (96.1kB/s-110kB/s), io=23.4MiB (24.5MB), run=58084-61222msec WRITE: bw=412KiB/s (421kB/s), 104KiB/s-107KiB/s (106kB/s-109kB/s), io=24.6MiB (25.8MB), run=58084-61222msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144630: Thu Sep 10 02:14:44 2026 read: IOPS=1, BW=1717KiB/s (1758kB/s)(7168KiB/4175msec) clat (usec): min=601, max=427645, avg=223885.43, stdev=166810.99 lat (usec): min=602, max=427647, avg=223886.88, stdev=166811.05 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 758], | 30.00th=[225444], 40.00th=[225444], 50.00th=[240124], 60.00th=[325059], | 70.00th=[325059], 80.00th=[346031], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 2000, max= 4079, per=81.90%, avg=2990.33, stdev=1042.98, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1226KiB/s (1256kB/s)(5120KiB/4175msec); 0 zone resets clat (msec): min=301, max=692, avg=481.67, stdev=151.41 lat (msec): min=304, max=692, avg=482.33, stdev=150.55 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1976, max= 4047, per=58.92%, avg=3011.50, stdev=1464.42, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=9.99%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144631: Thu Sep 10 02:14:44 2026 read: IOPS=0, BW=365KiB/s (374kB/s)(2048KiB/5609msec) clat (msec): min=9, max=309, avg=159.36, stdev=212.58 lat (msec): min=9, max=309, avg=159.36, stdev=212.58 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 9], | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1456, max= 2023, per=47.64%, avg=1739.50, stdev=400.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1826KiB/s (1869kB/s)(10.0MiB/5609msec); 0 zone resets clat (msec): min=176, max=1148, avg=514.30, stdev=374.62 lat (msec): min=176, max=1148, avg=514.42, stdev=374.61 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 222], | 30.00th=[ 241], 40.00th=[ 271], 50.00th=[ 309], 60.00th=[ 388], | 70.00th=[ 418], 80.00th=[ 919], 90.00th=[ 1053], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1976, max= 4079, per=63.17%, avg=3228.80, stdev=1117.20, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 10=8.33%, 250=25.00%, 500=41.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=7.13%, ctx=121, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144632: Thu Sep 10 02:14:44 2026 read: IOPS=1, BW=1366KiB/s (1399kB/s)(6144KiB/4498msec) clat (usec): min=469, max=379788, avg=178245.49, stdev=195564.93 lat (usec): min=470, max=379789, avg=178246.59, stdev=195564.85 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 537], 50.00th=[ 537], 60.00th=[325059], | 70.00th=[362808], 80.00th=[362808], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 2023, max= 4079, per=69.57%, avg=2540.00, stdev=1026.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1366KiB/s (1399kB/s)(6144KiB/4498msec); 0 zone resets clat (msec): min=183, max=1272, avg=545.71, stdev=459.74 lat (msec): min=183, max=1272, avg=545.85, stdev=459.69 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 326], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 2023, max= 3160, per=45.28%, avg=2314.25, stdev=563.87, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=16.67%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.67%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144633: Thu Sep 10 02:14:44 2026 read: IOPS=1, BW=1139KiB/s (1166kB/s)(5120KiB/4495msec) clat (usec): min=373, max=376358, avg=124596.14, stdev=176069.71 lat (usec): min=374, max=376359, avg=124597.45, stdev=176069.78 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 375], 10.00th=[ 375], 20.00th=[ 375], | 30.00th=[ 424], 40.00th=[ 424], 50.00th=[ 922], 60.00th=[ 922], | 70.00th=[244319], 80.00th=[244319], 90.00th=[375391], 95.00th=[375391], | 99.00th=[375391], 99.50th=[375391], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 2035, max= 6071, per=100.00%, avg=4053.00, stdev=2853.88, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1595KiB/s (1633kB/s)(7168KiB/4495msec); 0 zone resets clat (msec): min=240, max=1153, avg=547.04, stdev=294.87 lat (msec): min=240, max=1153, avg=547.15, stdev=294.86 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 405], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 426], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 642], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1521, max= 2039, per=37.92%, avg=1938.17, stdev=205.71, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=7.61%, ctx=99, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3651KiB/s (3739kB/s), 365KiB/s-1717KiB/s (374kB/s-1758kB/s), io=20.0MiB (20.0MB), run=4175-5609msec WRITE: bw=5112KiB/s (5234kB/s), 1226KiB/s-1826KiB/s (1256kB/s-1869kB/s), io=28.0MiB (29.4MB), run=4175-5609msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144635: Thu Sep 10 02:14:44 2026 read: IOPS=1, BW=1313KiB/s (1344kB/s)(7168KiB/5461msec) clat (msec): min=64, max=1123, avg=364.56, stdev=364.68 lat (msec): min=64, max=1123, avg=364.56, stdev=364.68 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 89], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 279], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 498], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1835, max= 3723, per=63.43%, avg=2378.75, stdev=898.73, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=938KiB/s (960kB/s)(5120KiB/5461msec); 0 zone resets clat (msec): min=191, max=1331, avg=546.02, stdev=460.97 lat (msec): min=191, max=1331, avg=546.12, stdev=461.03 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1988, max= 4096, per=51.28%, avg=2692.00, stdev=1215.90, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 2000=16.67% cpu : usr=0.04%, sys=3.86%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144636: Thu Sep 10 02:14:44 2026 read: IOPS=0, BW=380KiB/s (389kB/s)(2048KiB/5390msec) clat (msec): min=169, max=256, avg=213.43, stdev=61.48 lat (msec): min=169, max=256, avg=213.43, stdev=61.48 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1861, max= 2027, per=51.84%, avg=1944.00, stdev=117.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1900KiB/s (1945kB/s)(10.0MiB/5390msec); 0 zone resets clat (msec): min=162, max=1101, avg=485.69, stdev=333.08 lat (msec): min=162, max=1101, avg=485.92, stdev=333.15 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 226], | 30.00th=[ 279], 40.00th=[ 313], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 426], 80.00th=[ 592], 90.00th=[ 1053], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1973, max= 4096, per=49.31%, avg=2589.00, stdev=1018.39, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=3.73%, ctx=69, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144637: Thu Sep 10 02:14:44 2026 read: IOPS=1, BW=1238KiB/s (1268kB/s)(6144KiB/4961msec) clat (msec): min=97, max=392, avg=233.58, stdev=105.69 lat (msec): min=97, max=392, avg=233.58, stdev=105.69 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 264], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1861, max= 4055, per=65.97%, avg=2474.00, stdev=1055.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1238KiB/s (1268kB/s)(6144KiB/4961msec); 0 zone resets clat (msec): min=288, max=922, avg=582.91, stdev=254.31 lat (msec): min=289, max=923, avg=583.02, stdev=254.33 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 667], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1973, max= 2031, per=38.15%, avg=2003.00, stdev=26.52, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=2.66%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144638: Thu Sep 10 02:14:44 2026 read: IOPS=0, BW=946KiB/s (968kB/s)(5120KiB/5414msec) clat (msec): min=37, max=307, avg=205.64, stdev=110.47 lat (msec): min=37, max=307, avg=205.64, stdev=110.47 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 37], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 2035, max= 6083, per=100.00%, avg=4059.00, stdev=2862.37, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1324KiB/s (1356kB/s)(7168KiB/5414msec); 0 zone resets clat (msec): min=145, max=1445, avg=623.97, stdev=413.28 lat (msec): min=146, max=1445, avg=624.08, stdev=413.25 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 359], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 617], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 735], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1432, max= 4096, per=43.41%, avg=2279.20, stdev=1042.19, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 50=8.33%, 250=25.00%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=2.99%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3750KiB/s (3840kB/s), 380KiB/s-1313KiB/s (389kB/s-1344kB/s), io=20.0MiB (20.0MB), run=4961-5461msec WRITE: bw=5250KiB/s (5376kB/s), 938KiB/s-1900KiB/s (960kB/s-1945kB/s), io=28.0MiB (29.4MB), run=4961-5461msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144646: Thu Sep 10 02:15:03 2026 read: IOPS=0, BW=3035KiB/s (3108kB/s)(12.0MiB/4049msec) clat (msec): min=200, max=2187, avg=1349.42, stdev=1029.21 lat (msec): min=200, max=2187, avg=1349.42, stdev=1029.21 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 1653], 50.00th=[ 1653], 60.00th=[ 1653], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.88%, ctx=33, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144647: Thu Sep 10 02:15:03 2026 read: IOPS=0, BW=866KiB/s (887kB/s)(4096KiB/4729msec) clat (nsec): min=1495.4M, max=1495.4M, avg=1495376823.00, stdev= 0.00 lat (nsec): min=1495.4M, max=1495.4M, avg=1495378010.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1502], 5.00th=[ 1502], 10.00th=[ 1502], 20.00th=[ 1502], | 30.00th=[ 1502], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1732KiB/s (1774kB/s)(8192KiB/4729msec); 0 zone resets clat (msec): min=724, max=2398, avg=1561.84, stdev=1183.50 lat (msec): min=725, max=2399, avg=1562.27, stdev=1183.44 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.18%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144648: Thu Sep 10 02:15:03 2026 write: IOPS=1, BW=4452KiB/s (4559kB/s)(12.0MiB/2760msec); 0 zone resets clat (msec): min=652, max=1148, avg=906.26, stdev=247.87 lat (msec): min=653, max=1151, avg=907.69, stdev=249.34 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7953, max= 8094, per=100.00%, avg=8023.50, stdev=99.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=3.77%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144649: Thu Sep 10 02:15:03 2026 write: IOPS=1, BW=4385KiB/s (4491kB/s)(12.0MiB/2802msec); 0 zone resets clat (msec): min=483, max=1566, avg=897.37, stdev=585.27 lat (msec): min=483, max=1571, avg=899.54, stdev=587.34 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7922, max= 7953, per=100.00%, avg=7937.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.07%, sys=4.32%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3465KiB/s (3548kB/s), 866KiB/s-3035KiB/s (887kB/s-3108kB/s), io=16.0MiB (16.8MB), run=4049-4729msec WRITE: bw=6929KiB/s (7095kB/s), 1732KiB/s-4452KiB/s (1774kB/s-4559kB/s), io=32.0MiB (33.6MB), run=2760-4729msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144651: Thu Sep 10 02:15:04 2026 read: IOPS=0, BW=3802KiB/s (3893kB/s)(12.0MiB/3232msec) clat (msec): min=770, max=1399, avg=1075.54, stdev=314.66 lat (msec): min=770, max=1399, avg=1075.54, stdev=314.66 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=8.23%, ctx=315, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144652: Thu Sep 10 02:15:04 2026 read: IOPS=0, BW=1067KiB/s (1092kB/s)(4096KiB/3840msec) clat (nsec): min=941613k, max=941613k, avg=941613342.00, stdev= 0.00 lat (nsec): min=941616k, max=941616k, avg=941615884.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2133KiB/s (2185kB/s)(8192KiB/3840msec); 0 zone resets clat (msec): min=382, max=2511, avg=1446.84, stdev=1505.55 lat (msec): min=383, max=2511, avg=1447.57, stdev=1504.84 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 2500], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.86%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144653: Thu Sep 10 02:15:04 2026 write: IOPS=0, BW=2484KiB/s (2544kB/s)(12.0MiB/4946msec); 0 zone resets clat (msec): min=334, max=2483, avg=1646.18, stdev=1150.58 lat (msec): min=334, max=2487, avg=1647.76, stdev=1151.87 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 2123], 50.00th=[ 2123], 60.00th=[ 2123], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.04%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144654: Thu Sep 10 02:15:04 2026 write: IOPS=0, BW=3954KiB/s (4049kB/s)(12.0MiB/3108msec); 0 zone resets clat (msec): min=552, max=1962, avg=1033.82, stdev=804.27 lat (msec): min=556, max=1962, avg=1035.30, stdev=803.36 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 6350, max= 8047, per=100.00%, avg=7198.50, stdev=1199.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.28%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4267KiB/s (4369kB/s), 1067KiB/s-3802KiB/s (1092kB/s-3893kB/s), io=16.0MiB (16.8MB), run=3232-3840msec WRITE: bw=6625KiB/s (6784kB/s), 2133KiB/s-3954KiB/s (2185kB/s-4049kB/s), io=32.0MiB (33.6MB), run=3108-4946msec