== sanity test 398b: DIO and buffer IO race ============== 03:45:23 (1785397523) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 9.34676 s, 5.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178099: Thu Jul 30 03:48:57 2026 read: IOPS=8, BW=32.0KiB/s (32.8kB/s)(5992KiB/187222msec) clat (usec): min=34, max=1291.8k, avg=69911.19, stdev=59225.35 lat (usec): min=34, max=1291.8k, avg=69916.64, stdev=59224.78 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 14222], 10.00th=[ 24773], | 20.00th=[ 33424], 30.00th=[ 42206], 40.00th=[ 50070], | 50.00th=[ 57934], 60.00th=[ 67634], 70.00th=[ 81265], | 80.00th=[ 96994], 90.00th=[ 124257], 95.00th=[ 158335], | 99.00th=[ 291505], 99.50th=[ 346031], 99.90th=[ 509608], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 7, max= 79, per=25.53%, avg=32.43, stdev=14.78, samples=357 iops : min= 1, max= 19, avg= 7.44, stdev= 3.72, samples=357 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6296KiB/187222msec); 0 zone resets clat (usec): min=1019, max=753258, avg=51993.88, stdev=60470.52 lat (usec): min=1020, max=753260, avg=51997.39, stdev=60470.55 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1254], 10.00th=[ 1385], 20.00th=[ 5211], | 30.00th=[ 11076], 40.00th=[ 22676], 50.00th=[ 35390], 60.00th=[ 47973], | 70.00th=[ 64226], 80.00th=[ 90702], 90.00th=[124257], 95.00th=[154141], | 99.00th=[238027], 99.50th=[341836], 99.90th=[717226], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 118, per=25.92%, avg=34.47, stdev=18.57, samples=353 iops : min= 1, max= 29, avg= 7.95, stdev= 4.68, samples=353 lat (usec) : 50=0.59%, 100=1.27%, 250=0.16% lat (msec) : 2=6.74%, 4=1.79%, 10=6.09%, 20=6.58%, 50=27.57% lat (msec) : 100=31.61%, 250=16.60%, 500=0.88%, 750=0.07%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.05%, sys=3.63%, ctx=6072, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178100: Thu Jul 30 03:48:57 2026 read: IOPS=7, BW=31.6KiB/s (32.4kB/s)(5940KiB/187705msec) clat (usec): min=38, max=428052, avg=69584.49, stdev=49236.79 lat (usec): min=39, max=428052, avg=69585.78, stdev=49236.79 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 15926], 10.00th=[ 24773], 20.00th=[ 34866], | 30.00th=[ 42730], 40.00th=[ 49546], 50.00th=[ 58983], 60.00th=[ 68682], | 70.00th=[ 81265], 80.00th=[ 96994], 90.00th=[126354], 95.00th=[152044], | 99.00th=[250610], 99.50th=[320865], 99.90th=[421528], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 87, per=25.13%, avg=31.91, stdev=15.42, samples=359 iops : min= 1, max= 21, avg= 7.31, stdev= 3.90, samples=359 write: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6348KiB/187705msec); 0 zone resets clat (usec): min=1003, max=1266.9k, avg=52725.93, stdev=68400.84 lat (usec): min=1003, max=1266.9k, avg=52729.68, stdev=68404.95 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1237], 10.00th=[ 1401], | 20.00th=[ 5211], 30.00th=[ 10945], 40.00th=[ 22414], | 50.00th=[ 35390], 60.00th=[ 48497], 70.00th=[ 64226], | 80.00th=[ 87557], 90.00th=[ 125305], 95.00th=[ 158335], | 99.00th=[ 267387], 99.50th=[ 341836], 99.90th=[ 834667], | 99.95th=[1266680], 99.99th=[1266680] bw ( KiB/s): min= 6, max= 118, per=25.73%, avg=34.23, stdev=19.29, samples=358 iops : min= 1, max= 29, avg= 7.90, stdev= 4.86, samples=358 lat (usec) : 50=0.59%, 100=1.24%, 250=0.03%, 500=0.03% lat (msec) : 2=6.41%, 4=2.54%, 10=6.15%, 20=5.76%, 50=28.16% lat (msec) : 100=31.35%, 250=16.50%, 500=1.14%, 750=0.03%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.05%, sys=3.61%, ctx=6130, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178101: Thu Jul 30 03:48:57 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6028KiB/184161msec) clat (usec): min=27, max=538984, avg=65973.32, stdev=50926.52 lat (usec): min=27, max=538985, avg=65979.07, stdev=50925.31 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 1156], 10.00th=[ 22676], 20.00th=[ 31589], | 30.00th=[ 39060], 40.00th=[ 46924], 50.00th=[ 54789], 60.00th=[ 64750], | 70.00th=[ 77071], 80.00th=[ 93848], 90.00th=[117965], 95.00th=[154141], | 99.00th=[254804], 99.50th=[350225], 99.90th=[450888], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 6, max= 101, per=26.05%, avg=33.08, stdev=16.56, samples=352 iops : min= 1, max= 25, avg= 7.61, stdev= 4.18, samples=352 write: IOPS=8, BW=33.0KiB/s (34.8kB/s)(6260KiB/184161msec); 0 zone resets clat (usec): min=996, max=1317.1k, avg=53602.15, stdev=69513.41 lat (usec): min=998, max=1317.1k, avg=53604.17, stdev=69513.87 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1270], 10.00th=[ 1467], | 20.00th=[ 5080], 30.00th=[ 9372], 40.00th=[ 19530], | 50.00th=[ 33817], 60.00th=[ 47973], 70.00th=[ 65274], | 80.00th=[ 91751], 90.00th=[ 128451], 95.00th=[ 170918], | 99.00th=[ 291505], 99.50th=[ 350225], 99.90th=[ 574620], | 99.95th=[1317012], 99.99th=[1317012] bw ( KiB/s): min= 6, max= 96, per=26.30%, avg=34.98, stdev=19.11, samples=346 iops : min= 1, max= 24, avg= 8.09, stdev= 4.83, samples=346 lat (usec) : 50=0.62%, 100=1.69%, 250=0.03%, 750=0.03%, 1000=0.10% lat (msec) : 2=5.99%, 4=2.77%, 10=7.10%, 20=6.15%, 50=28.45% lat (msec) : 100=30.34%, 250=15.46%, 500=1.17%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=3.60%, ctx=5946, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178102: Thu Jul 30 03:48:57 2026 read: IOPS=8, BW=32.6KiB/s (33.4kB/s)(6052KiB/185490msec) clat (usec): min=35, max=521182, avg=68842.72, stdev=53053.83 lat (usec): min=35, max=521183, avg=68847.82, stdev=53055.61 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 10683], 10.00th=[ 22152], 20.00th=[ 32113], | 30.00th=[ 41157], 40.00th=[ 49021], 50.00th=[ 56886], 60.00th=[ 66323], | 70.00th=[ 79168], 80.00th=[ 98042], 90.00th=[123208], 95.00th=[164627], | 99.00th=[283116], 99.50th=[333448], 99.90th=[513803], 99.95th=[522191], | 99.99th=[522191] bw ( KiB/s): min= 6, max= 79, per=25.77%, avg=32.73, stdev=15.49, samples=356 iops : min= 1, max= 19, avg= 7.52, stdev= 3.90, samples=356 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6236KiB/185490msec); 0 zone resets clat (usec): min=879, max=1288.4k, avg=51637.42, stdev=66733.60 lat (usec): min=881, max=1288.4k, avg=51640.44, stdev=66733.94 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1237], 10.00th=[ 1385], | 20.00th=[ 5211], 30.00th=[ 10159], 40.00th=[ 21890], | 50.00th=[ 33817], 60.00th=[ 46400], 70.00th=[ 64750], | 80.00th=[ 85459], 90.00th=[ 125305], 95.00th=[ 156238], | 99.00th=[ 238027], 99.50th=[ 291505], 99.90th=[ 943719], | 99.95th=[1283458], 99.99th=[1283458] bw ( KiB/s): min= 7, max= 95, per=26.09%, avg=34.70, stdev=18.19, samples=346 iops : min= 1, max= 23, avg= 8.02, stdev= 4.59, samples=346 lat (usec) : 50=0.62%, 100=1.46%, 250=0.07%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.71%, 4=2.18%, 10=6.32%, 20=6.05%, 50=28.22% lat (msec) : 100=31.15%, 250=15.82%, 500=1.07%, 750=0.07%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.05%, sys=3.70%, ctx=6065, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (131kB/s), 31.6KiB/s-32.7KiB/s (32.4kB/s-33.5kB/s), io=23.4MiB (24.6MB), run=184161-187705msec WRITE: bw=134KiB/s (137kB/s), 33.6KiB/s-33.0KiB/s (34.4kB/s-34.8kB/s), io=24.6MiB (25.7MB), run=184161-187705msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178095: Thu Jul 30 03:49:45 2026 read: IOPS=6, BW=25.4KiB/s (26.0kB/s)(5992KiB/235875msec) clat (msec): min=6, max=1301, avg=62.46, stdev=72.00 lat (msec): min=6, max=1301, avg=62.49, stdev=72.04 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 65], 80.00th=[ 93], 90.00th=[ 142], 95.00th=[ 184], | 99.00th=[ 317], 99.50th=[ 405], 99.90th=[ 701], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 6, max= 118, per=26.83%, avg=27.09, stdev=21.34, samples=423 iops : min= 1, max= 29, avg= 6.10, stdev= 5.38, samples=423 write: IOPS=6, BW=26.7KiB/s (27.3kB/s)(6296KiB/235875msec); 0 zone resets clat (msec): min=13, max=1003, avg=90.00, stdev=78.48 lat (msec): min=13, max=1003, avg=90.00, stdev=78.48 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 80], | 70.00th=[ 107], 80.00th=[ 140], 90.00th=[ 182], 95.00th=[ 232], | 99.00th=[ 384], 99.50th=[ 443], 99.90th=[ 735], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 6, max= 88, per=25.86%, avg=27.42, stdev=20.16, samples=440 iops : min= 1, max= 22, avg= 6.17, stdev= 5.07, samples=440 lat (msec) : 10=1.20%, 20=9.54%, 50=39.45%, 100=24.28%, 250=22.75% lat (msec) : 500=2.47%, 750=0.23%, 2000=0.07% cpu : usr=0.03%, sys=1.29%, ctx=4688, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178096: Thu Jul 30 03:49:45 2026 read: IOPS=6, BW=25.2KiB/s (25.8kB/s)(5940KiB/235906msec) clat (msec): min=5, max=1362, avg=62.80, stdev=69.43 lat (msec): min=5, max=1362, avg=62.81, stdev=69.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 50], | 70.00th=[ 66], 80.00th=[ 94], 90.00th=[ 144], 95.00th=[ 190], | 99.00th=[ 288], 99.50th=[ 351], 99.90th=[ 485], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7, max= 112, per=27.20%, avg=27.47, stdev=21.07, samples=414 iops : min= 1, max= 28, avg= 6.19, stdev= 5.33, samples=414 write: IOPS=6, BW=26.9KiB/s (27.6kB/s)(6348KiB/235906msec); 0 zone resets clat (msec): min=10, max=1049, avg=89.46, stdev=76.00 lat (msec): min=10, max=1049, avg=89.46, stdev=76.00 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 80], | 70.00th=[ 105], 80.00th=[ 138], 90.00th=[ 182], 95.00th=[ 232], | 99.00th=[ 372], 99.50th=[ 460], 99.90th=[ 550], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 6, max= 103, per=26.16%, avg=27.73, stdev=20.15, samples=438 iops : min= 1, max= 25, avg= 6.26, stdev= 5.08, samples=438 lat (msec) : 10=0.88%, 20=9.08%, 50=38.90%, 100=25.94%, 250=22.33% lat (msec) : 500=2.67%, 750=0.13%, 2000=0.07% cpu : usr=0.04%, sys=1.45%, ctx=4865, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178097: Thu Jul 30 03:49:45 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6028KiB/235526msec) clat (msec): min=5, max=677, avg=64.28, stdev=67.66 lat (msec): min=5, max=677, avg=64.28, stdev=67.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 51], | 70.00th=[ 68], 80.00th=[ 99], 90.00th=[ 148], 95.00th=[ 197], | 99.00th=[ 342], 99.50th=[ 397], 99.90th=[ 550], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 6, max= 137, per=27.06%, avg=27.33, stdev=21.14, samples=425 iops : min= 1, max= 34, avg= 6.16, stdev= 5.32, samples=425 write: IOPS=6, BW=26.6KiB/s (27.2kB/s)(6260KiB/235526msec); 0 zone resets clat (msec): min=10, max=1352, avg=88.18, stdev=81.68 lat (msec): min=10, max=1352, avg=88.18, stdev=81.68 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 51], 50.00th=[ 61], 60.00th=[ 78], | 70.00th=[ 101], 80.00th=[ 130], 90.00th=[ 180], 95.00th=[ 226], | 99.00th=[ 380], 99.50th=[ 435], 99.90th=[ 986], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 6, max= 111, per=26.12%, avg=27.69, stdev=21.06, samples=435 iops : min= 1, max= 27, avg= 6.24, stdev= 5.32, samples=435 lat (msec) : 10=1.33%, 20=9.41%, 50=39.13%, 100=25.16%, 250=21.91% lat (msec) : 500=2.77%, 750=0.23%, 1000=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.38%, ctx=4701, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178098: Thu Jul 30 03:49:45 2026 read: IOPS=6, BW=25.8KiB/s (26.4kB/s)(6052KiB/234747msec) clat (msec): min=5, max=583, avg=62.29, stdev=67.01 lat (msec): min=5, max=583, avg=62.29, stdev=67.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 48], | 70.00th=[ 64], 80.00th=[ 90], 90.00th=[ 142], 95.00th=[ 201], | 99.00th=[ 313], 99.50th=[ 384], 99.90th=[ 542], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 6, max= 110, per=27.78%, avg=28.06, stdev=21.05, samples=415 iops : min= 1, max= 27, avg= 6.34, stdev= 5.30, samples=415 write: IOPS=6, BW=26.6KiB/s (27.2kB/s)(6236KiB/234747msec); 0 zone resets clat (msec): min=15, max=1344, avg=89.61, stdev=85.94 lat (msec): min=15, max=1344, avg=89.61, stdev=85.95 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 78], | 70.00th=[ 103], 80.00th=[ 133], 90.00th=[ 171], 95.00th=[ 224], | 99.00th=[ 393], 99.50th=[ 558], 99.90th=[ 1045], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7, max= 102, per=26.24%, avg=27.82, stdev=20.23, samples=431 iops : min= 1, max= 25, avg= 6.28, stdev= 5.11, samples=431 lat (msec) : 10=1.37%, 20=9.57%, 50=39.39%, 100=25.23%, 250=21.19% lat (msec) : 500=2.86%, 750=0.33%, 2000=0.07% cpu : usr=0.03%, sys=1.40%, ctx=4890, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=102KiB/s (104kB/s), 25.2KiB/s-25.8KiB/s (25.8kB/s-26.4kB/s), io=23.4MiB (24.6MB), run=234747-235906msec WRITE: bw=107KiB/s (109kB/s), 26.6KiB/s-26.9KiB/s (27.2kB/s-27.6kB/s), io=24.6MiB (25.7MB), run=234747-235906msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178158: Thu Jul 30 03:50:43 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(5920KiB/45347msec) clat (usec): min=34, max=373607, avg=64186.83, stdev=47636.26 lat (usec): min=34, max=373607, avg=64187.83, stdev=47636.23 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 77], 20.00th=[ 28967], | 30.00th=[ 38536], 40.00th=[ 48497], 50.00th=[ 56886], 60.00th=[ 68682], | 70.00th=[ 80217], 80.00th=[ 93848], 90.00th=[116917], 95.00th=[147850], | 99.00th=[252707], 99.50th=[270533], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 30, max= 281, per=24.35%, avg=128.33, stdev=52.70, samples=88 iops : min= 1, max= 17, avg= 7.25, stdev= 3.35, samples=88 write: IOPS=8, BW=140KiB/s (144kB/s)(6368KiB/45347msec); 0 zone resets clat (usec): min=1416, max=284181, avg=54142.97, stdev=54031.50 lat (usec): min=1430, max=284183, avg=54146.10, stdev=54031.15 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1893], 10.00th=[ 4359], 20.00th=[ 9503], | 30.00th=[ 16581], 40.00th=[ 28705], 50.00th=[ 38536], 60.00th=[ 47973], | 70.00th=[ 61080], 80.00th=[ 89654], 90.00th=[137364], 95.00th=[162530], | 99.00th=[265290], 99.50th=[270533], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 30, max= 348, per=25.65%, avg=142.35, stdev=69.19, samples=86 iops : min= 1, max= 21, avg= 8.13, stdev= 4.40, samples=86 lat (usec) : 50=0.78%, 100=4.69%, 500=0.13% lat (msec) : 2=3.39%, 4=1.69%, 10=5.86%, 20=7.55%, 50=27.99% lat (msec) : 100=30.73%, 250=16.15%, 500=1.04% cpu : usr=0.07%, sys=4.32%, ctx=1607, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178159: Thu Jul 30 03:50:43 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5744KiB/45371msec) clat (usec): min=52, max=317590, avg=71294.87, stdev=48086.82 lat (usec): min=53, max=317592, avg=71295.96, stdev=48086.87 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 22938], 20.00th=[ 35914], | 30.00th=[ 44827], 40.00th=[ 52167], 50.00th=[ 61080], 60.00th=[ 73925], | 70.00th=[ 86508], 80.00th=[101188], 90.00th=[135267], 95.00th=[170918], | 99.00th=[214959], 99.50th=[283116], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 27, max= 375, per=23.95%, avg=126.22, stdev=58.32, samples=87 iops : min= 1, max= 23, avg= 7.11, stdev= 3.71, samples=87 write: IOPS=9, BW=144KiB/s (148kB/s)(6544KiB/45371msec); 0 zone resets clat (usec): min=1325, max=237584, avg=48216.85, stdev=47540.53 lat (usec): min=1325, max=237585, avg=48223.90, stdev=47538.95 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1860], 10.00th=[ 3195], 20.00th=[ 9765], | 30.00th=[ 15401], 40.00th=[ 22676], 50.00th=[ 31589], 60.00th=[ 44303], | 70.00th=[ 60556], 80.00th=[ 84411], 90.00th=[122160], 95.00th=[141558], | 99.00th=[208667], 99.50th=[219153], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 29, max= 351, per=26.34%, avg=146.16, stdev=70.36, samples=86 iops : min= 1, max= 21, avg= 8.38, stdev= 4.45, samples=86 lat (usec) : 100=2.86%, 250=0.13% lat (msec) : 2=3.65%, 4=2.99%, 10=4.56%, 20=8.85%, 50=28.13% lat (msec) : 100=31.38%, 250=17.19%, 500=0.26% cpu : usr=0.07%, sys=4.20%, ctx=1704, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178160: Thu Jul 30 03:50:43 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6256KiB/44771msec) clat (usec): min=37, max=299577, avg=63736.59, stdev=47684.57 lat (usec): min=37, max=299578, avg=63739.60, stdev=47682.47 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 151], 20.00th=[ 27395], | 30.00th=[ 37487], 40.00th=[ 47973], 50.00th=[ 55837], 60.00th=[ 64750], | 70.00th=[ 79168], 80.00th=[ 93848], 90.00th=[119014], 95.00th=[145753], | 99.00th=[254804], 99.50th=[283116], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 30, max= 279, per=26.80%, avg=141.26, stdev=60.45, samples=86 iops : min= 1, max= 17, avg= 8.06, stdev= 3.81, samples=86 write: IOPS=8, BW=135KiB/s (138kB/s)(6032KiB/44771msec); 0 zone resets clat (usec): min=1362, max=365272, avg=52502.70, stdev=53858.07 lat (usec): min=1364, max=365274, avg=52508.14, stdev=53855.37 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1926], 10.00th=[ 5407], 20.00th=[ 10159], | 30.00th=[ 17695], 40.00th=[ 23462], 50.00th=[ 34866], 60.00th=[ 47449], | 70.00th=[ 64750], 80.00th=[ 90702], 90.00th=[122160], 95.00th=[154141], | 99.00th=[238027], 99.50th=[299893], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 30, max= 286, per=24.14%, avg=134.00, stdev=62.06, samples=86 iops : min= 1, max= 17, avg= 7.62, stdev= 3.95, samples=86 lat (usec) : 50=0.39%, 100=4.56%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.99%, 4=1.43%, 10=5.60%, 20=8.46%, 50=28.26% lat (msec) : 100=31.38%, 250=15.49%, 500=0.91% cpu : usr=0.06%, sys=4.35%, ctx=1621, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178161: Thu Jul 30 03:50:43 2026 read: IOPS=8, BW=141KiB/s (144kB/s)(6032KiB/42917msec) clat (usec): min=43, max=276118, avg=60049.40, stdev=44696.42 lat (usec): min=44, max=276119, avg=60050.86, stdev=44696.59 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 69], 20.00th=[ 23987], | 30.00th=[ 36963], 40.00th=[ 44827], 50.00th=[ 54789], 60.00th=[ 65799], | 70.00th=[ 74974], 80.00th=[ 94897], 90.00th=[115868], 95.00th=[137364], | 99.00th=[206570], 99.50th=[267387], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 351, per=26.81%, avg=141.27, stdev=61.96, samples=82 iops : min= 1, max= 21, avg= 8.07, stdev= 3.93, samples=82 write: IOPS=9, BW=146KiB/s (149kB/s)(6256KiB/42917msec); 0 zone resets clat (usec): min=1042, max=312095, avg=51704.78, stdev=52839.00 lat (usec): min=1043, max=312098, avg=51706.56, stdev=52839.10 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1991], 10.00th=[ 4490], 20.00th=[ 9634], | 30.00th=[ 13698], 40.00th=[ 20055], 50.00th=[ 34866], 60.00th=[ 50070], | 70.00th=[ 63701], 80.00th=[ 89654], 90.00th=[132645], 95.00th=[156238], | 99.00th=[219153], 99.50th=[278922], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 30, max= 351, per=26.33%, avg=146.13, stdev=66.71, samples=83 iops : min= 1, max= 21, avg= 8.36, stdev= 4.24, samples=83 lat (usec) : 50=0.52%, 100=5.21%, 250=0.78%, 1000=0.13% lat (msec) : 2=2.73%, 4=2.34%, 10=6.51%, 20=10.55%, 50=23.83% lat (msec) : 100=31.38%, 250=15.36%, 500=0.65% cpu : usr=0.03%, sys=4.32%, ctx=1604, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=528KiB/s (541kB/s), 127KiB/s-141KiB/s (130kB/s-144kB/s), io=23.4MiB (24.5MB), run=42917-45371msec WRITE: bw=555KiB/s (569kB/s), 135KiB/s-146KiB/s (138kB/s-149kB/s), io=24.6MiB (25.8MB), run=42917-45371msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178153: Thu Jul 30 03:51:02 2026 read: IOPS=5, BW=91.9KiB/s (94.1kB/s)(5920KiB/64398msec) clat (msec): min=10, max=334, avg=69.12, stdev=54.68 lat (msec): min=10, max=334, avg=69.14, stdev=54.70 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 20], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 93], 90.00th=[ 128], 95.00th=[ 197], | 99.00th=[ 288], 99.50th=[ 330], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 288, per=25.84%, avg=95.86, stdev=56.01, samples=119 iops : min= 1, max= 18, avg= 5.19, stdev= 3.58, samples=119 write: IOPS=6, BW=98.9KiB/s (101kB/s)(6368KiB/64398msec); 0 zone resets clat (msec): min=23, max=502, avg=96.91, stdev=65.02 lat (msec): min=23, max=502, avg=96.91, stdev=65.02 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 48], | 30.00th=[ 57], 40.00th=[ 69], 50.00th=[ 80], 60.00th=[ 92], | 70.00th=[ 106], 80.00th=[ 138], 90.00th=[ 176], 95.00th=[ 228], | 99.00th=[ 359], 99.50th=[ 409], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 31, max= 223, per=25.76%, avg=100.48, stdev=50.53, samples=123 iops : min= 1, max= 13, avg= 5.49, stdev= 3.16, samples=123 lat (msec) : 20=2.47%, 50=32.55%, 100=39.32%, 250=23.18%, 500=2.34% lat (msec) : 750=0.13% cpu : usr=0.04%, sys=1.44%, ctx=1249, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178154: Thu Jul 30 03:51:02 2026 read: IOPS=5, BW=89.1KiB/s (91.3kB/s)(5744KiB/64447msec) clat (msec): min=7, max=291, avg=69.19, stdev=49.14 lat (msec): min=7, max=291, avg=69.19, stdev=49.14 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 19], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 40], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 94], 90.00th=[ 136], 95.00th=[ 174], | 99.00th=[ 264], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 316, per=24.96%, avg=92.61, stdev=56.24, samples=122 iops : min= 1, max= 19, avg= 4.99, stdev= 3.55, samples=122 write: IOPS=6, BW=102KiB/s (104kB/s)(6544KiB/64447msec); 0 zone resets clat (msec): min=16, max=505, avg=96.35, stdev=67.49 lat (msec): min=16, max=505, avg=96.36, stdev=67.49 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 37], 20.00th=[ 45], | 30.00th=[ 56], 40.00th=[ 67], 50.00th=[ 78], 60.00th=[ 89], | 70.00th=[ 111], 80.00th=[ 136], 90.00th=[ 178], 95.00th=[ 241], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 30, max= 287, per=26.35%, avg=102.75, stdev=57.23, samples=125 iops : min= 1, max= 17, avg= 5.63, stdev= 3.61, samples=125 lat (msec) : 10=0.13%, 20=2.47%, 50=29.82%, 100=40.62%, 250=24.22% lat (msec) : 500=2.60%, 750=0.13% cpu : usr=0.03%, sys=1.33%, ctx=1257, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178155: Thu Jul 30 03:51:02 2026 read: IOPS=6, BW=98.6KiB/s (101kB/s)(6256KiB/63419msec) clat (msec): min=9, max=360, avg=64.95, stdev=52.66 lat (msec): min=9, max=360, avg=64.96, stdev=52.67 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 18], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 87], 90.00th=[ 124], 95.00th=[ 174], | 99.00th=[ 326], 99.50th=[ 338], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 316, per=28.11%, avg=104.27, stdev=64.28, samples=118 iops : min= 1, max= 19, avg= 5.71, stdev= 4.08, samples=118 write: IOPS=5, BW=95.1KiB/s (97.4kB/s)(6032KiB/63419msec); 0 zone resets clat (msec): min=21, max=406, avg=100.28, stdev=66.32 lat (msec): min=21, max=406, avg=100.29, stdev=66.32 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 34], 10.00th=[ 40], 20.00th=[ 50], | 30.00th=[ 57], 40.00th=[ 66], 50.00th=[ 82], 60.00th=[ 96], | 70.00th=[ 112], 80.00th=[ 142], 90.00th=[ 194], 95.00th=[ 234], | 99.00th=[ 355], 99.50th=[ 384], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 288, per=24.25%, avg=94.58, stdev=52.24, samples=125 iops : min= 1, max= 18, avg= 5.12, stdev= 3.32, samples=125 lat (msec) : 10=0.13%, 20=2.86%, 50=33.07%, 100=38.15%, 250=22.92% lat (msec) : 500=2.86% cpu : usr=0.03%, sys=1.37%, ctx=1259, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178156: Thu Jul 30 03:51:02 2026 read: IOPS=5, BW=93.5KiB/s (95.8kB/s)(6032KiB/64508msec) clat (msec): min=8, max=341, avg=70.30, stdev=54.71 lat (msec): min=8, max=341, avg=70.30, stdev=54.71 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 19], 10.00th=[ 24], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 65], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 140], 95.00th=[ 192], | 99.00th=[ 288], 99.50th=[ 338], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 256, per=26.37%, avg=97.82, stdev=55.92, samples=120 iops : min= 1, max= 16, avg= 5.33, stdev= 3.56, samples=120 write: IOPS=6, BW=96.0KiB/s (99.3kB/s)(6256KiB/64508msec); 0 zone resets clat (msec): min=13, max=449, avg=97.06, stdev=63.53 lat (msec): min=13, max=449, avg=97.06, stdev=63.53 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 32], 10.00th=[ 40], 20.00th=[ 49], | 30.00th=[ 56], 40.00th=[ 67], 50.00th=[ 81], 60.00th=[ 95], | 70.00th=[ 110], 80.00th=[ 138], 90.00th=[ 186], 95.00th=[ 230], | 99.00th=[ 321], 99.50th=[ 355], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 30, max= 314, per=25.43%, avg=99.16, stdev=52.96, samples=124 iops : min= 1, max= 19, avg= 5.40, stdev= 3.35, samples=124 lat (msec) : 10=0.26%, 20=3.39%, 50=29.30%, 100=39.97%, 250=24.35% lat (msec) : 500=2.73% cpu : usr=0.02%, sys=1.41%, ctx=1272, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=371KiB/s (380kB/s), 89.1KiB/s-98.6KiB/s (91.3kB/s-101kB/s), io=23.4MiB (24.5MB), run=63419-64508msec WRITE: bw=391KiB/s (400kB/s), 95.1KiB/s-102KiB/s (97.4kB/s-104kB/s), io=24.6MiB (25.8MB), run=63419-64508msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178182: Thu Jul 30 03:51:27 2026 read: IOPS=1, BW=1105KiB/s (1131kB/s)(7168KiB/6489msec) clat (msec): min=7, max=703, avg=324.23, stdev=206.36 lat (msec): min=7, max=703, avg=324.23, stdev=206.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 255], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 317], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 380], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1950, max= 4031, per=100.00%, avg=2952.00, stdev=1135.71, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=789KiB/s (808kB/s)(5120KiB/6489msec); 0 zone resets clat (msec): min=361, max=1698, avg=730.92, stdev=546.28 lat (msec): min=361, max=1698, avg=730.98, stdev=546.29 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1910, max= 2015, per=54.59%, avg=1969.75, stdev=53.57, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 10=8.33%, 500=58.33%, 750=25.00%, 2000=8.33% cpu : usr=0.03%, sys=6.72%, ctx=192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178183: Thu Jul 30 03:51:27 2026 read: IOPS=0, BW=258KiB/s (264kB/s)(2048KiB/7945msec) clat (usec): min=448, max=314782, avg=157615.81, stdev=222267.54 lat (usec): min=449, max=314784, avg=157617.37, stdev=222268.33 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 449], | 30.00th=[ 449], 40.00th=[ 449], 50.00th=[ 449], 60.00th=[316670], | 70.00th=[316670], 80.00th=[316670], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 1992, max= 2015, per=77.75%, avg=2003.50, stdev=16.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1289KiB/s (1320kB/s)(10.0MiB/7945msec); 0 zone resets clat (msec): min=276, max=1430, avg=721.72, stdev=363.26 lat (msec): min=276, max=1430, avg=721.79, stdev=363.25 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 435], | 30.00th=[ 439], 40.00th=[ 439], 50.00th=[ 542], 60.00th=[ 810], | 70.00th=[ 818], 80.00th=[ 919], 90.00th=[ 1116], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 1910, max= 2039, per=54.87%, avg=1979.56, stdev=52.14, samples=9 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=9 lat (usec) : 500=8.33% lat (msec) : 500=41.67%, 750=8.33%, 1000=25.00%, 2000=16.67% cpu : usr=0.00%, sys=5.73%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178184: Thu Jul 30 03:51:27 2026 read: IOPS=1, BW=1179KiB/s (1207kB/s)(6144KiB/5213msec) clat (msec): min=2, max=479, avg=150.66, stdev=195.51 lat (msec): min=2, max=479, avg=150.67, stdev=195.51 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 44], 50.00th=[ 44], 60.00th=[ 72], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1932, max= 3835, per=94.23%, avg=2428.25, stdev=938.44, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1179KiB/s (1207kB/s)(6144KiB/5213msec); 0 zone resets clat (msec): min=318, max=1147, avg=628.57, stdev=348.07 lat (msec): min=318, max=1147, avg=628.65, stdev=348.08 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 514], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1910, max= 2007, per=54.13%, avg=1953.00, stdev=44.10, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 4=8.33%, 10=8.33%, 50=8.33%, 100=8.33%, 500=41.67% lat (msec) : 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.73%, ctx=149, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178185: Thu Jul 30 03:51:27 2026 read: IOPS=0, BW=746KiB/s (764kB/s)(5120KiB/6861msec) clat (usec): min=417, max=690349, avg=259231.50, stdev=355607.85 lat (usec): min=418, max=690350, avg=259232.48, stdev=355607.69 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], 20.00th=[ 416], | 30.00th=[ 498], 40.00th=[ 498], 50.00th=[ 529], 60.00th=[ 529], | 70.00th=[608175], 80.00th=[608175], 90.00th=[692061], 95.00th=[692061], | 99.00th=[692061], 99.50th=[692061], 99.90th=[692061], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 4015, max= 4031, per=100.00%, avg=4023.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1045KiB/s (1070kB/s)(7168KiB/6861msec); 0 zone resets clat (msec): min=334, max=1491, avg=763.20, stdev=473.13 lat (msec): min=335, max=1491, avg=763.27, stdev=473.14 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 372], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 617], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 1351], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 1695, max= 3900, per=63.06%, avg=2275.20, stdev=913.89, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 500=25.00%, 750=33.33%, 2000=16.67% cpu : usr=0.00%, sys=5.58%, ctx=144, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2578KiB/s (2640kB/s), 258KiB/s-1179KiB/s (264kB/s-1207kB/s), io=20.0MiB (20.0MB), run=5213-7945msec WRITE: bw=3609KiB/s (3695kB/s), 789KiB/s-1289KiB/s (808kB/s-1320kB/s), io=28.0MiB (29.4MB), run=5213-7945msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178177: Thu Jul 30 03:51:29 2026 read: IOPS=1, BW=1214KiB/s (1243kB/s)(7168KiB/5906msec) clat (msec): min=126, max=1050, avg=363.51, stdev=318.89 lat (msec): min=126, max=1050, avg=363.51, stdev=318.89 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 159], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 249], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 384], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1718, max= 4047, per=100.00%, avg=2962.75, stdev=1258.82, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=867KiB/s (888kB/s)(5120KiB/5906msec); 0 zone resets clat (msec): min=165, max=1469, avg=623.24, stdev=531.40 lat (msec): min=165, max=1469, avg=623.32, stdev=531.39 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1954, max= 2035, per=64.50%, avg=2000.75, stdev=33.85, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=0.95%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178178: Thu Jul 30 03:51:29 2026 read: IOPS=0, BW=222KiB/s (227kB/s)(2048KiB/9241msec) clat (msec): min=232, max=726, avg=479.44, stdev=349.00 lat (msec): min=232, max=726, avg=479.44, stdev=349.00 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1914, max= 2007, per=88.47%, avg=1960.50, stdev=65.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1108KiB/s (1135kB/s)(10.0MiB/9241msec); 0 zone resets clat (msec): min=176, max=1511, avg=810.92, stdev=426.85 lat (msec): min=176, max=1511, avg=811.00, stdev=426.85 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 401], | 30.00th=[ 468], 40.00th=[ 609], 50.00th=[ 751], 60.00th=[ 760], | 70.00th=[ 927], 80.00th=[ 1200], 90.00th=[ 1301], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1954, max= 2048, per=65.29%, avg=2025.33, stdev=28.38, samples=9 iops : min= 1, max= 2, avg= 1.22, stdev= 0.44, samples=9 lat (msec) : 250=16.67%, 500=16.67%, 750=16.67%, 1000=25.00%, 2000=25.00% cpu : usr=0.00%, sys=3.31%, ctx=114, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178180: Thu Jul 30 03:51:29 2026 read: IOPS=0, BW=753KiB/s (771kB/s)(6144KiB/8160msec) clat (msec): min=127, max=1459, avg=505.50, stdev=496.00 lat (msec): min=127, max=1459, avg=505.50, stdev=496.00 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 506], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1954, max= 2039, per=90.64%, avg=2008.60, stdev=35.66, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=753KiB/s (771kB/s)(6144KiB/8160msec); 0 zone resets clat (msec): min=241, max=1198, avg=813.84, stdev=352.29 lat (msec): min=241, max=1198, avg=813.91, stdev=352.29 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1875, max= 2039, per=64.06%, avg=1987.00, stdev=63.82, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 750=25.00%, 1000=16.67%, 2000=25.00% cpu : usr=0.01%, sys=2.49%, ctx=104, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178181: Thu Jul 30 03:51:29 2026 read: IOPS=0, BW=974KiB/s (998kB/s)(5120KiB/5256msec) clat (msec): min=163, max=749, avg=424.23, stdev=265.19 lat (msec): min=163, max=749, avg=424.23, stdev=265.19 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2007, max= 6071, per=100.00%, avg=4039.00, stdev=2873.68, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1364KiB/s (1397kB/s)(7168KiB/5256msec); 0 zone resets clat (msec): min=239, max=953, avg=440.10, stdev=243.90 lat (msec): min=239, max=953, avg=440.37, stdev=243.80 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 275], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 401], | 70.00th=[ 401], 80.00th=[ 523], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1954, max= 4071, per=86.76%, avg=2691.20, stdev=999.84, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=1.98%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2216KiB/s (2269kB/s), 222KiB/s-1214KiB/s (227kB/s-1243kB/s), io=20.0MiB (20.0MB), run=5256-9241msec WRITE: bw=3103KiB/s (3177kB/s), 753KiB/s-1364KiB/s (771kB/s-1397kB/s), io=28.0MiB (29.4MB), run=5256-9241msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178196: Thu Jul 30 03:51:54 2026 read: IOPS=0, BW=1856KiB/s (1901kB/s)(12.0MiB/6620msec) clat (msec): min=994, max=4139, avg=2167.38, stdev=1717.92 lat (msec): min=994, max=4139, avg=2167.38, stdev=1717.92 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 4144], 80.00th=[ 4144], 90.00th=[ 4144], 95.00th=[ 4144], | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4144], 99.95th=[ 4144], | 99.99th=[ 4144] bw ( KiB/s): min= 8031, max= 8175, per=100.00%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.27%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178197: Thu Jul 30 03:51:54 2026 read: IOPS=0, BW=614KiB/s (629kB/s)(4096KiB/6669msec) clat (nsec): min=3277.7M, max=3277.7M, avg=3277651605.00, stdev= 0.00 lat (nsec): min=3277.7M, max=3277.7M, avg=3277653792.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3272], 5.00th=[ 3272], 10.00th=[ 3272], 20.00th=[ 3272], | 30.00th=[ 3272], 40.00th=[ 3272], 50.00th=[ 3272], 60.00th=[ 3272], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1228KiB/s (1258kB/s)(8192KiB/6669msec); 0 zone resets clat (msec): min=1041, max=2209, avg=1625.52, stdev=826.18 lat (msec): min=1041, max=2209, avg=1625.75, stdev=826.05 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.65%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178198: Thu Jul 30 03:51:54 2026 write: IOPS=0, BW=1464KiB/s (1500kB/s)(12.0MiB/8391msec); 0 zone resets clat (msec): min=503, max=5204, avg=2755.68, stdev=2357.06 lat (msec): min=503, max=5205, avg=2756.00, stdev=2357.02 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 2567], 50.00th=[ 2567], 60.00th=[ 2567], | 70.00th=[ 5201], 80.00th=[ 5201], 90.00th=[ 5201], 95.00th=[ 5201], | 99.00th=[ 5201], 99.50th=[ 5201], 99.90th=[ 5201], 99.95th=[ 5201], | 99.99th=[ 5201] bw ( KiB/s): min= 7984, max= 8015, per=100.00%, avg=7999.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=1.54%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178201: Thu Jul 30 03:51:54 2026 write: IOPS=0, BW=1705KiB/s (1746kB/s)(12.0MiB/7205msec); 0 zone resets clat (msec): min=310, max=3588, avg=2299.75, stdev=1747.88 lat (msec): min=310, max=3592, avg=2301.27, stdev=1748.80 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 3004], 50.00th=[ 3004], 60.00th=[ 3004], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.03%, sys=1.60%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2457KiB/s (2516kB/s), 614KiB/s-1856KiB/s (629kB/s-1901kB/s), io=16.0MiB (16.8MB), run=6620-6669msec WRITE: bw=3905KiB/s (3999kB/s), 1228KiB/s-1705KiB/s (1258kB/s-1746kB/s), io=32.0MiB (33.6MB), run=6669-8391msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178199: Thu Jul 30 03:51:54 2026 read: IOPS=0, BW=1733KiB/s (1774kB/s)(12.0MiB/7091msec) clat (msec): min=1311, max=3744, avg=2251.59, stdev=1306.96 lat (msec): min=1311, max=3744, avg=2251.59, stdev=1306.96 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1703], 50.00th=[ 1703], 60.00th=[ 1703], | 70.00th=[ 3742], 80.00th=[ 3742], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 7953, max= 8094, per=100.00%, avg=8023.50, stdev=99.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.07%, sys=4.26%, ctx=283, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178200: Thu Jul 30 03:51:54 2026 read: IOPS=0, BW=538KiB/s (551kB/s)(4096KiB/7615msec) clat (nsec): min=4054.4M, max=4054.4M, avg=4054368885.00, stdev= 0.00 lat (nsec): min=4054.4M, max=4054.4M, avg=4054370669.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4044], 5.00th=[ 4044], 10.00th=[ 4044], 20.00th=[ 4044], | 30.00th=[ 4044], 40.00th=[ 4044], 50.00th=[ 4044], 60.00th=[ 4044], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1076KiB/s (1102kB/s)(8192KiB/7615msec); 0 zone resets clat (msec): min=1212, max=2259, avg=1736.07, stdev=740.52 lat (msec): min=1212, max=2259, avg=1736.30, stdev=740.61 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 2265], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=33.33%, >=2000=66.67% cpu : usr=0.07%, sys=2.80%, ctx=334, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178202: Thu Jul 30 03:51:54 2026 write: IOPS=0, BW=1426KiB/s (1460kB/s)(12.0MiB/8618msec); 0 zone resets clat (msec): min=301, max=5477, avg=2818.29, stdev=2590.75 lat (msec): min=301, max=5477, avg=2818.60, stdev=2590.74 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 2668], 50.00th=[ 2668], 60.00th=[ 2668], | 70.00th=[ 5470], 80.00th=[ 5470], 90.00th=[ 5470], 95.00th=[ 5470], | 99.00th=[ 5470], 99.50th=[ 5470], 99.90th=[ 5470], 99.95th=[ 5470], | 99.99th=[ 5470] bw ( KiB/s): min= 7816, max= 8159, per=100.00%, avg=7987.50, stdev=242.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=1.29%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178203: Thu Jul 30 03:51:54 2026 write: IOPS=0, BW=1642KiB/s (1681kB/s)(12.0MiB/7484msec); 0 zone resets clat (msec): min=227, max=3605, avg=2386.78, stdev=1874.88 lat (msec): min=228, max=3621, avg=2392.51, stdev=1880.07 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 3339], 50.00th=[ 3339], 60.00th=[ 3339], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 7953, max= 8175, per=100.00%, avg=8064.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, >=2000=66.67% cpu : usr=0.04%, sys=1.30%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2152KiB/s (2203kB/s), 538KiB/s-1733KiB/s (551kB/s-1774kB/s), io=16.0MiB (16.8MB), run=7091-7615msec WRITE: bw=3802KiB/s (3894kB/s), 1076KiB/s-1642KiB/s (1102kB/s-1681kB/s), io=32.0MiB (33.6MB), run=7484-8618msec