== sanity test 398b: DIO and buffer IO race ============== 14:52:38 (1780339958) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.77743 s, 7.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179960: Mon Jun 1 14:55:15 2026 read: IOPS=11, BW=44.6KiB/s (45.6kB/s)(5992KiB/134486msec) clat (usec): min=34, max=1008.7k, avg=50719.90, stdev=40111.34 lat (usec): min=34, max=1008.7k, avg=50726.46, stdev=40110.70 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11731], 10.00th=[ 20055], | 20.00th=[ 26084], 30.00th=[ 32113], 40.00th=[ 38011], | 50.00th=[ 43779], 60.00th=[ 50594], 70.00th=[ 59507], | 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[ 106431], | 99.00th=[ 168821], 99.50th=[ 193987], 99.90th=[ 250610], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 95, per=25.56%, avg=44.48, stdev=17.45, samples=262 iops : min= 1, max= 23, avg=10.44, stdev= 4.39, samples=262 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6296KiB/134486msec); 0 zone resets clat (usec): min=1130, max=319700, avg=36872.81, stdev=38970.75 lat (usec): min=1130, max=319701, avg=36887.00, stdev=38969.19 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1549], 20.00th=[ 4113], | 30.00th=[ 7898], 40.00th=[ 16909], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 47973], 80.00th=[ 64750], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[175113], 99.50th=[206570], 99.90th=[242222], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 5, max= 110, per=25.33%, avg=46.36, stdev=21.09, samples=264 iops : min= 1, max= 27, avg=10.92, stdev= 5.31, samples=264 lat (usec) : 50=0.23%, 100=1.82%, 250=0.10%, 500=0.03% lat (msec) : 2=6.38%, 4=3.78%, 10=7.19%, 20=7.52%, 50=38.48% lat (msec) : 100=27.60%, 250=6.77%, 500=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.10%, ctx=6494, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179961: Mon Jun 1 14:55:15 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(5940KiB/133382msec) clat (usec): min=38, max=1034.8k, avg=49646.23, stdev=41023.53 lat (usec): min=38, max=1034.8k, avg=49650.20, stdev=41023.18 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12649], 10.00th=[ 19006], | 20.00th=[ 25822], 30.00th=[ 30802], 40.00th=[ 35390], | 50.00th=[ 41681], 60.00th=[ 49021], 70.00th=[ 58983], | 80.00th=[ 69731], 90.00th=[ 87557], 95.00th=[ 106431], | 99.00th=[ 170918], 99.50th=[ 210764], 99.90th=[ 312476], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=44.18, stdev=17.55, samples=262 iops : min= 1, max= 29, avg=10.37, stdev= 4.42, samples=262 write: IOPS=11, BW=47.6KiB/s (48.7kB/s)(6348KiB/133382msec); 0 zone resets clat (usec): min=1087, max=226419, avg=37271.76, stdev=38728.14 lat (usec): min=1088, max=226422, avg=37282.76, stdev=38728.71 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1418], 10.00th=[ 1844], 20.00th=[ 4113], | 30.00th=[ 7308], 40.00th=[ 15401], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 48497], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[115868], | 99.00th=[170918], 99.50th=[189793], 99.90th=[223347], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 7, max= 159, per=25.89%, avg=47.37, stdev=22.10, samples=261 iops : min= 1, max= 39, avg=11.17, stdev= 5.56, samples=261 lat (usec) : 50=0.20%, 100=1.46%, 250=0.03%, 1000=0.03% lat (msec) : 2=5.66%, 4=4.36%, 10=7.65%, 20=8.56%, 50=37.92% lat (msec) : 100=27.25%, 250=6.77%, 500=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.24%, ctx=6499, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179962: Mon Jun 1 14:55:15 2026 read: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6028KiB/135489msec) clat (usec): min=41, max=234709, avg=50276.85, stdev=31798.59 lat (usec): min=42, max=234710, avg=50286.95, stdev=31797.38 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12256], 10.00th=[ 18744], 20.00th=[ 26084], | 30.00th=[ 31851], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 61604], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[160433], 99.50th=[179307], 99.90th=[229639], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 87, per=25.37%, avg=44.14, stdev=16.53, samples=266 iops : min= 1, max= 21, avg=10.35, stdev= 4.14, samples=266 write: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6260KiB/135489msec); 0 zone resets clat (usec): min=1025, max=976643, avg=37828.54, stdev=45005.43 lat (usec): min=1027, max=976644, avg=37834.71, stdev=45004.22 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1385], 10.00th=[ 1795], 20.00th=[ 4228], | 30.00th=[ 7832], 40.00th=[ 16581], 50.00th=[ 25822], 60.00th=[ 35914], | 70.00th=[ 49546], 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[116917], | 99.00th=[158335], 99.50th=[175113], 99.90th=[244319], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 111, per=25.09%, avg=45.92, stdev=20.39, samples=265 iops : min= 1, max= 27, avg=10.81, stdev= 5.14, samples=265 lat (usec) : 50=0.16%, 100=1.82%, 250=0.07%, 1000=0.03% lat (msec) : 2=5.89%, 4=3.91%, 10=7.10%, 20=9.05%, 50=36.10% lat (msec) : 100=28.65%, 250=7.19%, 1000=0.03% cpu : usr=0.09%, sys=4.99%, ctx=6491, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179963: Mon Jun 1 14:55:15 2026 read: IOPS=11, BW=44.1KiB/s (45.1kB/s)(6052KiB/137350msec) clat (usec): min=35, max=1018.0k, avg=50482.28, stdev=41299.06 lat (usec): min=35, max=1018.0k, avg=50484.11, stdev=41299.80 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10159], 10.00th=[ 17957], | 20.00th=[ 25560], 30.00th=[ 31327], 40.00th=[ 36439], | 50.00th=[ 42730], 60.00th=[ 50594], 70.00th=[ 60031], | 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[ 108528], | 99.00th=[ 168821], 99.50th=[ 210764], 99.90th=[ 270533], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 111, per=25.11%, avg=43.70, stdev=17.87, samples=270 iops : min= 1, max= 27, avg=10.25, stdev= 4.49, samples=270 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6236KiB/137350msec); 0 zone resets clat (usec): min=1073, max=315151, avg=38818.94, stdev=38995.73 lat (usec): min=1076, max=315153, avg=38822.35, stdev=38995.87 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1942], 20.00th=[ 4948], | 30.00th=[ 9765], 40.00th=[ 19006], 50.00th=[ 29230], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 64226], 90.00th=[ 99091], 95.00th=[116917], | 99.00th=[156238], 99.50th=[183501], 99.90th=[265290], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 119, per=24.61%, avg=45.03, stdev=21.54, samples=270 iops : min= 1, max= 29, avg=10.58, stdev= 5.41, samples=270 lat (usec) : 50=0.26%, 100=1.73%, 250=0.07%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.18%, 4=3.48%, 10=6.87%, 20=9.15%, 50=38.28% lat (msec) : 100=26.56%, 250=8.04%, 500=0.16%, 2000=0.03% cpu : usr=0.09%, sys=4.99%, ctx=6631, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=175KiB/s (179kB/s), 44.1KiB/s-44.6KiB/s (45.1kB/s-45.6kB/s), io=23.4MiB (24.6MB), run=133382-137350msec WRITE: bw=183KiB/s (187kB/s), 45.4KiB/s-47.6KiB/s (46.5kB/s-48.7kB/s), io=24.6MiB (25.7MB), run=133382-137350msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179965: Mon Jun 1 14:56:07 2026 read: IOPS=7, BW=31.9KiB/s (32.7kB/s)(5992KiB/187780msec) clat (msec): min=6, max=1093, avg=48.74, stdev=49.68 lat (msec): min=6, max=1093, avg=48.75, stdev=49.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 106], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 241], 99.90th=[ 321], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 119, per=25.52%, avg=32.41, stdev=21.69, samples=359 iops : min= 1, max= 29, avg= 7.45, stdev= 5.47, samples=359 write: IOPS=8, BW=33.5KiB/s (34.3kB/s)(6296KiB/187780msec); 0 zone resets clat (msec): min=11, max=447, avg=72.80, stdev=49.01 lat (msec): min=11, max=447, avg=72.80, stdev=49.01 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 107], 90.00th=[ 136], 95.00th=[ 169], | 99.00th=[ 251], 99.50th=[ 284], 99.90th=[ 397], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 102, per=25.11%, avg=33.39, stdev=20.14, samples=366 iops : min= 1, max= 25, avg= 7.69, stdev= 5.11, samples=366 lat (msec) : 10=0.94%, 20=11.43%, 50=42.81%, 100=27.25%, 250=16.89% lat (msec) : 500=0.65%, 2000=0.03% cpu : usr=0.06%, sys=2.00%, ctx=5117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179966: Mon Jun 1 14:56:07 2026 read: IOPS=7, BW=31.8KiB/s (32.5kB/s)(5940KiB/186929msec) clat (msec): min=5, max=1047, avg=48.14, stdev=48.52 lat (msec): min=5, max=1047, avg=48.14, stdev=48.52 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 69], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 201], 99.50th=[ 220], 99.90th=[ 355], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 128, per=25.38%, avg=32.24, stdev=21.86, samples=357 iops : min= 1, max= 32, avg= 7.40, stdev= 5.54, samples=357 write: IOPS=8, BW=33.0KiB/s (34.8kB/s)(6348KiB/186929msec); 0 zone resets clat (msec): min=11, max=458, avg=72.63, stdev=48.98 lat (msec): min=11, max=458, avg=72.63, stdev=48.98 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 85], 80.00th=[ 103], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 241], 99.50th=[ 292], 99.90th=[ 384], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=33.75, stdev=19.59, samples=365 iops : min= 1, max= 25, avg= 7.78, stdev= 4.96, samples=365 lat (msec) : 10=1.04%, 20=10.38%, 50=44.04%, 100=28.22%, 250=15.82% lat (msec) : 500=0.46%, 2000=0.03% cpu : usr=0.06%, sys=1.98%, ctx=4989, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179967: Mon Jun 1 14:56:07 2026 read: IOPS=7, BW=31.0KiB/s (32.8kB/s)(6028KiB/188474msec) clat (msec): min=6, max=438, avg=49.45, stdev=43.20 lat (msec): min=6, max=438, avg=49.45, stdev=43.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 54], 80.00th=[ 70], 90.00th=[ 112], 95.00th=[ 144], | 99.00th=[ 199], 99.50th=[ 226], 99.90th=[ 368], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 134, per=25.87%, avg=32.86, stdev=20.79, samples=356 iops : min= 1, max= 33, avg= 7.56, stdev= 5.27, samples=356 write: IOPS=8, BW=33.2KiB/s (34.0kB/s)(6260KiB/188474msec); 0 zone resets clat (msec): min=13, max=1110, avg=72.72, stdev=56.03 lat (msec): min=13, max=1110, avg=72.72, stdev=56.03 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 67], | 70.00th=[ 83], 80.00th=[ 103], 90.00th=[ 134], 95.00th=[ 167], | 99.00th=[ 268], 99.50th=[ 309], 99.90th=[ 388], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 119, per=24.83%, avg=33.03, stdev=20.25, samples=367 iops : min= 1, max= 29, avg= 7.60, stdev= 5.12, samples=367 lat (msec) : 10=0.91%, 20=10.16%, 50=43.49%, 100=28.87%, 250=15.82% lat (msec) : 500=0.72%, 2000=0.03% cpu : usr=0.06%, sys=1.89%, ctx=4938, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179968: Mon Jun 1 14:56:07 2026 read: IOPS=8, BW=32.1KiB/s (32.8kB/s)(6052KiB/188816msec) clat (msec): min=6, max=374, avg=49.97, stdev=44.91 lat (msec): min=6, max=374, avg=49.98, stdev=44.91 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 53], 80.00th=[ 73], 90.00th=[ 113], 95.00th=[ 146], | 99.00th=[ 220], 99.50th=[ 253], 99.90th=[ 351], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 104, per=25.78%, avg=32.74, stdev=21.68, samples=359 iops : min= 1, max= 26, avg= 7.52, stdev= 5.48, samples=359 write: IOPS=8, BW=33.0KiB/s (33.8kB/s)(6236KiB/188816msec); 0 zone resets clat (msec): min=12, max=1125, avg=72.52, stdev=53.84 lat (msec): min=12, max=1125, avg=72.52, stdev=53.84 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 83], 80.00th=[ 104], 90.00th=[ 134], 95.00th=[ 161], | 99.00th=[ 249], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 95, per=24.78%, avg=32.95, stdev=19.28, samples=367 iops : min= 1, max= 23, avg= 7.58, stdev= 4.89, samples=367 lat (msec) : 10=0.88%, 20=10.61%, 50=44.08%, 100=27.64%, 250=16.05% lat (msec) : 500=0.72%, 2000=0.03% cpu : usr=0.06%, sys=1.95%, ctx=5092, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=127KiB/s (130kB/s), 31.8KiB/s-32.1KiB/s (32.5kB/s-32.8kB/s), io=23.4MiB (24.6MB), run=186929-188816msec WRITE: bw=133KiB/s (136kB/s), 33.0KiB/s-33.0KiB/s (33.8kB/s-34.8kB/s), io=24.6MiB (25.7MB), run=186929-188816msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180016: Mon Jun 1 14:56:59 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(5920KiB/37970msec) clat (usec): min=36, max=290300, avg=56796.07, stdev=39647.73 lat (usec): min=36, max=290303, avg=56805.12, stdev=39639.86 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 65], 10.00th=[ 91], 20.00th=[ 28967], | 30.00th=[ 37487], 40.00th=[ 44827], 50.00th=[ 51119], 60.00th=[ 59507], | 70.00th=[ 68682], 80.00th=[ 81265], 90.00th=[106431], 95.00th=[128451], | 99.00th=[196084], 99.50th=[221250], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 30, max= 346, per=26.23%, avg=155.53, stdev=57.08, samples=74 iops : min= 1, max= 21, avg= 8.96, stdev= 3.60, samples=74 write: IOPS=10, BW=168KiB/s (172kB/s)(6368KiB/37970msec); 0 zone resets clat (usec): min=1533, max=283471, avg=42402.95, stdev=47793.95 lat (usec): min=1536, max=283475, avg=42407.53, stdev=47792.32 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1926], 10.00th=[ 3032], 20.00th=[ 6652], | 30.00th=[ 10028], 40.00th=[ 16057], 50.00th=[ 26346], 60.00th=[ 35914], | 70.00th=[ 48497], 80.00th=[ 72877], 90.00th=[107480], 95.00th=[143655], | 99.00th=[221250], 99.50th=[256902], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 415, per=27.35%, avg=170.64, stdev=73.57, samples=73 iops : min= 1, max= 25, avg= 9.90, stdev= 4.61, samples=73 lat (usec) : 50=0.52%, 100=4.43%, 250=0.26%, 500=0.13%, 750=0.26% lat (msec) : 2=3.12%, 4=3.39%, 10=8.98%, 20=8.07%, 50=30.47% lat (msec) : 100=28.78%, 250=11.20%, 500=0.39% cpu : usr=0.08%, sys=5.17%, ctx=1582, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180017: Mon Jun 1 14:56:59 2026 read: IOPS=8, BW=142KiB/s (146kB/s)(5744KiB/40355msec) clat (usec): min=38, max=343177, avg=58287.34, stdev=40798.80 lat (usec): min=38, max=343178, avg=58288.91, stdev=40798.82 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 97], 20.00th=[ 27919], | 30.00th=[ 38011], 40.00th=[ 44827], 50.00th=[ 51643], 60.00th=[ 62653], | 70.00th=[ 71828], 80.00th=[ 85459], 90.00th=[108528], 95.00th=[127402], | 99.00th=[168821], 99.50th=[270533], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 22, max= 256, per=24.07%, avg=142.73, stdev=60.52, samples=79 iops : min= 1, max= 16, avg= 8.14, stdev= 3.81, samples=79 write: IOPS=10, BW=162KiB/s (166kB/s)(6544KiB/40355msec); 0 zone resets clat (usec): min=1508, max=243202, avg=46453.31, stdev=47863.45 lat (usec): min=1510, max=243203, avg=46476.93, stdev=47880.17 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 1926], 10.00th=[ 3064], 20.00th=[ 6718], | 30.00th=[ 11338], 40.00th=[ 20317], 50.00th=[ 31065], 60.00th=[ 40633], | 70.00th=[ 60031], 80.00th=[ 79168], 90.00th=[115868], 95.00th=[149947], | 99.00th=[185598], 99.50th=[227541], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 403, per=25.95%, avg=161.91, stdev=73.73, samples=79 iops : min= 1, max= 25, avg= 9.37, stdev= 4.69, samples=79 lat (usec) : 50=0.39%, 100=4.30% lat (msec) : 2=3.39%, 4=3.78%, 10=7.03%, 20=8.20%, 50=29.95% lat (msec) : 100=29.30%, 250=13.41%, 500=0.26% cpu : usr=0.08%, sys=5.01%, ctx=1614, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180018: Mon Jun 1 14:56:59 2026 read: IOPS=9, BW=156KiB/s (159kB/s)(6256KiB/40205msec) clat (usec): min=39, max=365915, avg=58350.96, stdev=44446.89 lat (usec): min=39, max=365916, avg=58354.53, stdev=44447.97 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 334], 20.00th=[ 29230], | 30.00th=[ 36439], 40.00th=[ 43254], 50.00th=[ 50070], 60.00th=[ 58459], | 70.00th=[ 67634], 80.00th=[ 83362], 90.00th=[106431], 95.00th=[145753], | 99.00th=[214959], 99.50th=[233833], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 31, max= 320, per=26.41%, avg=156.62, stdev=59.30, samples=78 iops : min= 1, max= 20, avg= 9.01, stdev= 3.77, samples=78 write: IOPS=9, BW=150KiB/s (154kB/s)(6032KiB/40205msec); 0 zone resets clat (usec): min=1476, max=245792, avg=44883.26, stdev=40492.01 lat (usec): min=1477, max=245793, avg=44901.98, stdev=40479.46 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2114], 10.00th=[ 3392], 20.00th=[ 8094], | 30.00th=[ 16581], 40.00th=[ 25035], 50.00th=[ 33817], 60.00th=[ 47449], | 70.00th=[ 57410], 80.00th=[ 72877], 90.00th=[107480], 95.00th=[126354], | 99.00th=[160433], 99.50th=[219153], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 403, per=24.08%, avg=150.23, stdev=77.66, samples=77 iops : min= 1, max= 25, avg= 8.61, stdev= 4.92, samples=77 lat (usec) : 50=0.26%, 100=4.17%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=2.08%, 4=3.39%, 10=6.12%, 20=6.25%, 50=32.68% lat (msec) : 100=32.03%, 250=11.98%, 500=0.13% cpu : usr=0.06%, sys=4.76%, ctx=1678, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180019: Mon Jun 1 14:56:59 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6032KiB/39912msec) clat (usec): min=41, max=235630, avg=54794.92, stdev=39302.22 lat (usec): min=42, max=235630, avg=54796.39, stdev=39302.07 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 61], 10.00th=[ 74], 20.00th=[ 22676], | 30.00th=[ 34341], 40.00th=[ 42730], 50.00th=[ 52167], 60.00th=[ 61604], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[104334], 95.00th=[129500], | 99.00th=[166724], 99.50th=[175113], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 30, max= 318, per=25.89%, avg=153.51, stdev=62.28, samples=77 iops : min= 1, max= 19, avg= 8.82, stdev= 3.96, samples=77 write: IOPS=9, BW=157KiB/s (161kB/s)(6256KiB/39912msec); 0 zone resets clat (usec): min=1415, max=267949, avg=47940.81, stdev=49883.25 lat (usec): min=1417, max=267951, avg=47979.18, stdev=49871.62 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2212], 10.00th=[ 3163], 20.00th=[ 7439], | 30.00th=[ 13173], 40.00th=[ 22938], 50.00th=[ 33162], 60.00th=[ 41681], | 70.00th=[ 60031], 80.00th=[ 81265], 90.00th=[117965], 95.00th=[145753], | 99.00th=[248513], 99.50th=[256902], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 372, per=25.17%, avg=157.04, stdev=73.06, samples=78 iops : min= 1, max= 23, avg= 9.05, stdev= 4.64, samples=78 lat (usec) : 50=0.39%, 100=6.64%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=2.08%, 4=5.08%, 10=5.60%, 20=7.68%, 50=29.43% lat (msec) : 100=30.47%, 250=11.85%, 500=0.39% cpu : usr=0.06%, sys=4.80%, ctx=1543, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=594KiB/s (608kB/s), 142KiB/s-156KiB/s (146kB/s-160kB/s), io=23.4MiB (24.5MB), run=37970-40355msec WRITE: bw=624KiB/s (639kB/s), 150KiB/s-168KiB/s (154kB/s-172kB/s), io=24.6MiB (25.8MB), run=37970-40355msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180012: Mon Jun 1 14:57:16 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(5920KiB/56491msec) clat (msec): min=9, max=384, avg=59.99, stdev=51.59 lat (msec): min=9, max=384, avg=60.00, stdev=51.60 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 81], 90.00th=[ 120], 95.00th=[ 176], | 99.00th=[ 253], 99.50th=[ 321], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 30, max= 319, per=26.01%, avg=108.45, stdev=65.70, samples=105 iops : min= 1, max= 19, avg= 6.01, stdev= 4.14, samples=105 write: IOPS=7, BW=113KiB/s (115kB/s)(6368KiB/56491msec); 0 zone resets clat (msec): min=12, max=411, avg=85.43, stdev=58.14 lat (msec): min=12, max=411, avg=85.43, stdev=58.14 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 80], | 70.00th=[ 99], 80.00th=[ 128], 90.00th=[ 174], 95.00th=[ 197], | 99.00th=[ 284], 99.50th=[ 380], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 29, max= 318, per=26.03%, avg=114.29, stdev=62.89, samples=108 iops : min= 1, max= 19, avg= 6.38, stdev= 4.00, samples=108 lat (msec) : 10=0.13%, 20=5.08%, 50=41.80%, 100=31.64%, 250=20.05% lat (msec) : 500=1.30% cpu : usr=0.04%, sys=1.77%, ctx=1326, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180013: Mon Jun 1 14:57:16 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(5744KiB/56668msec) clat (msec): min=10, max=422, avg=59.67, stdev=48.38 lat (msec): min=10, max=422, avg=59.67, stdev=48.38 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 84], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 241], 99.50th=[ 296], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 22, max= 413, per=25.05%, avg=104.44, stdev=69.11, samples=107 iops : min= 1, max= 25, avg= 5.75, stdev= 4.35, samples=107 write: IOPS=7, BW=115KiB/s (118kB/s)(6544KiB/56668msec); 0 zone resets clat (msec): min=16, max=347, avg=85.41, stdev=55.79 lat (msec): min=16, max=347, avg=85.41, stdev=55.79 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 49], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 85], | 70.00th=[ 102], 80.00th=[ 123], 90.00th=[ 157], 95.00th=[ 197], | 99.00th=[ 275], 99.50th=[ 292], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 320, per=26.70%, avg=117.19, stdev=66.89, samples=109 iops : min= 1, max= 20, avg= 6.56, stdev= 4.26, samples=109 lat (msec) : 20=4.95%, 50=38.15%, 100=34.11%, 250=21.22%, 500=1.56% cpu : usr=0.05%, sys=1.62%, ctx=1270, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180014: Mon Jun 1 14:57:16 2026 read: IOPS=6, BW=110KiB/s (112kB/s)(6256KiB/57027msec) clat (msec): min=9, max=412, avg=59.63, stdev=47.63 lat (msec): min=9, max=412, avg=59.63, stdev=47.63 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 53], | 70.00th=[ 64], 80.00th=[ 80], 90.00th=[ 120], 95.00th=[ 150], | 99.00th=[ 251], 99.50th=[ 309], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 29, max= 351, per=27.02%, avg=112.69, stdev=71.67, samples=109 iops : min= 1, max= 21, avg= 6.27, stdev= 4.53, samples=109 write: IOPS=6, BW=106KiB/s (108kB/s)(6032KiB/57027msec); 0 zone resets clat (msec): min=18, max=448, avg=89.27, stdev=58.92 lat (msec): min=18, max=448, avg=89.27, stdev=58.92 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 59], 50.00th=[ 69], 60.00th=[ 90], | 70.00th=[ 106], 80.00th=[ 131], 90.00th=[ 169], 95.00th=[ 207], | 99.00th=[ 296], 99.50th=[ 321], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 286, per=24.88%, avg=109.24, stdev=55.66, samples=108 iops : min= 1, max= 17, avg= 6.05, stdev= 3.55, samples=108 lat (msec) : 10=0.13%, 20=3.12%, 50=41.28%, 100=31.25%, 250=22.53% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.76%, ctx=1291, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180015: Mon Jun 1 14:57:16 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(6032KiB/57344msec) clat (msec): min=10, max=262, avg=60.50, stdev=45.19 lat (msec): min=10, max=262, avg=60.51, stdev=45.19 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 118], 95.00th=[ 159], | 99.00th=[ 251], 99.50th=[ 257], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 318, per=26.53%, avg=110.65, stdev=62.64, samples=105 iops : min= 1, max= 19, avg= 6.14, stdev= 3.99, samples=105 write: IOPS=6, BW=109KiB/s (112kB/s)(6256KiB/57344msec); 0 zone resets clat (msec): min=16, max=393, avg=87.81, stdev=60.58 lat (msec): min=16, max=393, avg=87.82, stdev=60.58 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 58], 50.00th=[ 68], 60.00th=[ 80], | 70.00th=[ 103], 80.00th=[ 131], 90.00th=[ 176], 95.00th=[ 203], | 99.00th=[ 313], 99.50th=[ 321], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 315, per=25.03%, avg=109.89, stdev=64.86, samples=110 iops : min= 1, max= 19, avg= 6.09, stdev= 4.12, samples=110 lat (msec) : 20=4.95%, 50=38.15%, 100=34.24%, 250=20.83%, 500=1.82% cpu : usr=0.06%, sys=1.77%, ctx=1348, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=418KiB/s (428kB/s), 101KiB/s-110KiB/s (104kB/s-112kB/s), io=23.4MiB (24.5MB), run=56491-57344msec WRITE: bw=439KiB/s (450kB/s), 106KiB/s-115KiB/s (108kB/s-118kB/s), io=24.6MiB (25.8MB), run=56491-57344msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180035: Mon Jun 1 14:57:32 2026 read: IOPS=1, BW=1953KiB/s (1999kB/s)(7168KiB/3671msec) clat (msec): min=179, max=385, avg=256.50, stdev=69.64 lat (msec): min=179, max=385, avg=256.50, stdev=69.64 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 213], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 230], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 300], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1845, max= 4000, per=55.49%, avg=2725.75, stdev=1000.87, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1395KiB/s (1428kB/s)(5120KiB/3671msec); 0 zone resets clat (msec): min=183, max=537, avg=361.21, stdev=171.53 lat (msec): min=183, max=537, avg=361.30, stdev=171.52 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2000, max= 3930, per=38.51%, avg=2648.33, stdev=1109.98, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=13.38%, ctx=195, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180036: Mon Jun 1 14:57:32 2026 read: IOPS=0, BW=491KiB/s (503kB/s)(2048KiB/4169msec) clat (usec): min=748, max=213229, avg=106988.80, stdev=150246.93 lat (usec): min=749, max=213232, avg=106991.01, stdev=150247.63 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[ 750], | 30.00th=[ 750], 40.00th=[ 750], 50.00th=[ 750], 60.00th=[212861], | 70.00th=[212861], 80.00th=[212861], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 1484, max= 2000, per=35.46%, avg=1742.00, stdev=364.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2456KiB/s (2515kB/s)(10.0MiB/4169msec); 0 zone resets clat (msec): min=96, max=745, avg=381.58, stdev=203.24 lat (msec): min=96, max=745, avg=381.67, stdev=203.23 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 144], | 30.00th=[ 226], 40.00th=[ 259], 50.00th=[ 372], 60.00th=[ 418], | 70.00th=[ 485], 80.00th=[ 518], 90.00th=[ 558], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1845, max= 4015, per=43.24%, avg=2973.33, stdev=1131.50, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=25.00% cpu : usr=0.02%, sys=14.08%, ctx=147, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180037: Mon Jun 1 14:57:32 2026 read: IOPS=1, BW=1612KiB/s (1650kB/s)(6144KiB/3812msec) clat (usec): min=359, max=5431, avg=1551.35, stdev=1987.95 lat (usec): min=360, max=5433, avg=1552.78, stdev=1987.87 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 586], | 70.00th=[ 1926], 80.00th=[ 1926], 90.00th=[ 5407], 95.00th=[ 5407], | 99.00th=[ 5407], 99.50th=[ 5407], 99.90th=[ 5407], 99.95th=[ 5407], | 99.99th=[ 5407] bw ( KiB/s): min= 1845, max= 7861, per=98.80%, avg=4853.00, stdev=4253.95, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1612KiB/s (1650kB/s)(6144KiB/3812msec); 0 zone resets clat (msec): min=178, max=1091, avg=605.07, stdev=401.47 lat (msec): min=178, max=1091, avg=605.33, stdev=401.50 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 726], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1503, max= 3930, per=33.78%, avg=2323.25, stdev=1092.12, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=16.67%, 750=16.67% lat (msec) : 2=8.33%, 10=8.33%, 250=16.67%, 500=8.33%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=8.69%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180038: Mon Jun 1 14:57:32 2026 read: IOPS=1, BW=1544KiB/s (1581kB/s)(5120KiB/3316msec) clat (usec): min=605, max=183379, avg=71977.69, stdev=97543.62 lat (usec): min=606, max=183381, avg=71978.75, stdev=97543.94 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 685], 40.00th=[ 685], 50.00th=[ 1057], 60.00th=[ 1057], | 70.00th=[175113], 80.00th=[175113], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2162KiB/s (2214kB/s)(7168KiB/3316msec); 0 zone resets clat (msec): min=108, max=571, avg=402.76, stdev=154.56 lat (msec): min=108, max=571, avg=402.89, stdev=154.59 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 305], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 430], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 502], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1759, max= 6000, per=42.18%, avg=2901.00, stdev=2068.41, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=11.22%, ctx=149, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4912KiB/s (5030kB/s), 491KiB/s-1953KiB/s (503kB/s-1999kB/s), io=20.0MiB (20.0MB), run=3316-4169msec WRITE: bw=6877KiB/s (7042kB/s), 1395KiB/s-2456KiB/s (1428kB/s-2515kB/s), io=28.0MiB (29.4MB), run=3316-4169msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180039: Mon Jun 1 14:57:33 2026 read: IOPS=1, BW=1402KiB/s (1436kB/s)(7168KiB/5111msec) clat (msec): min=135, max=866, avg=469.94, stdev=311.31 lat (msec): min=135, max=866, avg=469.94, stdev=311.31 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 165], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 426], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 835], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1615, max= 3992, per=62.00%, avg=2412.50, stdev=1070.44, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=1002KiB/s (1026kB/s)(5120KiB/5111msec); 0 zone resets clat (msec): min=134, max=424, avg=299.77, stdev=115.25 lat (msec): min=134, max=426, avg=300.26, stdev=115.75 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2015, max= 4023, per=49.48%, avg=2695.33, stdev=1149.91, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=4.56%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180040: Mon Jun 1 14:57:33 2026 read: IOPS=0, BW=415KiB/s (425kB/s)(2048KiB/4935msec) clat (msec): min=193, max=477, avg=335.51, stdev=201.14 lat (msec): min=193, max=477, avg=335.51, stdev=201.14 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1587, max= 1996, per=46.04%, avg=1791.50, stdev=289.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2075KiB/s (2125kB/s)(10.0MiB/4935msec); 0 zone resets clat (msec): min=164, max=706, avg=407.66, stdev=206.19 lat (msec): min=165, max=706, avg=407.81, stdev=206.20 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 209], | 30.00th=[ 259], 40.00th=[ 271], 50.00th=[ 305], 60.00th=[ 351], | 70.00th=[ 485], 80.00th=[ 617], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1988, max= 4096, per=55.62%, avg=3029.50, stdev=1118.35, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=25.00% cpu : usr=0.00%, sys=3.91%, ctx=77, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180041: Mon Jun 1 14:57:33 2026 read: IOPS=1, BW=1236KiB/s (1266kB/s)(6144KiB/4970msec) clat (msec): min=111, max=395, avg=248.98, stdev=136.45 lat (msec): min=111, max=395, avg=248.98, stdev=136.45 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 326], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2015, max= 4023, per=85.92%, avg=3343.33, stdev=1150.47, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1236KiB/s (1266kB/s)(6144KiB/4970msec); 0 zone resets clat (msec): min=109, max=1805, avg=565.33, stdev=659.61 lat (msec): min=110, max=1805, avg=565.73, stdev=659.44 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 271], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 1796, max= 3976, per=44.97%, avg=2449.50, stdev=1022.80, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.76%, ctx=79, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180042: Mon Jun 1 14:57:33 2026 read: IOPS=0, BW=973KiB/s (996kB/s)(5120KiB/5263msec) clat (msec): min=47, max=400, avg=280.26, stdev=158.75 lat (msec): min=47, max=400, avg=280.26, stdev=158.75 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2011, max= 4031, per=77.64%, avg=3021.00, stdev=1428.36, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1362KiB/s (1395kB/s)(7168KiB/5263msec); 0 zone resets clat (msec): min=98, max=1493, avg=501.32, stdev=508.18 lat (msec): min=98, max=1493, avg=501.62, stdev=508.25 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 126], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 224], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 751], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 1796, max= 2048, per=35.93%, avg=1957.00, stdev=110.58, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.02%, ctx=123, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3891KiB/s (3985kB/s), 415KiB/s-1402KiB/s (425kB/s-1436kB/s), io=20.0MiB (20.0MB), run=4935-5263msec WRITE: bw=5448KiB/s (5579kB/s), 1002KiB/s-2075KiB/s (1026kB/s-2125kB/s), io=28.0MiB (29.4MB), run=4935-5263msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180049: Mon Jun 1 14:57:49 2026 read: IOPS=1, BW=7782KiB/s (7969kB/s)(12.0MiB/1579msec) clat (msec): min=474, max=564, avg=504.17, stdev=52.02 lat (msec): min=474, max=564, avg=504.17, stdev=52.02 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 6360, max= 8192, per=100.00%, avg=7276.00, stdev=1295.42, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=5.96%, ctx=60, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180050: Mon Jun 1 14:57:49 2026 read: IOPS=0, BW=1082KiB/s (1108kB/s)(4096KiB/3787msec) clat (nsec): min=1752.1M, max=1752.1M, avg=1752139214.00, stdev= 0.00 lat (nsec): min=1752.1M, max=1752.1M, avg=1752141716.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1754], 5.00th=[ 1754], 10.00th=[ 1754], 20.00th=[ 1754], | 30.00th=[ 1754], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2163KiB/s (2215kB/s)(8192KiB/3787msec); 0 zone resets clat (msec): min=358, max=1507, avg=933.13, stdev=812.60 lat (msec): min=359, max=1508, avg=933.59, stdev=812.56 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8159, max= 8159, per=94.30%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.17%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180051: Mon Jun 1 14:57:49 2026 write: IOPS=0, BW=3519KiB/s (3603kB/s)(12.0MiB/3492msec); 0 zone resets clat (msec): min=507, max=1500, avg=1140.11, stdev=549.93 lat (msec): min=507, max=1500, avg=1140.64, stdev=549.92 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 7984, max= 8078, per=92.82%, avg=8031.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.21%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180052: Mon Jun 1 14:57:49 2026 write: IOPS=0, BW=4066KiB/s (4164kB/s)(12.0MiB/3022msec); 0 zone resets clat (msec): min=507, max=1324, avg=974.03, stdev=420.79 lat (msec): min=509, max=1324, avg=974.98, stdev=419.71 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 5826, max= 8078, per=80.35%, avg=6952.00, stdev=1592.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.13%, sys=3.11%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4326KiB/s (4430kB/s), 1082KiB/s-7782KiB/s (1108kB/s-7969kB/s), io=16.0MiB (16.8MB), run=1579-3787msec WRITE: bw=8653KiB/s (8860kB/s), 2163KiB/s-4066KiB/s (2215kB/s-4164kB/s), io=32.0MiB (33.6MB), run=3022-3787msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180054: Mon Jun 1 14:57:50 2026 read: IOPS=1, BW=4499KiB/s (4607kB/s)(12.0MiB/2731msec) clat (msec): min=636, max=997, avg=865.87, stdev=199.62 lat (msec): min=636, max=997, avg=865.87, stdev=199.62 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8078, max= 8094, per=100.00%, avg=8086.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=10.29%, ctx=289, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180055: Mon Jun 1 14:57:50 2026 read: IOPS=0, BW=1312KiB/s (1344kB/s)(4096KiB/3121msec) clat (nsec): min=685768k, max=685768k, avg=685768361.00, stdev= 0.00 lat (nsec): min=685771k, max=685771k, avg=685770707.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2625KiB/s (2688kB/s)(8192KiB/3121msec); 0 zone resets clat (msec): min=708, max=1643, avg=1175.82, stdev=660.82 lat (msec): min=708, max=1644, avg=1176.51, stdev=661.23 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8078, max= 8078, per=90.70%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.29%, sys=3.94%, ctx=90, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180056: Mon Jun 1 14:57:50 2026 write: IOPS=0, BW=3340KiB/s (3420kB/s)(12.0MiB/3679msec); 0 zone resets clat (msec): min=221, max=1682, avg=1173.70, stdev=825.24 lat (msec): min=222, max=1683, avg=1174.25, stdev=825.26 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8126, max= 8126, per=91.24%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.58%, ctx=39, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180057: Mon Jun 1 14:57:50 2026 write: IOPS=0, BW=3996KiB/s (4092kB/s)(12.0MiB/3075msec); 0 zone resets clat (msec): min=476, max=1310, avg=970.04, stdev=437.74 lat (msec): min=476, max=1311, avg=971.00, stdev=438.15 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 5728, max= 8126, per=77.78%, avg=6927.00, stdev=1695.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.16%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5250KiB/s (5376kB/s), 1312KiB/s-4499KiB/s (1344kB/s-4607kB/s), io=16.0MiB (16.8MB), run=2731-3121msec WRITE: bw=8907KiB/s (9121kB/s), 2625KiB/s-3996KiB/s (2688kB/s-4092kB/s), io=32.0MiB (33.6MB), run=3075-3679msec