== sanity test 398b: DIO and buffer IO race ============== 17:46:01 (1786311961) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.47985 s, 6.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178536: Sun Aug 9 17:48:56 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(5992KiB/147068msec) clat (usec): min=33, max=979824, avg=54895.47, stdev=42934.51 lat (usec): min=33, max=979826, avg=54897.21, stdev=42934.47 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 12911], 10.00th=[ 20317], 20.00th=[ 27132], | 30.00th=[ 32900], 40.00th=[ 39584], 50.00th=[ 46924], 60.00th=[ 54789], | 70.00th=[ 63701], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[121111], | 99.00th=[187696], 99.50th=[204473], 99.90th=[350225], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 93, per=25.60%, avg=40.70, stdev=17.35, samples=286 iops : min= 1, max= 23, avg= 9.51, stdev= 4.36, samples=286 write: IOPS=10, BW=42.8KiB/s (43.8kB/s)(6296KiB/147068msec); 0 zone resets clat (usec): min=905, max=339033, avg=40849.75, stdev=44117.05 lat (usec): min=906, max=339035, avg=40851.82, stdev=44117.01 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1532], 20.00th=[ 3654], | 30.00th=[ 7963], 40.00th=[ 16712], 50.00th=[ 28705], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[130548], | 99.00th=[185598], 99.50th=[217056], 99.90th=[312476], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 6, max= 119, per=25.54%, avg=42.40, stdev=21.26, samples=288 iops : min= 1, max= 29, avg= 9.94, stdev= 5.35, samples=288 lat (usec) : 50=0.13%, 100=1.73%, 250=0.10%, 500=0.03%, 1000=0.07% lat (msec) : 2=6.64%, 4=4.26%, 10=6.32%, 20=7.26%, 50=34.80% lat (msec) : 100=28.61%, 250=9.90%, 500=0.13%, 1000=0.03% cpu : usr=0.06%, sys=4.34%, ctx=6328, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178537: Sun Aug 9 17:48:56 2026 read: IOPS=9, BW=39.9KiB/s (40.8kB/s)(5940KiB/148944msec) clat (usec): min=51, max=332424, avg=54713.84, stdev=36462.09 lat (usec): min=52, max=332425, avg=54715.55, stdev=36462.10 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 13566], 10.00th=[ 20055], 20.00th=[ 27132], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 46924], 60.00th=[ 56361], | 70.00th=[ 64226], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[119014], | 99.00th=[175113], 99.50th=[217056], 99.90th=[283116], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 6, max= 93, per=25.03%, avg=39.79, stdev=16.38, samples=288 iops : min= 1, max= 23, avg= 9.29, stdev= 4.12, samples=288 write: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6348KiB/148944msec); 0 zone resets clat (usec): min=1010, max=1000.2k, avg=42269.42, stdev=50758.13 lat (usec): min=1012, max=1000.2k, avg=42272.39, stdev=50758.10 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1369], 10.00th=[ 1582], | 20.00th=[ 3949], 30.00th=[ 8094], 40.00th=[ 17171], | 50.00th=[ 28967], 60.00th=[ 39584], 70.00th=[ 54264], | 80.00th=[ 71828], 90.00th=[ 102237], 95.00th=[ 130548], | 99.00th=[ 181404], 99.50th=[ 258999], 99.90th=[ 346031], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 125, per=25.57%, avg=42.44, stdev=20.70, samples=288 iops : min= 1, max= 31, avg= 9.95, stdev= 5.22, samples=288 lat (usec) : 100=1.53%, 250=0.16%, 500=0.07% lat (msec) : 2=6.35%, 4=4.13%, 10=6.54%, 20=7.65%, 50=34.08% lat (msec) : 100=29.33%, 250=9.67%, 500=0.46%, 2000=0.03% cpu : usr=0.07%, sys=4.40%, ctx=6232, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178539: Sun Aug 9 17:48:56 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6028KiB/150997msec) clat (usec): min=35, max=336626, avg=56603.96, stdev=38844.30 lat (usec): min=36, max=336628, avg=56609.11, stdev=38845.23 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 13698], 10.00th=[ 20317], 20.00th=[ 27657], | 30.00th=[ 32900], 40.00th=[ 39584], 50.00th=[ 47449], 60.00th=[ 56361], | 70.00th=[ 67634], 80.00th=[ 81265], 90.00th=[105382], 95.00th=[131597], | 99.00th=[185598], 99.50th=[219153], 99.90th=[295699], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 103, per=25.10%, avg=39.91, stdev=16.75, samples=291 iops : min= 1, max= 25, avg= 9.31, stdev= 4.21, samples=291 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6260KiB/150997msec); 0 zone resets clat (usec): min=850, max=956674, avg=41539.02, stdev=48451.30 lat (usec): min=851, max=956676, avg=41541.62, stdev=48451.02 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1401], 10.00th=[ 1696], 20.00th=[ 4424], | 30.00th=[ 8979], 40.00th=[ 19268], 50.00th=[ 29492], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[100140], 95.00th=[123208], | 99.00th=[196084], 99.50th=[219153], 99.90th=[312476], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 119, per=24.68%, avg=40.98, stdev=20.95, samples=294 iops : min= 1, max= 29, avg= 9.58, stdev= 5.27, samples=294 lat (usec) : 50=0.13%, 100=1.63%, 250=0.07%, 500=0.03%, 1000=0.20% lat (msec) : 2=5.70%, 4=3.45%, 10=6.67%, 20=7.71%, 50=34.80% lat (msec) : 100=28.68%, 250=10.71%, 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=4.30%, ctx=6425, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178540: Sun Aug 9 17:48:56 2026 read: IOPS=10, BW=40.3KiB/s (41.3kB/s)(6052KiB/150099msec) clat (usec): min=32, max=409242, avg=54018.37, stdev=39821.41 lat (usec): min=32, max=409244, avg=54021.13, stdev=39821.50 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 429], 10.00th=[ 18482], 20.00th=[ 26346], | 30.00th=[ 32375], 40.00th=[ 39584], 50.00th=[ 45351], 60.00th=[ 54264], | 70.00th=[ 63177], 80.00th=[ 74974], 90.00th=[ 95945], 95.00th=[124257], | 99.00th=[198181], 99.50th=[258999], 99.90th=[341836], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 119, per=25.25%, avg=40.15, stdev=17.55, samples=292 iops : min= 1, max= 29, avg= 9.38, stdev= 4.40, samples=292 write: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6236KiB/150099msec); 0 zone resets clat (usec): min=975, max=797757, avg=43462.55, stdev=50805.77 lat (usec): min=976, max=797759, avg=43476.11, stdev=50806.40 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1352], 10.00th=[ 1614], 20.00th=[ 4146], | 30.00th=[ 8455], 40.00th=[ 18744], 50.00th=[ 30016], 60.00th=[ 41157], | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[104334], 95.00th=[137364], | 99.00th=[217056], 99.50th=[250610], 99.90th=[404751], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 119, per=24.83%, avg=41.22, stdev=20.07, samples=293 iops : min= 1, max= 29, avg= 9.65, stdev= 5.06, samples=293 lat (usec) : 50=0.33%, 100=1.92%, 250=0.13%, 500=0.10%, 1000=0.07% lat (msec) : 2=6.15%, 4=3.65%, 10=6.64%, 20=7.62%, 50=34.90% lat (msec) : 100=28.58%, 250=9.41%, 500=0.49%, 1000=0.03% cpu : usr=0.05%, sys=4.01%, ctx=6329, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (163kB/s), 39.9KiB/s-40.7KiB/s (40.8kB/s-41.7kB/s), io=23.4MiB (24.6MB), run=147068-150997msec WRITE: bw=166KiB/s (170kB/s), 41.5KiB/s-42.8KiB/s (42.5kB/s-43.8kB/s), io=24.6MiB (25.7MB), run=147068-150997msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178538: Sun Aug 9 17:49:48 2026 read: IOPS=7, BW=29.8KiB/s (30.5kB/s)(5992KiB/200938msec) clat (msec): min=6, max=1066, avg=52.35, stdev=55.60 lat (msec): min=6, max=1066, avg=52.36, stdev=55.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 56], 80.00th=[ 75], 90.00th=[ 111], 95.00th=[ 148], | 99.00th=[ 259], 99.50th=[ 296], 99.90th=[ 527], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 127, per=26.17%, avg=30.88, stdev=21.95, samples=375 iops : min= 1, max= 31, avg= 7.05, stdev= 5.50, samples=375 write: IOPS=7, BW=31.3KiB/s (32.1kB/s)(6296KiB/200938msec); 0 zone resets clat (msec): min=12, max=390, avg=77.51, stdev=56.15 lat (msec): min=12, max=390, avg=77.52, stdev=56.15 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 60], 60.00th=[ 72], | 70.00th=[ 90], 80.00th=[ 113], 90.00th=[ 150], 95.00th=[ 190], | 99.00th=[ 292], 99.50th=[ 321], 99.90th=[ 384], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 118, per=25.41%, avg=31.51, stdev=20.88, samples=386 iops : min= 1, max= 29, avg= 7.21, stdev= 5.26, samples=386 lat (msec) : 10=1.20%, 20=10.81%, 50=41.11%, 100=28.22%, 250=17.19% lat (msec) : 500=1.40%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.70%, ctx=4927, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178541: Sun Aug 9 17:49:48 2026 read: IOPS=7, BW=29.5KiB/s (30.2kB/s)(5940KiB/201371msec) clat (msec): min=5, max=1078, avg=52.40, stdev=56.86 lat (msec): min=5, max=1078, avg=52.40, stdev=56.86 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 74], 90.00th=[ 113], 95.00th=[ 159], | 99.00th=[ 251], 99.50th=[ 296], 99.90th=[ 527], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 119, per=25.86%, avg=30.51, stdev=22.66, samples=376 iops : min= 1, max= 29, avg= 6.96, stdev= 5.70, samples=376 write: IOPS=7, BW=31.5KiB/s (32.3kB/s)(6348KiB/201371msec); 0 zone resets clat (msec): min=12, max=468, avg=77.36, stdev=54.12 lat (msec): min=12, max=468, avg=77.37, stdev=54.12 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 73], | 70.00th=[ 91], 80.00th=[ 114], 90.00th=[ 150], 95.00th=[ 182], | 99.00th=[ 262], 99.50th=[ 309], 99.90th=[ 388], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 110, per=25.34%, avg=31.42, stdev=20.35, samples=390 iops : min= 1, max= 27, avg= 7.18, stdev= 5.12, samples=390 lat (msec) : 10=1.50%, 20=10.71%, 50=40.95%, 100=27.73%, 250=18.03% lat (msec) : 500=1.01%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.63%, ctx=4783, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178542: Sun Aug 9 17:49:48 2026 read: IOPS=7, BW=29.8KiB/s (30.5kB/s)(6028KiB/202148msec) clat (msec): min=5, max=388, avg=53.12, stdev=50.23 lat (msec): min=5, max=388, avg=53.12, stdev=50.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 75], 90.00th=[ 118], 95.00th=[ 159], | 99.00th=[ 255], 99.50th=[ 296], 99.90th=[ 380], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 142, per=25.93%, avg=30.60, stdev=21.57, samples=381 iops : min= 1, max= 35, avg= 6.98, stdev= 5.42, samples=381 write: IOPS=7, BW=30.0KiB/s (31.7kB/s)(6260KiB/202148msec); 0 zone resets clat (msec): min=10, max=1254, avg=77.57, stdev=63.33 lat (msec): min=10, max=1254, avg=77.57, stdev=63.33 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 113], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 288], 99.50th=[ 326], 99.90th=[ 460], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 109, per=25.24%, avg=31.29, stdev=20.73, samples=387 iops : min= 1, max= 27, avg= 7.15, stdev= 5.22, samples=387 lat (msec) : 10=1.20%, 20=10.94%, 50=40.27%, 100=28.39%, 250=17.74% lat (msec) : 500=1.43%, 2000=0.03% cpu : usr=0.05%, sys=1.67%, ctx=4948, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178543: Sun Aug 9 17:49:48 2026 read: IOPS=7, BW=29.9KiB/s (30.6kB/s)(6052KiB/202545msec) clat (msec): min=5, max=469, avg=53.13, stdev=50.18 lat (msec): min=5, max=469, avg=53.13, stdev=50.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 57], 80.00th=[ 78], 90.00th=[ 120], 95.00th=[ 159], | 99.00th=[ 236], 99.50th=[ 279], 99.90th=[ 338], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 119, per=26.06%, avg=30.75, stdev=21.61, samples=377 iops : min= 1, max= 29, avg= 7.01, stdev= 5.43, samples=377 write: IOPS=7, BW=30.8KiB/s (31.5kB/s)(6236KiB/202545msec); 0 zone resets clat (msec): min=11, max=1171, avg=77.88, stdev=61.42 lat (msec): min=11, max=1171, avg=77.88, stdev=61.42 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 60], 60.00th=[ 73], | 70.00th=[ 90], 80.00th=[ 114], 90.00th=[ 148], 95.00th=[ 182], | 99.00th=[ 292], 99.50th=[ 351], 99.90th=[ 443], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 110, per=24.95%, avg=30.93, stdev=19.88, samples=387 iops : min= 1, max= 27, avg= 7.06, stdev= 5.01, samples=387 lat (msec) : 10=1.30%, 20=10.71%, 50=40.46%, 100=28.06%, 250=18.20% lat (msec) : 500=1.24%, 2000=0.03% cpu : usr=0.05%, sys=1.62%, ctx=4888, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=119KiB/s (121kB/s), 29.5KiB/s-29.9KiB/s (30.2kB/s-30.6kB/s), io=23.4MiB (24.6MB), run=200938-202545msec WRITE: bw=124KiB/s (127kB/s), 30.8KiB/s-31.5KiB/s (31.5kB/s-32.3kB/s), io=24.6MiB (25.7MB), run=200938-202545msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178599: Sun Aug 9 17:50:38 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(5920KiB/38171msec) clat (usec): min=31, max=248679, avg=57635.37, stdev=36454.56 lat (usec): min=31, max=248680, avg=57637.92, stdev=36453.98 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 2606], 20.00th=[ 29492], | 30.00th=[ 36963], 40.00th=[ 45351], 50.00th=[ 53740], 60.00th=[ 62653], | 70.00th=[ 73925], 80.00th=[ 85459], 90.00th=[101188], 95.00th=[116917], | 99.00th=[164627], 99.50th=[200279], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 315, per=25.31%, avg=153.62, stdev=53.20, samples=74 iops : min= 1, max= 19, avg= 8.84, stdev= 3.38, samples=74 write: IOPS=10, BW=167KiB/s (171kB/s)(6368KiB/38171msec); 0 zone resets clat (usec): min=1650, max=195277, avg=41795.06, stdev=41335.43 lat (usec): min=1652, max=195280, avg=41798.31, stdev=41335.31 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2606], 10.00th=[ 3752], 20.00th=[ 7570], | 30.00th=[ 10814], 40.00th=[ 17171], 50.00th=[ 26608], 60.00th=[ 38536], | 70.00th=[ 54789], 80.00th=[ 77071], 90.00th=[103285], 95.00th=[131597], | 99.00th=[177210], 99.50th=[179307], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 30, max= 434, per=26.09%, avg=166.74, stdev=72.81, samples=74 iops : min= 1, max= 27, avg= 9.66, stdev= 4.59, samples=74 lat (usec) : 50=0.26%, 100=3.26%, 250=0.65%, 500=0.13% lat (msec) : 2=1.82%, 4=4.30%, 10=9.11%, 20=8.33%, 50=29.30% lat (msec) : 100=31.77%, 250=11.07% cpu : usr=0.07%, sys=4.51%, ctx=1633, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178600: Sun Aug 9 17:50:38 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(5744KiB/38039msec) clat (usec): min=40, max=270931, avg=57863.38, stdev=37431.80 lat (usec): min=40, max=270935, avg=57868.10, stdev=37430.47 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 15795], 20.00th=[ 30802], | 30.00th=[ 38011], 40.00th=[ 44303], 50.00th=[ 51643], 60.00th=[ 62129], | 70.00th=[ 72877], 80.00th=[ 86508], 90.00th=[103285], 95.00th=[119014], | 99.00th=[185598], 99.50th=[244319], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 287, per=24.85%, avg=150.85, stdev=55.22, samples=74 iops : min= 1, max= 17, avg= 8.66, stdev= 3.48, samples=74 write: IOPS=10, BW=172KiB/s (176kB/s)(6544KiB/38039msec); 0 zone resets clat (usec): min=1304, max=279840, avg=41482.85, stdev=43784.51 lat (usec): min=1305, max=279843, avg=41489.08, stdev=43782.62 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2008], 10.00th=[ 2999], 20.00th=[ 6521], | 30.00th=[ 10028], 40.00th=[ 16909], 50.00th=[ 27395], 60.00th=[ 38011], | 70.00th=[ 51643], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[126354], | 99.00th=[204473], 99.50th=[244319], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 383, per=26.89%, avg=171.82, stdev=85.34, samples=74 iops : min= 1, max= 23, avg= 9.97, stdev= 5.44, samples=74 lat (usec) : 50=0.26%, 100=3.26%, 250=0.91%, 500=0.13% lat (msec) : 2=2.47%, 4=4.30%, 10=9.24%, 20=6.90%, 50=30.86% lat (msec) : 100=31.25%, 250=10.03%, 500=0.39% cpu : usr=0.06%, sys=4.85%, ctx=1637, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178601: Sun Aug 9 17:50:38 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(6256KiB/39396msec) clat (usec): min=39, max=237520, avg=55336.36, stdev=38662.51 lat (usec): min=41, max=237522, avg=55337.83, stdev=38662.52 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 92], 20.00th=[ 27132], | 30.00th=[ 36963], 40.00th=[ 43254], 50.00th=[ 50070], 60.00th=[ 58459], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[102237], 95.00th=[119014], | 99.00th=[198181], 99.50th=[219153], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 318, per=26.16%, avg=158.79, stdev=57.75, samples=77 iops : min= 1, max= 19, avg= 9.17, stdev= 3.65, samples=77 write: IOPS=9, BW=153KiB/s (157kB/s)(6032KiB/39396msec); 0 zone resets clat (usec): min=1660, max=256523, avg=46553.25, stdev=46877.83 lat (usec): min=1662, max=256525, avg=46560.14, stdev=46892.08 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2114], 10.00th=[ 3916], 20.00th=[ 6718], | 30.00th=[ 11600], 40.00th=[ 21627], 50.00th=[ 29492], 60.00th=[ 44303], | 70.00th=[ 60556], 80.00th=[ 83362], 90.00th=[111674], 95.00th=[131597], | 99.00th=[217056], 99.50th=[242222], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 30, max= 380, per=23.73%, avg=151.66, stdev=76.61, samples=77 iops : min= 1, max= 23, avg= 8.71, stdev= 4.84, samples=77 lat (usec) : 50=0.26%, 100=5.08%, 250=0.52% lat (msec) : 2=2.08%, 4=3.12%, 10=8.33%, 20=7.55%, 50=29.17% lat (msec) : 100=31.51%, 250=12.24%, 500=0.13% cpu : usr=0.07%, sys=4.70%, ctx=1679, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178602: Sun Aug 9 17:50:38 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(6032KiB/38373msec) clat (usec): min=43, max=370889, avg=55784.59, stdev=40061.70 lat (usec): min=43, max=370891, avg=55796.33, stdev=40047.95 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 108], 20.00th=[ 29230], | 30.00th=[ 35914], 40.00th=[ 43254], 50.00th=[ 50070], 60.00th=[ 59507], | 70.00th=[ 69731], 80.00th=[ 81265], 90.00th=[102237], 95.00th=[120062], | 99.00th=[175113], 99.50th=[208667], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 31, max= 351, per=26.18%, avg=158.93, stdev=64.07, samples=74 iops : min= 1, max= 21, avg= 9.18, stdev= 4.05, samples=74 write: IOPS=10, BW=163KiB/s (167kB/s)(6256KiB/38373msec); 0 zone resets clat (usec): min=1642, max=262635, avg=44142.74, stdev=45313.11 lat (usec): min=1643, max=262637, avg=44146.58, stdev=45311.85 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2212], 10.00th=[ 3392], 20.00th=[ 7046], | 30.00th=[ 10683], 40.00th=[ 20579], 50.00th=[ 28967], 60.00th=[ 40633], | 70.00th=[ 56361], 80.00th=[ 73925], 90.00th=[114820], 95.00th=[135267], | 99.00th=[200279], 99.50th=[242222], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 60, max= 382, per=25.84%, avg=165.15, stdev=70.65, samples=74 iops : min= 3, max= 23, avg= 9.55, stdev= 4.47, samples=74 lat (usec) : 50=0.26%, 100=4.30%, 250=1.30%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.56%, 4=4.56%, 10=8.59%, 20=5.73%, 50=32.16% lat (msec) : 100=30.08%, 250=10.81%, 500=0.26% cpu : usr=0.06%, sys=4.77%, ctx=1605, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=608KiB/s (623kB/s), 151KiB/s-159KiB/s (155kB/s-163kB/s), io=23.4MiB (24.5MB), run=38039-39396msec WRITE: bw=640KiB/s (655kB/s), 153KiB/s-172KiB/s (157kB/s-176kB/s), io=24.6MiB (25.8MB), run=38039-39396msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178604: Sun Aug 9 17:50:54 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(5920KiB/53842msec) clat (msec): min=10, max=351, avg=57.09, stdev=53.40 lat (msec): min=10, max=351, avg=57.10, stdev=53.40 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 60], 80.00th=[ 80], 90.00th=[ 128], 95.00th=[ 178], | 99.00th=[ 249], 99.50th=[ 313], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 351, per=25.82%, avg=113.07, stdev=70.93, samples=100 iops : min= 1, max= 21, avg= 6.29, stdev= 4.49, samples=100 write: IOPS=7, BW=118KiB/s (121kB/s)(6368KiB/53842msec); 0 zone resets clat (msec): min=18, max=378, avg=81.86, stdev=56.42 lat (msec): min=18, max=378, avg=81.86, stdev=56.42 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 31], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 73], | 70.00th=[ 92], 80.00th=[ 114], 90.00th=[ 167], 95.00th=[ 203], | 99.00th=[ 284], 99.50th=[ 300], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 288, per=25.96%, avg=119.67, stdev=72.47, samples=103 iops : min= 1, max= 18, avg= 6.69, stdev= 4.62, samples=103 lat (msec) : 20=8.98%, 50=40.10%, 100=30.21%, 250=19.27%, 500=1.43% cpu : usr=0.05%, sys=1.73%, ctx=1237, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178605: Sun Aug 9 17:50:54 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(5744KiB/54512msec) clat (msec): min=9, max=348, avg=56.26, stdev=52.45 lat (msec): min=9, max=348, avg=56.26, stdev=52.45 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 75], 90.00th=[ 123], 95.00th=[ 186], | 99.00th=[ 279], 99.50th=[ 300], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 25, max= 410, per=25.73%, avg=112.69, stdev=78.43, samples=100 iops : min= 1, max= 25, avg= 6.26, stdev= 4.96, samples=100 write: IOPS=7, BW=120KiB/s (123kB/s)(6544KiB/54512msec); 0 zone resets clat (msec): min=18, max=328, avg=83.68, stdev=53.59 lat (msec): min=18, max=328, avg=83.69, stdev=53.59 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 48], 40.00th=[ 54], 50.00th=[ 66], 60.00th=[ 83], | 70.00th=[ 99], 80.00th=[ 128], 90.00th=[ 165], 95.00th=[ 194], | 99.00th=[ 243], 99.50th=[ 259], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 25, max= 351, per=26.23%, avg=120.93, stdev=71.31, samples=106 iops : min= 1, max= 21, avg= 6.77, stdev= 4.49, samples=106 lat (msec) : 10=0.13%, 20=6.64%, 50=41.80%, 100=29.43%, 250=20.96% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.60%, ctx=1194, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178606: Sun Aug 9 17:50:54 2026 read: IOPS=7, BW=115KiB/s (117kB/s)(6256KiB/54614msec) clat (msec): min=8, max=336, avg=57.98, stdev=52.40 lat (msec): min=8, max=336, avg=57.98, stdev=52.40 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 79], 90.00th=[ 136], 95.00th=[ 182], | 99.00th=[ 259], 99.50th=[ 317], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 29, max= 383, per=27.52%, avg=120.56, stdev=84.93, samples=102 iops : min= 1, max= 23, avg= 6.74, stdev= 5.37, samples=102 write: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54614msec); 0 zone resets clat (msec): min=18, max=375, avg=84.39, stdev=59.73 lat (msec): min=18, max=375, avg=84.43, stdev=59.73 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 55], 50.00th=[ 64], 60.00th=[ 80], | 70.00th=[ 97], 80.00th=[ 123], 90.00th=[ 161], 95.00th=[ 215], | 99.00th=[ 321], 99.50th=[ 372], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 378, per=24.59%, avg=113.34, stdev=66.88, samples=103 iops : min= 1, max= 23, avg= 6.30, stdev= 4.25, samples=103 lat (msec) : 10=0.26%, 20=8.20%, 50=40.10%, 100=29.95%, 250=19.66% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.64%, ctx=1266, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178607: Sun Aug 9 17:50:54 2026 read: IOPS=6, BW=111KiB/s (113kB/s)(6032KiB/54588msec) clat (msec): min=6, max=313, avg=58.75, stdev=52.13 lat (msec): min=6, max=313, avg=58.76, stdev=52.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 49], | 70.00th=[ 64], 80.00th=[ 85], 90.00th=[ 134], 95.00th=[ 178], | 99.00th=[ 259], 99.50th=[ 266], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 415, per=26.42%, avg=115.71, stdev=78.99, samples=101 iops : min= 1, max= 25, avg= 6.45, stdev= 4.97, samples=101 write: IOPS=7, BW=115KiB/s (117kB/s)(6256KiB/54588msec); 0 zone resets clat (msec): min=14, max=384, avg=82.68, stdev=58.12 lat (msec): min=14, max=384, avg=82.68, stdev=58.12 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 40], | 30.00th=[ 46], 40.00th=[ 53], 50.00th=[ 62], 60.00th=[ 78], | 70.00th=[ 95], 80.00th=[ 120], 90.00th=[ 163], 95.00th=[ 201], | 99.00th=[ 279], 99.50th=[ 376], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 320, per=25.29%, avg=116.59, stdev=74.44, samples=105 iops : min= 1, max= 20, avg= 6.50, stdev= 4.72, samples=105 lat (msec) : 10=0.52%, 20=7.16%, 50=40.89%, 100=29.69%, 250=20.05% lat (msec) : 500=1.69% cpu : usr=0.06%, sys=1.62%, ctx=1154, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=439KiB/s (449kB/s), 105KiB/s-115KiB/s (108kB/s-117kB/s), io=23.4MiB (24.5MB), run=53842-54614msec WRITE: bw=461KiB/s (472kB/s), 110KiB/s-120KiB/s (113kB/s-123kB/s), io=24.6MiB (25.8MB), run=53842-54614msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178620: Sun Aug 9 17:51:10 2026 read: IOPS=1, BW=1476KiB/s (1511kB/s)(7168KiB/4857msec) clat (usec): min=508, max=2954.2k, avg=574190.76, stdev=1056265.40 lat (usec): min=509, max=2954.2k, avg=574192.72, stdev=1056265.68 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], | 20.00th=[ 111674], 30.00th=[ 135267], 40.00th=[ 135267], | 50.00th=[ 183501], 60.00th=[ 248513], 70.00th=[ 248513], | 80.00th=[ 383779], 90.00th=[2969568], 95.00th=[2969568], | 99.00th=[2969568], 99.50th=[2969568], 99.90th=[2969568], | 99.95th=[2969568], 99.99th=[2969568] bw ( KiB/s): min= 1428, max= 6119, per=95.37%, avg=2898.25, stdev=2165.47, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1054KiB/s (1079kB/s)(5120KiB/4857msec); 0 zone resets clat (msec): min=92, max=187, avg=154.47, stdev=38.33 lat (msec): min=92, max=187, avg=154.60, stdev=38.33 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 178], 80.00th=[ 178], 90.00th=[ 188], 95.00th=[ 188], | 99.00th=[ 188], 99.50th=[ 188], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 2003, max= 4087, per=63.70%, avg=2709.67, stdev=1192.94, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=10.56%, ctx=605, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178621: Sun Aug 9 17:51:10 2026 read: IOPS=0, BW=304KiB/s (311kB/s)(2048KiB/6739msec) clat (usec): min=781, max=652587, avg=326684.67, stdev=460896.83 lat (usec): min=782, max=652590, avg=326686.58, stdev=460897.41 clat percentiles (usec): | 1.00th=[ 783], 5.00th=[ 783], 10.00th=[ 783], 20.00th=[ 783], | 30.00th=[ 783], 40.00th=[ 783], 50.00th=[ 783], 60.00th=[650118], | 70.00th=[650118], 80.00th=[650118], 90.00th=[650118], 95.00th=[650118], | 99.00th=[650118], 99.50th=[650118], 99.90th=[650118], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 1432, max= 2035, per=57.04%, avg=1733.50, stdev=426.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1520KiB/s (1556kB/s)(10.0MiB/6739msec); 0 zone resets clat (msec): min=170, max=2838, avg=603.83, stdev=815.19 lat (msec): min=170, max=2838, avg=603.92, stdev=815.19 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 182], 50.00th=[ 213], 60.00th=[ 418], | 70.00th=[ 447], 80.00th=[ 600], 90.00th=[ 818], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1932, max= 4087, per=85.60%, avg=3641.60, stdev=955.87, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.24%, ctx=182, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178622: Sun Aug 9 17:51:10 2026 read: IOPS=0, BW=980KiB/s (1004kB/s)(6144KiB/6267msec) clat (usec): min=520, max=383807, avg=144491.95, stdev=149163.76 lat (usec): min=522, max=383809, avg=144493.40, stdev=149163.66 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 89654], 50.00th=[ 89654], 60.00th=[149947], | 70.00th=[242222], 80.00th=[242222], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 2035, max= 4087, per=100.00%, avg=3376.33, stdev=1162.32, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=980KiB/s (1004kB/s)(6144KiB/6267msec); 0 zone resets clat (msec): min=258, max=2839, avg=893.82, stdev=962.16 lat (msec): min=258, max=2839, avg=893.90, stdev=962.16 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 567], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1391, max= 2039, per=44.64%, avg=1899.00, stdev=284.32, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=16.67%, 500=16.67%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.77%, ctx=206, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178623: Sun Aug 9 17:51:10 2026 read: IOPS=0, BW=841KiB/s (861kB/s)(5120KiB/6086msec) clat (usec): min=404, max=178436, avg=47134.88, stdev=77216.63 lat (usec): min=405, max=178438, avg=47136.32, stdev=77216.86 clat percentiles (usec): | 1.00th=[ 404], 5.00th=[ 404], 10.00th=[ 404], 20.00th=[ 404], | 30.00th=[ 486], 40.00th=[ 486], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 55837], 80.00th=[ 55837], 90.00th=[179307], 95.00th=[179307], | 99.00th=[179307], 99.50th=[179307], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1178KiB/s (1206kB/s)(7168KiB/6086msec); 0 zone resets clat (msec): min=160, max=2985, avg=827.84, stdev=971.40 lat (msec): min=160, max=2985, avg=827.91, stdev=971.41 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 330], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 472], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 751], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 2003, max= 4087, per=57.22%, avg=2434.20, stdev=924.02, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 100=8.33%, 250=16.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=7.90%, ctx=94, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3039KiB/s (3112kB/s), 304KiB/s-1476KiB/s (311kB/s-1511kB/s), io=20.0MiB (20.0MB), run=4857-6739msec WRITE: bw=4255KiB/s (4357kB/s), 980KiB/s-1520KiB/s (1004kB/s-1556kB/s), io=28.0MiB (29.4MB), run=4857-6739msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178625: Sun Aug 9 17:51:12 2026 read: IOPS=1, BW=1048KiB/s (1073kB/s)(7168KiB/6841msec) clat (msec): min=109, max=2739, avg=754.57, stdev=967.27 lat (msec): min=109, max=2739, avg=754.58, stdev=967.27 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 148], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 334], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 1284], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1917, max= 4063, per=87.51%, avg=2420.40, stdev=919.82, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=748KiB/s (766kB/s)(5120KiB/6841msec); 0 zone resets clat (msec): min=136, max=709, avg=272.61, stdev=246.04 lat (msec): min=136, max=710, avg=272.74, stdev=246.04 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2015, max= 4087, per=70.16%, avg=2716.67, stdev=1186.86, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=58.33%, 500=8.33%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.94%, ctx=78, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178626: Sun Aug 9 17:51:12 2026 read: IOPS=0, BW=287KiB/s (294kB/s)(2048KiB/7124msec) clat (msec): min=184, max=262, avg=223.52, stdev=55.17 lat (msec): min=184, max=262, avg=223.52, stdev=55.17 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 1865, max= 2048, per=70.73%, avg=1956.50, stdev=129.40, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1437KiB/s (1472kB/s)(10.0MiB/7124msec); 0 zone resets clat (msec): min=141, max=3498, avg=655.43, stdev=1031.93 lat (msec): min=141, max=3498, avg=656.95, stdev=1031.28 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 197], | 30.00th=[ 211], 40.00th=[ 234], 50.00th=[ 255], 60.00th=[ 300], | 70.00th=[ 309], 80.00th=[ 363], 90.00th=[ 1053], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 2011, max= 6131, per=82.85%, avg=3208.00, stdev=1812.37, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.81%, ctx=145, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178627: Sun Aug 9 17:51:12 2026 read: IOPS=0, BW=862KiB/s (883kB/s)(6144KiB/7125msec) clat (msec): min=116, max=839, avg=316.97, stdev=274.92 lat (msec): min=116, max=839, avg=316.97, stdev=274.92 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 279], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1917, max= 2048, per=72.52%, avg=2006.00, stdev=52.76, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=862KiB/s (883kB/s)(6144KiB/7125msec); 0 zone resets clat (msec): min=171, max=3320, avg=857.56, stdev=1216.88 lat (msec): min=171, max=3320, avg=857.71, stdev=1216.93 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 485], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 2000, max= 4015, per=62.59%, avg=2423.40, stdev=889.97, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.26%, ctx=93, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178628: Sun Aug 9 17:51:12 2026 read: IOPS=0, BW=692KiB/s (708kB/s)(5120KiB/7404msec) clat (msec): min=79, max=338, avg=240.84, stdev=106.40 lat (msec): min=79, max=338, avg=240.84, stdev=106.40 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2043, max= 4015, per=97.69%, avg=2702.00, stdev=1137.09, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=968KiB/s (991kB/s)(7168KiB/7404msec); 0 zone resets clat (msec): min=118, max=3184, avg=885.13, stdev=1081.00 lat (msec): min=118, max=3184, avg=885.24, stdev=1081.00 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 138], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 558], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 1036], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1481, max= 4096, per=59.81%, avg=2316.00, stdev=1021.12, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=3.43%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2766KiB/s (2832kB/s), 287KiB/s-1048KiB/s (294kB/s-1073kB/s), io=20.0MiB (20.0MB), run=6841-7404msec WRITE: bw=3873KiB/s (3965kB/s), 748KiB/s-1437KiB/s (766kB/s-1472kB/s), io=28.0MiB (29.4MB), run=6841-7404msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178637: Sun Aug 9 17:51:26 2026 read: IOPS=1, BW=5258KiB/s (5384kB/s)(12.0MiB/2337msec) clat (msec): min=552, max=934, avg=749.12, stdev=191.15 lat (msec): min=552, max=934, avg=749.12, stdev=191.15 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=15.24%, ctx=288, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178638: Sun Aug 9 17:51:26 2026 read: IOPS=0, BW=1673KiB/s (1713kB/s)(4096KiB/2448msec) clat (nsec): min=835013k, max=835013k, avg=835012752.00, stdev= 0.00 lat (nsec): min=835016k, max=835016k, avg=835015502.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3346KiB/s (3427kB/s)(8192KiB/2448msec); 0 zone resets clat (msec): min=410, max=1105, avg=757.74, stdev=491.56 lat (msec): min=410, max=1105, avg=758.06, stdev=491.54 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8143, max= 8143, per=60.84%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.51%, ctx=258, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178639: Sun Aug 9 17:51:26 2026 write: IOPS=1, BW=6557KiB/s (6714kB/s)(12.0MiB/1874msec); 0 zone resets clat (msec): min=396, max=936, avg=585.12, stdev=304.86 lat (msec): min=397, max=938, avg=588.99, stdev=303.21 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7160, max= 8126, per=57.10%, avg=7643.00, stdev=683.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=4.22%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178640: Sun Aug 9 17:51:26 2026 write: IOPS=1, BW=5520KiB/s (5653kB/s)(12.0MiB/2226msec); 0 zone resets clat (msec): min=439, max=1257, avg=719.31, stdev=466.34 lat (msec): min=439, max=1257, avg=720.17, stdev=465.91 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 6930, max= 8062, per=56.00%, avg=7496.00, stdev=800.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.09%, sys=5.53%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6693KiB/s (6853kB/s), 1673KiB/s-5258KiB/s (1713kB/s-5384kB/s), io=16.0MiB (16.8MB), run=2337-2448msec WRITE: bw=13.1MiB/s (13.7MB/s), 3346KiB/s-6557KiB/s (3427kB/s-6714kB/s), io=32.0MiB (33.6MB), run=1874-2448msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178641: Sun Aug 9 17:51:26 2026 read: IOPS=1, BW=4872KiB/s (4989kB/s)(12.0MiB/2522msec) clat (msec): min=483, max=1068, avg=804.56, stdev=296.73 lat (msec): min=483, max=1068, avg=804.56, stdev=296.73 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7937, max= 8062, per=100.00%, avg=7999.50, stdev=88.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.41%, ctx=44, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178642: Sun Aug 9 17:51:26 2026 read: IOPS=0, BW=1306KiB/s (1337kB/s)(4096KiB/3136msec) clat (nsec): min=1384.8M, max=1384.8M, avg=1384763728.00, stdev= 0.00 lat (nsec): min=1384.8M, max=1384.8M, avg=1384766299.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2612KiB/s (2675kB/s)(8192KiB/3136msec); 0 zone resets clat (msec): min=383, max=1034, avg=708.94, stdev=460.61 lat (msec): min=383, max=1035, avg=709.45, stdev=461.06 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8062, max= 8062, per=77.16%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.57%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178643: Sun Aug 9 17:51:26 2026 write: IOPS=0, BW=4046KiB/s (4143kB/s)(12.0MiB/3037msec); 0 zone resets clat (msec): min=396, max=1186, avg=908.86, stdev=444.25 lat (msec): min=396, max=1186, avg=909.28, stdev=444.24 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8031, max= 8175, per=77.56%, avg=8103.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.02%, ctx=59, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178644: Sun Aug 9 17:51:26 2026 write: IOPS=0, BW=3950KiB/s (4045kB/s)(12.0MiB/3111msec); 0 zone resets clat (msec): min=306, max=2039, avg=960.13, stdev=941.67 lat (msec): min=308, max=2041, avg=961.76, stdev=941.50 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 7937, max= 7937, per=75.97%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.69%, ctx=81, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5224KiB/s (5350kB/s), 1306KiB/s-4872KiB/s (1337kB/s-4989kB/s), io=16.0MiB (16.8MB), run=2522-3136msec WRITE: bw=10.2MiB/s (10.7MB/s), 2612KiB/s-4046KiB/s (2675kB/s-4143kB/s), io=32.0MiB (33.6MB), run=3037-3136msec