== sanity test 398b: DIO and buffer IO race ============== 22:06:22 (1763348782) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.87798 s, 13.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182772: Sun Nov 16 22:08:12 2025 read: IOPS=15, BW=61.0KiB/s (63.4kB/s)(5992KiB/96716msec) clat (usec): min=111, max=720371, avg=36581.14, stdev=29814.85 lat (usec): min=111, max=720373, avg=36582.27, stdev=29814.91 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 9503], 10.00th=[ 14091], 20.00th=[ 18482], | 30.00th=[ 21890], 40.00th=[ 26084], 50.00th=[ 31065], 60.00th=[ 36439], | 70.00th=[ 42730], 80.00th=[ 52167], 90.00th=[ 65274], 95.00th=[ 77071], | 99.00th=[116917], 99.50th=[166724], 99.90th=[206570], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 7, max= 119, per=24.99%, avg=61.47, stdev=22.05, samples=191 iops : min= 1, max= 29, avg=14.72, stdev= 5.53, samples=191 write: IOPS=16, BW=65.1KiB/s (66.7kB/s)(6296KiB/96716msec); 0 zone resets clat (usec): min=799, max=184463, avg=26390.84, stdev=26677.14 lat (usec): min=800, max=184464, avg=26395.02, stdev=26675.99 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1205], 20.00th=[ 2376], | 30.00th=[ 6128], 40.00th=[ 13304], 50.00th=[ 19792], 60.00th=[ 26084], | 70.00th=[ 33424], 80.00th=[ 44303], 90.00th=[ 64750], 95.00th=[ 80217], | 99.00th=[116917], 99.50th=[135267], 99.90th=[152044], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 15, max= 159, per=25.25%, avg=64.90, stdev=25.41, samples=190 iops : min= 3, max= 39, avg=15.58, stdev= 6.39, samples=190 lat (usec) : 250=1.60%, 500=0.23%, 750=0.03%, 1000=0.29% lat (msec) : 2=8.95%, 4=3.61%, 10=6.28%, 20=16.31%, 50=43.59% lat (msec) : 100=17.15%, 250=1.92%, 750=0.03% cpu : usr=0.09%, sys=6.79%, ctx=6390, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182773: Sun Nov 16 22:08:12 2025 read: IOPS=15, BW=62.0KiB/s (63.5kB/s)(5940KiB/95772msec) clat (usec): min=131, max=762534, avg=36691.32, stdev=29167.15 lat (usec): min=132, max=762534, avg=36692.38, stdev=29167.16 clat percentiles (usec): | 1.00th=[ 157], 5.00th=[ 9503], 10.00th=[ 14353], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 63701], 95.00th=[ 78119], | 99.00th=[111674], 99.50th=[116917], 99.90th=[219153], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 125, per=25.14%, avg=61.85, stdev=20.91, samples=188 iops : min= 1, max= 31, avg=14.81, stdev= 5.27, samples=188 write: IOPS=16, BW=66.3KiB/s (67.9kB/s)(6348KiB/95772msec); 0 zone resets clat (usec): min=904, max=235173, avg=25782.97, stdev=27043.52 lat (usec): min=905, max=235174, avg=25789.42, stdev=27046.66 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 2212], | 30.00th=[ 5604], 40.00th=[ 12518], 50.00th=[ 19006], 60.00th=[ 25297], | 70.00th=[ 31851], 80.00th=[ 44303], 90.00th=[ 64226], 95.00th=[ 76022], | 99.00th=[115868], 99.50th=[147850], 99.90th=[185598], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 159, per=25.73%, avg=66.14, stdev=28.39, samples=188 iops : min= 1, max= 39, avg=15.90, stdev= 7.16, samples=188 lat (usec) : 250=1.60%, 500=0.16%, 750=0.03%, 1000=0.36% lat (msec) : 2=9.47%, 4=4.04%, 10=6.02%, 20=16.11%, 50=43.07% lat (msec) : 100=17.48%, 250=1.63%, 1000=0.03% cpu : usr=0.10%, sys=6.77%, ctx=6387, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182774: Sun Nov 16 22:08:12 2025 read: IOPS=15, BW=63.4KiB/s (64.9kB/s)(6028KiB/95134msec) clat (usec): min=114, max=732018, avg=35484.99, stdev=28766.89 lat (usec): min=115, max=732019, avg=35486.23, stdev=28766.89 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 1614], 10.00th=[ 13042], 20.00th=[ 18482], | 30.00th=[ 22414], 40.00th=[ 26608], 50.00th=[ 30540], 60.00th=[ 35390], | 70.00th=[ 41681], 80.00th=[ 48497], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[108528], 99.50th=[139461], 99.90th=[193987], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 119, per=25.50%, avg=62.74, stdev=22.01, samples=187 iops : min= 1, max= 29, avg=15.04, stdev= 5.54, samples=187 write: IOPS=16, BW=65.8KiB/s (67.4kB/s)(6260KiB/95134msec); 0 zone resets clat (usec): min=920, max=211743, avg=26371.57, stdev=27809.85 lat (usec): min=922, max=211745, avg=26373.26, stdev=27809.74 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 1893], | 30.00th=[ 5342], 40.00th=[ 11994], 50.00th=[ 19268], 60.00th=[ 26084], | 70.00th=[ 34341], 80.00th=[ 45876], 90.00th=[ 63177], 95.00th=[ 82314], | 99.00th=[123208], 99.50th=[141558], 99.90th=[166724], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 157, per=25.45%, avg=65.40, stdev=25.98, samples=186 iops : min= 1, max= 39, avg=15.72, stdev= 6.56, samples=186 lat (usec) : 250=1.95%, 500=0.39%, 750=0.03%, 1000=0.36% lat (msec) : 2=10.42%, 4=3.29%, 10=5.60%, 20=15.69%, 50=44.50% lat (msec) : 100=15.72%, 250=2.02%, 750=0.03% cpu : usr=0.09%, sys=6.66%, ctx=6310, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182775: Sun Nov 16 22:08:12 2025 read: IOPS=15, BW=62.1KiB/s (63.6kB/s)(6052KiB/97469msec) clat (usec): min=115, max=744388, avg=36252.45, stdev=29753.97 lat (usec): min=115, max=744389, avg=36254.74, stdev=29753.46 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 9634], 10.00th=[ 14091], 20.00th=[ 18744], | 30.00th=[ 22152], 40.00th=[ 26346], 50.00th=[ 30802], 60.00th=[ 36439], | 70.00th=[ 42206], 80.00th=[ 50070], 90.00th=[ 62653], 95.00th=[ 78119], | 99.00th=[121111], 99.50th=[139461], 99.90th=[250610], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 118, per=25.06%, avg=61.66, stdev=21.58, samples=191 iops : min= 1, max= 29, avg=14.77, stdev= 5.44, samples=191 write: IOPS=15, BW=63.0KiB/s (65.5kB/s)(6236KiB/97469msec); 0 zone resets clat (usec): min=835, max=207214, avg=27100.00, stdev=28027.71 lat (usec): min=836, max=207216, avg=27101.31, stdev=28027.77 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1221], 20.00th=[ 2278], | 30.00th=[ 5604], 40.00th=[ 12649], 50.00th=[ 20317], 60.00th=[ 27395], | 70.00th=[ 35390], 80.00th=[ 46924], 90.00th=[ 64226], 95.00th=[ 79168], | 99.00th=[124257], 99.50th=[133694], 99.90th=[193987], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 15, max= 159, per=24.73%, avg=63.57, stdev=24.97, samples=191 iops : min= 3, max= 39, avg=15.25, stdev= 6.26, samples=191 lat (usec) : 250=1.60%, 500=0.16%, 1000=0.39% lat (msec) : 2=9.08%, 4=3.65%, 10=6.22%, 20=15.33%, 50=44.76% lat (msec) : 100=16.70%, 250=2.05%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=6.66%, ctx=6439, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=246KiB/s (252kB/s), 61.0KiB/s-63.4KiB/s (63.4kB/s-64.9kB/s), io=23.4MiB (24.6MB), run=95134-97469msec WRITE: bw=258KiB/s (264kB/s), 63.0KiB/s-66.3KiB/s (65.5kB/s-67.9kB/s), io=24.6MiB (25.7MB), run=95134-97469msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182777: Sun Nov 16 22:08:43 2025 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(5992KiB/128581msec) clat (msec): min=5, max=769, avg=33.69, stdev=36.09 lat (msec): min=5, max=769, avg=33.69, stdev=36.09 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 75], 95.00th=[ 102], | 99.00th=[ 150], 99.50th=[ 171], 99.90th=[ 262], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 166, per=25.30%, avg=47.05, stdev=30.93, samples=249 iops : min= 1, max= 41, avg=11.12, stdev= 7.79, samples=249 write: IOPS=12, BW=48.0KiB/s (50.1kB/s)(6296KiB/128581msec); 0 zone resets clat (msec): min=9, max=339, avg=49.53, stdev=34.21 lat (msec): min=9, max=339, avg=49.53, stdev=34.21 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 72], 90.00th=[ 95], 95.00th=[ 118], | 99.00th=[ 169], 99.50th=[ 188], 99.90th=[ 317], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 135, per=25.08%, avg=48.66, stdev=29.23, samples=253 iops : min= 1, max= 33, avg=11.52, stdev= 7.36, samples=253 lat (msec) : 10=3.74%, 20=23.37%, 50=45.67%, 100=20.31%, 250=6.77% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=2.13%, ctx=4662, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182778: Sun Nov 16 22:08:43 2025 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(5940KiB/128954msec) clat (msec): min=5, max=766, avg=33.35, stdev=36.87 lat (msec): min=5, max=766, avg=33.35, stdev=36.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 74], 95.00th=[ 102], | 99.00th=[ 163], 99.50th=[ 180], 99.90th=[ 284], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 159, per=24.94%, avg=46.38, stdev=31.89, samples=249 iops : min= 1, max= 39, avg=10.94, stdev= 8.01, samples=249 write: IOPS=12, BW=49.2KiB/s (50.4kB/s)(6348KiB/128954msec); 0 zone resets clat (msec): min=10, max=334, avg=49.98, stdev=36.02 lat (msec): min=10, max=334, avg=49.98, stdev=36.02 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 96], 95.00th=[ 117], | 99.00th=[ 186], 99.50th=[ 243], 99.90th=[ 309], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 135, per=25.12%, avg=48.74, stdev=29.49, samples=253 iops : min= 1, max= 33, avg=11.53, stdev= 7.43, samples=253 lat (msec) : 10=3.97%, 20=23.93%, 50=44.82%, 100=20.28%, 250=6.74% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.18%, ctx=4783, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182779: Sun Nov 16 22:08:43 2025 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6028KiB/128882msec) clat (msec): min=5, max=233, avg=33.49, stdev=31.78 lat (msec): min=5, max=233, avg=33.50, stdev=31.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 165], 99.50th=[ 186], 99.90th=[ 218], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 7, max= 200, per=25.15%, avg=46.78, stdev=31.59, samples=251 iops : min= 1, max= 50, avg=11.04, stdev= 7.96, samples=251 write: IOPS=12, BW=48.6KiB/s (49.7kB/s)(6260KiB/128882msec); 0 zone resets clat (msec): min=8, max=774, avg=50.03, stdev=38.64 lat (msec): min=8, max=774, avg=50.03, stdev=38.64 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 74], 90.00th=[ 94], 95.00th=[ 113], | 99.00th=[ 161], 99.50th=[ 222], 99.90th=[ 284], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 151, per=24.89%, avg=48.29, stdev=29.74, samples=252 iops : min= 1, max= 37, avg=11.42, stdev= 7.47, samples=252 lat (msec) : 10=3.87%, 20=24.02%, 50=44.95%, 100=20.57%, 250=6.41% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=2.23%, ctx=4810, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182780: Sun Nov 16 22:08:43 2025 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6052KiB/127632msec) clat (msec): min=5, max=276, avg=31.95, stdev=29.13 lat (msec): min=5, max=276, avg=31.95, stdev=29.13 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 70], 95.00th=[ 92], | 99.00th=[ 153], 99.50th=[ 171], 99.90th=[ 215], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 171, per=25.65%, avg=47.71, stdev=30.77, samples=248 iops : min= 1, max= 42, avg=11.27, stdev= 7.71, samples=248 write: IOPS=12, BW=48.9KiB/s (50.0kB/s)(6236KiB/127632msec); 0 zone resets clat (msec): min=10, max=750, avg=50.78, stdev=38.68 lat (msec): min=10, max=750, avg=50.78, stdev=38.68 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 73], 90.00th=[ 99], 95.00th=[ 120], | 99.00th=[ 161], 99.50th=[ 213], 99.90th=[ 268], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 136, per=25.01%, avg=48.51, stdev=28.83, samples=251 iops : min= 1, max= 34, avg=11.48, stdev= 7.26, samples=251 lat (msec) : 10=3.97%, 20=24.28%, 50=45.18%, 100=20.05%, 250=6.38% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=2.16%, ctx=4683, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (191kB/s), 46.1KiB/s-47.4KiB/s (47.2kB/s-48.6kB/s), io=23.4MiB (24.6MB), run=127632-128954msec WRITE: bw=195KiB/s (200kB/s), 48.6KiB/s-49.2KiB/s (49.7kB/s-50.4kB/s), io=24.6MiB (25.7MB), run=127632-128954msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182818: Sun Nov 16 22:09:17 2025 read: IOPS=16, BW=264KiB/s (270kB/s)(5920KiB/22458msec) clat (usec): min=98, max=157738, avg=33875.38, stdev=20624.08 lat (usec): min=99, max=157739, avg=33876.64, stdev=20624.06 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 330], 10.00th=[ 14222], 20.00th=[ 19006], | 30.00th=[ 22414], 40.00th=[ 25822], 50.00th=[ 30016], 60.00th=[ 34341], | 70.00th=[ 40109], 80.00th=[ 46400], 90.00th=[ 60556], 95.00th=[ 70779], | 99.00th=[100140], 99.50th=[129500], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 61, max= 413, per=25.02%, avg=261.18, stdev=76.03, samples=44 iops : min= 3, max= 25, avg=15.59, stdev= 4.83, samples=44 write: IOPS=17, BW=284KiB/s (290kB/s)(6368KiB/22458msec); 0 zone resets clat (usec): min=1416, max=131328, avg=24713.44, stdev=23745.48 lat (usec): min=1418, max=131330, avg=24720.13, stdev=23743.00 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1811], 10.00th=[ 1958], 20.00th=[ 3884], | 30.00th=[ 7111], 40.00th=[ 11863], 50.00th=[ 18482], 60.00th=[ 23725], | 70.00th=[ 31851], 80.00th=[ 43779], 90.00th=[ 58459], 95.00th=[ 73925], | 99.00th=[103285], 99.50th=[123208], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 63, max= 563, per=25.66%, avg=282.00, stdev=105.30, samples=44 iops : min= 3, max= 35, avg=16.91, stdev= 6.68, samples=44 lat (usec) : 100=0.13%, 250=1.95%, 500=0.52%, 750=0.13% lat (msec) : 2=5.34%, 4=5.47%, 10=8.98%, 20=16.28%, 50=45.44% lat (msec) : 100=14.71%, 250=1.04% cpu : usr=0.10%, sys=8.48%, ctx=1758, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182819: Sun Nov 16 22:09:17 2025 read: IOPS=16, BW=260KiB/s (266kB/s)(5744KiB/22105msec) clat (usec): min=137, max=153069, avg=31748.13, stdev=18792.57 lat (usec): min=138, max=153069, avg=31749.71, stdev=18792.87 clat percentiles (usec): | 1.00th=[ 149], 5.00th=[ 1057], 10.00th=[ 13435], 20.00th=[ 17433], | 30.00th=[ 21890], 40.00th=[ 25297], 50.00th=[ 28443], 60.00th=[ 33162], | 70.00th=[ 38011], 80.00th=[ 43779], 90.00th=[ 54789], 95.00th=[ 61080], | 99.00th=[101188], 99.50th=[116917], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 62, max= 532, per=24.67%, avg=257.60, stdev=90.44, samples=43 iops : min= 3, max= 33, avg=15.35, stdev= 5.76, samples=43 write: IOPS=18, BW=296KiB/s (303kB/s)(6544KiB/22105msec); 0 zone resets clat (usec): min=1247, max=135167, avg=25645.47, stdev=24055.49 lat (usec): min=1249, max=135170, avg=25647.55, stdev=24055.47 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1713], 10.00th=[ 2040], 20.00th=[ 5342], | 30.00th=[ 8455], 40.00th=[ 14615], 50.00th=[ 19268], 60.00th=[ 24773], | 70.00th=[ 31327], 80.00th=[ 41681], 90.00th=[ 58983], 95.00th=[ 76022], | 99.00th=[110625], 99.50th=[113771], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 95, max= 478, per=26.58%, avg=292.14, stdev=93.22, samples=43 iops : min= 5, max= 29, avg=17.53, stdev= 5.83, samples=43 lat (usec) : 250=1.43%, 500=0.78% lat (msec) : 2=5.34%, 4=4.04%, 10=8.59%, 20=19.14%, 50=46.88% lat (msec) : 100=12.37%, 250=1.43% cpu : usr=0.09%, sys=8.60%, ctx=1807, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182820: Sun Nov 16 22:09:17 2025 read: IOPS=17, BW=273KiB/s (279kB/s)(6256KiB/22928msec) clat (usec): min=115, max=141736, avg=34108.73, stdev=24085.34 lat (usec): min=116, max=141737, avg=34124.42, stdev=24096.74 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 180], 10.00th=[ 6259], 20.00th=[ 16581], | 30.00th=[ 21365], 40.00th=[ 25822], 50.00th=[ 29492], 60.00th=[ 34866], | 70.00th=[ 41157], 80.00th=[ 50070], 90.00th=[ 61604], 95.00th=[ 74974], | 99.00th=[127402], 99.50th=[131597], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 95, max= 509, per=25.81%, avg=269.44, stdev=92.74, samples=45 iops : min= 5, max= 31, avg=16.11, stdev= 5.85, samples=45 write: IOPS=16, BW=263KiB/s (269kB/s)(6032KiB/22928msec); 0 zone resets clat (usec): min=1437, max=116556, avg=24904.29, stdev=23889.78 lat (usec): min=1438, max=116559, avg=24907.31, stdev=23890.30 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1713], 10.00th=[ 2040], 20.00th=[ 4424], | 30.00th=[ 7373], 40.00th=[ 11863], 50.00th=[ 17695], 60.00th=[ 23462], | 70.00th=[ 31065], 80.00th=[ 42730], 90.00th=[ 62129], 95.00th=[ 72877], | 99.00th=[101188], 99.50th=[103285], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 125, max= 657, per=23.37%, avg=256.84, stdev=113.79, samples=45 iops : min= 7, max= 41, avg=15.31, stdev= 7.17, samples=45 lat (usec) : 250=4.30%, 500=0.39%, 750=0.13% lat (msec) : 2=4.82%, 4=4.82%, 10=8.72%, 20=16.93%, 50=42.19% lat (msec) : 100=15.36%, 250=2.34% cpu : usr=0.11%, sys=8.13%, ctx=1682, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182821: Sun Nov 16 22:09:17 2025 read: IOPS=17, BW=276KiB/s (283kB/s)(6032KiB/21851msec) clat (usec): min=121, max=180589, avg=32062.33, stdev=22664.50 lat (usec): min=121, max=180590, avg=32063.54, stdev=22664.68 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 159], 10.00th=[ 326], 20.00th=[ 17695], | 30.00th=[ 22152], 40.00th=[ 25035], 50.00th=[ 27919], 60.00th=[ 32900], | 70.00th=[ 38536], 80.00th=[ 45351], 90.00th=[ 58983], 95.00th=[ 69731], | 99.00th=[107480], 99.50th=[141558], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 125, max= 475, per=26.14%, avg=272.95, stdev=82.91, samples=43 iops : min= 7, max= 29, avg=16.33, stdev= 5.22, samples=43 write: IOPS=17, BW=286KiB/s (293kB/s)(6256KiB/21851msec); 0 zone resets clat (usec): min=1303, max=148054, avg=24291.66, stdev=24618.07 lat (usec): min=1304, max=148057, avg=24311.99, stdev=24668.06 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1745], 10.00th=[ 2089], 20.00th=[ 4817], | 30.00th=[ 7767], 40.00th=[ 10945], 50.00th=[ 16581], 60.00th=[ 21365], | 70.00th=[ 27919], 80.00th=[ 42206], 90.00th=[ 59507], 95.00th=[ 73925], | 99.00th=[111674], 99.50th=[133694], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 95, max= 563, per=25.99%, avg=285.60, stdev=95.43, samples=43 iops : min= 5, max= 35, avg=17.12, stdev= 6.01, samples=43 lat (usec) : 250=4.69%, 500=0.91%, 1000=0.13% lat (msec) : 2=4.82%, 4=4.69%, 10=10.16%, 20=16.02%, 50=42.19% lat (msec) : 100=15.10%, 250=1.30% cpu : usr=0.09%, sys=8.82%, ctx=1701, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1045KiB/s (1070kB/s), 260KiB/s-276KiB/s (266kB/s-283kB/s), io=23.4MiB (24.5MB), run=21851-22928msec WRITE: bw=1099KiB/s (1125kB/s), 263KiB/s-296KiB/s (269kB/s-303kB/s), io=24.6MiB (25.8MB), run=21851-22928msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182824: Sun Nov 16 22:09:25 2025 read: IOPS=12, BW=206KiB/s (211kB/s)(5920KiB/28755msec) clat (msec): min=6, max=158, avg=29.84, stdev=27.05 lat (msec): min=6, max=158, avg=29.85, stdev=27.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 62], 95.00th=[ 94], | 99.00th=[ 146], 99.50th=[ 148], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 62, max= 536, per=24.39%, avg=199.79, stdev=116.98, samples=56 iops : min= 3, max= 33, avg=11.70, stdev= 7.36, samples=56 write: IOPS=13, BW=221KiB/s (227kB/s)(6368KiB/28755msec); 0 zone resets clat (msec): min=9, max=231, avg=44.22, stdev=31.47 lat (msec): min=9, max=231, avg=44.23, stdev=31.47 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 85], 95.00th=[ 106], | 99.00th=[ 155], 99.50th=[ 199], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 576, per=25.35%, avg=218.54, stdev=129.19, samples=56 iops : min= 1, max= 36, avg=12.88, stdev= 8.14, samples=56 lat (msec) : 10=4.95%, 20=27.21%, 50=45.31%, 100=17.32%, 250=5.21% cpu : usr=0.06%, sys=2.87%, ctx=1267, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182825: Sun Nov 16 22:09:25 2025 read: IOPS=12, BW=197KiB/s (201kB/s)(5744KiB/29210msec) clat (msec): min=5, max=189, avg=31.11, stdev=30.32 lat (msec): min=5, max=189, avg=31.11, stdev=30.32 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 32], 80.00th=[ 48], 90.00th=[ 81], 95.00th=[ 101], | 99.00th=[ 140], 99.50th=[ 150], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 574, per=23.83%, avg=195.18, stdev=138.67, samples=56 iops : min= 1, max= 35, avg=11.41, stdev= 8.70, samples=56 write: IOPS=14, BW=224KiB/s (229kB/s)(6544KiB/29210msec); 0 zone resets clat (msec): min=10, max=196, avg=43.58, stdev=31.88 lat (msec): min=10, max=196, avg=43.59, stdev=31.88 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 64], 90.00th=[ 88], 95.00th=[ 113], | 99.00th=[ 159], 99.50th=[ 165], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 507, per=24.97%, avg=215.21, stdev=132.46, samples=57 iops : min= 1, max= 31, avg=12.67, stdev= 8.37, samples=57 lat (msec) : 10=7.03%, 20=29.95%, 50=39.71%, 100=17.06%, 250=6.25% cpu : usr=0.07%, sys=2.80%, ctx=1256, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182826: Sun Nov 16 22:09:25 2025 read: IOPS=13, BW=219KiB/s (224kB/s)(6256KiB/28565msec) clat (msec): min=5, max=141, avg=29.26, stdev=25.48 lat (msec): min=5, max=141, avg=29.26, stdev=25.48 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 66], 95.00th=[ 87], | 99.00th=[ 121], 99.50th=[ 136], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 31, max= 667, per=26.62%, avg=218.04, stdev=148.50, samples=56 iops : min= 1, max= 41, avg=12.84, stdev= 9.33, samples=56 write: IOPS=13, BW=211KiB/s (216kB/s)(6032KiB/28565msec); 0 zone resets clat (msec): min=8, max=175, avg=44.89, stdev=29.84 lat (msec): min=8, max=175, avg=44.90, stdev=29.84 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 65], 90.00th=[ 87], 95.00th=[ 105], | 99.00th=[ 159], 99.50th=[ 169], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 62, max= 544, per=24.03%, avg=207.16, stdev=120.50, samples=56 iops : min= 3, max= 34, avg=12.16, stdev= 7.61, samples=56 lat (msec) : 10=7.29%, 20=26.56%, 50=41.28%, 100=20.44%, 250=4.43% cpu : usr=0.07%, sys=2.99%, ctx=1283, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182827: Sun Nov 16 22:09:25 2025 read: IOPS=13, BW=210KiB/s (215kB/s)(6032KiB/28753msec) clat (msec): min=5, max=187, avg=29.79, stdev=28.56 lat (msec): min=5, max=187, avg=29.79, stdev=28.56 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 71], 95.00th=[ 99], | 99.00th=[ 136], 99.50th=[ 165], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 31, max= 504, per=25.88%, avg=211.98, stdev=129.10, samples=55 iops : min= 1, max= 31, avg=12.47, stdev= 8.08, samples=55 write: IOPS=13, BW=218KiB/s (223kB/s)(6256KiB/28753msec); 0 zone resets clat (msec): min=10, max=170, avg=44.51, stdev=32.41 lat (msec): min=10, max=170, avg=44.51, stdev=32.41 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 90], 95.00th=[ 117], | 99.00th=[ 161], 99.50th=[ 165], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 31, max= 604, per=25.13%, avg=216.64, stdev=139.39, samples=56 iops : min= 1, max= 37, avg=12.77, stdev= 8.74, samples=56 lat (msec) : 10=6.12%, 20=29.69%, 50=41.02%, 100=16.93%, 250=6.25% cpu : usr=0.09%, sys=2.83%, ctx=1281, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=820KiB/s (840kB/s), 197KiB/s-219KiB/s (201kB/s-224kB/s), io=23.4MiB (24.5MB), run=28565-29210msec WRITE: bw=863KiB/s (883kB/s), 211KiB/s-224KiB/s (216kB/s-229kB/s), io=24.6MiB (25.8MB), run=28565-29210msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182837: Sun Nov 16 22:09:38 2025 read: IOPS=2, BW=2260KiB/s (2315kB/s)(7168KiB/3171msec) clat (usec): min=750, max=1125.9k, avg=266820.39, stdev=383498.63 lat (usec): min=752, max=1125.9k, avg=266821.98, stdev=383498.63 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], | 20.00th=[ 101188], 30.00th=[ 147850], 40.00th=[ 147850], | 50.00th=[ 149947], 60.00th=[ 166724], 70.00th=[ 166724], | 80.00th=[ 175113], 90.00th=[1132463], 95.00th=[1132463], | 99.00th=[1132463], 99.50th=[1132463], 99.90th=[1132463], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 1935, max= 4079, per=65.03%, avg=2990.00, stdev=1169.69, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1615KiB/s (1653kB/s)(5120KiB/3171msec); 0 zone resets clat (msec): min=85, max=450, avg=251.85, stdev=174.76 lat (msec): min=85, max=450, avg=251.95, stdev=174.77 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1935, max= 4063, per=41.21%, avg=2653.00, stdev=1221.17, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=20.28%, ctx=310, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182838: Sun Nov 16 22:09:38 2025 read: IOPS=0, BW=460KiB/s (471kB/s)(2048KiB/4454msec) clat (usec): min=736, max=168099, avg=84418.01, stdev=118343.15 lat (usec): min=737, max=168101, avg=84419.73, stdev=118343.96 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 734], | 30.00th=[ 734], 40.00th=[ 734], 50.00th=[ 734], 60.00th=[168821], | 70.00th=[168821], 80.00th=[168821], 90.00th=[168821], 95.00th=[168821], | 99.00th=[168821], 99.50th=[168821], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 1988, max= 2027, per=43.66%, avg=2007.50, stdev=27.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2299KiB/s (2354kB/s)(10.0MiB/4454msec); 0 zone resets clat (msec): min=92, max=1390, avg=420.76, stdev=465.75 lat (msec): min=92, max=1391, avg=420.88, stdev=465.80 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 117], | 30.00th=[ 180], 40.00th=[ 192], 50.00th=[ 209], 60.00th=[ 218], | 70.00th=[ 249], 80.00th=[ 380], 90.00th=[ 1183], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 2031, max= 5885, per=61.90%, avg=3984.75, stdev=1573.96, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=8.33%, 2000=16.67% cpu : usr=0.04%, sys=16.91%, ctx=138, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182839: Sun Nov 16 22:09:38 2025 read: IOPS=1, BW=1891KiB/s (1936kB/s)(6144KiB/3249msec) clat (usec): min=1876, max=213952, avg=105295.66, stdev=79888.04 lat (usec): min=1877, max=213954, avg=105297.30, stdev=79888.22 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 1876], 10.00th=[ 1876], 20.00th=[ 41157], | 30.00th=[ 41157], 40.00th=[ 94897], 50.00th=[ 94897], 60.00th=[102237], | 70.00th=[177210], 80.00th=[177210], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 1935, max= 4063, per=71.92%, avg=3307.00, stdev=1190.25, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1891KiB/s (1936kB/s)(6144KiB/3249msec); 0 zone resets clat (msec): min=125, max=1158, avg=421.85, stdev=376.22 lat (msec): min=125, max=1158, avg=421.96, stdev=376.24 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 326], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1935, max= 4063, per=46.63%, avg=3001.50, stdev=1216.54, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 2=8.33%, 50=8.33%, 100=8.33%, 250=41.67%, 500=25.00% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=18.32%, ctx=235, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182840: Sun Nov 16 22:09:38 2025 read: IOPS=1, BW=1532KiB/s (1569kB/s)(5120KiB/3341msec) clat (usec): min=676, max=218499, avg=109413.71, stdev=102103.56 lat (usec): min=677, max=218500, avg=109414.85, stdev=102103.68 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 766], 40.00th=[ 766], 50.00th=[152044], 60.00th=[152044], | 70.00th=[175113], 80.00th=[175113], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 2048, max= 6095, per=88.55%, avg=4071.50, stdev=2861.66, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2145KiB/s (2197kB/s)(7168KiB/3341msec); 0 zone resets clat (msec): min=167, max=1099, avg=392.93, stdev=326.02 lat (msec): min=168, max=1099, avg=393.10, stdev=325.96 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 192], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 262], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 460], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1416, max= 4096, per=41.26%, avg=2655.60, stdev=1198.89, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=20.45%, ctx=124, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4598KiB/s (4708kB/s), 460KiB/s-2260KiB/s (471kB/s-2315kB/s), io=20.0MiB (20.0MB), run=3171-4454msec WRITE: bw=6437KiB/s (6592kB/s), 1615KiB/s-2299KiB/s (1653kB/s-2354kB/s), io=28.0MiB (29.4MB), run=3171-4454msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182842: Sun Nov 16 22:09:38 2025 read: IOPS=1, BW=1618KiB/s (1657kB/s)(7168KiB/4431msec) clat (msec): min=61, max=1648, avg=490.31, stdev=605.43 lat (msec): min=61, max=1648, avg=490.32, stdev=605.43 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 90], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 239], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 1003], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1928, max= 4096, per=53.55%, avg=2424.20, stdev=935.75, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=1, BW=1155KiB/s (1183kB/s)(5120KiB/4431msec); 0 zone resets clat (msec): min=84, max=335, avg=186.13, stdev=102.01 lat (msec): min=84, max=335, avg=186.24, stdev=102.00 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 97], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 215], 80.00th=[ 215], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2011, max= 4087, per=42.84%, avg=2715.33, stdev=1188.04, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 2000=16.67% cpu : usr=0.05%, sys=5.17%, ctx=72, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182843: Sun Nov 16 22:09:38 2025 read: IOPS=0, BW=453KiB/s (464kB/s)(2048KiB/4523msec) clat (msec): min=90, max=370, avg=230.27, stdev=197.92 lat (msec): min=90, max=370, avg=230.27, stdev=197.92 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 91], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1410, max= 2048, per=38.19%, avg=1729.00, stdev=451.13, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2264KiB/s (2318kB/s)(10.0MiB/4523msec); 0 zone resets clat (msec): min=97, max=1842, avg=397.63, stdev=536.54 lat (msec): min=97, max=1843, avg=397.91, stdev=536.48 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 114], | 30.00th=[ 130], 40.00th=[ 146], 50.00th=[ 178], 60.00th=[ 205], | 70.00th=[ 241], 80.00th=[ 342], 90.00th=[ 684], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 2011, max= 6144, per=71.55%, avg=4535.50, stdev=1997.31, samples=4 iops : min= 1, max= 6, avg= 3.75, stdev= 2.22, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.35%, ctx=106, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182844: Sun Nov 16 22:09:38 2025 read: IOPS=1, BW=1415KiB/s (1449kB/s)(6144KiB/4342msec) clat (msec): min=71, max=724, avg=207.80, stdev=255.74 lat (msec): min=71, max=724, avg=207.80, stdev=255.74 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 91], 50.00th=[ 91], 60.00th=[ 127], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1928, max= 4096, per=74.45%, avg=3370.33, stdev=1249.11, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1415KiB/s (1449kB/s)(6144KiB/4342msec); 0 zone resets clat (msec): min=109, max=1989, avg=507.05, stdev=736.68 lat (msec): min=109, max=1989, avg=507.26, stdev=736.68 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 268], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1928, max= 4087, per=43.40%, avg=2751.25, stdev=998.82, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=4.65%, ctx=142, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182845: Sun Nov 16 22:09:38 2025 read: IOPS=1, BW=1155KiB/s (1183kB/s)(5120KiB/4432msec) clat (msec): min=48, max=286, avg=136.83, stdev=92.52 lat (msec): min=48, max=286, avg=136.84, stdev=92.52 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 49], | 30.00th=[ 89], 40.00th=[ 89], 50.00th=[ 103], 60.00th=[ 103], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 4087, max= 4096, per=90.38%, avg=4091.50, stdev= 6.36, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1617KiB/s (1656kB/s)(7168KiB/4432msec); 0 zone resets clat (msec): min=96, max=1673, avg=527.68, stdev=546.36 lat (msec): min=96, max=1673, avg=527.78, stdev=546.36 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 127], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 359], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 667], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1473, max= 4087, per=36.40%, avg=2307.60, stdev=1020.67, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=8.33%, ctx=102, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4528KiB/s (4637kB/s), 453KiB/s-1618KiB/s (464kB/s-1657kB/s), io=20.0MiB (20.0MB), run=4342-4523msec WRITE: bw=6339KiB/s (6491kB/s), 1155KiB/s-2264KiB/s (1183kB/s-2318kB/s), io=28.0MiB (29.4MB), run=4342-4523msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=182851: Sun Nov 16 22:09:52 2025 read: IOPS=0, BW=2672KiB/s (2736kB/s)(12.0MiB/4599msec) clat (msec): min=686, max=3033, avg=1498.97, stdev=1330.11 lat (msec): min=686, max=3033, avg=1498.97, stdev=1330.11 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 3037], 80.00th=[ 3037], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.83%, ctx=686, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182852: Sun Nov 16 22:09:52 2025 read: IOPS=0, BW=796KiB/s (815kB/s)(4096KiB/5148msec) clat (nsec): min=3106.4M, max=3106.4M, avg=3106389761.00, stdev= 0.00 lat (nsec): min=3106.4M, max=3106.4M, avg=3106392431.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3104], 5.00th=[ 3104], 10.00th=[ 3104], 20.00th=[ 3104], | 30.00th=[ 3104], 40.00th=[ 3104], 50.00th=[ 3104], 60.00th=[ 3104], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1591KiB/s (1629kB/s)(8192KiB/5148msec); 0 zone resets clat (msec): min=545, max=1484, avg=1015.26, stdev=663.65 lat (msec): min=546, max=1484, avg=1015.62, stdev=663.72 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=4.74%, ctx=454, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182853: Sun Nov 16 22:09:52 2025 write: IOPS=0, BW=2453KiB/s (2512kB/s)(12.0MiB/5010msec); 0 zone resets clat (msec): min=371, max=3171, avg=1617.58, stdev=1425.13 lat (msec): min=386, max=3172, avg=1622.76, stdev=1418.95 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=4.17%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182854: Sun Nov 16 22:09:52 2025 write: IOPS=0, BW=2748KiB/s (2814kB/s)(12.0MiB/4472msec); 0 zone resets clat (msec): min=396, max=3132, avg=1447.01, stdev=1474.72 lat (msec): min=396, max=3133, avg=1447.44, stdev=1474.72 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 3138], 80.00th=[ 3138], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.36%, ctx=74, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3183KiB/s (3259kB/s), 796KiB/s-2672KiB/s (815kB/s-2736kB/s), io=16.0MiB (16.8MB), run=4599-5148msec WRITE: bw=6365KiB/s (6518kB/s), 1591KiB/s-2748KiB/s (1629kB/s-2814kB/s), io=32.0MiB (33.6MB), run=4472-5148msec rand-rw: (groupid=0, jobs=1): err= 0: pid=182856: Sun Nov 16 22:09:52 2025 read: IOPS=0, BW=2497KiB/s (2556kB/s)(12.0MiB/4922msec) clat (msec): min=123, max=3247, avg=1637.97, stdev=1563.93 lat (msec): min=123, max=3247, avg=1637.98, stdev=1563.93 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.54%, ctx=36, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182857: Sun Nov 16 22:09:52 2025 read: IOPS=0, BW=823KiB/s (843kB/s)(4096KiB/4974msec) clat (nsec): min=3508.2M, max=3508.2M, avg=3508220523.00, stdev= 0.00 lat (nsec): min=3508.2M, max=3508.2M, avg=3508223246.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3507], 5.00th=[ 3507], 10.00th=[ 3507], 20.00th=[ 3507], | 30.00th=[ 3507], 40.00th=[ 3507], 50.00th=[ 3507], 60.00th=[ 3507], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1647KiB/s (1686kB/s)(8192KiB/4974msec); 0 zone resets clat (msec): min=663, max=774, avg=718.84, stdev=78.86 lat (msec): min=664, max=774, avg=719.57, stdev=78.33 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.24%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182858: Sun Nov 16 22:09:52 2025 write: IOPS=0, BW=2536KiB/s (2597kB/s)(12.0MiB/4845msec); 0 zone resets clat (msec): min=193, max=3161, avg=1610.54, stdev=1488.66 lat (msec): min=194, max=3162, avg=1614.46, stdev=1488.21 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=2.79%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=182859: Sun Nov 16 22:09:52 2025 write: IOPS=0, BW=2725KiB/s (2790kB/s)(12.0MiB/4510msec); 0 zone resets clat (msec): min=186, max=2954, avg=1496.73, stdev=1389.84 lat (msec): min=186, max=2954, avg=1497.20, stdev=1389.64 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=3.22%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3294KiB/s (3373kB/s), 823KiB/s-2497KiB/s (843kB/s-2556kB/s), io=16.0MiB (16.8MB), run=4922-4974msec WRITE: bw=6588KiB/s (6746kB/s), 1647KiB/s-2725KiB/s (1686kB/s-2790kB/s), io=32.0MiB (33.6MB), run=4510-4974msec