== sanity test 398b: DIO and buffer IO race ============== 00:59:23 (1783141163) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.30508 s, 15.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145103: Sat Jul 4 01:00:50 2026 read: IOPS=19, BW=78.4KiB/s (80.2kB/s)(5992KiB/76465msec) clat (usec): min=24, max=732743, avg=24799.79, stdev=24979.21 lat (usec): min=24, max=732744, avg=24802.33, stdev=24979.59 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 7635], 20.00th=[ 12911], | 30.00th=[ 15664], 40.00th=[ 18220], 50.00th=[ 21365], 60.00th=[ 25560], | 70.00th=[ 29754], 80.00th=[ 35914], 90.00th=[ 44303], 95.00th=[ 50594], | 99.00th=[ 77071], 99.50th=[ 90702], 99.90th=[287310], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 143, per=25.02%, avg=77.80, stdev=25.62, samples=151 iops : min= 1, max= 35, avg=18.87, stdev= 6.43, samples=151 write: IOPS=20, BW=82.3KiB/s (84.3kB/s)(6296KiB/76465msec); 0 zone resets clat (usec): min=764, max=262538, avg=24800.12, stdev=24652.53 lat (usec): min=766, max=262541, avg=24802.03, stdev=24652.39 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1401], 10.00th=[ 1991], 20.00th=[ 3556], | 30.00th=[ 7046], 40.00th=[ 13566], 50.00th=[ 19006], 60.00th=[ 25297], | 70.00th=[ 31851], 80.00th=[ 40633], 90.00th=[ 55837], 95.00th=[ 70779], | 99.00th=[104334], 99.50th=[126354], 99.90th=[227541], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 15, max= 151, per=25.31%, avg=82.25, stdev=24.66, samples=150 iops : min= 3, max= 37, avg=19.98, stdev= 6.21, samples=150 lat (usec) : 50=0.68%, 100=2.86%, 250=0.68%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=5.08%, 4=6.25%, 10=8.24%, 20=24.48%, 50=41.80% lat (msec) : 100=8.85%, 250=0.65%, 500=0.07%, 750=0.03% cpu : usr=0.12%, sys=9.81%, ctx=7227, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145104: Sat Jul 4 01:00:50 2026 read: IOPS=19, BW=77.0KiB/s (78.9kB/s)(5940KiB/77124msec) clat (usec): min=39, max=215544, avg=25410.67, stdev=18568.37 lat (usec): min=41, max=215545, avg=25412.13, stdev=18568.23 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 75], 10.00th=[ 9110], 20.00th=[ 12780], | 30.00th=[ 15926], 40.00th=[ 18744], 50.00th=[ 21627], 60.00th=[ 25560], | 70.00th=[ 30540], 80.00th=[ 36439], 90.00th=[ 45351], 95.00th=[ 56361], | 99.00th=[ 88605], 99.50th=[122160], 99.90th=[166724], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 7, max= 151, per=24.58%, avg=76.46, stdev=26.19, samples=153 iops : min= 1, max= 37, avg=18.54, stdev= 6.55, samples=153 write: IOPS=20, BW=82.3KiB/s (84.3kB/s)(6348KiB/77124msec); 0 zone resets clat (usec): min=793, max=651920, avg=24640.17, stdev=27480.71 lat (usec): min=794, max=651921, avg=24643.78, stdev=27480.16 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1385], 10.00th=[ 1991], 20.00th=[ 3785], | 30.00th=[ 7046], 40.00th=[ 13829], 50.00th=[ 19792], 60.00th=[ 25035], | 70.00th=[ 31851], 80.00th=[ 41157], 90.00th=[ 53740], 95.00th=[ 64226], | 99.00th=[102237], 99.50th=[114820], 99.90th=[196084], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 149, per=25.08%, avg=81.51, stdev=25.47, samples=153 iops : min= 1, max= 37, avg=19.80, stdev= 6.41, samples=153 lat (usec) : 50=0.49%, 100=2.51%, 250=0.46%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.26% lat (msec) : 2=4.98%, 4=5.89%, 10=8.53%, 20=23.93%, 50=43.00% lat (msec) : 100=8.89%, 250=0.78%, 750=0.03% cpu : usr=0.11%, sys=9.91%, ctx=7219, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145106: Sat Jul 4 01:00:50 2026 read: IOPS=19, BW=78.8KiB/s (80.7kB/s)(6028KiB/76524msec) clat (usec): min=35, max=256768, avg=24758.68, stdev=20147.85 lat (usec): min=35, max=256770, avg=24760.68, stdev=20148.07 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 1401], 20.00th=[ 12256], | 30.00th=[ 15139], 40.00th=[ 17695], 50.00th=[ 21103], 60.00th=[ 24511], | 70.00th=[ 29754], 80.00th=[ 36439], 90.00th=[ 45876], 95.00th=[ 54264], | 99.00th=[ 80217], 99.50th=[137364], 99.90th=[229639], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 23, max= 151, per=25.52%, avg=79.37, stdev=27.28, samples=150 iops : min= 5, max= 37, avg=19.27, stdev= 6.86, samples=150 write: IOPS=20, BW=81.8KiB/s (83.8kB/s)(6260KiB/76524msec); 0 zone resets clat (usec): min=624, max=708906, avg=24880.46, stdev=29370.62 lat (usec): min=624, max=708907, avg=24882.48, stdev=29370.87 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1385], 10.00th=[ 1860], 20.00th=[ 3326], | 30.00th=[ 6390], 40.00th=[ 13566], 50.00th=[ 18744], 60.00th=[ 24773], | 70.00th=[ 32375], 80.00th=[ 41681], 90.00th=[ 55837], 95.00th=[ 67634], | 99.00th=[104334], 99.50th=[132645], 99.90th=[198181], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 15, max= 168, per=25.19%, avg=81.88, stdev=26.96, samples=151 iops : min= 3, max= 42, avg=19.89, stdev= 6.77, samples=151 lat (usec) : 50=1.01%, 100=3.03%, 250=0.49%, 500=0.20%, 750=0.16% lat (usec) : 1000=0.29% lat (msec) : 2=5.27%, 4=6.48%, 10=8.33%, 20=24.61%, 50=39.75% lat (msec) : 100=9.41%, 250=0.91%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=10.08%, ctx=7232, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145109: Sat Jul 4 01:00:50 2026 read: IOPS=19, BW=78.7KiB/s (80.6kB/s)(6052KiB/76926msec) clat (usec): min=32, max=273893, avg=24704.04, stdev=19383.95 lat (usec): min=32, max=273894, avg=24705.53, stdev=19383.88 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 66], 10.00th=[ 1004], 20.00th=[ 12387], | 30.00th=[ 15008], 40.00th=[ 17695], 50.00th=[ 20841], 60.00th=[ 24773], | 70.00th=[ 29492], 80.00th=[ 36963], 90.00th=[ 45351], 95.00th=[ 53740], | 99.00th=[ 89654], 99.50th=[111674], 99.90th=[187696], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 151, per=25.63%, avg=79.70, stdev=25.75, samples=149 iops : min= 1, max= 37, avg=19.36, stdev= 6.51, samples=149 write: IOPS=20, BW=81.1KiB/s (83.0kB/s)(6236KiB/76926msec); 0 zone resets clat (usec): min=772, max=687159, avg=25196.49, stdev=29912.45 lat (usec): min=773, max=687161, avg=25197.94, stdev=29912.46 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1385], 10.00th=[ 1991], 20.00th=[ 3621], | 30.00th=[ 6325], 40.00th=[ 13698], 50.00th=[ 19530], 60.00th=[ 25297], | 70.00th=[ 32113], 80.00th=[ 41681], 90.00th=[ 54789], 95.00th=[ 69731], | 99.00th=[106431], 99.50th=[121111], 99.90th=[308282], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 15, max= 184, per=24.95%, avg=81.08, stdev=27.27, samples=151 iops : min= 3, max= 46, avg=19.70, stdev= 6.88, samples=151 lat (usec) : 50=0.72%, 100=3.16%, 250=0.85%, 500=0.20%, 1000=0.23% lat (msec) : 2=4.95%, 4=6.28%, 10=8.04%, 20=24.77%, 50=40.95% lat (msec) : 100=8.95%, 250=0.81%, 500=0.07%, 750=0.03% cpu : usr=0.11%, sys=9.92%, ctx=7331, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=311KiB/s (319kB/s), 77.0KiB/s-78.8KiB/s (78.9kB/s-80.7kB/s), io=23.4MiB (24.6MB), run=76465-77124msec WRITE: bw=326KiB/s (334kB/s), 81.1KiB/s-82.3KiB/s (83.0kB/s-84.3kB/s), io=24.6MiB (25.7MB), run=76465-77124msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145105: Sat Jul 4 01:02:03 2026 read: IOPS=10, BW=40.1KiB/s (41.1kB/s)(5992KiB/149468msec) clat (msec): min=4, max=736, avg=23.00, stdev=27.35 lat (msec): min=4, max=736, avg=23.00, stdev=27.35 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 44], 95.00th=[ 60], | 99.00th=[ 102], 99.50th=[ 140], 99.90th=[ 253], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 120, per=25.45%, avg=40.46, stdev=25.43, samples=291 iops : min= 1, max= 30, avg= 9.60, stdev= 6.42, samples=291 write: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6296KiB/149468msec); 0 zone resets clat (msec): min=23, max=277, avg=72.92, stdev=35.68 lat (msec): min=23, max=277, avg=72.92, stdev=35.68 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 70], | 70.00th=[ 83], 80.00th=[ 100], 90.00th=[ 126], 95.00th=[ 144], | 99.00th=[ 184], 99.50th=[ 203], 99.90th=[ 257], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 95, per=25.15%, avg=41.74, stdev=18.26, samples=296 iops : min= 1, max= 23, avg= 9.93, stdev= 4.66, samples=296 lat (msec) : 10=9.86%, 20=19.40%, 50=30.96%, 100=29.26%, 250=10.35% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.05%, sys=2.70%, ctx=5786, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145107: Sat Jul 4 01:02:03 2026 read: IOPS=9, BW=39.4KiB/s (40.3kB/s)(5940KiB/150813msec) clat (msec): min=4, max=664, avg=23.19, stdev=25.38 lat (msec): min=4, max=664, avg=23.19, stdev=25.38 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 59], | 99.00th=[ 101], 99.50th=[ 126], 99.90th=[ 222], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 136, per=25.23%, avg=40.12, stdev=24.23, samples=291 iops : min= 1, max= 34, avg= 9.52, stdev= 6.10, samples=291 write: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6348KiB/150813msec); 0 zone resets clat (msec): min=20, max=342, avg=73.17, stdev=36.89 lat (msec): min=20, max=342, avg=73.18, stdev=36.89 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 44], | 30.00th=[ 50], 40.00th=[ 56], 50.00th=[ 63], 60.00th=[ 72], | 70.00th=[ 83], 80.00th=[ 99], 90.00th=[ 125], 95.00th=[ 146], | 99.00th=[ 186], 99.50th=[ 226], 99.90th=[ 330], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 104, per=25.13%, avg=41.72, stdev=18.46, samples=299 iops : min= 1, max= 26, avg= 9.92, stdev= 4.72, samples=299 lat (msec) : 10=9.90%, 20=18.98%, 50=32.13%, 100=28.65%, 250=10.16% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.07%, sys=2.66%, ctx=5875, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145108: Sat Jul 4 01:02:03 2026 read: IOPS=10, BW=40.2KiB/s (41.1kB/s)(6028KiB/150016msec) clat (msec): min=4, max=252, avg=23.76, stdev=20.82 lat (msec): min=4, max=252, avg=23.76, stdev=20.82 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 45], 95.00th=[ 61], | 99.00th=[ 112], 99.50th=[ 125], 99.90th=[ 224], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7, max= 151, per=25.36%, avg=40.32, stdev=24.19, samples=293 iops : min= 1, max= 37, avg= 9.57, stdev= 6.09, samples=293 write: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6260KiB/150016msec); 0 zone resets clat (msec): min=23, max=704, avg=72.81, stdev=40.30 lat (msec): min=23, max=704, avg=72.82, stdev=40.30 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 38], 20.00th=[ 44], | 30.00th=[ 50], 40.00th=[ 56], 50.00th=[ 62], 60.00th=[ 70], | 70.00th=[ 81], 80.00th=[ 100], 90.00th=[ 123], 95.00th=[ 146], | 99.00th=[ 201], 99.50th=[ 228], 99.90th=[ 309], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 95, per=24.97%, avg=41.45, stdev=19.22, samples=296 iops : min= 1, max= 23, avg= 9.85, stdev= 4.90, samples=296 lat (msec) : 10=8.72%, 20=19.40%, 50=33.07%, 100=28.22%, 250=10.42% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=2.82%, ctx=5965, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145110: Sat Jul 4 01:02:03 2026 read: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6052KiB/149829msec) clat (msec): min=4, max=256, avg=22.88, stdev=20.76 lat (msec): min=4, max=256, avg=22.89, stdev=20.76 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 44], 95.00th=[ 60], | 99.00th=[ 102], 99.50th=[ 134], 99.90th=[ 249], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 127, per=25.89%, avg=41.17, stdev=25.17, samples=289 iops : min= 1, max= 31, avg= 9.79, stdev= 6.34, samples=289 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6236KiB/149829msec); 0 zone resets clat (msec): min=21, max=683, avg=73.73, stdev=40.31 lat (msec): min=21, max=683, avg=73.74, stdev=40.31 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 50], 40.00th=[ 56], 50.00th=[ 63], 60.00th=[ 71], | 70.00th=[ 84], 80.00th=[ 101], 90.00th=[ 124], 95.00th=[ 146], | 99.00th=[ 207], 99.50th=[ 222], 99.90th=[ 338], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 88, per=24.83%, avg=41.22, stdev=18.15, samples=297 iops : min= 1, max= 22, avg= 9.79, stdev= 4.63, samples=297 lat (msec) : 10=10.12%, 20=19.86%, 50=30.96%, 100=28.42%, 250=10.42% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.06%, sys=2.73%, ctx=5814, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (163kB/s), 39.4KiB/s-40.4KiB/s (40.3kB/s-41.4kB/s), io=23.4MiB (24.6MB), run=149468-150813msec WRITE: bw=167KiB/s (171kB/s), 41.6KiB/s-42.1KiB/s (42.6kB/s-43.1kB/s), io=24.6MiB (25.7MB), run=149468-150813msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145156: Sat Jul 4 01:02:24 2026 read: IOPS=25, BW=405KiB/s (415kB/s)(5920KiB/14617msec) clat (usec): min=21, max=98469, avg=19957.32, stdev=16170.13 lat (usec): min=21, max=98471, avg=19958.59, stdev=16170.03 clat percentiles (usec): | 1.00th=[ 34], 5.00th=[ 52], 10.00th=[ 64], 20.00th=[ 141], | 30.00th=[12387], 40.00th=[15795], 50.00th=[18744], 60.00th=[21890], | 70.00th=[26608], 80.00th=[31327], 90.00th=[39060], 95.00th=[47449], | 99.00th=[72877], 99.50th=[94897], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 221, max= 640, per=25.85%, avg=395.04, stdev=105.72, samples=28 iops : min= 13, max= 40, avg=24.14, stdev= 6.65, samples=28 write: IOPS=27, BW=436KiB/s (446kB/s)(6368KiB/14617msec); 0 zone resets clat (usec): min=1053, max=90941, avg=18058.59, stdev=16981.26 lat (usec): min=1054, max=90943, avg=18060.49, stdev=16981.30 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1745], 10.00th=[ 2311], 20.00th=[ 3785], | 30.00th=[ 5407], 40.00th=[ 7701], 50.00th=[11600], 60.00th=[17433], | 70.00th=[23725], 80.00th=[32375], 90.00th=[42206], 95.00th=[50594], | 99.00th=[72877], 99.50th=[84411], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 159, max= 640, per=26.88%, avg=432.04, stdev=127.19, samples=28 iops : min= 9, max= 40, avg=26.46, stdev= 7.99, samples=28 lat (usec) : 50=1.95%, 100=6.38%, 250=2.34%, 500=0.13%, 750=0.13% lat (msec) : 2=3.78%, 4=8.07%, 10=13.28%, 20=24.61%, 50=34.77% lat (msec) : 100=4.56% cpu : usr=0.10%, sys=13.53%, ctx=1623, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145157: Sat Jul 4 01:02:24 2026 read: IOPS=24, BW=395KiB/s (404kB/s)(5744KiB/14550msec) clat (usec): min=36, max=158235, avg=21043.30, stdev=18637.43 lat (usec): min=36, max=158236, avg=21044.39, stdev=18637.44 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 78], 20.00th=[ 184], | 30.00th=[ 12780], 40.00th=[ 16057], 50.00th=[ 19006], 60.00th=[ 22152], | 70.00th=[ 25297], 80.00th=[ 32637], 90.00th=[ 40633], 95.00th=[ 52691], | 99.00th=[ 86508], 99.50th=[137364], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 160, max= 638, per=25.99%, avg=397.07, stdev=117.64, samples=28 iops : min= 10, max= 39, avg=24.29, stdev= 7.35, samples=28 write: IOPS=28, BW=450KiB/s (461kB/s)(6544KiB/14550msec); 0 zone resets clat (usec): min=1127, max=92638, avg=16765.00, stdev=16474.25 lat (usec): min=1128, max=92640, avg=16771.98, stdev=16475.05 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1795], 10.00th=[ 2180], 20.00th=[ 3785], | 30.00th=[ 4883], 40.00th=[ 7111], 50.00th=[10683], 60.00th=[15401], | 70.00th=[20579], 80.00th=[29230], 90.00th=[41157], 95.00th=[49546], | 99.00th=[67634], 99.50th=[79168], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 224, max= 926, per=27.76%, avg=446.07, stdev=141.25, samples=28 iops : min= 14, max= 57, avg=27.32, stdev= 8.78, samples=28 lat (usec) : 50=1.43%, 100=5.60%, 250=2.34%, 500=0.26%, 750=0.13% lat (msec) : 2=4.30%, 4=7.29%, 10=14.45%, 20=26.04%, 50=33.07% lat (msec) : 100=4.82%, 250=0.26% cpu : usr=0.12%, sys=14.32%, ctx=1660, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145158: Sat Jul 4 01:02:24 2026 read: IOPS=24, BW=399KiB/s (409kB/s)(6256KiB/15673msec) clat (usec): min=23, max=186783, avg=20573.34, stdev=16963.19 lat (usec): min=23, max=186785, avg=20574.52, stdev=16963.25 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 58], 10.00th=[ 75], 20.00th=[ 627], | 30.00th=[ 12518], 40.00th=[ 16909], 50.00th=[ 19530], 60.00th=[ 23200], | 70.00th=[ 27395], 80.00th=[ 31851], 90.00th=[ 38536], 95.00th=[ 45876], | 99.00th=[ 62653], 99.50th=[ 79168], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 134, max= 736, per=26.26%, avg=401.26, stdev=130.81, samples=31 iops : min= 8, max= 46, avg=24.52, stdev= 8.27, samples=31 write: IOPS=24, BW=385KiB/s (394kB/s)(6032KiB/15673msec); 0 zone resets clat (usec): min=1057, max=114357, avg=19761.68, stdev=19190.31 lat (usec): min=1057, max=114361, avg=19771.99, stdev=19201.12 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1893], 10.00th=[ 2704], 20.00th=[ 4047], | 30.00th=[ 5800], 40.00th=[ 9372], 50.00th=[ 14615], 60.00th=[ 20579], | 70.00th=[ 25035], 80.00th=[ 31589], 90.00th=[ 44303], 95.00th=[ 53740], | 99.00th=[ 91751], 99.50th=[113771], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 134, max= 734, per=24.00%, avg=385.74, stdev=139.28, samples=31 iops : min= 8, max= 45, avg=23.55, stdev= 8.71, samples=31 lat (usec) : 50=1.30%, 100=6.38%, 250=2.08%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=3.12%, 4=6.77%, 10=12.24%, 20=22.01%, 50=40.36% lat (msec) : 100=4.30%, 250=0.52% cpu : usr=0.09%, sys=13.17%, ctx=1745, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145160: Sat Jul 4 01:02:24 2026 read: IOPS=24, BW=388KiB/s (397kB/s)(6032KiB/15546msec) clat (usec): min=31, max=83879, avg=20334.73, stdev=16162.94 lat (usec): min=32, max=83880, avg=20337.29, stdev=16163.12 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 112], | 30.00th=[12125], 40.00th=[15533], 50.00th=[19530], 60.00th=[22676], | 70.00th=[27395], 80.00th=[33817], 90.00th=[41681], 95.00th=[47449], | 99.00th=[72877], 99.50th=[76022], 99.90th=[83362], 99.95th=[83362], | 99.99th=[83362] bw ( KiB/s): min= 80, max= 638, per=25.20%, avg=385.10, stdev=143.16, samples=30 iops : min= 5, max= 39, avg=23.53, stdev= 8.86, samples=30 write: IOPS=25, BW=402KiB/s (412kB/s)(6256KiB/15546msec); 0 zone resets clat (usec): min=1173, max=225511, avg=19853.10, stdev=23570.80 lat (usec): min=1174, max=225513, avg=19855.58, stdev=23571.42 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1958], 10.00th=[ 2442], 20.00th=[ 3556], | 30.00th=[ 5145], 40.00th=[ 7308], 50.00th=[ 11994], 60.00th=[ 17695], | 70.00th=[ 23200], 80.00th=[ 32113], 90.00th=[ 42206], 95.00th=[ 66847], | 99.00th=[111674], 99.50th=[125305], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 96, max= 669, per=25.14%, avg=404.07, stdev=141.42, samples=30 iops : min= 6, max= 41, avg=24.70, stdev= 8.80, samples=30 lat (usec) : 50=1.04%, 100=7.42%, 250=2.60%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.86%, 4=8.46%, 10=13.28%, 20=22.53%, 50=35.81% lat (msec) : 100=5.08%, 250=0.65% cpu : usr=0.15%, sys=13.37%, ctx=1690, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1528KiB/s (1565kB/s), 388KiB/s-405KiB/s (397kB/s-415kB/s), io=23.4MiB (24.5MB), run=14550-15673msec WRITE: bw=1608KiB/s (1646kB/s), 385KiB/s-450KiB/s (394kB/s-461kB/s), io=24.6MiB (25.8MB), run=14550-15673msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145159: Sat Jul 4 01:02:41 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(5920KiB/32211msec) clat (msec): min=5, max=137, avg=19.58, stdev=19.50 lat (msec): min=5, max=137, avg=19.58, stdev=19.50 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 17], 80.00th=[ 27], 90.00th=[ 47], 95.00th=[ 62], | 99.00th=[ 97], 99.50th=[ 120], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 478, per=24.87%, avg=184.06, stdev=108.20, samples=62 iops : min= 1, max= 29, avg=10.90, stdev= 6.87, samples=62 write: IOPS=12, BW=198KiB/s (202kB/s)(6368KiB/32211msec); 0 zone resets clat (msec): min=21, max=248, avg=62.25, stdev=31.43 lat (msec): min=21, max=248, avg=62.25, stdev=31.43 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 37], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 61], | 70.00th=[ 69], 80.00th=[ 85], 90.00th=[ 108], 95.00th=[ 122], | 99.00th=[ 176], 99.50th=[ 180], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 63, max= 384, per=25.29%, avg=197.00, stdev=97.15, samples=63 iops : min= 3, max= 24, avg=11.70, stdev= 6.18, samples=63 lat (msec) : 10=18.23%, 20=17.58%, 50=30.60%, 100=26.04%, 250=7.55% cpu : usr=0.06%, sys=3.34%, ctx=1472, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145161: Sat Jul 4 01:02:41 2026 read: IOPS=11, BW=178KiB/s (182kB/s)(5744KiB/32346msec) clat (msec): min=4, max=138, avg=18.56, stdev=17.89 lat (msec): min=4, max=138, avg=18.56, stdev=17.89 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 63], | 99.00th=[ 84], 99.50th=[ 114], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 26, max= 576, per=24.25%, avg=179.43, stdev=114.26, samples=63 iops : min= 1, max= 36, avg=10.59, stdev= 7.24, samples=63 write: IOPS=12, BW=202KiB/s (207kB/s)(6544KiB/32346msec); 0 zone resets clat (msec): min=21, max=252, avg=62.45, stdev=34.38 lat (msec): min=21, max=252, avg=62.46, stdev=34.38 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 84], 90.00th=[ 110], 95.00th=[ 129], | 99.00th=[ 184], 99.50th=[ 184], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 63, max= 415, per=25.90%, avg=201.78, stdev=96.65, samples=64 iops : min= 3, max= 25, avg=12.00, stdev= 6.17, samples=64 lat (msec) : 10=17.84%, 20=16.54%, 50=34.77%, 100=23.83%, 250=6.90% lat (msec) : 500=0.13% cpu : usr=0.09%, sys=3.38%, ctx=1447, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145162: Sat Jul 4 01:02:41 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6256KiB/30719msec) clat (msec): min=4, max=127, avg=18.46, stdev=17.39 lat (msec): min=4, max=127, avg=18.47, stdev=17.39 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 27], 90.00th=[ 39], 95.00th=[ 52], | 99.00th=[ 96], 99.50th=[ 103], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 31, max= 736, per=27.60%, avg=204.21, stdev=137.85, samples=61 iops : min= 1, max= 46, avg=12.16, stdev= 8.78, samples=61 write: IOPS=12, BW=196KiB/s (201kB/s)(6032KiB/30719msec); 0 zone resets clat (msec): min=21, max=198, avg=61.95, stdev=29.89 lat (msec): min=21, max=198, avg=61.95, stdev=29.89 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 34], 20.00th=[ 39], | 30.00th=[ 43], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 62], | 70.00th=[ 70], 80.00th=[ 83], 90.00th=[ 100], 95.00th=[ 124], | 99.00th=[ 178], 99.50th=[ 186], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 31, max= 383, per=25.18%, avg=196.18, stdev=85.04, samples=61 iops : min= 1, max= 23, avg=11.67, stdev= 5.40, samples=61 lat (msec) : 10=19.92%, 20=17.32%, 50=32.29%, 100=25.26%, 250=5.21% cpu : usr=0.08%, sys=3.54%, ctx=1337, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145163: Sat Jul 4 01:02:41 2026 read: IOPS=11, BW=189KiB/s (193kB/s)(6032KiB/31990msec) clat (msec): min=4, max=163, avg=19.56, stdev=20.14 lat (msec): min=4, max=163, avg=19.57, stdev=20.14 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 26], 90.00th=[ 47], 95.00th=[ 63], | 99.00th=[ 95], 99.50th=[ 104], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 31, max= 480, per=25.72%, avg=190.34, stdev=113.39, samples=62 iops : min= 1, max= 30, avg=11.27, stdev= 7.19, samples=62 write: IOPS=12, BW=196KiB/s (200kB/s)(6256KiB/31990msec); 0 zone resets clat (msec): min=21, max=187, avg=62.75, stdev=30.80 lat (msec): min=21, max=187, avg=62.76, stdev=30.80 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 44], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 87], 90.00th=[ 105], 95.00th=[ 123], | 99.00th=[ 176], 99.50th=[ 182], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 63, max= 352, per=25.08%, avg=195.40, stdev=89.89, samples=63 iops : min= 3, max= 22, avg=11.60, stdev= 5.73, samples=63 lat (msec) : 10=18.49%, 20=17.97%, 50=30.60%, 100=26.17%, 250=6.77% cpu : usr=0.08%, sys=3.48%, ctx=1505, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=740KiB/s (758kB/s), 178KiB/s-204KiB/s (182kB/s-209kB/s), io=23.4MiB (24.5MB), run=30719-32346msec WRITE: bw=779KiB/s (798kB/s), 196KiB/s-202KiB/s (200kB/s-207kB/s), io=24.6MiB (25.8MB), run=30719-32346msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145180: Sat Jul 4 01:02:50 2026 read: IOPS=1, BW=1714KiB/s (1756kB/s)(7168KiB/4181msec) clat (usec): min=551, max=2800.9k, avg=489494.30, stdev=1022531.95 lat (usec): min=553, max=2800.9k, avg=489496.05, stdev=1022531.73 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 668], 30.00th=[ 104334], 40.00th=[ 104334], | 50.00th=[ 141558], 60.00th=[ 149947], 70.00th=[ 149947], | 80.00th=[ 229639], 90.00th=[2801796], 95.00th=[2801796], | 99.00th=[2801796], 99.50th=[2801796], 99.90th=[2801796], | 99.95th=[2801796], 99.99th=[2801796] bw ( KiB/s): min= 2048, max= 6131, per=82.72%, avg=4051.67, stdev=2042.55, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1225KiB/s (1254kB/s)(5120KiB/4181msec); 0 zone resets clat (msec): min=105, max=172, avg=144.44, stdev=34.85 lat (msec): min=105, max=172, avg=144.50, stdev=34.82 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 165], 60.00th=[ 165], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 2043, max= 8192, per=74.63%, avg=5117.50, stdev=4348.00, samples=2 iops : min= 1, max= 8, avg= 4.50, stdev= 4.95, samples=2 lat (usec) : 750=16.67% lat (msec) : 250=75.00%, >=2000=8.33% cpu : usr=0.00%, sys=17.58%, ctx=605, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145181: Sat Jul 4 01:02:50 2026 read: IOPS=0, BW=505KiB/s (517kB/s)(2048KiB/4059msec) clat (msec): min=229, max=237, avg=233.67, stdev= 5.46 lat (msec): min=229, max=237, avg=233.67, stdev= 5.46 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 1872, max= 2023, per=39.76%, avg=1947.50, stdev=106.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2523KiB/s (2583kB/s)(10.0MiB/4059msec); 0 zone resets clat (msec): min=92, max=1664, avg=350.71, stdev=471.51 lat (msec): min=92, max=1665, avg=350.80, stdev=471.50 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 103], | 30.00th=[ 144], 40.00th=[ 165], 50.00th=[ 171], 60.00th=[ 207], | 70.00th=[ 271], 80.00th=[ 279], 90.00th=[ 409], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 2039, max= 6144, per=59.40%, avg=4073.25, stdev=1676.00, samples=4 iops : min= 1, max= 6, avg= 3.25, stdev= 2.06, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=19.57%, ctx=384, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145182: Sat Jul 4 01:02:50 2026 read: IOPS=1, BW=1556KiB/s (1593kB/s)(6144KiB/3949msec) clat (usec): min=514, max=328492, avg=130988.27, stdev=146985.01 lat (usec): min=516, max=328493, avg=130989.76, stdev=146984.80 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 799], | 30.00th=[ 799], 40.00th=[ 2212], 50.00th=[ 2212], 60.00th=[223347], | 70.00th=[231736], 80.00th=[231736], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 4047, max= 4096, per=83.13%, avg=4071.50, stdev=34.65, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1556KiB/s (1593kB/s)(6144KiB/3949msec); 0 zone resets clat (msec): min=107, max=1916, avg=524.49, stdev=697.78 lat (msec): min=107, max=1916, avg=524.57, stdev=697.75 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 241], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 2031, max= 3864, per=36.41%, avg=2496.50, stdev=911.69, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.27%, ctx=233, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145183: Sat Jul 4 01:02:50 2026 read: IOPS=1, BW=1352KiB/s (1384kB/s)(5120KiB/3787msec) clat (usec): min=371, max=131696, avg=52595.57, stdev=70923.10 lat (usec): min=372, max=131698, avg=52596.62, stdev=70923.14 clat percentiles (usec): | 1.00th=[ 371], 5.00th=[ 371], 10.00th=[ 371], 20.00th=[ 371], | 30.00th=[ 441], 40.00th=[ 441], 50.00th=[ 1614], 60.00th=[ 1614], | 70.00th=[128451], 80.00th=[128451], 90.00th=[131597], 95.00th=[131597], | 99.00th=[131597], 99.50th=[131597], 99.90th=[131597], 99.95th=[131597], | 99.99th=[131597] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1893KiB/s (1938kB/s)(7168KiB/3787msec); 0 zone resets clat (msec): min=135, max=1986, avg=490.66, stdev=671.41 lat (msec): min=136, max=1986, avg=490.76, stdev=671.38 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 199], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 502], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 1882, max= 4063, per=36.59%, avg=2509.00, stdev=1038.87, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=16.67% lat (msec) : 2=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=18.96%, ctx=243, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4898KiB/s (5016kB/s), 505KiB/s-1714KiB/s (517kB/s-1756kB/s), io=20.0MiB (20.0MB), run=3787-4181msec WRITE: bw=6858KiB/s (7022kB/s), 1225KiB/s-2523KiB/s (1254kB/s-2583kB/s), io=28.0MiB (29.4MB), run=3787-4181msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145185: Sat Jul 4 01:02:51 2026 read: IOPS=1, BW=1671KiB/s (1711kB/s)(7168KiB/4290msec) clat (msec): min=54, max=1841, avg=478.58, stdev=650.05 lat (msec): min=54, max=1841, avg=478.58, stdev=650.05 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 67], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 97], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 625], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1899, max= 4096, per=52.81%, avg=2520.50, stdev=1052.55, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1193KiB/s (1222kB/s)(5120KiB/4290msec); 0 zone resets clat (msec): min=81, max=315, avg=146.84, stdev=96.86 lat (msec): min=82, max=316, avg=146.95, stdev=96.85 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 102], 60.00th=[ 102], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2048, max= 6144, per=61.29%, avg=4096.00, stdev=2896.31, samples=2 iops : min= 2, max= 6, avg= 4.00, stdev= 2.83, samples=2 lat (msec) : 100=50.00%, 250=16.67%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.29%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145186: Sat Jul 4 01:02:51 2026 read: IOPS=0, BW=511KiB/s (523kB/s)(2048KiB/4008msec) clat (msec): min=83, max=116, avg=99.75, stdev=23.14 lat (msec): min=83, max=116, avg=99.75, stdev=23.14 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 116], | 70.00th=[ 116], 80.00th=[ 116], 90.00th=[ 116], 95.00th=[ 116], | 99.00th=[ 116], 99.50th=[ 116], 99.90th=[ 116], 99.95th=[ 116], | 99.99th=[ 116] bw ( KiB/s): min= 1921, max= 2043, per=41.53%, avg=1982.00, stdev=86.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2555KiB/s (2616kB/s)(10.0MiB/4008msec); 0 zone resets clat (msec): min=81, max=1951, avg=369.86, stdev=570.90 lat (msec): min=81, max=1951, avg=369.95, stdev=570.90 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 110], | 30.00th=[ 124], 40.00th=[ 131], 50.00th=[ 144], 60.00th=[ 148], | 70.00th=[ 188], 80.00th=[ 300], 90.00th=[ 527], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 1921, max= 8094, per=80.53%, avg=5382.00, stdev=3153.92, samples=3 iops : min= 1, max= 7, avg= 4.33, stdev= 3.06, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=7.61%, ctx=125, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145187: Sat Jul 4 01:02:51 2026 read: IOPS=1, BW=1539KiB/s (1576kB/s)(6144KiB/3991msec) clat (usec): min=44823, max=96405, avg=71372.15, stdev=20486.90 lat (usec): min=44825, max=96406, avg=71373.43, stdev=20486.73 clat percentiles (usec): | 1.00th=[44827], 5.00th=[44827], 10.00th=[44827], 20.00th=[54789], | 30.00th=[54789], 40.00th=[62653], 50.00th=[62653], 60.00th=[79168], | 70.00th=[90702], 80.00th=[90702], 90.00th=[95945], 95.00th=[95945], | 99.00th=[95945], 99.50th=[95945], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 2031, max= 8175, per=100.00%, avg=5103.00, stdev=4344.46, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=1, BW=1539KiB/s (1576kB/s)(6144KiB/3991msec); 0 zone resets clat (msec): min=171, max=2039, avg=577.73, stdev=749.38 lat (msec): min=171, max=2039, avg=577.82, stdev=749.39 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 182], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 1367, max= 4031, per=35.43%, avg=2368.00, stdev=1152.79, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.24%, ctx=192, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145188: Sat Jul 4 01:02:51 2026 read: IOPS=1, BW=1282KiB/s (1313kB/s)(5120KiB/3993msec) clat (usec): min=46690, max=92967, avg=72362.54, stdev=18139.28 lat (usec): min=46691, max=92968, avg=72363.98, stdev=18139.23 clat percentiles (usec): | 1.00th=[46924], 5.00th=[46924], 10.00th=[46924], 20.00th=[46924], | 30.00th=[66323], 40.00th=[66323], 50.00th=[69731], 60.00th=[69731], | 70.00th=[86508], 80.00th=[86508], 90.00th=[92799], 95.00th=[92799], | 99.00th=[92799], 99.50th=[92799], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1795KiB/s (1838kB/s)(7168KiB/3993msec); 0 zone resets clat (msec): min=74, max=2061, avg=508.66, stdev=704.85 lat (msec): min=74, max=2061, avg=509.09, stdev=704.65 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 144], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 184], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 550], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 1387, max= 4031, per=35.51%, avg=2373.00, stdev=1147.03, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=25.00%, 500=8.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.29%, ctx=151, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4774KiB/s (4888kB/s), 511KiB/s-1671KiB/s (523kB/s-1711kB/s), io=20.0MiB (20.0MB), run=3991-4290msec WRITE: bw=6683KiB/s (6844kB/s), 1193KiB/s-2555KiB/s (1222kB/s-2616kB/s), io=28.0MiB (29.4MB), run=3991-4290msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145194: Sat Jul 4 01:02:58 2026 read: IOPS=1, BW=5868KiB/s (6009kB/s)(12.0MiB/2094msec) clat (msec): min=576, max=852, avg=687.08, stdev=145.75 lat (msec): min=576, max=852, avg=687.08, stdev=145.75 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7953, max= 8143, per=100.00%, avg=8048.00, stdev=134.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=20.07%, ctx=460, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145195: Sat Jul 4 01:02:58 2026 read: IOPS=0, BW=2182KiB/s (2235kB/s)(4096KiB/1877msec) clat (nsec): min=748132k, max=748132k, avg=748132067.00, stdev= 0.00 lat (nsec): min=748134k, max=748134k, avg=748134289.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4364KiB/s (4469kB/s)(8192KiB/1877msec); 0 zone resets clat (msec): min=434, max=634, avg=534.66, stdev=141.05 lat (msec): min=435, max=635, avg=535.20, stdev=141.35 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7892, max= 7892, per=45.21%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=8.26%, ctx=201, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145196: Sat Jul 4 01:02:58 2026 write: IOPS=3, BW=12.3MiB/s (12.9MB/s)(12.0MiB/977msec); 0 zone resets clat (msec): min=206, max=393, avg=292.79, stdev=94.44 lat (msec): min=206, max=393, avg=301.31, stdev=93.63 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7816, max= 7816, per=44.77%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.20%, sys=13.73%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145197: Sat Jul 4 01:02:58 2026 write: IOPS=1, BW=6846KiB/s (7010kB/s)(12.0MiB/1795msec); 0 zone resets clat (msec): min=189, max=1309, avg=584.69, stdev=628.72 lat (msec): min=190, max=1311, avg=585.91, stdev=629.25 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min=16189, max=16189, per=92.74%, avg=16189.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.28%, sys=6.13%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7824KiB/s (8012kB/s), 2182KiB/s-5868KiB/s (2235kB/s-6009kB/s), io=16.0MiB (16.8MB), run=1877-2094msec WRITE: bw=17.0MiB/s (17.9MB/s), 4364KiB/s-12.3MiB/s (4469kB/s-12.9MB/s), io=32.0MiB (33.6MB), run=977-1877msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145198: Sat Jul 4 01:02:58 2026 read: IOPS=1, BW=5750KiB/s (5888kB/s)(12.0MiB/2137msec) clat (msec): min=286, max=1040, avg=664.63, stdev=377.41 lat (msec): min=286, max=1040, avg=664.63, stdev=377.41 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min=15937, max=15937, per=100.00%, avg=15937.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.18%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145199: Sat Jul 4 01:02:58 2026 read: IOPS=0, BW=1843KiB/s (1888kB/s)(4096KiB/2222msec) clat (nsec): min=899306k, max=899306k, avg=899306482.00, stdev= 0.00 lat (nsec): min=899309k, max=899309k, avg=899309471.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3687KiB/s (3775kB/s)(8192KiB/2222msec); 0 zone resets clat (msec): min=285, max=1001, avg=643.54, stdev=506.06 lat (msec): min=286, max=1001, avg=643.93, stdev=506.08 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8110, max= 8110, per=61.06%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.27%, ctx=58, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145200: Sat Jul 4 01:02:58 2026 write: IOPS=1, BW=4981KiB/s (5100kB/s)(12.0MiB/2467msec); 0 zone resets clat (msec): min=158, max=1995, avg=778.77, stdev=1053.55 lat (msec): min=158, max=1995, avg=779.09, stdev=1053.66 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8110, max= 8110, per=61.06%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.29%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145201: Sat Jul 4 01:02:58 2026 write: IOPS=1, BW=6190KiB/s (6339kB/s)(12.0MiB/1985msec); 0 zone resets clat (msec): min=254, max=1310, avg=622.06, stdev=596.73 lat (msec): min=255, max=1310, avg=622.47, stdev=596.66 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min=11206, max=11206, per=84.37%, avg=11206.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.20%, sys=5.09%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7374KiB/s (7551kB/s), 1843KiB/s-5750KiB/s (1888kB/s-5888kB/s), io=16.0MiB (16.8MB), run=2137-2222msec WRITE: bw=12.0MiB/s (13.6MB/s), 3687KiB/s-6190KiB/s (3775kB/s-6339kB/s), io=32.0MiB (33.6MB), run=1985-2467msec