== sanity test 398b: DIO and buffer IO race ============== 10:33:49 (1761143629) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.10894 s, 16.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192062: Wed Oct 22 10:34:45 2025 read: IOPS=31, BW=125KiB/s (128kB/s)(5992KiB/47973msec) clat (usec): min=118, max=647045, avg=17373.01, stdev=18563.60 lat (usec): min=119, max=647045, avg=17373.58, stdev=18563.63 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 6783], 10.00th=[ 8029], 20.00th=[ 9634], | 30.00th=[ 11338], 40.00th=[ 13435], 50.00th=[ 15533], 60.00th=[ 17433], | 70.00th=[ 19792], 80.00th=[ 22938], 90.00th=[ 28181], 95.00th=[ 34341], | 99.00th=[ 47449], 99.50th=[ 54264], 99.90th=[ 64226], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 12, max= 224, per=25.12%, avg=124.61, stdev=37.73, samples=95 iops : min= 3, max= 56, avg=30.76, stdev= 9.53, samples=95 write: IOPS=32, BW=131KiB/s (134kB/s)(6296KiB/47973msec); 0 zone resets clat (usec): min=566, max=70499, avg=13846.31, stdev=10683.34 lat (usec): min=566, max=70500, avg=13847.01, stdev=10683.35 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 2180], 10.00th=[ 2704], 20.00th=[ 3982], | 30.00th=[ 6259], 40.00th=[ 8848], 50.00th=[11207], 60.00th=[14222], | 70.00th=[17433], 80.00th=[22152], 90.00th=[28705], 95.00th=[34866], | 99.00th=[46400], 99.50th=[50594], 99.90th=[62129], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 47, max= 216, per=25.52%, avg=132.45, stdev=36.22, samples=94 iops : min= 11, max= 54, avg=32.71, stdev= 9.16, samples=94 lat (usec) : 250=0.13%, 500=0.68%, 750=0.33%, 1000=0.42% lat (msec) : 2=1.40%, 4=8.37%, 10=22.17%, 20=39.71%, 50=26.14% lat (msec) : 100=0.62%, 750=0.03% cpu : usr=0.12%, sys=26.19%, ctx=9068, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192063: Wed Oct 22 10:34:45 2025 read: IOPS=30, BW=123KiB/s (126kB/s)(5940KiB/48142msec) clat (usec): min=149, max=64613, avg=16900.95, stdev=8802.62 lat (usec): min=150, max=64613, avg=16901.51, stdev=8802.66 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 6849], 10.00th=[ 7963], 20.00th=[ 9503], | 30.00th=[11207], 40.00th=[13304], 50.00th=[15401], 60.00th=[17433], | 70.00th=[19530], 80.00th=[22938], 90.00th=[28443], 95.00th=[33162], | 99.00th=[45876], 99.50th=[48497], 99.90th=[60031], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 6, max= 207, per=24.74%, avg=122.69, stdev=38.90, samples=95 iops : min= 1, max= 51, avg=30.27, stdev= 9.77, samples=95 write: IOPS=32, BW=132KiB/s (135kB/s)(6348KiB/48142msec); 0 zone resets clat (usec): min=674, max=645727, avg=14419.11, stdev=19205.60 lat (usec): min=675, max=645728, avg=14419.82, stdev=19205.64 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2442], 10.00th=[ 2737], 20.00th=[ 3949], | 30.00th=[ 6718], 40.00th=[ 9372], 50.00th=[ 11600], 60.00th=[ 14091], | 70.00th=[ 17695], 80.00th=[ 22414], 90.00th=[ 29492], 95.00th=[ 34866], | 99.00th=[ 47973], 99.50th=[ 57410], 99.90th=[ 83362], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 55, max= 248, per=25.42%, avg=131.91, stdev=36.69, samples=94 iops : min= 13, max= 62, avg=32.59, stdev= 9.26, samples=94 lat (usec) : 250=0.16%, 500=0.39%, 750=0.20%, 1000=0.26% lat (msec) : 2=1.14%, 4=9.15%, 10=21.91%, 20=39.94%, 50=26.24% lat (msec) : 100=0.59%, 750=0.03% cpu : usr=0.09%, sys=26.07%, ctx=9015, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192064: Wed Oct 22 10:34:45 2025 read: IOPS=31, BW=127KiB/s (130kB/s)(6028KiB/47459msec) clat (usec): min=75, max=651844, avg=17283.71, stdev=18646.50 lat (usec): min=76, max=651845, avg=17284.40, stdev=18646.53 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 7046], 10.00th=[ 8160], 20.00th=[ 9634], | 30.00th=[ 11207], 40.00th=[ 13042], 50.00th=[ 15270], 60.00th=[ 17171], | 70.00th=[ 19530], 80.00th=[ 22414], 90.00th=[ 28443], 95.00th=[ 33817], | 99.00th=[ 47449], 99.50th=[ 54264], 99.90th=[ 62129], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 6, max= 200, per=25.64%, avg=127.17, stdev=34.82, samples=94 iops : min= 1, max= 50, avg=31.39, stdev= 8.81, samples=94 write: IOPS=32, BW=132KiB/s (135kB/s)(6260KiB/47459msec); 0 zone resets clat (usec): min=613, max=72313, avg=13573.93, stdev=10458.53 lat (usec): min=613, max=72314, avg=13574.71, stdev=10458.58 clat percentiles (usec): | 1.00th=[ 914], 5.00th=[ 2245], 10.00th=[ 2671], 20.00th=[ 3818], | 30.00th=[ 6521], 40.00th=[ 8979], 50.00th=[11207], 60.00th=[14091], | 70.00th=[17433], 80.00th=[21627], 90.00th=[27657], 95.00th=[33424], | 99.00th=[49021], 99.50th=[53216], 99.90th=[69731], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 19, max= 248, per=25.44%, avg=132.05, stdev=41.62, samples=94 iops : min= 4, max= 62, avg=32.62, stdev=10.48, samples=94 lat (usec) : 100=0.03%, 250=0.16%, 500=0.39%, 750=0.46%, 1000=0.42% lat (msec) : 2=1.24%, 4=8.79%, 10=22.23%, 20=40.82%, 50=24.61% lat (msec) : 100=0.81%, 750=0.03% cpu : usr=0.09%, sys=26.20%, ctx=9043, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192065: Wed Oct 22 10:34:45 2025 read: IOPS=31, BW=125KiB/s (128kB/s)(6052KiB/48387msec) clat (usec): min=116, max=73549, avg=16830.29, stdev=8760.13 lat (usec): min=116, max=73549, avg=16830.88, stdev=8760.14 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 6915], 10.00th=[ 8094], 20.00th=[10028], | 30.00th=[11600], 40.00th=[13566], 50.00th=[15401], 60.00th=[17171], | 70.00th=[19268], 80.00th=[22152], 90.00th=[27395], 95.00th=[33424], | 99.00th=[46400], 99.50th=[52167], 99.90th=[71828], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 47, max= 200, per=25.49%, avg=126.42, stdev=33.65, samples=95 iops : min= 11, max= 50, avg=31.21, stdev= 8.53, samples=95 write: IOPS=32, BW=129KiB/s (132kB/s)(6236KiB/48387msec); 0 zone resets clat (usec): min=619, max=687361, avg=14586.23, stdev=20158.09 lat (usec): min=620, max=687363, avg=14586.94, stdev=20158.13 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 2409], 10.00th=[ 2835], 20.00th=[ 4178], | 30.00th=[ 6980], 40.00th=[ 9765], 50.00th=[ 11600], 60.00th=[ 14353], | 70.00th=[ 17695], 80.00th=[ 22414], 90.00th=[ 28967], 95.00th=[ 35390], | 99.00th=[ 46400], 99.50th=[ 57934], 99.90th=[ 74974], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 55, max= 239, per=25.05%, avg=130.02, stdev=38.94, samples=95 iops : min= 13, max= 59, avg=32.12, stdev= 9.78, samples=95 lat (usec) : 250=0.10%, 500=0.75%, 750=0.29%, 1000=0.26% lat (msec) : 2=1.27%, 4=8.20%, 10=19.92%, 20=43.20%, 50=25.33% lat (msec) : 100=0.65%, 750=0.03% cpu : usr=0.06%, sys=26.10%, ctx=9072, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=496KiB/s (508kB/s), 123KiB/s-127KiB/s (126kB/s-130kB/s), io=23.4MiB (24.6MB), run=47459-48387msec WRITE: bw=520KiB/s (532kB/s), 129KiB/s-132KiB/s (132kB/s-135kB/s), io=24.6MiB (25.7MB), run=47459-48387msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192057: Wed Oct 22 10:34:51 2025 read: IOPS=27, BW=108KiB/s (111kB/s)(5992KiB/55283msec) clat (msec): min=2, max=655, avg=16.16, stdev=20.67 lat (msec): min=2, max=655, avg=16.16, stdev=20.67 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 34], 95.00th=[ 41], | 99.00th=[ 65], 99.50th=[ 73], 99.90th=[ 90], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 31, max= 352, per=25.19%, avg=109.31, stdev=66.76, samples=109 iops : min= 7, max= 88, avg=27.02, stdev=16.80, samples=109 write: IOPS=28, BW=114KiB/s (117kB/s)(6296KiB/55283msec); 0 zone resets clat (usec): min=3592, max=93503, avg=19622.47, stdev=13210.76 lat (usec): min=3594, max=93504, avg=19625.87, stdev=13214.14 clat percentiles (usec): | 1.00th=[ 4752], 5.00th=[ 6128], 10.00th=[ 6915], 20.00th=[ 8094], | 30.00th=[ 9634], 40.00th=[12387], 50.00th=[15795], 60.00th=[19792], | 70.00th=[24249], 80.00th=[30016], 90.00th=[38011], 95.00th=[45351], | 99.00th=[63177], 99.50th=[68682], 99.90th=[80217], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 31, max= 392, per=25.27%, avg=114.73, stdev=68.46, samples=109 iops : min= 7, max= 98, avg=28.38, stdev=17.22, samples=109 lat (msec) : 4=1.17%, 10=35.71%, 20=30.86%, 50=29.30%, 100=2.93% lat (msec) : 750=0.03% cpu : usr=0.10%, sys=13.20%, ctx=5536, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192058: Wed Oct 22 10:34:51 2025 read: IOPS=26, BW=108KiB/s (111kB/s)(5940KiB/55019msec) clat (msec): min=2, max=678, avg=15.78, stdev=20.75 lat (msec): min=2, max=678, avg=15.78, stdev=20.75 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 32], 95.00th=[ 41], | 99.00th=[ 58], 99.50th=[ 63], 99.90th=[ 103], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 15, max= 416, per=25.03%, avg=108.61, stdev=69.12, samples=108 iops : min= 3, max= 104, avg=26.84, stdev=17.40, samples=108 write: IOPS=28, BW=115KiB/s (118kB/s)(6348KiB/55019msec); 0 zone resets clat (usec): min=3995, max=85629, avg=19781.15, stdev=13300.51 lat (usec): min=3995, max=85630, avg=19781.97, stdev=13300.51 clat percentiles (usec): | 1.00th=[ 5145], 5.00th=[ 6063], 10.00th=[ 6849], 20.00th=[ 8094], | 30.00th=[10028], 40.00th=[12649], 50.00th=[16188], 60.00th=[19792], | 70.00th=[24249], 80.00th=[30016], 90.00th=[38011], 95.00th=[45351], | 99.00th=[64750], 99.50th=[69731], 99.90th=[82314], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 39, max= 352, per=25.49%, avg=115.73, stdev=66.52, samples=108 iops : min= 9, max= 88, avg=28.62, stdev=16.74, samples=108 lat (msec) : 4=1.14%, 10=34.57%, 20=32.00%, 50=29.65%, 100=2.57% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.09%, sys=13.25%, ctx=5558, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192059: Wed Oct 22 10:34:51 2025 read: IOPS=27, BW=109KiB/s (112kB/s)(6028KiB/55257msec) clat (msec): min=2, max=102, avg=16.07, stdev=12.44 lat (msec): min=2, max=102, avg=16.08, stdev=12.44 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 34], 95.00th=[ 42], | 99.00th=[ 61], 99.50th=[ 70], 99.90th=[ 84], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 32, max= 376, per=25.39%, avg=110.18, stdev=70.04, samples=109 iops : min= 8, max= 94, avg=27.24, stdev=17.61, samples=109 write: IOPS=28, BW=113KiB/s (116kB/s)(6260KiB/55257msec); 0 zone resets clat (msec): min=3, max=689, avg=19.71, stdev=21.52 lat (msec): min=3, max=689, avg=19.71, stdev=21.52 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 39], 95.00th=[ 46], | 99.00th=[ 65], 99.50th=[ 71], 99.90th=[ 117], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 31, max= 328, per=25.17%, avg=114.29, stdev=65.79, samples=109 iops : min= 7, max= 82, avg=28.27, stdev=16.55, samples=109 lat (msec) : 4=1.17%, 10=35.06%, 20=31.54%, 50=29.30%, 100=2.83% lat (msec) : 250=0.07%, 750=0.03% cpu : usr=0.10%, sys=13.26%, ctx=5564, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192061: Wed Oct 22 10:34:51 2025 read: IOPS=27, BW=110KiB/s (112kB/s)(6052KiB/55182msec) clat (usec): min=2630, max=86439, avg=15868.29, stdev=12218.73 lat (usec): min=2631, max=86440, avg=15868.84, stdev=12218.74 clat percentiles (usec): | 1.00th=[ 3589], 5.00th=[ 4686], 10.00th=[ 5538], 20.00th=[ 6849], | 30.00th=[ 8094], 40.00th=[ 9896], 50.00th=[11600], 60.00th=[13960], | 70.00th=[17433], 80.00th=[22938], 90.00th=[33162], 95.00th=[41681], | 99.00th=[60031], 99.50th=[65799], 99.90th=[79168], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 40, max= 336, per=25.25%, avg=109.58, stdev=64.35, samples=108 iops : min= 10, max= 84, avg=27.08, stdev=16.20, samples=108 write: IOPS=28, BW=113KiB/s (116kB/s)(6236KiB/55182msec); 0 zone resets clat (msec): min=3, max=688, avg=19.88, stdev=21.42 lat (msec): min=3, max=688, avg=19.88, stdev=21.42 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 29], 90.00th=[ 37], 95.00th=[ 45], | 99.00th=[ 64], 99.50th=[ 71], 99.90th=[ 122], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 24, max= 400, per=24.95%, avg=113.28, stdev=67.67, samples=108 iops : min= 6, max= 100, avg=28.01, stdev=17.02, samples=108 lat (msec) : 4=1.17%, 10=34.08%, 20=32.58%, 50=29.26%, 100=2.83% lat (msec) : 250=0.03%, 750=0.03% cpu : usr=0.07%, sys=13.34%, ctx=5631, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=434KiB/s (445kB/s), 108KiB/s-110KiB/s (111kB/s-112kB/s), io=23.4MiB (24.6MB), run=55019-55283msec WRITE: bw=455KiB/s (466kB/s), 113KiB/s-115KiB/s (116kB/s-118kB/s), io=24.6MiB (25.7MB), run=55019-55283msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192087: Wed Oct 22 10:35:15 2025 read: IOPS=20, BW=331KiB/s (339kB/s)(5920KiB/17888msec) clat (usec): min=350, max=69833, avg=25197.37, stdev=12746.98 lat (usec): min=351, max=69833, avg=25198.06, stdev=12747.05 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 1647], 10.00th=[11469], 20.00th=[15533], | 30.00th=[17957], 40.00th=[20841], 50.00th=[23200], 60.00th=[26870], | 70.00th=[30278], 80.00th=[34341], 90.00th=[41157], 95.00th=[51119], | 99.00th=[59507], 99.50th=[64750], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 159, max= 542, per=24.68%, avg=328.43, stdev=79.60, samples=35 iops : min= 9, max= 33, avg=19.86, stdev= 5.04, samples=35 write: IOPS=22, BW=356KiB/s (365kB/s)(6368KiB/17888msec); 0 zone resets clat (usec): min=1321, max=82802, avg=21359.15, stdev=13079.91 lat (usec): min=1322, max=82805, avg=21360.57, stdev=13080.02 clat percentiles (usec): | 1.00th=[ 2474], 5.00th=[ 5014], 10.00th=[ 6980], 20.00th=[10159], | 30.00th=[13829], 40.00th=[15926], 50.00th=[18744], 60.00th=[22152], | 70.00th=[25822], 80.00th=[31065], 90.00th=[39584], 95.00th=[47449], | 99.00th=[62653], 99.50th=[78119], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 159, max= 637, per=25.40%, avg=355.89, stdev=101.53, samples=35 iops : min= 9, max= 39, avg=21.57, stdev= 6.47, samples=35 lat (usec) : 500=0.39%, 750=1.56%, 1000=0.39% lat (msec) : 2=0.39%, 4=1.56%, 10=9.24%, 20=32.42%, 50=49.74% lat (msec) : 100=4.30% cpu : usr=0.11%, sys=29.81%, ctx=3267, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192088: Wed Oct 22 10:35:15 2025 read: IOPS=20, BW=325KiB/s (333kB/s)(5744KiB/17666msec) clat (usec): min=267, max=89290, avg=25577.49, stdev=13231.42 lat (usec): min=268, max=89291, avg=25578.23, stdev=13231.47 clat percentiles (usec): | 1.00th=[ 404], 5.00th=[ 8291], 10.00th=[12649], 20.00th=[15270], | 30.00th=[18482], 40.00th=[21890], 50.00th=[24249], 60.00th=[26608], | 70.00th=[29230], 80.00th=[33817], 90.00th=[41681], 95.00th=[49546], | 99.00th=[72877], 99.50th=[79168], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 159, max= 638, per=24.53%, avg=326.50, stdev=101.31, samples=34 iops : min= 9, max= 39, avg=19.74, stdev= 6.32, samples=34 write: IOPS=23, BW=370KiB/s (379kB/s)(6544KiB/17666msec); 0 zone resets clat (usec): min=1812, max=72048, avg=20682.33, stdev=12727.96 lat (usec): min=1813, max=72049, avg=20683.67, stdev=12728.00 clat percentiles (usec): | 1.00th=[ 3359], 5.00th=[ 4883], 10.00th=[ 7308], 20.00th=[ 8979], | 30.00th=[11863], 40.00th=[15139], 50.00th=[18482], 60.00th=[21627], | 70.00th=[25822], 80.00th=[30278], 90.00th=[37487], 95.00th=[43779], | 99.00th=[61080], 99.50th=[66323], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 95, max= 636, per=26.20%, avg=367.12, stdev=115.65, samples=34 iops : min= 5, max= 39, avg=22.26, stdev= 7.36, samples=34 lat (usec) : 500=0.78%, 750=0.52%, 1000=0.39% lat (msec) : 2=0.13%, 4=1.30%, 10=12.89%, 20=29.82%, 50=50.39% lat (msec) : 100=3.78% cpu : usr=0.07%, sys=30.38%, ctx=3168, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192089: Wed Oct 22 10:35:15 2025 read: IOPS=21, BW=348KiB/s (356kB/s)(6256KiB/17984msec) clat (usec): min=270, max=75482, avg=24919.76, stdev=12497.24 lat (usec): min=271, max=75482, avg=24932.66, stdev=12511.96 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 8094], 10.00th=[12125], 20.00th=[15795], | 30.00th=[17695], 40.00th=[20841], 50.00th=[23200], 60.00th=[26608], | 70.00th=[30016], 80.00th=[33817], 90.00th=[39060], 95.00th=[48497], | 99.00th=[67634], 99.50th=[70779], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 191, max= 542, per=26.16%, avg=348.23, stdev=89.10, samples=35 iops : min= 11, max= 33, avg=21.09, stdev= 5.63, samples=35 write: IOPS=20, BW=335KiB/s (343kB/s)(6032KiB/17984msec); 0 zone resets clat (usec): min=1191, max=65187, avg=21688.89, stdev=12825.94 lat (usec): min=1193, max=65188, avg=21690.99, stdev=12826.34 clat percentiles (usec): | 1.00th=[ 2114], 5.00th=[ 5014], 10.00th=[ 7111], 20.00th=[ 9765], | 30.00th=[13173], 40.00th=[16450], 50.00th=[19268], 60.00th=[22414], | 70.00th=[26870], 80.00th=[32375], 90.00th=[39584], 95.00th=[47449], | 99.00th=[56361], 99.50th=[57934], 99.90th=[65274], 99.95th=[65274], | 99.99th=[65274] bw ( KiB/s): min= 159, max= 573, per=23.59%, avg=330.54, stdev=110.37, samples=35 iops : min= 9, max= 35, avg=19.97, stdev= 7.02, samples=35 lat (usec) : 500=1.04%, 750=0.65%, 1000=0.52% lat (msec) : 2=0.39%, 4=0.78%, 10=11.20%, 20=30.47%, 50=51.17% lat (msec) : 100=3.78% cpu : usr=0.09%, sys=29.64%, ctx=3170, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192090: Wed Oct 22 10:35:15 2025 read: IOPS=21, BW=342KiB/s (350kB/s)(6032KiB/17649msec) clat (usec): min=231, max=91303, avg=25588.10, stdev=13317.13 lat (usec): min=232, max=91305, avg=25588.79, stdev=13317.17 clat percentiles (usec): | 1.00th=[ 367], 5.00th=[ 7701], 10.00th=[11600], 20.00th=[16450], | 30.00th=[18482], 40.00th=[20579], 50.00th=[23462], 60.00th=[26346], | 70.00th=[29492], 80.00th=[35914], 90.00th=[43779], 95.00th=[49021], | 99.00th=[65274], 99.50th=[80217], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 159, max= 670, per=25.66%, avg=341.53, stdev=99.33, samples=34 iops : min= 9, max= 41, avg=20.68, stdev= 6.30, samples=34 write: IOPS=22, BW=354KiB/s (363kB/s)(6256KiB/17649msec); 0 zone resets clat (usec): min=1622, max=62927, avg=20349.74, stdev=13045.75 lat (usec): min=1623, max=62929, avg=20351.11, stdev=13045.79 clat percentiles (usec): | 1.00th=[ 2245], 5.00th=[ 4621], 10.00th=[ 6718], 20.00th=[ 8455], | 30.00th=[10814], 40.00th=[13566], 50.00th=[18220], 60.00th=[21890], | 70.00th=[25297], 80.00th=[30540], 90.00th=[38011], 95.00th=[45351], | 99.00th=[60556], 99.50th=[61604], 99.90th=[63177], 99.95th=[63177], | 99.99th=[63177] bw ( KiB/s): min= 192, max= 699, per=25.42%, avg=356.09, stdev=120.90, samples=34 iops : min= 12, max= 43, avg=21.59, stdev= 7.54, samples=34 lat (usec) : 250=0.13%, 500=0.52%, 750=1.43% lat (msec) : 2=0.26%, 4=1.04%, 10=13.28%, 20=29.17%, 50=50.13% lat (msec) : 100=4.04% cpu : usr=0.08%, sys=29.94%, ctx=3117, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1332KiB/s (1364kB/s), 325KiB/s-348KiB/s (333kB/s-356kB/s), io=23.4MiB (24.5MB), run=17649-17984msec WRITE: bw=1401KiB/s (1435kB/s), 335KiB/s-370KiB/s (343kB/s-379kB/s), io=24.6MiB (25.8MB), run=17649-17984msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192092: Wed Oct 22 10:35:16 2025 read: IOPS=19, BW=311KiB/s (319kB/s)(5920KiB/19009msec) clat (msec): min=3, max=114, avg=22.36, stdev=16.00 lat (msec): min=3, max=114, avg=22.37, stdev=16.00 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 46], 95.00th=[ 55], | 99.00th=[ 69], 99.50th=[ 96], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 95, max= 990, per=23.72%, avg=298.92, stdev=164.25, samples=37 iops : min= 5, max= 61, avg=18.11, stdev=10.31, samples=37 write: IOPS=20, BW=335KiB/s (343kB/s)(6368KiB/19009msec); 0 zone resets clat (msec): min=4, max=107, avg=26.84, stdev=17.35 lat (msec): min=4, max=107, avg=26.84, stdev=17.35 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 41], 90.00th=[ 53], 95.00th=[ 61], | 99.00th=[ 84], 99.50th=[ 85], 99.90th=[ 108], 99.95th=[ 108], | 99.99th=[ 108] bw ( KiB/s): min= 158, max= 894, per=24.30%, avg=321.95, stdev=151.76, samples=37 iops : min= 9, max= 55, avg=19.54, stdev= 9.55, samples=37 lat (msec) : 4=0.26%, 10=17.58%, 20=30.99%, 50=41.80%, 100=9.11% lat (msec) : 250=0.26% cpu : usr=0.13%, sys=14.19%, ctx=1722, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192093: Wed Oct 22 10:35:16 2025 read: IOPS=18, BW=302KiB/s (310kB/s)(5744KiB/18993msec) clat (msec): min=3, max=133, avg=21.74, stdev=16.38 lat (msec): min=3, max=133, avg=21.74, stdev=16.38 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 55], | 99.00th=[ 79], 99.50th=[ 88], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 127, max= 1021, per=23.38%, avg=294.62, stdev=157.48, samples=37 iops : min= 7, max= 63, avg=17.81, stdev= 9.93, samples=37 write: IOPS=21, BW=345KiB/s (353kB/s)(6544KiB/18993msec); 0 zone resets clat (msec): min=4, max=120, avg=27.08, stdev=18.14 lat (msec): min=4, max=120, avg=27.08, stdev=18.14 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 42], 90.00th=[ 51], 95.00th=[ 64], | 99.00th=[ 85], 99.50th=[ 96], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 158, max= 992, per=24.77%, avg=328.16, stdev=175.79, samples=37 iops : min= 9, max= 62, avg=19.92, stdev=11.00, samples=37 lat (msec) : 4=0.13%, 10=18.49%, 20=32.68%, 50=40.23%, 100=8.07% lat (msec) : 250=0.39% cpu : usr=0.09%, sys=14.08%, ctx=1674, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192094: Wed Oct 22 10:35:16 2025 read: IOPS=20, BW=332KiB/s (340kB/s)(6256KiB/18860msec) clat (msec): min=3, max=121, avg=22.37, stdev=16.40 lat (msec): min=3, max=121, avg=22.37, stdev=16.40 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 34], 90.00th=[ 44], 95.00th=[ 56], | 99.00th=[ 82], 99.50th=[ 89], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 127, max= 1117, per=26.10%, avg=328.81, stdev=200.26, samples=37 iops : min= 7, max= 69, avg=19.97, stdev=12.58, samples=37 write: IOPS=19, BW=320KiB/s (328kB/s)(6032KiB/18860msec); 0 zone resets clat (msec): min=4, max=128, avg=26.53, stdev=17.36 lat (msec): min=4, max=128, avg=26.53, stdev=17.36 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 39], 90.00th=[ 51], 95.00th=[ 63], | 99.00th=[ 82], 99.50th=[ 100], 99.90th=[ 129], 99.95th=[ 129], | 99.99th=[ 129] bw ( KiB/s): min= 190, max= 894, per=23.55%, avg=312.08, stdev=133.35, samples=37 iops : min= 11, max= 55, avg=18.92, stdev= 8.39, samples=37 lat (msec) : 4=0.13%, 10=16.67%, 20=34.51%, 50=39.84%, 100=8.59% lat (msec) : 250=0.26% cpu : usr=0.04%, sys=14.31%, ctx=1794, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192095: Wed Oct 22 10:35:16 2025 read: IOPS=20, BW=321KiB/s (329kB/s)(6032KiB/18798msec) clat (usec): min=3027, max=83946, avg=21797.13, stdev=14618.77 lat (usec): min=3028, max=83947, avg=21797.91, stdev=14618.74 clat percentiles (usec): | 1.00th=[ 4293], 5.00th=[ 5997], 10.00th=[ 7570], 20.00th=[ 9896], | 30.00th=[12911], 40.00th=[14877], 50.00th=[17433], 60.00th=[21103], | 70.00th=[25035], 80.00th=[31327], 90.00th=[44303], 95.00th=[53740], | 99.00th=[67634], 99.50th=[71828], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 96, max= 958, per=25.15%, avg=316.89, stdev=169.86, samples=37 iops : min= 6, max= 59, avg=19.22, stdev=10.58, samples=37 write: IOPS=20, BW=333KiB/s (341kB/s)(6256KiB/18798msec); 0 zone resets clat (msec): min=4, max=133, avg=26.82, stdev=17.89 lat (msec): min=4, max=133, avg=26.82, stdev=17.89 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 51], 95.00th=[ 61], | 99.00th=[ 81], 99.50th=[ 104], 99.90th=[ 134], 99.95th=[ 134], | 99.99th=[ 134] bw ( KiB/s): min= 159, max= 926, per=24.98%, avg=331.03, stdev=161.06, samples=37 iops : min= 9, max= 57, avg=20.11, stdev=10.16, samples=37 lat (msec) : 4=0.13%, 10=15.63%, 20=35.68%, 50=39.58%, 100=8.72% lat (msec) : 250=0.26% cpu : usr=0.08%, sys=14.66%, ctx=1692, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1260KiB/s (1290kB/s), 302KiB/s-332KiB/s (310kB/s-340kB/s), io=23.4MiB (24.5MB), run=18798-19009msec WRITE: bw=1326KiB/s (1358kB/s), 320KiB/s-345KiB/s (328kB/s-353kB/s), io=24.6MiB (25.8MB), run=18798-19009msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192105: Wed Oct 22 10:35:27 2025 read: IOPS=1, BW=1706KiB/s (1747kB/s)(7168KiB/4201msec) clat (msec): min=102, max=619, avg=217.24, stdev=189.66 lat (msec): min=102, max=619, avg=217.24, stdev=189.66 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 122], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 126], 60.00th=[ 129], | 70.00th=[ 129], 80.00th=[ 300], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1424, max= 3308, per=47.94%, avg=2131.20, stdev=701.93, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1219KiB/s (1248kB/s)(5120KiB/4201msec); 0 zone resets clat (msec): min=213, max=673, avg=525.79, stdev=187.66 lat (msec): min=213, max=673, avg=525.89, stdev=187.66 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1984, max= 3785, per=41.67%, avg=2593.33, stdev=1032.10, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 500=8.33%, 750=41.67% cpu : usr=0.00%, sys=19.19%, ctx=336, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192106: Wed Oct 22 10:35:27 2025 read: IOPS=0, BW=445KiB/s (455kB/s)(2048KiB/4606msec) clat (msec): min=99, max=147, avg=123.52, stdev=33.72 lat (msec): min=99, max=147, avg=123.52, stdev=33.72 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 148], 95.00th=[ 148], | 99.00th=[ 148], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 1452, max= 1892, per=37.61%, avg=1672.00, stdev=311.13, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2223KiB/s (2277kB/s)(10.0MiB/4606msec); 0 zone resets clat (msec): min=58, max=1567, avg=434.20, stdev=436.87 lat (msec): min=58, max=1568, avg=434.29, stdev=436.87 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 109], | 30.00th=[ 167], 40.00th=[ 186], 50.00th=[ 326], 60.00th=[ 338], | 70.00th=[ 481], 80.00th=[ 542], 90.00th=[ 575], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1452, max= 3308, per=34.07%, avg=2120.50, stdev=622.86, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=25.43%, ctx=234, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192107: Wed Oct 22 10:35:27 2025 read: IOPS=1, BW=1467KiB/s (1503kB/s)(6144KiB/4187msec) clat (msec): min=72, max=521, avg=239.29, stdev=177.29 lat (msec): min=72, max=521, avg=239.29, stdev=177.29 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 313], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1892, max= 2048, per=44.98%, avg=1999.75, stdev=73.92, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=1, BW=1467KiB/s (1503kB/s)(6144KiB/4187msec); 0 zone resets clat (msec): min=101, max=1151, avg=448.18, stdev=394.48 lat (msec): min=101, max=1151, avg=448.29, stdev=394.49 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 485], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1438, max= 2048, per=28.25%, avg=1758.00, stdev=267.88, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 rand-rw: (groupid=0, jobs=1): err= 0: pid=192108: Wed Oct 22 10:35:27 2025 read: IOPS=2, BW=2236KiB/s (2289kB/s)(7168KiB/3206msec) clat (usec): min=1126, max=369716, avg=220987.47, stdev=110134.33 lat (usec): min=1127, max=369717, avg=220988.81, stdev=110134.76 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1123], 10.00th=[ 1123], 20.00th=[214959], | 30.00th=[225444], 40.00th=[225444], 50.00th=[233833], 60.00th=[240124], | 70.00th=[240124], 80.00th=[263193], 90.00th=[371196], 95.00th=[371196], | 99.00th=[371196], 99.50th=[371196], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 1654, max= 3968, per=58.13%, avg=2633.25, stdev=1033.76, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1597KiB/s (1635kB/s)(5120KiB/3206msec); 0 zone resets clat (msec): min=126, max=631, avg=316.63, stdev=193.51 lat (msec): min=126, max=632, avg=316.71, stdev=193.52 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1654, max= 4096, per=40.76%, avg=2585.67, stdev=1319.84, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 2=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.06%, sys=56.16%, ctx=501, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192110: Wed Oct 22 10:35:27 2025 read: IOPS=0, BW=453KiB/s (464kB/s)(2048KiB/4520msec) clat (msec): min=254, max=260, avg=257.57, stdev= 4.70 lat (msec): min=254, max=260, avg=257.57, stdev= 4.70 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 255], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1456, max= 1892, per=36.95%, avg=1674.00, stdev=308.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2265KiB/s (2320kB/s)(10.0MiB/4520msec); 0 zone resets clat (msec): min=187, max=826, avg=390.16, stdev=173.11 lat (msec): min=187, max=826, avg=390.24, stdev=173.11 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 259], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 384], 80.00th=[ 426], 90.00th=[ 481], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1456, max= 4096, per=33.85%, avg=2147.00, stdev=815.19, samples=8 iops : min= 1, max= 4, avg= 1.50, stdev= 1.07, samples=8 lat (msec) : 250=8.33%, 500=83.33%, 1000=8.33% cpu : usr=0.02%, sys=53.71%, ctx=433, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192111: Wed Oct 22 10:35:27 2025 read: IOPS=1, BW=1778KiB/s (1821kB/s)(6144KiB/3455msec) clat (usec): min=1003, max=256517, avg=79769.56, stdev=122315.94 lat (usec): min=1004, max=256518, avg=79770.58, stdev=122315.72 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1004], 10.00th=[ 1004], 20.00th=[ 1156], | 30.00th=[ 1156], 40.00th=[ 1237], 50.00th=[ 1237], 60.00th=[ 1516], | 70.00th=[217056], 80.00th=[217056], 90.00th=[256902], 95.00th=[256902], | 99.00th=[256902], 99.50th=[256902], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 1892, max= 4096, per=73.61%, avg=3334.33, stdev=1249.75, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1778KiB/s (1821kB/s)(6144KiB/3455msec); 0 zone resets clat (msec): min=231, max=1064, avg=482.04, stdev=317.80 lat (msec): min=231, max=1064, avg=482.12, stdev=317.83 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 380], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1467, max= 3785, per=34.56%, avg=2192.20, stdev=922.99, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 2=33.33%, 250=16.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=46.64%, ctx=411, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192112: Wed Oct 22 10:35:27 2025 read: IOPS=1, BW=1148KiB/s (1176kB/s)(5120KiB/4458msec) clat (usec): min=1252, max=276359, avg=102002.59, stdev=115620.73 lat (usec): min=1253, max=276360, avg=102004.01, stdev=115620.79 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1254], 10.00th=[ 1254], 20.00th=[ 1254], | 30.00th=[ 1270], 40.00th=[ 1270], 50.00th=[ 81265], 60.00th=[ 81265], | 70.00th=[149947], 80.00th=[149947], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7571, max= 7571, per=100.00%, avg=7571.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1608KiB/s (1646kB/s)(7168KiB/4458msec); 0 zone resets clat (msec): min=247, max=1092, avg=561.59, stdev=285.93 lat (msec): min=249, max=1092, avg=561.92, stdev=285.64 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 368], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 481], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 768], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1440, max= 2048, per=30.39%, avg=1927.67, stdev=240.27, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 2=16.67%, 100=8.33%, 250=16.67%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=34.84%, ctx=375, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4531KiB/s (4640kB/s), 453KiB/s-2236KiB/s (464kB/s-2289kB/s), io=20.0MiB (20.0MB), run=3206-4520msec WRITE: bw=6343Ki lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33% B/s (6496kB/s), 1597KiB/s-2265KiB/s (1635kB/s-2320kB/s), io=28.0MiB (29.4MB), run=3206-4520msec cpu : usr=0.02%, sys=18.20%, ctx=228, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192109: Wed Oct 22 10:35:27 2025 read: IOPS=1, BW=1445KiB/s (1480kB/s)(5120KiB/3543msec) clat (msec): min=88, max=396, avg=205.56, stdev=120.89 lat (msec): min=88, max=396, avg=205.56, stdev=120.89 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 3968, max= 4096, per=90.69%, avg=4032.00, stdev=90.51, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2023KiB/s (2072kB/s)(7168KiB/3543msec); 0 zone resets clat (msec): min=64, max=662, avg=357.97, stdev=202.14 lat (msec): min=64, max=662, avg=358.08, stdev=202.15 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 178], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 359], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 531], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2011, max= 3785, per=47.90%, avg=2981.00, stdev=757.22, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=17.62%, ctx=123, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4446KiB/s (4553kB/s), 445KiB/s-1706KiB/s (455kB/s-1747kB/s), io=20.0MiB (20.0MB), run=3543-4606msec WRITE: bw=6225KiB/s (6374kB/s), 1219KiB/s-2223KiB/s (1248kB/s-2277kB/s), io=28.0MiB (29.4MB), run=3543-4606msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=192118: Wed Oct 22 10:35:34 2025 read: IOPS=2, BW=9.89MiB/s (10.4MB/s)(12.0MiB/1213msec) clat (msec): min=374, max=419, avg=390.18, stdev=25.35 lat (msec): min=374, max=419, avg=390.18, stdev=25.35 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7301, max= 8192, per=60.14%, avg=7746.50, stdev=630.03, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=60.56%, ctx=2959, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192119: Wed Oct 22 10:35:34 2025 read: IOPS=0, BW=3220KiB/s (3297kB/s)(4096KiB/1272msec) clat (nsec): min=413588k, max=413588k, avg=413587693.00, stdev= 0.00 lat (nsec): min=413589k, max=413589k, avg=413589203.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7314, max= 7314, per=56.79%, avg=7314.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6440KiB/s (6595kB/s)(8192KiB/1272msec); 0 zone resets clat (msec): min=285, max=525, avg=405.54, stdev=169.30 lat (msec): min=285, max=525, avg=405.81, stdev=169.49 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 8192, max= 8192, per=44.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=20.30%, ctx=1054, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192121: Wed Oct 22 10:35:34 2025 write: IOPS=1, BW=6876KiB/s (7041kB/s)(12.0MiB/1787msec); 0 zone resets clat (msec): min=60, max=1372, avg=578.47, stdev=698.29 lat (msec): min=60, max=1372, avg=578.79, stdev=698.31 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8192, max= 8192, per=44.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.29%, ctx=74, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192122: Wed Oct 22 10:35:34 2025 write: IOPS=1, BW=7948KiB/s (8139kB/s)(12.0MiB/1546msec); 0 zone resets clat (msec): min=107, max=1163, avg=508.08, stdev=572.44 lat (msec): min=108, max=1164, avg=508.37, stdev=572.47 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min=15086, max=15086, per=82.28%, avg=15086.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.28%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=12.6MiB/s (13.2MB/s), 3220KiB/s-9.89MiB/s (3297kB/s-10.4MB/s), io=16.0MiB (16.8MB), run=1213-1272msec WRITE: bw=17.9MiB/s (18.8MB/s), 6440KiB/s-7948KiB/s (6595kB/s-8139kB/s), io=32.0MiB (33.6MB), run=1272-1787msec rand-rw: (groupid=0, jobs=1): err= 0: pid=192123: Wed Oct 22 10:35:35 2025 read: IOPS=1, BW=7974KiB/s (8165kB/s)(12.0MiB/1541msec) clat (msec): min=172, max=1057, avg=504.48, stdev=482.09 lat (msec): min=172, max=1057, avg=504.48, stdev=482.09 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=16.10%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192124: Wed Oct 22 10:35:35 2025 read: IOPS=0, BW=2622KiB/s (2685kB/s)(4096KiB/1562msec) clat (nsec): min=793568k, max=793568k, avg=793567606.00, stdev= 0.00 lat (nsec): min=793570k, max=793570k, avg=793569730.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8159, max= 8159, per=77.79%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5245KiB/s (5370kB/s)(8192KiB/1562msec); 0 zone resets clat (msec): min=334, max=397, avg=366.09, stdev=44.52 lat (msec): min=334, max=397, avg=366.38, stdev=44.56 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 8192, max= 8192, per=41.40%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=20.37%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192125: Wed Oct 22 10:35:35 2025 write: IOPS=2, BW=8790KiB/s (9001kB/s)(12.0MiB/1398msec); 0 zone resets clat (msec): min=340, max=546, avg=462.47, stdev=107.99 lat (msec): min=340, max=546, avg=462.79, stdev=107.98 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7393, max= 7393, per=37.36%, avg=7393.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.07%, sys=22.41%, ctx=93, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=192126: Wed Oct 22 10:35:35 2025 write: IOPS=1, BW=7420KiB/s (7598kB/s)(12.0MiB/1656msec); 0 zone resets clat (msec): min=308, max=967, avg=545.21, stdev=366.49 lat (msec): min=308, max=967, avg=545.55, stdev=366.55 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7613, max= 8159, per=39.85%, avg=7886.00, stdev=386.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.18%, sys=15.83%, ctx=85, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.2MiB/s (10.7MB/s), 2622KiB/s-7974KiB/s (2685kB/s-8165kB/s), io=16.0MiB (16.8MB), run=1541-1562msec WRITE: bw=19.3MiB/s (20.3MB/s), 5245KiB/s-8790KiB/s (5370kB/s-9001kB/s), io=32.0MiB (33.6MB), run=1398-1656msec