== sanity test 398b: DIO and buffer IO race ============== 13:46:01 (1784051161) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.19574 s, 8.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180407: Tue Jul 14 13:48:56 2026 read: IOPS=9, BW=39.8KiB/s (40.7kB/s)(5992KiB/150634msec) clat (usec): min=45, max=1256.0k, avg=56569.95, stdev=46928.54 lat (usec): min=46, max=1256.0k, avg=56573.62, stdev=46927.59 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 16581], 10.00th=[ 21890], | 20.00th=[ 29754], 30.00th=[ 35390], 40.00th=[ 41681], | 50.00th=[ 49546], 60.00th=[ 56886], 70.00th=[ 65799], | 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[ 119014], | 99.00th=[ 187696], 99.50th=[ 219153], 99.90th=[ 333448], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 111, per=25.43%, avg=39.42, stdev=15.04, samples=295 iops : min= 1, max= 27, avg= 9.19, stdev= 3.79, samples=295 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6296KiB/150634msec); 0 zone resets clat (usec): min=1104, max=414690, avg=41554.46, stdev=41239.74 lat (usec): min=1105, max=414692, avg=41565.83, stdev=41248.37 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1680], 10.00th=[ 2966], 20.00th=[ 5800], | 30.00th=[ 10421], 40.00th=[ 20841], 50.00th=[ 31851], 60.00th=[ 42206], | 70.00th=[ 54264], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[119014], | 99.00th=[168821], 99.50th=[193987], 99.90th=[375391], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 7, max= 103, per=25.63%, avg=41.53, stdev=20.29, samples=294 iops : min= 1, max= 25, avg= 9.73, stdev= 5.13, samples=294 lat (usec) : 50=0.10%, 100=1.07%, 250=0.10% lat (msec) : 2=3.32%, 4=4.13%, 10=7.71%, 20=7.52%, 50=34.77% lat (msec) : 100=32.49%, 250=8.50%, 500=0.26%, 2000=0.03% cpu : usr=0.08%, sys=4.64%, ctx=6943, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180409: Tue Jul 14 13:48:56 2026 read: IOPS=9, BW=38.6KiB/s (39.5kB/s)(5940KiB/153924msec) clat (usec): min=40, max=1114.3k, avg=58608.88, stdev=46328.56 lat (usec): min=41, max=1114.3k, avg=58614.00, stdev=46327.75 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 16057], 10.00th=[ 22414], | 20.00th=[ 30016], 30.00th=[ 36439], 40.00th=[ 42730], | 50.00th=[ 50070], 60.00th=[ 58459], 70.00th=[ 68682], | 80.00th=[ 80217], 90.00th=[ 104334], 95.00th=[ 124257], | 99.00th=[ 193987], 99.50th=[ 229639], 99.90th=[ 358613], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 95, per=24.98%, avg=38.72, stdev=14.76, samples=297 iops : min= 1, max= 23, avg= 9.01, stdev= 3.72, samples=297 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6348KiB/153924msec); 0 zone resets clat (usec): min=1191, max=448429, avg=41843.91, stdev=43834.03 lat (usec): min=1192, max=448431, avg=41858.86, stdev=43833.03 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1582], 10.00th=[ 2409], 20.00th=[ 5211], | 30.00th=[ 9241], 40.00th=[ 19268], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 52691], 80.00th=[ 72877], 90.00th=[103285], 95.00th=[126354], | 99.00th=[193987], 99.50th=[214959], 99.90th=[291505], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 118, per=25.51%, avg=41.33, stdev=19.13, samples=297 iops : min= 1, max= 29, avg= 9.68, stdev= 4.82, samples=297 lat (usec) : 50=0.10%, 100=1.01%, 250=0.16%, 500=0.07% lat (msec) : 2=4.20%, 4=4.17%, 10=7.88%, 20=7.49%, 50=34.18% lat (msec) : 100=29.82%, 250=10.64%, 500=0.26%, 2000=0.03% cpu : usr=0.07%, sys=4.50%, ctx=6905, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180410: Tue Jul 14 13:48:56 2026 read: IOPS=9, BW=39.6KiB/s (40.5kB/s)(6028KiB/152371msec) clat (usec): min=42, max=464766, avg=56286.68, stdev=37074.87 lat (usec): min=42, max=464767, avg=56290.86, stdev=37074.04 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 14615], 10.00th=[ 21890], 20.00th=[ 28967], | 30.00th=[ 34866], 40.00th=[ 42206], 50.00th=[ 49546], 60.00th=[ 57410], | 70.00th=[ 65799], 80.00th=[ 79168], 90.00th=[ 99091], 95.00th=[127402], | 99.00th=[179307], 99.50th=[204473], 99.90th=[308282], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 96, per=25.36%, avg=39.31, stdev=16.33, samples=297 iops : min= 1, max= 24, avg= 9.17, stdev= 4.12, samples=297 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6260KiB/152371msec); 0 zone resets clat (usec): min=1130, max=1153.1k, avg=42862.71, stdev=50733.93 lat (usec): min=1131, max=1153.1k, avg=42865.55, stdev=50733.46 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1565], 10.00th=[ 2474], | 20.00th=[ 5342], 30.00th=[ 10028], 40.00th=[ 19792], | 50.00th=[ 30802], 60.00th=[ 43254], 70.00th=[ 56361], | 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[ 123208], | 99.00th=[ 179307], 99.50th=[ 212861], 99.90th=[ 450888], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 95, per=25.16%, avg=40.76, stdev=18.15, samples=297 iops : min= 1, max= 23, avg= 9.53, stdev= 4.57, samples=297 lat (usec) : 50=0.16%, 100=1.43%, 250=0.20%, 500=0.07% lat (msec) : 2=4.07%, 4=3.71%, 10=7.52%, 20=7.32%, 50=33.85% lat (msec) : 100=32.03%, 250=9.38%, 500=0.23%, 2000=0.03% cpu : usr=0.07%, sys=4.45%, ctx=6841, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180412: Tue Jul 14 13:48:56 2026 read: IOPS=9, BW=39.1KiB/s (40.0kB/s)(6052KiB/154908msec) clat (usec): min=38, max=295167, avg=55412.62, stdev=35091.63 lat (usec): min=39, max=295169, avg=55420.14, stdev=35089.52 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 14353], 10.00th=[ 20841], 20.00th=[ 28181], | 30.00th=[ 35390], 40.00th=[ 41681], 50.00th=[ 49021], 60.00th=[ 57410], | 70.00th=[ 64750], 80.00th=[ 78119], 90.00th=[ 98042], 95.00th=[114820], | 99.00th=[181404], 99.50th=[217056], 99.90th=[278922], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 95, per=25.17%, avg=39.02, stdev=16.39, samples=301 iops : min= 1, max= 23, avg= 9.09, stdev= 4.14, samples=301 write: IOPS=10, BW=40.3KiB/s (41.2kB/s)(6236KiB/154908msec); 0 zone resets clat (usec): min=1167, max=1108.7k, avg=45268.31, stdev=51468.65 lat (usec): min=1169, max=1108.7k, avg=45272.04, stdev=51469.35 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1614], 10.00th=[ 2638], | 20.00th=[ 5669], 30.00th=[ 10683], 40.00th=[ 22152], | 50.00th=[ 32113], 60.00th=[ 43779], 70.00th=[ 58459], | 80.00th=[ 77071], 90.00th=[ 109577], 95.00th=[ 133694], | 99.00th=[ 196084], 99.50th=[ 208667], 99.90th=[ 248513], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 135, per=24.92%, avg=40.36, stdev=19.63, samples=300 iops : min= 1, max= 33, avg= 9.43, stdev= 4.95, samples=300 lat (usec) : 50=0.07%, 100=1.37%, 250=0.29%, 1000=0.03% lat (msec) : 2=3.94%, 4=3.68%, 10=7.19%, 20=7.49%, 50=33.95% lat (msec) : 100=31.12%, 250=10.77%, 500=0.07%, 2000=0.03% cpu : usr=0.06%, sys=4.49%, ctx=6900, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (159kB/s), 38.6KiB/s-39.8KiB/s (39.5kB/s-40.7kB/s), io=23.4MiB (24.6MB), run=150634-154908msec WRITE: bw=162KiB/s (166kB/s), 40.3KiB/s-41.8KiB/s (41.2kB/s-42.8kB/s), io=24.6MiB (25.7MB), run=150634-154908msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180405: Tue Jul 14 13:49:36 2026 read: IOPS=7, BW=30.9KiB/s (31.6kB/s)(5992KiB/194088msec) clat (msec): min=6, max=1267, avg=52.72, stdev=57.78 lat (msec): min=6, max=1267, avg=52.72, stdev=57.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 55], 80.00th=[ 79], 90.00th=[ 122], 95.00th=[ 153], | 99.00th=[ 226], 99.50th=[ 266], 99.90th=[ 472], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 151, per=26.29%, avg=32.34, stdev=24.08, samples=359 iops : min= 1, max= 37, avg= 7.43, stdev= 6.07, samples=359 write: IOPS=8, BW=32.4KiB/s (33.2kB/s)(6296KiB/194088msec); 0 zone resets clat (msec): min=12, max=378, avg=72.88, stdev=54.71 lat (msec): min=12, max=378, avg=72.88, stdev=54.71 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 68], | 70.00th=[ 88], 80.00th=[ 108], 90.00th=[ 142], 95.00th=[ 182], | 99.00th=[ 275], 99.50th=[ 300], 99.90th=[ 363], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 133, per=25.17%, avg=32.47, stdev=22.87, samples=375 iops : min= 1, max= 33, avg= 7.45, stdev= 5.78, samples=375 lat (msec) : 10=0.94%, 20=12.21%, 50=42.90%, 100=25.10%, 250=17.71% lat (msec) : 500=1.11%, 2000=0.03% cpu : usr=0.06%, sys=1.99%, ctx=5156, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180406: Tue Jul 14 13:49:36 2026 read: IOPS=7, BW=30.6KiB/s (31.3kB/s)(5940KiB/194314msec) clat (msec): min=6, max=1108, avg=52.23, stdev=55.43 lat (msec): min=6, max=1108, avg=52.23, stdev=55.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 56], 80.00th=[ 77], 90.00th=[ 121], 95.00th=[ 150], | 99.00th=[ 234], 99.50th=[ 292], 99.90th=[ 485], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 143, per=25.82%, avg=31.76, stdev=24.26, samples=363 iops : min= 1, max= 35, avg= 7.27, stdev= 6.12, samples=363 write: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6348KiB/194314msec); 0 zone resets clat (msec): min=12, max=362, avg=73.30, stdev=53.17 lat (msec): min=12, max=362, avg=73.30, stdev=53.17 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 56], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 111], 90.00th=[ 142], 95.00th=[ 176], | 99.00th=[ 264], 99.50th=[ 300], 99.90th=[ 351], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 119, per=25.20%, avg=32.51, stdev=22.36, samples=379 iops : min= 1, max= 29, avg= 7.46, stdev= 5.64, samples=379 lat (msec) : 10=1.43%, 20=12.27%, 50=41.15%, 100=25.62%, 250=18.46% lat (msec) : 500=1.04%, 2000=0.03% cpu : usr=0.06%, sys=2.00%, ctx=5113, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180408: Tue Jul 14 13:49:36 2026 read: IOPS=7, BW=31.2KiB/s (31.9kB/s)(6028KiB/193501msec) clat (msec): min=6, max=290, avg=51.67, stdev=45.11 lat (msec): min=6, max=290, avg=51.67, stdev=45.11 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 75], 90.00th=[ 117], 95.00th=[ 153], | 99.00th=[ 215], 99.50th=[ 230], 99.90th=[ 284], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 143, per=26.26%, avg=32.30, stdev=23.67, samples=362 iops : min= 1, max= 35, avg= 7.41, stdev= 5.97, samples=362 write: IOPS=8, BW=32.4KiB/s (33.1kB/s)(6260KiB/193501msec); 0 zone resets clat (msec): min=11, max=1152, avg=73.62, stdev=63.90 lat (msec): min=11, max=1152, avg=73.63, stdev=63.90 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 69], | 70.00th=[ 85], 80.00th=[ 108], 90.00th=[ 144], 95.00th=[ 180], | 99.00th=[ 288], 99.50th=[ 359], 99.90th=[ 550], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 119, per=25.10%, avg=32.37, stdev=23.15, samples=375 iops : min= 1, max= 29, avg= 7.42, stdev= 5.84, samples=375 lat (msec) : 10=0.91%, 20=12.24%, 50=43.07%, 100=25.91%, 250=16.93% lat (msec) : 500=0.88%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=2.08%, ctx=5285, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180411: Tue Jul 14 13:49:36 2026 read: IOPS=7, BW=31.1KiB/s (31.9kB/s)(6052KiB/194289msec) clat (msec): min=7, max=468, avg=50.17, stdev=45.08 lat (msec): min=7, max=468, avg=50.17, stdev=45.08 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 113], 95.00th=[ 148], | 99.00th=[ 203], 99.50th=[ 226], 99.90th=[ 338], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 144, per=26.20%, avg=32.23, stdev=23.70, samples=365 iops : min= 1, max= 36, avg= 7.39, stdev= 5.98, samples=365 write: IOPS=8, BW=32.1KiB/s (32.9kB/s)(6236KiB/194289msec); 0 zone resets clat (msec): min=11, max=1156, avg=75.64, stdev=63.20 lat (msec): min=11, max=1156, avg=75.64, stdev=63.20 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 38], 40.00th=[ 46], 50.00th=[ 56], 60.00th=[ 71], | 70.00th=[ 89], 80.00th=[ 112], 90.00th=[ 148], 95.00th=[ 186], | 99.00th=[ 275], 99.50th=[ 338], 99.90th=[ 489], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 119, per=24.83%, avg=32.03, stdev=22.29, samples=378 iops : min= 1, max= 29, avg= 7.34, stdev= 5.62, samples=378 lat (msec) : 10=0.98%, 20=13.09%, 50=41.11%, 100=25.94%, 250=17.87% lat (msec) : 500=0.98%, 2000=0.03% cpu : usr=0.05%, sys=2.03%, ctx=5167, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=124KiB/s (127kB/s), 30.6KiB/s-31.2KiB/s (31.3kB/s-31.9kB/s), io=23.4MiB (24.6MB), run=193501-194314msec WRITE: bw=129KiB/s (132kB/s), 32.1KiB/s-32.7KiB/s (32.9kB/s-33.5kB/s), io=24.6MiB (25.7MB), run=193501-194314msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180464: Tue Jul 14 13:50:22 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5920KiB/32352msec) clat (usec): min=43, max=166068, avg=47336.49, stdev=30950.74 lat (usec): min=44, max=166070, avg=47339.83, stdev=30948.19 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 70], 10.00th=[ 145], 20.00th=[ 25297], | 30.00th=[ 31065], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[100140], | 99.00th=[147850], 99.50th=[160433], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 95, max= 318, per=26.91%, avg=181.90, stdev=56.16, samples=63 iops : min= 5, max= 19, avg=10.60, stdev= 3.43, samples=63 write: IOPS=12, BW=197KiB/s (202kB/s)(6368KiB/32352msec); 0 zone resets clat (usec): min=1449, max=185903, avg=36439.92, stdev=35356.16 lat (usec): min=1450, max=185905, avg=36463.70, stdev=35381.96 clat percentiles (usec): | 1.00th=[ 1975], 5.00th=[ 2769], 10.00th=[ 3884], 20.00th=[ 7308], | 30.00th=[ 11469], 40.00th=[ 18220], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 43779], 80.00th=[ 60031], 90.00th=[ 85459], 95.00th=[114820], | 99.00th=[164627], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 29, max= 351, per=27.71%, avg=196.98, stdev=80.49, samples=63 iops : min= 1, max= 21, avg=11.54, stdev= 5.10, samples=63 lat (usec) : 50=0.13%, 100=3.91%, 250=1.17%, 500=0.26% lat (msec) : 2=0.91%, 4=4.82%, 10=8.85%, 20=8.98%, 50=37.89% lat (msec) : 100=27.08%, 250=5.99% cpu : usr=0.09%, sys=6.10%, ctx=1755, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180465: Tue Jul 14 13:50:22 2026 read: IOPS=10, BW=162KiB/s (166kB/s)(5744KiB/35415msec) clat (usec): min=54, max=262828, avg=52593.44, stdev=34399.40 lat (usec): min=55, max=262830, avg=52595.37, stdev=34398.84 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 82], 10.00th=[ 17171], 20.00th=[ 28967], | 30.00th=[ 35390], 40.00th=[ 42206], 50.00th=[ 47973], 60.00th=[ 54264], | 70.00th=[ 62653], 80.00th=[ 71828], 90.00th=[ 92799], 95.00th=[121111], | 99.00th=[177210], 99.50th=[202376], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 350, per=23.78%, avg=160.74, stdev=70.75, samples=69 iops : min= 1, max= 21, avg= 9.25, stdev= 4.47, samples=69 write: IOPS=11, BW=185KiB/s (189kB/s)(6544KiB/35415msec); 0 zone resets clat (usec): min=1697, max=207864, avg=39958.31, stdev=37931.63 lat (usec): min=1698, max=207868, avg=39969.63, stdev=37925.40 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2442], 10.00th=[ 3982], 20.00th=[ 6587], | 30.00th=[ 10552], 40.00th=[ 18220], 50.00th=[ 30016], 60.00th=[ 40633], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[170918], 99.50th=[173016], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 349, per=25.53%, avg=181.49, stdev=72.81, samples=69 iops : min= 1, max= 21, avg=10.57, stdev= 4.59, samples=69 lat (usec) : 100=2.47%, 250=0.78%, 500=0.26%, 750=0.13% lat (msec) : 2=1.30%, 4=4.30%, 10=10.29%, 20=8.07%, 50=33.85% lat (msec) : 100=31.25%, 250=7.16%, 500=0.13% cpu : usr=0.07%, sys=5.70%, ctx=1877, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180466: Tue Jul 14 13:50:22 2026 read: IOPS=11, BW=178KiB/s (183kB/s)(6256KiB/35061msec) clat (usec): min=52, max=221541, avg=49961.24, stdev=33974.38 lat (usec): min=54, max=221543, avg=49962.74, stdev=33974.38 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 80], 10.00th=[ 1221], 20.00th=[ 26608], | 30.00th=[ 32375], 40.00th=[ 38536], 50.00th=[ 46400], 60.00th=[ 52691], | 70.00th=[ 60556], 80.00th=[ 70779], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[183501], 99.50th=[208667], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 315, per=26.35%, avg=178.12, stdev=66.80, samples=69 iops : min= 1, max= 19, avg=10.35, stdev= 4.19, samples=69 write: IOPS=10, BW=172KiB/s (176kB/s)(6032KiB/35061msec); 0 zone resets clat (usec): min=1812, max=205921, avg=40409.67, stdev=38186.85 lat (usec): min=1812, max=205922, avg=40432.57, stdev=38205.14 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 3425], 10.00th=[ 5145], 20.00th=[ 8160], | 30.00th=[ 12125], 40.00th=[ 20579], 50.00th=[ 30016], 60.00th=[ 38011], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[185598], 99.50th=[202376], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 316, per=23.74%, avg=168.78, stdev=67.15, samples=69 iops : min= 1, max= 19, avg= 9.77, stdev= 4.20, samples=69 lat (usec) : 100=3.78%, 250=1.17%, 500=0.13% lat (msec) : 2=0.78%, 4=2.86%, 10=8.85%, 20=8.33%, 50=35.42% lat (msec) : 100=31.77%, 250=6.90% cpu : usr=0.08%, sys=5.87%, ctx=1870, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180467: Tue Jul 14 13:50:22 2026 read: IOPS=10, BW=173KiB/s (178kB/s)(6032KiB/34774msec) clat (usec): min=41, max=204905, avg=48710.95, stdev=35242.95 lat (usec): min=41, max=204906, avg=48717.70, stdev=35241.60 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 24249], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 52691], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[114820], | 99.00th=[179307], 99.50th=[198181], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 348, per=25.40%, avg=171.72, stdev=63.83, samples=68 iops : min= 1, max= 21, avg= 9.96, stdev= 4.01, samples=68 write: IOPS=11, BW=180KiB/s (184kB/s)(6256KiB/34774msec); 0 zone resets clat (usec): min=1844, max=241237, avg=40993.79, stdev=39556.55 lat (usec): min=1845, max=241240, avg=41022.26, stdev=39552.05 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 8], | 30.00th=[ 13], 40.00th=[ 21], 50.00th=[ 29], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 66], 90.00th=[ 101], 95.00th=[ 120], | 99.00th=[ 171], 99.50th=[ 194], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 351, per=25.23%, avg=179.38, stdev=65.84, samples=68 iops : min= 1, max= 21, avg=10.43, stdev= 4.17, samples=68 lat (usec) : 50=0.26%, 100=5.08%, 250=1.43%, 500=0.13%, 750=0.13% lat (msec) : 2=0.39%, 4=2.86%, 10=9.64%, 20=8.46%, 50=34.51% lat (msec) : 100=28.39%, 250=8.72% cpu : usr=0.08%, sys=5.53%, ctx=1824, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=676KiB/s (693kB/s), 162KiB/s-183KiB/s (166kB/s-187kB/s), io=23.4MiB (24.5MB), run=32352-35415msec WRITE: bw=712KiB/s (729kB/s), 172KiB/s-197KiB/s (176kB/s-202kB/s), io=24.6MiB (25.8MB), run=32352-35415msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180460: Tue Jul 14 13:50:33 2026 read: IOPS=7, BW=127KiB/s (130kB/s)(5920KiB/46643msec) clat (msec): min=7, max=221, avg=50.04, stdev=40.62 lat (msec): min=7, max=221, avg=50.05, stdev=40.62 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 72], 90.00th=[ 108], 95.00th=[ 140], | 99.00th=[ 199], 99.50th=[ 205], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 444, per=24.82%, avg=126.33, stdev=84.87, samples=92 iops : min= 1, max= 27, avg= 7.07, stdev= 5.37, samples=92 write: IOPS=8, BW=137KiB/s (140kB/s)(6368KiB/46643msec); 0 zone resets clat (msec): min=17, max=247, avg=70.22, stdev=45.22 lat (msec): min=17, max=247, avg=70.23, stdev=45.22 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 82], 80.00th=[ 104], 90.00th=[ 138], 95.00th=[ 159], | 99.00th=[ 226], 99.50th=[ 241], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 351, per=25.56%, avg=137.02, stdev=77.54, samples=91 iops : min= 1, max= 21, avg= 7.75, stdev= 4.89, samples=91 lat (msec) : 10=0.39%, 20=8.98%, 50=45.31%, 100=28.65%, 250=16.67% cpu : usr=0.08%, sys=2.30%, ctx=1311, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180461: Tue Jul 14 13:50:33 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(5744KiB/46821msec) clat (msec): min=10, max=230, avg=49.94, stdev=42.07 lat (msec): min=10, max=230, avg=49.95, stdev=42.07 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 73], 90.00th=[ 117], 95.00th=[ 148], | 99.00th=[ 194], 99.50th=[ 197], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 383, per=24.32%, avg=123.78, stdev=78.80, samples=90 iops : min= 1, max= 23, avg= 6.90, stdev= 4.98, samples=90 write: IOPS=8, BW=140KiB/s (143kB/s)(6544KiB/46821msec); 0 zone resets clat (msec): min=11, max=304, avg=70.20, stdev=49.12 lat (msec): min=11, max=304, avg=70.21, stdev=49.12 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 63], | 70.00th=[ 81], 80.00th=[ 102], 90.00th=[ 129], 95.00th=[ 176], | 99.00th=[ 266], 99.50th=[ 288], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 383, per=25.74%, avg=137.95, stdev=80.49, samples=92 iops : min= 1, max= 23, avg= 7.80, stdev= 5.06, samples=92 lat (msec) : 20=9.77%, 50=46.88%, 100=26.82%, 250=15.89%, 500=0.65% cpu : usr=0.05%, sys=2.20%, ctx=1286, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180462: Tue Jul 14 13:50:33 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6256KiB/46975msec) clat (msec): min=8, max=317, avg=50.10, stdev=45.57 lat (msec): min=8, max=317, avg=50.10, stdev=45.57 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 114], 95.00th=[ 161], | 99.00th=[ 218], 99.50th=[ 241], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 29, max= 448, per=25.97%, avg=132.18, stdev=94.14, samples=92 iops : min= 1, max= 28, avg= 7.43, stdev= 5.96, samples=92 write: IOPS=8, BW=128KiB/s (131kB/s)(6032KiB/46975msec); 0 zone resets clat (msec): min=19, max=310, avg=71.77, stdev=51.22 lat (msec): min=19, max=310, avg=71.79, stdev=51.22 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 106], 90.00th=[ 148], 95.00th=[ 171], | 99.00th=[ 249], 99.50th=[ 288], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 411, per=23.36%, avg=125.21, stdev=76.12, samples=92 iops : min= 1, max= 25, avg= 7.00, stdev= 4.78, samples=92 lat (msec) : 10=0.52%, 20=11.07%, 50=47.14%, 100=24.09%, 250=16.67% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=2.10%, ctx=1310, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180463: Tue Jul 14 13:50:33 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(6032KiB/46515msec) clat (msec): min=8, max=318, avg=48.19, stdev=41.33 lat (msec): min=8, max=318, avg=48.19, stdev=41.33 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 104], 95.00th=[ 142], | 99.00th=[ 194], 99.50th=[ 207], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 415, per=26.02%, avg=132.47, stdev=83.69, samples=88 iops : min= 1, max= 25, avg= 7.44, stdev= 5.24, samples=88 write: IOPS=8, BW=134KiB/s (138kB/s)(6256KiB/46515msec); 0 zone resets clat (msec): min=18, max=336, avg=72.31, stdev=49.84 lat (msec): min=18, max=336, avg=72.31, stdev=49.84 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 86], 80.00th=[ 106], 90.00th=[ 140], 95.00th=[ 180], | 99.00th=[ 245], 99.50th=[ 279], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 383, per=24.77%, avg=132.75, stdev=79.42, samples=91 iops : min= 1, max= 23, avg= 7.47, stdev= 5.00, samples=91 lat (msec) : 10=0.39%, 20=9.90%, 50=46.22%, 100=26.82%, 250=16.15% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=2.28%, ctx=1306, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=510KiB/s (522kB/s), 123KiB/s-133KiB/s (126kB/s-136kB/s), io=23.4MiB (24.5MB), run=46515-46975msec WRITE: bw=536KiB/s (549kB/s), 128KiB/s-140KiB/s (131kB/s-143kB/s), io=24.6MiB (25.8MB), run=46515-46975msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180482: Tue Jul 14 13:50:51 2026 read: IOPS=1, BW=1583KiB/s (1621kB/s)(7168KiB/4527msec) clat (usec): min=546, max=446408, avg=177147.18, stdev=155041.88 lat (usec): min=548, max=446409, avg=177149.07, stdev=155041.84 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 5473], | 30.00th=[126354], 40.00th=[126354], 50.00th=[179307], 60.00th=[233833], | 70.00th=[233833], 80.00th=[248513], 90.00th=[446694], 95.00th=[446694], | 99.00th=[446694], 99.50th=[446694], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 1678, max= 4087, per=72.35%, avg=2970.75, stdev=1292.75, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1131KiB/s (1158kB/s)(5120KiB/4527msec); 0 zone resets clat (msec): min=271, max=893, avg=568.73, stdev=279.76 lat (msec): min=271, max=893, avg=568.80, stdev=279.76 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1921, max= 2039, per=34.75%, avg=1997.75, stdev=55.76, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=13.26%, ctx=203, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180485: Tue Jul 14 13:50:51 2026 read: IOPS=0, BW=411KiB/s (421kB/s)(2048KiB/4987msec) clat (msec): min=165, max=229, avg=197.46, stdev=45.18 lat (msec): min=165, max=229, avg=197.46, stdev=45.18 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 1992, max= 2039, per=49.09%, avg=2015.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2053KiB/s (2103kB/s)(10.0MiB/4987msec); 0 zone resets clat (msec): min=139, max=772, avg=411.79, stdev=196.56 lat (msec): min=139, max=773, avg=411.93, stdev=196.49 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 236], | 30.00th=[ 275], 40.00th=[ 284], 50.00th=[ 296], 60.00th=[ 498], | 70.00th=[ 506], 80.00th=[ 523], 90.00th=[ 600], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1921, max= 4079, per=45.18%, avg=2597.14, stdev=1010.46, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=33.33%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=15.54%, ctx=213, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180487: Tue Jul 14 13:50:51 2026 read: IOPS=1, BW=1624KiB/s (1663kB/s)(6144KiB/3783msec) clat (msec): min=196, max=274, avg=229.84, stdev=28.96 lat (msec): min=196, max=274, avg=229.84, stdev=28.96 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 234], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 1921, max= 2043, per=48.86%, avg=2006.00, stdev=51.77, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1624KiB/s (1663kB/s)(6144KiB/3783msec); 0 zone resets clat (msec): min=230, max=828, avg=394.43, stdev=230.67 lat (msec): min=230, max=828, avg=394.51, stdev=230.68 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 384], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1921, max= 3330, per=39.37%, avg=2263.40, stdev=598.13, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=66.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=18.09%, ctx=271, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180488: Tue Jul 14 13:50:51 2026 read: IOPS=1, BW=1078KiB/s (1104kB/s)(5120KiB/4750msec) clat (msec): min=3, max=327, avg=132.11, stdev=175.46 lat (msec): min=3, max=327, avg=132.11, stdev=175.46 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 5], 60.00th=[ 5], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 3842, max= 4071, per=96.36%, avg=3956.50, stdev=161.93, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1509KiB/s (1545kB/s)(7168KiB/4750msec); 0 zone resets clat (msec): min=149, max=801, avg=508.56, stdev=235.63 lat (msec): min=150, max=801, avg=508.74, stdev=235.46 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 351], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 506], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 760], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1921, max= 2043, per=35.11%, avg=2018.67, stdev=47.94, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 4=16.67%, 10=8.33%, 250=8.33%, 500=33.33%, 750=16.67% lat (msec) : 1000=16.67% cpu : usr=0.00%, sys=10.13%, ctx=170, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4107KiB/s (4205kB/s), 411KiB/s-1624KiB/s (421kB/s-1663kB/s), io=20.0MiB (20.0MB), run=3783-4987msec WRITE: bw=5749KiB/s (5887kB/s), 1131KiB/s-2053KiB/s (1158kB/s-2103kB/s), io=28.0MiB (29.4MB), run=3783-4987msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180481: Tue Jul 14 13:50:51 2026 read: IOPS=1, BW=1930KiB/s (1976kB/s)(7168KiB/3714msec) clat (msec): min=101, max=1373, avg=335.29, stdev=460.88 lat (msec): min=101, max=1373, avg=335.29, stdev=460.88 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 126], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 271], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 2035, max= 4213, per=87.26%, avg=3365.67, stdev=1166.67, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1379KiB/s (1412kB/s)(5120KiB/3714msec); 0 zone resets clat (msec): min=156, max=477, avg=245.69, stdev=131.11 lat (msec): min=157, max=477, avg=245.85, stdev=131.02 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1924, max= 4071, per=46.63%, avg=2518.25, stdev=1036.59, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=75.00%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.52%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180483: Tue Jul 14 13:50:51 2026 read: IOPS=0, BW=466KiB/s (477kB/s)(2048KiB/4398msec) clat (msec): min=137, max=213, avg=175.66, stdev=53.71 lat (msec): min=137, max=213, avg=175.66, stdev=53.71 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 213], 95.00th=[ 213], | 99.00th=[ 213], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 1450, max= 2035, per=45.18%, avg=1742.50, stdev=413.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2328KiB/s (2384kB/s)(10.0MiB/4398msec); 0 zone resets clat (msec): min=105, max=783, avg=396.22, stdev=241.18 lat (msec): min=106, max=783, avg=396.53, stdev=241.34 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 182], | 30.00th=[ 197], 40.00th=[ 222], 50.00th=[ 264], 60.00th=[ 414], | 70.00th=[ 514], 80.00th=[ 550], 90.00th=[ 743], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1984, max= 3849, per=44.69%, avg=2413.43, stdev=711.71, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.79, samples=7 lat (msec) : 250=50.00%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=6.12%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180484: Tue Jul 14 13:50:51 2026 read: IOPS=1, BW=1231KiB/s (1260kB/s)(6144KiB/4992msec) clat (msec): min=118, max=1334, avg=442.69, stdev=515.63 lat (msec): min=118, max=1334, avg=442.69, stdev=515.63 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 144], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1969, max= 3856, per=64.19%, avg=2475.75, stdev=920.76, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1231KiB/s (1260kB/s)(6144KiB/4992msec); 0 zone resets clat (msec): min=106, max=626, avg=376.68, stdev=208.03 lat (msec): min=107, max=626, avg=377.11, stdev=208.15 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 443], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1928, max= 3908, per=45.57%, avg=2461.00, stdev=965.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.83%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180486: Tue Jul 14 13:50:51 2026 read: IOPS=0, BW=964KiB/s (988kB/s)(5120KiB/5309msec) clat (msec): min=67, max=868, avg=290.03, stdev=328.18 lat (msec): min=67, max=868, avg=290.03, stdev=328.18 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 4071, max= 4096, per=100.00%, avg=4083.50, stdev=17.68, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1350KiB/s (1383kB/s)(7168KiB/5309msec); 0 zone resets clat (msec): min=304, max=856, avg=526.33, stdev=199.82 lat (msec): min=304, max=856, avg=526.41, stdev=199.82 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 313], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 510], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 709], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1448, max= 4047, per=41.61%, avg=2246.83, stdev=909.78, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=16.67% cpu : usr=0.02%, sys=6.99%, ctx=119, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3858KiB/s (3950kB/s), 466KiB/s-1930KiB/s (477kB/s-1976kB/s), io=20.0MiB (20.0MB), run=3714-5309msec WRITE: bw=5401KiB/s (5530kB/s), 1231KiB/s-2328KiB/s (1260kB/s-2384kB/s), io=28.0MiB (29.4MB), run=3714-5309msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180497: Tue Jul 14 13:51:08 2026 read: IOPS=1, BW=4754KiB/s (4868kB/s)(12.0MiB/2585msec) clat (msec): min=719, max=862, avg=803.68, stdev=74.70 lat (msec): min=719, max=862, avg=803.69, stdev=74.70 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7953, max= 8143, per=100.00%, avg=8048.00, stdev=134.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=15.09%, ctx=331, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180499: Tue Jul 14 13:51:08 2026 read: IOPS=0, BW=1359KiB/s (1392kB/s)(4096KiB/3013msec) clat (nsec): min=706468k, max=706468k, avg=706468392.00, stdev= 0.00 lat (nsec): min=706472k, max=706472k, avg=706471581.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2719KiB/s (2784kB/s)(8192KiB/3013msec); 0 zone resets clat (msec): min=1004, max=1102, avg=1053.19, stdev=69.05 lat (msec): min=1008, max=1102, avg=1055.54, stdev=66.18 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8143, max= 8143, per=88.92%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.84%, ctx=109, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180501: Tue Jul 14 13:51:08 2026 write: IOPS=0, BW=3434KiB/s (3517kB/s)(12.0MiB/3578msec); 0 zone resets clat (msec): min=304, max=2122, avg=1158.99, stdev=913.84 lat (msec): min=311, max=2122, avg=1161.37, stdev=910.96 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8143, max= 8143, per=88.92%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.02%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180503: Tue Jul 14 13:51:08 2026 write: IOPS=0, BW=3646KiB/s (3734kB/s)(12.0MiB/3370msec); 0 zone resets clat (msec): min=791, max=1546, avg=1108.28, stdev=391.60 lat (msec): min=792, max=1547, avg=1109.30, stdev=392.06 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7984, max= 8110, per=87.87%, avg=8047.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.85%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5438KiB/s (5568kB/s), 1359KiB/s-4754KiB/s (1392kB/s-4868kB/s), io=16.0MiB (16.8MB), run=2585-3013msec WRITE: bw=9158KiB/s (9378kB/s), 2719KiB/s-3646KiB/s (2784kB/s-3734kB/s), io=32.0MiB (33.6MB), run=3013-3578msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180498: Tue Jul 14 13:51:09 2026 read: IOPS=0, BW=3930KiB/s (4024kB/s)(12.0MiB/3127msec) clat (msec): min=556, max=1328, avg=1014.86, stdev=405.79 lat (msec): min=556, max=1328, avg=1014.86, stdev=405.79 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.23%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180500: Tue Jul 14 13:51:09 2026 read: IOPS=0, BW=1126KiB/s (1153kB/s)(4096KiB/3638msec) clat (nsec): min=887329k, max=887329k, avg=887328807.00, stdev= 0.00 lat (nsec): min=887331k, max=887331k, avg=887330933.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2252KiB/s (2306kB/s)(8192KiB/3638msec); 0 zone resets clat (msec): min=882, max=1739, avg=1310.65, stdev=605.93 lat (msec): min=882, max=1739, avg=1311.08, stdev=605.87 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.48%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180502: Tue Jul 14 13:51:09 2026 write: IOPS=0, BW=2939KiB/s (3010kB/s)(12.0MiB/4181msec); 0 zone resets clat (msec): min=332, max=2831, avg=1375.95, stdev=1299.25 lat (msec): min=332, max=2832, avg=1377.27, stdev=1299.88 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8031, max= 8192, per=100.00%, avg=8111.50, stdev=113.84, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.89%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180504: Tue Jul 14 13:51:09 2026 write: IOPS=0, BW=3942KiB/s (4037kB/s)(12.0MiB/3117msec); 0 zone resets clat (msec): min=504, max=1947, avg=1027.80, stdev=799.25 lat (msec): min=504, max=1948, avg=1028.31, stdev=799.29 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.82%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4504KiB/s (4612kB/s), 1126KiB/s-3930KiB/s (1153kB/s-4024kB/s), io=16.0MiB (16.8MB), run=3127-3638msec WRITE: bw=7837KiB/s (8025kB/s), 2252KiB/s-3942KiB/s (2306kB/s-4037kB/s), io=32.0MiB (33.6MB), run=3117-4181msec