== sanity test 398b: DIO and buffer IO race ============== 12:18:54 (1790785134) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.93402 s, 7.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150399: Wed Sep 30 12:21:10 2026 read: IOPS=12, BW=51.0KiB/s (53.2kB/s)(5992KiB/115233msec) clat (usec): min=41, max=963149, avg=42253.03, stdev=37177.53 lat (usec): min=42, max=963150, avg=42256.27, stdev=37178.84 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 153], 10.00th=[ 14877], 20.00th=[ 20841], | 30.00th=[ 25035], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 92799], | 99.00th=[158335], 99.50th=[170918], 99.90th=[246416], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 135, per=24.89%, avg=51.78, stdev=20.20, samples=227 iops : min= 1, max= 33, avg=12.35, stdev= 5.13, samples=227 write: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6296KiB/115233msec); 0 zone resets clat (usec): min=962, max=315230, avg=32749.30, stdev=34060.99 lat (usec): min=963, max=315231, avg=32759.10, stdev=34060.55 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1745], 20.00th=[ 3556], | 30.00th=[ 6652], 40.00th=[ 14615], 50.00th=[ 23462], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[143655], 99.50th=[158335], 99.90th=[242222], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 174, per=25.04%, avg=54.58, stdev=23.26, samples=226 iops : min= 1, max= 43, avg=13.05, stdev= 5.84, samples=226 lat (usec) : 50=0.46%, 100=1.89%, 250=0.13%, 750=0.03%, 1000=0.10% lat (msec) : 2=6.22%, 4=4.92%, 10=7.06%, 20=11.59%, 50=40.43% lat (msec) : 100=22.59%, 250=4.52%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.45%, ctx=6467, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150400: Wed Sep 30 12:21:10 2026 read: IOPS=13, BW=52.0KiB/s (53.3kB/s)(5940KiB/114151msec) clat (usec): min=35, max=294274, avg=42008.92, stdev=29466.63 lat (usec): min=36, max=294275, avg=42012.01, stdev=29467.10 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9110], 10.00th=[ 15270], 20.00th=[ 21103], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[158335], 99.50th=[181404], 99.90th=[274727], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 104, per=24.88%, avg=51.75, stdev=19.94, samples=225 iops : min= 1, max= 26, avg=12.34, stdev= 5.02, samples=225 write: IOPS=13, BW=55.6KiB/s (56.9kB/s)(6348KiB/114151msec); 0 zone resets clat (usec): min=937, max=890311, avg=32370.93, stdev=39667.56 lat (usec): min=938, max=890312, avg=32373.53, stdev=39666.80 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1565], 20.00th=[ 3228], | 30.00th=[ 6194], 40.00th=[ 12649], 50.00th=[ 22938], 60.00th=[ 31065], | 70.00th=[ 40633], 80.00th=[ 56361], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[147850], 99.50th=[160433], 99.90th=[229639], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 128, per=25.39%, avg=55.35, stdev=21.93, samples=225 iops : min= 1, max= 32, avg=13.24, stdev= 5.50, samples=225 lat (usec) : 50=0.42%, 100=1.46%, 250=0.16%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.41%, 4=5.50%, 10=7.10%, 20=11.56%, 50=40.43% lat (msec) : 100=22.40%, 250=4.23%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.73%, ctx=6514, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150401: Wed Sep 30 12:21:10 2026 read: IOPS=13, BW=52.6KiB/s (53.8kB/s)(6028KiB/114648msec) clat (usec): min=36, max=215687, avg=41148.53, stdev=27538.93 lat (usec): min=37, max=215687, avg=41149.90, stdev=27538.86 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 988], 10.00th=[ 14746], 20.00th=[ 20579], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[137364], 99.50th=[162530], 99.90th=[208667], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 7, max= 128, per=25.17%, avg=52.36, stdev=20.95, samples=226 iops : min= 1, max= 32, avg=12.49, stdev= 5.31, samples=226 write: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6260KiB/114648msec); 0 zone resets clat (usec): min=897, max=922509, avg=33385.68, stdev=40755.58 lat (usec): min=898, max=922510, avg=33390.18, stdev=40758.26 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1713], 20.00th=[ 3785], | 30.00th=[ 7308], 40.00th=[ 14615], 50.00th=[ 23987], 60.00th=[ 31589], | 70.00th=[ 43254], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[137364], 99.50th=[177210], 99.90th=[354419], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 135, per=24.93%, avg=54.35, stdev=22.73, samples=226 iops : min= 1, max= 33, avg=13.00, stdev= 5.70, samples=226 lat (usec) : 50=0.52%, 100=1.76%, 250=0.10%, 500=0.07%, 1000=0.16% lat (msec) : 2=6.25%, 4=4.33%, 10=7.52%, 20=11.46%, 50=41.02% lat (msec) : 100=22.53%, 250=4.23%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.49%, ctx=6411, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150402: Wed Sep 30 12:21:10 2026 read: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6052KiB/113394msec) clat (usec): min=39, max=217237, avg=41627.24, stdev=27722.17 lat (usec): min=39, max=217237, avg=41628.44, stdev=27722.18 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 1123], 10.00th=[ 15795], 20.00th=[ 21365], | 30.00th=[ 25822], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[141558], 99.50th=[156238], 99.90th=[202376], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 112, per=25.54%, avg=53.12, stdev=19.90, samples=223 iops : min= 1, max= 28, avg=12.68, stdev= 5.02, samples=223 write: IOPS=13, BW=54.0KiB/s (56.3kB/s)(6236KiB/113394msec); 0 zone resets clat (usec): min=949, max=858359, avg=32101.79, stdev=39024.03 lat (usec): min=951, max=858360, avg=32104.35, stdev=39023.28 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1680], 20.00th=[ 3523], | 30.00th=[ 6390], 40.00th=[ 14091], 50.00th=[ 22414], 60.00th=[ 31589], | 70.00th=[ 41157], 80.00th=[ 54789], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[179307], 99.90th=[254804], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 135, per=25.21%, avg=54.97, stdev=22.40, samples=222 iops : min= 1, max= 33, avg=13.15, stdev= 5.64, samples=222 lat (usec) : 50=0.42%, 100=1.76%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.02%, 4=5.08%, 10=7.32%, 20=11.59%, 50=41.50% lat (msec) : 100=21.81%, 250=4.04%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.67%, ctx=6499, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=208KiB/s (213kB/s), 51.0KiB/s-53.4KiB/s (53.2kB/s-54.7kB/s), io=23.4MiB (24.6MB), run=113394-115233msec WRITE: bw=218KiB/s (223kB/s), 54.6KiB/s-55.6KiB/s (55.9kB/s-56.9kB/s), io=24.6MiB (25.7MB), run=113394-115233msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150404: Wed Sep 30 12:21:47 2026 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(5992KiB/152478msec) clat (msec): min=4, max=972, avg=39.74, stdev=45.18 lat (msec): min=4, max=972, avg=39.74, stdev=45.18 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 58], 90.00th=[ 86], 95.00th=[ 118], | 99.00th=[ 190], 99.50th=[ 220], 99.90th=[ 397], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 135, per=24.99%, avg=39.23, stdev=26.85, samples=296 iops : min= 1, max= 33, avg= 9.17, stdev= 6.78, samples=296 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6296KiB/152478msec); 0 zone resets clat (msec): min=10, max=353, avg=58.98, stdev=42.62 lat (msec): min=10, max=353, avg=58.98, stdev=42.62 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 347], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 134, per=25.03%, avg=41.04, stdev=26.59, samples=298 iops : min= 1, max= 33, avg= 9.62, stdev= 6.69, samples=298 lat (msec) : 10=3.12%, 20=18.20%, 50=45.18%, 100=22.04%, 250=10.90% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.05%, sys=1.82%, ctx=4722, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150405: Wed Sep 30 12:21:47 2026 read: IOPS=9, BW=39.2KiB/s (40.1kB/s)(5940KiB/151717msec) clat (msec): min=5, max=997, avg=38.80, stdev=43.61 lat (msec): min=5, max=997, avg=38.80, stdev=43.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 54], 90.00th=[ 83], 95.00th=[ 114], | 99.00th=[ 184], 99.50th=[ 232], 99.90th=[ 275], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 128, per=25.00%, avg=39.24, stdev=27.05, samples=295 iops : min= 1, max= 32, avg= 9.17, stdev= 6.81, samples=295 write: IOPS=10, BW=41.8KiB/s (42.8kB/s)(6348KiB/151717msec); 0 zone resets clat (msec): min=11, max=356, avg=59.20, stdev=40.77 lat (msec): min=11, max=356, avg=59.21, stdev=40.77 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 201], 99.50th=[ 232], 99.90th=[ 292], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 128, per=25.27%, avg=41.45, stdev=25.52, samples=299 iops : min= 1, max= 32, avg= 9.72, stdev= 6.43, samples=299 lat (msec) : 10=2.41%, 20=17.90%, 50=46.29%, 100=22.95%, 250=10.19% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=1.87%, ctx=4823, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150406: Wed Sep 30 12:21:47 2026 read: IOPS=9, BW=39.7KiB/s (40.7kB/s)(6028KiB/151824msec) clat (msec): min=4, max=331, avg=38.83, stdev=36.02 lat (msec): min=4, max=331, avg=38.84, stdev=36.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 83], 95.00th=[ 111], | 99.00th=[ 182], 99.50th=[ 209], 99.90th=[ 275], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 125, per=25.34%, avg=39.78, stdev=26.40, samples=295 iops : min= 1, max= 31, avg= 9.31, stdev= 6.64, samples=295 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6260KiB/151824msec); 0 zone resets clat (msec): min=7, max=1130, avg=59.53, stdev=49.34 lat (msec): min=7, max=1130, avg=59.54, stdev=49.34 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 259], 99.90th=[ 351], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 111, per=24.96%, avg=40.94, stdev=25.84, samples=298 iops : min= 1, max= 27, avg= 9.59, stdev= 6.51, samples=298 lat (msec) : 10=2.93%, 20=16.21%, 50=46.81%, 100=23.60%, 250=10.03% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=1.78%, ctx=4617, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150407: Wed Sep 30 12:21:47 2026 read: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6052KiB/151719msec) clat (msec): min=6, max=402, avg=40.02, stdev=37.88 lat (msec): min=6, max=402, avg=40.02, stdev=37.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 94], 95.00th=[ 117], | 99.00th=[ 184], 99.50th=[ 205], 99.90th=[ 317], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 143, per=25.75%, avg=40.43, stdev=26.91, samples=292 iops : min= 1, max= 35, avg= 9.47, stdev= 6.77, samples=292 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6236KiB/151719msec); 0 zone resets clat (msec): min=8, max=1136, avg=58.40, stdev=47.75 lat (msec): min=8, max=1136, avg=58.40, stdev=47.75 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 230], 99.90th=[ 317], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 144, per=24.97%, avg=40.95, stdev=25.34, samples=297 iops : min= 1, max= 36, avg= 9.60, stdev= 6.39, samples=297 lat (msec) : 10=3.26%, 20=17.48%, 50=45.31%, 100=23.05%, 250=10.61% lat (msec) : 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=1.86%, ctx=4814, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=157KiB/s (161kB/s), 39.2KiB/s-39.9KiB/s (40.1kB/s-40.8kB/s), io=23.4MiB (24.6MB), run=151717-152478msec WRITE: bw=165KiB/s (169kB/s), 41.1KiB/s-41.8KiB/s (42.1kB/s-42.8kB/s), io=24.6MiB (25.7MB), run=151717-152478msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150459: Wed Sep 30 12:22:26 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(5920KiB/28527msec) clat (usec): min=34, max=168471, avg=41214.55, stdev=28706.12 lat (usec): min=34, max=168473, avg=41216.33, stdev=28707.12 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 56], 10.00th=[ 92], 20.00th=[ 20841], | 30.00th=[ 25822], 40.00th=[ 30802], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 59507], 90.00th=[ 71828], 95.00th=[ 91751], | 99.00th=[152044], 99.50th=[162530], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 31, max= 506, per=25.34%, avg=206.80, stdev=76.79, samples=56 iops : min= 1, max= 31, avg=12.18, stdev= 4.87, samples=56 write: IOPS=13, BW=223KiB/s (229kB/s)(6368KiB/28527msec); 0 zone resets clat (usec): min=1373, max=213386, avg=33196.83, stdev=32352.24 lat (usec): min=1375, max=213387, avg=33231.12, stdev=32386.26 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2114], 10.00th=[ 3064], 20.00th=[ 6063], | 30.00th=[ 10290], 40.00th=[ 16450], 50.00th=[ 23200], 60.00th=[ 31065], | 70.00th=[ 42206], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[135267], 99.50th=[193987], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 62, max= 510, per=25.94%, avg=222.80, stdev=91.27, samples=56 iops : min= 3, max= 31, avg=13.18, stdev= 5.77, samples=56 lat (usec) : 50=1.69%, 100=3.12%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=2.34%, 4=5.34%, 10=7.68%, 20=10.94%, 50=41.67% lat (msec) : 100=23.18%, 250=3.65% cpu : usr=0.06%, sys=6.58%, ctx=1706, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150460: Wed Sep 30 12:22:26 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(5744KiB/29127msec) clat (usec): min=50, max=129635, avg=41319.71, stdev=24614.28 lat (usec): min=51, max=129636, avg=41323.81, stdev=24614.22 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 15795], 20.00th=[ 21890], | 30.00th=[ 27657], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 73925], 95.00th=[ 86508], | 99.00th=[117965], 99.50th=[126354], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 56, max= 382, per=24.00%, avg=195.86, stdev=79.73, samples=57 iops : min= 3, max= 23, avg=11.49, stdev= 4.93, samples=57 write: IOPS=14, BW=225KiB/s (230kB/s)(6544KiB/29127msec); 0 zone resets clat (usec): min=1364, max=170242, avg=34616.74, stdev=33120.39 lat (usec): min=1366, max=170243, avg=34623.49, stdev=33117.66 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2147], 10.00th=[ 3294], 20.00th=[ 6194], | 30.00th=[ 10290], 40.00th=[ 16450], 50.00th=[ 24773], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[141558], 99.50th=[145753], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 90, max= 412, per=26.01%, avg=223.40, stdev=84.39, samples=57 iops : min= 5, max= 25, avg=13.23, stdev= 5.39, samples=57 lat (usec) : 100=3.26%, 250=0.13% lat (msec) : 2=2.47%, 4=4.30%, 10=8.98%, 20=12.11%, 50=40.23% lat (msec) : 100=24.74%, 250=3.78% cpu : usr=0.07%, sys=6.12%, ctx=1722, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150461: Wed Sep 30 12:22:26 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(6256KiB/29321msec) clat (usec): min=36, max=195206, avg=41717.48, stdev=27499.27 lat (usec): min=37, max=195207, avg=41719.73, stdev=27498.80 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 11076], 20.00th=[ 22938], | 30.00th=[ 28443], 40.00th=[ 32637], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[168821], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 63, max= 508, per=25.81%, avg=210.65, stdev=85.70, samples=57 iops : min= 3, max= 31, avg=12.44, stdev= 5.40, samples=57 write: IOPS=12, BW=206KiB/s (211kB/s)(6032KiB/29321msec); 0 zone resets clat (usec): min=1445, max=197384, avg=34125.16, stdev=34481.96 lat (usec): min=1447, max=197387, avg=34149.33, stdev=34492.14 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1926], 10.00th=[ 3097], 20.00th=[ 5735], | 30.00th=[ 8586], 40.00th=[ 16188], 50.00th=[ 22938], 60.00th=[ 31327], | 70.00th=[ 42730], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[154141], 99.50th=[170918], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 63, max= 448, per=23.31%, avg=200.23, stdev=86.19, samples=57 iops : min= 3, max= 28, avg=11.77, stdev= 5.46, samples=57 lat (usec) : 50=1.04%, 100=2.73%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.73%, 4=4.30%, 10=10.03%, 20=8.33%, 50=43.10% lat (msec) : 100=22.53%, 250=4.56% cpu : usr=0.07%, sys=6.15%, ctx=1743, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150462: Wed Sep 30 12:22:26 2026 read: IOPS=13, BW=208KiB/s (213kB/s)(6032KiB/28988msec) clat (usec): min=46, max=216665, avg=41391.64, stdev=29988.68 lat (usec): min=47, max=216667, avg=41410.88, stdev=30003.58 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 12780], 20.00th=[ 21103], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 48497], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[156238], 99.50th=[212861], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 384, per=25.42%, avg=207.46, stdev=69.92, samples=57 iops : min= 1, max= 24, avg=12.23, stdev= 4.42, samples=57 write: IOPS=13, BW=216KiB/s (221kB/s)(6256KiB/28988msec); 0 zone resets clat (usec): min=1475, max=161689, avg=33763.35, stdev=34056.94 lat (usec): min=1477, max=161691, avg=33769.01, stdev=34062.14 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1827], 10.00th=[ 3097], 20.00th=[ 5407], | 30.00th=[ 9110], 40.00th=[ 15664], 50.00th=[ 22676], 60.00th=[ 29754], | 70.00th=[ 39584], 80.00th=[ 57410], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[145753], 99.50th=[149947], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 63, max= 448, per=25.24%, avg=216.81, stdev=82.73, samples=57 iops : min= 3, max= 28, avg=12.82, stdev= 5.23, samples=57 lat (usec) : 50=0.26%, 100=3.78%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=2.73%, 4=4.17%, 10=9.11%, 20=11.07%, 50=43.10% lat (msec) : 100=19.92%, 250=5.47% cpu : usr=0.07%, sys=6.07%, ctx=1694, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=817KiB/s (836kB/s), 197KiB/s-213KiB/s (202kB/s-218kB/s), io=23.4MiB (24.5MB), run=28527-29321msec WRITE: bw=859KiB/s (880kB/s), 206KiB/s-225KiB/s (211kB/s-230kB/s), io=24.6MiB (25.8MB), run=28527-29321msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150463: Wed Sep 30 12:22:39 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(5920KiB/41533msec) clat (msec): min=7, max=224, avg=44.77, stdev=35.19 lat (msec): min=7, max=224, avg=44.77, stdev=35.19 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 65], 90.00th=[ 95], 95.00th=[ 123], | 99.00th=[ 171], 99.50th=[ 203], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 384, per=24.67%, avg=141.85, stdev=75.44, samples=82 iops : min= 1, max= 24, avg= 8.05, stdev= 4.81, samples=82 write: IOPS=9, BW=153KiB/s (157kB/s)(6368KiB/41533msec); 0 zone resets clat (msec): min=15, max=249, avg=62.06, stdev=38.90 lat (msec): min=15, max=249, avg=62.06, stdev=38.90 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 201], 99.50th=[ 239], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 31, max= 405, per=25.56%, avg=154.67, stdev=80.09, samples=81 iops : min= 1, max= 25, avg= 8.85, stdev= 5.10, samples=81 lat (msec) : 10=0.39%, 20=11.46%, 50=47.66%, 100=28.65%, 250=11.85% cpu : usr=0.06%, sys=1.97%, ctx=1216, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150464: Wed Sep 30 12:22:39 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5744KiB/41598msec) clat (msec): min=5, max=203, avg=43.04, stdev=35.58 lat (msec): min=5, max=203, avg=43.04, stdev=35.58 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 92], 95.00th=[ 122], | 99.00th=[ 184], 99.50th=[ 203], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 29, max= 405, per=24.16%, avg=138.94, stdev=95.24, samples=81 iops : min= 1, max= 25, avg= 7.86, stdev= 6.02, samples=81 write: IOPS=9, BW=157KiB/s (161kB/s)(6544KiB/41598msec); 0 zone resets clat (msec): min=13, max=273, avg=62.94, stdev=37.50 lat (msec): min=13, max=273, avg=62.94, stdev=37.50 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 113], 95.00th=[ 140], | 99.00th=[ 182], 99.50th=[ 190], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 29, max= 374, per=25.95%, avg=156.99, stdev=80.14, samples=82 iops : min= 1, max= 23, avg= 9.00, stdev= 5.11, samples=82 lat (msec) : 10=1.30%, 20=12.37%, 50=45.57%, 100=29.17%, 250=11.46% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.94%, ctx=1201, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150465: Wed Sep 30 12:22:39 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6256KiB/41361msec) clat (msec): min=8, max=265, avg=42.21, stdev=33.51 lat (msec): min=8, max=265, avg=42.21, stdev=33.50 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 88], 95.00th=[ 113], | 99.00th=[ 165], 99.50th=[ 209], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 416, per=26.47%, avg=152.22, stdev=94.12, samples=81 iops : min= 1, max= 26, avg= 8.70, stdev= 5.96, samples=81 write: IOPS=9, BW=146KiB/s (149kB/s)(6032KiB/41361msec); 0 zone resets clat (msec): min=14, max=275, avg=65.77, stdev=41.15 lat (msec): min=14, max=275, avg=65.77, stdev=41.15 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 77], 80.00th=[ 100], 90.00th=[ 127], 95.00th=[ 150], | 99.00th=[ 192], 99.50th=[ 253], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 383, per=23.93%, avg=144.78, stdev=74.11, samples=81 iops : min= 1, max= 23, avg= 8.23, stdev= 4.72, samples=81 lat (msec) : 10=0.91%, 20=11.59%, 50=48.70%, 100=25.78%, 250=12.63% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.92%, ctx=1208, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150466: Wed Sep 30 12:22:39 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6032KiB/41536msec) clat (msec): min=7, max=261, avg=43.38, stdev=35.93 lat (msec): min=7, max=261, avg=43.38, stdev=35.93 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 59], 90.00th=[ 91], 95.00th=[ 114], | 99.00th=[ 194], 99.50th=[ 207], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 352, per=25.64%, avg=147.41, stdev=75.44, samples=80 iops : min= 1, max= 22, avg= 8.40, stdev= 4.79, samples=80 write: IOPS=9, BW=151KiB/s (154kB/s)(6256KiB/41536msec); 0 zone resets clat (msec): min=12, max=238, avg=63.51, stdev=37.46 lat (msec): min=12, max=238, avg=63.51, stdev=37.46 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 91], 90.00th=[ 116], 95.00th=[ 138], | 99.00th=[ 190], 99.50th=[ 207], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 30, max= 416, per=25.24%, avg=152.70, stdev=81.04, samples=81 iops : min= 1, max= 26, avg= 8.73, stdev= 5.17, samples=81 lat (msec) : 10=0.91%, 20=11.72%, 50=48.44%, 100=26.43%, 250=12.37% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.94%, ctx=1235, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=576KiB/s (590kB/s), 138KiB/s-151KiB/s (141kB/s-155kB/s), io=23.4MiB (24.5MB), run=41361-41598msec WRITE: bw=606KiB/s (620kB/s), 146KiB/s-157KiB/s (149kB/s-161kB/s), io=24.6MiB (25.8MB), run=41361-41598msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150479: Wed Sep 30 12:22:53 2026 read: IOPS=2, BW=2704KiB/s (2769kB/s)(7168KiB/2651msec) clat (usec): min=491, max=336607, avg=174921.22, stdev=124398.10 lat (usec): min=492, max=336608, avg=174922.60, stdev=124398.21 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 11469], | 30.00th=[202376], 40.00th=[202376], 50.00th=[204473], 60.00th=[212861], | 70.00th=[212861], 80.00th=[254804], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 2027, max= 4047, per=57.82%, avg=2746.25, stdev=951.95, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1931KiB/s (1978kB/s)(5120KiB/2651msec); 0 zone resets clat (msec): min=162, max=558, avg=276.42, stdev=163.16 lat (msec): min=162, max=558, avg=276.53, stdev=163.12 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2023, max= 4055, per=40.71%, avg=2707.00, stdev=1167.45, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 20=8.33%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.04%, sys=15.13%, ctx=180, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150480: Wed Sep 30 12:22:53 2026 read: IOPS=0, BW=475KiB/s (486kB/s)(2048KiB/4311msec) clat (usec): min=435, max=414484, avg=207460.27, stdev=292776.85 lat (usec): min=436, max=414485, avg=207461.21, stdev=292776.95 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 437], 10.00th=[ 437], 20.00th=[ 437], | 30.00th=[ 437], 40.00th=[ 437], 50.00th=[ 437], 60.00th=[413139], | 70.00th=[413139], 80.00th=[413139], 90.00th=[413139], 95.00th=[413139], | 99.00th=[413139], 99.50th=[413139], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 2015, max= 2023, per=42.51%, avg=2019.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2375KiB/s (2432kB/s)(10.0MiB/4311msec); 0 zone resets clat (msec): min=128, max=721, avg=354.10, stdev=183.31 lat (msec): min=128, max=721, avg=354.22, stdev=183.27 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 180], | 30.00th=[ 207], 40.00th=[ 275], 50.00th=[ 296], 60.00th=[ 334], | 70.00th=[ 405], 80.00th=[ 422], 90.00th=[ 575], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2027, max= 6047, per=54.76%, avg=3641.40, stdev=1682.61, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.02%, sys=13.20%, ctx=156, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150481: Wed Sep 30 12:22:53 2026 read: IOPS=2, BW=2372KiB/s (2429kB/s)(6144KiB/2590msec) clat (usec): min=416, max=269393, avg=90446.97, stdev=116602.28 lat (usec): min=417, max=269394, avg=90448.11, stdev=116602.16 clat percentiles (usec): | 1.00th=[ 416], 5.00th=[ 416], 10.00th=[ 416], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 619], 50.00th=[ 619], 60.00th=[ 73925], | 70.00th=[198181], 80.00th=[198181], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 4055, max= 4087, per=85.71%, avg=4071.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2372KiB/s (2429kB/s)(6144KiB/2590msec); 0 zone resets clat (msec): min=163, max=520, avg=322.11, stdev=145.05 lat (msec): min=163, max=520, avg=322.17, stdev=145.05 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 384], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1523, max= 2043, per=28.63%, avg=1904.00, stdev=254.15, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.08%, sys=13.83%, ctx=180, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150484: Wed Sep 30 12:22:53 2026 read: IOPS=1, BW=1777KiB/s (1819kB/s)(5120KiB/2882msec) clat (usec): min=385, max=262935, avg=53428.08, stdev=117121.46 lat (usec): min=386, max=262936, avg=53429.15, stdev=117121.53 clat percentiles (usec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 461], 40.00th=[ 461], 50.00th=[ 857], 60.00th=[ 857], | 70.00th=[ 2507], 80.00th=[ 2507], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2487KiB/s (2547kB/s)(7168KiB/2882msec); 0 zone resets clat (msec): min=157, max=631, avg=366.88, stdev=161.51 lat (msec): min=157, max=631, avg=366.96, stdev=161.49 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 255], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 363], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 514], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2027, max= 4047, per=38.21%, avg=2541.25, stdev=1003.87, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=16.67%, 1000=8.33% lat (msec) : 4=8.33%, 250=8.33%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=12.77%, ctx=117, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4751KiB/s (4865kB/s), 475KiB/s-2704KiB/s (486kB/s-2769kB/s), io=20.0MiB (20.0MB), run=2590-4311msec WRITE: bw=6651KiB/s (6811kB/s), 1931KiB/s-2487KiB/s (1978kB/s-2547kB/s), io=28.0MiB (29.4MB), run=2590-4311msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150482: Wed Sep 30 12:22:54 2026 read: IOPS=1, BW=1681KiB/s (1721kB/s)(7168KiB/4265msec) clat (msec): min=156, max=755, avg=320.46, stdev=202.44 lat (msec): min=156, max=755, avg=320.46, stdev=202.44 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 192], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 292], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 338], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2043, max= 3992, per=70.67%, avg=2971.67, stdev=977.73, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1200KiB/s (1229kB/s)(5120KiB/4265msec); 0 zone resets clat (msec): min=231, max=808, avg=388.95, stdev=240.73 lat (msec): min=231, max=808, avg=389.03, stdev=240.73 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1992, max= 4023, per=45.65%, avg=2687.67, stdev=1156.77, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=41.67%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=5.14%, ctx=122, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150483: Wed Sep 30 12:22:54 2026 read: IOPS=0, BW=445KiB/s (455kB/s)(2048KiB/4606msec) clat (msec): min=250, max=555, avg=403.13, stdev=215.68 lat (msec): min=250, max=555, avg=403.13, stdev=215.68 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1535, max= 2011, per=42.16%, avg=1773.00, stdev=336.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2223KiB/s (2277kB/s)(10.0MiB/4606msec); 0 zone resets clat (msec): min=189, max=525, avg=352.80, stdev=101.11 lat (msec): min=189, max=525, avg=353.13, stdev=101.22 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 241], | 30.00th=[ 271], 40.00th=[ 330], 50.00th=[ 355], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 418], 90.00th=[ 456], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1861, max= 4096, per=45.36%, avg=2670.50, stdev=1066.45, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 250=16.67%, 500=66.67%, 750=16.67% cpu : usr=0.00%, sys=4.56%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150485: Wed Sep 30 12:22:54 2026 read: IOPS=1, BW=1446KiB/s (1481kB/s)(6144KiB/4249msec) clat (msec): min=104, max=578, avg=308.63, stdev=205.43 lat (msec): min=104, max=578, avg=308.63, stdev=205.43 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 224], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1861, max= 2048, per=47.06%, avg=1979.00, stdev=81.65, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1446KiB/s (1481kB/s)(6144KiB/4249msec); 0 zone resets clat (msec): min=145, max=774, avg=357.70, stdev=229.34 lat (msec): min=145, max=774, avg=357.77, stdev=229.33 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 376], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1424, max= 2048, per=31.84%, avg=1874.40, stdev=262.86, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=4.38%, ctx=96, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150486: Wed Sep 30 12:22:54 2026 read: IOPS=1, BW=1051KiB/s (1077kB/s)(5120KiB/4870msec) clat (msec): min=81, max=437, avg=197.44, stdev=145.99 lat (msec): min=81, max=437, avg=197.44, stdev=145.99 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 123], 60.00th=[ 123], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 2048, max= 4079, per=64.80%, avg=2725.00, stdev=1172.60, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 write: IOPS=1, BW=1472KiB/s (1507kB/s)(7168KiB/4870msec); 0 zone resets clat (msec): min=88, max=1151, avg=515.61, stdev=437.86 lat (msec): min=88, max=1151, avg=515.69, stdev=437.86 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 94], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 430], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 860], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1861, max= 4096, per=40.97%, avg=2411.80, stdev=944.58, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.02%, sys=4.09%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4205KiB/s (4306kB/s), 445KiB/s-1681KiB/s (455kB/s-1721kB/s), io=20.0MiB (20.0MB), run=4249-4870msec WRITE: bw=5887KiB/s (6029kB/s), 1200KiB/s-2223KiB/s (1229kB/s-2277kB/s), io=28.0MiB (29.4MB), run=4249-4870msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150497: Wed Sep 30 12:23:09 2026 read: IOPS=1, BW=4793KiB/s (4908kB/s)(12.0MiB/2564msec) clat (msec): min=795, max=886, avg=833.88, stdev=47.27 lat (msec): min=795, max=886, avg=833.88, stdev=47.27 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7937, max= 8192, per=100.00%, avg=8064.50, stdev=180.31, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.40%, ctx=267, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150498: Wed Sep 30 12:23:09 2026 read: IOPS=0, BW=1212KiB/s (1241kB/s)(4096KiB/3380msec) clat (nsec): min=613829k, max=613829k, avg=613829324.00, stdev= 0.00 lat (nsec): min=613832k, max=613832k, avg=613832466.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 5618, max= 5618, per=100.00%, avg=5618.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2424KiB/s (2482kB/s)(8192KiB/3380msec); 0 zone resets clat (msec): min=1219, max=1495, avg=1357.63, stdev=195.29 lat (msec): min=1220, max=1496, avg=1358.14, stdev=195.13 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8126, max= 8126, per=87.29%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.20%, ctx=87, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150499: Wed Sep 30 12:23:09 2026 write: IOPS=0, BW=3491KiB/s (3575kB/s)(12.0MiB/3520msec); 0 zone resets clat (msec): min=324, max=1764, avg=1138.20, stdev=737.84 lat (msec): min=325, max=1766, avg=1139.07, stdev=738.46 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 7937, max= 7937, per=85.26%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.04%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150500: Wed Sep 30 12:23:09 2026 write: IOPS=0, BW=3770KiB/s (3861kB/s)(12.0MiB/3259msec); 0 zone resets clat (msec): min=321, max=1427, avg=1008.54, stdev=599.63 lat (msec): min=325, max=1428, avg=1010.06, stdev=597.99 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8143, max= 8192, per=87.74%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.68%, ctx=36, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4847KiB/s (4964kB/s), 1212KiB/s-4793KiB/s (1241kB/s-4908kB/s), io=16.0MiB (16.8MB), run=2564-3380msec WRITE: bw=9309KiB/s (9533kB/s), 2424KiB/s-3770KiB/s (2482kB/s-3861kB/s), io=32.0MiB (33.6MB), run=3259-3520msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150492: Wed Sep 30 12:23:09 2026 read: IOPS=1, BW=4188KiB/s (4289kB/s)(12.0MiB/2934msec) clat (msec): min=439, max=1420, avg=932.44, stdev=490.66 lat (msec): min=439, max=1420, avg=932.44, stdev=490.66 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.65%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150493: Wed Sep 30 12:23:09 2026 read: IOPS=0, BW=1345KiB/s (1377kB/s)(4096KiB/3046msec) clat (nsec): min=417929k, max=417929k, avg=417928707.00, stdev= 0.00 lat (nsec): min=417931k, max=417931k, avg=417931253.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7728, max= 7728, per=100.00%, avg=7728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2689KiB/s (2754kB/s)(8192KiB/3046msec); 0 zone resets clat (msec): min=779, max=1762, avg=1271.21, stdev=695.04 lat (msec): min=780, max=1762, avg=1271.46, stdev=694.93 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 1770], | 70.00th=[ 1770], 80.00th=[ 1770], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.60%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150495: Wed Sep 30 12:23:09 2026 write: IOPS=0, BW=2881KiB/s (2950kB/s)(12.0MiB/4265msec); 0 zone resets clat (msec): min=213, max=2866, avg=1391.91, stdev=1350.80 lat (msec): min=214, max=2866, avg=1392.46, stdev=1350.75 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=4.22%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150496: Wed Sep 30 12:23:09 2026 write: IOPS=1, BW=4318KiB/s (4421kB/s)(12.0MiB/2846msec); 0 zone resets clat (msec): min=294, max=2124, avg=932.68, stdev=1032.94 lat (msec): min=295, max=2126, avg=933.69, stdev=1033.43 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min=11145, max=11145, per=100.00%, avg=11145.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.64%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5379KiB/s (5508kB/s), 1345KiB/s-4188KiB/s (1377kB/s-4289kB/s), io=16.0MiB (16.8MB), run=2934-3046msec WRITE: bw=7683KiB/s (7867kB/s), 2689KiB/s-4318KiB/s (2754kB/s-4421kB/s), io=32.0MiB (33.6MB), run=2846-4265msec