== sanity test 398b: DIO and buffer IO race ============== 09:55:53 (1788875753) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.05955 s, 9.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178976: Tue Sep 8 09:58:09 2026 read: IOPS=12, BW=50.2KiB/s (51.4kB/s)(5992KiB/119459msec) clat (usec): min=45, max=937735, avg=43909.41, stdev=36980.92 lat (usec): min=46, max=937738, avg=43912.81, stdev=36981.85 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10421], 10.00th=[ 15795], 20.00th=[ 21890], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 94897], | 99.00th=[147850], 99.50th=[175113], 99.90th=[295699], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 103, per=25.11%, avg=50.21, stdev=18.47, samples=233 iops : min= 1, max= 25, avg=11.89, stdev= 4.66, samples=233 write: IOPS=13, BW=52.7KiB/s (53.0kB/s)(6296KiB/119459msec); 0 zone resets clat (usec): min=993, max=246285, avg=33847.50, stdev=33648.57 lat (usec): min=994, max=246286, avg=33855.00, stdev=33647.67 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1958], 20.00th=[ 4113], | 30.00th=[ 8979], 40.00th=[ 16712], 50.00th=[ 26084], 60.00th=[ 33424], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[158335], 99.50th=[173016], 99.90th=[223347], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 125, per=25.02%, avg=52.54, stdev=22.12, samples=234 iops : min= 1, max= 31, avg=12.47, stdev= 5.58, samples=234 lat (usec) : 50=0.10%, 100=1.50%, 250=0.29%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.37%, 4=4.46%, 10=6.67%, 20=11.43%, 50=41.96% lat (msec) : 100=23.60%, 250=4.33%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.29%, ctx=6708, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178977: Tue Sep 8 09:58:09 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(5940KiB/119711msec) clat (usec): min=40, max=897360, avg=44741.73, stdev=37006.36 lat (usec): min=40, max=897362, avg=44743.43, stdev=37006.51 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11600], 10.00th=[ 16712], 20.00th=[ 22676], | 30.00th=[ 27395], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[154141], 99.50th=[179307], 99.90th=[229639], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 103, per=24.74%, avg=49.49, stdev=17.99, samples=234 iops : min= 1, max= 25, avg=11.71, stdev= 4.53, samples=234 write: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6348KiB/119711msec); 0 zone resets clat (usec): min=966, max=294761, avg=33323.13, stdev=34853.95 lat (usec): min=966, max=294763, avg=33328.97, stdev=34856.46 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1352], 10.00th=[ 1991], 20.00th=[ 4015], | 30.00th=[ 6980], 40.00th=[ 15533], 50.00th=[ 23462], 60.00th=[ 32113], | 70.00th=[ 43254], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[179307], 99.90th=[263193], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 127, per=25.13%, avg=52.78, stdev=22.45, samples=234 iops : min= 1, max= 31, avg=12.53, stdev= 5.67, samples=234 lat (usec) : 50=0.20%, 100=1.07%, 250=0.23%, 500=0.10%, 1000=0.07% lat (msec) : 2=5.24%, 4=5.11%, 10=7.94%, 20=11.26%, 50=40.36% lat (msec) : 100=23.80%, 250=4.52%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.31%, ctx=6743, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178978: Tue Sep 8 09:58:09 2026 read: IOPS=12, BW=51.0KiB/s (52.2kB/s)(6028KiB/118154msec) clat (usec): min=34, max=233994, avg=41793.36, stdev=27267.11 lat (usec): min=34, max=233995, avg=41804.50, stdev=27276.64 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9634], 10.00th=[ 16188], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 31065], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[141558], 99.50th=[173016], 99.90th=[231736], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 111, per=25.42%, avg=50.84, stdev=19.31, samples=231 iops : min= 1, max= 27, avg=12.04, stdev= 4.85, samples=231 write: IOPS=13, BW=52.0KiB/s (54.3kB/s)(6260KiB/118154msec); 0 zone resets clat (usec): min=986, max=943283, avg=35005.75, stdev=42058.40 lat (usec): min=987, max=943284, avg=35008.62, stdev=42059.37 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1303], 10.00th=[ 1844], 20.00th=[ 3752], | 30.00th=[ 7701], 40.00th=[ 16450], 50.00th=[ 25297], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 59507], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[147850], 99.50th=[170918], 99.90th=[337642], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 144, per=24.97%, avg=52.43, stdev=20.60, samples=232 iops : min= 1, max= 36, avg=12.44, stdev= 5.21, samples=232 lat (usec) : 50=0.16%, 100=1.53%, 250=0.13%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=5.57%, 4=5.08%, 10=6.97%, 20=10.97%, 50=41.67% lat (msec) : 100=23.27%, 250=4.39%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.43%, ctx=6716, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178979: Tue Sep 8 09:58:09 2026 read: IOPS=12, BW=51.6KiB/s (52.8kB/s)(6052KiB/117373msec) clat (usec): min=40, max=213116, avg=42445.49, stdev=27422.26 lat (usec): min=41, max=213117, avg=42448.94, stdev=27421.90 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11338], 10.00th=[ 15795], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 30278], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[135267], 99.50th=[154141], 99.90th=[202376], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 103, per=25.92%, avg=51.85, stdev=18.94, samples=228 iops : min= 1, max= 25, avg=12.30, stdev= 4.77, samples=228 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6236KiB/117373msec); 0 zone resets clat (usec): min=977, max=923640, avg=33845.34, stdev=40915.42 lat (usec): min=978, max=923644, avg=33850.60, stdev=40919.22 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1762], 20.00th=[ 3851], | 30.00th=[ 6849], 40.00th=[ 14222], 50.00th=[ 23987], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[147850], 99.50th=[168821], 99.90th=[214959], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 124, per=25.22%, avg=52.96, stdev=20.26, samples=230 iops : min= 1, max= 31, avg=12.58, stdev= 5.09, samples=230 lat (usec) : 50=0.13%, 100=1.56%, 250=0.26%, 500=0.10%, 1000=0.07% lat (msec) : 2=5.50%, 4=5.05%, 10=7.32%, 20=11.85%, 50=40.01% lat (msec) : 100=23.54%, 250=4.59%, 1000=0.03% cpu : usr=0.08%, sys=5.31%, ctx=6530, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=201KiB/s (205kB/s), 49.6KiB/s-51.6KiB/s (50.8kB/s-52.8kB/s), io=23.4MiB (24.6MB), run=117373-119711msec WRITE: bw=210KiB/s (215kB/s), 52.7KiB/s-53.1KiB/s (53.0kB/s-54.4kB/s), io=24.6MiB (25.7MB), run=117373-119711msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178971: Tue Sep 8 09:58:41 2026 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(5992KiB/152554msec) clat (msec): min=6, max=969, avg=39.23, stdev=43.05 lat (msec): min=6, max=969, avg=39.23, stdev=43.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 41], 80.00th=[ 58], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 174], 99.50th=[ 190], 99.90th=[ 253], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 127, per=25.39%, avg=39.87, stdev=28.28, samples=293 iops : min= 1, max= 31, avg= 9.32, stdev= 7.10, samples=293 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6296KiB/152554msec); 0 zone resets clat (msec): min=10, max=376, avg=59.35, stdev=44.89 lat (msec): min=10, max=376, avg=59.36, stdev=44.89 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 70], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 146], | 99.00th=[ 226], 99.50th=[ 259], 99.90th=[ 359], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 135, per=25.19%, avg=41.32, stdev=27.10, samples=297 iops : min= 1, max= 33, avg= 9.69, stdev= 6.81, samples=297 lat (msec) : 10=3.22%, 20=18.65%, 50=44.34%, 100=21.88%, 250=11.56% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.85%, ctx=4914, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178972: Tue Sep 8 09:58:41 2026 read: IOPS=9, BW=39.2KiB/s (40.2kB/s)(5940KiB/151410msec) clat (msec): min=5, max=946, avg=39.10, stdev=43.19 lat (msec): min=5, max=946, avg=39.10, stdev=43.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 57], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 184], 99.50th=[ 218], 99.90th=[ 305], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 151, per=25.42%, avg=39.91, stdev=29.15, samples=291 iops : min= 1, max= 37, avg= 9.33, stdev= 7.32, samples=291 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6348KiB/151410msec); 0 zone resets clat (msec): min=11, max=370, avg=58.57, stdev=42.84 lat (msec): min=11, max=370, avg=58.57, stdev=42.84 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 89], 90.00th=[ 116], 95.00th=[ 148], | 99.00th=[ 220], 99.50th=[ 243], 99.90th=[ 264], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 142, per=25.56%, avg=41.92, stdev=27.28, samples=296 iops : min= 1, max= 35, avg= 9.84, stdev= 6.86, samples=296 lat (msec) : 10=3.68%, 20=18.49%, 50=44.08%, 100=22.14%, 250=11.36% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.05%, sys=1.90%, ctx=4857, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178973: Tue Sep 8 09:58:41 2026 read: IOPS=9, BW=39.6KiB/s (40.5kB/s)(6028KiB/152376msec) clat (msec): min=5, max=309, avg=40.31, stdev=39.50 lat (msec): min=5, max=309, avg=40.31, stdev=39.50 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 93], 95.00th=[ 122], | 99.00th=[ 194], 99.50th=[ 218], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 135, per=25.32%, avg=39.74, stdev=27.78, samples=294 iops : min= 1, max= 33, avg= 9.30, stdev= 6.99, samples=294 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6260KiB/152376msec); 0 zone resets clat (msec): min=8, max=959, avg=58.30, stdev=48.01 lat (msec): min=8, max=959, avg=58.31, stdev=48.01 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 89], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 201], 99.50th=[ 234], 99.90th=[ 372], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 143, per=25.17%, avg=41.28, stdev=28.33, samples=294 iops : min= 1, max= 35, avg= 9.68, stdev= 7.11, samples=294 lat (msec) : 10=3.32%, 20=20.12%, 50=42.61%, 100=22.53%, 250=11.00% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.07%, sys=1.87%, ctx=4805, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178974: Tue Sep 8 09:58:41 2026 read: IOPS=9, BW=39.0KiB/s (40.9kB/s)(6052KiB/151471msec) clat (msec): min=5, max=288, avg=40.03, stdev=37.38 lat (msec): min=5, max=288, avg=40.03, stdev=37.38 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 44], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 121], | 99.00th=[ 180], 99.50th=[ 209], 99.90th=[ 259], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 136, per=25.78%, avg=40.48, stdev=28.47, samples=292 iops : min= 1, max= 34, avg= 9.47, stdev= 7.14, samples=292 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6236KiB/151471msec); 0 zone resets clat (msec): min=9, max=965, avg=58.05, stdev=47.76 lat (msec): min=9, max=965, avg=58.06, stdev=47.76 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 113], 95.00th=[ 136], | 99.00th=[ 205], 99.50th=[ 288], 99.90th=[ 338], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 134, per=24.99%, avg=40.98, stdev=26.80, samples=297 iops : min= 1, max= 33, avg= 9.60, stdev= 6.74, samples=297 lat (msec) : 10=3.06%, 20=20.18%, 50=42.35%, 100=23.24%, 250=10.77% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.05%, sys=1.90%, ctx=4876, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=157KiB/s (161kB/s), 39.2KiB/s-39.0KiB/s (40.2kB/s-40.9kB/s), io=23.4MiB (24.6MB), run=151410-152554msec WRITE: bw=165KiB/s (169kB/s), 41.1KiB/s-41.9KiB/s (42.1kB/s-42.9kB/s), io=24.6MiB (25.7MB), run=151410-152554msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179016: Tue Sep 8 09:59:14 2026 read: IOPS=16, BW=256KiB/s (262kB/s)(5920KiB/23096msec) clat (usec): min=32, max=123380, avg=32558.44, stdev=19691.13 lat (usec): min=32, max=123382, avg=32566.96, stdev=19689.52 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 67], 10.00th=[ 223], 20.00th=[ 18744], | 30.00th=[ 23462], 40.00th=[ 27132], 50.00th=[ 30540], 60.00th=[ 34341], | 70.00th=[ 40109], 80.00th=[ 45351], 90.00th=[ 55313], 95.00th=[ 66847], | 99.00th=[ 93848], 99.50th=[100140], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 127, max= 479, per=25.44%, avg=256.91, stdev=79.78, samples=45 iops : min= 7, max= 29, avg=15.36, stdev= 5.04, samples=45 write: IOPS=17, BW=276KiB/s (282kB/s)(6368KiB/23096msec); 0 zone resets clat (usec): min=1692, max=125697, avg=27607.02, stdev=24437.94 lat (usec): min=1694, max=125698, avg=27610.15, stdev=24438.90 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2769], 10.00th=[ 3818], 20.00th=[ 6259], | 30.00th=[ 9634], 40.00th=[ 15533], 50.00th=[ 20579], 60.00th=[ 27919], | 70.00th=[ 34866], 80.00th=[ 44303], 90.00th=[ 62653], 95.00th=[ 81265], | 99.00th=[100140], 99.50th=[125305], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 126, max= 438, per=26.17%, avg=277.93, stdev=68.77, samples=45 iops : min= 7, max= 27, avg=16.69, stdev= 4.43, samples=45 lat (usec) : 50=0.78%, 100=3.26%, 250=0.78%, 750=0.13% lat (msec) : 2=1.04%, 4=5.08%, 10=10.29%, 20=14.97%, 50=47.79% lat (msec) : 100=15.23%, 250=0.65% cpu : usr=0.08%, sys=9.20%, ctx=1862, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179017: Tue Sep 8 09:59:14 2026 read: IOPS=15, BW=248KiB/s (254kB/s)(5744KiB/23118msec) clat (usec): min=40, max=115388, avg=34053.06, stdev=20980.10 lat (usec): min=40, max=115389, avg=34054.98, stdev=20979.66 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 76], 10.00th=[ 914], 20.00th=[ 18744], | 30.00th=[ 23725], 40.00th=[ 27919], 50.00th=[ 31851], 60.00th=[ 35914], | 70.00th=[ 41681], 80.00th=[ 47449], 90.00th=[ 62653], 95.00th=[ 70779], | 99.00th=[105382], 99.50th=[108528], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 126, max= 381, per=24.54%, avg=247.89, stdev=67.01, samples=45 iops : min= 7, max= 23, avg=14.78, stdev= 4.14, samples=45 write: IOPS=17, BW=283KiB/s (290kB/s)(6544KiB/23118msec); 0 zone resets clat (usec): min=1597, max=130227, avg=26344.56, stdev=24562.45 lat (usec): min=1599, max=130229, avg=26367.29, stdev=24566.12 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2704], 10.00th=[ 3490], 20.00th=[ 5735], | 30.00th=[ 8291], 40.00th=[ 12911], 50.00th=[ 18220], 60.00th=[ 25822], | 70.00th=[ 33162], 80.00th=[ 44303], 90.00th=[ 64226], 95.00th=[ 77071], | 99.00th=[105382], 99.50th=[107480], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 127, max= 444, per=26.37%, avg=280.07, stdev=79.33, samples=45 iops : min= 7, max= 27, avg=16.82, stdev= 5.07, samples=45 lat (usec) : 50=0.26%, 100=3.12%, 250=0.91%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.04%, 4=4.82%, 10=13.41%, 20=14.45%, 50=43.88% lat (msec) : 100=16.41%, 250=1.30% cpu : usr=0.11%, sys=9.01%, ctx=1808, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179018: Tue Sep 8 09:59:14 2026 read: IOPS=16, BW=264KiB/s (270kB/s)(6256KiB/23708msec) clat (usec): min=52, max=112352, avg=33355.41, stdev=20173.16 lat (usec): min=53, max=112354, avg=33356.51, stdev=20173.17 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 90], 10.00th=[ 10683], 20.00th=[ 18744], | 30.00th=[ 23200], 40.00th=[ 27395], 50.00th=[ 31327], 60.00th=[ 34866], | 70.00th=[ 40633], 80.00th=[ 46924], 90.00th=[ 57934], 95.00th=[ 68682], | 99.00th=[103285], 99.50th=[105382], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 94, max= 383, per=26.01%, avg=262.67, stdev=76.50, samples=46 iops : min= 5, max= 23, avg=15.70, stdev= 4.79, samples=46 write: IOPS=15, BW=254KiB/s (261kB/s)(6032KiB/23708msec); 0 zone resets clat (usec): min=1627, max=168147, avg=27962.82, stdev=26647.97 lat (usec): min=1630, max=168150, avg=27979.28, stdev=26645.98 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2769], 10.00th=[ 3654], 20.00th=[ 5276], | 30.00th=[ 8356], 40.00th=[ 13829], 50.00th=[ 20841], 60.00th=[ 28967], | 70.00th=[ 34866], 80.00th=[ 45876], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[131597], 99.50th=[145753], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 93, max= 479, per=23.48%, avg=249.39, stdev=91.44, samples=46 iops : min= 5, max= 29, avg=14.87, stdev= 5.74, samples=46 lat (usec) : 100=2.86%, 250=1.17%, 500=0.26%, 750=0.13% lat (msec) : 2=1.43%, 4=4.69%, 10=11.20%, 20=13.93%, 50=47.14% lat (msec) : 100=15.49%, 250=1.69% cpu : usr=0.09%, sys=8.87%, ctx=1939, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179019: Tue Sep 8 09:59:14 2026 read: IOPS=16, BW=266KiB/s (273kB/s)(6032KiB/22666msec) clat (usec): min=40, max=124198, avg=32581.57, stdev=20978.96 lat (usec): min=40, max=124199, avg=32616.23, stdev=20965.95 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 184], 20.00th=[ 17957], | 30.00th=[ 21890], 40.00th=[ 25822], 50.00th=[ 29754], 60.00th=[ 35914], | 70.00th=[ 41681], 80.00th=[ 47449], 90.00th=[ 57410], 95.00th=[ 69731], | 99.00th=[ 99091], 99.50th=[119014], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 127, max= 445, per=26.31%, avg=265.77, stdev=80.50, samples=44 iops : min= 7, max= 27, avg=15.91, stdev= 5.06, samples=44 write: IOPS=17, BW=276KiB/s (283kB/s)(6256KiB/22666msec); 0 zone resets clat (usec): min=1627, max=172477, avg=26226.79, stdev=26304.64 lat (usec): min=1629, max=172480, avg=26233.93, stdev=26300.26 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2540], 10.00th=[ 3589], 20.00th=[ 5407], | 30.00th=[ 7701], 40.00th=[ 11207], 50.00th=[ 16909], 60.00th=[ 22414], | 70.00th=[ 32375], 80.00th=[ 42730], 90.00th=[ 66323], 95.00th=[ 79168], | 99.00th=[111674], 99.50th=[124257], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 128, max= 477, per=25.90%, avg=275.07, stdev=75.19, samples=44 iops : min= 8, max= 29, avg=16.50, stdev= 4.69, samples=44 lat (usec) : 50=0.39%, 100=3.39%, 250=1.43%, 500=0.13%, 750=0.13% lat (msec) : 2=1.43%, 4=5.34%, 10=12.76%, 20=16.54%, 50=41.80% lat (msec) : 100=15.23%, 250=1.43% cpu : usr=0.10%, sys=9.06%, ctx=1869, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1010KiB/s (1035kB/s), 248KiB/s-266KiB/s (254kB/s-273kB/s), io=23.4MiB (24.5MB), run=22666-23708msec WRITE: bw=1063KiB/s (1088kB/s), 254KiB/s-283KiB/s (261kB/s-290kB/s), io=24.6MiB (25.8MB), run=22666-23708msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179021: Tue Sep 8 09:59:23 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(5920KiB/32077msec) clat (msec): min=5, max=185, avg=32.25, stdev=26.24 lat (msec): min=5, max=185, avg=32.25, stdev=26.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 40], 90.00th=[ 67], 95.00th=[ 93], | 99.00th=[ 134], 99.50th=[ 167], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 32, max= 446, per=24.93%, avg=185.69, stdev=96.64, samples=62 iops : min= 2, max= 27, avg=10.82, stdev= 6.00, samples=62 write: IOPS=12, BW=199KiB/s (203kB/s)(6368KiB/32077msec); 0 zone resets clat (msec): min=14, max=209, avg=50.44, stdev=32.14 lat (msec): min=14, max=209, avg=50.45, stdev=32.15 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 71], 90.00th=[ 100], 95.00th=[ 120], | 99.00th=[ 155], 99.50th=[ 174], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 415, per=25.22%, avg=197.49, stdev=93.90, samples=63 iops : min= 1, max= 25, avg=11.57, stdev= 5.91, samples=63 lat (msec) : 10=1.04%, 20=20.96%, 50=52.34%, 100=19.27%, 250=6.38% cpu : usr=0.07%, sys=2.78%, ctx=1213, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179022: Tue Sep 8 09:59:23 2026 read: IOPS=11, BW=179KiB/s (183kB/s)(5744KiB/32111msec) clat (msec): min=5, max=189, avg=34.06, stdev=27.52 lat (msec): min=5, max=189, avg=34.06, stdev=27.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 94], | 99.00th=[ 126], 99.50th=[ 171], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 476, per=24.52%, avg=182.69, stdev=109.49, samples=61 iops : min= 1, max= 29, avg=10.64, stdev= 6.88, samples=61 write: IOPS=12, BW=204KiB/s (209kB/s)(6544KiB/32111msec); 0 zone resets clat (msec): min=11, max=204, avg=48.50, stdev=28.51 lat (msec): min=11, max=204, avg=48.51, stdev=28.51 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 68], 90.00th=[ 90], 95.00th=[ 108], | 99.00th=[ 131], 99.50th=[ 148], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 63, max= 505, per=25.79%, avg=201.94, stdev=101.12, samples=63 iops : min= 3, max= 31, avg=11.86, stdev= 6.34, samples=63 lat (msec) : 10=1.82%, 20=18.49%, 50=52.47%, 100=21.61%, 250=5.60% cpu : usr=0.06%, sys=2.88%, ctx=1237, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179023: Tue Sep 8 09:59:23 2026 read: IOPS=12, BW=195KiB/s (199kB/s)(6256KiB/32150msec) clat (msec): min=6, max=183, avg=34.03, stdev=28.20 lat (msec): min=6, max=184, avg=34.03, stdev=28.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 71], 95.00th=[ 100], | 99.00th=[ 142], 99.50th=[ 150], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 542, per=25.95%, avg=193.32, stdev=125.12, samples=63 iops : min= 1, max= 33, avg=11.32, stdev= 7.86, samples=63 write: IOPS=11, BW=188KiB/s (192kB/s)(6032KiB/32150msec); 0 zone resets clat (msec): min=11, max=200, avg=49.83, stdev=29.81 lat (msec): min=11, max=200, avg=49.83, stdev=29.81 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 58], 80.00th=[ 72], 90.00th=[ 91], 95.00th=[ 109], | 99.00th=[ 157], 99.50th=[ 174], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 414, per=23.54%, avg=184.33, stdev=88.99, samples=63 iops : min= 1, max= 25, avg=10.75, stdev= 5.58, samples=63 lat (msec) : 10=1.56%, 20=23.05%, 50=47.40%, 100=22.14%, 250=5.86% cpu : usr=0.08%, sys=2.77%, ctx=1234, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179024: Tue Sep 8 09:59:23 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(6032KiB/31786msec) clat (msec): min=6, max=199, avg=34.79, stdev=26.67 lat (msec): min=6, max=199, avg=34.80, stdev=26.67 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 92], | 99.00th=[ 122], 99.50th=[ 134], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 32, max= 505, per=25.28%, avg=188.37, stdev=102.89, samples=62 iops : min= 2, max= 31, avg=11.00, stdev= 6.43, samples=62 write: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31786msec); 0 zone resets clat (msec): min=13, max=210, avg=47.66, stdev=29.28 lat (msec): min=13, max=210, avg=47.67, stdev=29.28 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 90], 95.00th=[ 108], | 99.00th=[ 150], 99.50th=[ 161], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 476, per=24.91%, avg=195.08, stdev=100.56, samples=62 iops : min= 1, max= 29, avg=11.44, stdev= 6.31, samples=62 lat (msec) : 10=1.04%, 20=20.83%, 50=52.73%, 100=19.92%, 250=5.47% cpu : usr=0.07%, sys=2.78%, ctx=1197, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=745KiB/s (763kB/s), 179KiB/s-195KiB/s (183kB/s-199kB/s), io=23.4MiB (24.5MB), run=31786-32150msec WRITE: bw=784KiB/s (803kB/s), 188KiB/s-204KiB/s (192kB/s-209kB/s), io=24.6MiB (25.8MB), run=31786-32150msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179035: Tue Sep 8 09:59:35 2026 read: IOPS=1, BW=1914KiB/s (1960kB/s)(7168KiB/3745msec) clat (msec): min=94, max=709, avg=285.84, stdev=250.48 lat (msec): min=94, max=709, avg=285.84, stdev=250.48 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 142], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 153], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 584], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1899, max= 5763, per=55.82%, avg=2915.50, stdev=1899.25, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1367KiB/s (1400kB/s)(5120KiB/3745msec); 0 zone resets clat (msec): min=152, max=606, avg=337.16, stdev=182.49 lat (msec): min=152, max=606, avg=337.25, stdev=182.46 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1957, max= 4087, per=34.63%, avg=2532.50, stdev=1037.13, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=4.51%, ctx=88, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179036: Tue Sep 8 09:59:35 2026 read: IOPS=0, BW=522KiB/s (535kB/s)(2048KiB/3921msec) clat (msec): min=90, max=118, avg=104.35, stdev=20.02 lat (msec): min=90, max=118, avg=104.36, stdev=20.02 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 91], 60.00th=[ 120], | 70.00th=[ 120], 80.00th=[ 120], 90.00th=[ 120], 95.00th=[ 120], | 99.00th=[ 120], 99.50th=[ 120], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 1906, max= 1957, per=36.98%, avg=1931.50, stdev=36.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2612KiB/s (2674kB/s)(10.0MiB/3921msec); 0 zone resets clat (msec): min=86, max=843, avg=364.31, stdev=289.86 lat (msec): min=86, max=843, avg=364.41, stdev=289.85 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 121], | 30.00th=[ 122], 40.00th=[ 138], 50.00th=[ 184], 60.00th=[ 292], | 70.00th=[ 498], 80.00th=[ 584], 90.00th=[ 785], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1899, max= 5720, per=35.80%, avg=2617.50, stdev=1521.06, samples=6 iops : min= 1, max= 5, avg= 1.67, stdev= 1.63, samples=6 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=16.67% cpu : usr=0.05%, sys=7.68%, ctx=98, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179037: Tue Sep 8 09:59:35 2026 read: IOPS=1, BW=1752KiB/s (1794kB/s)(6144KiB/3507msec) clat (msec): min=74, max=495, avg=330.92, stdev=176.36 lat (msec): min=74, max=495, avg=330.92, stdev=176.36 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 439], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1899, max= 4087, per=64.29%, avg=3357.67, stdev=1263.24, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1752KiB/s (1794kB/s)(6144KiB/3507msec); 0 zone resets clat (msec): min=104, max=670, avg=246.35, stdev=216.83 lat (msec): min=104, max=670, avg=247.88, stdev=216.24 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 169], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1899, max= 5616, per=39.37%, avg=2878.75, stdev=1825.79, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=6.50%, ctx=101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179038: Tue Sep 8 09:59:35 2026 read: IOPS=1, BW=1668KiB/s (1708kB/s)(5120KiB/3069msec) clat (msec): min=162, max=622, avg=384.22, stdev=189.48 lat (msec): min=162, max=622, avg=384.22, stdev=189.48 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1973, max= 4055, per=51.33%, avg=2681.00, stdev=1190.10, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2336KiB/s (2392kB/s)(7168KiB/3069msec); 0 zone resets clat (msec): min=73, max=362, avg=161.44, stdev=114.96 lat (msec): min=73, max=362, avg=161.62, stdev=114.94 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 84], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 104], 60.00th=[ 136], | 70.00th=[ 136], 80.00th=[ 288], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1899, max= 5520, per=43.06%, avg=3148.67, stdev=2054.63, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=4.69%, ctx=65, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5223KiB/s (5349kB/s), 522KiB/s-1914KiB/s (535kB/s-1960kB/s), io=20.0MiB (20.0MB), run=3069-3921msec WRITE: bw=7312KiB/s (7488kB/s), 1367KiB/s-2612KiB/s (1400kB/s-2674kB/s), io=28.0MiB (29.4MB), run=3069-3921msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179040: Tue Sep 8 09:59:35 2026 read: IOPS=2, BW=2476KiB/s (2535kB/s)(7168KiB/2895msec) clat (usec): min=591, max=565339, avg=183553.64, stdev=183783.06 lat (usec): min=592, max=565340, avg=183554.92, stdev=183782.98 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 47973], | 30.00th=[112722], 40.00th=[112722], 50.00th=[183501], 60.00th=[183501], | 70.00th=[183501], 80.00th=[191890], 90.00th=[566232], 95.00th=[566232], | 99.00th=[566232], 99.50th=[566232], 99.90th=[566232], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 1899, max= 4987, per=62.82%, avg=3600.33, stdev=1567.86, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1769KiB/s (1811kB/s)(5120KiB/2895msec); 0 zone resets clat (msec): min=184, max=393, avg=321.64, stdev=84.42 lat (msec): min=184, max=393, avg=321.73, stdev=84.43 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 326], 60.00th=[ 326], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2023, max= 3799, per=32.67%, avg=2621.67, stdev=1019.65, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=21.46%, ctx=239, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179041: Tue Sep 8 09:59:35 2026 read: IOPS=0, BW=573KiB/s (587kB/s)(2048KiB/3573msec) clat (msec): min=3, max=584, avg=293.78, stdev=410.79 lat (msec): min=3, max=584, avg=293.78, stdev=410.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 4], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1899, max= 2023, per=34.22%, avg=1961.00, stdev=87.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2866KiB/s (2935kB/s)(10.0MiB/3573msec); 0 zone resets clat (msec): min=122, max=457, avg=297.25, stdev=125.27 lat (msec): min=122, max=457, avg=297.46, stdev=125.30 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 153], | 30.00th=[ 169], 40.00th=[ 211], 50.00th=[ 309], 60.00th=[ 330], | 70.00th=[ 384], 80.00th=[ 401], 90.00th=[ 439], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1957, max= 4047, per=34.62%, avg=2777.80, stdev=1049.68, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 4=8.33%, 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=20.69%, ctx=226, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179042: Tue Sep 8 09:59:35 2026 read: IOPS=1, BW=1955KiB/s (2002kB/s)(6144KiB/3143msec) clat (usec): min=395, max=363085, avg=112773.02, stdev=135856.19 lat (usec): min=396, max=363087, avg=112774.24, stdev=135856.35 clat percentiles (usec): | 1.00th=[ 396], 5.00th=[ 396], 10.00th=[ 396], 20.00th=[ 1123], | 30.00th=[ 1123], 40.00th=[ 61604], 50.00th=[ 61604], 60.00th=[ 96994], | 70.00th=[154141], 80.00th=[154141], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 1899, max= 4087, per=57.59%, avg=3300.33, stdev=1216.63, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1955KiB/s (2002kB/s)(6144KiB/3143msec); 0 zone resets clat (msec): min=158, max=676, avg=410.13, stdev=190.39 lat (msec): min=158, max=676, avg=410.20, stdev=190.42 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 481], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1796, max= 4087, per=29.68%, avg=2381.20, stdev=958.49, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=18.05%, ctx=170, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179043: Tue Sep 8 09:59:35 2026 read: IOPS=1, BW=1884KiB/s (1930kB/s)(5120KiB/2717msec) clat (usec): min=420, max=217626, avg=43984.07, stdev=97069.27 lat (usec): min=421, max=217628, avg=43985.03, stdev=97069.47 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 420], | 30.00th=[ 490], 40.00th=[ 490], 50.00th=[ 594], 60.00th=[ 594], | 70.00th=[ 791], 80.00th=[ 791], 90.00th=[217056], 95.00th=[217056], | 99.00th=[217056], 99.50th=[217056], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2638KiB/s (2702kB/s)(7168KiB/2717msec); 0 zone resets clat (msec): min=117, max=765, avg=356.45, stdev=218.24 lat (msec): min=117, max=765, avg=356.55, stdev=218.24 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 192], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 313], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 510], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1750, max= 3799, per=28.84%, avg=2314.40, stdev=837.99, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=20.21%, ctx=91, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5732KiB/s (5869kB/s), 573KiB/s-2476KiB/s (587kB/s-2535kB/s), io=20.0MiB (20.0MB), run=2717-3573msec WRITE: bw=8025KiB/s (8217kB/s), 1769KiB/s-2866KiB/s (1811kB/s-2935kB/s), io=28.0MiB (29.4MB), run=2717-3573msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179049: Tue Sep 8 09:59:48 2026 read: IOPS=1, BW=5442KiB/s (5573kB/s)(12.0MiB/2258msec) clat (msec): min=641, max=788, avg=713.37, stdev=73.69 lat (msec): min=641, max=788, avg=713.37, stdev=73.69 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8015, max= 8143, per=100.00%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=18.03%, ctx=261, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179051: Tue Sep 8 09:59:48 2026 read: IOPS=0, BW=1448KiB/s (1483kB/s)(4096KiB/2829msec) clat (nsec): min=789355k, max=789355k, avg=789355041.00, stdev= 0.00 lat (nsec): min=789357k, max=789357k, avg=789357169.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2896KiB/s (2965kB/s)(8192KiB/2829msec); 0 zone resets clat (msec): min=599, max=1324, avg=962.26, stdev=512.72 lat (msec): min=600, max=1325, avg=962.73, stdev=512.72 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8015, max= 8015, per=69.20%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.73%, ctx=146, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179052: Tue Sep 8 09:59:48 2026 write: IOPS=1, BW=4632KiB/s (4743kB/s)(12.0MiB/2653msec); 0 zone resets clat (msec): min=192, max=1447, avg=845.95, stdev=628.90 lat (msec): min=193, max=1447, avg=846.35, stdev=628.90 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8143, max= 8143, per=70.31%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.96%, ctx=97, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179053: Tue Sep 8 09:59:48 2026 write: IOPS=1, BW=5352KiB/s (5480kB/s)(12.0MiB/2296msec); 0 zone resets clat (msec): min=251, max=1636, avg=734.68, stdev=781.74 lat (msec): min=255, max=1637, avg=736.25, stdev=781.03 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 6272, max= 8143, per=62.23%, avg=7207.50, stdev=1323.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.04%, sys=5.66%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5791KiB/s (5930kB/s), 1448KiB/s-5442KiB/s (1483kB/s-5573kB/s), io=16.0MiB (16.8MB), run=2258-2829msec WRITE: bw=11.3MiB/s (11.9MB/s), 2896KiB/s-5352KiB/s (2965kB/s-5480kB/s), io=32.0MiB (33.6MB), run=2296-2829msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179054: Tue Sep 8 09:59:49 2026 read: IOPS=1, BW=4556KiB/s (4666kB/s)(12.0MiB/2697msec) clat (msec): min=254, max=1599, avg=898.65, stdev=674.33 lat (msec): min=254, max=1599, avg=898.65, stdev=674.33 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=3.75%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179055: Tue Sep 8 09:59:49 2026 read: IOPS=0, BW=1444KiB/s (1479kB/s)(4096KiB/2836msec) clat (nsec): min=1206.3M, max=1206.3M, avg=1206323576.00, stdev= 0.00 lat (nsec): min=1206.3M, max=1206.3M, avg=1206326095.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1200], 5.00th=[ 1200], 10.00th=[ 1200], 20.00th=[ 1200], | 30.00th=[ 1200], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2889KiB/s (2958kB/s)(8192KiB/2836msec); 0 zone resets clat (msec): min=750, max=802, avg=776.38, stdev=36.63 lat (msec): min=751, max=803, avg=777.48, stdev=37.20 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8192, max= 8192, per=70.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.07%, sys=6.14%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179056: Tue Sep 8 09:59:49 2026 write: IOPS=1, BW=5126KiB/s (5249kB/s)(12.0MiB/2397msec); 0 zone resets clat (msec): min=194, max=1311, avg=796.80, stdev=563.52 lat (msec): min=194, max=1311, avg=797.27, stdev=563.57 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8078, max= 8175, per=70.33%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.42%, ctx=39, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179057: Tue Sep 8 09:59:49 2026 write: IOPS=1, BW=6260KiB/s (6410kB/s)(12.0MiB/1963msec); 0 zone resets clat (msec): min=409, max=934, avg=652.46, stdev=264.69 lat (msec): min=409, max=935, avg=652.92, stdev=264.80 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 6747, max= 8192, per=64.65%, avg=7469.50, stdev=1021.77, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=8.41%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5777KiB/s (5916kB/s), 1444KiB/s-4556KiB/s (1479kB/s-4666kB/s), io=16.0MiB (16.8MB), run=2697-2836msec WRITE: bw=11.3MiB/s (11.8MB/s), 2889KiB/s-6260KiB/s (2958kB/s-6410kB/s), io=32.0MiB (33.6MB), run=1963-2836msec