== sanity test 398b: DIO and buffer IO race ============== 01:21:51 (1783142511) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.52954 s, 11.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144915: Sat Jul 4 01:23:58 2026 read: IOPS=13, BW=54.7KiB/s (55.0kB/s)(5992KiB/109596msec) clat (usec): min=35, max=907502, avg=36971.24, stdev=34561.57 lat (usec): min=36, max=907505, avg=36974.58, stdev=34561.63 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 11731], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 27132], 50.00th=[ 32113], 60.00th=[ 38536], | 70.00th=[ 44303], 80.00th=[ 52691], 90.00th=[ 65799], 95.00th=[ 79168], | 99.00th=[114820], 99.50th=[133694], 99.90th=[379585], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 144, per=25.49%, avg=54.55, stdev=21.95, samples=215 iops : min= 1, max= 36, avg=13.00, stdev= 5.54, samples=215 write: IOPS=14, BW=57.4KiB/s (58.8kB/s)(6296KiB/109596msec); 0 zone resets clat (usec): min=1186, max=308667, avg=34161.95, stdev=33287.21 lat (usec): min=1186, max=308668, avg=34163.83, stdev=33287.38 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1762], 10.00th=[ 2737], 20.00th=[ 4883], | 30.00th=[ 8160], 40.00th=[ 17171], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[154141], 99.90th=[258999], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 15, max= 127, per=25.69%, avg=57.55, stdev=19.15, samples=214 iops : min= 3, max= 31, avg=13.74, stdev= 4.78, samples=214 lat (usec) : 50=0.16%, 100=3.45%, 250=0.52%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.35%, 4=5.34%, 10=8.33%, 20=11.98%, 50=42.42% lat (msec) : 100=21.29%, 250=2.90%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=6.55%, ctx=7148, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144916: Sat Jul 4 01:23:58 2026 read: IOPS=13, BW=53.4KiB/s (54.7kB/s)(5940KiB/111248msec) clat (usec): min=28, max=180269, avg=36188.87, stdev=24198.68 lat (usec): min=28, max=180271, avg=36200.45, stdev=24206.51 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 67], 10.00th=[ 9241], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 26870], 50.00th=[ 31589], 60.00th=[ 37487], | 70.00th=[ 45876], 80.00th=[ 54264], 90.00th=[ 65799], 95.00th=[ 78119], | 99.00th=[115868], 99.50th=[135267], 99.90th=[168821], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 5, max= 111, per=24.85%, avg=53.19, stdev=20.55, samples=219 iops : min= 1, max= 27, avg=12.66, stdev= 5.16, samples=219 write: IOPS=14, BW=57.1KiB/s (58.4kB/s)(6348KiB/111248msec); 0 zone resets clat (usec): min=1112, max=899835, avg=35939.54, stdev=40993.60 lat (usec): min=1112, max=899836, avg=35941.20, stdev=40993.59 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1647], 10.00th=[ 2573], 20.00th=[ 5145], | 30.00th=[ 9896], 40.00th=[ 19006], 50.00th=[ 27395], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[103285], | 99.00th=[156238], 99.50th=[196084], 99.90th=[295699], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 112, per=25.41%, avg=56.92, stdev=20.68, samples=219 iops : min= 1, max= 28, avg=13.59, stdev= 5.21, samples=219 lat (usec) : 50=0.55%, 100=3.16%, 250=0.59%, 500=0.23%, 750=0.07% lat (msec) : 2=3.81%, 4=4.43%, 10=7.65%, 20=11.65%, 50=42.45% lat (msec) : 100=21.88%, 250=3.48%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.69%, ctx=7074, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Sat Jul 4 01:23:58 2026 read: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6028KiB/110473msec) clat (usec): min=29, max=849820, avg=35530.91, stdev=31635.19 lat (usec): min=29, max=849821, avg=35533.42, stdev=31634.77 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 69], 10.00th=[ 799], 20.00th=[ 18220], | 30.00th=[ 22414], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 51643], 90.00th=[ 63701], 95.00th=[ 76022], | 99.00th=[113771], 99.50th=[139461], 99.90th=[191890], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 5, max= 119, per=25.41%, avg=54.37, stdev=22.67, samples=217 iops : min= 1, max= 29, avg=12.94, stdev= 5.69, samples=217 write: IOPS=14, BW=56.7KiB/s (58.0kB/s)(6260KiB/110473msec); 0 zone resets clat (usec): min=1135, max=358899, avg=36086.47, stdev=35970.44 lat (usec): min=1136, max=358899, avg=36093.38, stdev=35969.74 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1565], 10.00th=[ 2376], 20.00th=[ 5014], | 30.00th=[ 9765], 40.00th=[ 20317], 50.00th=[ 28705], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 60031], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[149947], 99.50th=[185598], 99.90th=[346031], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 119, per=25.08%, avg=56.19, stdev=19.31, samples=218 iops : min= 1, max= 29, avg=13.41, stdev= 4.84, samples=218 lat (usec) : 50=0.46%, 100=3.29%, 250=0.88%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=4.13%, 4=4.56%, 10=7.00%, 20=11.65%, 50=42.58% lat (msec) : 100=21.91%, 250=3.03%, 500=0.13%, 1000=0.03% cpu : usr=0.10%, sys=6.60%, ctx=7040, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Sat Jul 4 01:23:58 2026 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6052KiB/111960msec) clat (usec): min=32, max=345773, avg=35391.94, stdev=26839.55 lat (usec): min=32, max=345774, avg=35394.70, stdev=26839.88 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 141], 20.00th=[ 17171], | 30.00th=[ 21627], 40.00th=[ 26346], 50.00th=[ 31065], 60.00th=[ 35914], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 66847], 95.00th=[ 77071], | 99.00th=[122160], 99.50th=[141558], 99.90th=[287310], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 112, per=25.39%, avg=54.33, stdev=20.78, samples=218 iops : min= 1, max= 28, avg=12.94, stdev= 5.26, samples=218 write: IOPS=13, BW=55.7KiB/s (57.0kB/s)(6236KiB/111960msec); 0 zone resets clat (usec): min=1116, max=896487, avg=37206.43, stdev=42132.09 lat (usec): min=1118, max=896489, avg=37208.89, stdev=42131.95 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1532], 10.00th=[ 2311], 20.00th=[ 4686], | 30.00th=[ 9372], 40.00th=[ 19530], 50.00th=[ 29230], 60.00th=[ 38536], | 70.00th=[ 49021], 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[217056], 99.90th=[337642], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 5, max= 111, per=24.75%, avg=55.44, stdev=20.99, samples=220 iops : min= 1, max= 27, avg=13.23, stdev= 5.30, samples=220 lat (usec) : 50=0.33%, 100=4.20%, 250=0.59%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.13%, 4=4.59%, 10=7.45%, 20=11.98%, 50=40.62% lat (msec) : 100=22.36%, 250=3.22%, 500=0.20%, 1000=0.03% cpu : usr=0.09%, sys=6.48%, ctx=7056, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=214KiB/s (220kB/s), 53.4KiB/s-54.7KiB/s (54.7kB/s-55.0kB/s), io=23.4MiB (24.6MB), run=109596-111960msec WRITE: bw=225KiB/s (230kB/s), 55.7KiB/s-57.4KiB/s (57.0kB/s-58.8kB/s), io=24.6MiB (25.7MB), run=109596-111960msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144914: Sat Jul 4 01:25:47 2026 read: IOPS=6, BW=27.2KiB/s (27.9kB/s)(5992KiB/219995msec) clat (msec): min=5, max=923, avg=30.60, stdev=38.35 lat (msec): min=5, max=923, avg=30.61, stdev=38.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 41], 90.00th=[ 65], 95.00th=[ 90], | 99.00th=[ 146], 99.50th=[ 201], 99.90th=[ 414], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 118, per=26.58%, avg=28.70, stdev=20.13, samples=406 iops : min= 1, max= 29, avg= 6.58, stdev= 5.09, samples=406 write: IOPS=7, BW=28.6KiB/s (29.3kB/s)(6296KiB/219995msec); 0 zone resets clat (msec): min=38, max=395, avg=110.37, stdev=52.83 lat (msec): min=38, max=395, avg=110.38, stdev=52.82 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 107], | 70.00th=[ 123], 80.00th=[ 148], 90.00th=[ 182], 95.00th=[ 218], | 99.00th=[ 284], 99.50th=[ 317], 99.90th=[ 384], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 56, per=24.75%, avg=28.22, stdev=12.75, samples=433 iops : min= 1, max= 14, avg= 6.45, stdev= 3.26, samples=433 lat (msec) : 10=3.16%, 20=22.69%, 50=16.57%, 100=32.10%, 250=23.93% lat (msec) : 500=1.53%, 1000=0.03% cpu : usr=0.06%, sys=1.82%, ctx=5420, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144917: Sat Jul 4 01:25:47 2026 read: IOPS=6, BW=26.9KiB/s (27.6kB/s)(5940KiB/220498msec) clat (msec): min=6, max=982, avg=30.50, stdev=37.78 lat (msec): min=6, max=982, avg=30.50, stdev=37.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 43], 90.00th=[ 67], 95.00th=[ 85], | 99.00th=[ 144], 99.50th=[ 201], 99.90th=[ 309], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 103, per=27.47%, avg=29.67, stdev=19.94, samples=389 iops : min= 1, max= 25, avg= 6.82, stdev= 5.07, samples=389 write: IOPS=7, BW=28.8KiB/s (29.5kB/s)(6348KiB/220498msec); 0 zone resets clat (msec): min=30, max=410, avg=110.14, stdev=51.28 lat (msec): min=30, max=410, avg=110.14, stdev=51.28 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 69], | 30.00th=[ 78], 40.00th=[ 88], 50.00th=[ 96], 60.00th=[ 108], | 70.00th=[ 124], 80.00th=[ 146], 90.00th=[ 182], 95.00th=[ 211], | 99.00th=[ 284], 99.50th=[ 326], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 63, per=24.83%, avg=28.30, stdev=12.65, samples=435 iops : min= 1, max= 15, avg= 6.47, stdev= 3.24, samples=435 lat (msec) : 10=3.12%, 20=21.94%, 50=16.96%, 100=32.85%, 250=24.19% lat (msec) : 500=0.91%, 1000=0.03% cpu : usr=0.06%, sys=1.81%, ctx=5462, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Sat Jul 4 01:25:47 2026 read: IOPS=6, BW=27.6KiB/s (28.2kB/s)(6028KiB/218766msec) clat (msec): min=5, max=299, avg=30.32, stdev=28.84 lat (msec): min=5, max=299, avg=30.33, stdev=28.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 66], 95.00th=[ 86], | 99.00th=[ 136], 99.50th=[ 197], 99.90th=[ 271], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 118, per=26.73%, avg=28.87, stdev=19.33, samples=406 iops : min= 1, max= 29, avg= 6.63, stdev= 4.89, samples=406 write: IOPS=7, BW=28.6KiB/s (29.3kB/s)(6260KiB/218766msec); 0 zone resets clat (msec): min=40, max=1112, avg=110.31, stdev=57.28 lat (msec): min=40, max=1112, avg=110.32, stdev=57.28 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 70], | 30.00th=[ 79], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 106], | 70.00th=[ 123], 80.00th=[ 144], 90.00th=[ 180], 95.00th=[ 213], | 99.00th=[ 279], 99.50th=[ 330], 99.90th=[ 414], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 63, per=24.93%, avg=28.43, stdev=12.84, samples=428 iops : min= 1, max= 15, avg= 6.50, stdev= 3.29, samples=428 lat (msec) : 10=3.22%, 20=21.09%, 50=18.39%, 100=32.26%, 250=23.86% lat (msec) : 500=1.14%, 2000=0.03% cpu : usr=0.05%, sys=1.80%, ctx=5397, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144921: Sat Jul 4 01:25:47 2026 read: IOPS=6, BW=27.6KiB/s (28.3kB/s)(6052KiB/218993msec) clat (msec): min=6, max=412, avg=30.46, stdev=32.60 lat (msec): min=6, max=412, avg=30.47, stdev=32.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 66], 95.00th=[ 91], | 99.00th=[ 165], 99.50th=[ 211], 99.90th=[ 317], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 112, per=27.46%, avg=29.65, stdev=19.43, samples=397 iops : min= 1, max= 28, avg= 6.82, stdev= 4.94, samples=397 write: IOPS=7, BW=28.5KiB/s (29.2kB/s)(6236KiB/218993msec); 0 zone resets clat (msec): min=37, max=1110, avg=110.63, stdev=56.41 lat (msec): min=37, max=1110, avg=110.63, stdev=56.40 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 70], | 30.00th=[ 79], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 107], | 70.00th=[ 125], 80.00th=[ 146], 90.00th=[ 182], 95.00th=[ 215], | 99.00th=[ 279], 99.50th=[ 326], 99.90th=[ 405], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 56, per=24.56%, avg=28.00, stdev=12.72, samples=432 iops : min= 1, max= 14, avg= 6.40, stdev= 3.26, samples=432 lat (msec) : 10=3.35%, 20=22.40%, 50=16.96%, 100=31.90%, 250=24.32% lat (msec) : 500=1.04%, 2000=0.03% cpu : usr=0.06%, sys=1.77%, ctx=5443, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=109KiB/s (112kB/s), 26.9KiB/s-27.6KiB/s (27.6kB/s-28.3kB/s), io=23.4MiB (24.6MB), run=218766-220498msec WRITE: bw=114KiB/s (117kB/s), 28.5KiB/s-28.8KiB/s (29.2kB/s-29.5kB/s), io=24.6MiB (25.7MB), run=218766-220498msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144975: Sat Jul 4 01:26:19 2026 read: IOPS=15, BW=246KiB/s (252kB/s)(5920KiB/24022msec) clat (usec): min=38, max=170026, avg=31679.22, stdev=25239.15 lat (usec): min=38, max=170026, avg=31695.70, stdev=25221.87 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 78], 20.00th=[ 227], | 30.00th=[ 19792], 40.00th=[ 25297], 50.00th=[ 29492], 60.00th=[ 36963], | 70.00th=[ 41681], 80.00th=[ 47449], 90.00th=[ 62653], 95.00th=[ 77071], | 99.00th=[109577], 99.50th=[143655], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 62, max= 446, per=24.67%, avg=243.72, stdev=81.34, samples=47 iops : min= 3, max= 27, avg=14.51, stdev= 5.08, samples=47 write: IOPS=16, BW=265KiB/s (271kB/s)(6368KiB/24022msec); 0 zone resets clat (usec): min=1657, max=264699, avg=30254.68, stdev=33178.60 lat (usec): min=1659, max=264703, avg=30265.44, stdev=33173.94 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2540], 10.00th=[ 3752], 20.00th=[ 5800], | 30.00th=[ 8094], 40.00th=[ 12125], 50.00th=[ 18220], 60.00th=[ 27132], | 70.00th=[ 39060], 80.00th=[ 51643], 90.00th=[ 69731], 95.00th=[ 94897], | 99.00th=[156238], 99.50th=[246416], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 29, max= 476, per=25.51%, avg=265.06, stdev=99.56, samples=47 iops : min= 1, max= 29, avg=15.83, stdev= 6.32, samples=47 lat (usec) : 50=0.65%, 100=6.64%, 250=2.47%, 500=0.65%, 750=0.39% lat (msec) : 2=1.17%, 4=5.21%, 10=12.50%, 20=12.11%, 50=38.80% lat (msec) : 100=17.19%, 250=2.08%, 500=0.13% cpu : usr=0.05%, sys=9.14%, ctx=1715, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144976: Sat Jul 4 01:26:19 2026 read: IOPS=16, BW=259KiB/s (266kB/s)(5744KiB/22137msec) clat (usec): min=40, max=183724, avg=31108.03, stdev=24655.71 lat (usec): min=40, max=183726, avg=31109.38, stdev=24655.72 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 71], 10.00th=[ 86], 20.00th=[ 1352], | 30.00th=[ 20055], 40.00th=[ 24773], 50.00th=[ 29230], 60.00th=[ 33817], | 70.00th=[ 40109], 80.00th=[ 49021], 90.00th=[ 60556], 95.00th=[ 71828], | 99.00th=[103285], 99.50th=[168821], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 88, max= 480, per=26.32%, avg=260.00, stdev=92.77, samples=43 iops : min= 5, max= 30, avg=15.51, stdev= 5.83, samples=43 write: IOPS=18, BW=296KiB/s (303kB/s)(6544KiB/22137msec); 0 zone resets clat (usec): min=1654, max=201868, avg=26347.87, stdev=28300.45 lat (usec): min=1658, max=201869, avg=26354.18, stdev=28306.26 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2474], 10.00th=[ 3130], 20.00th=[ 4359], | 30.00th=[ 6718], 40.00th=[ 9372], 50.00th=[ 15270], 60.00th=[ 23987], | 70.00th=[ 33817], 80.00th=[ 49021], 90.00th=[ 62653], 95.00th=[ 78119], | 99.00th=[124257], 99.50th=[160433], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 95, max= 510, per=28.23%, avg=293.30, stdev=98.86, samples=43 iops : min= 5, max= 31, avg=17.63, stdev= 6.17, samples=43 lat (usec) : 50=0.65%, 100=5.86%, 250=2.21%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.43%, 4=7.42%, 10=13.67%, 20=11.46%, 50=38.54% lat (msec) : 100=16.80%, 250=1.56% cpu : usr=0.10%, sys=9.66%, ctx=1642, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144977: Sat Jul 4 01:26:19 2026 read: IOPS=16, BW=272KiB/s (278kB/s)(6256KiB/23024msec) clat (usec): min=42, max=191541, avg=31183.14, stdev=24098.34 lat (usec): min=42, max=191543, avg=31185.13, stdev=24098.66 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 67], 10.00th=[ 81], 20.00th=[ 979], | 30.00th=[ 20579], 40.00th=[ 25297], 50.00th=[ 30278], 60.00th=[ 34866], | 70.00th=[ 39584], 80.00th=[ 47449], 90.00th=[ 60031], 95.00th=[ 69731], | 99.00th=[102237], 99.50th=[141558], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 126, max= 472, per=28.35%, avg=280.09, stdev=83.80, samples=44 iops : min= 7, max= 29, avg=16.80, stdev= 5.22, samples=44 write: IOPS=16, BW=262KiB/s (268kB/s)(6032KiB/23024msec); 0 zone resets clat (usec): min=1559, max=193007, avg=27958.88, stdev=29120.76 lat (usec): min=1562, max=193009, avg=27967.11, stdev=29124.71 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2147], 10.00th=[ 3458], 20.00th=[ 5080], | 30.00th=[ 6849], 40.00th=[ 11863], 50.00th=[ 17695], 60.00th=[ 25297], | 70.00th=[ 37487], 80.00th=[ 49021], 90.00th=[ 66847], 95.00th=[ 82314], | 99.00th=[149947], 99.50th=[177210], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 58, max= 512, per=24.93%, avg=259.07, stdev=97.32, samples=45 iops : min= 3, max= 32, avg=15.47, stdev= 6.12, samples=45 lat (usec) : 50=0.52%, 100=6.77%, 250=1.82%, 500=0.65%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=1.56%, 4=5.47%, 10=11.85%, 20=11.59%, 50=41.41% lat (msec) : 100=16.28%, 250=1.56% cpu : usr=0.07%, sys=9.56%, ctx=1676, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144978: Sat Jul 4 01:26:19 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(6032KiB/24242msec) clat (usec): min=35, max=118025, avg=32117.87, stdev=23241.88 lat (usec): min=36, max=118026, avg=32121.57, stdev=23239.94 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 74], 10.00th=[ 88], 20.00th=[ 709], | 30.00th=[ 21627], 40.00th=[ 27132], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 42730], 80.00th=[ 49021], 90.00th=[ 60556], 95.00th=[ 73925], | 99.00th=[100140], 99.50th=[111674], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 31, max= 510, per=25.15%, avg=248.44, stdev=85.84, samples=48 iops : min= 1, max= 31, avg=14.79, stdev= 5.40, samples=48 write: IOPS=16, BW=258KiB/s (264kB/s)(6256KiB/24242msec); 0 zone resets clat (usec): min=1465, max=262102, avg=30837.75, stdev=31698.90 lat (usec): min=1467, max=262105, avg=30841.99, stdev=31698.79 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 11], 40.00th=[ 17], 50.00th=[ 23], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 49], 90.00th=[ 70], 95.00th=[ 86], | 99.00th=[ 159], 99.50th=[ 241], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 93, max= 446, per=24.86%, avg=258.25, stdev=83.13, samples=48 iops : min= 5, max= 27, avg=15.42, stdev= 5.26, samples=48 lat (usec) : 50=0.26%, 100=5.86%, 250=3.26%, 750=0.52%, 1000=0.13% lat (msec) : 2=0.52%, 4=4.82%, 10=10.29%, 20=11.33%, 50=43.49% lat (msec) : 100=17.58%, 250=1.82%, 500=0.13% cpu : usr=0.12%, sys=9.16%, ctx=1785, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=988KiB/s (1012kB/s), 246KiB/s-272KiB/s (252kB/s-278kB/s), io=23.4MiB (24.5MB), run=22137-24242msec WRITE: bw=1040KiB/s (1064kB/s), 258KiB/s-296KiB/s (264kB/s-303kB/s), io=24.6MiB (25.8MB), run=22137-24242msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144979: Sat Jul 4 01:26:53 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(5920KiB/58523msec) clat (msec): min=8, max=283, avg=35.30, stdev=31.57 lat (msec): min=8, max=283, avg=35.31, stdev=31.57 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 70], 95.00th=[ 87], | 99.00th=[ 161], 99.50th=[ 232], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 287, per=25.73%, avg=104.46, stdev=63.70, samples=112 iops : min= 1, max= 17, avg= 5.77, stdev= 4.03, samples=112 write: IOPS=6, BW=109KiB/s (111kB/s)(6368KiB/58523msec); 0 zone resets clat (msec): min=46, max=290, avg=114.00, stdev=42.10 lat (msec): min=46, max=290, avg=114.01, stdev=42.10 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 82], | 30.00th=[ 89], 40.00th=[ 96], 50.00th=[ 105], 60.00th=[ 115], | 70.00th=[ 128], 80.00th=[ 142], 90.00th=[ 169], 95.00th=[ 199], | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 189, per=25.37%, avg=108.34, stdev=40.70, samples=116 iops : min= 1, max= 11, avg= 6.02, stdev= 2.58, samples=116 lat (msec) : 10=0.65%, 20=15.23%, 50=23.57%, 100=29.95%, 250=29.95% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.99%, ctx=1395, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144980: Sat Jul 4 01:26:53 2026 read: IOPS=6, BW=97.4KiB/s (99.8kB/s)(5744KiB/58947msec) clat (msec): min=7, max=286, avg=35.65, stdev=33.24 lat (msec): min=7, max=286, avg=35.65, stdev=33.24 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 110], | 99.00th=[ 176], 99.50th=[ 180], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 28, max= 319, per=26.29%, avg=106.74, stdev=63.87, samples=105 iops : min= 1, max= 19, avg= 5.92, stdev= 4.01, samples=105 write: IOPS=6, BW=111KiB/s (114kB/s)(6544KiB/58947msec); 0 zone resets clat (msec): min=41, max=345, avg=112.20, stdev=44.53 lat (msec): min=41, max=345, avg=112.20, stdev=44.53 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 58], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 105], 60.00th=[ 114], | 70.00th=[ 125], 80.00th=[ 142], 90.00th=[ 176], 95.00th=[ 197], | 99.00th=[ 266], 99.50th=[ 284], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 192, per=25.99%, avg=110.98, stdev=41.26, samples=115 iops : min= 1, max= 12, avg= 6.17, stdev= 2.66, samples=115 lat (msec) : 10=1.04%, 20=16.15%, 50=21.35%, 100=29.56%, 250=30.99% lat (msec) : 500=0.91% cpu : usr=0.06%, sys=2.04%, ctx=1476, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144981: Sat Jul 4 01:26:53 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6256KiB/56625msec) clat (msec): min=8, max=233, avg=32.16, stdev=28.11 lat (msec): min=8, max=233, avg=32.16, stdev=28.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 62], 95.00th=[ 81], | 99.00th=[ 174], 99.50th=[ 178], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 319, per=27.99%, avg=113.62, stdev=76.39, samples=109 iops : min= 1, max= 19, avg= 6.34, stdev= 4.77, samples=109 write: IOPS=6, BW=107KiB/s (109kB/s)(6032KiB/56625msec); 0 zone resets clat (msec): min=45, max=348, avg=116.26, stdev=45.87 lat (msec): min=45, max=348, avg=116.26, stdev=45.87 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 88], 40.00th=[ 97], 50.00th=[ 109], 60.00th=[ 117], | 70.00th=[ 129], 80.00th=[ 148], 90.00th=[ 178], 95.00th=[ 203], | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 192, per=24.75%, avg=105.70, stdev=39.02, samples=112 iops : min= 1, max= 12, avg= 5.84, stdev= 2.48, samples=112 lat (msec) : 10=1.30%, 20=19.53%, 50=22.01%, 100=27.21%, 250=29.17% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=2.06%, ctx=1412, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144982: Sat Jul 4 01:26:53 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(6032KiB/58176msec) clat (msec): min=7, max=203, avg=34.76, stdev=28.84 lat (msec): min=7, max=203, avg=34.76, stdev=28.84 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 51], 90.00th=[ 71], 95.00th=[ 89], | 99.00th=[ 150], 99.50th=[ 182], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 319, per=27.71%, avg=112.49, stdev=62.01, samples=105 iops : min= 1, max= 19, avg= 6.28, stdev= 3.89, samples=105 write: IOPS=6, BW=108KiB/s (110kB/s)(6256KiB/58176msec); 0 zone resets clat (msec): min=42, max=340, avg=114.62, stdev=43.75 lat (msec): min=42, max=340, avg=114.63, stdev=43.75 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 95], 50.00th=[ 104], 60.00th=[ 114], | 70.00th=[ 127], 80.00th=[ 144], 90.00th=[ 174], 95.00th=[ 194], | 99.00th=[ 292], 99.50th=[ 321], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 192, per=25.08%, avg=107.10, stdev=41.19, samples=115 iops : min= 1, max= 12, avg= 5.94, stdev= 2.66, samples=115 lat (msec) : 10=1.30%, 20=15.89%, 50=22.53%, 100=30.34%, 250=29.30% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.93%, ctx=1421, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=406KiB/s (416kB/s), 97.4KiB/s-110KiB/s (99.8kB/s-113kB/s), io=23.4MiB (24.5MB), run=56625-58947msec WRITE: bw=428KiB/s (438kB/s), 107KiB/s-111KiB/s (109kB/s-114kB/s), io=24.6MiB (25.8MB), run=56625-58947msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144996: Sat Jul 4 01:27:10 2026 read: IOPS=1, BW=1083KiB/s (1109kB/s)(7168KiB/6621msec) clat (usec): min=689, max=3262.9k, avg=654084.73, stdev=1159119.93 lat (usec): min=690, max=3262.9k, avg=654086.44, stdev=1159120.58 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], | 20.00th=[ 145753], 30.00th=[ 160433], 40.00th=[ 160433], | 50.00th=[ 256902], 60.00th=[ 291505], 70.00th=[ 291505], | 80.00th=[ 459277], 90.00th=[3271558], 95.00th=[3271558], | 99.00th=[3271558], 99.50th=[3271558], 99.90th=[3271558], | 99.95th=[3271558], 99.99th=[3271558] bw ( KiB/s): min= 1946, max= 4087, per=100.00%, avg=3017.25, stdev=1221.47, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=773KiB/s (792kB/s)(5120KiB/6621msec); 0 zone resets clat (msec): min=196, max=781, avg=398.78, stdev=226.23 lat (msec): min=197, max=781, avg=398.87, stdev=226.24 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1946, max= 2031, per=51.49%, avg=1975.00, stdev=39.18, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.83%, ctx=651, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144997: Sat Jul 4 01:27:10 2026 read: IOPS=0, BW=274KiB/s (281kB/s)(2048KiB/7473msec) clat (msec): min=317, max=525, avg=421.57, stdev=147.47 lat (msec): min=317, max=525, avg=421.57, stdev=147.47 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1946, max= 2043, per=72.79%, avg=1994.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1370KiB/s (1403kB/s)(10.0MiB/7473msec); 0 zone resets clat (msec): min=114, max=3105, avg=646.33, stdev=889.00 lat (msec): min=114, max=3105, avg=646.59, stdev=888.93 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 197], | 30.00th=[ 236], 40.00th=[ 279], 50.00th=[ 300], 60.00th=[ 363], | 70.00th=[ 435], 80.00th=[ 617], 90.00th=[ 818], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1950, max= 4096, per=69.96%, avg=2683.67, stdev=1037.54, samples=6 iops : min= 1, max= 4, avg= 2.00, stdev= 1.26, samples=6 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.53%, ctx=200, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144998: Sat Jul 4 01:27:10 2026 read: IOPS=0, BW=935KiB/s (957kB/s)(6144KiB/6571msec) clat (usec): min=540, max=573067, avg=226737.31, stdev=220421.96 lat (usec): min=541, max=573069, avg=226738.38, stdev=220422.09 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 4883], | 30.00th=[ 4883], 40.00th=[181404], 50.00th=[181404], 60.00th=[229639], | 70.00th=[371196], 80.00th=[371196], 90.00th=[574620], 95.00th=[574620], | 99.00th=[574620], 99.50th=[574620], 99.90th=[574620], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 1946, max= 6107, per=100.00%, avg=3334.33, stdev=2401.20, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=935KiB/s (957kB/s)(6144KiB/6571msec); 0 zone resets clat (msec): min=92, max=3809, avg=850.80, stdev=1453.50 lat (msec): min=92, max=3809, avg=850.92, stdev=1453.50 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 338], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 1946, max= 2748, per=56.29%, avg=2159.20, stdev=331.51, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=8.08%, ctx=223, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144999: Sat Jul 4 01:27:10 2026 read: IOPS=0, BW=778KiB/s (797kB/s)(5120KiB/6581msec) clat (usec): min=999, max=307620, avg=147328.64, stdev=138738.78 lat (usec): min=1000, max=307621, avg=147329.92, stdev=138738.72 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 996], 10.00th=[ 996], 20.00th=[ 996], | 30.00th=[ 1958], 40.00th=[ 1958], 50.00th=[204473], 60.00th=[204473], | 70.00th=[221250], 80.00th=[221250], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 2035, max= 5851, per=100.00%, avg=3943.00, stdev=2698.32, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1089KiB/s (1115kB/s)(7168KiB/6581msec); 0 zone resets clat (msec): min=162, max=3469, avg=817.72, stdev=1188.53 lat (msec): min=162, max=3469, avg=817.82, stdev=1188.53 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 228], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 363], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 810], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1376, max= 4096, per=75.25%, avg=2886.50, stdev=1390.18, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.50%, ctx=218, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2741KiB/s (2806kB/s), 274KiB/s-1083KiB/s (281kB/s-1109kB/s), io=20.0MiB (20.0MB), run=6571-7473msec WRITE: bw=3837KiB/s (3929kB/s), 773KiB/s-1370KiB/s (792kB/s-1403kB/s), io=28.0MiB (29.4MB), run=6571-7473msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145000: Sat Jul 4 01:27:10 2026 read: IOPS=0, BW=882KiB/s (904kB/s)(7168KiB/8123msec) clat (msec): min=103, max=2964, avg=879.31, stdev=1108.82 lat (msec): min=103, max=2964, avg=879.31, stdev=1108.82 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 120], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 342], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 1854], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1976, max= 2048, per=80.23%, avg=2014.60, stdev=29.13, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=630KiB/s (645kB/s)(5120KiB/8123msec); 0 zone resets clat (msec): min=134, max=633, avg=335.63, stdev=195.35 lat (msec): min=134, max=633, avg=335.78, stdev=195.42 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2003, max= 4087, per=77.09%, avg=2709.67, stdev=1192.94, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.23%, ctx=88, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145001: Sat Jul 4 01:27:10 2026 read: IOPS=0, BW=255KiB/s (261kB/s)(2048KiB/8022msec) clat (msec): min=172, max=356, avg=264.52, stdev=129.89 lat (msec): min=172, max=356, avg=264.52, stdev=129.89 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1577, max= 2039, per=72.00%, avg=1808.00, stdev=326.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1276KiB/s (1307kB/s)(10.0MiB/8022msec); 0 zone resets clat (msec): min=151, max=3728, avg=725.62, stdev=1068.57 lat (msec): min=151, max=3729, avg=726.06, stdev=1068.48 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 253], | 30.00th=[ 271], 40.00th=[ 363], 50.00th=[ 380], 60.00th=[ 397], | 70.00th=[ 460], 80.00th=[ 481], 90.00th=[ 776], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 1809, max= 6131, per=72.79%, avg=2558.43, stdev=1577.58, samples=7 iops : min= 1, max= 5, avg= 1.71, stdev= 1.50, samples=7 lat (msec) : 250=16.67%, 500=66.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.18%, ctx=114, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145002: Sat Jul 4 01:27:10 2026 read: IOPS=0, BW=815KiB/s (834kB/s)(6144KiB/7540msec) clat (msec): min=63, max=576, avg=298.43, stdev=199.59 lat (msec): min=63, max=576, avg=298.43, stdev=199.59 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 305], | 70.00th=[ 489], 80.00th=[ 489], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2003, max= 4096, per=100.00%, avg=3392.67, stdev=1203.52, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=0, BW=815KiB/s (834kB/s)(6144KiB/7540msec); 0 zone resets clat (msec): min=96, max=4245, avg=903.62, stdev=1639.32 lat (msec): min=96, max=4245, avg=905.22, stdev=1638.68 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 309], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 4245], 95.00th=[ 4245], | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], | 99.99th=[ 4245] bw ( KiB/s): min= 1903, max= 4007, per=76.17%, avg=2677.50, stdev=979.96, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=2.65%, ctx=117, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145003: Sat Jul 4 01:27:10 2026 read: IOPS=0, BW=628KiB/s (643kB/s)(5120KiB/8155msec) clat (msec): min=56, max=514, avg=266.96, stdev=211.92 lat (msec): min=56, max=514, avg=266.96, stdev=211.92 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1903, max= 4079, per=100.00%, avg=2661.67, stdev=1228.46, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=879KiB/s (900kB/s)(7168KiB/8155msec); 0 zone resets clat (msec): min=164, max=3910, avg=961.62, stdev=1308.94 lat (msec): min=164, max=3911, avg=961.82, stdev=1308.90 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 451], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 510], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 625], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1458, max= 2048, per=53.11%, avg=1866.80, stdev=248.12, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.65%, ctx=89, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2511KiB/s (2572kB/s), 255KiB/s-882KiB/s (261kB/s-904kB/s), io=20.0MiB (20.0MB), run=7540-8155msec WRITE: bw=3516KiB/s (3600kB/s), 630KiB/s-1276KiB/s (645kB/s-1307kB/s), io=28.0MiB (29.4MB), run=7540-8155msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145010: Sat Jul 4 01:27:22 2026 read: IOPS=1, BW=4337KiB/s (4442kB/s)(12.0MiB/2833msec) clat (msec): min=584, max=1404, avg=918.70, stdev=430.52 lat (msec): min=584, max=1404, avg=918.70, stdev=430.52 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8062, max= 8143, per=100.00%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.07%, sys=4.45%, ctx=59, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145011: Sat Jul 4 01:27:22 2026 read: IOPS=0, BW=1131KiB/s (1159kB/s)(4096KiB/3620msec) clat (nsec): min=1071.1M, max=1071.1M, avg=1071120646.00, stdev= 0.00 lat (nsec): min=1071.1M, max=1071.1M, avg=1071122942.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2263KiB/s (2317kB/s)(8192KiB/3620msec); 0 zone resets clat (msec): min=1140, max=1325, avg=1232.97, stdev=130.83 lat (msec): min=1140, max=1326, avg=1233.64, stdev=131.11 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8143, max= 8143, per=89.97%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.03%, sys=4.73%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145012: Sat Jul 4 01:27:22 2026 write: IOPS=1, BW=6582KiB/s (6740kB/s)(12.0MiB/1867msec); 0 zone resets clat (msec): min=299, max=773, avg=598.31, stdev=260.46 lat (msec): min=299, max=774, avg=599.16, stdev=260.84 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 6068, max= 8126, per=78.41%, avg=7097.00, stdev=1455.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.11%, sys=7.93%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145013: Sat Jul 4 01:27:22 2026 write: IOPS=1, BW=5408KiB/s (5538kB/s)(12.0MiB/2272msec); 0 zone resets clat (msec): min=285, max=1044, avg=712.86, stdev=388.77 lat (msec): min=285, max=1045, avg=713.56, stdev=389.04 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 6330, max= 8062, per=79.51%, avg=7196.00, stdev=1224.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.25%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4526KiB/s (4635kB/s), 1131KiB/s-4337KiB/s (1159kB/s-4442kB/s), io=16.0MiB (16.8MB), run=2833-3620msec WRITE: bw=9052KiB/s (9269kB/s), 2263KiB/s-6582KiB/s (2317kB/s-6740kB/s), io=32.0MiB (33.6MB), run=1867-3620msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145015: Sat Jul 4 01:27:22 2026 read: IOPS=1, BW=5488KiB/s (5620kB/s)(12.0MiB/2239msec) clat (msec): min=607, max=830, avg=732.86, stdev=114.08 lat (msec): min=607, max=830, avg=732.86, stdev=114.08 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=21.67%, ctx=390, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145016: Sat Jul 4 01:27:22 2026 read: IOPS=0, BW=1175KiB/s (1203kB/s)(4096KiB/3487msec) clat (nsec): min=1021.4M, max=1021.4M, avg=1021407401.00, stdev= 0.00 lat (nsec): min=1021.4M, max=1021.4M, avg=1021409016.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2349KiB/s (2406kB/s)(8192KiB/3487msec); 0 zone resets clat (msec): min=310, max=2152, avg=1231.11, stdev=1302.62 lat (msec): min=310, max=2153, avg=1232.01, stdev=1303.18 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.42%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145017: Sat Jul 4 01:27:22 2026 write: IOPS=0, BW=3633KiB/s (3721kB/s)(12.0MiB/3382msec); 0 zone resets clat (msec): min=498, max=1481, avg=1125.21, stdev=544.06 lat (msec): min=502, max=1481, avg=1126.93, stdev=542.09 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8126, max= 8143, per=86.56%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.73%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145018: Sat Jul 4 01:27:22 2026 write: IOPS=1, BW=4300KiB/s (4403kB/s)(12.0MiB/2858msec); 0 zone resets clat (msec): min=267, max=1725, avg=940.80, stdev=735.43 lat (msec): min=268, max=1726, avg=941.36, stdev=735.54 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8143, max= 8175, per=86.83%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.50%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4699KiB/s (4811kB/s), 1175KiB/s-5488KiB/s (1203kB/s-5620kB/s), io=16.0MiB (16.8MB), run=2239-3487msec WRITE: bw=9397KiB/s (9623kB/s), 2349KiB/s-4300KiB/s (2406kB/s-4403kB/s), io=32.0MiB (33.6MB), run=2858-3487msec