== sanity test 398b: DIO and buffer IO race ============== 00:56:52 (1788670612) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.9447 s, 8.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145734: Sun Sep 6 00:59:35 2026 read: IOPS=10, BW=42.1KiB/s (43.1kB/s)(5992KiB/142448msec) clat (usec): min=35, max=441135, avg=45179.57, stdev=38212.28 lat (usec): min=35, max=441137, avg=45182.57, stdev=38211.19 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 84], 20.00th=[ 18482], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[107480], | 99.00th=[162530], 99.50th=[198181], 99.90th=[421528], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 112, per=25.81%, avg=42.58, stdev=20.40, samples=274 iops : min= 1, max= 28, avg=10.01, stdev= 5.17, samples=274 write: IOPS=11, BW=44.2KiB/s (45.3kB/s)(6296KiB/142448msec); 0 zone resets clat (usec): min=944, max=845822, avg=47365.38, stdev=50924.94 lat (usec): min=945, max=845824, avg=47374.31, stdev=50920.81 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1385], 10.00th=[ 2409], 20.00th=[ 5211], | 30.00th=[ 11076], 40.00th=[ 22152], 50.00th=[ 34866], 60.00th=[ 49021], | 70.00th=[ 62653], 80.00th=[ 81265], 90.00th=[109577], 95.00th=[137364], | 99.00th=[212861], 99.50th=[238027], 99.90th=[329253], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 6, max= 103, per=25.31%, avg=43.78, stdev=18.67, samples=280 iops : min= 1, max= 25, avg=10.31, stdev= 4.71, samples=280 lat (usec) : 50=0.49%, 100=4.65%, 250=0.81%, 500=0.20%, 750=0.16% lat (usec) : 1000=0.10% lat (msec) : 2=4.39%, 4=3.87%, 10=6.80%, 20=8.53%, 50=32.88% lat (msec) : 100=27.05%, 250=9.70%, 500=0.33%, 1000=0.03% cpu : usr=0.07%, sys=4.96%, ctx=6690, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145735: Sun Sep 6 00:59:35 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(5940KiB/144592msec) clat (usec): min=26, max=516971, avg=45963.04, stdev=38571.16 lat (usec): min=27, max=516972, avg=45965.98, stdev=38569.47 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 90], 20.00th=[ 19006], | 30.00th=[ 25297], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 45876], | 70.00th=[ 56886], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[119014], | 99.00th=[158335], 99.50th=[198181], 99.90th=[263193], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 6, max= 111, per=24.93%, avg=41.14, stdev=20.45, samples=281 iops : min= 1, max= 27, avg= 9.64, stdev= 5.16, samples=281 write: IOPS=10, BW=43.9KiB/s (44.0kB/s)(6348KiB/144592msec); 0 zone resets clat (usec): min=1015, max=741553, avg=47920.16, stdev=50821.54 lat (usec): min=1016, max=741554, avg=47927.57, stdev=50820.23 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1418], 10.00th=[ 2180], 20.00th=[ 4686], | 30.00th=[ 9765], 40.00th=[ 22676], 50.00th=[ 35914], 60.00th=[ 47973], | 70.00th=[ 63177], 80.00th=[ 82314], 90.00th=[113771], 95.00th=[141558], | 99.00th=[202376], 99.50th=[233833], 99.90th=[341836], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 126, per=25.19%, avg=43.58, stdev=20.99, samples=283 iops : min= 1, max= 31, avg=10.25, stdev= 5.28, samples=283 lat (usec) : 50=0.49%, 100=4.75%, 250=0.78%, 500=0.26%, 750=0.16% lat (usec) : 1000=0.03% lat (msec) : 2=4.62%, 4=4.75%, 10=6.54%, 20=7.65%, 50=32.65% lat (msec) : 100=26.11%, 250=10.90%, 500=0.23%, 750=0.07% cpu : usr=0.08%, sys=4.91%, ctx=6722, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145736: Sun Sep 6 00:59:35 2026 read: IOPS=10, BW=41.7KiB/s (42.7kB/s)(6028KiB/144697msec) clat (usec): min=35, max=381994, avg=44581.31, stdev=36284.83 lat (usec): min=35, max=381996, avg=44582.83, stdev=36284.76 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 83], 20.00th=[ 19530], | 30.00th=[ 25560], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[160433], 99.50th=[191890], 99.90th=[263193], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 134, per=25.17%, avg=41.53, stdev=20.69, samples=283 iops : min= 1, max= 33, avg= 9.73, stdev= 5.20, samples=283 write: IOPS=10, BW=43.3KiB/s (44.3kB/s)(6260KiB/144697msec); 0 zone resets clat (usec): min=938, max=601400, avg=49405.71, stdev=51113.23 lat (usec): min=938, max=601403, avg=49412.64, stdev=51111.41 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1319], 10.00th=[ 2114], 20.00th=[ 5473], | 30.00th=[ 12649], 40.00th=[ 27395], 50.00th=[ 39584], 60.00th=[ 51119], | 70.00th=[ 63177], 80.00th=[ 81265], 90.00th=[110625], 95.00th=[139461], | 99.00th=[229639], 99.50th=[256902], 99.90th=[549454], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 6, max= 127, per=24.89%, avg=43.06, stdev=19.84, samples=283 iops : min= 1, max= 31, avg=10.13, stdev= 5.00, samples=283 lat (usec) : 50=0.52%, 100=4.92%, 250=0.75%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.16% lat (msec) : 2=4.85%, 4=3.55%, 10=5.89%, 20=7.42%, 50=34.28% lat (msec) : 100=27.08%, 250=9.80%, 500=0.46%, 750=0.07% cpu : usr=0.08%, sys=4.86%, ctx=6786, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145737: Sun Sep 6 00:59:35 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6052KiB/141872msec) clat (usec): min=31, max=475695, avg=44943.69, stdev=37998.15 lat (usec): min=31, max=475695, avg=44948.02, stdev=38001.05 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 101], 20.00th=[ 19792], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 68682], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[154141], 99.50th=[175113], 99.90th=[371196], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 135, per=25.93%, avg=42.79, stdev=20.68, samples=276 iops : min= 1, max= 33, avg=10.05, stdev= 5.21, samples=276 write: IOPS=10, BW=43.0KiB/s (45.0kB/s)(6236KiB/141872msec); 0 zone resets clat (usec): min=920, max=503457, avg=47238.10, stdev=48882.90 lat (usec): min=922, max=503460, avg=47250.70, stdev=48877.21 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1369], 10.00th=[ 2057], 20.00th=[ 4817], | 30.00th=[ 9372], 40.00th=[ 19792], 50.00th=[ 33424], 60.00th=[ 47449], | 70.00th=[ 65274], 80.00th=[ 84411], 90.00th=[113771], 95.00th=[137364], | 99.00th=[191890], 99.50th=[217056], 99.90th=[325059], 99.95th=[505414], | 99.99th=[505414] bw ( KiB/s): min= 6, max= 127, per=25.19%, avg=43.58, stdev=20.02, samples=279 iops : min= 1, max= 31, avg=10.25, stdev= 5.06, samples=279 lat (usec) : 50=0.55%, 100=4.30%, 250=1.17%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.26% lat (msec) : 2=5.05%, 4=4.13%, 10=6.87%, 20=7.68%, 50=33.30% lat (msec) : 100=25.91%, 250=10.12%, 500=0.33%, 750=0.03% cpu : usr=0.07%, sys=5.10%, ctx=6785, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=166KiB/s (170kB/s), 41.1KiB/s-42.7KiB/s (42.1kB/s-43.7kB/s), io=23.4MiB (24.6MB), run=141872-144697msec WRITE: bw=174KiB/s (178kB/s), 43.3KiB/s-44.2KiB/s (44.3kB/s-45.3kB/s), io=24.6MiB (25.7MB), run=141872-144697msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145729: Sun Sep 6 01:02:22 2026 read: IOPS=4, BW=19.3KiB/s (19.8kB/s)(5992KiB/310028msec) clat (msec): min=6, max=833, avg=45.31, stdev=46.46 lat (msec): min=6, max=833, avg=45.31, stdev=46.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 61], 90.00th=[ 89], 95.00th=[ 114], | 99.00th=[ 190], 99.50th=[ 296], 99.90th=[ 600], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 87, per=28.63%, avg=21.76, stdev=14.56, samples=530 iops : min= 1, max= 21, avg= 4.81, stdev= 3.68, samples=530 write: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6296KiB/310028msec); 0 zone resets clat (msec): min=46, max=802, avg=153.55, stdev=70.26 lat (msec): min=46, max=802, avg=153.56, stdev=70.26 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 74], 10.00th=[ 84], 20.00th=[ 97], | 30.00th=[ 112], 40.00th=[ 125], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 284], | 99.00th=[ 380], 99.50th=[ 468], 99.90th=[ 609], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 48, per=25.17%, avg=20.14, stdev= 8.76, samples=599 iops : min= 1, max= 12, avg= 4.40, stdev= 2.26, samples=599 lat (msec) : 10=1.46%, 20=10.32%, 50=22.82%, 100=21.19%, 250=39.42% lat (msec) : 500=4.56%, 750=0.16%, 1000=0.07% cpu : usr=0.05%, sys=1.14%, ctx=5428, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145730: Sun Sep 6 01:02:22 2026 read: IOPS=4, BW=19.0KiB/s (19.5kB/s)(5940KiB/312622msec) clat (msec): min=6, max=670, avg=44.99, stdev=39.96 lat (msec): min=6, max=670, avg=44.99, stdev=39.96 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 91], 95.00th=[ 118], | 99.00th=[ 182], 99.50th=[ 213], 99.90th=[ 447], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 88, per=29.01%, avg=22.05, stdev=14.31, samples=518 iops : min= 1, max= 22, avg= 4.89, stdev= 3.62, samples=518 write: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6348KiB/312622msec); 0 zone resets clat (msec): min=36, max=728, avg=154.61, stdev=72.24 lat (msec): min=36, max=728, avg=154.61, stdev=72.24 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 83], 20.00th=[ 99], | 30.00th=[ 111], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 288], | 99.00th=[ 388], 99.50th=[ 447], 99.90th=[ 709], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 48, per=24.86%, avg=19.89, stdev= 8.83, samples=611 iops : min= 1, max= 12, avg= 4.34, stdev= 2.27, samples=611 lat (msec) : 10=1.07%, 20=10.55%, 50=22.85%, 100=21.39%, 250=39.29% lat (msec) : 500=4.65%, 750=0.20% cpu : usr=0.04%, sys=1.16%, ctx=5496, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145731: Sun Sep 6 01:02:22 2026 read: IOPS=4, BW=19.5KiB/s (19.0kB/s)(6028KiB/309168msec) clat (msec): min=4, max=607, avg=46.07, stdev=40.02 lat (msec): min=4, max=607, avg=46.07, stdev=40.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 93], 95.00th=[ 118], | 99.00th=[ 180], 99.50th=[ 236], 99.90th=[ 338], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 79, per=28.03%, avg=21.30, stdev=14.12, samples=544 iops : min= 1, max= 19, avg= 4.70, stdev= 3.55, samples=544 write: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6260KiB/309168msec); 0 zone resets clat (msec): min=39, max=698, avg=152.90, stdev=71.02 lat (msec): min=39, max=698, avg=152.91, stdev=71.02 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 73], 10.00th=[ 83], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 197], 90.00th=[ 241], 95.00th=[ 288], | 99.00th=[ 384], 99.50th=[ 456], 99.90th=[ 684], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 47, per=25.12%, avg=20.10, stdev= 8.93, samples=597 iops : min= 1, max= 11, avg= 4.40, stdev= 2.30, samples=597 lat (msec) : 10=1.89%, 20=9.21%, 50=23.11%, 100=22.20%, 250=39.00% lat (msec) : 500=4.36%, 750=0.23% cpu : usr=0.04%, sys=1.12%, ctx=5352, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145732: Sun Sep 6 01:02:22 2026 read: IOPS=4, BW=19.7KiB/s (20.1kB/s)(6052KiB/307798msec) clat (msec): min=7, max=825, avg=44.96, stdev=43.62 lat (msec): min=7, max=825, avg=44.96, stdev=43.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 90], 95.00th=[ 117], | 99.00th=[ 199], 99.50th=[ 239], 99.90th=[ 443], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 95, per=29.76%, avg=22.62, stdev=15.41, samples=516 iops : min= 1, max= 23, avg= 5.03, stdev= 3.91, samples=516 write: IOPS=5, BW=20.3KiB/s (20.7kB/s)(6236KiB/307798msec); 0 zone resets clat (msec): min=46, max=728, avg=153.52, stdev=71.44 lat (msec): min=46, max=728, avg=153.52, stdev=71.44 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 74], 10.00th=[ 83], 20.00th=[ 100], | 30.00th=[ 110], 40.00th=[ 123], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 284], | 99.00th=[ 368], 99.50th=[ 456], 99.90th=[ 709], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 47, per=24.82%, avg=19.86, stdev= 8.82, samples=602 iops : min= 1, max= 11, avg= 4.33, stdev= 2.26, samples=602 lat (msec) : 10=1.40%, 20=10.48%, 50=23.05%, 100=21.19%, 250=39.03% lat (msec) : 500=4.69%, 750=0.13%, 1000=0.03% cpu : usr=0.04%, sys=1.13%, ctx=5496, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=76.8KiB/s (78.7kB/s), 19.0KiB/s-19.7KiB/s (19.5kB/s-20.1kB/s), io=23.4MiB (24.6MB), run=307798-312622msec WRITE: bw=80.4KiB/s (82.3kB/s), 20.2KiB/s-20.3KiB/s (20.7kB/s-20.8kB/s), io=24.6MiB (25.7MB), run=307798-312622msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145816: Sun Sep 6 01:03:09 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(5920KiB/35016msec) clat (usec): min=30, max=280391, avg=47543.46, stdev=40153.53 lat (usec): min=30, max=280393, avg=47544.78, stdev=40153.58 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 59], 10.00th=[ 64], 20.00th=[ 96], | 30.00th=[ 28443], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 51119], | 70.00th=[ 61604], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[119014], | 99.00th=[196084], 99.50th=[204473], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 32, max= 286, per=24.63%, avg=168.49, stdev=60.44, samples=68 iops : min= 2, max= 17, avg= 9.74, stdev= 3.80, samples=68 write: IOPS=11, BW=182KiB/s (186kB/s)(6368KiB/35016msec); 0 zone resets clat (usec): min=1528, max=306736, avg=43667.40, stdev=46799.84 lat (usec): min=1530, max=306738, avg=43690.80, stdev=46786.43 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2008], 10.00th=[ 3425], 20.00th=[ 6718], | 30.00th=[ 10028], 40.00th=[ 16057], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 55837], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[130548], | 99.00th=[233833], 99.50th=[270533], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 55, max= 375, per=25.38%, avg=182.49, stdev=74.12, samples=68 iops : min= 3, max= 23, avg=10.63, stdev= 4.67, samples=68 lat (usec) : 50=1.30%, 100=8.46%, 250=0.78%, 500=0.26% lat (msec) : 2=2.73%, 4=3.65%, 10=9.38%, 20=7.68%, 50=28.39% lat (msec) : 100=27.08%, 250=9.77%, 500=0.52% cpu : usr=0.08%, sys=4.50%, ctx=1453, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145817: Sun Sep 6 01:03:09 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(5744KiB/34770msec) clat (usec): min=38, max=365406, avg=49180.48, stdev=42863.83 lat (usec): min=38, max=365407, avg=49182.13, stdev=42863.66 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 155], | 30.00th=[ 31327], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 52691], | 70.00th=[ 64750], 80.00th=[ 77071], 90.00th=[ 94897], 95.00th=[110625], | 99.00th=[191890], 99.50th=[333448], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 27, max= 375, per=24.20%, avg=165.55, stdev=66.06, samples=67 iops : min= 1, max= 23, avg= 9.55, stdev= 4.18, samples=67 write: IOPS=11, BW=188KiB/s (193kB/s)(6544KiB/34770msec); 0 zone resets clat (usec): min=1423, max=341338, avg=41721.23, stdev=46295.54 lat (usec): min=1424, max=341340, avg=41729.75, stdev=46291.83 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1860], 10.00th=[ 3064], 20.00th=[ 6194], | 30.00th=[ 9765], 40.00th=[ 15664], 50.00th=[ 26608], 60.00th=[ 36439], | 70.00th=[ 51119], 80.00th=[ 69731], 90.00th=[106431], 95.00th=[128451], | 99.00th=[200279], 99.50th=[223347], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 445, per=25.74%, avg=185.09, stdev=86.98, samples=68 iops : min= 1, max= 27, avg=10.79, stdev= 5.49, samples=68 lat (usec) : 50=1.04%, 100=7.94%, 250=0.39%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.26%, 4=4.56%, 10=8.98%, 20=7.81%, 50=29.43% lat (msec) : 100=26.43%, 250=9.24%, 500=0.52% cpu : usr=0.06%, sys=4.40%, ctx=1395, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145818: Sun Sep 6 01:03:09 2026 read: IOPS=11, BW=182KiB/s (187kB/s)(6256KiB/34319msec) clat (usec): min=37, max=400369, avg=47951.22, stdev=43804.08 lat (usec): min=38, max=400370, avg=47959.09, stdev=43804.07 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 88], | 30.00th=[ 27395], 40.00th=[ 35914], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 60556], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[123208], | 99.00th=[173016], 99.50th=[316670], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 27, max= 414, per=26.82%, avg=183.43, stdev=84.61, samples=67 iops : min= 1, max= 25, avg=10.67, stdev= 5.32, samples=67 write: IOPS=10, BW=176KiB/s (180kB/s)(6032KiB/34319msec); 0 zone resets clat (usec): min=1427, max=306578, avg=41092.01, stdev=43017.99 lat (usec): min=1430, max=306580, avg=41095.64, stdev=43016.81 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1745], 10.00th=[ 2442], 20.00th=[ 6063], | 30.00th=[ 8979], 40.00th=[ 13304], 50.00th=[ 25822], 60.00th=[ 39584], | 70.00th=[ 56886], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[119014], | 99.00th=[173016], 99.50th=[217056], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 32, max= 438, per=24.57%, avg=176.64, stdev=78.43, samples=66 iops : min= 2, max= 27, avg=10.26, stdev= 4.92, samples=66 lat (usec) : 50=1.82%, 100=8.85%, 250=0.39%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.04%, 4=3.91%, 10=8.72%, 20=7.16%, 50=26.04% lat (msec) : 100=27.73%, 250=10.42%, 500=0.39% cpu : usr=0.09%, sys=4.69%, ctx=1412, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145819: Sun Sep 6 01:03:09 2026 read: IOPS=11, BW=178KiB/s (182kB/s)(6032KiB/33937msec) clat (usec): min=32, max=259916, avg=49123.71, stdev=39920.10 lat (usec): min=32, max=259918, avg=49125.66, stdev=39919.31 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 277], | 30.00th=[ 29754], 40.00th=[ 39584], 50.00th=[ 45876], 60.00th=[ 54264], | 70.00th=[ 62129], 80.00th=[ 78119], 90.00th=[ 98042], 95.00th=[121111], | 99.00th=[160433], 99.50th=[256902], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 57, max= 375, per=25.74%, avg=176.09, stdev=63.80, samples=66 iops : min= 3, max= 23, avg=10.23, stdev= 4.05, samples=66 write: IOPS=11, BW=184KiB/s (189kB/s)(6256KiB/33937msec); 0 zone resets clat (usec): min=1395, max=359314, avg=39256.20, stdev=45295.61 lat (usec): min=1397, max=359316, avg=39258.51, stdev=45295.54 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1942], 10.00th=[ 3130], 20.00th=[ 5473], | 30.00th=[ 8455], 40.00th=[ 12256], 50.00th=[ 21627], 60.00th=[ 33424], | 70.00th=[ 51119], 80.00th=[ 70779], 90.00th=[100140], 95.00th=[122160], | 99.00th=[221250], 99.50th=[258999], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 62, max= 414, per=25.94%, avg=186.48, stdev=75.53, samples=65 iops : min= 3, max= 25, avg=10.89, stdev= 4.81, samples=65 lat (usec) : 50=1.30%, 100=7.68%, 250=0.78%, 500=0.26%, 750=0.26% lat (msec) : 2=3.52%, 4=4.04%, 10=11.07%, 20=7.94%, 50=25.39% lat (msec) : 100=28.13%, 250=9.11%, 500=0.52% cpu : usr=0.08%, sys=4.74%, ctx=1492, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=684KiB/s (700kB/s), 165KiB/s-182KiB/s (169kB/s-187kB/s), io=23.4MiB (24.5MB), run=33937-35016msec WRITE: bw=720KiB/s (737kB/s), 176KiB/s-188KiB/s (180kB/s-193kB/s), io=24.6MiB (25.8MB), run=33937-35016msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145811: Sun Sep 6 01:04:00 2026 read: IOPS=4, BW=68.0KiB/s (69.7kB/s)(5920KiB/87014msec) clat (msec): min=8, max=609, avg=53.48, stdev=55.92 lat (msec): min=9, max=609, avg=53.48, stdev=55.92 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 101], 95.00th=[ 140], | 99.00th=[ 275], 99.50th=[ 338], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 30, max= 286, per=29.24%, avg=80.12, stdev=48.23, samples=145 iops : min= 1, max= 17, avg= 4.19, stdev= 3.08, samples=145 write: IOPS=4, BW=73.2KiB/s (74.9kB/s)(6368KiB/87014msec); 0 zone resets clat (msec): min=54, max=461, avg=168.50, stdev=73.31 lat (msec): min=54, max=461, avg=168.51, stdev=73.31 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 79], 10.00th=[ 94], 20.00th=[ 111], | 30.00th=[ 124], 40.00th=[ 138], 50.00th=[ 153], 60.00th=[ 169], | 70.00th=[ 190], 80.00th=[ 222], 90.00th=[ 262], 95.00th=[ 317], | 99.00th=[ 418], 99.50th=[ 460], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 30, max= 160, per=26.03%, avg=74.97, stdev=32.87, samples=167 iops : min= 1, max= 10, avg= 3.86, stdev= 2.12, samples=167 lat (msec) : 10=0.52%, 20=7.16%, 50=23.70%, 100=18.36%, 250=42.71% lat (msec) : 500=7.42%, 750=0.13% cpu : usr=0.03%, sys=1.11%, ctx=1267, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145812: Sun Sep 6 01:04:00 2026 read: IOPS=4, BW=65.8KiB/s (67.3kB/s)(5744KiB/87352msec) clat (msec): min=9, max=289, avg=47.68, stdev=40.82 lat (msec): min=9, max=289, avg=47.68, stdev=40.82 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 86], 95.00th=[ 140], | 99.00th=[ 211], 99.50th=[ 284], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 319, per=30.99%, avg=84.90, stdev=53.16, samples=132 iops : min= 1, max= 19, avg= 4.50, stdev= 3.32, samples=132 write: IOPS=4, BW=74.9KiB/s (76.7kB/s)(6544KiB/87352msec); 0 zone resets clat (msec): min=53, max=661, avg=171.28, stdev=80.87 lat (msec): min=53, max=661, avg=171.29, stdev=80.87 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 79], 10.00th=[ 89], 20.00th=[ 108], | 30.00th=[ 123], 40.00th=[ 138], 50.00th=[ 153], 60.00th=[ 169], | 70.00th=[ 188], 80.00th=[ 228], 90.00th=[ 284], 95.00th=[ 326], | 99.00th=[ 430], 99.50th=[ 447], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 30, max= 190, per=26.28%, avg=75.69, stdev=34.89, samples=169 iops : min= 1, max= 11, avg= 3.91, stdev= 2.26, samples=169 lat (msec) : 10=0.26%, 20=6.77%, 50=26.04%, 100=18.36%, 250=40.23% lat (msec) : 500=8.20%, 750=0.13% cpu : usr=0.04%, sys=1.08%, ctx=1269, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145813: Sun Sep 6 01:04:00 2026 read: IOPS=4, BW=73.4KiB/s (75.2kB/s)(6256KiB/85242msec) clat (msec): min=6, max=321, avg=48.14, stdev=41.63 lat (msec): min=6, max=321, avg=48.15, stdev=41.63 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 64], 90.00th=[ 100], 95.00th=[ 132], | 99.00th=[ 239], 99.50th=[ 275], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 442, per=31.05%, avg=85.07, stdev=60.49, samples=145 iops : min= 1, max= 27, avg= 4.52, stdev= 3.84, samples=145 write: IOPS=4, BW=70.8KiB/s (72.5kB/s)(6032KiB/85242msec); 0 zone resets clat (msec): min=57, max=532, avg=175.70, stdev=81.52 lat (msec): min=57, max=532, avg=175.72, stdev=81.51 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 81], 10.00th=[ 90], 20.00th=[ 111], | 30.00th=[ 125], 40.00th=[ 138], 50.00th=[ 153], 60.00th=[ 176], | 70.00th=[ 199], 80.00th=[ 234], 90.00th=[ 300], 95.00th=[ 342], | 99.00th=[ 430], 99.50th=[ 502], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 30, max= 157, per=24.79%, avg=71.38, stdev=30.77, samples=165 iops : min= 1, max= 9, avg= 3.64, stdev= 2.00, samples=165 lat (msec) : 10=0.52%, 20=7.94%, 50=26.30%, 100=18.23%, 250=38.41% lat (msec) : 500=8.46%, 750=0.13% cpu : usr=0.04%, sys=1.09%, ctx=1346, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145814: Sun Sep 6 01:04:00 2026 read: IOPS=4, BW=69.3KiB/s (70.9kB/s)(6032KiB/87086msec) clat (msec): min=6, max=603, avg=52.78, stdev=57.48 lat (msec): min=6, max=603, avg=52.78, stdev=57.48 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 66], 90.00th=[ 102], 95.00th=[ 150], | 99.00th=[ 351], 99.50th=[ 430], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 30, max= 347, per=29.83%, avg=81.73, stdev=52.35, samples=144 iops : min= 1, max= 21, avg= 4.29, stdev= 3.31, samples=144 write: IOPS=4, BW=71.8KiB/s (73.6kB/s)(6256KiB/87086msec); 0 zone resets clat (msec): min=44, max=472, avg=171.66, stdev=78.71 lat (msec): min=44, max=472, avg=171.67, stdev=78.71 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 81], 10.00th=[ 91], 20.00th=[ 110], | 30.00th=[ 126], 40.00th=[ 138], 50.00th=[ 153], 60.00th=[ 171], | 70.00th=[ 194], 80.00th=[ 228], 90.00th=[ 292], 95.00th=[ 330], | 99.00th=[ 430], 99.50th=[ 468], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 30, max= 160, per=25.70%, avg=74.02, stdev=31.06, samples=166 iops : min= 1, max= 10, avg= 3.81, stdev= 2.03, samples=166 lat (msec) : 10=0.65%, 20=7.81%, 50=24.87%, 100=17.45%, 250=41.41% lat (msec) : 500=7.68%, 750=0.13% cpu : usr=0.04%, sys=1.09%, ctx=1276, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=274KiB/s (281kB/s), 65.8KiB/s-73.4KiB/s (67.3kB/s-75.2kB/s), io=23.4MiB (24.5MB), run=85242-87352msec WRITE: bw=288KiB/s (295kB/s), 70.8KiB/s-74.9KiB/s (72.5kB/s-76.7kB/s), io=24.6MiB (25.8MB), run=85242-87352msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145842: Sun Sep 6 01:04:14 2026 read: IOPS=2, BW=2140KiB/s (2191kB/s)(7168KiB/3350msec) clat (msec): min=85, max=711, avg=221.83, stdev=218.14 lat (msec): min=85, max=711, avg=221.83, stdev=218.14 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 109], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 159], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 178], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1950, max= 5555, per=64.66%, avg=2887.75, stdev=1778.50, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1528KiB/s (1565kB/s)(5120KiB/3350msec); 0 zone resets clat (msec): min=200, max=609, avg=343.61, stdev=193.47 lat (msec): min=200, max=609, avg=343.74, stdev=193.49 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2027, max= 6131, per=65.23%, avg=4079.00, stdev=2901.97, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=16.67% cpu : usr=0.00%, sys=3.85%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145843: Sun Sep 6 01:04:14 2026 read: IOPS=0, BW=447KiB/s (457kB/s)(2048KiB/4585msec) clat (msec): min=148, max=226, avg=187.18, stdev=55.04 lat (msec): min=148, max=226, avg=187.18, stdev=55.04 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 226], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 226], 95.00th=[ 226], | 99.00th=[ 226], 99.50th=[ 226], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 1818, max= 2043, per=43.23%, avg=1930.50, stdev=159.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2233KiB/s (2287kB/s)(10.0MiB/4585msec); 0 zone resets clat (msec): min=223, max=660, avg=411.48, stdev=129.44 lat (msec): min=223, max=661, avg=411.68, stdev=129.47 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 321], | 30.00th=[ 326], 40.00th=[ 351], 50.00th=[ 393], 60.00th=[ 409], | 70.00th=[ 418], 80.00th=[ 422], 90.00th=[ 592], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1818, max= 4096, per=36.59%, avg=2287.71, stdev=801.07, samples=7 iops : min= 1, max= 4, avg= 1.43, stdev= 1.13, samples=7 lat (msec) : 250=25.00%, 500=58.33%, 750=16.67% cpu : usr=0.02%, sys=3.88%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145844: Sun Sep 6 01:04:14 2026 read: IOPS=1, BW=1418KiB/s (1452kB/s)(6144KiB/4332msec) clat (msec): min=183, max=718, avg=387.66, stdev=221.52 lat (msec): min=183, max=718, avg=387.66, stdev=221.52 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 426], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1950, max= 2048, per=44.91%, avg=2005.60, stdev=36.86, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1418KiB/s (1452kB/s)(6144KiB/4332msec); 0 zone resets clat (msec): min=204, max=619, avg=327.39, stdev=153.87 lat (msec): min=205, max=619, avg=328.43, stdev=153.41 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 296], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2019, max= 3586, per=37.50%, avg=2344.60, stdev=694.06, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=2.66%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145845: Sun Sep 6 01:04:14 2026 read: IOPS=1, BW=1257KiB/s (1287kB/s)(5120KiB/4074msec) clat (msec): min=146, max=407, avg=252.13, stdev=115.11 lat (msec): min=146, max=407, avg=252.13, stdev=115.11 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1950, max= 3984, per=59.54%, avg=2659.00, stdev=1148.43, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1759KiB/s (1802kB/s)(7168KiB/4074msec); 0 zone resets clat (msec): min=210, max=652, avg=394.11, stdev=158.99 lat (msec): min=212, max=652, avg=394.48, stdev=158.70 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 213], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 384], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 523], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1950, max= 3915, per=38.25%, avg=2391.80, stdev=852.29, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=4.00%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4467KiB/s (4574kB/s), 447KiB/s-2140KiB/s (457kB/s-2191kB/s), io=20.0MiB (20.0MB), run=3350-4585msec WRITE: bw=6253KiB/s (6404kB/s), 1418KiB/s-2233KiB/s (1452kB/s-2287kB/s), io=28.0MiB (29.4MB), run=3350-4585msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145847: Sun Sep 6 01:04:15 2026 read: IOPS=2, BW=2436KiB/s (2494kB/s)(7168KiB/2943msec) clat (usec): min=880, max=306341, avg=177800.58, stdev=131298.05 lat (usec): min=881, max=306342, avg=177802.26, stdev=131297.93 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 2933], | 30.00th=[158335], 40.00th=[158335], 50.00th=[208667], 60.00th=[263193], | 70.00th=[263193], 80.00th=[304088], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 2011, max= 4096, per=54.87%, avg=2741.50, stdev=983.19, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1740KiB/s (1781kB/s)(5120KiB/2943msec); 0 zone resets clat (msec): min=137, max=781, avg=325.91, stdev=259.10 lat (msec): min=137, max=781, avg=326.00, stdev=259.12 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 222], 60.00th=[ 222], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2019, max= 4096, per=38.80%, avg=2714.00, stdev=1196.85, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=14.21%, ctx=242, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145848: Sun Sep 6 01:04:15 2026 read: IOPS=0, BW=500KiB/s (512kB/s)(2048KiB/4099msec) clat (msec): min=39, max=627, avg=333.52, stdev=415.51 lat (msec): min=39, max=627, avg=333.52, stdev=415.51 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 40], | 30.00th=[ 40], 40.00th=[ 40], 50.00th=[ 40], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2011, max= 2048, per=40.62%, avg=2029.50, stdev=26.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2498KiB/s (2558kB/s)(10.0MiB/4099msec); 0 zone resets clat (msec): min=125, max=1069, avg=342.79, stdev=276.13 lat (msec): min=125, max=1069, avg=343.01, stdev=276.07 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 155], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 218], 60.00th=[ 288], | 70.00th=[ 309], 80.00th=[ 414], 90.00th=[ 447], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 2027, max= 4096, per=46.52%, avg=3253.80, stdev=1120.31, samples=5 iops : min= 1, max= 4, avg= 2.60, stdev= 1.52, samples=5 lat (msec) : 50=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.37%, ctx=104, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145849: Sun Sep 6 01:04:15 2026 read: IOPS=1, BW=1544KiB/s (1582kB/s)(6144KiB/3978msec) clat (usec): min=546, max=782468, avg=217961.42, stdev=293758.81 lat (usec): min=547, max=782470, avg=217962.97, stdev=293758.96 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 553], | 30.00th=[ 553], 40.00th=[ 84411], 50.00th=[ 84411], 60.00th=[206570], | 70.00th=[233833], 80.00th=[233833], 90.00th=[784335], 95.00th=[784335], | 99.00th=[784335], 99.50th=[784335], 99.90th=[784335], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 2048, max= 4096, per=68.05%, avg=3399.67, stdev=1170.76, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1544KiB/s (1582kB/s)(6144KiB/3978msec); 0 zone resets clat (msec): min=133, max=1175, avg=444.72, stdev=375.48 lat (msec): min=133, max=1175, avg=444.84, stdev=375.43 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 380], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 2011, max= 3117, per=32.90%, avg=2300.75, stdev=544.38, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=12.12%, ctx=178, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145850: Sun Sep 6 01:04:15 2026 read: IOPS=1, BW=1379KiB/s (1412kB/s)(5120KiB/3712msec) clat (usec): min=1607, max=462011, avg=243462.98, stdev=165244.95 lat (usec): min=1609, max=462012, avg=243464.65, stdev=165244.89 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1614], 10.00th=[ 1614], 20.00th=[ 1614], | 30.00th=[229639], 40.00th=[229639], 50.00th=[229639], 60.00th=[229639], | 70.00th=[295699], 80.00th=[295699], 90.00th=[463471], 95.00th=[463471], | 99.00th=[463471], 99.50th=[463471], 99.90th=[463471], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 4039, max= 4096, per=81.42%, avg=4067.50, stdev=40.31, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1931KiB/s (1977kB/s)(7168KiB/3712msec); 0 zone resets clat (msec): min=160, max=519, avg=354.89, stdev=135.57 lat (msec): min=160, max=519, avg=355.00, stdev=135.59 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 330], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 489], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1424, max= 4055, per=41.27%, avg=2886.25, stdev=1370.67, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 2=8.33%, 250=25.00%, 500=58.33%, 750=8.33% cpu : usr=0.05%, sys=15.84%, ctx=209, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4996KiB/s (5116kB/s), 500KiB/s-2436KiB/s (512kB/s-2494kB/s), io=20.0MiB (20.0MB), run=2943-4099msec WRITE: bw=6995KiB/s (7163kB/s), 1544KiB/s-2498KiB/s (1582kB/s-2558kB/s), io=28.0MiB (29.4MB), run=2943-4099msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145858: Sun Sep 6 01:04:31 2026 read: IOPS=0, BW=2126KiB/s (2177kB/s)(12.0MiB/5779msec) clat (msec): min=836, max=3525, avg=1858.92, stdev=1455.48 lat (msec): min=836, max=3525, avg=1858.92, stdev=1455.48 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 3540], 80.00th=[ 3540], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 8000, max= 8126, per=100.00%, avg=8063.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.92%, ctx=700, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145859: Sun Sep 6 01:04:31 2026 read: IOPS=0, BW=671KiB/s (688kB/s)(4096KiB/6100msec) clat (nsec): min=842354k, max=842354k, avg=842353614.00, stdev= 0.00 lat (nsec): min=842355k, max=842355k, avg=842355281.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1343KiB/s (1375kB/s)(8192KiB/6100msec); 0 zone resets clat (msec): min=1827, max=3309, avg=2568.28, stdev=1047.69 lat (msec): min=1828, max=3309, avg=2568.87, stdev=1047.53 clat percentiles (msec): | 1.00th=[ 1821], 5.00th=[ 1821], 10.00th=[ 1821], 20.00th=[ 1821], | 30.00th=[ 1821], 40.00th=[ 1821], 50.00th=[ 1821], 60.00th=[ 3306], | 70.00th=[ 3306], 80.00th=[ 3306], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.95%, ctx=139, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145861: Sun Sep 6 01:04:31 2026 write: IOPS=0, BW=1951KiB/s (1998kB/s)(12.0MiB/6297msec); 0 zone resets clat (msec): min=1046, max=3750, avg=2007.76, stdev=1511.65 lat (msec): min=1047, max=3750, avg=2008.85, stdev=1511.25 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 3742], 80.00th=[ 3742], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.84%, ctx=128, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145863: Sun Sep 6 01:04:31 2026 write: IOPS=0, BW=2191KiB/s (2244kB/s)(12.0MiB/5608msec); 0 zone resets clat (msec): min=387, max=4510, avg=1773.21, stdev=2370.29 lat (msec): min=388, max=4512, avg=1775.24, stdev=2371.01 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 422], 50.00th=[ 422], 60.00th=[ 422], | 70.00th=[ 4530], 80.00th=[ 4530], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 5843, max= 8126, per=100.00%, avg=6984.50, stdev=1614.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.96%, ctx=95, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2686KiB/s (2750kB/s), 671KiB/s-2126KiB/s (688kB/s-2177kB/s), io=16.0MiB (16.8MB), run=5779-6100msec WRITE: bw=5204KiB/s (5329kB/s), 1343KiB/s-2191KiB/s (1375kB/s-2244kB/s), io=32.0MiB (33.6MB), run=5608-6297msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145860: Sun Sep 6 01:04:31 2026 read: IOPS=0, BW=2090KiB/s (2140kB/s)(12.0MiB/5879msec) clat (msec): min=460, max=3926, avg=1934.60, stdev=1790.15 lat (msec): min=460, max=3926, avg=1934.60, stdev=1790.16 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.70%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145862: Sun Sep 6 01:04:31 2026 read: IOPS=0, BW=610KiB/s (624kB/s)(4096KiB/6719msec) clat (nsec): min=4084.5M, max=4084.5M, avg=4084460984.00, stdev= 0.00 lat (nsec): min=4084.5M, max=4084.5M, avg=4084463397.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4077], 5.00th=[ 4077], 10.00th=[ 4077], 20.00th=[ 4077], | 30.00th=[ 4077], 40.00th=[ 4077], 50.00th=[ 4077], 60.00th=[ 4077], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1219KiB/s (1248kB/s)(8192KiB/6719msec); 0 zone resets clat (msec): min=769, max=1698, avg=1234.00, stdev=656.68 lat (msec): min=772, max=1698, avg=1235.47, stdev=655.33 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.98%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145864: Sun Sep 6 01:04:31 2026 write: IOPS=0, BW=1822KiB/s (1866kB/s)(12.0MiB/6744msec); 0 zone resets clat (msec): min=429, max=4764, avg=2173.67, stdev=2287.84 lat (msec): min=430, max=4764, avg=2174.15, stdev=2287.93 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 4732], 80.00th=[ 4732], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.79%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145865: Sun Sep 6 01:04:31 2026 write: IOPS=0, BW=2023KiB/s (2071kB/s)(12.0MiB/6075msec); 0 zone resets clat (msec): min=826, max=3432, avg=1982.96, stdev=1327.57 lat (msec): min=827, max=3433, avg=1983.85, stdev=1327.22 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 1687], 50.00th=[ 1687], 60.00th=[ 1687], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=2.98%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2438KiB/s (2497kB/s), 610KiB/s-2090KiB/s (624kB/s-2140kB/s), io=16.0MiB (16.8MB), run=5879-6719msec WRITE: bw=4859KiB/s (4975kB/s), 1219KiB/s-2023KiB/s (1248kB/s-2071kB/s), io=32.0MiB (33.6MB), run=6075-6744msec