== sanity test 398b: DIO and buffer IO race ============== 04:35:22 (1789461322) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.11004 s, 6.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179178: Tue Sep 15 04:37:38 2026 read: IOPS=13, BW=53.0KiB/s (54.3kB/s)(5992KiB/113023msec) clat (usec): min=33, max=887351, avg=42077.03, stdev=34923.12 lat (usec): min=33, max=887353, avg=42085.07, stdev=34924.31 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10290], 10.00th=[ 16057], 20.00th=[ 21103], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[164627], 99.90th=[219153], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 15, max= 111, per=25.01%, avg=53.02, stdev=19.49, samples=221 iops : min= 3, max= 27, avg=12.62, stdev= 4.91, samples=221 write: IOPS=13, BW=55.7KiB/s (57.0kB/s)(6296KiB/113023msec); 0 zone resets clat (usec): min=779, max=188971, avg=31504.28, stdev=31743.21 lat (usec): min=779, max=188973, avg=31506.36, stdev=31742.97 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 3097], | 30.00th=[ 6783], 40.00th=[ 16188], 50.00th=[ 24249], 60.00th=[ 30802], | 70.00th=[ 40633], 80.00th=[ 54789], 90.00th=[ 73925], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[164627], 99.90th=[183501], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 7, max= 159, per=25.07%, avg=55.66, stdev=23.37, samples=221 iops : min= 1, max= 39, avg=13.28, stdev= 5.90, samples=221 lat (usec) : 50=0.20%, 100=1.63%, 250=0.13%, 500=0.07%, 1000=0.36% lat (msec) : 2=7.23%, 4=4.43%, 10=6.05%, 20=11.30%, 50=42.29% lat (msec) : 100=22.53%, 250=3.78%, 1000=0.03% cpu : usr=0.08%, sys=4.78%, ctx=6210, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179179: Tue Sep 15 04:37:38 2026 read: IOPS=13, BW=53.1KiB/s (54.4kB/s)(5940KiB/111857msec) clat (usec): min=44, max=520010, avg=41063.20, stdev=28728.47 lat (usec): min=45, max=520013, avg=41066.04, stdev=28726.77 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 11076], 10.00th=[ 15664], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 29754], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 47973], 80.00th=[ 58459], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[132645], 99.50th=[154141], 99.90th=[210764], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 104, per=25.05%, avg=53.11, stdev=19.16, samples=219 iops : min= 1, max= 26, avg=12.63, stdev= 4.82, samples=219 write: IOPS=14, BW=56.8KiB/s (58.1kB/s)(6348KiB/111857msec); 0 zone resets clat (usec): min=710, max=561100, avg=31809.10, stdev=34509.18 lat (usec): min=711, max=561102, avg=31812.69, stdev=34510.87 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 3032], | 30.00th=[ 6783], 40.00th=[ 14746], 50.00th=[ 23462], 60.00th=[ 31589], | 70.00th=[ 40633], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[156238], 99.90th=[208667], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 15, max= 126, per=25.58%, avg=56.79, stdev=21.32, samples=219 iops : min= 3, max= 31, avg=13.55, stdev= 5.36, samples=219 lat (usec) : 50=0.13%, 100=1.43%, 250=0.07%, 750=0.03%, 1000=0.33% lat (msec) : 2=7.91%, 4=4.10%, 10=6.12%, 20=12.17%, 50=41.99% lat (msec) : 100=22.20%, 250=3.45%, 750=0.07% cpu : usr=0.08%, sys=4.93%, ctx=6307, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179180: Tue Sep 15 04:37:38 2026 read: IOPS=13, BW=55.0KiB/s (56.4kB/s)(6028KiB/109539msec) clat (usec): min=35, max=208914, avg=39982.79, stdev=25874.38 lat (usec): min=36, max=208915, avg=39986.22, stdev=25873.91 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10159], 10.00th=[ 14877], 20.00th=[ 20317], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 57410], 90.00th=[ 72877], 95.00th=[ 84411], | 99.00th=[127402], 99.50th=[147850], 99.90th=[191890], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 8, max= 119, per=25.97%, avg=55.07, stdev=20.01, samples=214 iops : min= 2, max= 29, avg=13.11, stdev= 5.02, samples=214 write: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6260KiB/109539msec); 0 zone resets clat (usec): min=700, max=600799, avg=31261.17, stdev=37844.21 lat (usec): min=702, max=600801, avg=31271.28, stdev=37850.70 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 2606], | 30.00th=[ 5211], 40.00th=[ 14484], 50.00th=[ 22414], 60.00th=[ 29492], | 70.00th=[ 38536], 80.00th=[ 53216], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[152044], 99.90th=[591397], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 118, per=25.58%, avg=56.79, stdev=22.62, samples=215 iops : min= 1, max= 29, avg=13.56, stdev= 5.74, samples=215 lat (usec) : 50=0.39%, 100=1.37%, 250=0.16%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.65% lat (msec) : 2=7.88%, 4=4.69%, 10=5.86%, 20=11.98%, 50=42.09% lat (msec) : 100=21.03%, 250=3.68%, 750=0.07% cpu : usr=0.08%, sys=4.85%, ctx=6144, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179181: Tue Sep 15 04:37:38 2026 read: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6052KiB/112351msec) clat (usec): min=35, max=183468, avg=40929.06, stdev=25707.75 lat (usec): min=35, max=183469, avg=40933.31, stdev=25706.68 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 77], 10.00th=[ 14353], 20.00th=[ 21103], | 30.00th=[ 26084], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 58983], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[120062], 99.50th=[139461], 99.90th=[181404], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 7, max= 120, per=25.42%, avg=53.88, stdev=18.31, samples=220 iops : min= 1, max= 30, avg=12.83, stdev= 4.62, samples=220 write: IOPS=13, BW=55.5KiB/s (56.8kB/s)(6236KiB/112351msec); 0 zone resets clat (usec): min=774, max=664257, avg=32048.13, stdev=37403.49 lat (usec): min=775, max=664258, avg=32053.52, stdev=37402.79 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 3097], | 30.00th=[ 6783], 40.00th=[ 15533], 50.00th=[ 23200], 60.00th=[ 31065], | 70.00th=[ 40633], 80.00th=[ 53740], 90.00th=[ 74974], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[162530], 99.90th=[488637], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 131, per=24.88%, avg=55.24, stdev=22.91, samples=221 iops : min= 1, max= 32, avg=13.17, stdev= 5.76, samples=221 lat (usec) : 50=0.65%, 100=2.02%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=7.26%, 4=3.84%, 10=6.22%, 20=11.78%, 50=42.06% lat (msec) : 100=22.23%, 250=3.45%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=4.89%, ctx=6247, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=212KiB/s (218kB/s), 53.0KiB/s-55.0KiB/s (54.3kB/s-56.4kB/s), io=23.4MiB (24.6MB), run=109539-113023msec WRITE: bw=222KiB/s (228kB/s), 55.5KiB/s-57.1KiB/s (56.8kB/s-58.5kB/s), io=24.6MiB (25.7MB), run=109539-113023msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179173: Tue Sep 15 04:38:19 2026 read: IOPS=9, BW=39.0KiB/s (39.0kB/s)(5992KiB/153565msec) clat (msec): min=4, max=974, avg=40.97, stdev=43.55 lat (msec): min=4, max=974, avg=40.97, stdev=43.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 84], 95.00th=[ 114], | 99.00th=[ 192], 99.50th=[ 209], 99.90th=[ 288], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 119, per=25.08%, avg=39.12, stdev=25.18, samples=298 iops : min= 1, max= 29, avg= 9.13, stdev= 6.33, samples=298 write: IOPS=10, BW=40.0KiB/s (41.0kB/s)(6296KiB/153565msec); 0 zone resets clat (msec): min=8, max=250, avg=58.35, stdev=38.45 lat (msec): min=8, max=250, avg=58.35, stdev=38.45 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 114], 95.00th=[ 134], | 99.00th=[ 188], 99.50th=[ 224], 99.90th=[ 251], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 7, max= 111, per=25.03%, avg=40.79, stdev=23.66, samples=300 iops : min= 1, max= 27, avg= 9.55, stdev= 5.97, samples=300 lat (msec) : 10=2.38%, 20=16.67%, 50=45.74%, 100=24.35%, 250=10.77% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=1.70%, ctx=4772, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179174: Tue Sep 15 04:38:19 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(5940KiB/153551msec) clat (msec): min=4, max=574, avg=39.94, stdev=38.83 lat (msec): min=4, max=574, avg=39.94, stdev=38.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 87], 95.00th=[ 115], | 99.00th=[ 194], 99.50th=[ 215], 99.90th=[ 292], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 127, per=25.22%, avg=39.34, stdev=25.32, samples=294 iops : min= 1, max= 31, avg= 9.19, stdev= 6.36, samples=294 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6348KiB/153551msec); 0 zone resets clat (msec): min=11, max=397, avg=59.15, stdev=41.03 lat (msec): min=11, max=397, avg=59.15, stdev=41.03 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 113], 95.00th=[ 138], | 99.00th=[ 209], 99.50th=[ 239], 99.90th=[ 300], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 126, per=25.04%, avg=40.81, stdev=24.33, samples=302 iops : min= 1, max= 31, avg= 9.55, stdev= 6.12, samples=302 lat (msec) : 10=2.12%, 20=16.80%, 50=46.61%, 100=23.93%, 250=10.29% lat (msec) : 500=0.23%, 750=0.03% cpu : usr=0.06%, sys=1.70%, ctx=4740, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179175: Tue Sep 15 04:38:19 2026 read: IOPS=9, BW=39.5KiB/s (40.5kB/s)(6028KiB/152463msec) clat (msec): min=4, max=275, avg=40.45, stdev=36.26 lat (msec): min=4, max=275, avg=40.45, stdev=36.26 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 86], 95.00th=[ 115], | 99.00th=[ 197], 99.50th=[ 224], 99.90th=[ 249], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 142, per=25.62%, avg=39.97, stdev=25.11, samples=294 iops : min= 1, max= 35, avg= 9.34, stdev= 6.30, samples=294 write: IOPS=10, BW=41.1KiB/s (42.0kB/s)(6260KiB/152463msec); 0 zone resets clat (msec): min=10, max=596, avg=58.23, stdev=42.80 lat (msec): min=10, max=596, avg=58.24, stdev=42.80 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 112], 95.00th=[ 136], | 99.00th=[ 222], 99.50th=[ 251], 99.90th=[ 351], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 120, per=25.18%, avg=41.04, stdev=23.60, samples=297 iops : min= 1, max= 30, avg= 9.61, stdev= 5.95, samples=297 lat (msec) : 10=2.02%, 20=16.41%, 50=47.01%, 100=24.28%, 250=9.99% lat (msec) : 500=0.26%, 750=0.03% cpu : usr=0.06%, sys=1.65%, ctx=4579, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179176: Tue Sep 15 04:38:19 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6052KiB/151527msec) clat (msec): min=5, max=291, avg=39.44, stdev=35.32 lat (msec): min=5, max=291, avg=39.45, stdev=35.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 83], 95.00th=[ 112], | 99.00th=[ 190], 99.50th=[ 211], 99.90th=[ 284], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 142, per=25.78%, avg=40.22, stdev=25.06, samples=293 iops : min= 1, max= 35, avg= 9.41, stdev= 6.29, samples=293 write: IOPS=10, BW=41.2KiB/s (42.1kB/s)(6236KiB/151527msec); 0 zone resets clat (msec): min=9, max=597, avg=58.69, stdev=41.37 lat (msec): min=9, max=597, avg=58.69, stdev=41.37 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 69], 80.00th=[ 84], 90.00th=[ 110], 95.00th=[ 130], | 99.00th=[ 207], 99.50th=[ 226], 99.90th=[ 418], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 119, per=25.07%, avg=40.87, stdev=23.72, samples=297 iops : min= 1, max= 29, avg= 9.57, stdev= 5.97, samples=297 lat (msec) : 10=2.38%, 20=16.24%, 50=46.48%, 100=24.80%, 250=9.86% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.06%, sys=1.69%, ctx=4644, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (160kB/s), 38.7KiB/s-39.9KiB/s (39.6kB/s-40.9kB/s), io=23.4MiB (24.6MB), run=151527-153565msec WRITE: bw=164KiB/s (168kB/s), 40.0KiB/s-41.3KiB/s (41.0kB/s-42.3kB/s), io=24.6MiB (25.7MB), run=151527-153565msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179225: Tue Sep 15 04:38:57 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5920KiB/28263msec) clat (usec): min=36, max=261199, avg=41677.13, stdev=29281.90 lat (usec): min=37, max=261201, avg=41686.67, stdev=29287.32 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 2040], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 90702], | 99.00th=[127402], 99.50th=[154141], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 95, max= 416, per=24.76%, avg=206.96, stdev=72.52, samples=55 iops : min= 5, max= 26, avg=12.22, stdev= 4.62, samples=55 write: IOPS=14, BW=225KiB/s (231kB/s)(6368KiB/28263msec); 0 zone resets clat (usec): min=993, max=205224, avg=31830.62, stdev=33890.43 lat (usec): min=995, max=205226, avg=31835.05, stdev=33888.31 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1696], 10.00th=[ 1942], 20.00th=[ 4080], | 30.00th=[ 7111], 40.00th=[ 13042], 50.00th=[ 21365], 60.00th=[ 29754], | 70.00th=[ 38536], 80.00th=[ 51643], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[139461], 99.50th=[177210], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 29, max= 446, per=25.52%, avg=224.62, stdev=96.03, samples=55 iops : min= 1, max= 27, avg=13.33, stdev= 6.02, samples=55 lat (usec) : 50=1.17%, 100=3.26%, 250=0.26%, 1000=0.13% lat (msec) : 2=5.21%, 4=5.34%, 10=9.11%, 20=8.72%, 50=40.89% lat (msec) : 100=20.96%, 250=4.82%, 500=0.13% cpu : usr=0.08%, sys=5.48%, ctx=1578, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179226: Tue Sep 15 04:38:57 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5744KiB/28062msec) clat (usec): min=38, max=176311, avg=40161.32, stdev=26419.29 lat (usec): min=38, max=176312, avg=40163.07, stdev=26419.45 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 10290], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 42206], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 67634], 95.00th=[ 89654], | 99.00th=[147850], 99.50th=[164627], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 28, max= 382, per=24.43%, avg=204.22, stdev=79.16, samples=55 iops : min= 1, max= 23, avg=12.04, stdev= 4.98, samples=55 write: IOPS=14, BW=233KiB/s (239kB/s)(6544KiB/28062msec); 0 zone resets clat (usec): min=1095, max=154826, avg=32473.11, stdev=32186.71 lat (usec): min=1096, max=154827, avg=32475.18, stdev=32186.66 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1778], 10.00th=[ 2474], 20.00th=[ 5407], | 30.00th=[ 8455], 40.00th=[ 15664], 50.00th=[ 22152], 60.00th=[ 31589], | 70.00th=[ 38536], 80.00th=[ 56886], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[135267], 99.50th=[139461], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 57, max= 476, per=26.56%, avg=233.69, stdev=85.83, samples=55 iops : min= 3, max= 29, avg=13.91, stdev= 5.42, samples=55 lat (usec) : 50=0.52%, 100=3.39%, 250=0.13%, 750=0.13% lat (msec) : 2=4.17%, 4=4.43%, 10=9.11%, 20=10.16%, 50=42.97% lat (msec) : 100=20.70%, 250=4.30% cpu : usr=0.09%, sys=5.19%, ctx=1541, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179227: Tue Sep 15 04:38:57 2026 read: IOPS=13, BW=218KiB/s (224kB/s)(6256KiB/28633msec) clat (usec): min=36, max=201926, avg=41721.46, stdev=28516.27 lat (usec): min=38, max=201926, avg=41723.24, stdev=28516.27 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 3851], 20.00th=[ 21890], | 30.00th=[ 28443], 40.00th=[ 32375], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 73925], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[149947], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 94, max= 445, per=26.20%, avg=219.07, stdev=72.50, samples=56 iops : min= 5, max= 27, avg=12.98, stdev= 4.57, samples=56 write: IOPS=13, BW=211KiB/s (216kB/s)(6032KiB/28633msec); 0 zone resets clat (usec): min=1195, max=175191, avg=32500.27, stdev=32467.06 lat (usec): min=1197, max=175194, avg=32509.62, stdev=32472.35 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1778], 10.00th=[ 2376], 20.00th=[ 4490], | 30.00th=[ 8094], 40.00th=[ 15795], 50.00th=[ 22676], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 55313], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[164627], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 391, per=23.66%, avg=208.21, stdev=87.96, samples=56 iops : min= 1, max= 24, avg=12.29, stdev= 5.53, samples=56 lat (usec) : 50=0.26%, 100=4.17%, 250=0.39%, 500=0.13% lat (msec) : 2=4.43%, 4=4.43%, 10=8.07%, 20=10.03%, 50=41.15% lat (msec) : 100=22.53%, 250=4.43% cpu : usr=0.06%, sys=5.30%, ctx=1625, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179228: Tue Sep 15 04:38:57 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(6032KiB/27601msec) clat (usec): min=38, max=192912, avg=39594.03, stdev=27983.13 lat (usec): min=38, max=192914, avg=39595.33, stdev=27983.09 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 18744], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 35914], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 59507], 90.00th=[ 73925], 95.00th=[ 85459], | 99.00th=[137364], 99.50th=[185598], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 95, max= 379, per=25.96%, avg=217.04, stdev=69.00, samples=54 iops : min= 5, max= 23, avg=12.85, stdev= 4.38, samples=54 write: IOPS=14, BW=227KiB/s (232kB/s)(6256KiB/27601msec); 0 zone resets clat (usec): min=1206, max=166836, avg=31635.21, stdev=31537.01 lat (usec): min=1209, max=166838, avg=31638.20, stdev=31536.99 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1827], 10.00th=[ 2737], 20.00th=[ 4752], | 30.00th=[ 8455], 40.00th=[ 13698], 50.00th=[ 21103], 60.00th=[ 28967], | 70.00th=[ 40633], 80.00th=[ 54264], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[121111], 99.50th=[158335], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 94, max= 446, per=25.71%, avg=226.28, stdev=77.23, samples=54 iops : min= 5, max= 27, avg=13.43, stdev= 4.83, samples=54 lat (usec) : 50=0.52%, 100=5.73%, 250=0.39%, 500=0.13% lat (msec) : 2=3.78%, 4=4.04%, 10=9.90%, 20=11.20%, 50=36.98% lat (msec) : 100=23.83%, 250=3.52% cpu : usr=0.08%, sys=5.12%, ctx=1560, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=837KiB/s (857kB/s), 205KiB/s-219KiB/s (210kB/s-224kB/s), io=23.4MiB (24.5MB), run=27601-28633msec WRITE: bw=880KiB/s (901kB/s), 211KiB/s-233KiB/s (216kB/s-239kB/s), io=24.6MiB (25.8MB), run=27601-28633msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179229: Tue Sep 15 04:39:10 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5920KiB/41131msec) clat (msec): min=7, max=222, avg=43.33, stdev=35.48 lat (msec): min=7, max=222, avg=43.33, stdev=35.48 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 87], 95.00th=[ 113], | 99.00th=[ 180], 99.50th=[ 215], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 414, per=24.67%, avg=142.37, stdev=78.93, samples=81 iops : min= 1, max= 25, avg= 8.11, stdev= 4.96, samples=81 write: IOPS=9, BW=155KiB/s (159kB/s)(6368KiB/41131msec); 0 zone resets clat (msec): min=13, max=275, avg=62.34, stdev=40.05 lat (msec): min=13, max=275, avg=62.35, stdev=40.05 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 68], 80.00th=[ 88], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 207], 99.50th=[ 241], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 382, per=25.39%, avg=154.10, stdev=80.29, samples=81 iops : min= 1, max= 23, avg= 8.85, stdev= 5.06, samples=81 lat (msec) : 10=1.17%, 20=9.64%, 50=51.04%, 100=26.04%, 250=11.98% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.56%, ctx=1101, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179230: Tue Sep 15 04:39:10 2026 read: IOPS=8, BW=138KiB/s (142kB/s)(5744KiB/41480msec) clat (msec): min=7, max=210, avg=41.43, stdev=33.47 lat (msec): min=7, max=210, avg=41.43, stdev=33.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 81], 95.00th=[ 116], | 99.00th=[ 174], 99.50th=[ 199], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 31, max= 512, per=24.58%, avg=141.81, stdev=90.97, samples=80 iops : min= 1, max= 32, avg= 8.06, stdev= 5.74, samples=80 write: IOPS=9, BW=158KiB/s (162kB/s)(6544KiB/41480msec); 0 zone resets clat (msec): min=12, max=289, avg=64.37, stdev=43.07 lat (msec): min=12, max=289, avg=64.37, stdev=43.07 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 124], 95.00th=[ 157], | 99.00th=[ 203], 99.50th=[ 259], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 479, per=25.85%, avg=156.90, stdev=80.27, samples=82 iops : min= 1, max= 29, avg= 9.02, stdev= 5.05, samples=82 lat (msec) : 10=0.78%, 20=12.89%, 50=46.48%, 100=27.86%, 250=11.59% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.62%, ctx=1188, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179231: Tue Sep 15 04:39:10 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(6256KiB/40968msec) clat (msec): min=5, max=202, avg=43.26, stdev=33.97 lat (msec): min=5, max=202, avg=43.26, stdev=33.97 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 96], 95.00th=[ 113], | 99.00th=[ 178], 99.50th=[ 184], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 31, max= 382, per=27.47%, avg=158.50, stdev=88.17, samples=78 iops : min= 1, max= 23, avg= 9.13, stdev= 5.56, samples=78 write: IOPS=9, BW=147KiB/s (151kB/s)(6032KiB/40968msec); 0 zone resets clat (msec): min=10, max=296, avg=63.50, stdev=41.76 lat (msec): min=10, max=296, avg=63.51, stdev=41.76 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 71], 80.00th=[ 91], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 224], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 416, per=24.15%, avg=146.58, stdev=76.92, samples=81 iops : min= 1, max= 26, avg= 8.38, stdev= 4.85, samples=81 lat (msec) : 10=1.04%, 20=11.46%, 50=49.09%, 100=26.95%, 250=11.07% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.50%, ctx=1080, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179232: Tue Sep 15 04:39:10 2026 read: IOPS=9, BW=147KiB/s (150kB/s)(6032KiB/41106msec) clat (msec): min=7, max=199, avg=42.09, stdev=35.07 lat (msec): min=7, max=199, avg=42.09, stdev=35.07 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 91], 95.00th=[ 129], | 99.00th=[ 167], 99.50th=[ 192], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 411, per=25.86%, avg=149.20, stdev=83.77, samples=79 iops : min= 1, max= 25, avg= 8.54, stdev= 5.25, samples=79 write: IOPS=9, BW=152KiB/s (156kB/s)(6256KiB/41106msec); 0 zone resets clat (msec): min=15, max=290, avg=64.00, stdev=39.90 lat (msec): min=15, max=290, avg=64.01, stdev=39.90 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 72], 80.00th=[ 89], 90.00th=[ 115], 95.00th=[ 144], | 99.00th=[ 220], 99.50th=[ 275], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 448, per=25.07%, avg=152.19, stdev=81.71, samples=81 iops : min= 1, max= 28, avg= 8.73, stdev= 5.18, samples=81 lat (msec) : 10=1.04%, 20=11.85%, 50=47.01%, 100=28.13%, 250=11.72% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.77%, ctx=1101, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=577KiB/s (591kB/s), 138KiB/s-153KiB/s (142kB/s-156kB/s), io=23.4MiB (24.5MB), run=40968-41480msec WRITE: bw=608KiB/s (622kB/s), 147KiB/s-158KiB/s (151kB/s-162kB/s), io=24.6MiB (25.8MB), run=40968-41480msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179250: Tue Sep 15 04:39:25 2026 read: IOPS=1, BW=1913KiB/s (1959kB/s)(7168KiB/3747msec) clat (msec): min=146, max=384, avg=231.98, stdev=75.91 lat (msec): min=146, max=384, avg=231.98, stdev=75.91 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 190], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 222], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 264], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1492, max= 4063, per=57.69%, avg=2895.50, stdev=1353.63, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1366KiB/s (1399kB/s)(5120KiB/3747msec); 0 zone resets clat (msec): min=127, max=1072, avg=402.35, stdev=381.85 lat (msec): min=129, max=1072, avg=402.85, stdev=381.47 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 1980, max= 4047, per=35.77%, avg=2513.50, stdev=1022.56, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=11.91%, ctx=224, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179251: Tue Sep 15 04:39:25 2026 read: IOPS=0, BW=502KiB/s (514kB/s)(2048KiB/4080msec) clat (usec): min=630, max=234086, avg=117358.37, stdev=165078.61 lat (usec): min=631, max=234087, avg=117359.66, stdev=165078.44 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 627], | 30.00th=[ 627], 40.00th=[ 627], 50.00th=[ 627], 60.00th=[233833], | 70.00th=[233833], 80.00th=[233833], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 1414, max= 1980, per=33.81%, avg=1697.00, stdev=400.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2510KiB/s (2570kB/s)(10.0MiB/4080msec); 0 zone resets clat (msec): min=143, max=941, avg=377.76, stdev=269.47 lat (msec): min=143, max=942, avg=377.94, stdev=269.71 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 148], | 30.00th=[ 165], 40.00th=[ 205], 50.00th=[ 255], 60.00th=[ 275], | 70.00th=[ 397], 80.00th=[ 584], 90.00th=[ 667], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1414, max= 5941, per=49.57%, avg=3483.40, stdev=1809.46, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=11.55%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179252: Tue Sep 15 04:39:25 2026 read: IOPS=1, BW=1817KiB/s (1861kB/s)(6144KiB/3381msec) clat (usec): min=478, max=718263, avg=211387.91, stdev=266920.34 lat (usec): min=479, max=718264, avg=211389.35, stdev=266920.45 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 3720], | 30.00th=[ 3720], 40.00th=[111674], 50.00th=[111674], 60.00th=[187696], | 70.00th=[246416], 80.00th=[246416], 90.00th=[717226], 95.00th=[717226], | 99.00th=[717226], 99.50th=[717226], 99.90th=[717226], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 2023, max= 4063, per=67.09%, avg=3367.00, stdev=1164.19, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1817KiB/s (1861kB/s)(6144KiB/3381msec); 0 zone resets clat (msec): min=166, max=837, avg=330.88, stdev=256.93 lat (msec): min=166, max=837, avg=330.95, stdev=256.92 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 215], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 2023, max= 4015, per=39.48%, avg=2774.50, stdev=952.39, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=10.44%, ctx=126, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179253: Tue Sep 15 04:39:25 2026 read: IOPS=1, BW=1358KiB/s (1391kB/s)(5120KiB/3769msec) clat (usec): min=1127, max=397044, avg=181051.65, stdev=181686.88 lat (usec): min=1128, max=397045, avg=181052.82, stdev=181686.75 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1123], 10.00th=[ 1123], 20.00th=[ 1123], | 30.00th=[ 1352], 40.00th=[ 1352], 50.00th=[181404], 60.00th=[181404], | 70.00th=[325059], 80.00th=[325059], 90.00th=[396362], 95.00th=[396362], | 99.00th=[396362], 99.50th=[396362], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 1980, max= 6023, per=79.73%, avg=4001.50, stdev=2858.83, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1902KiB/s (1947kB/s)(7168KiB/3769msec); 0 zone resets clat (msec): min=140, max=855, avg=399.01, stdev=269.79 lat (msec): min=140, max=856, avg=399.21, stdev=270.00 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 148], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 376], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 592], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1700, max= 3992, per=33.37%, avg=2345.20, stdev=930.61, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=10.91%, ctx=115, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5020KiB/s (5140kB/s), 502KiB/s-1913KiB/s (514kB/s-1959kB/s), io=20.0MiB (20.0MB), run=3381-4080msec WRITE: bw=7027KiB/s (7196kB/s), 1366KiB/s-2510KiB/s (1399kB/s-2570kB/s), io=28.0MiB (29.4MB), run=3381-4080msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179245: Tue Sep 15 04:39:26 2026 read: IOPS=1, BW=1952KiB/s (1998kB/s)(7168KiB/3673msec) clat (msec): min=93, max=390, avg=170.66, stdev=99.47 lat (msec): min=93, max=390, avg=170.67, stdev=99.47 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 125], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 148], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 161], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1868, max= 4661, per=59.74%, avg=2651.75, stdev=1341.93, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1394KiB/s (1427kB/s)(5120KiB/3673msec); 0 zone resets clat (msec): min=175, max=1164, avg=488.70, stdev=413.10 lat (msec): min=175, max=1164, avg=488.80, stdev=413.10 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1868, max= 2043, per=31.98%, avg=1987.25, stdev=81.36, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.08%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179246: Tue Sep 15 04:39:26 2026 read: IOPS=0, BW=444KiB/s (455kB/s)(2048KiB/4613msec) clat (msec): min=107, max=689, avg=398.48, stdev=411.92 lat (msec): min=107, max=689, avg=398.49, stdev=411.91 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1458, max= 2023, per=39.21%, avg=1740.50, stdev=399.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2220KiB/s (2273kB/s)(10.0MiB/4613msec); 0 zone resets clat (msec): min=152, max=936, avg=367.66, stdev=227.19 lat (msec): min=152, max=936, avg=367.76, stdev=227.18 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 201], | 30.00th=[ 220], 40.00th=[ 236], 50.00th=[ 317], 60.00th=[ 338], | 70.00th=[ 368], 80.00th=[ 393], 90.00th=[ 518], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1458, max= 4079, per=41.59%, avg=2585.00, stdev=1172.19, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=41.67%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=6.72%, ctx=132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179247: Tue Sep 15 04:39:26 2026 read: IOPS=1, BW=2038KiB/s (2087kB/s)(6144KiB/3015msec) clat (msec): min=94, max=468, avg=244.95, stdev=165.02 lat (msec): min=94, max=468, avg=244.95, stdev=165.02 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 188], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1868, max= 4007, per=56.05%, avg=2488.25, stdev=1015.71, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=2038KiB/s (2087kB/s)(6144KiB/3015msec); 0 zone resets clat (msec): min=118, max=506, avg=254.38, stdev=151.89 lat (msec): min=118, max=507, avg=254.47, stdev=151.88 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 249], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2003, max= 4504, per=45.81%, avg=2847.33, stdev=1434.80, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=3.28%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179248: Tue Sep 15 04:39:26 2026 read: IOPS=1, BW=1559KiB/s (1596kB/s)(5120KiB/3284msec) clat (msec): min=85, max=339, avg=190.01, stdev=107.52 lat (msec): min=85, max=339, avg=190.02, stdev=107.52 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2003, max= 6107, per=91.35%, avg=4055.00, stdev=2901.97, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2183KiB/s (2235kB/s)(7168KiB/3284msec); 0 zone resets clat (msec): min=135, max=718, avg=324.69, stdev=191.54 lat (msec): min=135, max=718, avg=324.78, stdev=191.55 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 167], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 300], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 363], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1868, max= 4087, per=52.85%, avg=3284.50, stdev=1041.46, samples=4 iops : min= 1, max= 3, avg= 2.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=3.93%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4440KiB/s (4546kB/s), 444KiB/s-2038KiB/s (455kB/s-2087kB/s), io=20.0MiB (20.0MB), run=3015-4613msec WRITE: bw=6215KiB/s (6365kB/s), 1394KiB/s-2220KiB/s (1427kB/s-2273kB/s), io=28.0MiB (29.4MB), run=3015-4613msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179262: Tue Sep 15 04:39:43 2026 read: IOPS=0, BW=2253KiB/s (2308kB/s)(12.0MiB/5453msec) clat (msec): min=545, max=3932, avg=1789.65, stdev=1864.17 lat (msec): min=545, max=3932, avg=1789.66, stdev=1864.16 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=7.21%, ctx=933, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179264: Tue Sep 15 04:39:43 2026 read: IOPS=0, BW=787KiB/s (806kB/s)(4096KiB/5203msec) clat (nsec): min=812412k, max=812412k, avg=812412251.00, stdev= 0.00 lat (nsec): min=812415k, max=812415k, avg=812414725.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1574KiB/s (1612kB/s)(8192KiB/5203msec); 0 zone resets clat (msec): min=555, max=3795, avg=2175.30, stdev=2290.85 lat (msec): min=555, max=3795, avg=2175.72, stdev=2291.18 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 3809], | 70.00th=[ 3809], 80.00th=[ 3809], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.23%, ctx=107, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179266: Tue Sep 15 04:39:43 2026 write: IOPS=0, BW=3979KiB/s (4075kB/s)(12.0MiB/3088msec); 0 zone resets clat (msec): min=267, max=1625, avg=969.86, stdev=680.40 lat (msec): min=268, max=1625, avg=970.68, stdev=679.81 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7831, max= 7831, per=100.00%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=6.38%, ctx=146, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179268: Tue Sep 15 04:39:43 2026 write: IOPS=1, BW=5877KiB/s (6018kB/s)(12.0MiB/2091msec); 0 zone resets clat (msec): min=203, max=1615, avg=683.42, stdev=807.31 lat (msec): min=203, max=1623, avg=686.46, stdev=811.89 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min=11538, max=11538, per=100.00%, avg=11538.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.11%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3005KiB/s (3077kB/s), 787KiB/s-2253KiB/s (806kB/s-2308kB/s), io=16.0MiB (16.8MB), run=5203-5453msec WRITE: bw=6298KiB/s (6449kB/s), 1574KiB/s-5877KiB/s (1612kB/s-6018kB/s), io=32.0MiB (33.6MB), run=2091-5203msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179261: Tue Sep 15 04:39:44 2026 read: IOPS=0, BW=2010KiB/s (2059kB/s)(12.0MiB/6112msec) clat (msec): min=265, max=4091, avg=2014.33, stdev=1933.67 lat (msec): min=265, max=4091, avg=2014.33, stdev=1933.67 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 1687], 50.00th=[ 1687], 60.00th=[ 1687], | 70.00th=[ 4077], 80.00th=[ 4077], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 8031, max= 8159, per=100.00%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.60%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179263: Tue Sep 15 04:39:44 2026 read: IOPS=0, BW=688KiB/s (704kB/s)(4096KiB/5954msec) clat (nsec): min=1797.3M, max=1797.3M, avg=1797296044.00, stdev= 0.00 lat (nsec): min=1797.3M, max=1797.3M, avg=1797298582.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1804], 5.00th=[ 1804], 10.00th=[ 1804], 20.00th=[ 1804], | 30.00th=[ 1804], 40.00th=[ 1804], 50.00th=[ 1804], 60.00th=[ 1804], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1376KiB/s (1409kB/s)(8192KiB/5954msec); 0 zone resets clat (msec): min=223, max=3886, avg=2054.97, stdev=2589.95 lat (msec): min=224, max=3887, avg=2055.66, stdev=2590.13 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 3876], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.08%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179265: Tue Sep 15 04:39:44 2026 write: IOPS=0, BW=2041KiB/s (2089kB/s)(12.0MiB/6022msec); 0 zone resets clat (msec): min=321, max=4036, avg=1938.06, stdev=1903.56 lat (msec): min=322, max=4036, avg=1938.73, stdev=1903.38 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 7922, max= 8159, per=100.00%, avg=8040.50, stdev=167.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=1.99%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179267: Tue Sep 15 04:39:44 2026 write: IOPS=1, BW=5558KiB/s (5691kB/s)(12.0MiB/2211msec); 0 zone resets clat (msec): min=257, max=1470, avg=705.88, stdev=665.09 lat (msec): min=257, max=1470, avg=706.23, stdev=665.07 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 5953, max= 8159, per=100.00%, avg=7056.00, stdev=1559.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.21%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2681KiB/s (2745kB/s), 688KiB/s-2010KiB/s (704kB/s-2059kB/s), io=16.0MiB (16.8MB), run=5954-6112msec WRITE: bw=5441KiB/s (5572kB/s), 1376KiB/s-5558KiB/s (1409kB/s-5691kB/s), io=32.0MiB (33.6MB), run=2211-6022msec