== sanity test 398b: DIO and buffer IO race ============== 12:52:59 (1772473979) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.61428 s, 13.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147163: Mon Mar 2 12:54:24 2026 read: IOPS=20, BW=81.0KiB/s (82.0kB/s)(5992KiB/73929msec) clat (usec): min=26, max=474510, avg=23821.08, stdev=21515.65 lat (usec): min=27, max=474511, avg=23822.96, stdev=21515.14 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 114], 20.00th=[ 11338], | 30.00th=[ 14353], 40.00th=[ 16581], 50.00th=[ 19530], 60.00th=[ 23462], | 70.00th=[ 28443], 80.00th=[ 35390], 90.00th=[ 46400], 95.00th=[ 57410], | 99.00th=[ 80217], 99.50th=[ 96994], 99.90th=[214959], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 23, max= 159, per=24.83%, avg=80.46, stdev=25.99, samples=146 iops : min= 5, max= 39, avg=19.58, stdev= 6.53, samples=146 write: IOPS=21, BW=85.2KiB/s (87.2kB/s)(6296KiB/73929msec); 0 zone resets clat (usec): min=746, max=245550, avg=24236.99, stdev=23856.30 lat (usec): min=747, max=245551, avg=24241.57, stdev=23855.16 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1319], 10.00th=[ 1811], 20.00th=[ 3458], | 30.00th=[ 6718], 40.00th=[ 12518], 50.00th=[ 17957], 60.00th=[ 24511], | 70.00th=[ 31851], 80.00th=[ 40633], 90.00th=[ 54264], 95.00th=[ 70779], | 99.00th=[103285], 99.50th=[121111], 99.90th=[166724], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 167, per=25.00%, avg=84.75, stdev=28.09, samples=146 iops : min= 7, max= 41, avg=20.65, stdev= 7.04, samples=146 lat (usec) : 50=1.01%, 100=3.68%, 250=0.52%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.29% lat (msec) : 2=5.86%, 4=5.18%, 10=9.64%, 20=25.68%, 50=37.70% lat (msec) : 100=9.34%, 250=0.78%, 500=0.03% cpu : usr=0.10%, sys=10.04%, ctx=6984, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147164: Mon Mar 2 12:54:24 2026 read: IOPS=20, BW=80.6KiB/s (82.5kB/s)(5940KiB/73708msec) clat (usec): min=23, max=486895, avg=23136.63, stdev=20485.13 lat (usec): min=24, max=486897, avg=23137.76, stdev=20485.16 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 59], 10.00th=[ 109], 20.00th=[ 11338], | 30.00th=[ 14222], 40.00th=[ 16909], 50.00th=[ 19792], 60.00th=[ 23200], | 70.00th=[ 27132], 80.00th=[ 34341], 90.00th=[ 43779], 95.00th=[ 52167], | 99.00th=[ 73925], 99.50th=[ 87557], 99.90th=[175113], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 5, max= 139, per=24.80%, avg=80.35, stdev=27.86, samples=146 iops : min= 1, max= 34, avg=19.55, stdev= 6.98, samples=146 write: IOPS=21, BW=86.1KiB/s (88.2kB/s)(6348KiB/73708msec); 0 zone resets clat (usec): min=825, max=300449, avg=24740.09, stdev=25395.18 lat (usec): min=827, max=300450, avg=24742.24, stdev=25395.22 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1401], 10.00th=[ 2024], 20.00th=[ 3458], | 30.00th=[ 6390], 40.00th=[ 13173], 50.00th=[ 19268], 60.00th=[ 25035], | 70.00th=[ 32375], 80.00th=[ 41157], 90.00th=[ 54789], 95.00th=[ 68682], | 99.00th=[114820], 99.50th=[145753], 99.90th=[244319], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 5, max= 189, per=25.34%, avg=85.89, stdev=29.45, samples=146 iops : min= 1, max= 47, avg=20.95, stdev= 7.39, samples=146 lat (usec) : 50=1.14%, 100=3.48%, 250=0.62%, 500=0.07%, 750=0.16% lat (usec) : 1000=0.26% lat (msec) : 2=4.79%, 4=6.58%, 10=9.24%, 20=25.16%, 50=38.96% lat (msec) : 100=8.63%, 250=0.85%, 500=0.07% cpu : usr=0.10%, sys=10.12%, ctx=6881, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147165: Mon Mar 2 12:54:24 2026 read: IOPS=20, BW=81.4KiB/s (83.4kB/s)(6028KiB/74041msec) clat (usec): min=23, max=287818, avg=23417.46, stdev=19232.83 lat (usec): min=23, max=287819, avg=23419.27, stdev=19232.67 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 135], 20.00th=[ 11076], | 30.00th=[ 14222], 40.00th=[ 16450], 50.00th=[ 19530], 60.00th=[ 23200], | 70.00th=[ 27919], 80.00th=[ 34341], 90.00th=[ 44303], 95.00th=[ 54789], | 99.00th=[ 84411], 99.50th=[ 96994], 99.90th=[191890], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 15, max= 144, per=25.18%, avg=81.59, stdev=27.42, samples=145 iops : min= 3, max= 36, avg=19.86, stdev= 6.91, samples=145 write: IOPS=21, BW=84.5KiB/s (86.6kB/s)(6260KiB/74041msec); 0 zone resets clat (usec): min=882, max=508662, avg=24679.95, stdev=26853.10 lat (usec): min=883, max=508665, avg=24687.21, stdev=26856.77 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1450], 10.00th=[ 2040], 20.00th=[ 3654], | 30.00th=[ 6390], 40.00th=[ 12649], 50.00th=[ 19268], 60.00th=[ 25035], | 70.00th=[ 31851], 80.00th=[ 40633], 90.00th=[ 54264], 95.00th=[ 68682], | 99.00th=[110625], 99.50th=[143655], 99.90th=[196084], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 17, max= 167, per=24.78%, avg=84.00, stdev=28.16, samples=146 iops : min= 4, max= 41, avg=20.47, stdev= 7.09, samples=146 lat (usec) : 50=0.81%, 100=3.65%, 250=0.65%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.39% lat (msec) : 2=4.59%, 4=6.18%, 10=9.93%, 20=25.55%, 50=38.48% lat (msec) : 100=8.76%, 250=0.75%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=9.99%, ctx=6966, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147166: Mon Mar 2 12:54:24 2026 read: IOPS=20, BW=82.5KiB/s (84.4kB/s)(6052KiB/73391msec) clat (usec): min=27, max=201195, avg=22794.26, stdev=17563.75 lat (usec): min=27, max=201197, avg=22795.44, stdev=17563.78 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 102], 20.00th=[ 11076], | 30.00th=[ 13960], 40.00th=[ 16712], 50.00th=[ 19530], 60.00th=[ 23200], | 70.00th=[ 27919], 80.00th=[ 34341], 90.00th=[ 44303], 95.00th=[ 53216], | 99.00th=[ 74974], 99.50th=[ 91751], 99.90th=[189793], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 7, max= 167, per=25.51%, avg=82.67, stdev=26.21, samples=144 iops : min= 1, max= 41, avg=20.13, stdev= 6.55, samples=144 write: IOPS=21, BW=84.0KiB/s (87.0kB/s)(6236KiB/73391msec); 0 zone resets clat (usec): min=784, max=517177, avg=24889.88, stdev=28154.02 lat (usec): min=784, max=517180, avg=24895.13, stdev=28155.21 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1418], 10.00th=[ 1926], 20.00th=[ 3490], | 30.00th=[ 6521], 40.00th=[ 12125], 50.00th=[ 17695], 60.00th=[ 23462], | 70.00th=[ 30802], 80.00th=[ 42206], 90.00th=[ 57410], 95.00th=[ 72877], | 99.00th=[111674], 99.50th=[131597], 99.90th=[238027], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 11, max= 166, per=24.95%, avg=84.57, stdev=27.83, samples=145 iops : min= 2, max= 41, avg=20.60, stdev= 6.98, samples=145 lat (usec) : 50=1.01%, 100=3.84%, 250=0.98%, 500=0.10%, 750=0.16% lat (usec) : 1000=0.33% lat (msec) : 2=5.08%, 4=6.18%, 10=9.54%, 20=25.42%, 50=37.27% lat (msec) : 100=9.18%, 250=0.88%, 750=0.03% cpu : usr=0.12%, sys=10.00%, ctx=6974, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=324KiB/s (332kB/s), 80.6KiB/s-82.5KiB/s (82.5kB/s-84.4kB/s), io=23.4MiB (24.6MB), run=73391-74041msec WRITE: bw=340KiB/s (348kB/s), 84.5KiB/s-86.1KiB/s (86.6kB/s-88.2kB/s), io=24.6MiB (25.7MB), run=73391-74041msec fio: pid=147161, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=147158: Mon Mar 2 12:55:37 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(5992KiB/146852msec) clat (msec): min=4, max=699, avg=21.05, stdev=27.96 lat (msec): min=4, max=699, avg=21.05, stdev=27.96 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 44], 95.00th=[ 59], | 99.00th=[ 101], 99.50th=[ 130], 99.90th=[ 330], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 143, per=28.72%, avg=41.35, stdev=26.58, samples=283 iops : min= 1, max= 35, avg= 9.84, stdev= 6.68, samples=283 write: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6296KiB/146852msec); 0 zone resets clat (msec): min=22, max=295, avg=73.12, stdev=34.24 lat (msec): min=22, max=295, avg=73.12, stdev=34.24 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 57], 50.00th=[ 64], 60.00th=[ 73], | 70.00th=[ 84], 80.00th=[ 99], 90.00th=[ 122], 95.00th=[ 140], | 99.00th=[ 184], 99.50th=[ 211], 99.90th=[ 234], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 80, per=28.13%, avg=42.47, stdev=18.26, samples=290 iops : min= 1, max= 20, avg=10.12, stdev= 4.63, samples=290 lat (msec) : 10=14.91%, 20=19.04%, 50=25.85%, 100=30.14%, 250=9.93% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.06%, sys=2.50%, ctx=5662, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147159: Mon Mar 2 12:55:37 2026 read: IOPS=10, BW=40.4KiB/s (41.4kB/s)(5940KiB/146863msec) clat (msec): min=4, max=720, avg=20.98, stdev=26.40 lat (msec): min=4, max=720, avg=20.98, stdev=26.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 46], 95.00th=[ 58], | 99.00th=[ 87], 99.50th=[ 118], 99.90th=[ 209], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 120, per=28.98%, avg=41.73, stdev=24.77, samples=279 iops : min= 1, max= 30, avg= 9.93, stdev= 6.24, samples=279 write: IOPS=10, BW=43.2KiB/s (44.3kB/s)(6348KiB/146863msec); 0 zone resets clat (msec): min=24, max=361, avg=72.75, stdev=34.79 lat (msec): min=24, max=361, avg=72.76, stdev=34.79 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 37], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 64], 60.00th=[ 71], | 70.00th=[ 82], 80.00th=[ 96], 90.00th=[ 121], 95.00th=[ 140], | 99.00th=[ 190], 99.50th=[ 201], 99.90th=[ 305], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 8, max= 95, per=28.35%, avg=42.81, stdev=18.05, samples=290 iops : min= 2, max= 23, avg=10.20, stdev= 4.57, samples=290 lat (msec) : 10=14.78%, 20=19.08%, 50=25.39%, 100=30.86%, 250=9.73% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=2.48%, ctx=5644, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147160: Mon Mar 2 12:55:37 2026 read: IOPS=10, BW=40.9KiB/s (41.9kB/s)(6028KiB/147311msec) clat (msec): min=4, max=308, avg=21.12, stdev=20.00 lat (msec): min=4, max=308, avg=21.12, stdev=20.00 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 31], 90.00th=[ 46], 95.00th=[ 62], | 99.00th=[ 89], 99.50th=[ 94], 99.90th=[ 224], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 120, per=28.37%, avg=40.86, stdev=25.25, samples=289 iops : min= 1, max= 30, avg= 9.71, stdev= 6.36, samples=289 write: IOPS=10, BW=42.5KiB/s (43.5kB/s)(6260KiB/147311msec); 0 zone resets clat (msec): min=25, max=720, avg=73.64, stdev=39.65 lat (msec): min=25, max=720, avg=73.64, stdev=39.65 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 36], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 58], 50.00th=[ 65], 60.00th=[ 72], | 70.00th=[ 83], 80.00th=[ 97], 90.00th=[ 120], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 239], 99.90th=[ 376], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 87, per=27.85%, avg=42.06, stdev=18.87, samples=291 iops : min= 1, max= 21, avg=10.01, stdev= 4.77, samples=291 lat (msec) : 10=14.49%, 20=18.59%, 50=26.14%, 100=31.09%, 250=9.44% lat (msec) : 500=0.23%, 750=0.03% cpu : usr=0.07%, sys=2.50%, ctx=5557, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=147161: Mon Mar 2 12:55:37 2026 read: IOPS=8, BW=33.6KiB/s (34.5kB/s)(3264KiB/97004msec) clat (msec): min=4, max=175, avg=28.34, stdev=24.17 lat (msec): min=4, max=175, avg=28.34, stdev=24.17 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 34], 80.00th=[ 43], 90.00th=[ 60], 95.00th=[ 75], | 99.00th=[ 122], 99.50th=[ 136], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 7, max= 128, per=23.99%, avg=34.55, stdev=23.03, samples=184 iops : min= 1, max= 32, avg= 8.11, stdev= 5.83, samples=184 write: IOPS=8, BW=34.7KiB/s (35.6kB/s)(3368KiB/97004msec); 0 zone resets clat (msec): min=22, max=721, avg=87.49, stdev=44.83 lat (msec): min=22, max=721, avg=87.49, stdev=44.83 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 39], 10.00th=[ 46], 20.00th=[ 54], | 30.00th=[ 63], 40.00th=[ 72], 50.00th=[ 80], 60.00th=[ 90], | 70.00th=[ 104], 80.00th=[ 116], 90.00th=[ 136], 95.00th=[ 150], | 99.00th=[ 211], 99.50th=[ 326], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 80, per=22.72%, avg=34.30, stdev=14.61, samples=191 iops : min= 1, max= 20, avg= 8.06, stdev= 3.72, samples=191 lat (msec) : 10=8.08%, 20=16.88%, 50=25.20%, 100=32.91%, 250=16.52% lat (msec) : 500=0.30%, 750=0.06% cpu : usr=0.06%, sys=2.33%, ctx=2566, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=817,842,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=144KiB/s (148kB/s), 33.6KiB/s-40.9KiB/s (34.5kB/s-41.9kB/s), io=20.7MiB (21.7MB), run=97004-147311msec WRITE: bw=151KiB/s (155kB/s), 34.7KiB/s-43.2KiB/s (35.6kB/s-44.3kB/s), io=21.8MiB (22.8MB), run=97004-147311msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147209: Mon Mar 2 12:56:00 2026 read: IOPS=23, BW=382KiB/s (391kB/s)(5920KiB/15502msec) clat (usec): min=26, max=108171, avg=21545.89, stdev=16842.04 lat (usec): min=26, max=108171, avg=21546.91, stdev=16842.14 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 190], | 30.00th=[ 13829], 40.00th=[ 16909], 50.00th=[ 20579], 60.00th=[ 23725], | 70.00th=[ 27919], 80.00th=[ 32637], 90.00th=[ 41157], 95.00th=[ 49546], | 99.00th=[ 85459], 99.50th=[100140], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 254, max= 669, per=26.40%, avg=381.20, stdev=89.98, samples=30 iops : min= 15, max= 41, avg=23.13, stdev= 5.66, samples=30 write: IOPS=25, BW=411KiB/s (421kB/s)(6368KiB/15502msec); 0 zone resets clat (usec): min=1143, max=111363, avg=18814.74, stdev=18249.08 lat (usec): min=1143, max=111365, avg=18817.19, stdev=18249.07 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 2147], 10.00th=[ 3064], 20.00th=[ 4359], | 30.00th=[ 6194], 40.00th=[ 8225], 50.00th=[ 12256], 60.00th=[ 17433], | 70.00th=[ 23462], 80.00th=[ 33817], 90.00th=[ 42730], 95.00th=[ 51119], | 99.00th=[ 96994], 99.50th=[110625], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 191, max= 604, per=27.19%, avg=413.00, stdev=107.02, samples=30 iops : min= 11, max= 37, avg=25.13, stdev= 6.79, samples=30 lat (usec) : 50=1.04%, 100=6.90%, 250=1.95%, 500=0.13% lat (msec) : 2=1.69%, 4=7.03%, 10=15.23%, 20=22.92%, 50=38.54% lat (msec) : 100=4.04%, 250=0.52% cpu : usr=0.16%, sys=13.70%, ctx=1684, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147210: Mon Mar 2 12:56:00 2026 read: IOPS=22, BW=360KiB/s (369kB/s)(5744KiB/15950msec) clat (usec): min=37, max=202168, avg=22487.76, stdev=19328.50 lat (usec): min=37, max=202168, avg=22488.68, stdev=19328.46 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 73], 20.00th=[ 2507], | 30.00th=[ 14091], 40.00th=[ 18220], 50.00th=[ 21365], 60.00th=[ 24511], | 70.00th=[ 28181], 80.00th=[ 33817], 90.00th=[ 43254], 95.00th=[ 49021], | 99.00th=[ 83362], 99.50th=[123208], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 28, max= 563, per=24.98%, avg=360.65, stdev=120.45, samples=31 iops : min= 1, max= 35, avg=21.84, stdev= 7.62, samples=31 write: IOPS=25, BW=410KiB/s (420kB/s)(6544KiB/15950msec); 0 zone resets clat (usec): min=1073, max=144289, avg=18806.52, stdev=19537.51 lat (usec): min=1074, max=144291, avg=18808.25, stdev=19537.52 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 2073], 10.00th=[ 2769], 20.00th=[ 4359], | 30.00th=[ 5800], 40.00th=[ 8455], 50.00th=[ 12911], 60.00th=[ 16909], | 70.00th=[ 22938], 80.00th=[ 30540], 90.00th=[ 43254], 95.00th=[ 54264], | 99.00th=[ 91751], 99.50th=[110625], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 86, max= 761, per=26.84%, avg=407.71, stdev=126.81, samples=31 iops : min= 5, max= 47, avg=24.81, stdev= 7.99, samples=31 lat (usec) : 50=0.91%, 100=5.73%, 250=2.21%, 500=0.13%, 750=0.13% lat (msec) : 2=2.21%, 4=7.03%, 10=16.02%, 20=21.35%, 50=38.80% lat (msec) : 100=4.69%, 250=0.78% cpu : usr=0.14%, sys=13.47%, ctx=1730, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147211: Mon Mar 2 12:56:00 2026 read: IOPS=23, BW=377KiB/s (386kB/s)(6256KiB/16583msec) clat (usec): min=35, max=154179, avg=22004.10, stdev=19013.34 lat (usec): min=35, max=154181, avg=22009.98, stdev=19009.06 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 71], 20.00th=[ 127], | 30.00th=[ 13566], 40.00th=[ 17171], 50.00th=[ 20841], 60.00th=[ 23725], | 70.00th=[ 27919], 80.00th=[ 34341], 90.00th=[ 44303], 95.00th=[ 53740], | 99.00th=[ 82314], 99.50th=[121111], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 143, max= 604, per=26.17%, avg=377.84, stdev=118.17, samples=32 iops : min= 8, max= 37, avg=22.91, stdev= 7.46, samples=32 write: IOPS=22, BW=364KiB/s (372kB/s)(6032KiB/16583msec); 0 zone resets clat (usec): min=1178, max=184597, avg=20764.72, stdev=21830.27 lat (usec): min=1179, max=184599, avg=20771.78, stdev=21827.21 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2212], 10.00th=[ 2999], 20.00th=[ 4424], | 30.00th=[ 6325], 40.00th=[ 8848], 50.00th=[ 13698], 60.00th=[ 19792], | 70.00th=[ 26084], 80.00th=[ 32637], 90.00th=[ 49021], 95.00th=[ 60556], | 99.00th=[101188], 99.50th=[143655], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 143, max= 608, per=23.63%, avg=358.91, stdev=116.72, samples=32 iops : min= 8, max= 38, avg=21.72, stdev= 7.40, samples=32 lat (usec) : 50=1.43%, 100=6.90%, 250=2.73%, 500=0.52%, 1000=0.26% lat (msec) : 2=1.95%, 4=5.99%, 10=13.02%, 20=21.09%, 50=38.15% lat (msec) : 100=7.03%, 250=0.91% cpu : usr=0.09%, sys=12.88%, ctx=1733, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147212: Mon Mar 2 12:56:00 2026 read: IOPS=23, BW=380KiB/s (390kB/s)(6032KiB/15856msec) clat (usec): min=39, max=128543, avg=20345.22, stdev=16935.25 lat (usec): min=40, max=128544, avg=20346.11, stdev=16935.24 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 125], | 30.00th=[ 12780], 40.00th=[ 16188], 50.00th=[ 19530], 60.00th=[ 22676], | 70.00th=[ 26346], 80.00th=[ 32637], 90.00th=[ 40633], 95.00th=[ 48497], | 99.00th=[ 62653], 99.50th=[121111], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 115, max= 604, per=26.31%, avg=379.97, stdev=109.32, samples=31 iops : min= 7, max= 37, avg=23.06, stdev= 6.93, samples=31 write: IOPS=24, BW=395KiB/s (404kB/s)(6256KiB/15856msec); 0 zone resets clat (usec): min=1405, max=162161, avg=20511.08, stdev=21038.20 lat (usec): min=1405, max=162163, avg=20514.23, stdev=21039.51 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2212], 10.00th=[ 2835], 20.00th=[ 4146], | 30.00th=[ 5932], 40.00th=[ 9372], 50.00th=[ 15008], 60.00th=[ 19006], | 70.00th=[ 24249], 80.00th=[ 33817], 90.00th=[ 49546], 95.00th=[ 57934], | 99.00th=[ 99091], 99.50th=[141558], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 115, max= 608, per=26.17%, avg=397.58, stdev=122.72, samples=31 iops : min= 7, max= 38, avg=24.16, stdev= 7.72, samples=31 lat (usec) : 50=1.30%, 100=6.90%, 250=3.12%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.43%, 4=8.46%, 10=12.50%, 20=22.53%, 50=36.59% lat (msec) : 100=5.99%, 250=0.65% cpu : usr=0.06%, sys=13.28%, ctx=1724, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1444KiB/s (1479kB/s), 360KiB/s-382KiB/s (369kB/s-391kB/s), io=23.4MiB (24.5MB), run=15502-16583msec WRITE: bw=1520KiB/s (1556kB/s), 364KiB/s-411KiB/s (372kB/s-421kB/s), io=24.6MiB (25.8MB), run=15502-16583msec fio: pid=147206, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=147205: Mon Mar 2 12:56:22 2026 read: IOPS=9, BW=154KiB/s (157kB/s)(5920KiB/38495msec) clat (msec): min=4, max=101, avg=22.33, stdev=17.60 lat (msec): min=4, max=101, avg=22.33, stdev=17.60 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 45], 95.00th=[ 59], | 99.00th=[ 93], 99.50th=[ 100], 99.90th=[ 103], 99.95th=[ 103], | 99.99th=[ 103] bw ( KiB/s): min= 31, max= 415, per=26.63%, avg=152.05, stdev=83.59, samples=76 iops : min= 1, max= 25, avg= 8.87, stdev= 5.22, samples=76 write: IOPS=10, BW=165KiB/s (169kB/s)(6368KiB/38495msec); 0 zone resets clat (msec): min=22, max=272, avg=75.56, stdev=31.71 lat (msec): min=22, max=272, avg=75.56, stdev=31.71 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 38], 10.00th=[ 45], 20.00th=[ 51], | 30.00th=[ 58], 40.00th=[ 64], 50.00th=[ 71], 60.00th=[ 77], | 70.00th=[ 83], 80.00th=[ 95], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 186], 99.50th=[ 236], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 288, per=27.62%, avg=164.37, stdev=60.62, samples=76 iops : min= 1, max= 18, avg= 9.63, stdev= 3.97, samples=76 lat (msec) : 10=9.11%, 20=20.31%, 50=24.22%, 100=38.28%, 250=7.94% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.88%, ctx=1471, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=147206: Mon Mar 2 12:56:22 2026 read: IOPS=8, BW=135KiB/s (139kB/s)(3776KiB/27879msec) clat (msec): min=5, max=144, avg=24.67, stdev=22.42 lat (msec): min=5, max=144, avg=24.67, stdev=22.42 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 25], 80.00th=[ 36], 90.00th=[ 54], 95.00th=[ 72], | 99.00th=[ 130], 99.50th=[ 136], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 29, max= 352, per=23.80%, avg=135.91, stdev=79.75, samples=54 iops : min= 1, max= 22, avg= 7.85, stdev= 5.10, samples=54 write: IOPS=9, BW=153KiB/s (157kB/s)(4272KiB/27879msec); 0 zone resets clat (msec): min=29, max=313, avg=81.86, stdev=38.16 lat (msec): min=29, max=313, avg=81.86, stdev=38.16 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 41], 10.00th=[ 45], 20.00th=[ 54], | 30.00th=[ 60], 40.00th=[ 64], 50.00th=[ 73], 60.00th=[ 80], | 70.00th=[ 90], 80.00th=[ 112], 90.00th=[ 133], 95.00th=[ 150], | 99.00th=[ 211], 99.50th=[ 224], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 256, per=25.64%, avg=152.58, stdev=61.96, samples=55 iops : min= 1, max= 16, avg= 8.89, stdev= 4.09, samples=55 lat (msec) : 10=7.34%, 20=22.82%, 50=19.44%, 100=36.51%, 250=13.49% lat (msec) : 500=0.20% cpu : usr=0.05%, sys=2.89%, ctx=969, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=237,267,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147207: Mon Mar 2 12:56:22 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(6256KiB/36641msec) clat (msec): min=5, max=119, avg=20.11, stdev=15.94 lat (msec): min=5, max=119, avg=20.11, stdev=15.94 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 56], | 99.00th=[ 78], 99.50th=[ 115], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 31, max= 474, per=30.13%, avg=172.06, stdev=111.35, samples=72 iops : min= 1, max= 29, avg=10.13, stdev= 7.11, samples=72 write: IOPS=10, BW=165KiB/s (169kB/s)(6032KiB/36641msec); 0 zone resets clat (msec): min=30, max=302, avg=76.14, stdev=34.11 lat (msec): min=30, max=302, avg=76.14, stdev=34.11 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 40], 10.00th=[ 42], 20.00th=[ 50], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 68], 60.00th=[ 75], | 70.00th=[ 84], 80.00th=[ 95], 90.00th=[ 125], 95.00th=[ 144], | 99.00th=[ 194], 99.50th=[ 220], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 62, max= 288, per=27.60%, avg=164.21, stdev=59.06, samples=72 iops : min= 3, max= 18, avg= 9.62, stdev= 3.88, samples=72 lat (msec) : 10=10.68%, 20=24.74%, 50=22.79%, 100=33.07%, 250=8.59% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.91%, ctx=1498, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147208: Mon Mar 2 12:56:22 2026 read: IOPS=10, BW=160KiB/s (164kB/s)(6032KiB/37681msec) clat (msec): min=5, max=139, avg=22.66, stdev=19.73 lat (msec): min=5, max=139, avg=22.66, stdev=19.73 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 44], 95.00th=[ 67], | 99.00th=[ 106], 99.50th=[ 112], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 447, per=28.15%, avg=160.71, stdev=90.72, samples=73 iops : min= 1, max= 27, avg= 9.40, stdev= 5.75, samples=73 write: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37681msec); 0 zone resets clat (msec): min=27, max=211, avg=74.09, stdev=29.64 lat (msec): min=27, max=211, avg=74.09, stdev=29.64 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 39], 10.00th=[ 43], 20.00th=[ 51], | 30.00th=[ 56], 40.00th=[ 61], 50.00th=[ 67], 60.00th=[ 74], | 70.00th=[ 83], 80.00th=[ 100], 90.00th=[ 113], 95.00th=[ 129], | 99.00th=[ 169], 99.50th=[ 197], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 63, max= 320, per=27.71%, avg=164.88, stdev=58.88, samples=74 iops : min= 3, max= 20, avg= 9.66, stdev= 3.86, samples=74 lat (msec) : 10=9.11%, 20=22.66%, 50=23.05%, 100=34.90%, 250=10.29% cpu : usr=0.05%, sys=2.94%, ctx=1533, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=571KiB/s (585kB/s), 135KiB/s-171KiB/s (139kB/s-175kB/s), io=21.5MiB (22.5MB), run=27879-38495msec WRITE: bw=596KiB/s (610kB/s), 153KiB/s-166KiB/s (157kB/s-170kB/s), io=22.4MiB (23.5MB), run=27879-38495msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147222: Mon Mar 2 12:56:30 2026 read: IOPS=2, BW=2671KiB/s (2735kB/s)(7168KiB/2684msec) clat (usec): min=1137, max=266465, avg=139950.18, stdev=88881.49 lat (usec): min=1138, max=266466, avg=139951.51, stdev=88881.69 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1139], 10.00th=[ 1139], 20.00th=[ 81265], | 30.00th=[109577], 40.00th=[109577], 50.00th=[120062], 60.00th=[189793], | 70.00th=[189793], 80.00th=[210764], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 2048, max= 5224, per=60.77%, avg=3770.33, stdev=1604.95, samples=3 iops : min= 2, max= 5, avg= 3.33, stdev= 1.53, samples=3 write: IOPS=1, BW=1908KiB/s (1953kB/s)(5120KiB/2684msec); 0 zone resets clat (msec): min=106, max=630, avg=331.59, stdev=199.01 lat (msec): min=106, max=630, avg=331.67, stdev=199.01 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2003, max= 2048, per=23.31%, avg=2024.25, stdev=18.71, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 100=8.33%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=21.80%, ctx=254, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147223: Mon Mar 2 12:56:30 2026 read: IOPS=0, BW=620KiB/s (635kB/s)(2048KiB/3301msec) clat (usec): min=465, max=181997, avg=91231.53, stdev=128362.46 lat (usec): min=466, max=181999, avg=91233.37, stdev=128363.10 clat percentiles (usec): | 1.00th=[ 465], 5.00th=[ 465], 10.00th=[ 465], 20.00th=[ 465], | 30.00th=[ 465], 40.00th=[ 465], 50.00th=[ 465], 60.00th=[181404], | 70.00th=[181404], 80.00th=[181404], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 1774, max= 2048, per=30.80%, avg=1911.00, stdev=193.75, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3102KiB/s (3177kB/s)(10.0MiB/3301msec); 0 zone resets clat (msec): min=89, max=654, avg=295.21, stdev=187.15 lat (msec): min=89, max=654, avg=295.42, stdev=187.14 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 91], | 30.00th=[ 136], 40.00th=[ 205], 50.00th=[ 271], 60.00th=[ 296], | 70.00th=[ 305], 80.00th=[ 359], 90.00th=[ 550], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2003, max= 6144, per=37.45%, avg=3252.20, stdev=1836.66, samples=5 iops : min= 1, max= 6, avg= 2.60, stdev= 2.07, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.06%, sys=20.64%, ctx=140, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147224: Mon Mar 2 12:56:30 2026 read: IOPS=2, BW=2667KiB/s (2731kB/s)(6144KiB/2304msec) clat (usec): min=544, max=235581, avg=147755.23, stdev=87087.38 lat (usec): min=545, max=235583, avg=147756.48, stdev=87087.29 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 92799], | 30.00th=[ 92799], 40.00th=[164627], 50.00th=[164627], 60.00th=[181404], | 70.00th=[212861], 80.00th=[212861], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 2027, max= 4039, per=54.12%, avg=3357.67, stdev=1152.50, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2667KiB/s (2731kB/s)(6144KiB/2304msec); 0 zone resets clat (msec): min=162, max=422, avg=232.81, stdev=96.38 lat (msec): min=162, max=422, avg=232.89, stdev=96.38 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 207], | 70.00th=[ 234], 80.00th=[ 234], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2003, max= 4055, per=33.16%, avg=2879.75, stdev=1033.91, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=75.00%, 500=8.33% cpu : usr=0.00%, sys=29.27%, ctx=264, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147225: Mon Mar 2 12:56:30 2026 read: IOPS=2, BW=2070KiB/s (2119kB/s)(5120KiB/2474msec) clat (usec): min=736, max=290211, avg=162154.65, stdev=108443.59 lat (usec): min=737, max=290212, avg=162155.66, stdev=108443.66 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 734], | 30.00th=[120062], 40.00th=[120062], 50.00th=[198181], 60.00th=[198181], | 70.00th=[200279], 80.00th=[200279], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2897KiB/s (2967kB/s)(7168KiB/2474msec); 0 zone resets clat (msec): min=103, max=472, avg=229.74, stdev=115.53 lat (msec): min=103, max=472, avg=229.82, stdev=115.54 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 169], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 218], 60.00th=[ 222], | 70.00th=[ 222], 80.00th=[ 230], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1762, max= 6059, per=45.58%, avg=3958.67, stdev=2150.12, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=75.00%, 500=16.67% cpu : usr=0.00%, sys=26.49%, ctx=175, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6204KiB/s (6353kB/s), 620KiB/s-2671KiB/s (635kB/s-2735kB/s), io=20.0MiB (20.0MB), run=2304-3301msec WRITE: bw=8686KiB/s (8894kB/s), 1908KiB/s-3102KiB/s (1953kB/s-3177kB/s), io=28.0MiB (29.4MB), run=2304-3301msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147227: Mon Mar 2 12:56:30 2026 read: IOPS=2, BW=2541KiB/s (2602kB/s)(7168KiB/2821msec) clat (msec): min=53, max=542, avg=190.86, stdev=170.96 lat (msec): min=53, max=542, avg=190.86, stdev=170.96 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 68], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 113], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 266], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1799, max= 4087, per=55.11%, avg=3319.00, stdev=1316.38, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1815KiB/s (1859kB/s)(5120KiB/2821msec); 0 zone resets clat (msec): min=108, max=731, avg=282.26, stdev=254.14 lat (msec): min=108, max=731, avg=282.37, stdev=254.15 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 205], 80.00th=[ 205], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2035, max= 4071, per=32.18%, avg=2713.67, stdev=1175.49, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=8.33%, 750=16.67% cpu : usr=0.04%, sys=8.76%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147228: Mon Mar 2 12:56:30 2026 read: IOPS=0, BW=602KiB/s (617kB/s)(2048KiB/3400msec) clat (usec): min=57098, max=58035, avg=57566.96, stdev=663.04 lat (usec): min=57099, max=58037, avg=57568.64, stdev=663.71 clat percentiles (usec): | 1.00th=[56886], 5.00th=[56886], 10.00th=[56886], 20.00th=[56886], | 30.00th=[56886], 40.00th=[56886], 50.00th=[56886], 60.00th=[57934], | 70.00th=[57934], 80.00th=[57934], 90.00th=[57934], 95.00th=[57934], | 99.00th=[57934], 99.50th=[57934], 99.90th=[57934], 99.95th=[57934], | 99.99th=[57934] bw ( KiB/s): min= 1992, max= 2035, per=33.43%, avg=2013.50, stdev=30.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3012KiB/s (3084kB/s)(10.0MiB/3400msec); 0 zone resets clat (msec): min=49, max=729, avg=299.36, stdev=220.62 lat (msec): min=50, max=730, avg=299.44, stdev=220.63 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 77], | 30.00th=[ 90], 40.00th=[ 148], 50.00th=[ 292], 60.00th=[ 313], | 70.00th=[ 326], 80.00th=[ 447], 90.00th=[ 527], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2035, max= 4071, per=36.23%, avg=3055.00, stdev=1173.18, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 50=8.33%, 100=33.33%, 250=8.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=11.97%, ctx=234, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147229: Mon Mar 2 12:56:30 2026 read: IOPS=2, BW=2145KiB/s (2196kB/s)(6144KiB/2865msec) clat (msec): min=71, max=288, avg=146.69, stdev=100.69 lat (msec): min=71, max=288, avg=146.69, stdev=100.69 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 77], 50.00th=[ 77], 60.00th=[ 110], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 4087, max= 6107, per=84.63%, avg=5097.00, stdev=1428.36, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2145KiB/s (2196kB/s)(6144KiB/2865msec); 0 zone resets clat (msec): min=154, max=445, avg=315.06, stdev=98.90 lat (msec): min=154, max=445, avg=315.17, stdev=98.89 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 359], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1787, max= 2043, per=23.56%, avg=1987.00, stdev=111.86, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=25.00%, 250=16.67%, 500=58.33% cpu : usr=0.03%, sys=7.58%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147230: Mon Mar 2 12:56:30 2026 read: IOPS=1, BW=1825KiB/s (1868kB/s)(5120KiB/2806msec) clat (msec): min=60, max=694, avg=219.15, stdev=266.73 lat (msec): min=60, max=694, avg=219.15, stdev=266.73 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 61], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 113], 60.00th=[ 113], | 70.00th=[ 121], 80.00th=[ 121], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 2035, max= 4071, per=45.10%, avg=2716.33, stdev=1173.18, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2555KiB/s (2616kB/s)(7168KiB/2806msec); 0 zone resets clat (msec): min=83, max=544, avg=234.85, stdev=159.35 lat (msec): min=83, max=544, avg=235.36, stdev=159.22 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 115], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 184], 60.00th=[ 224], | 70.00th=[ 224], 80.00th=[ 338], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1868, max= 4087, per=29.72%, avg=2506.25, stdev=1056.77, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=8.33%, 750=16.67% cpu : usr=0.07%, sys=8.95%, ctx=93, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6024KiB/s (6168kB/s), 602KiB/s-2541KiB/s (617kB/s-2602kB/s), io=20.0MiB (20.0MB), run=2806-3400msec WRITE: bw=8433KiB/s (8635kB/s), 1815KiB/s-3012KiB/s (1859kB/s-3084kB/s), io=28.0MiB (29.4MB), run=2806-3400msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147236: Mon Mar 2 12:56:39 2026 read: IOPS=1, BW=6671KiB/s (6831kB/s)(12.0MiB/1842msec) clat (msec): min=355, max=720, avg=547.41, stdev=182.99 lat (msec): min=355, max=720, avg=547.41, stdev=182.99 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 5793, max= 8192, per=88.27%, avg=6992.50, stdev=1696.35, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=27.00%, ctx=654, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147237: Mon Mar 2 12:56:39 2026 read: IOPS=0, BW=1981KiB/s (2028kB/s)(4096KiB/2068msec) clat (nsec): min=557573k, max=557573k, avg=557572603.00, stdev= 0.00 lat (nsec): min=557575k, max=557575k, avg=557574722.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 5626, max= 5626, per=71.02%, avg=5626.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3961KiB/s (4056kB/s)(8192KiB/2068msec); 0 zone resets clat (msec): min=537, max=949, avg=743.81, stdev=291.57 lat (msec): min=537, max=950, avg=744.16, stdev=291.57 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8192, max= 8192, per=65.41%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=10.50%, ctx=196, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147238: Mon Mar 2 12:56:39 2026 write: IOPS=1, BW=4697KiB/s (4810kB/s)(12.0MiB/2616msec); 0 zone resets clat (msec): min=249, max=1413, avg=842.26, stdev=582.29 lat (msec): min=249, max=1413, avg=842.70, stdev=582.33 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8175, max= 8175, per=65.27%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.85%, ctx=104, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147239: Mon Mar 2 12:56:39 2026 write: IOPS=1, BW=7380KiB/s (7557kB/s)(12.0MiB/1665msec); 0 zone resets clat (msec): min=231, max=1011, avg=539.94, stdev=414.99 lat (msec): min=232, max=1012, avg=540.33, stdev=414.92 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 6481, max= 8192, per=58.57%, avg=7336.50, stdev=1209.86, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.47%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7923KiB/s (8113kB/s), 1981KiB/s-6671KiB/s (2028kB/s-6831kB/s), io=16.0MiB (16.8MB), run=1842-2068msec WRITE: bw=12.2MiB/s (12.8MB/s), 3961KiB/s-7380KiB/s (4056kB/s-7557kB/s), io=32.0MiB (33.6MB), run=1665-2616msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147241: Mon Mar 2 12:56:39 2026 read: IOPS=1, BW=5283KiB/s (5410kB/s)(12.0MiB/2326msec) clat (msec): min=248, max=966, avg=724.33, stdev=412.22 lat (msec): min=248, max=966, avg=724.33, stdev=412.22 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.42%, ctx=64, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147242: Mon Mar 2 12:56:39 2026 read: IOPS=0, BW=1705KiB/s (1746kB/s)(4096KiB/2402msec) clat (nsec): min=1011.7M, max=1011.7M, avg=1011704826.00, stdev= 0.00 lat (nsec): min=1011.7M, max=1011.7M, avg=1011707296.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3410KiB/s (3492kB/s)(8192KiB/2402msec); 0 zone resets clat (msec): min=502, max=689, avg=595.87, stdev=132.45 lat (msec): min=502, max=689, avg=596.26, stdev=132.44 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8143, max= 8143, per=59.70%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.50%, ctx=74, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147243: Mon Mar 2 12:56:39 2026 write: IOPS=1, BW=5707KiB/s (5844kB/s)(12.0MiB/2153msec); 0 zone resets clat (msec): min=570, max=877, avg=684.89, stdev=167.45 lat (msec): min=570, max=877, avg=685.19, stdev=167.48 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8159, max= 8175, per=59.87%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.62%, ctx=49, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147244: Mon Mar 2 12:56:39 2026 write: IOPS=1, BW=6744KiB/s (6906kB/s)(12.0MiB/1822msec); 0 zone resets clat (msec): min=414, max=717, avg=549.86, stdev=154.40 lat (msec): min=414, max=718, avg=550.22, stdev=154.41 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 6140, max= 8175, per=52.47%, avg=7157.50, stdev=1438.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.16%, sys=12.14%, ctx=78, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6821KiB/s (6985kB/s), 1705KiB/s-5283KiB/s (1746kB/s-5410kB/s), io=16.0MiB (16.8MB), run=2326-2402msec WRITE: bw=13.3MiB/s (13.0MB/s), 3410KiB/s-6744KiB/s (3492kB/s-6906kB/s), io=32.0MiB (33.6MB), run=1822-2402msec