== sanity test 398b: DIO and buffer IO race ============== 00:36:26 (1783139786) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.56875 s, 9.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144494: Sat Jul 4 00:38:59 2026 read: IOPS=11, BW=44.6KiB/s (45.6kB/s)(5992KiB/134462msec) clat (usec): min=33, max=377380, avg=46074.27, stdev=35832.82 lat (usec): min=33, max=377382, avg=46083.83, stdev=35833.46 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 73], 10.00th=[ 13960], 20.00th=[ 21890], | 30.00th=[ 28181], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 64750], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[175113], 99.50th=[227541], 99.90th=[350225], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 120, per=24.99%, avg=44.23, stdev=19.43, samples=264 iops : min= 1, max= 30, avg=10.39, stdev= 4.90, samples=264 write: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6296KiB/134462msec); 0 zone resets clat (usec): min=925, max=855694, avg=41263.47, stdev=45143.12 lat (usec): min=927, max=855696, avg=41274.76, stdev=45146.67 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1631], 10.00th=[ 2835], 20.00th=[ 6128], | 30.00th=[ 11863], 40.00th=[ 20055], 50.00th=[ 30540], 60.00th=[ 40109], | 70.00th=[ 54264], 80.00th=[ 69731], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[175113], 99.50th=[221250], 99.90th=[329253], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 119, per=25.12%, avg=46.71, stdev=21.77, samples=263 iops : min= 1, max= 29, avg=11.00, stdev= 5.49, samples=263 lat (usec) : 50=0.16%, 100=3.32%, 250=0.42%, 1000=0.03% lat (msec) : 2=4.04%, 4=3.45%, 10=6.80%, 20=10.48%, 50=37.47% lat (msec) : 100=26.53%, 250=6.93%, 500=0.33%, 1000=0.03% cpu : usr=0.09%, sys=5.54%, ctx=6671, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144495: Sat Jul 4 00:38:59 2026 read: IOPS=11, BW=44.9KiB/s (45.9kB/s)(5940KiB/132371msec) clat (usec): min=39, max=396871, avg=44322.66, stdev=30820.96 lat (usec): min=39, max=396873, avg=44333.52, stdev=30818.21 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 81], 10.00th=[ 16057], 20.00th=[ 22676], | 30.00th=[ 27657], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[147850], 99.50th=[173016], 99.90th=[248513], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 5, max= 98, per=25.27%, avg=44.74, stdev=18.71, samples=258 iops : min= 1, max= 24, avg=10.51, stdev= 4.70, samples=258 write: IOPS=11, BW=47.0KiB/s (49.1kB/s)(6348KiB/132371msec); 0 zone resets clat (usec): min=959, max=853645, avg=41581.95, stdev=48423.68 lat (usec): min=961, max=853647, avg=41586.04, stdev=48423.19 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1598], 10.00th=[ 2245], 20.00th=[ 5538], | 30.00th=[ 11469], 40.00th=[ 20317], 50.00th=[ 30278], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 67634], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[189793], 99.50th=[221250], 99.90th=[583009], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 119, per=25.44%, avg=47.31, stdev=21.96, samples=260 iops : min= 1, max= 29, avg=11.17, stdev= 5.54, samples=260 lat (usec) : 50=0.16%, 100=2.60%, 250=0.33%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.62%, 4=3.97%, 10=6.32%, 20=9.60%, 50=40.01% lat (msec) : 100=25.10%, 250=6.90%, 500=0.13%, 750=0.03%, 1000=0.03% cpu : usr=0.11%, sys=5.53%, ctx=6803, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144496: Sat Jul 4 00:38:59 2026 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6028KiB/135108msec) clat (usec): min=29, max=617492, avg=44605.54, stdev=34919.69 lat (usec): min=29, max=617492, avg=44615.73, stdev=34918.35 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 77], 10.00th=[ 14222], 20.00th=[ 22152], | 30.00th=[ 26870], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 64750], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[181404], 99.90th=[346031], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 109, per=25.43%, avg=45.02, stdev=20.95, samples=260 iops : min= 1, max= 27, avg=10.59, stdev= 5.28, samples=260 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6260KiB/135108msec); 0 zone resets clat (usec): min=887, max=1130.0k, avg=43063.26, stdev=51210.38 lat (usec): min=888, max=1130.0k, avg=43068.77, stdev=51208.28 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1614], 10.00th=[ 2409], | 20.00th=[ 5538], 30.00th=[ 10814], 40.00th=[ 20579], | 50.00th=[ 31851], 60.00th=[ 41157], 70.00th=[ 54789], | 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[ 128451], | 99.00th=[ 200279], 99.50th=[ 219153], 99.90th=[ 329253], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 111, per=24.82%, avg=46.16, stdev=20.64, samples=263 iops : min= 1, max= 27, avg=10.87, stdev= 5.22, samples=263 lat (usec) : 50=0.26%, 100=3.03%, 250=0.26%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=4.36%, 4=3.19%, 10=7.65%, 20=9.28%, 50=38.02% lat (msec) : 100=26.40%, 250=6.97%, 500=0.26%, 750=0.03%, 2000=0.03% cpu : usr=0.10%, sys=5.58%, ctx=6757, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144500: Sat Jul 4 00:38:59 2026 read: IOPS=11, BW=44.0KiB/s (46.0kB/s)(6052KiB/134617msec) clat (usec): min=34, max=914738, avg=45256.93, stdev=38423.18 lat (usec): min=34, max=915341, avg=45268.38, stdev=38431.16 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 77], 10.00th=[ 14222], 20.00th=[ 22414], | 30.00th=[ 27395], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 65799], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[158335], 99.50th=[193987], 99.90th=[256902], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 111, per=25.32%, avg=44.81, stdev=18.91, samples=262 iops : min= 1, max= 27, avg=10.53, stdev= 4.77, samples=262 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6236KiB/134617msec); 0 zone resets clat (usec): min=1179, max=507599, avg=42108.87, stdev=43658.28 lat (usec): min=1181, max=507602, avg=42115.35, stdev=43655.36 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1614], 10.00th=[ 2671], 20.00th=[ 5800], | 30.00th=[ 10290], 40.00th=[ 19006], 50.00th=[ 30016], 60.00th=[ 41157], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[ 99091], 95.00th=[121111], | 99.00th=[181404], 99.50th=[202376], 99.90th=[341836], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 112, per=24.73%, avg=45.99, stdev=19.74, samples=263 iops : min= 1, max= 28, avg=10.83, stdev= 4.98, samples=263 lat (usec) : 50=0.36%, 100=2.70%, 250=0.36%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.20%, 4=3.35%, 10=7.85%, 20=10.12%, 50=36.88% lat (msec) : 100=26.66%, 250=7.16%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.55%, ctx=6859, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=178KiB/s (182kB/s), 44.6KiB/s-44.0KiB/s (45.6kB/s-46.0kB/s), io=23.4MiB (24.6MB), run=132371-135108msec WRITE: bw=186KiB/s (191kB/s), 46.3KiB/s-47.0KiB/s (47.4kB/s-49.1kB/s), io=24.6MiB (25.7MB), run=132371-135108msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144497: Sat Jul 4 00:40:58 2026 read: IOPS=5, BW=23.6KiB/s (24.2kB/s)(5992KiB/253561msec) clat (msec): min=6, max=889, avg=36.91, stdev=46.88 lat (msec): min=6, max=889, avg=36.91, stdev=46.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 117], | 99.00th=[ 209], 99.50th=[ 243], 99.90th=[ 617], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 104, per=27.63%, avg=25.97, stdev=17.35, samples=445 iops : min= 1, max= 26, avg= 5.84, stdev= 4.39, samples=445 write: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6296KiB/253561msec); 0 zone resets clat (msec): min=36, max=590, avg=125.67, stdev=67.99 lat (msec): min=36, max=590, avg=125.68, stdev=68.00 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 73], | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 213], 95.00th=[ 257], | 99.00th=[ 368], 99.50th=[ 384], 99.90th=[ 558], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 63, per=25.26%, avg=24.76, stdev=12.32, samples=489 iops : min= 1, max= 15, avg= 5.53, stdev= 3.14, samples=489 lat (msec) : 10=3.61%, 20=18.36%, 50=18.95%, 100=27.96%, 250=27.99% lat (msec) : 500=2.99%, 750=0.10%, 1000=0.03% cpu : usr=0.06%, sys=1.57%, ctx=5320, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144498: Sat Jul 4 00:40:58 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(5940KiB/254147msec) clat (msec): min=5, max=931, avg=35.32, stdev=43.65 lat (msec): min=5, max=931, avg=35.33, stdev=43.65 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 108], | 99.00th=[ 174], 99.50th=[ 234], 99.90th=[ 368], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 95, per=28.08%, avg=26.40, stdev=18.25, samples=435 iops : min= 1, max= 23, avg= 5.95, stdev= 4.62, samples=435 write: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6348KiB/254147msec); 0 zone resets clat (msec): min=33, max=556, avg=126.83, stdev=67.24 lat (msec): min=33, max=556, avg=126.83, stdev=67.23 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 142], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 259], | 99.00th=[ 368], 99.50th=[ 414], 99.90th=[ 477], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 56, per=25.24%, avg=24.74, stdev=12.04, samples=495 iops : min= 1, max= 14, avg= 5.53, stdev= 3.07, samples=495 lat (msec) : 10=3.71%, 20=18.23%, 50=18.75%, 100=27.15%, 250=28.84% lat (msec) : 500=3.26%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.53%, ctx=5303, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144499: Sat Jul 4 00:40:58 2026 read: IOPS=5, BW=23.7KiB/s (24.3kB/s)(6028KiB/254386msec) clat (msec): min=5, max=538, avg=36.90, stdev=41.34 lat (msec): min=5, max=538, avg=36.90, stdev=41.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 113], | 99.00th=[ 192], 99.50th=[ 213], 99.90th=[ 384], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 103, per=27.15%, avg=25.52, stdev=17.39, samples=455 iops : min= 1, max= 25, avg= 5.73, stdev= 4.36, samples=455 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6260KiB/254386msec); 0 zone resets clat (msec): min=32, max=1085, avg=126.78, stdev=70.49 lat (msec): min=32, max=1085, avg=126.78, stdev=70.49 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 96], 50.00th=[ 108], 60.00th=[ 123], | 70.00th=[ 142], 80.00th=[ 169], 90.00th=[ 215], 95.00th=[ 257], | 99.00th=[ 359], 99.50th=[ 435], 99.90th=[ 523], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 56, per=24.92%, avg=24.42, stdev=12.28, samples=493 iops : min= 1, max= 14, avg= 5.45, stdev= 3.14, samples=493 lat (msec) : 10=3.58%, 20=17.94%, 50=18.88%, 100=27.31%, 250=29.13% lat (msec) : 500=3.06%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.55%, ctx=5253, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144501: Sat Jul 4 00:40:58 2026 read: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6052KiB/252377msec) clat (msec): min=5, max=316, avg=34.81, stdev=36.70 lat (msec): min=5, max=316, avg=34.81, stdev=36.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 113], | 99.00th=[ 188], 99.50th=[ 222], 99.90th=[ 305], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 96, per=28.28%, avg=26.58, stdev=18.49, samples=440 iops : min= 1, max= 24, avg= 5.99, stdev= 4.69, samples=440 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6236KiB/252377msec); 0 zone resets clat (msec): min=28, max=979, avg=127.82, stdev=72.89 lat (msec): min=28, max=979, avg=127.82, stdev=72.89 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 107], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 176], 90.00th=[ 218], 95.00th=[ 266], | 99.00th=[ 363], 99.50th=[ 430], 99.90th=[ 600], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 63, per=24.78%, avg=24.29, stdev=12.50, samples=494 iops : min= 1, max= 15, avg= 5.41, stdev= 3.18, samples=494 lat (msec) : 10=4.43%, 20=17.97%, 50=19.01%, 100=27.25%, 250=27.96% lat (msec) : 500=3.22%, 750=0.13%, 1000=0.03% cpu : usr=0.06%, sys=1.53%, ctx=5303, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=94.4KiB/s (96.7kB/s), 23.4KiB/s-23.0KiB/s (23.9kB/s-24.6kB/s), io=23.4MiB (24.6MB), run=252377-254386msec WRITE: bw=98.8KiB/s (101kB/s), 24.6KiB/s-24.0KiB/s (25.2kB/s-25.6kB/s), io=24.6MiB (25.7MB), run=252377-254386msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144555: Sat Jul 4 00:41:40 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5920KiB/28777msec) clat (usec): min=45, max=246278, avg=42616.67, stdev=33436.98 lat (usec): min=45, max=246281, avg=42636.02, stdev=33439.67 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 76], 20.00th=[ 1729], | 30.00th=[ 26084], 40.00th=[ 32900], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 54789], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[164627], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 94, max= 380, per=26.59%, avg=204.98, stdev=80.44, samples=56 iops : min= 5, max= 23, avg=12.04, stdev= 5.14, samples=56 write: IOPS=13, BW=221KiB/s (227kB/s)(6368KiB/28777msec); 0 zone resets clat (usec): min=1769, max=178034, avg=32525.00, stdev=32305.29 lat (usec): min=1772, max=178037, avg=32547.83, stdev=32330.72 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2089], 10.00th=[ 3294], 20.00th=[ 5800], | 30.00th=[ 9372], 40.00th=[ 14222], 50.00th=[ 21365], 60.00th=[ 29230], | 70.00th=[ 40109], 80.00th=[ 58983], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[137364], 99.50th=[162530], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 544, per=27.39%, avg=222.14, stdev=99.28, samples=56 iops : min= 1, max= 34, avg=13.11, stdev= 6.29, samples=56 lat (usec) : 50=0.39%, 100=7.68%, 250=0.91%, 500=0.26%, 750=0.13% lat (msec) : 2=1.82%, 4=4.95%, 10=10.29%, 20=9.77%, 50=32.68% lat (msec) : 100=26.43%, 250=4.69% cpu : usr=0.09%, sys=6.72%, ctx=1584, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144556: Sat Jul 4 00:41:40 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(5744KiB/30656msec) clat (usec): min=41, max=326146, avg=44997.20, stdev=35664.58 lat (usec): min=41, max=326148, avg=45002.79, stdev=35665.56 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 65], 10.00th=[ 81], 20.00th=[ 20841], | 30.00th=[ 29492], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 45876], | 70.00th=[ 56361], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[177210], 99.50th=[204473], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 392, per=24.49%, avg=188.80, stdev=81.64, samples=59 iops : min= 1, max= 24, avg=11.00, stdev= 5.20, samples=59 write: IOPS=13, BW=213KiB/s (219kB/s)(6544KiB/30656msec); 0 zone resets clat (usec): min=1403, max=441669, avg=35283.54, stdev=41821.98 lat (usec): min=1406, max=441673, avg=35299.33, stdev=41815.80 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2147], 10.00th=[ 3228], 20.00th=[ 6063], | 30.00th=[ 8586], 40.00th=[ 14222], 50.00th=[ 20317], 60.00th=[ 31589], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[107480], | 99.00th=[149947], 99.50th=[250610], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 63, max= 384, per=26.12%, avg=211.87, stdev=78.82, samples=60 iops : min= 3, max= 24, avg=12.48, stdev= 5.01, samples=60 lat (usec) : 50=0.78%, 100=4.82%, 250=1.17%, 500=0.52%, 750=0.13% lat (msec) : 2=2.08%, 4=4.69%, 10=10.94%, 20=10.29%, 50=33.85% lat (msec) : 100=24.74%, 250=5.47%, 500=0.52% cpu : usr=0.08%, sys=6.63%, ctx=1629, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144557: Sat Jul 4 00:41:40 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31064msec) clat (usec): min=23, max=423443, avg=44399.99, stdev=43176.34 lat (usec): min=23, max=423444, avg=44404.52, stdev=43182.62 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 63], 10.00th=[ 76], 20.00th=[ 15926], | 30.00th=[ 25035], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 54264], 80.00th=[ 65799], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[214959], 99.50th=[308282], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 30, max= 477, per=26.13%, avg=201.46, stdev=82.47, samples=61 iops : min= 1, max= 29, avg=11.82, stdev= 5.21, samples=61 write: IOPS=12, BW=194KiB/s (199kB/s)(6032KiB/31064msec); 0 zone resets clat (usec): min=1612, max=226306, avg=36134.68, stdev=34360.80 lat (usec): min=1615, max=226310, avg=36153.67, stdev=34370.96 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2540], 10.00th=[ 3851], 20.00th=[ 7308], | 30.00th=[ 9896], 40.00th=[ 17171], 50.00th=[ 26870], 60.00th=[ 35390], | 70.00th=[ 47449], 80.00th=[ 61080], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[145753], 99.50th=[212861], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 30, max= 383, per=23.61%, avg=191.48, stdev=77.27, samples=61 iops : min= 1, max= 23, avg=11.20, stdev= 4.89, samples=61 lat (usec) : 50=1.04%, 100=7.29%, 250=1.17%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.04%, 4=4.30%, 10=9.77%, 20=8.20%, 50=35.68% lat (msec) : 100=25.65%, 250=5.34%, 500=0.26% cpu : usr=0.08%, sys=6.60%, ctx=1594, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144558: Sat Jul 4 00:41:40 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29520msec) clat (usec): min=39, max=228068, avg=42835.79, stdev=32822.13 lat (usec): min=39, max=228071, avg=42837.80, stdev=32822.06 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 67], 10.00th=[ 81], 20.00th=[ 16909], | 30.00th=[ 27919], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[102237], | 99.00th=[143655], 99.50th=[196084], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 381, per=26.31%, avg=202.84, stdev=84.78, samples=58 iops : min= 1, max= 23, avg=11.90, stdev= 5.34, samples=58 write: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29520msec); 0 zone resets clat (usec): min=1568, max=356372, avg=34075.19, stdev=36557.82 lat (usec): min=1572, max=356377, avg=34091.93, stdev=36553.13 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2180], 10.00th=[ 3884], 20.00th=[ 7046], | 30.00th=[ 9372], 40.00th=[ 15401], 50.00th=[ 23200], 60.00th=[ 32375], | 70.00th=[ 43254], 80.00th=[ 54264], 90.00th=[ 74974], 95.00th=[104334], | 99.00th=[149947], 99.50th=[212861], 99.90th=[354419], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 31, max= 410, per=26.11%, avg=211.74, stdev=84.15, samples=58 iops : min= 1, max= 25, avg=12.47, stdev= 5.29, samples=58 lat (usec) : 50=0.65%, 100=5.99%, 250=1.56%, 500=0.39% lat (msec) : 2=1.69%, 4=4.30%, 10=10.03%, 20=9.64%, 50=36.98% lat (msec) : 100=23.44%, 250=5.21%, 500=0.13% cpu : usr=0.08%, sys=6.40%, ctx=1600, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=771KiB/s (790kB/s), 187KiB/s-206KiB/s (192kB/s-211kB/s), io=23.4MiB (24.5MB), run=28777-31064msec WRITE: bw=811KiB/s (831kB/s), 194KiB/s-221KiB/s (199kB/s-227kB/s), io=24.6MiB (25.8MB), run=28777-31064msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144550: Sat Jul 4 00:42:26 2026 read: IOPS=4, BW=77.0KiB/s (78.9kB/s)(5920KiB/76843msec) clat (msec): min=7, max=272, avg=43.06, stdev=39.47 lat (msec): min=7, max=272, avg=43.06, stdev=39.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 91], 95.00th=[ 121], | 99.00th=[ 207], 99.50th=[ 247], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 30, max= 320, per=27.93%, avg=86.31, stdev=52.98, samples=133 iops : min= 1, max= 20, avg= 4.59, stdev= 3.38, samples=133 write: IOPS=5, BW=82.9KiB/s (84.9kB/s)(6368KiB/76843msec); 0 zone resets clat (msec): min=47, max=478, avg=152.53, stdev=63.12 lat (msec): min=47, max=478, avg=152.55, stdev=63.15 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 73], 10.00th=[ 85], 20.00th=[ 103], | 30.00th=[ 116], 40.00th=[ 128], 50.00th=[ 144], 60.00th=[ 157], | 70.00th=[ 174], 80.00th=[ 194], 90.00th=[ 243], 95.00th=[ 275], | 99.00th=[ 355], 99.50th=[ 409], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 29, max= 224, per=25.79%, avg=83.83, stdev=33.44, samples=148 iops : min= 1, max= 14, avg= 4.43, stdev= 2.18, samples=148 lat (msec) : 10=1.95%, 20=9.90%, 50=24.74%, 100=17.45%, 250=41.93% lat (msec) : 500=4.04% cpu : usr=0.05%, sys=1.43%, ctx=1310, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144551: Sat Jul 4 00:42:26 2026 read: IOPS=4, BW=74.2KiB/s (75.0kB/s)(5744KiB/77420msec) clat (msec): min=7, max=200, avg=41.21, stdev=32.27 lat (msec): min=7, max=200, avg=41.22, stdev=32.27 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 83], 95.00th=[ 113], | 99.00th=[ 174], 99.50th=[ 192], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 28, max= 349, per=27.64%, avg=85.40, stdev=56.59, samples=130 iops : min= 1, max= 21, avg= 4.55, stdev= 3.62, samples=130 write: IOPS=5, BW=84.5KiB/s (86.6kB/s)(6544KiB/77420msec); 0 zone resets clat (msec): min=30, max=555, avg=152.72, stdev=70.47 lat (msec): min=30, max=555, avg=152.72, stdev=70.47 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 96], | 30.00th=[ 107], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 203], 90.00th=[ 245], 95.00th=[ 279], | 99.00th=[ 359], 99.50th=[ 468], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 30, max= 224, per=25.79%, avg=83.80, stdev=36.63, samples=151 iops : min= 1, max= 14, avg= 4.42, stdev= 2.38, samples=151 lat (msec) : 10=0.91%, 20=9.77%, 50=24.74%, 100=20.44%, 250=39.32% lat (msec) : 500=4.69%, 750=0.13% cpu : usr=0.05%, sys=1.44%, ctx=1283, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144552: Sat Jul 4 00:42:26 2026 read: IOPS=5, BW=83.1KiB/s (85.1kB/s)(6256KiB/75269msec) clat (msec): min=7, max=219, avg=40.67, stdev=31.95 lat (msec): min=7, max=219, avg=40.67, stdev=31.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 77], 95.00th=[ 108], | 99.00th=[ 171], 99.50th=[ 186], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 30, max= 277, per=30.06%, avg=92.89, stdev=57.87, samples=132 iops : min= 1, max= 17, avg= 4.98, stdev= 3.68, samples=132 write: IOPS=5, BW=80.1KiB/s (82.1kB/s)(6032KiB/75269msec); 0 zone resets clat (msec): min=33, max=520, avg=157.27, stdev=67.44 lat (msec): min=33, max=520, avg=157.27, stdev=67.44 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 69], 10.00th=[ 84], 20.00th=[ 103], | 30.00th=[ 116], 40.00th=[ 129], 50.00th=[ 146], 60.00th=[ 167], | 70.00th=[ 182], 80.00th=[ 205], 90.00th=[ 247], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 426], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 31, max= 224, per=24.49%, avg=79.58, stdev=33.26, samples=147 iops : min= 1, max= 14, avg= 4.15, stdev= 2.18, samples=147 lat (msec) : 10=1.30%, 20=10.42%, 50=27.60%, 100=17.45%, 250=38.80% lat (msec) : 500=4.30%, 750=0.13% cpu : usr=0.04%, sys=1.53%, ctx=1353, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144553: Sat Jul 4 00:42:26 2026 read: IOPS=4, BW=78.8KiB/s (80.7kB/s)(6032KiB/76561msec) clat (msec): min=6, max=214, avg=43.41, stdev=36.16 lat (msec): min=6, max=214, avg=43.41, stdev=36.16 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 87], 95.00th=[ 130], | 99.00th=[ 174], 99.50th=[ 197], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 30, max= 288, per=29.72%, avg=91.84, stdev=56.73, samples=128 iops : min= 1, max= 18, avg= 4.93, stdev= 3.63, samples=128 write: IOPS=5, BW=81.7KiB/s (83.7kB/s)(6256KiB/76561msec); 0 zone resets clat (msec): min=41, max=388, avg=153.50, stdev=63.12 lat (msec): min=41, max=388, avg=153.51, stdev=63.12 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 67], 10.00th=[ 87], 20.00th=[ 101], | 30.00th=[ 115], 40.00th=[ 130], 50.00th=[ 146], 60.00th=[ 161], | 70.00th=[ 178], 80.00th=[ 201], 90.00th=[ 243], 95.00th=[ 275], | 99.00th=[ 355], 99.50th=[ 368], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 30, max= 224, per=25.27%, avg=82.14, stdev=35.08, samples=149 iops : min= 1, max= 14, avg= 4.32, stdev= 2.29, samples=149 lat (msec) : 10=1.82%, 20=10.29%, 50=23.70%, 100=19.92%, 250=40.36% lat (msec) : 500=3.91% cpu : usr=0.04%, sys=1.39%, ctx=1322, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=309KiB/s (317kB/s), 74.2KiB/s-83.1KiB/s (75.0kB/s-85.1kB/s), io=23.4MiB (24.5MB), run=75269-77420msec WRITE: bw=325KiB/s (333kB/s), 80.1KiB/s-84.5KiB/s (82.1kB/s-86.6kB/s), io=24.6MiB (25.8MB), run=75269-77420msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144579: Sat Jul 4 00:42:47 2026 read: IOPS=1, BW=1802KiB/s (1846kB/s)(7168KiB/3977msec) clat (msec): min=97, max=384, avg=194.11, stdev=100.88 lat (msec): min=97, max=384, avg=194.11, stdev=100.88 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 124], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 153], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 271], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1828, max= 4101, per=78.71%, avg=2492.00, stdev=1076.58, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1287KiB/s (1318kB/s)(5120KiB/3977msec); 0 zone resets clat (msec): min=246, max=934, avg=478.92, stdev=267.95 lat (msec): min=246, max=937, avg=479.85, stdev=269.45 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1828, max= 2039, per=44.15%, avg=1956.80, stdev=85.41, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=3.40%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144580: Sat Jul 4 00:42:47 2026 read: IOPS=0, BW=317KiB/s (324kB/s)(2048KiB/6468msec) clat (msec): min=128, max=376, avg=252.56, stdev=175.19 lat (msec): min=128, max=376, avg=252.57, stdev=175.19 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 129], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1376, max= 2003, per=53.36%, avg=1689.50, stdev=443.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1583KiB/s (1621kB/s)(10.0MiB/6468msec); 0 zone resets clat (msec): min=223, max=1587, avg=583.01, stdev=403.09 lat (msec): min=223, max=1587, avg=583.32, stdev=402.97 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 271], | 30.00th=[ 317], 40.00th=[ 334], 50.00th=[ 460], 60.00th=[ 575], | 70.00th=[ 584], 80.00th=[ 625], 90.00th=[ 860], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 1376, max= 4079, per=55.34%, avg=2452.57, stdev=1101.78, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.06%, sys=3.11%, ctx=72, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144581: Sat Jul 4 00:42:47 2026 read: IOPS=1, BW=1288KiB/s (1319kB/s)(6144KiB/4769msec) clat (msec): min=128, max=353, avg=208.33, stdev=80.66 lat (msec): min=128, max=353, avg=208.34, stdev=80.66 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 207], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1831, max= 4063, per=77.50%, avg=2453.50, stdev=1075.30, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1288KiB/s (1319kB/s)(6144KiB/4769msec); 0 zone resets clat (msec): min=205, max=1004, avg=576.13, stdev=338.35 lat (msec): min=205, max=1004, avg=576.27, stdev=338.33 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 542], | 70.00th=[ 961], 80.00th=[ 961], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1831, max= 4096, per=53.38%, avg=2365.60, stdev=969.60, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=3.63%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144582: Sat Jul 4 00:42:47 2026 read: IOPS=1, BW=1134KiB/s (1161kB/s)(5120KiB/4515msec) clat (msec): min=181, max=892, avg=355.97, stdev=300.90 lat (msec): min=181, max=892, avg=355.97, stdev=300.90 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 182], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 255], 80.00th=[ 255], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1917, max= 4007, per=82.83%, avg=2622.33, stdev=1199.23, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1588KiB/s (1626kB/s)(7168KiB/4515msec); 0 zone resets clat (msec): min=206, max=561, avg=364.12, stdev=118.08 lat (msec): min=207, max=561, avg=364.42, stdev=117.87 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 275], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 363], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 460], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1831, max= 4063, per=54.26%, avg=2405.00, stdev=931.43, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.21%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3166KiB/s (3242kB/s), 317KiB/s-1802KiB/s (324kB/s-1846kB/s), io=20.0MiB (20.0MB), run=3977-6468msec WRITE: bw=4433KiB/s (4539kB/s), 1287KiB/s-1588KiB/s (1318kB/s-1626kB/s), io=28.0MiB (29.4MB), run=3977-6468msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144584: Sat Jul 4 00:42:47 2026 read: IOPS=1, BW=1953KiB/s (2000kB/s)(7168KiB/3670msec) clat (msec): min=132, max=540, avg=334.23, stdev=131.58 lat (msec): min=132, max=540, avg=334.23, stdev=131.58 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 245], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 347], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 430], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1780, max= 3737, per=63.65%, avg=2346.00, stdev=930.16, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1395KiB/s (1429kB/s)(5120KiB/3670msec); 0 zone resets clat (msec): min=126, max=391, avg=265.47, stdev=107.08 lat (msec): min=126, max=392, avg=265.55, stdev=107.09 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1868, max= 4031, per=50.73%, avg=2617.67, stdev=1224.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=14.72%, ctx=138, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144585: Sat Jul 4 00:42:47 2026 read: IOPS=0, BW=369KiB/s (377kB/s)(2048KiB/5556msec) clat (msec): min=339, max=371, avg=355.28, stdev=22.98 lat (msec): min=339, max=371, avg=355.28, stdev=22.98 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1992, max= 2039, per=54.68%, avg=2015.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1843KiB/s (1887kB/s)(10.0MiB/5556msec); 0 zone resets clat (msec): min=179, max=842, avg=482.19, stdev=232.58 lat (msec): min=180, max=842, avg=484.11, stdev=234.56 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 194], | 30.00th=[ 321], 40.00th=[ 397], 50.00th=[ 426], 60.00th=[ 460], | 70.00th=[ 506], 80.00th=[ 709], 90.00th=[ 785], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1790, max= 2048, per=38.12%, avg=1966.75, stdev=99.23, samples=8 iops : min= 1, max= 2, avg= 1.12, stdev= 0.35, samples=8 lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=16.67% cpu : usr=0.04%, sys=13.95%, ctx=173, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144586: Sat Jul 4 00:42:47 2026 read: IOPS=1, BW=1260KiB/s (1290kB/s)(6144KiB/4877msec) clat (usec): min=699, max=315817, avg=100723.21, stdev=149328.31 lat (usec): min=700, max=315819, avg=100724.78, stdev=149328.14 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 4146], | 30.00th=[ 4146], 40.00th=[ 4752], 50.00th=[ 4752], 60.00th=[ 9634], | 70.00th=[270533], 80.00th=[270533], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 1954, max= 5585, per=86.70%, avg=3195.67, stdev=2069.76, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1260KiB/s (1290kB/s)(6144KiB/4877msec); 0 zone resets clat (msec): min=286, max=1872, avg=711.84, stdev=608.07 lat (msec): min=286, max=1872, avg=711.90, stdev=608.08 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 542], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 1861, max= 3856, per=47.09%, avg=2429.75, stdev=953.89, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=25.00%, 500=41.67%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.71%, ctx=153, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144587: Sat Jul 4 00:42:47 2026 read: IOPS=0, BW=987KiB/s (1010kB/s)(5120KiB/5189msec) clat (usec): min=452, max=228286, avg=46339.34, stdev=101711.67 lat (usec): min=453, max=228287, avg=46340.37, stdev=101712.08 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[ 955], 60.00th=[ 955], | 70.00th=[ 1139], 80.00th=[ 1139], 90.00th=[227541], 95.00th=[227541], | 99.00th=[227541], 99.50th=[227541], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1381KiB/s (1415kB/s)(7168KiB/5189msec); 0 zone resets clat (msec): min=115, max=1919, avg=707.55, stdev=659.64 lat (msec): min=116, max=1919, avg=707.64, stdev=659.65 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 288], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 359], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 1284], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 1928, max= 4096, per=46.62%, avg=2405.60, stdev=945.97, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 500=8.33%, 1000=16.67% lat (msec) : 2=8.33%, 250=16.67%, 500=25.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=6.75%, ctx=112, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3686KiB/s (3775kB/s), 369KiB/s-1953KiB/s (377kB/s-2000kB/s), io=20.0MiB (20.0MB), run=3670-5556msec WRITE: bw=5161KiB/s (5284kB/s), 1260KiB/s-1843KiB/s (1290kB/s-1887kB/s), io=28.0MiB (29.4MB), run=3670-5556msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144599: Sat Jul 4 00:43:03 2026 read: IOPS=0, BW=3992KiB/s (4088kB/s)(12.0MiB/3078msec) clat (msec): min=379, max=1603, avg=1015.09, stdev=613.14 lat (msec): min=379, max=1603, avg=1015.09, stdev=613.14 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.38%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144600: Sat Jul 4 00:43:03 2026 read: IOPS=0, BW=1311KiB/s (1343kB/s)(4096KiB/3124msec) clat (nsec): min=826618k, max=826618k, avg=826618165.00, stdev= 0.00 lat (nsec): min=826622k, max=826622k, avg=826621522.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2622KiB/s (2685kB/s)(8192KiB/3124msec); 0 zone resets clat (msec): min=404, max=1836, avg=1120.23, stdev=1012.35 lat (msec): min=404, max=1836, avg=1120.67, stdev=1012.34 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8192, max= 8192, per=90.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.65%, ctx=44, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144601: Sat Jul 4 00:43:03 2026 write: IOPS=0, BW=3388KiB/s (3469kB/s)(12.0MiB/3627msec); 0 zone resets clat (msec): min=259, max=1824, avg=1185.62, stdev=821.38 lat (msec): min=259, max=1836, avg=1189.71, stdev=825.57 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8175, max= 8192, per=90.59%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=2.90%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144602: Sat Jul 4 00:43:03 2026 write: IOPS=1, BW=4523KiB/s (4631kB/s)(12.0MiB/2717msec); 0 zone resets clat (msec): min=385, max=1276, avg=903.04, stdev=462.79 lat (msec): min=386, max=1277, avg=904.02, stdev=462.32 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 5490, max= 8175, per=75.63%, avg=6832.50, stdev=1898.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.07%, sys=7.07%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5245KiB/s (5370kB/s), 1311KiB/s-3992KiB/s (1343kB/s-4088kB/s), io=16.0MiB (16.8MB), run=3078-3124msec WRITE: bw=9034KiB/s (9251kB/s), 2622KiB/s-4523KiB/s (2685kB/s-4631kB/s), io=32.0MiB (33.6MB), run=2717-3627msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144594: Sat Jul 4 00:43:03 2026 read: IOPS=0, BW=3876KiB/s (3969kB/s)(12.0MiB/3170msec) clat (msec): min=916, max=971, avg=950.59, stdev=30.07 lat (msec): min=916, max=971, avg=950.59, stdev=30.07 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7876, max= 8078, per=100.00%, avg=7977.00, stdev=142.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=12.46%, ctx=326, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144595: Sat Jul 4 00:43:03 2026 read: IOPS=0, BW=1308KiB/s (1340kB/s)(4096KiB/3131msec) clat (nsec): min=971253k, max=971253k, avg=971253202.00, stdev= 0.00 lat (nsec): min=971257k, max=971257k, avg=971257162.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 969], 5.00th=[ 969], 10.00th=[ 969], 20.00th=[ 969], | 30.00th=[ 969], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2616KiB/s (2679kB/s)(8192KiB/3131msec); 0 zone resets clat (msec): min=376, max=1497, avg=937.00, stdev=792.92 lat (msec): min=376, max=1499, avg=938.13, stdev=793.68 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.18%, ctx=282, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144596: Sat Jul 4 00:43:03 2026 write: IOPS=0, BW=2696KiB/s (2761kB/s)(12.0MiB/4558msec); 0 zone resets clat (msec): min=258, max=2829, avg=1430.03, stdev=1300.56 lat (msec): min=258, max=2829, avg=1430.68, stdev=1300.37 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.14%, ctx=87, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144597: Sat Jul 4 00:43:03 2026 write: IOPS=1, BW=4618KiB/s (4729kB/s)(12.0MiB/2661msec); 0 zone resets clat (msec): min=419, max=1249, avg=765.29, stdev=432.21 lat (msec): min=419, max=1251, avg=766.55, stdev=432.95 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=7.03%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5168KiB/s (5292kB/s), 1308KiB/s-3876KiB/s (1340kB/s-3969kB/s), io=16.0MiB (16.8MB), run=3131-3170msec WRITE: bw=7189KiB/s (7362kB/s), 2616KiB/s-4618KiB/s (2679kB/s-4729kB/s), io=32.0MiB (33.6MB), run=2661-4558msec