== sanity test 398b: DIO and buffer IO race ============== 03:27:31 (1785223651) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.91813 s, 8.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144613: Tue Jul 28 03:30:09 2026 read: IOPS=10, BW=43.4KiB/s (44.5kB/s)(5992KiB/137996msec) clat (usec): min=35, max=541912, avg=45120.61, stdev=39375.69 lat (usec): min=35, max=541915, avg=45123.74, stdev=39375.51 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 94], 20.00th=[ 20317], | 30.00th=[ 26608], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[162530], 99.50th=[254804], 99.90th=[455082], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 111, per=25.38%, avg=43.65, stdev=19.31, samples=267 iops : min= 1, max= 27, avg=10.26, stdev= 4.87, samples=267 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6296KiB/137996msec); 0 zone resets clat (usec): min=1076, max=391977, avg=44456.42, stdev=44249.55 lat (usec): min=1077, max=391979, avg=44465.86, stdev=44244.38 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1450], 10.00th=[ 2057], 20.00th=[ 5211], | 30.00th=[ 10552], 40.00th=[ 21890], 50.00th=[ 33162], 60.00th=[ 43779], | 70.00th=[ 58459], 80.00th=[ 76022], 90.00th=[108528], 95.00th=[133694], | 99.00th=[175113], 99.50th=[191890], 99.90th=[316670], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 111, per=25.32%, avg=45.57, stdev=20.13, samples=269 iops : min= 1, max= 27, avg=10.74, stdev= 5.05, samples=269 lat (usec) : 50=0.42%, 100=4.49%, 250=0.62%, 500=0.13%, 750=0.10% lat (msec) : 2=4.98%, 4=3.48%, 10=6.87%, 20=8.30%, 50=35.71% lat (msec) : 100=25.85%, 250=8.72%, 500=0.29%, 750=0.03% cpu : usr=0.08%, sys=4.98%, ctx=6609, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144614: Tue Jul 28 03:30:09 2026 read: IOPS=10, BW=42.7KiB/s (43.7kB/s)(5940KiB/139222msec) clat (usec): min=28, max=430256, avg=44495.86, stdev=34083.21 lat (usec): min=28, max=430258, avg=44498.66, stdev=34082.65 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 65], 10.00th=[ 151], 20.00th=[ 20841], | 30.00th=[ 27395], 40.00th=[ 32637], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 65799], 90.00th=[ 85459], 95.00th=[105382], | 99.00th=[145753], 99.50th=[173016], 99.90th=[358613], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 7, max= 117, per=24.75%, avg=42.57, stdev=20.45, samples=272 iops : min= 1, max= 29, avg= 9.99, stdev= 5.15, samples=272 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6348KiB/139222msec); 0 zone resets clat (usec): min=1031, max=701733, avg=45864.21, stdev=54673.18 lat (usec): min=1033, max=701736, avg=45866.76, stdev=54673.09 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 2147], 20.00th=[ 5276], | 30.00th=[ 9372], 40.00th=[ 19792], 50.00th=[ 30540], 60.00th=[ 43254], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[106431], 95.00th=[137364], | 99.00th=[235930], 99.50th=[329253], 99.90th=[574620], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 112, per=25.12%, avg=45.21, stdev=20.65, samples=274 iops : min= 1, max= 28, avg=10.65, stdev= 5.21, samples=274 lat (usec) : 50=0.49%, 100=4.07%, 250=0.39%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=4.65%, 4=3.94%, 10=7.58%, 20=8.37%, 50=35.12% lat (msec) : 100=26.37%, 250=8.17%, 500=0.46%, 750=0.10% cpu : usr=0.08%, sys=4.89%, ctx=6490, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144615: Tue Jul 28 03:30:09 2026 read: IOPS=10, BW=43.7KiB/s (44.8kB/s)(6028KiB/137886msec) clat (usec): min=33, max=363564, avg=45145.00, stdev=34247.78 lat (usec): min=34, max=363566, avg=45149.85, stdev=34244.69 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 109], 20.00th=[ 21103], | 30.00th=[ 26870], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[147850], 99.50th=[170918], 99.90th=[304088], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 135, per=25.66%, avg=44.13, stdev=20.25, samples=266 iops : min= 1, max= 33, avg=10.37, stdev= 5.10, samples=266 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6260KiB/137886msec); 0 zone resets clat (usec): min=1050, max=849138, avg=44366.78, stdev=52530.83 lat (usec): min=1050, max=849141, avg=44374.55, stdev=52530.63 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1516], 10.00th=[ 2573], 20.00th=[ 5538], | 30.00th=[ 10159], 40.00th=[ 17433], 50.00th=[ 30540], 60.00th=[ 43779], | 70.00th=[ 57410], 80.00th=[ 76022], 90.00th=[103285], 95.00th=[128451], | 99.00th=[208667], 99.50th=[267387], 99.90th=[608175], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 111, per=25.25%, avg=45.45, stdev=20.96, samples=268 iops : min= 1, max= 27, avg=10.71, stdev= 5.27, samples=268 lat (usec) : 50=0.52%, 100=4.26%, 250=0.46%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.04%, 4=3.65%, 10=7.85%, 20=9.41%, 50=34.11% lat (msec) : 100=26.76%, 250=8.24%, 500=0.36%, 750=0.07%, 1000=0.03% cpu : usr=0.08%, sys=4.91%, ctx=6560, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144616: Tue Jul 28 03:30:09 2026 read: IOPS=10, BW=43.6KiB/s (44.7kB/s)(6052KiB/138769msec) clat (usec): min=22, max=541810, avg=44746.55, stdev=38176.18 lat (usec): min=22, max=541812, avg=44751.81, stdev=38176.07 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 79], 20.00th=[ 19792], | 30.00th=[ 26084], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[162530], 99.50th=[208667], 99.90th=[471860], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 7, max= 102, per=25.40%, avg=43.69, stdev=19.86, samples=270 iops : min= 1, max= 25, avg=10.27, stdev= 5.00, samples=270 write: IOPS=11, BW=44.9KiB/s (46.0kB/s)(6236KiB/138769msec); 0 zone resets clat (usec): min=957, max=834734, avg=45312.30, stdev=51678.32 lat (usec): min=958, max=834737, avg=45320.10, stdev=51678.44 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 2089], 20.00th=[ 5276], | 30.00th=[ 9896], 40.00th=[ 20055], 50.00th=[ 32900], 60.00th=[ 45876], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[132645], | 99.00th=[212861], 99.50th=[240124], 99.90th=[530580], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 103, per=25.01%, avg=45.02, stdev=18.96, samples=270 iops : min= 1, max= 25, avg=10.60, stdev= 4.78, samples=270 lat (usec) : 50=0.98%, 100=4.65%, 250=0.46%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.82%, 4=3.78%, 10=6.90%, 20=8.56%, 50=33.69% lat (msec) : 100=27.02%, 250=8.59%, 500=0.23%, 750=0.07%, 1000=0.03% cpu : usr=0.07%, sys=4.72%, ctx=6453, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=172KiB/s (177kB/s), 42.7KiB/s-43.7KiB/s (43.7kB/s-44.8kB/s), io=23.4MiB (24.6MB), run=137886-139222msec WRITE: bw=181KiB/s (185kB/s), 44.9KiB/s-45.6KiB/s (46.0kB/s-46.7kB/s), io=24.6MiB (25.7MB), run=137886-139222msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144608: Tue Jul 28 03:32:27 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(5992KiB/276293msec) clat (msec): min=6, max=609, avg=38.66, stdev=44.91 lat (msec): min=6, max=609, avg=38.66, stdev=44.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 90], 95.00th=[ 125], | 99.00th=[ 199], 99.50th=[ 253], 99.90th=[ 493], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 80, per=28.54%, avg=24.54, stdev=17.05, samples=472 iops : min= 1, max= 20, avg= 5.51, stdev= 4.32, samples=472 write: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6296KiB/276293msec); 0 zone resets clat (msec): min=29, max=1023, avg=138.45, stdev=77.10 lat (msec): min=29, max=1023, avg=138.46, stdev=77.10 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 116], 60.00th=[ 133], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 236], 95.00th=[ 292], | 99.00th=[ 414], 99.50th=[ 460], 99.90th=[ 542], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 63, per=25.40%, avg=22.86, stdev=11.38, samples=530 iops : min= 1, max= 15, avg= 5.08, stdev= 2.89, samples=530 lat (msec) : 10=2.86%, 20=17.38%, 50=19.30%, 100=24.48%, 250=31.64% lat (msec) : 500=4.20%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.34%, ctx=5319, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144609: Tue Jul 28 03:32:27 2026 read: IOPS=5, BW=21.5KiB/s (22.0kB/s)(5940KiB/276255msec) clat (msec): min=5, max=778, avg=37.07, stdev=42.78 lat (msec): min=5, max=778, avg=37.08, stdev=42.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 49], 90.00th=[ 83], 95.00th=[ 116], | 99.00th=[ 197], 99.50th=[ 209], 99.90th=[ 426], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 88, per=29.19%, avg=25.10, stdev=16.69, samples=457 iops : min= 1, max= 22, avg= 5.66, stdev= 4.20, samples=457 write: IOPS=5, BW=22.0KiB/s (23.5kB/s)(6348KiB/276255msec); 0 zone resets clat (msec): min=35, max=840, avg=139.12, stdev=78.40 lat (msec): min=35, max=840, avg=139.13, stdev=78.40 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 107], 50.00th=[ 118], 60.00th=[ 134], | 70.00th=[ 157], 80.00th=[ 186], 90.00th=[ 239], 95.00th=[ 296], | 99.00th=[ 414], 99.50th=[ 477], 99.90th=[ 785], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 56, per=25.48%, avg=22.93, stdev=11.22, samples=533 iops : min= 1, max= 14, avg= 5.11, stdev= 2.87, samples=533 lat (msec) : 10=2.38%, 20=17.61%, 50=19.69%, 100=23.57%, 250=32.32% lat (msec) : 500=4.20%, 750=0.13%, 1000=0.10% cpu : usr=0.04%, sys=1.33%, ctx=5457, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144610: Tue Jul 28 03:32:27 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6028KiB/276938msec) clat (msec): min=5, max=290, avg=38.24, stdev=37.11 lat (msec): min=5, max=290, avg=38.24, stdev=37.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 38], 80.00th=[ 56], 90.00th=[ 91], 95.00th=[ 118], | 99.00th=[ 167], 99.50th=[ 205], 99.90th=[ 255], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 120, per=28.47%, avg=24.48, stdev=16.80, samples=475 iops : min= 1, max= 30, avg= 5.50, stdev= 4.25, samples=475 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6260KiB/276938msec); 0 zone resets clat (msec): min=29, max=1272, avg=139.87, stdev=80.96 lat (msec): min=29, max=1272, avg=139.88, stdev=80.96 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 159], 80.00th=[ 186], 90.00th=[ 241], 95.00th=[ 284], | 99.00th=[ 397], 99.50th=[ 502], 99.90th=[ 869], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 63, per=25.13%, avg=22.61, stdev=11.43, samples=532 iops : min= 1, max= 15, avg= 5.02, stdev= 2.91, samples=532 lat (msec) : 10=2.90%, 20=17.02%, 50=18.95%, 100=23.96%, 250=32.71% lat (msec) : 500=4.23%, 750=0.16%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.31%, ctx=5263, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144611: Tue Jul 28 03:32:27 2026 read: IOPS=5, BW=22.0KiB/s (22.6kB/s)(6052KiB/274460msec) clat (msec): min=6, max=425, avg=36.53, stdev=37.89 lat (msec): min=6, max=425, avg=36.54, stdev=37.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 115], | 99.00th=[ 184], 99.50th=[ 236], 99.90th=[ 368], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 119, per=29.20%, avg=25.12, stdev=17.37, samples=466 iops : min= 1, max= 29, avg= 5.66, stdev= 4.38, samples=466 write: IOPS=5, BW=22.7KiB/s (23.3kB/s)(6236KiB/274460msec); 0 zone resets clat (msec): min=41, max=1268, avg=140.34, stdev=81.33 lat (msec): min=41, max=1268, avg=140.34, stdev=81.33 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 188], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 405], 99.50th=[ 477], 99.90th=[ 877], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7, max= 48, per=25.30%, avg=22.77, stdev=10.95, samples=527 iops : min= 1, max= 12, avg= 5.07, stdev= 2.79, samples=527 lat (msec) : 10=2.73%, 20=18.16%, 50=18.88%, 100=24.51%, 250=31.71% lat (msec) : 500=3.78%, 750=0.13%, 1000=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.37%, ctx=5338, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=86.7KiB/s (88.8kB/s), 21.5KiB/s-22.0KiB/s (22.0kB/s-22.6kB/s), io=23.4MiB (24.6MB), run=274460-276938msec WRITE: bw=90.8KiB/s (92.0kB/s), 22.6KiB/s-22.0KiB/s (23.1kB/s-23.5kB/s), io=24.6MiB (25.7MB), run=274460-276938msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144670: Tue Jul 28 03:33:04 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5920KiB/27981msec) clat (usec): min=38, max=196474, avg=40207.26, stdev=32530.74 lat (usec): min=38, max=196476, avg=40208.70, stdev=32530.53 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 9896], | 30.00th=[ 22938], 40.00th=[ 30016], 50.00th=[ 34866], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[145753], 99.50th=[166724], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 62, max= 509, per=25.65%, avg=212.13, stdev=85.96, samples=55 iops : min= 3, max= 31, avg=12.53, stdev= 5.43, samples=55 write: IOPS=14, BW=228KiB/s (233kB/s)(6368KiB/27981msec); 0 zone resets clat (usec): min=1671, max=395024, avg=32309.55, stdev=40874.04 lat (usec): min=1672, max=395025, avg=32333.96, stdev=40880.20 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2073], 10.00th=[ 3195], 20.00th=[ 5342], | 30.00th=[ 7570], 40.00th=[ 12649], 50.00th=[ 19792], 60.00th=[ 27657], | 70.00th=[ 38536], 80.00th=[ 53740], 90.00th=[ 72877], 95.00th=[102237], | 99.00th=[250610], 99.50th=[270533], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 61, max= 412, per=26.21%, avg=228.04, stdev=86.27, samples=55 iops : min= 3, max= 25, avg=13.55, stdev= 5.50, samples=55 lat (usec) : 50=1.43%, 100=6.90%, 250=0.65%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.21%, 4=5.60%, 10=11.33%, 20=10.03%, 50=34.64% lat (msec) : 100=21.09%, 250=5.34%, 500=0.39% cpu : usr=0.08%, sys=5.83%, ctx=1491, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144671: Tue Jul 28 03:33:04 2026 read: IOPS=12, BW=199KiB/s (203kB/s)(5744KiB/28935msec) clat (usec): min=37, max=320997, avg=42797.21, stdev=31563.95 lat (usec): min=37, max=320998, avg=42801.30, stdev=31564.20 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 85], 20.00th=[ 20055], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 40633], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 63701], 90.00th=[ 79168], 95.00th=[ 90702], | 99.00th=[128451], 99.50th=[133694], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 380, per=24.36%, avg=201.43, stdev=74.81, samples=56 iops : min= 1, max= 23, avg=11.88, stdev= 4.75, samples=56 write: IOPS=14, BW=226KiB/s (232kB/s)(6544KiB/28935msec); 0 zone resets clat (usec): min=1193, max=307290, avg=32387.50, stdev=37378.96 lat (usec): min=1194, max=307295, avg=32393.09, stdev=37376.86 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1909], 10.00th=[ 2638], 20.00th=[ 4948], | 30.00th=[ 7177], 40.00th=[ 12125], 50.00th=[ 19268], 60.00th=[ 30016], | 70.00th=[ 39060], 80.00th=[ 56886], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[147850], 99.50th=[221250], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 63, max= 415, per=25.94%, avg=225.72, stdev=87.90, samples=57 iops : min= 3, max= 25, avg=13.40, stdev= 5.61, samples=57 lat (usec) : 50=0.52%, 100=4.69%, 250=0.91%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.26%, 4=5.34%, 10=10.68%, 20=10.16%, 50=35.03% lat (msec) : 100=24.48%, 250=3.78%, 500=0.39% cpu : usr=0.06%, sys=5.92%, ctx=1552, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144672: Tue Jul 28 03:33:04 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28173msec) clat (usec): min=38, max=447349, avg=44107.35, stdev=38112.61 lat (usec): min=38, max=447351, avg=44122.34, stdev=38103.73 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 62], 10.00th=[ 81], 20.00th=[ 20055], | 30.00th=[ 28181], 40.00th=[ 33424], 50.00th=[ 40633], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 66323], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[168821], 99.50th=[246416], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 63, max= 384, per=27.01%, avg=223.35, stdev=80.12, samples=55 iops : min= 3, max= 24, avg=13.25, stdev= 5.08, samples=55 write: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28173msec); 0 zone resets clat (usec): min=1368, max=215373, avg=28697.30, stdev=31585.35 lat (usec): min=1368, max=215376, avg=28702.66, stdev=31586.34 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1958], 10.00th=[ 2507], 20.00th=[ 4490], | 30.00th=[ 6980], 40.00th=[ 9896], 50.00th=[ 15533], 60.00th=[ 26084], | 70.00th=[ 37487], 80.00th=[ 52167], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[132645], 99.50th=[210764], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 60, max= 414, per=25.22%, avg=219.42, stdev=78.62, samples=53 iops : min= 3, max= 25, avg=13.00, stdev= 4.94, samples=53 lat (usec) : 50=0.78%, 100=5.60%, 250=0.65%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=6.64%, 10=10.94%, 20=8.46%, 50=35.68% lat (msec) : 100=24.48%, 250=3.52%, 500=0.13% cpu : usr=0.08%, sys=6.23%, ctx=1555, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144673: Tue Jul 28 03:33:04 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(6032KiB/27832msec) clat (usec): min=23, max=229660, avg=40305.96, stdev=35933.04 lat (usec): min=23, max=229662, avg=40307.83, stdev=35932.41 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 65], 20.00th=[ 137], | 30.00th=[ 24249], 40.00th=[ 29230], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[189793], 99.50th=[196084], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 62, max= 414, per=26.13%, avg=216.05, stdev=87.52, samples=55 iops : min= 3, max= 25, avg=12.78, stdev= 5.48, samples=55 write: IOPS=14, BW=225KiB/s (230kB/s)(6256KiB/27832msec); 0 zone resets clat (usec): min=1360, max=268268, avg=31670.89, stdev=35941.67 lat (usec): min=1362, max=268271, avg=31673.95, stdev=35941.43 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1909], 10.00th=[ 2606], 20.00th=[ 4686], | 30.00th=[ 7898], 40.00th=[ 11600], 50.00th=[ 19268], 60.00th=[ 28181], | 70.00th=[ 36963], 80.00th=[ 52167], 90.00th=[ 77071], 95.00th=[104334], | 99.00th=[162530], 99.50th=[204473], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 63, max= 576, per=25.84%, avg=224.78, stdev=100.29, samples=55 iops : min= 3, max= 36, avg=13.33, stdev= 6.40, samples=55 lat (usec) : 50=1.04%, 100=7.81%, 250=1.30%, 500=0.26%, 750=0.13% lat (msec) : 2=3.26%, 4=6.12%, 10=10.03%, 20=8.33%, 50=35.42% lat (msec) : 100=20.96%, 250=5.21%, 500=0.13% cpu : usr=0.10%, sys=5.77%, ctx=1477, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=828KiB/s (848kB/s), 199KiB/s-222KiB/s (203kB/s-227kB/s), io=23.4MiB (24.5MB), run=27832-28935msec WRITE: bw=871KiB/s (892kB/s), 214KiB/s-228KiB/s (219kB/s-233kB/s), io=24.6MiB (25.8MB), run=27832-28935msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144674: Tue Jul 28 03:33:41 2026 read: IOPS=5, BW=91.4KiB/s (93.6kB/s)(5920KiB/64772msec) clat (msec): min=8, max=358, avg=38.41, stdev=37.63 lat (msec): min=8, max=358, avg=38.41, stdev=37.63 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 83], 95.00th=[ 114], | 99.00th=[ 167], 99.50th=[ 251], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 30, max= 352, per=26.34%, avg=95.89, stdev=61.82, samples=120 iops : min= 1, max= 22, avg= 5.28, stdev= 3.91, samples=120 write: IOPS=6, BW=98.3KiB/s (101kB/s)(6368KiB/64772msec); 0 zone resets clat (msec): min=45, max=473, avg=126.28, stdev=58.83 lat (msec): min=45, max=473, avg=126.29, stdev=58.83 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 70], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 142], 80.00th=[ 163], 90.00th=[ 213], 95.00th=[ 251], | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 22, max= 192, per=25.81%, avg=98.85, stdev=43.70, samples=126 iops : min= 1, max= 12, avg= 5.46, stdev= 2.74, samples=126 lat (msec) : 10=1.04%, 20=13.93%, 50=24.61%, 100=27.08%, 250=30.47% lat (msec) : 500=2.86% cpu : usr=0.05%, sys=1.55%, ctx=1353, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144675: Tue Jul 28 03:33:41 2026 read: IOPS=5, BW=87.5KiB/s (89.6kB/s)(5744KiB/65679msec) clat (msec): min=5, max=334, avg=37.56, stdev=41.14 lat (msec): min=5, max=334, avg=37.56, stdev=41.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 77], 95.00th=[ 116], | 99.00th=[ 230], 99.50th=[ 266], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 22, max= 383, per=27.29%, avg=99.35, stdev=67.61, samples=113 iops : min= 1, max= 23, avg= 5.50, stdev= 4.25, samples=113 write: IOPS=6, BW=99.6KiB/s (102kB/s)(6544KiB/65679msec); 0 zone resets clat (msec): min=31, max=468, avg=126.56, stdev=61.77 lat (msec): min=31, max=468, avg=126.57, stdev=61.77 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 78], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 211], 95.00th=[ 255], | 99.00th=[ 359], 99.50th=[ 372], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 22, max= 191, per=26.05%, avg=99.79, stdev=46.26, samples=128 iops : min= 1, max= 11, avg= 5.52, stdev= 2.87, samples=128 lat (msec) : 10=1.56%, 20=13.93%, 50=23.70%, 100=25.52%, 250=32.16% lat (msec) : 500=3.12% cpu : usr=0.05%, sys=1.48%, ctx=1371, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144676: Tue Jul 28 03:33:41 2026 read: IOPS=6, BW=99.7KiB/s (102kB/s)(6256KiB/62740msec) clat (msec): min=7, max=295, avg=35.67, stdev=32.90 lat (msec): min=7, max=295, avg=35.67, stdev=32.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 72], 95.00th=[ 105], | 99.00th=[ 171], 99.50th=[ 182], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 349, per=29.16%, avg=106.16, stdev=72.31, samples=116 iops : min= 1, max= 21, avg= 5.91, stdev= 4.58, samples=116 write: IOPS=6, BW=96.1KiB/s (98.5kB/s)(6032KiB/62740msec); 0 zone resets clat (msec): min=49, max=528, avg=129.12, stdev=61.04 lat (msec): min=49, max=528, avg=129.12, stdev=61.04 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 103], 50.00th=[ 113], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 167], 90.00th=[ 194], 95.00th=[ 232], | 99.00th=[ 409], 99.50th=[ 468], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 30, max= 190, per=24.90%, avg=95.38, stdev=39.46, samples=123 iops : min= 1, max= 11, avg= 5.24, stdev= 2.53, samples=123 lat (msec) : 10=1.30%, 20=17.19%, 50=23.57%, 100=23.70%, 250=32.55% lat (msec) : 500=1.56%, 750=0.13% cpu : usr=0.05%, sys=1.52%, ctx=1288, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144677: Tue Jul 28 03:33:41 2026 read: IOPS=5, BW=92.7KiB/s (94.9kB/s)(6032KiB/65085msec) clat (msec): min=6, max=465, avg=38.25, stdev=47.17 lat (msec): min=6, max=465, avg=38.26, stdev=47.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 74], 95.00th=[ 127], | 99.00th=[ 215], 99.50th=[ 435], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 31, max= 288, per=29.04%, avg=105.72, stdev=69.28, samples=111 iops : min= 1, max= 18, avg= 5.88, stdev= 4.42, samples=111 write: IOPS=6, BW=96.1KiB/s (98.4kB/s)(6256KiB/65085msec); 0 zone resets clat (msec): min=44, max=578, avg=128.76, stdev=61.93 lat (msec): min=44, max=578, avg=128.77, stdev=61.93 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 74], 20.00th=[ 83], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 124], | 70.00th=[ 142], 80.00th=[ 163], 90.00th=[ 203], 95.00th=[ 251], | 99.00th=[ 380], 99.50th=[ 405], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 22, max= 192, per=25.22%, avg=96.57, stdev=42.60, samples=127 iops : min= 1, max= 12, avg= 5.31, stdev= 2.67, samples=127 lat (msec) : 10=1.95%, 20=17.19%, 50=21.61%, 100=23.70%, 250=32.55% lat (msec) : 500=2.86%, 750=0.13% cpu : usr=0.05%, sys=1.63%, ctx=1438, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=365KiB/s (373kB/s), 87.5KiB/s-99.7KiB/s (89.6kB/s-102kB/s), io=23.4MiB (24.5MB), run=62740-65679msec WRITE: bw=384KiB/s (393kB/s), 96.1KiB/s-99.6KiB/s (98.4kB/s-102kB/s), io=24.6MiB (25.8MB), run=62740-65679msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144707: Tue Jul 28 03:33:55 2026 read: IOPS=1, BW=1901KiB/s (1947kB/s)(7168KiB/3770msec) clat (msec): min=59, max=309, avg=171.81, stdev=89.69 lat (msec): min=59, max=309, avg=171.81, stdev=89.69 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 110], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 148], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 262], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 2031, max= 5873, per=85.62%, avg=3849.33, stdev=1929.21, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1358KiB/s (1391kB/s)(5120KiB/3770msec); 0 zone resets clat (msec): min=243, max=749, avg=506.84, stdev=190.36 lat (msec): min=244, max=749, avg=506.93, stdev=190.36 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1822, max= 2031, per=31.41%, avg=1976.75, stdev=103.18, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=4.38%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144708: Tue Jul 28 03:33:55 2026 read: IOPS=0, BW=450KiB/s (460kB/s)(2048KiB/4555msec) clat (msec): min=75, max=208, avg=141.54, stdev=94.04 lat (msec): min=75, max=208, avg=141.54, stdev=94.04 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 75], 50.00th=[ 75], 60.00th=[ 209], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 209], 95.00th=[ 209], | 99.00th=[ 209], 99.50th=[ 209], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 2027, max= 2043, per=45.26%, avg=2035.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2248KiB/s (2302kB/s)(10.0MiB/4555msec); 0 zone resets clat (msec): min=154, max=597, avg=407.14, stdev=159.22 lat (msec): min=155, max=597, avg=407.25, stdev=159.24 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 234], | 30.00th=[ 288], 40.00th=[ 300], 50.00th=[ 351], 60.00th=[ 506], | 70.00th=[ 542], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2027, max= 3644, per=36.65%, avg=2306.83, stdev=655.13, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=41.67% cpu : usr=0.00%, sys=4.15%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144709: Tue Jul 28 03:33:55 2026 read: IOPS=1, BW=1625KiB/s (1664kB/s)(6144KiB/3782msec) clat (msec): min=80, max=237, avg=142.44, stdev=58.22 lat (msec): min=80, max=237, avg=142.44, stdev=58.22 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 138], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 2043, max= 4096, per=75.64%, avg=3400.67, stdev=1175.89, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1625KiB/s (1664kB/s)(6144KiB/3782msec); 0 zone resets clat (msec): min=213, max=873, avg=471.23, stdev=289.16 lat (msec): min=213, max=873, avg=471.36, stdev=289.21 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 368], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1389, max= 2048, per=30.37%, avg=1911.80, stdev=292.34, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 1000=16.67% cpu : usr=0.05%, sys=3.99%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144710: Tue Jul 28 03:33:55 2026 read: IOPS=1, BW=1142KiB/s (1170kB/s)(5120KiB/4483msec) clat (msec): min=104, max=375, avg=215.55, stdev=116.15 lat (msec): min=104, max=375, avg=215.55, stdev=116.15 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2031, max= 4055, per=60.31%, avg=2711.33, stdev=1163.68, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1599KiB/s (1637kB/s)(7168KiB/4483msec); 0 zone resets clat (msec): min=227, max=848, avg=459.87, stdev=220.94 lat (msec): min=227, max=848, avg=459.97, stdev=220.95 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 300], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 355], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 625], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1822, max= 4087, per=38.12%, avg=2399.00, stdev=947.95, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=5.35%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4496KiB/s (4604kB/s), 450KiB/s-1901KiB/s (460kB/s-1947kB/s), io=20.0MiB (20.0MB), run=3770-4555msec WRITE: bw=6295KiB/s (6446kB/s), 1358KiB/s-2248KiB/s (1391kB/s-2302kB/s), io=28.0MiB (29.4MB), run=3770-4555msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144712: Tue Jul 28 03:33:55 2026 read: IOPS=1, BW=1899KiB/s (1945kB/s)(7168KiB/3774msec) clat (usec): min=712, max=358043, avg=188150.30, stdev=115348.28 lat (usec): min=713, max=358044, avg=188152.07, stdev=115348.29 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[107480], | 30.00th=[149947], 40.00th=[149947], 50.00th=[210764], 60.00th=[223347], | 70.00th=[223347], 80.00th=[265290], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 2023, max= 4079, per=68.17%, avg=3043.25, stdev=1163.92, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1357KiB/s (1389kB/s)(5120KiB/3774msec); 0 zone resets clat (msec): min=150, max=762, avg=459.23, stdev=226.77 lat (msec): min=150, max=762, avg=459.32, stdev=226.78 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1872, max= 3938, per=41.51%, avg=2594.33, stdev=1164.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=14.68%, ctx=207, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144713: Tue Jul 28 03:33:55 2026 read: IOPS=0, BW=446KiB/s (457kB/s)(2048KiB/4587msec) clat (usec): min=963, max=250542, avg=125752.90, stdev=176479.43 lat (usec): min=964, max=250545, avg=125755.28, stdev=176480.40 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 963], 10.00th=[ 963], 20.00th=[ 963], | 30.00th=[ 963], 40.00th=[ 963], 50.00th=[ 963], 60.00th=[250610], | 70.00th=[250610], 80.00th=[250610], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 1818, max= 1969, per=42.42%, avg=1893.50, stdev=106.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2232KiB/s (2286kB/s)(10.0MiB/4587msec); 0 zone resets clat (msec): min=123, max=862, avg=416.78, stdev=219.57 lat (msec): min=123, max=862, avg=416.98, stdev=219.51 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 171], | 30.00th=[ 284], 40.00th=[ 300], 50.00th=[ 380], 60.00th=[ 443], | 70.00th=[ 451], 80.00th=[ 550], 90.00th=[ 609], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1872, max= 4079, per=36.55%, avg=2284.43, stdev=793.51, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (usec) : 1000=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=11.86%, ctx=113, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144714: Tue Jul 28 03:33:55 2026 read: IOPS=1, BW=1529KiB/s (1566kB/s)(6144KiB/4018msec) clat (usec): min=458, max=234951, avg=120147.00, stdev=97092.33 lat (usec): min=459, max=234953, avg=120148.27, stdev=97092.48 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 1795], | 30.00th=[ 1795], 40.00th=[141558], 50.00th=[141558], 60.00th=[166724], | 70.00th=[175113], 80.00th=[175113], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 1973, max= 3938, per=55.99%, avg=2499.50, stdev=959.58, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1529KiB/s (1566kB/s)(6144KiB/4018msec); 0 zone resets clat (msec): min=277, max=809, avg=537.52, stdev=200.79 lat (msec): min=277, max=809, avg=537.62, stdev=200.80 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 535], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1872, max= 2048, per=31.82%, avg=1988.60, stdev=71.43, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=11.48%, ctx=245, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144715: Tue Jul 28 03:33:55 2026 read: IOPS=1, BW=1349KiB/s (1382kB/s)(5120KiB/3794msec) clat (usec): min=1579, max=279722, avg=167599.82, stdev=101410.82 lat (usec): min=1581, max=279724, avg=167601.47, stdev=101410.87 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1582], 10.00th=[ 1582], 20.00th=[ 1582], | 30.00th=[181404], 40.00th=[181404], 50.00th=[185598], 60.00th=[185598], | 70.00th=[189793], 80.00th=[189793], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1973, max= 5907, per=88.26%, avg=3940.00, stdev=2781.76, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1889KiB/s (1935kB/s)(7168KiB/3794msec); 0 zone resets clat (msec): min=83, max=921, avg=392.37, stdev=286.25 lat (msec): min=83, max=921, avg=392.45, stdev=286.25 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 174], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 330], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 617], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1872, max= 6144, per=44.83%, avg=2801.60, stdev=1869.42, samples=5 iops : min= 1, max= 6, avg= 2.00, stdev= 2.24, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=13.08%, ctx=174, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4465KiB/s (4572kB/s), 446KiB/s-1899KiB/s (457kB/s-1945kB/s), io=20.0MiB (20.0MB), run=3774-4587msec WRITE: bw=6251KiB/s (6401kB/s), 1357KiB/s-2232KiB/s (1389kB/s-2286kB/s), io=28.0MiB (29.4MB), run=3774-4587msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144723: Tue Jul 28 03:34:06 2026 read: IOPS=1, BW=4379KiB/s (4484kB/s)(12.0MiB/2806msec) clat (msec): min=859, max=888, avg=873.38, stdev=14.08 lat (msec): min=859, max=888, avg=873.39, stdev=14.08 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=14.47%, ctx=488, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144724: Tue Jul 28 03:34:06 2026 read: IOPS=0, BW=1422KiB/s (1456kB/s)(4096KiB/2880msec) clat (nsec): min=891373k, max=891373k, avg=891373024.00, stdev= 0.00 lat (nsec): min=891374k, max=891374k, avg=891374191.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2844KiB/s (2913kB/s)(8192KiB/2880msec); 0 zone resets clat (msec): min=388, max=1441, avg=915.17, stdev=744.78 lat (msec): min=389, max=1442, avg=915.63, stdev=744.66 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8159, max= 8159, per=81.65%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.14%, sys=3.96%, ctx=117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144725: Tue Jul 28 03:34:06 2026 write: IOPS=0, BW=3747KiB/s (3837kB/s)(12.0MiB/3279msec); 0 zone resets clat (msec): min=671, max=1251, avg=1036.12, stdev=317.17 lat (msec): min=673, max=1254, avg=1037.85, stdev=317.55 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8175, max= 8192, per=81.89%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.64%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144726: Tue Jul 28 03:34:06 2026 write: IOPS=1, BW=4331KiB/s (4435kB/s)(12.0MiB/2837msec); 0 zone resets clat (msec): min=425, max=1691, avg=882.06, stdev=703.25 lat (msec): min=425, max=1695, avg=885.48, stdev=703.73 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 5610, max= 8175, per=68.97%, avg=6892.50, stdev=1813.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.15%, ctx=56, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5689KiB/s (5825kB/s), 1422KiB/s-4379KiB/s (1456kB/s-4484kB/s), io=16.0MiB (16.8MB), run=2806-2880msec WRITE: bw=9993KiB/s (10.2MB/s), 2844KiB/s-4331KiB/s (2913kB/s-4435kB/s), io=32.0MiB (33.6MB), run=2837-3279msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144727: Tue Jul 28 03:34:06 2026 read: IOPS=0, BW=3994KiB/s (4089kB/s)(12.0MiB/3077msec) clat (msec): min=316, max=1609, avg=1001.48, stdev=649.98 lat (msec): min=316, max=1609, avg=1001.48, stdev=649.98 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.87%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144728: Tue Jul 28 03:34:06 2026 read: IOPS=0, BW=1259KiB/s (1289kB/s)(4096KiB/3253msec) clat (nsec): min=1526.9M, max=1526.9M, avg=1526947803.00, stdev= 0.00 lat (nsec): min=1526.9M, max=1526.9M, avg=1526950624.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1536], 5.00th=[ 1536], 10.00th=[ 1536], 20.00th=[ 1536], | 30.00th=[ 1536], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2518KiB/s (2579kB/s)(8192KiB/3253msec); 0 zone resets clat (msec): min=691, max=908, avg=800.03, stdev=153.80 lat (msec): min=691, max=909, avg=800.47, stdev=153.86 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8175, max= 8175, per=83.16%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=4.00%, ctx=46, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144729: Tue Jul 28 03:34:06 2026 write: IOPS=0, BW=3687KiB/s (3775kB/s)(12.0MiB/3333msec); 0 zone resets clat (msec): min=334, max=1947, avg=1059.84, stdev=818.76 lat (msec): min=334, max=1948, avg=1060.29, stdev=818.77 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1955], 80.00th=[ 1955], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 8126, max= 8159, per=82.82%, avg=8142.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.79%, ctx=53, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144730: Tue Jul 28 03:34:06 2026 write: IOPS=1, BW=4213KiB/s (4314kB/s)(12.0MiB/2917msec); 0 zone resets clat (msec): min=694, max=1071, avg=928.93, stdev=204.44 lat (msec): min=696, max=1072, avg=929.83, stdev=203.85 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8047, max= 8110, per=82.17%, avg=8078.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=6.48%, ctx=60, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5037KiB/s (5157kB/s), 1259KiB/s-3994KiB/s (1289kB/s-4089kB/s), io=16.0MiB (16.8MB), run=3077-3253msec WRITE: bw=9831KiB/s (10.1MB/s), 2518KiB/s-4213KiB/s (2579kB/s-4314kB/s), io=32.0MiB (33.6MB), run=2917-3333msec